[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:57:49.408980   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:37363
I20260709 12:57:49.410491   431 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:57:49.411499   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:57:49.432190   440 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:49.432485   437 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:49.434612   431 server_base.cc:1061] running on GCE node
W20260709 12:57:49.433240   438 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:50.642354   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:57:50.642634   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:57:50.642845   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601870642823 us; error 0 us; skew 500 ppm
I20260709 12:57:50.643698   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:57:50.650084   431 webserver.cc:533] Webserver started at http://127.0.107.254:45759/ using document root <none> and password file <none>
I20260709 12:57:50.650964   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:57:50.651199   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:57:50.651655   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:57:50.657838   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601869227091-431-0/minicluster-data/master-0-root/instance:
uuid: "856e372ba0d841768d1bef2f847f7091"
format_stamp: "Formatted at 2026-07-09 12:57:50 on dist-test-slave-5mzn"
I20260709 12:57:50.665846   431 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:57:50.671499   446 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:50.673398   431 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.002s	sys 0.000s
I20260709 12:57:50.673832   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601869227091-431-0/minicluster-data/master-0-root
uuid: "856e372ba0d841768d1bef2f847f7091"
format_stamp: "Formatted at 2026-07-09 12:57:50 on dist-test-slave-5mzn"
I20260709 12:57:50.674243   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601869227091-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601869227091-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601869227091-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:57:50.739045   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:57:50.740731   431 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:57:50.741256   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:57:50.825157   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:37363
I20260709 12:57:50.825372   497 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:37363 every 8 connection(s)
I20260709 12:57:50.833561   498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:50.855559   498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 856e372ba0d841768d1bef2f847f7091: Bootstrap starting.
I20260709 12:57:50.861768   498 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 856e372ba0d841768d1bef2f847f7091: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:50.863477   498 log.cc:826] T 00000000000000000000000000000000 P 856e372ba0d841768d1bef2f847f7091: Log is configured to *not* fsync() on all Append() calls
I20260709 12:57:50.868124   498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 856e372ba0d841768d1bef2f847f7091: No bootstrap required, opened a new log
I20260709 12:57:50.889160   498 raft_consensus.cc:359] T 00000000000000000000000000000000 P 856e372ba0d841768d1bef2f847f7091 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "856e372ba0d841768d1bef2f847f7091" member_type: VOTER }
I20260709 12:57:50.889832   498 raft_consensus.cc:385] T 00000000000000000000000000000000 P 856e372ba0d841768d1bef2f847f7091 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:50.890036   498 raft_consensus.cc:740] T 00000000000000000000000000000000 P 856e372ba0d841768d1bef2f847f7091 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 856e372ba0d841768d1bef2f847f7091, State: Initialized, Role: FOLLOWER
I20260709 12:57:50.890839   498 consensus_queue.cc:260] T 00000000000000000000000000000000 P 856e372ba0d841768d1bef2f847f7091 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "856e372ba0d841768d1bef2f847f7091" member_type: VOTER }
I20260709 12:57:50.891283   498 raft_consensus.cc:399] T 00000000000000000000000000000000 P 856e372ba0d841768d1bef2f847f7091 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:57:50.891527   498 raft_consensus.cc:493] T 00000000000000000000000000000000 P 856e372ba0d841768d1bef2f847f7091 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:57:50.891810   498 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 856e372ba0d841768d1bef2f847f7091 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:50.896178   498 raft_consensus.cc:515] T 00000000000000000000000000000000 P 856e372ba0d841768d1bef2f847f7091 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "856e372ba0d841768d1bef2f847f7091" member_type: VOTER }
I20260709 12:57:50.896863   498 leader_election.cc:304] T 00000000000000000000000000000000 P 856e372ba0d841768d1bef2f847f7091 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 856e372ba0d841768d1bef2f847f7091; no voters: 
I20260709 12:57:50.898825   498 leader_election.cc:290] T 00000000000000000000000000000000 P 856e372ba0d841768d1bef2f847f7091 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:57:50.899164   501 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 856e372ba0d841768d1bef2f847f7091 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:50.901711   501 raft_consensus.cc:697] T 00000000000000000000000000000000 P 856e372ba0d841768d1bef2f847f7091 [term 1 LEADER]: Becoming Leader. State: Replica: 856e372ba0d841768d1bef2f847f7091, State: Running, Role: LEADER
I20260709 12:57:50.902660   501 consensus_queue.cc:237] T 00000000000000000000000000000000 P 856e372ba0d841768d1bef2f847f7091 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "856e372ba0d841768d1bef2f847f7091" member_type: VOTER }
I20260709 12:57:50.903716   498 sys_catalog.cc:565] T 00000000000000000000000000000000 P 856e372ba0d841768d1bef2f847f7091 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:57:50.915944   503 sys_catalog.cc:455] T 00000000000000000000000000000000 P 856e372ba0d841768d1bef2f847f7091 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 856e372ba0d841768d1bef2f847f7091. Latest consensus state: current_term: 1 leader_uuid: "856e372ba0d841768d1bef2f847f7091" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "856e372ba0d841768d1bef2f847f7091" member_type: VOTER } }
I20260709 12:57:50.916236   502 sys_catalog.cc:455] T 00000000000000000000000000000000 P 856e372ba0d841768d1bef2f847f7091 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "856e372ba0d841768d1bef2f847f7091" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "856e372ba0d841768d1bef2f847f7091" member_type: VOTER } }
I20260709 12:57:50.916744   503 sys_catalog.cc:458] T 00000000000000000000000000000000 P 856e372ba0d841768d1bef2f847f7091 [sys.catalog]: This master's current role is: LEADER
I20260709 12:57:50.916744   502 sys_catalog.cc:458] T 00000000000000000000000000000000 P 856e372ba0d841768d1bef2f847f7091 [sys.catalog]: This master's current role is: LEADER
I20260709 12:57:50.920883   511 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:57:50.933598   511 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:57:50.936213   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:57:50.952122   511 catalog_manager.cc:1383] Generated new cluster ID: 891ebf3d961c420aad978915ffb4fb46
I20260709 12:57:50.952440   511 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:57:50.969286   511 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:57:50.970892   511 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:57:50.991554   511 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 856e372ba0d841768d1bef2f847f7091: Generated new TSK 0
I20260709 12:57:50.992504   511 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:57:51.003016   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:57:51.013754   520 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:51.016103   521 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:51.022725   431 server_base.cc:1061] running on GCE node
W20260709 12:57:51.023113   523 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:51.024006   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:57:51.024226   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:57:51.024415   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601871024398 us; error 0 us; skew 500 ppm
I20260709 12:57:51.025110   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:57:51.029935   431 webserver.cc:533] Webserver started at http://127.0.107.193:32985/ using document root <none> and password file <none>
I20260709 12:57:51.030462   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:57:51.030676   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:57:51.030961   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:57:51.032047   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601869227091-431-0/minicluster-data/ts-0-root/instance:
uuid: "40919529b3d6492d82e76f9cb44e6542"
format_stamp: "Formatted at 2026-07-09 12:57:51 on dist-test-slave-5mzn"
I20260709 12:57:51.038152   431 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.000s	sys 0.005s
I20260709 12:57:51.043028   528 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:51.043882   431 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:57:51.044184   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601869227091-431-0/minicluster-data/ts-0-root
uuid: "40919529b3d6492d82e76f9cb44e6542"
format_stamp: "Formatted at 2026-07-09 12:57:51 on dist-test-slave-5mzn"
I20260709 12:57:51.044493   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601869227091-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601869227091-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601869227091-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:57:51.070600   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:57:51.072079   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:57:51.074811   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:57:51.079985   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:57:51.080202   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:51.080569   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:57:51.080770   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.001s
I20260709 12:57:51.196360   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:34223
I20260709 12:57:51.196434   590 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:34223 every 8 connection(s)
I20260709 12:57:51.204252   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:57:51.223570   595 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:51.225391   596 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:51.235589   431 server_base.cc:1061] running on GCE node
W20260709 12:57:51.235539   598 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:51.237205   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:57:51.237406   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:57:51.237528   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601871237515 us; error 0 us; skew 500 ppm
I20260709 12:57:51.238036   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:57:51.241381   431 webserver.cc:533] Webserver started at http://127.0.107.194:33133/ using document root <none> and password file <none>
I20260709 12:57:51.241920   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:57:51.242142   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:57:51.242455   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:57:51.243548   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601869227091-431-0/minicluster-data/ts-1-root/instance:
uuid: "833e299675134d28bcc13d2c73b996a6"
format_stamp: "Formatted at 2026-07-09 12:57:51 on dist-test-slave-5mzn"
I20260709 12:57:51.244181   591 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37363
I20260709 12:57:51.244684   591 heartbeater.cc:461] Registering TS with master...
I20260709 12:57:51.245841   591 heartbeater.cc:507] Master 127.0.107.254:37363 requested a full tablet report, sending...
I20260709 12:57:51.249712   463 ts_manager.cc:194] Registered new tserver with Master: 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193:34223)
I20260709 12:57:51.250180   431 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.003s	sys 0.005s
I20260709 12:57:51.252758   463 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35954
I20260709 12:57:51.254998   603 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:51.257066   431 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:57:51.257467   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601869227091-431-0/minicluster-data/ts-1-root
uuid: "833e299675134d28bcc13d2c73b996a6"
format_stamp: "Formatted at 2026-07-09 12:57:51 on dist-test-slave-5mzn"
I20260709 12:57:51.257818   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601869227091-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601869227091-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601869227091-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:57:51.287297   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:57:51.289004   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:57:51.291846   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:57:51.295913   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:57:51.296193   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:51.296490   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:57:51.296717   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:57:51.392544   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:39403
I20260709 12:57:51.392795   665 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:39403 every 8 connection(s)
I20260709 12:57:51.399916   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:57:51.409417   669 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:57:51.413733   670 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:51.416162   666 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37363
I20260709 12:57:51.416564   666 heartbeater.cc:461] Registering TS with master...
I20260709 12:57:51.417742   666 heartbeater.cc:507] Master 127.0.107.254:37363 requested a full tablet report, sending...
I20260709 12:57:51.419963   463 ts_manager.cc:194] Registered new tserver with Master: 833e299675134d28bcc13d2c73b996a6 (127.0.107.194:39403)
I20260709 12:57:51.421669   463 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35970
I20260709 12:57:51.427110   431 server_base.cc:1061] running on GCE node
W20260709 12:57:51.427069   672 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:57:51.428251   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:57:51.428556   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:57:51.428762   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601871428745 us; error 0 us; skew 500 ppm
I20260709 12:57:51.429325   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:57:51.431767   431 webserver.cc:533] Webserver started at http://127.0.107.195:45353/ using document root <none> and password file <none>
I20260709 12:57:51.432228   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:57:51.432440   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:57:51.432752   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:57:51.433854   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601869227091-431-0/minicluster-data/ts-2-root/instance:
uuid: "d7fcf132cb774583bd7967a84b418048"
format_stamp: "Formatted at 2026-07-09 12:57:51 on dist-test-slave-5mzn"
I20260709 12:57:51.438889   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:57:51.442193   677 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:51.442989   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:57:51.443276   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601869227091-431-0/minicluster-data/ts-2-root
uuid: "d7fcf132cb774583bd7967a84b418048"
format_stamp: "Formatted at 2026-07-09 12:57:51 on dist-test-slave-5mzn"
I20260709 12:57:51.443583   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601869227091-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601869227091-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783601869227091-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:57:51.466997   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:57:51.468708   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:57:51.470714   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:57:51.474516   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:57:51.474742   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:51.474985   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:57:51.475157   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:57:51.574846   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:42711
I20260709 12:57:51.575007   739 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:42711 every 8 connection(s)
I20260709 12:57:51.593077   740 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37363
I20260709 12:57:51.593456   740 heartbeater.cc:461] Registering TS with master...
I20260709 12:57:51.594209   740 heartbeater.cc:507] Master 127.0.107.254:37363 requested a full tablet report, sending...
I20260709 12:57:51.596129   463 ts_manager.cc:194] Registered new tserver with Master: d7fcf132cb774583bd7967a84b418048 (127.0.107.195:42711)
I20260709 12:57:51.596338   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016386553s
I20260709 12:57:51.597515   463 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35986
I20260709 12:57:51.655643   463 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35988:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:57:51.659586   463 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:57:51.774631   631 tablet_service.cc:1511] Processing CreateTablet for tablet 8e1e26ad8acd4644857773d9c53d3ff2 (DEFAULT_TABLE table=test-workload [id=b49a1e65a32646a0a52da7e5948a15ca]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:57:51.774893   629 tablet_service.cc:1511] Processing CreateTablet for tablet ba302d819a4c420b861764d4a6b5fed2 (DEFAULT_TABLE table=test-workload [id=b49a1e65a32646a0a52da7e5948a15ca]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:57:51.786976   629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba302d819a4c420b861764d4a6b5fed2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.787374   627 tablet_service.cc:1511] Processing CreateTablet for tablet bd75112d105d4b269b9a7b422866104f (DEFAULT_TABLE table=test-workload [id=b49a1e65a32646a0a52da7e5948a15ca]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:57:51.788280   703 tablet_service.cc:1511] Processing CreateTablet for tablet ba302d819a4c420b861764d4a6b5fed2 (DEFAULT_TABLE table=test-workload [id=b49a1e65a32646a0a52da7e5948a15ca]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:57:51.789002   705 tablet_service.cc:1511] Processing CreateTablet for tablet 8e1e26ad8acd4644857773d9c53d3ff2 (DEFAULT_TABLE table=test-workload [id=b49a1e65a32646a0a52da7e5948a15ca]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:57:51.796438   631 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e1e26ad8acd4644857773d9c53d3ff2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.796381   630 tablet_service.cc:1511] Processing CreateTablet for tablet 741777b7834d4f5e80bd0187702907dc (DEFAULT_TABLE table=test-workload [id=b49a1e65a32646a0a52da7e5948a15ca]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:57:51.798940   627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd75112d105d4b269b9a7b422866104f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.795984   703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba302d819a4c420b861764d4a6b5fed2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.794229   628 tablet_service.cc:1511] Processing CreateTablet for tablet ecf93bacf15045e3bbfc2b0d7c51dbd8 (DEFAULT_TABLE table=test-workload [id=b49a1e65a32646a0a52da7e5948a15ca]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:57:51.795131   704 tablet_service.cc:1511] Processing CreateTablet for tablet 741777b7834d4f5e80bd0187702907dc (DEFAULT_TABLE table=test-workload [id=b49a1e65a32646a0a52da7e5948a15ca]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:57:51.796479   625 tablet_service.cc:1511] Processing CreateTablet for tablet c48ae3b2d706406fad9295ac2ecdd688 (DEFAULT_TABLE table=test-workload [id=b49a1e65a32646a0a52da7e5948a15ca]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:57:51.809044   626 tablet_service.cc:1511] Processing CreateTablet for tablet 3b933fbc94f143caae7395db46bfa15c (DEFAULT_TABLE table=test-workload [id=b49a1e65a32646a0a52da7e5948a15ca]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:57:51.816031   705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e1e26ad8acd4644857773d9c53d3ff2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.816434   701 tablet_service.cc:1511] Processing CreateTablet for tablet bd75112d105d4b269b9a7b422866104f (DEFAULT_TABLE table=test-workload [id=b49a1e65a32646a0a52da7e5948a15ca]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:57:51.814926   624 tablet_service.cc:1511] Processing CreateTablet for tablet d3bc6327504f44dab50a3f1663e18ef4 (DEFAULT_TABLE table=test-workload [id=b49a1e65a32646a0a52da7e5948a15ca]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:57:51.809180   700 tablet_service.cc:1511] Processing CreateTablet for tablet 3b933fbc94f143caae7395db46bfa15c (DEFAULT_TABLE table=test-workload [id=b49a1e65a32646a0a52da7e5948a15ca]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:57:51.819613   630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 741777b7834d4f5e80bd0187702907dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.809588   702 tablet_service.cc:1511] Processing CreateTablet for tablet ecf93bacf15045e3bbfc2b0d7c51dbd8 (DEFAULT_TABLE table=test-workload [id=b49a1e65a32646a0a52da7e5948a15ca]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:57:51.828068   556 tablet_service.cc:1511] Processing CreateTablet for tablet 8e1e26ad8acd4644857773d9c53d3ff2 (DEFAULT_TABLE table=test-workload [id=b49a1e65a32646a0a52da7e5948a15ca]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:57:51.827035   699 tablet_service.cc:1511] Processing CreateTablet for tablet c48ae3b2d706406fad9295ac2ecdd688 (DEFAULT_TABLE table=test-workload [id=b49a1e65a32646a0a52da7e5948a15ca]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:57:51.831200   704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 741777b7834d4f5e80bd0187702907dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.832383   701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd75112d105d4b269b9a7b422866104f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.833082   626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b933fbc94f143caae7395db46bfa15c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.830133   552 tablet_service.cc:1511] Processing CreateTablet for tablet bd75112d105d4b269b9a7b422866104f (DEFAULT_TABLE table=test-workload [id=b49a1e65a32646a0a52da7e5948a15ca]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:57:51.824420   555 tablet_service.cc:1511] Processing CreateTablet for tablet 741777b7834d4f5e80bd0187702907dc (DEFAULT_TABLE table=test-workload [id=b49a1e65a32646a0a52da7e5948a15ca]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:57:51.839134   551 tablet_service.cc:1511] Processing CreateTablet for tablet 3b933fbc94f143caae7395db46bfa15c (DEFAULT_TABLE table=test-workload [id=b49a1e65a32646a0a52da7e5948a15ca]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:57:51.842273   700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b933fbc94f143caae7395db46bfa15c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.841081   698 tablet_service.cc:1511] Processing CreateTablet for tablet d3bc6327504f44dab50a3f1663e18ef4 (DEFAULT_TABLE table=test-workload [id=b49a1e65a32646a0a52da7e5948a15ca]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:57:51.845021   553 tablet_service.cc:1511] Processing CreateTablet for tablet ecf93bacf15045e3bbfc2b0d7c51dbd8 (DEFAULT_TABLE table=test-workload [id=b49a1e65a32646a0a52da7e5948a15ca]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:57:51.845112   554 tablet_service.cc:1511] Processing CreateTablet for tablet ba302d819a4c420b861764d4a6b5fed2 (DEFAULT_TABLE table=test-workload [id=b49a1e65a32646a0a52da7e5948a15ca]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:57:51.849335   624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3bc6327504f44dab50a3f1663e18ef4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.849699   556 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e1e26ad8acd4644857773d9c53d3ff2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.851099   550 tablet_service.cc:1511] Processing CreateTablet for tablet c48ae3b2d706406fad9295ac2ecdd688 (DEFAULT_TABLE table=test-workload [id=b49a1e65a32646a0a52da7e5948a15ca]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:57:51.857566   549 tablet_service.cc:1511] Processing CreateTablet for tablet d3bc6327504f44dab50a3f1663e18ef4 (DEFAULT_TABLE table=test-workload [id=b49a1e65a32646a0a52da7e5948a15ca]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:57:51.866729   623 tablet_service.cc:1511] Processing CreateTablet for tablet 2c2a2160a9fd483da791a5a8beb07ac6 (DEFAULT_TABLE table=test-workload [id=b49a1e65a32646a0a52da7e5948a15ca]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:57:51.863948   699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c48ae3b2d706406fad9295ac2ecdd688. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.867122   555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 741777b7834d4f5e80bd0187702907dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.866896   625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c48ae3b2d706406fad9295ac2ecdd688. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.865809   548 tablet_service.cc:1511] Processing CreateTablet for tablet 2c2a2160a9fd483da791a5a8beb07ac6 (DEFAULT_TABLE table=test-workload [id=b49a1e65a32646a0a52da7e5948a15ca]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:57:51.871866   551 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b933fbc94f143caae7395db46bfa15c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.877797   552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd75112d105d4b269b9a7b422866104f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.882407   554 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba302d819a4c420b861764d4a6b5fed2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.883075   550 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c48ae3b2d706406fad9295ac2ecdd688. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.887560   698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3bc6327504f44dab50a3f1663e18ef4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.898787   628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecf93bacf15045e3bbfc2b0d7c51dbd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.898116   697 tablet_service.cc:1511] Processing CreateTablet for tablet 2c2a2160a9fd483da791a5a8beb07ac6 (DEFAULT_TABLE table=test-workload [id=b49a1e65a32646a0a52da7e5948a15ca]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:57:51.903328   553 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecf93bacf15045e3bbfc2b0d7c51dbd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.910279   548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c2a2160a9fd483da791a5a8beb07ac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.908800   623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c2a2160a9fd483da791a5a8beb07ac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.918319   702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecf93bacf15045e3bbfc2b0d7c51dbd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:51.925860   549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3bc6327504f44dab50a3f1663e18ef4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:57:51.932035   510 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:57:51.945811   697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c2a2160a9fd483da791a5a8beb07ac6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:57:52.138746   759 tablet_bootstrap.cc:492] T ba302d819a4c420b861764d4a6b5fed2 P 833e299675134d28bcc13d2c73b996a6: Bootstrap starting.
I20260709 12:57:52.148602   758 tablet_bootstrap.cc:492] T 8e1e26ad8acd4644857773d9c53d3ff2 P d7fcf132cb774583bd7967a84b418048: Bootstrap starting.
I20260709 12:57:52.168263   760 tablet_bootstrap.cc:492] T d3bc6327504f44dab50a3f1663e18ef4 P 40919529b3d6492d82e76f9cb44e6542: Bootstrap starting.
I20260709 12:57:52.174077   759 tablet_bootstrap.cc:654] T ba302d819a4c420b861764d4a6b5fed2 P 833e299675134d28bcc13d2c73b996a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:52.182176   758 tablet_bootstrap.cc:654] T 8e1e26ad8acd4644857773d9c53d3ff2 P d7fcf132cb774583bd7967a84b418048: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:52.184964   760 tablet_bootstrap.cc:654] T d3bc6327504f44dab50a3f1663e18ef4 P 40919529b3d6492d82e76f9cb44e6542: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:52.194474   759 tablet_bootstrap.cc:492] T ba302d819a4c420b861764d4a6b5fed2 P 833e299675134d28bcc13d2c73b996a6: No bootstrap required, opened a new log
I20260709 12:57:52.194872   760 tablet_bootstrap.cc:492] T d3bc6327504f44dab50a3f1663e18ef4 P 40919529b3d6492d82e76f9cb44e6542: No bootstrap required, opened a new log
I20260709 12:57:52.195034   759 ts_tablet_manager.cc:1403] T ba302d819a4c420b861764d4a6b5fed2 P 833e299675134d28bcc13d2c73b996a6: Time spent bootstrapping tablet: real 0.058s	user 0.016s	sys 0.007s
I20260709 12:57:52.195268   760 ts_tablet_manager.cc:1403] T d3bc6327504f44dab50a3f1663e18ef4 P 40919529b3d6492d82e76f9cb44e6542: Time spent bootstrapping tablet: real 0.047s	user 0.003s	sys 0.013s
I20260709 12:57:52.197875   758 tablet_bootstrap.cc:492] T 8e1e26ad8acd4644857773d9c53d3ff2 P d7fcf132cb774583bd7967a84b418048: No bootstrap required, opened a new log
I20260709 12:57:52.198362   758 ts_tablet_manager.cc:1403] T 8e1e26ad8acd4644857773d9c53d3ff2 P d7fcf132cb774583bd7967a84b418048: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.005s
I20260709 12:57:52.198745   760 raft_consensus.cc:359] T d3bc6327504f44dab50a3f1663e18ef4 P 40919529b3d6492d82e76f9cb44e6542 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.199069   759 raft_consensus.cc:359] T ba302d819a4c420b861764d4a6b5fed2 P 833e299675134d28bcc13d2c73b996a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.199532   760 raft_consensus.cc:385] T d3bc6327504f44dab50a3f1663e18ef4 P 40919529b3d6492d82e76f9cb44e6542 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:52.199781   759 raft_consensus.cc:385] T ba302d819a4c420b861764d4a6b5fed2 P 833e299675134d28bcc13d2c73b996a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:52.199873   760 raft_consensus.cc:740] T d3bc6327504f44dab50a3f1663e18ef4 P 40919529b3d6492d82e76f9cb44e6542 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40919529b3d6492d82e76f9cb44e6542, State: Initialized, Role: FOLLOWER
I20260709 12:57:52.200152   759 raft_consensus.cc:740] T ba302d819a4c420b861764d4a6b5fed2 P 833e299675134d28bcc13d2c73b996a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 833e299675134d28bcc13d2c73b996a6, State: Initialized, Role: FOLLOWER
I20260709 12:57:52.200738   760 consensus_queue.cc:260] T d3bc6327504f44dab50a3f1663e18ef4 P 40919529b3d6492d82e76f9cb44e6542 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.201085   759 consensus_queue.cc:260] T ba302d819a4c420b861764d4a6b5fed2 P 833e299675134d28bcc13d2c73b996a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.201923   758 raft_consensus.cc:359] T 8e1e26ad8acd4644857773d9c53d3ff2 P d7fcf132cb774583bd7967a84b418048 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.203079   758 raft_consensus.cc:385] T 8e1e26ad8acd4644857773d9c53d3ff2 P d7fcf132cb774583bd7967a84b418048 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:52.203539   758 raft_consensus.cc:740] T 8e1e26ad8acd4644857773d9c53d3ff2 P d7fcf132cb774583bd7967a84b418048 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7fcf132cb774583bd7967a84b418048, State: Initialized, Role: FOLLOWER
I20260709 12:57:52.204756   758 consensus_queue.cc:260] T 8e1e26ad8acd4644857773d9c53d3ff2 P d7fcf132cb774583bd7967a84b418048 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.210202   591 heartbeater.cc:499] Master 127.0.107.254:37363 was elected leader, sending a full tablet report...
I20260709 12:57:52.213238   758 ts_tablet_manager.cc:1434] T 8e1e26ad8acd4644857773d9c53d3ff2 P d7fcf132cb774583bd7967a84b418048: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.005s
I20260709 12:57:52.213969   740 heartbeater.cc:499] Master 127.0.107.254:37363 was elected leader, sending a full tablet report...
I20260709 12:57:52.215044   760 ts_tablet_manager.cc:1434] T d3bc6327504f44dab50a3f1663e18ef4 P 40919529b3d6492d82e76f9cb44e6542: Time spent starting tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 12:57:52.215941   760 tablet_bootstrap.cc:492] T 3b933fbc94f143caae7395db46bfa15c P 40919529b3d6492d82e76f9cb44e6542: Bootstrap starting.
I20260709 12:57:52.217445   758 tablet_bootstrap.cc:492] T ba302d819a4c420b861764d4a6b5fed2 P d7fcf132cb774583bd7967a84b418048: Bootstrap starting.
I20260709 12:57:52.224323   666 heartbeater.cc:499] Master 127.0.107.254:37363 was elected leader, sending a full tablet report...
I20260709 12:57:52.225386   759 ts_tablet_manager.cc:1434] T ba302d819a4c420b861764d4a6b5fed2 P 833e299675134d28bcc13d2c73b996a6: Time spent starting tablet: real 0.030s	user 0.018s	sys 0.009s
I20260709 12:57:52.226548   759 tablet_bootstrap.cc:492] T bd75112d105d4b269b9a7b422866104f P 833e299675134d28bcc13d2c73b996a6: Bootstrap starting.
I20260709 12:57:52.228873   758 tablet_bootstrap.cc:654] T ba302d819a4c420b861764d4a6b5fed2 P d7fcf132cb774583bd7967a84b418048: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:52.230643   760 tablet_bootstrap.cc:654] T 3b933fbc94f143caae7395db46bfa15c P 40919529b3d6492d82e76f9cb44e6542: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:52.233278   759 tablet_bootstrap.cc:654] T bd75112d105d4b269b9a7b422866104f P 833e299675134d28bcc13d2c73b996a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:52.297978   766 raft_consensus.cc:493] T 8e1e26ad8acd4644857773d9c53d3ff2 P d7fcf132cb774583bd7967a84b418048 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:52.298409   759 tablet_bootstrap.cc:492] T bd75112d105d4b269b9a7b422866104f P 833e299675134d28bcc13d2c73b996a6: No bootstrap required, opened a new log
I20260709 12:57:52.298949   759 ts_tablet_manager.cc:1403] T bd75112d105d4b269b9a7b422866104f P 833e299675134d28bcc13d2c73b996a6: Time spent bootstrapping tablet: real 0.073s	user 0.041s	sys 0.029s
I20260709 12:57:52.299171   758 tablet_bootstrap.cc:492] T ba302d819a4c420b861764d4a6b5fed2 P d7fcf132cb774583bd7967a84b418048: No bootstrap required, opened a new log
I20260709 12:57:52.299631   758 ts_tablet_manager.cc:1403] T ba302d819a4c420b861764d4a6b5fed2 P d7fcf132cb774583bd7967a84b418048: Time spent bootstrapping tablet: real 0.082s	user 0.040s	sys 0.030s
I20260709 12:57:52.301924   759 raft_consensus.cc:359] T bd75112d105d4b269b9a7b422866104f P 833e299675134d28bcc13d2c73b996a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.302373   758 raft_consensus.cc:359] T ba302d819a4c420b861764d4a6b5fed2 P d7fcf132cb774583bd7967a84b418048 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.298492   766 raft_consensus.cc:515] T 8e1e26ad8acd4644857773d9c53d3ff2 P d7fcf132cb774583bd7967a84b418048 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.303157   759 raft_consensus.cc:385] T bd75112d105d4b269b9a7b422866104f P 833e299675134d28bcc13d2c73b996a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:52.303496   759 raft_consensus.cc:740] T bd75112d105d4b269b9a7b422866104f P 833e299675134d28bcc13d2c73b996a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 833e299675134d28bcc13d2c73b996a6, State: Initialized, Role: FOLLOWER
I20260709 12:57:52.304200   759 consensus_queue.cc:260] T bd75112d105d4b269b9a7b422866104f P 833e299675134d28bcc13d2c73b996a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.305975   766 leader_election.cc:290] T 8e1e26ad8acd4644857773d9c53d3ff2 P d7fcf132cb774583bd7967a84b418048 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 833e299675134d28bcc13d2c73b996a6 (127.0.107.194:39403), 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193:34223)
I20260709 12:57:52.306553   758 raft_consensus.cc:385] T ba302d819a4c420b861764d4a6b5fed2 P d7fcf132cb774583bd7967a84b418048 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:52.306932   758 raft_consensus.cc:740] T ba302d819a4c420b861764d4a6b5fed2 P d7fcf132cb774583bd7967a84b418048 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7fcf132cb774583bd7967a84b418048, State: Initialized, Role: FOLLOWER
I20260709 12:57:52.307686   758 consensus_queue.cc:260] T ba302d819a4c420b861764d4a6b5fed2 P d7fcf132cb774583bd7967a84b418048 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.310050   758 ts_tablet_manager.cc:1434] T ba302d819a4c420b861764d4a6b5fed2 P d7fcf132cb774583bd7967a84b418048: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:57:52.310954   758 tablet_bootstrap.cc:492] T 3b933fbc94f143caae7395db46bfa15c P d7fcf132cb774583bd7967a84b418048: Bootstrap starting.
I20260709 12:57:52.317953   758 tablet_bootstrap.cc:654] T 3b933fbc94f143caae7395db46bfa15c P d7fcf132cb774583bd7967a84b418048: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:52.327601   759 ts_tablet_manager.cc:1434] T bd75112d105d4b269b9a7b422866104f P 833e299675134d28bcc13d2c73b996a6: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.004s
I20260709 12:57:52.328965   759 tablet_bootstrap.cc:492] T 8e1e26ad8acd4644857773d9c53d3ff2 P 833e299675134d28bcc13d2c73b996a6: Bootstrap starting.
I20260709 12:57:52.329007   758 tablet_bootstrap.cc:492] T 3b933fbc94f143caae7395db46bfa15c P d7fcf132cb774583bd7967a84b418048: No bootstrap required, opened a new log
I20260709 12:57:52.329654   758 ts_tablet_manager.cc:1403] T 3b933fbc94f143caae7395db46bfa15c P d7fcf132cb774583bd7967a84b418048: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 12:57:52.333261   760 tablet_bootstrap.cc:492] T 3b933fbc94f143caae7395db46bfa15c P 40919529b3d6492d82e76f9cb44e6542: No bootstrap required, opened a new log
I20260709 12:57:52.332926   758 raft_consensus.cc:359] T 3b933fbc94f143caae7395db46bfa15c P d7fcf132cb774583bd7967a84b418048 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.333825   760 ts_tablet_manager.cc:1403] T 3b933fbc94f143caae7395db46bfa15c P 40919529b3d6492d82e76f9cb44e6542: Time spent bootstrapping tablet: real 0.118s	user 0.023s	sys 0.046s
I20260709 12:57:52.333838   758 raft_consensus.cc:385] T 3b933fbc94f143caae7395db46bfa15c P d7fcf132cb774583bd7967a84b418048 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:52.334437   758 raft_consensus.cc:740] T 3b933fbc94f143caae7395db46bfa15c P d7fcf132cb774583bd7967a84b418048 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7fcf132cb774583bd7967a84b418048, State: Initialized, Role: FOLLOWER
W20260709 12:57:52.335465   741 tablet.cc:2406] T 8e1e26ad8acd4644857773d9c53d3ff2 P d7fcf132cb774583bd7967a84b418048: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:57:52.335183   758 consensus_queue.cc:260] T 3b933fbc94f143caae7395db46bfa15c P d7fcf132cb774583bd7967a84b418048 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.337173   758 ts_tablet_manager.cc:1434] T 3b933fbc94f143caae7395db46bfa15c P d7fcf132cb774583bd7967a84b418048: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 12:57:52.338516   758 tablet_bootstrap.cc:492] T d3bc6327504f44dab50a3f1663e18ef4 P d7fcf132cb774583bd7967a84b418048: Bootstrap starting.
I20260709 12:57:52.343722   764 raft_consensus.cc:493] T d3bc6327504f44dab50a3f1663e18ef4 P 40919529b3d6492d82e76f9cb44e6542 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:52.344223   764 raft_consensus.cc:515] T d3bc6327504f44dab50a3f1663e18ef4 P 40919529b3d6492d82e76f9cb44e6542 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.346221   758 tablet_bootstrap.cc:654] T d3bc6327504f44dab50a3f1663e18ef4 P d7fcf132cb774583bd7967a84b418048: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:52.347517   764 leader_election.cc:290] T d3bc6327504f44dab50a3f1663e18ef4 P 40919529b3d6492d82e76f9cb44e6542 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 833e299675134d28bcc13d2c73b996a6 (127.0.107.194:39403), d7fcf132cb774583bd7967a84b418048 (127.0.107.195:42711)
I20260709 12:57:52.351778   760 raft_consensus.cc:359] T 3b933fbc94f143caae7395db46bfa15c P 40919529b3d6492d82e76f9cb44e6542 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.352604   760 raft_consensus.cc:385] T 3b933fbc94f143caae7395db46bfa15c P 40919529b3d6492d82e76f9cb44e6542 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:52.352948   760 raft_consensus.cc:740] T 3b933fbc94f143caae7395db46bfa15c P 40919529b3d6492d82e76f9cb44e6542 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40919529b3d6492d82e76f9cb44e6542, State: Initialized, Role: FOLLOWER
I20260709 12:57:52.353703   760 consensus_queue.cc:260] T 3b933fbc94f143caae7395db46bfa15c P 40919529b3d6492d82e76f9cb44e6542 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.356501   760 ts_tablet_manager.cc:1434] T 3b933fbc94f143caae7395db46bfa15c P 40919529b3d6492d82e76f9cb44e6542: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.001s
I20260709 12:57:52.357296   759 tablet_bootstrap.cc:654] T 8e1e26ad8acd4644857773d9c53d3ff2 P 833e299675134d28bcc13d2c73b996a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:52.357678   760 tablet_bootstrap.cc:492] T bd75112d105d4b269b9a7b422866104f P 40919529b3d6492d82e76f9cb44e6542: Bootstrap starting.
I20260709 12:57:52.369995   760 tablet_bootstrap.cc:654] T bd75112d105d4b269b9a7b422866104f P 40919529b3d6492d82e76f9cb44e6542: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:52.371563   765 raft_consensus.cc:493] T ba302d819a4c420b861764d4a6b5fed2 P 833e299675134d28bcc13d2c73b996a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:52.372267   765 raft_consensus.cc:515] T ba302d819a4c420b861764d4a6b5fed2 P 833e299675134d28bcc13d2c73b996a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.373366   758 tablet_bootstrap.cc:492] T d3bc6327504f44dab50a3f1663e18ef4 P d7fcf132cb774583bd7967a84b418048: No bootstrap required, opened a new log
I20260709 12:57:52.374115   758 ts_tablet_manager.cc:1403] T d3bc6327504f44dab50a3f1663e18ef4 P d7fcf132cb774583bd7967a84b418048: Time spent bootstrapping tablet: real 0.036s	user 0.008s	sys 0.008s
I20260709 12:57:52.377965   765 leader_election.cc:290] T ba302d819a4c420b861764d4a6b5fed2 P 833e299675134d28bcc13d2c73b996a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193:34223), d7fcf132cb774583bd7967a84b418048 (127.0.107.195:42711)
I20260709 12:57:52.384001   758 raft_consensus.cc:359] T d3bc6327504f44dab50a3f1663e18ef4 P d7fcf132cb774583bd7967a84b418048 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.407483   758 raft_consensus.cc:385] T d3bc6327504f44dab50a3f1663e18ef4 P d7fcf132cb774583bd7967a84b418048 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:52.408057   758 raft_consensus.cc:740] T d3bc6327504f44dab50a3f1663e18ef4 P d7fcf132cb774583bd7967a84b418048 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7fcf132cb774583bd7967a84b418048, State: Initialized, Role: FOLLOWER
I20260709 12:57:52.409317   758 consensus_queue.cc:260] T d3bc6327504f44dab50a3f1663e18ef4 P d7fcf132cb774583bd7967a84b418048 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.412245   758 ts_tablet_manager.cc:1434] T d3bc6327504f44dab50a3f1663e18ef4 P d7fcf132cb774583bd7967a84b418048: Time spent starting tablet: real 0.036s	user 0.004s	sys 0.002s
I20260709 12:57:52.418848   758 tablet_bootstrap.cc:492] T c48ae3b2d706406fad9295ac2ecdd688 P d7fcf132cb774583bd7967a84b418048: Bootstrap starting.
I20260709 12:57:52.436349   758 tablet_bootstrap.cc:654] T c48ae3b2d706406fad9295ac2ecdd688 P d7fcf132cb774583bd7967a84b418048: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:52.462302   759 tablet_bootstrap.cc:492] T 8e1e26ad8acd4644857773d9c53d3ff2 P 833e299675134d28bcc13d2c73b996a6: No bootstrap required, opened a new log
I20260709 12:57:52.462922   759 ts_tablet_manager.cc:1403] T 8e1e26ad8acd4644857773d9c53d3ff2 P 833e299675134d28bcc13d2c73b996a6: Time spent bootstrapping tablet: real 0.135s	user 0.025s	sys 0.046s
I20260709 12:57:52.467615   760 tablet_bootstrap.cc:492] T bd75112d105d4b269b9a7b422866104f P 40919529b3d6492d82e76f9cb44e6542: No bootstrap required, opened a new log
I20260709 12:57:52.468716   760 ts_tablet_manager.cc:1403] T bd75112d105d4b269b9a7b422866104f P 40919529b3d6492d82e76f9cb44e6542: Time spent bootstrapping tablet: real 0.111s	user 0.019s	sys 0.011s
I20260709 12:57:52.470407   765 raft_consensus.cc:493] T bd75112d105d4b269b9a7b422866104f P 833e299675134d28bcc13d2c73b996a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:52.471304   765 raft_consensus.cc:515] T bd75112d105d4b269b9a7b422866104f P 833e299675134d28bcc13d2c73b996a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.474651   765 leader_election.cc:290] T bd75112d105d4b269b9a7b422866104f P 833e299675134d28bcc13d2c73b996a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193:34223), d7fcf132cb774583bd7967a84b418048 (127.0.107.195:42711)
I20260709 12:57:52.476891   760 raft_consensus.cc:359] T bd75112d105d4b269b9a7b422866104f P 40919529b3d6492d82e76f9cb44e6542 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.477864   760 raft_consensus.cc:385] T bd75112d105d4b269b9a7b422866104f P 40919529b3d6492d82e76f9cb44e6542 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:52.478255   760 raft_consensus.cc:740] T bd75112d105d4b269b9a7b422866104f P 40919529b3d6492d82e76f9cb44e6542 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40919529b3d6492d82e76f9cb44e6542, State: Initialized, Role: FOLLOWER
I20260709 12:57:52.480585   760 consensus_queue.cc:260] T bd75112d105d4b269b9a7b422866104f P 40919529b3d6492d82e76f9cb44e6542 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.484690   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1e26ad8acd4644857773d9c53d3ff2" candidate_uuid: "d7fcf132cb774583bd7967a84b418048" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "833e299675134d28bcc13d2c73b996a6" is_pre_election: true
I20260709 12:57:52.484827   759 raft_consensus.cc:359] T 8e1e26ad8acd4644857773d9c53d3ff2 P 833e299675134d28bcc13d2c73b996a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.485786   759 raft_consensus.cc:385] T 8e1e26ad8acd4644857773d9c53d3ff2 P 833e299675134d28bcc13d2c73b996a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:52.486070   759 raft_consensus.cc:740] T 8e1e26ad8acd4644857773d9c53d3ff2 P 833e299675134d28bcc13d2c73b996a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 833e299675134d28bcc13d2c73b996a6, State: Initialized, Role: FOLLOWER
I20260709 12:57:52.486712   760 ts_tablet_manager.cc:1434] T bd75112d105d4b269b9a7b422866104f P 40919529b3d6492d82e76f9cb44e6542: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.002s
I20260709 12:57:52.487838   760 tablet_bootstrap.cc:492] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542: Bootstrap starting.
I20260709 12:57:52.486716   759 consensus_queue.cc:260] T 8e1e26ad8acd4644857773d9c53d3ff2 P 833e299675134d28bcc13d2c73b996a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.491008   641 raft_consensus.cc:2468] T 8e1e26ad8acd4644857773d9c53d3ff2 P 833e299675134d28bcc13d2c73b996a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7fcf132cb774583bd7967a84b418048 in term 0.
I20260709 12:57:52.492352   759 ts_tablet_manager.cc:1434] T 8e1e26ad8acd4644857773d9c53d3ff2 P 833e299675134d28bcc13d2c73b996a6: Time spent starting tablet: real 0.029s	user 0.002s	sys 0.006s
I20260709 12:57:52.493357   759 tablet_bootstrap.cc:492] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6: Bootstrap starting.
I20260709 12:57:52.505808   758 tablet_bootstrap.cc:492] T c48ae3b2d706406fad9295ac2ecdd688 P d7fcf132cb774583bd7967a84b418048: No bootstrap required, opened a new log
I20260709 12:57:52.506448   758 ts_tablet_manager.cc:1403] T c48ae3b2d706406fad9295ac2ecdd688 P d7fcf132cb774583bd7967a84b418048: Time spent bootstrapping tablet: real 0.088s	user 0.012s	sys 0.008s
I20260709 12:57:52.514401   758 raft_consensus.cc:359] T c48ae3b2d706406fad9295ac2ecdd688 P d7fcf132cb774583bd7967a84b418048 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.515880   758 raft_consensus.cc:385] T c48ae3b2d706406fad9295ac2ecdd688 P d7fcf132cb774583bd7967a84b418048 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:52.516269   758 raft_consensus.cc:740] T c48ae3b2d706406fad9295ac2ecdd688 P d7fcf132cb774583bd7967a84b418048 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7fcf132cb774583bd7967a84b418048, State: Initialized, Role: FOLLOWER
I20260709 12:57:52.517037   758 consensus_queue.cc:260] T c48ae3b2d706406fad9295ac2ecdd688 P d7fcf132cb774583bd7967a84b418048 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.518014   680 leader_election.cc:304] T 8e1e26ad8acd4644857773d9c53d3ff2 P d7fcf132cb774583bd7967a84b418048 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 833e299675134d28bcc13d2c73b996a6, d7fcf132cb774583bd7967a84b418048; no voters: 
I20260709 12:57:52.521180   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3bc6327504f44dab50a3f1663e18ef4" candidate_uuid: "40919529b3d6492d82e76f9cb44e6542" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "833e299675134d28bcc13d2c73b996a6" is_pre_election: true
I20260709 12:57:52.522589   758 ts_tablet_manager.cc:1434] T c48ae3b2d706406fad9295ac2ecdd688 P d7fcf132cb774583bd7967a84b418048: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 12:57:52.525607   766 raft_consensus.cc:2804] T 8e1e26ad8acd4644857773d9c53d3ff2 P d7fcf132cb774583bd7967a84b418048 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:52.526165   766 raft_consensus.cc:493] T 8e1e26ad8acd4644857773d9c53d3ff2 P d7fcf132cb774583bd7967a84b418048 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:52.527082   760 tablet_bootstrap.cc:654] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:52.526880   766 raft_consensus.cc:3060] T 8e1e26ad8acd4644857773d9c53d3ff2 P d7fcf132cb774583bd7967a84b418048 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:57:52.526844   531 leader_election.cc:343] T d3bc6327504f44dab50a3f1663e18ef4 P 40919529b3d6492d82e76f9cb44e6542 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 833e299675134d28bcc13d2c73b996a6 (127.0.107.194:39403): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:52.535401   759 tablet_bootstrap.cc:654] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:52.533293   758 tablet_bootstrap.cc:492] T bd75112d105d4b269b9a7b422866104f P d7fcf132cb774583bd7967a84b418048: Bootstrap starting.
I20260709 12:57:52.539752   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3bc6327504f44dab50a3f1663e18ef4" candidate_uuid: "40919529b3d6492d82e76f9cb44e6542" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fcf132cb774583bd7967a84b418048" is_pre_election: true
I20260709 12:57:52.540988   715 raft_consensus.cc:2468] T d3bc6327504f44dab50a3f1663e18ef4 P d7fcf132cb774583bd7967a84b418048 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40919529b3d6492d82e76f9cb44e6542 in term 0.
I20260709 12:57:52.541311   766 raft_consensus.cc:515] T 8e1e26ad8acd4644857773d9c53d3ff2 P d7fcf132cb774583bd7967a84b418048 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.544987   766 leader_election.cc:290] T 8e1e26ad8acd4644857773d9c53d3ff2 P d7fcf132cb774583bd7967a84b418048 [CANDIDATE]: Term 1 election: Requested vote from peers 833e299675134d28bcc13d2c73b996a6 (127.0.107.194:39403), 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193:34223)
I20260709 12:57:52.545033   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba302d819a4c420b861764d4a6b5fed2" candidate_uuid: "833e299675134d28bcc13d2c73b996a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fcf132cb774583bd7967a84b418048" is_pre_election: true
I20260709 12:57:52.550724   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd75112d105d4b269b9a7b422866104f" candidate_uuid: "833e299675134d28bcc13d2c73b996a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fcf132cb774583bd7967a84b418048" is_pre_election: true
I20260709 12:57:52.552366   530 leader_election.cc:304] T d3bc6327504f44dab50a3f1663e18ef4 P 40919529b3d6492d82e76f9cb44e6542 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40919529b3d6492d82e76f9cb44e6542, d7fcf132cb774583bd7967a84b418048; no voters: 833e299675134d28bcc13d2c73b996a6
I20260709 12:57:52.554723   764 raft_consensus.cc:2804] T d3bc6327504f44dab50a3f1663e18ef4 P 40919529b3d6492d82e76f9cb44e6542 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:52.555107   764 raft_consensus.cc:493] T d3bc6327504f44dab50a3f1663e18ef4 P 40919529b3d6492d82e76f9cb44e6542 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:52.551182   715 raft_consensus.cc:2468] T ba302d819a4c420b861764d4a6b5fed2 P d7fcf132cb774583bd7967a84b418048 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 833e299675134d28bcc13d2c73b996a6 in term 0.
I20260709 12:57:52.551482   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1e26ad8acd4644857773d9c53d3ff2" candidate_uuid: "d7fcf132cb774583bd7967a84b418048" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "833e299675134d28bcc13d2c73b996a6"
I20260709 12:57:52.557152   641 raft_consensus.cc:3060] T 8e1e26ad8acd4644857773d9c53d3ff2 P 833e299675134d28bcc13d2c73b996a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:52.557263   764 raft_consensus.cc:3060] T d3bc6327504f44dab50a3f1663e18ef4 P 40919529b3d6492d82e76f9cb44e6542 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:57:52.560079   605 leader_election.cc:343] T bd75112d105d4b269b9a7b422866104f P 833e299675134d28bcc13d2c73b996a6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7fcf132cb774583bd7967a84b418048 (127.0.107.195:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:52.562618   605 leader_election.cc:304] T ba302d819a4c420b861764d4a6b5fed2 P 833e299675134d28bcc13d2c73b996a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 833e299675134d28bcc13d2c73b996a6, d7fcf132cb774583bd7967a84b418048; no voters: 
I20260709 12:57:52.564945   765 raft_consensus.cc:2804] T ba302d819a4c420b861764d4a6b5fed2 P 833e299675134d28bcc13d2c73b996a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:52.565362   765 raft_consensus.cc:493] T ba302d819a4c420b861764d4a6b5fed2 P 833e299675134d28bcc13d2c73b996a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:52.566444   765 raft_consensus.cc:3060] T ba302d819a4c420b861764d4a6b5fed2 P 833e299675134d28bcc13d2c73b996a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:52.567221   759 tablet_bootstrap.cc:492] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6: No bootstrap required, opened a new log
I20260709 12:57:52.572118   764 raft_consensus.cc:515] T d3bc6327504f44dab50a3f1663e18ef4 P 40919529b3d6492d82e76f9cb44e6542 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.574699   641 raft_consensus.cc:2468] T 8e1e26ad8acd4644857773d9c53d3ff2 P 833e299675134d28bcc13d2c73b996a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7fcf132cb774583bd7967a84b418048 in term 1.
I20260709 12:57:52.574811   764 leader_election.cc:290] T d3bc6327504f44dab50a3f1663e18ef4 P 40919529b3d6492d82e76f9cb44e6542 [CANDIDATE]: Term 1 election: Requested vote from peers 833e299675134d28bcc13d2c73b996a6 (127.0.107.194:39403), d7fcf132cb774583bd7967a84b418048 (127.0.107.195:42711)
I20260709 12:57:52.567739   759 ts_tablet_manager.cc:1403] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6: Time spent bootstrapping tablet: real 0.075s	user 0.008s	sys 0.011s
I20260709 12:57:52.577430   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3bc6327504f44dab50a3f1663e18ef4" candidate_uuid: "40919529b3d6492d82e76f9cb44e6542" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "833e299675134d28bcc13d2c73b996a6"
I20260709 12:57:52.577679   680 leader_election.cc:304] T 8e1e26ad8acd4644857773d9c53d3ff2 P d7fcf132cb774583bd7967a84b418048 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 833e299675134d28bcc13d2c73b996a6, d7fcf132cb774583bd7967a84b418048; no voters: 
I20260709 12:57:52.579200   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3bc6327504f44dab50a3f1663e18ef4" candidate_uuid: "40919529b3d6492d82e76f9cb44e6542" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fcf132cb774583bd7967a84b418048"
I20260709 12:57:52.580456   766 raft_consensus.cc:2804] T 8e1e26ad8acd4644857773d9c53d3ff2 P d7fcf132cb774583bd7967a84b418048 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:57:52.580456   531 leader_election.cc:343] T d3bc6327504f44dab50a3f1663e18ef4 P 40919529b3d6492d82e76f9cb44e6542 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 833e299675134d28bcc13d2c73b996a6 (127.0.107.194:39403): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:52.580055   715 raft_consensus.cc:3060] T d3bc6327504f44dab50a3f1663e18ef4 P d7fcf132cb774583bd7967a84b418048 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:52.581578   758 tablet_bootstrap.cc:654] T bd75112d105d4b269b9a7b422866104f P d7fcf132cb774583bd7967a84b418048: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:52.583756   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1e26ad8acd4644857773d9c53d3ff2" candidate_uuid: "d7fcf132cb774583bd7967a84b418048" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40919529b3d6492d82e76f9cb44e6542" is_pre_election: true
I20260709 12:57:52.585986   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1e26ad8acd4644857773d9c53d3ff2" candidate_uuid: "d7fcf132cb774583bd7967a84b418048" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40919529b3d6492d82e76f9cb44e6542"
I20260709 12:57:52.589102   765 raft_consensus.cc:515] T ba302d819a4c420b861764d4a6b5fed2 P 833e299675134d28bcc13d2c73b996a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
W20260709 12:57:52.590775   680 leader_election.cc:343] T 8e1e26ad8acd4644857773d9c53d3ff2 P d7fcf132cb774583bd7967a84b418048 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193:34223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:52.591825   760 tablet_bootstrap.cc:492] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542: No bootstrap required, opened a new log
W20260709 12:57:52.591967   680 leader_election.cc:343] T 8e1e26ad8acd4644857773d9c53d3ff2 P d7fcf132cb774583bd7967a84b418048 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193:34223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:52.592267   760 ts_tablet_manager.cc:1403] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542: Time spent bootstrapping tablet: real 0.105s	user 0.021s	sys 0.017s
I20260709 12:57:52.593391   759 raft_consensus.cc:359] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.594168   759 raft_consensus.cc:385] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:52.594487   759 raft_consensus.cc:740] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 833e299675134d28bcc13d2c73b996a6, State: Initialized, Role: FOLLOWER
I20260709 12:57:52.595235   759 consensus_queue.cc:260] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.597744   766 raft_consensus.cc:697] T 8e1e26ad8acd4644857773d9c53d3ff2 P d7fcf132cb774583bd7967a84b418048 [term 1 LEADER]: Becoming Leader. State: Replica: d7fcf132cb774583bd7967a84b418048, State: Running, Role: LEADER
I20260709 12:57:52.598050   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba302d819a4c420b861764d4a6b5fed2" candidate_uuid: "833e299675134d28bcc13d2c73b996a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fcf132cb774583bd7967a84b418048"
I20260709 12:57:52.598155   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba302d819a4c420b861764d4a6b5fed2" candidate_uuid: "833e299675134d28bcc13d2c73b996a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40919529b3d6492d82e76f9cb44e6542" is_pre_election: true
I20260709 12:57:52.598656   714 raft_consensus.cc:3060] T ba302d819a4c420b861764d4a6b5fed2 P d7fcf132cb774583bd7967a84b418048 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:52.595391   765 leader_election.cc:290] T ba302d819a4c420b861764d4a6b5fed2 P 833e299675134d28bcc13d2c73b996a6 [CANDIDATE]: Term 1 election: Requested vote from peers 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193:34223), d7fcf132cb774583bd7967a84b418048 (127.0.107.195:42711)
I20260709 12:57:52.599545   760 raft_consensus.cc:359] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.598723   766 consensus_queue.cc:237] T 8e1e26ad8acd4644857773d9c53d3ff2 P d7fcf132cb774583bd7967a84b418048 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.599225   715 raft_consensus.cc:2468] T d3bc6327504f44dab50a3f1663e18ef4 P d7fcf132cb774583bd7967a84b418048 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40919529b3d6492d82e76f9cb44e6542 in term 1.
I20260709 12:57:52.600973   760 raft_consensus.cc:385] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:52.603406   760 raft_consensus.cc:740] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40919529b3d6492d82e76f9cb44e6542, State: Initialized, Role: FOLLOWER
I20260709 12:57:52.604101   530 leader_election.cc:304] T d3bc6327504f44dab50a3f1663e18ef4 P 40919529b3d6492d82e76f9cb44e6542 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40919529b3d6492d82e76f9cb44e6542, d7fcf132cb774583bd7967a84b418048; no voters: 833e299675134d28bcc13d2c73b996a6
I20260709 12:57:52.605327   760 consensus_queue.cc:260] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.610502   764 raft_consensus.cc:2804] T d3bc6327504f44dab50a3f1663e18ef4 P 40919529b3d6492d82e76f9cb44e6542 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:52.612902   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba302d819a4c420b861764d4a6b5fed2" candidate_uuid: "833e299675134d28bcc13d2c73b996a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40919529b3d6492d82e76f9cb44e6542"
I20260709 12:57:52.610304   765 raft_consensus.cc:493] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:52.610920   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd75112d105d4b269b9a7b422866104f" candidate_uuid: "833e299675134d28bcc13d2c73b996a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40919529b3d6492d82e76f9cb44e6542" is_pre_election: true
I20260709 12:57:52.619933   565 raft_consensus.cc:2468] T bd75112d105d4b269b9a7b422866104f P 40919529b3d6492d82e76f9cb44e6542 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 833e299675134d28bcc13d2c73b996a6 in term 0.
W20260709 12:57:52.621941   606 leader_election.cc:343] T ba302d819a4c420b861764d4a6b5fed2 P 833e299675134d28bcc13d2c73b996a6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193:34223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:52.619722   789 raft_consensus.cc:493] T c48ae3b2d706406fad9295ac2ecdd688 P d7fcf132cb774583bd7967a84b418048 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:52.628160   789 raft_consensus.cc:515] T c48ae3b2d706406fad9295ac2ecdd688 P d7fcf132cb774583bd7967a84b418048 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.631618   789 leader_election.cc:290] T c48ae3b2d706406fad9295ac2ecdd688 P d7fcf132cb774583bd7967a84b418048 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193:34223), 833e299675134d28bcc13d2c73b996a6 (127.0.107.194:39403)
I20260709 12:57:52.621724   765 raft_consensus.cc:515] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.633052   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48ae3b2d706406fad9295ac2ecdd688" candidate_uuid: "d7fcf132cb774583bd7967a84b418048" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40919529b3d6492d82e76f9cb44e6542" is_pre_election: true
W20260709 12:57:52.635718   680 leader_election.cc:343] T c48ae3b2d706406fad9295ac2ecdd688 P d7fcf132cb774583bd7967a84b418048 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193:34223): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:57:52.636096   606 leader_election.cc:343] T ba302d819a4c420b861764d4a6b5fed2 P 833e299675134d28bcc13d2c73b996a6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193:34223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:52.636942   606 leader_election.cc:304] T bd75112d105d4b269b9a7b422866104f P 833e299675134d28bcc13d2c73b996a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40919529b3d6492d82e76f9cb44e6542, 833e299675134d28bcc13d2c73b996a6; no voters: d7fcf132cb774583bd7967a84b418048
I20260709 12:57:52.640704   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48ae3b2d706406fad9295ac2ecdd688" candidate_uuid: "d7fcf132cb774583bd7967a84b418048" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "833e299675134d28bcc13d2c73b996a6" is_pre_election: true
I20260709 12:57:52.642263   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "741777b7834d4f5e80bd0187702907dc" candidate_uuid: "833e299675134d28bcc13d2c73b996a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fcf132cb774583bd7967a84b418048" is_pre_election: true
W20260709 12:57:52.643895   605 leader_election.cc:343] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7fcf132cb774583bd7967a84b418048 (127.0.107.195:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:52.644850   765 leader_election.cc:290] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193:34223), d7fcf132cb774583bd7967a84b418048 (127.0.107.195:42711)
I20260709 12:57:52.645512   765 raft_consensus.cc:2804] T bd75112d105d4b269b9a7b422866104f P 833e299675134d28bcc13d2c73b996a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:52.646111   765 raft_consensus.cc:493] T bd75112d105d4b269b9a7b422866104f P 833e299675134d28bcc13d2c73b996a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:52.646515   765 raft_consensus.cc:3060] T bd75112d105d4b269b9a7b422866104f P 833e299675134d28bcc13d2c73b996a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:52.647575   714 raft_consensus.cc:2468] T ba302d819a4c420b861764d4a6b5fed2 P d7fcf132cb774583bd7967a84b418048 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 833e299675134d28bcc13d2c73b996a6 in term 1.
I20260709 12:57:52.652909   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "741777b7834d4f5e80bd0187702907dc" candidate_uuid: "833e299675134d28bcc13d2c73b996a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40919529b3d6492d82e76f9cb44e6542" is_pre_election: true
W20260709 12:57:52.654243   680 leader_election.cc:343] T c48ae3b2d706406fad9295ac2ecdd688 P d7fcf132cb774583bd7967a84b418048 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 833e299675134d28bcc13d2c73b996a6 (127.0.107.194:39403): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:52.654904   565 raft_consensus.cc:2468] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 833e299675134d28bcc13d2c73b996a6 in term 0.
I20260709 12:57:52.654853   680 leader_election.cc:304] T c48ae3b2d706406fad9295ac2ecdd688 P d7fcf132cb774583bd7967a84b418048 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7fcf132cb774583bd7967a84b418048; no voters: 40919529b3d6492d82e76f9cb44e6542, 833e299675134d28bcc13d2c73b996a6
I20260709 12:57:52.656796   606 leader_election.cc:304] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40919529b3d6492d82e76f9cb44e6542, 833e299675134d28bcc13d2c73b996a6; no voters: d7fcf132cb774583bd7967a84b418048
I20260709 12:57:52.657123   605 leader_election.cc:304] T ba302d819a4c420b861764d4a6b5fed2 P 833e299675134d28bcc13d2c73b996a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 833e299675134d28bcc13d2c73b996a6, d7fcf132cb774583bd7967a84b418048; no voters: 40919529b3d6492d82e76f9cb44e6542
I20260709 12:57:52.659411   791 raft_consensus.cc:493] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:52.660598   791 raft_consensus.cc:515] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.664419   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "741777b7834d4f5e80bd0187702907dc" candidate_uuid: "40919529b3d6492d82e76f9cb44e6542" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "833e299675134d28bcc13d2c73b996a6" is_pre_election: true
I20260709 12:57:52.665271   640 raft_consensus.cc:2468] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40919529b3d6492d82e76f9cb44e6542 in term 0.
I20260709 12:57:52.666175   789 raft_consensus.cc:2749] T c48ae3b2d706406fad9295ac2ecdd688 P d7fcf132cb774583bd7967a84b418048 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:52.667135   531 leader_election.cc:304] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40919529b3d6492d82e76f9cb44e6542, 833e299675134d28bcc13d2c73b996a6; no voters: 
I20260709 12:57:52.671597   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "741777b7834d4f5e80bd0187702907dc" candidate_uuid: "40919529b3d6492d82e76f9cb44e6542" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fcf132cb774583bd7967a84b418048" is_pre_election: true
W20260709 12:57:52.673398   530 leader_election.cc:343] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d7fcf132cb774583bd7967a84b418048 (127.0.107.195:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:52.674480   791 leader_election.cc:290] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 833e299675134d28bcc13d2c73b996a6 (127.0.107.194:39403), d7fcf132cb774583bd7967a84b418048 (127.0.107.195:42711)
I20260709 12:57:52.675745   791 raft_consensus.cc:2804] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:52.677729   793 raft_consensus.cc:2804] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:52.688319   758 tablet_bootstrap.cc:492] T bd75112d105d4b269b9a7b422866104f P d7fcf132cb774583bd7967a84b418048: No bootstrap required, opened a new log
I20260709 12:57:52.688577   793 raft_consensus.cc:493] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:52.688872   758 ts_tablet_manager.cc:1403] T bd75112d105d4b269b9a7b422866104f P d7fcf132cb774583bd7967a84b418048: Time spent bootstrapping tablet: real 0.157s	user 0.010s	sys 0.016s
I20260709 12:57:52.689006   793 raft_consensus.cc:3060] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:52.680073   797 raft_consensus.cc:2804] T ba302d819a4c420b861764d4a6b5fed2 P 833e299675134d28bcc13d2c73b996a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:52.683104   760 ts_tablet_manager.cc:1434] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542: Time spent starting tablet: real 0.091s	user 0.011s	sys 0.007s
I20260709 12:57:52.683537   764 raft_consensus.cc:697] T d3bc6327504f44dab50a3f1663e18ef4 P 40919529b3d6492d82e76f9cb44e6542 [term 1 LEADER]: Becoming Leader. State: Replica: 40919529b3d6492d82e76f9cb44e6542, State: Running, Role: LEADER
I20260709 12:57:52.685647   759 ts_tablet_manager.cc:1434] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6: Time spent starting tablet: real 0.108s	user 0.013s	sys 0.008s
I20260709 12:57:52.687624   765 raft_consensus.cc:515] T bd75112d105d4b269b9a7b422866104f P 833e299675134d28bcc13d2c73b996a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.693255   791 raft_consensus.cc:493] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:52.693470   794 raft_consensus.cc:493] T 3b933fbc94f143caae7395db46bfa15c P 40919529b3d6492d82e76f9cb44e6542 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:52.693722   791 raft_consensus.cc:3060] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:52.693948   759 tablet_bootstrap.cc:492] T d3bc6327504f44dab50a3f1663e18ef4 P 833e299675134d28bcc13d2c73b996a6: Bootstrap starting.
I20260709 12:57:52.694159   794 raft_consensus.cc:515] T 3b933fbc94f143caae7395db46bfa15c P 40919529b3d6492d82e76f9cb44e6542 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.702596   765 leader_election.cc:290] T bd75112d105d4b269b9a7b422866104f P 833e299675134d28bcc13d2c73b996a6 [CANDIDATE]: Term 1 election: Requested vote from peers 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193:34223), d7fcf132cb774583bd7967a84b418048 (127.0.107.195:42711)
I20260709 12:57:52.705502   760 tablet_bootstrap.cc:492] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 40919529b3d6492d82e76f9cb44e6542: Bootstrap starting.
I20260709 12:57:52.708429   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd75112d105d4b269b9a7b422866104f" candidate_uuid: "833e299675134d28bcc13d2c73b996a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fcf132cb774583bd7967a84b418048"
I20260709 12:57:52.709574   758 raft_consensus.cc:359] T bd75112d105d4b269b9a7b422866104f P d7fcf132cb774583bd7967a84b418048 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.710808   758 raft_consensus.cc:385] T bd75112d105d4b269b9a7b422866104f P d7fcf132cb774583bd7967a84b418048 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:52.711264   758 raft_consensus.cc:740] T bd75112d105d4b269b9a7b422866104f P d7fcf132cb774583bd7967a84b418048 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7fcf132cb774583bd7967a84b418048, State: Initialized, Role: FOLLOWER
I20260709 12:57:52.708832   797 raft_consensus.cc:697] T ba302d819a4c420b861764d4a6b5fed2 P 833e299675134d28bcc13d2c73b996a6 [term 1 LEADER]: Becoming Leader. State: Replica: 833e299675134d28bcc13d2c73b996a6, State: Running, Role: LEADER
W20260709 12:57:52.712558   605 leader_election.cc:343] T bd75112d105d4b269b9a7b422866104f P 833e299675134d28bcc13d2c73b996a6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d7fcf132cb774583bd7967a84b418048 (127.0.107.195:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:52.711370   791 raft_consensus.cc:515] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.712343   759 tablet_bootstrap.cc:654] T d3bc6327504f44dab50a3f1663e18ef4 P 833e299675134d28bcc13d2c73b996a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:52.712350   758 consensus_queue.cc:260] T bd75112d105d4b269b9a7b422866104f P d7fcf132cb774583bd7967a84b418048 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.714679   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd75112d105d4b269b9a7b422866104f" candidate_uuid: "833e299675134d28bcc13d2c73b996a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40919529b3d6492d82e76f9cb44e6542"
I20260709 12:57:52.715564   565 raft_consensus.cc:3060] T bd75112d105d4b269b9a7b422866104f P 40919529b3d6492d82e76f9cb44e6542 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:52.713318   764 consensus_queue.cc:237] T d3bc6327504f44dab50a3f1663e18ef4 P 40919529b3d6492d82e76f9cb44e6542 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.712767   797 consensus_queue.cc:237] T ba302d819a4c420b861764d4a6b5fed2 P 833e299675134d28bcc13d2c73b996a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.716728   463 catalog_manager.cc:5697] T 8e1e26ad8acd4644857773d9c53d3ff2 P d7fcf132cb774583bd7967a84b418048 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7fcf132cb774583bd7967a84b418048 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "d7fcf132cb774583bd7967a84b418048" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:52.723677   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b933fbc94f143caae7395db46bfa15c" candidate_uuid: "40919529b3d6492d82e76f9cb44e6542" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "833e299675134d28bcc13d2c73b996a6" is_pre_election: true
W20260709 12:57:52.725528   531 leader_election.cc:343] T 3b933fbc94f143caae7395db46bfa15c P 40919529b3d6492d82e76f9cb44e6542 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 833e299675134d28bcc13d2c73b996a6 (127.0.107.194:39403): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:52.729192   794 leader_election.cc:290] T 3b933fbc94f143caae7395db46bfa15c P 40919529b3d6492d82e76f9cb44e6542 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 833e299675134d28bcc13d2c73b996a6 (127.0.107.194:39403), d7fcf132cb774583bd7967a84b418048 (127.0.107.195:42711)
I20260709 12:57:52.730264   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b933fbc94f143caae7395db46bfa15c" candidate_uuid: "40919529b3d6492d82e76f9cb44e6542" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fcf132cb774583bd7967a84b418048" is_pre_election: true
I20260709 12:57:52.730515   758 ts_tablet_manager.cc:1434] T bd75112d105d4b269b9a7b422866104f P d7fcf132cb774583bd7967a84b418048: Time spent starting tablet: real 0.041s	user 0.005s	sys 0.003s
I20260709 12:57:52.730891   714 raft_consensus.cc:2468] T 3b933fbc94f143caae7395db46bfa15c P d7fcf132cb774583bd7967a84b418048 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40919529b3d6492d82e76f9cb44e6542 in term 0.
I20260709 12:57:52.731484   758 tablet_bootstrap.cc:492] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P d7fcf132cb774583bd7967a84b418048: Bootstrap starting.
I20260709 12:57:52.732128   530 leader_election.cc:304] T 3b933fbc94f143caae7395db46bfa15c P 40919529b3d6492d82e76f9cb44e6542 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40919529b3d6492d82e76f9cb44e6542, d7fcf132cb774583bd7967a84b418048; no voters: 833e299675134d28bcc13d2c73b996a6
I20260709 12:57:52.726557   793 raft_consensus.cc:515] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.733593   794 raft_consensus.cc:2804] T 3b933fbc94f143caae7395db46bfa15c P 40919529b3d6492d82e76f9cb44e6542 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:52.735397   794 raft_consensus.cc:493] T 3b933fbc94f143caae7395db46bfa15c P 40919529b3d6492d82e76f9cb44e6542 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:52.735749   794 raft_consensus.cc:3060] T 3b933fbc94f143caae7395db46bfa15c P 40919529b3d6492d82e76f9cb44e6542 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:52.740507   565 raft_consensus.cc:2468] T bd75112d105d4b269b9a7b422866104f P 40919529b3d6492d82e76f9cb44e6542 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 833e299675134d28bcc13d2c73b996a6 in term 1.
I20260709 12:57:52.746557   759 tablet_bootstrap.cc:492] T d3bc6327504f44dab50a3f1663e18ef4 P 833e299675134d28bcc13d2c73b996a6: No bootstrap required, opened a new log
I20260709 12:57:52.747881   759 ts_tablet_manager.cc:1403] T d3bc6327504f44dab50a3f1663e18ef4 P 833e299675134d28bcc13d2c73b996a6: Time spent bootstrapping tablet: real 0.054s	user 0.017s	sys 0.008s
I20260709 12:57:52.756829   606 leader_election.cc:304] T bd75112d105d4b269b9a7b422866104f P 833e299675134d28bcc13d2c73b996a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40919529b3d6492d82e76f9cb44e6542, 833e299675134d28bcc13d2c73b996a6; no voters: d7fcf132cb774583bd7967a84b418048
I20260709 12:57:52.757216   794 raft_consensus.cc:515] T 3b933fbc94f143caae7395db46bfa15c P 40919529b3d6492d82e76f9cb44e6542 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.758881   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "741777b7834d4f5e80bd0187702907dc" candidate_uuid: "40919529b3d6492d82e76f9cb44e6542" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fcf132cb774583bd7967a84b418048"
I20260709 12:57:52.756399   791 leader_election.cc:290] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542 [CANDIDATE]: Term 1 election: Requested vote from peers 833e299675134d28bcc13d2c73b996a6 (127.0.107.194:39403), d7fcf132cb774583bd7967a84b418048 (127.0.107.195:42711)
I20260709 12:57:52.760069   793 leader_election.cc:290] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [CANDIDATE]: Term 1 election: Requested vote from peers 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193:34223), d7fcf132cb774583bd7967a84b418048 (127.0.107.195:42711)
I20260709 12:57:52.752756   759 raft_consensus.cc:359] T d3bc6327504f44dab50a3f1663e18ef4 P 833e299675134d28bcc13d2c73b996a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.762025   798 raft_consensus.cc:2804] T bd75112d105d4b269b9a7b422866104f P 833e299675134d28bcc13d2c73b996a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:52.763700   798 raft_consensus.cc:697] T bd75112d105d4b269b9a7b422866104f P 833e299675134d28bcc13d2c73b996a6 [term 1 LEADER]: Becoming Leader. State: Replica: 833e299675134d28bcc13d2c73b996a6, State: Running, Role: LEADER
I20260709 12:57:52.764153   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "741777b7834d4f5e80bd0187702907dc" candidate_uuid: "833e299675134d28bcc13d2c73b996a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40919529b3d6492d82e76f9cb44e6542"
I20260709 12:57:52.762245   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "741777b7834d4f5e80bd0187702907dc" candidate_uuid: "40919529b3d6492d82e76f9cb44e6542" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "833e299675134d28bcc13d2c73b996a6"
I20260709 12:57:52.762447   794 leader_election.cc:290] T 3b933fbc94f143caae7395db46bfa15c P 40919529b3d6492d82e76f9cb44e6542 [CANDIDATE]: Term 1 election: Requested vote from peers 833e299675134d28bcc13d2c73b996a6 (127.0.107.194:39403), d7fcf132cb774583bd7967a84b418048 (127.0.107.195:42711)
W20260709 12:57:52.760942   530 leader_election.cc:343] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d7fcf132cb774583bd7967a84b418048 (127.0.107.195:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:52.760867   462 catalog_manager.cc:5697] T d3bc6327504f44dab50a3f1663e18ef4 P 40919529b3d6492d82e76f9cb44e6542 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "40919529b3d6492d82e76f9cb44e6542" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:52.766395   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b933fbc94f143caae7395db46bfa15c" candidate_uuid: "40919529b3d6492d82e76f9cb44e6542" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "833e299675134d28bcc13d2c73b996a6"
I20260709 12:57:52.767055   640 raft_consensus.cc:2393] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 40919529b3d6492d82e76f9cb44e6542 in current term 1: Already voted for candidate 833e299675134d28bcc13d2c73b996a6 in this term.
I20260709 12:57:52.767457   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b933fbc94f143caae7395db46bfa15c" candidate_uuid: "40919529b3d6492d82e76f9cb44e6542" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fcf132cb774583bd7967a84b418048"
I20260709 12:57:52.765676   565 raft_consensus.cc:2393] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 833e299675134d28bcc13d2c73b996a6 in current term 1: Already voted for candidate 40919529b3d6492d82e76f9cb44e6542 in this term.
W20260709 12:57:52.767669   531 leader_election.cc:343] T 3b933fbc94f143caae7395db46bfa15c P 40919529b3d6492d82e76f9cb44e6542 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 833e299675134d28bcc13d2c73b996a6 (127.0.107.194:39403): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:52.768010   715 raft_consensus.cc:3060] T 3b933fbc94f143caae7395db46bfa15c P d7fcf132cb774583bd7967a84b418048 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:52.768648   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "741777b7834d4f5e80bd0187702907dc" candidate_uuid: "833e299675134d28bcc13d2c73b996a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fcf132cb774583bd7967a84b418048"
I20260709 12:57:52.770238   531 leader_election.cc:304] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40919529b3d6492d82e76f9cb44e6542; no voters: 833e299675134d28bcc13d2c73b996a6, d7fcf132cb774583bd7967a84b418048
W20260709 12:57:52.770463   605 leader_election.cc:343] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d7fcf132cb774583bd7967a84b418048 (127.0.107.195:42711): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:52.770916   605 leader_election.cc:304] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 833e299675134d28bcc13d2c73b996a6; no voters: 40919529b3d6492d82e76f9cb44e6542, d7fcf132cb774583bd7967a84b418048
I20260709 12:57:52.765053   759 raft_consensus.cc:385] T d3bc6327504f44dab50a3f1663e18ef4 P 833e299675134d28bcc13d2c73b996a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:52.768806   758 tablet_bootstrap.cc:654] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P d7fcf132cb774583bd7967a84b418048: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:52.764930   798 consensus_queue.cc:237] T bd75112d105d4b269b9a7b422866104f P 833e299675134d28bcc13d2c73b996a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.773164   793 raft_consensus.cc:2749] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:57:52.773260   794 raft_consensus.cc:2749] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:57:52.774123   759 raft_consensus.cc:740] T d3bc6327504f44dab50a3f1663e18ef4 P 833e299675134d28bcc13d2c73b996a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 833e299675134d28bcc13d2c73b996a6, State: Initialized, Role: FOLLOWER
I20260709 12:57:52.779742   759 consensus_queue.cc:260] T d3bc6327504f44dab50a3f1663e18ef4 P 833e299675134d28bcc13d2c73b996a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.781667   715 raft_consensus.cc:2468] T 3b933fbc94f143caae7395db46bfa15c P d7fcf132cb774583bd7967a84b418048 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40919529b3d6492d82e76f9cb44e6542 in term 1.
I20260709 12:57:52.782991   530 leader_election.cc:304] T 3b933fbc94f143caae7395db46bfa15c P 40919529b3d6492d82e76f9cb44e6542 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40919529b3d6492d82e76f9cb44e6542, d7fcf132cb774583bd7967a84b418048; no voters: 833e299675134d28bcc13d2c73b996a6
I20260709 12:57:52.786408   794 raft_consensus.cc:2804] T 3b933fbc94f143caae7395db46bfa15c P 40919529b3d6492d82e76f9cb44e6542 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:52.788489   794 raft_consensus.cc:697] T 3b933fbc94f143caae7395db46bfa15c P 40919529b3d6492d82e76f9cb44e6542 [term 1 LEADER]: Becoming Leader. State: Replica: 40919529b3d6492d82e76f9cb44e6542, State: Running, Role: LEADER
I20260709 12:57:52.789330   794 consensus_queue.cc:237] T 3b933fbc94f143caae7395db46bfa15c P 40919529b3d6492d82e76f9cb44e6542 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.791535   760 tablet_bootstrap.cc:654] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 40919529b3d6492d82e76f9cb44e6542: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:52.796123   759 ts_tablet_manager.cc:1434] T d3bc6327504f44dab50a3f1663e18ef4 P 833e299675134d28bcc13d2c73b996a6: Time spent starting tablet: real 0.048s	user 0.009s	sys 0.001s
I20260709 12:57:52.797896   759 tablet_bootstrap.cc:492] T c48ae3b2d706406fad9295ac2ecdd688 P 833e299675134d28bcc13d2c73b996a6: Bootstrap starting.
I20260709 12:57:52.813608   461 catalog_manager.cc:5697] T ba302d819a4c420b861764d4a6b5fed2 P 833e299675134d28bcc13d2c73b996a6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 833e299675134d28bcc13d2c73b996a6 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "833e299675134d28bcc13d2c73b996a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:52.820729   759 tablet_bootstrap.cc:654] T c48ae3b2d706406fad9295ac2ecdd688 P 833e299675134d28bcc13d2c73b996a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:52.828280   758 tablet_bootstrap.cc:492] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P d7fcf132cb774583bd7967a84b418048: No bootstrap required, opened a new log
I20260709 12:57:52.829007   758 ts_tablet_manager.cc:1403] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P d7fcf132cb774583bd7967a84b418048: Time spent bootstrapping tablet: real 0.098s	user 0.016s	sys 0.011s
I20260709 12:57:52.839627   758 raft_consensus.cc:359] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P d7fcf132cb774583bd7967a84b418048 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.844801   759 tablet_bootstrap.cc:492] T c48ae3b2d706406fad9295ac2ecdd688 P 833e299675134d28bcc13d2c73b996a6: No bootstrap required, opened a new log
I20260709 12:57:52.845306   759 ts_tablet_manager.cc:1403] T c48ae3b2d706406fad9295ac2ecdd688 P 833e299675134d28bcc13d2c73b996a6: Time spent bootstrapping tablet: real 0.048s	user 0.015s	sys 0.013s
I20260709 12:57:52.850345   759 raft_consensus.cc:359] T c48ae3b2d706406fad9295ac2ecdd688 P 833e299675134d28bcc13d2c73b996a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.851187   759 raft_consensus.cc:385] T c48ae3b2d706406fad9295ac2ecdd688 P 833e299675134d28bcc13d2c73b996a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:52.851552   759 raft_consensus.cc:740] T c48ae3b2d706406fad9295ac2ecdd688 P 833e299675134d28bcc13d2c73b996a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 833e299675134d28bcc13d2c73b996a6, State: Initialized, Role: FOLLOWER
I20260709 12:57:52.852385   759 consensus_queue.cc:260] T c48ae3b2d706406fad9295ac2ecdd688 P 833e299675134d28bcc13d2c73b996a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.855031   759 ts_tablet_manager.cc:1434] T c48ae3b2d706406fad9295ac2ecdd688 P 833e299675134d28bcc13d2c73b996a6: Time spent starting tablet: real 0.009s	user 0.000s	sys 0.007s
I20260709 12:57:52.856053   759 tablet_bootstrap.cc:492] T 3b933fbc94f143caae7395db46bfa15c P 833e299675134d28bcc13d2c73b996a6: Bootstrap starting.
I20260709 12:57:52.848850   758 raft_consensus.cc:385] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P d7fcf132cb774583bd7967a84b418048 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:52.863471   758 raft_consensus.cc:740] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P d7fcf132cb774583bd7967a84b418048 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7fcf132cb774583bd7967a84b418048, State: Initialized, Role: FOLLOWER
I20260709 12:57:52.864804   758 consensus_queue.cc:260] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P d7fcf132cb774583bd7967a84b418048 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.871919   758 ts_tablet_manager.cc:1434] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P d7fcf132cb774583bd7967a84b418048: Time spent starting tablet: real 0.042s	user 0.010s	sys 0.001s
I20260709 12:57:52.874608   760 tablet_bootstrap.cc:492] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 40919529b3d6492d82e76f9cb44e6542: No bootstrap required, opened a new log
I20260709 12:57:52.875272   760 ts_tablet_manager.cc:1403] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 40919529b3d6492d82e76f9cb44e6542: Time spent bootstrapping tablet: real 0.170s	user 0.020s	sys 0.033s
I20260709 12:57:52.878072   759 tablet_bootstrap.cc:654] T 3b933fbc94f143caae7395db46bfa15c P 833e299675134d28bcc13d2c73b996a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:52.880059   760 raft_consensus.cc:359] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 40919529b3d6492d82e76f9cb44e6542 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.880873   760 raft_consensus.cc:385] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 40919529b3d6492d82e76f9cb44e6542 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:52.881209   760 raft_consensus.cc:740] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 40919529b3d6492d82e76f9cb44e6542 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40919529b3d6492d82e76f9cb44e6542, State: Initialized, Role: FOLLOWER
I20260709 12:57:52.882002   760 consensus_queue.cc:260] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 40919529b3d6492d82e76f9cb44e6542 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.885073   760 ts_tablet_manager.cc:1434] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 40919529b3d6492d82e76f9cb44e6542: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:57:52.886126   760 tablet_bootstrap.cc:492] T c48ae3b2d706406fad9295ac2ecdd688 P 40919529b3d6492d82e76f9cb44e6542: Bootstrap starting.
I20260709 12:57:52.879287   462 catalog_manager.cc:5697] T 3b933fbc94f143caae7395db46bfa15c P 40919529b3d6492d82e76f9cb44e6542 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "40919529b3d6492d82e76f9cb44e6542" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:52.893682   760 tablet_bootstrap.cc:654] T c48ae3b2d706406fad9295ac2ecdd688 P 40919529b3d6492d82e76f9cb44e6542: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:52.901053   461 catalog_manager.cc:5697] T bd75112d105d4b269b9a7b422866104f P 833e299675134d28bcc13d2c73b996a6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 833e299675134d28bcc13d2c73b996a6 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "833e299675134d28bcc13d2c73b996a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:52.905441   760 tablet_bootstrap.cc:492] T c48ae3b2d706406fad9295ac2ecdd688 P 40919529b3d6492d82e76f9cb44e6542: No bootstrap required, opened a new log
I20260709 12:57:52.905961   760 ts_tablet_manager.cc:1403] T c48ae3b2d706406fad9295ac2ecdd688 P 40919529b3d6492d82e76f9cb44e6542: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.006s
I20260709 12:57:52.909649   760 raft_consensus.cc:359] T c48ae3b2d706406fad9295ac2ecdd688 P 40919529b3d6492d82e76f9cb44e6542 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.910440   760 raft_consensus.cc:385] T c48ae3b2d706406fad9295ac2ecdd688 P 40919529b3d6492d82e76f9cb44e6542 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:52.910838   758 tablet_bootstrap.cc:492] T 2c2a2160a9fd483da791a5a8beb07ac6 P d7fcf132cb774583bd7967a84b418048: Bootstrap starting.
I20260709 12:57:52.910758   760 raft_consensus.cc:740] T c48ae3b2d706406fad9295ac2ecdd688 P 40919529b3d6492d82e76f9cb44e6542 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40919529b3d6492d82e76f9cb44e6542, State: Initialized, Role: FOLLOWER
I20260709 12:57:52.911875   760 consensus_queue.cc:260] T c48ae3b2d706406fad9295ac2ecdd688 P 40919529b3d6492d82e76f9cb44e6542 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.914530   760 ts_tablet_manager.cc:1434] T c48ae3b2d706406fad9295ac2ecdd688 P 40919529b3d6492d82e76f9cb44e6542: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 12:57:52.915531   760 tablet_bootstrap.cc:492] T ba302d819a4c420b861764d4a6b5fed2 P 40919529b3d6492d82e76f9cb44e6542: Bootstrap starting.
I20260709 12:57:52.923350   760 tablet_bootstrap.cc:654] T ba302d819a4c420b861764d4a6b5fed2 P 40919529b3d6492d82e76f9cb44e6542: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:52.931052   758 tablet_bootstrap.cc:654] T 2c2a2160a9fd483da791a5a8beb07ac6 P d7fcf132cb774583bd7967a84b418048: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:52.936226   760 tablet_bootstrap.cc:492] T ba302d819a4c420b861764d4a6b5fed2 P 40919529b3d6492d82e76f9cb44e6542: No bootstrap required, opened a new log
I20260709 12:57:52.937161   760 ts_tablet_manager.cc:1403] T ba302d819a4c420b861764d4a6b5fed2 P 40919529b3d6492d82e76f9cb44e6542: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.007s
I20260709 12:57:52.939339   759 tablet_bootstrap.cc:492] T 3b933fbc94f143caae7395db46bfa15c P 833e299675134d28bcc13d2c73b996a6: No bootstrap required, opened a new log
I20260709 12:57:52.939947   759 ts_tablet_manager.cc:1403] T 3b933fbc94f143caae7395db46bfa15c P 833e299675134d28bcc13d2c73b996a6: Time spent bootstrapping tablet: real 0.084s	user 0.021s	sys 0.029s
I20260709 12:57:52.941207   760 raft_consensus.cc:359] T ba302d819a4c420b861764d4a6b5fed2 P 40919529b3d6492d82e76f9cb44e6542 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.942283   760 raft_consensus.cc:385] T ba302d819a4c420b861764d4a6b5fed2 P 40919529b3d6492d82e76f9cb44e6542 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:52.942703   760 raft_consensus.cc:740] T ba302d819a4c420b861764d4a6b5fed2 P 40919529b3d6492d82e76f9cb44e6542 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40919529b3d6492d82e76f9cb44e6542, State: Initialized, Role: FOLLOWER
I20260709 12:57:52.943910   760 consensus_queue.cc:260] T ba302d819a4c420b861764d4a6b5fed2 P 40919529b3d6492d82e76f9cb44e6542 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.944410   759 raft_consensus.cc:359] T 3b933fbc94f143caae7395db46bfa15c P 833e299675134d28bcc13d2c73b996a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.945391   759 raft_consensus.cc:385] T 3b933fbc94f143caae7395db46bfa15c P 833e299675134d28bcc13d2c73b996a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:52.945803   759 raft_consensus.cc:740] T 3b933fbc94f143caae7395db46bfa15c P 833e299675134d28bcc13d2c73b996a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 833e299675134d28bcc13d2c73b996a6, State: Initialized, Role: FOLLOWER
I20260709 12:57:52.946957   759 consensus_queue.cc:260] T 3b933fbc94f143caae7395db46bfa15c P 833e299675134d28bcc13d2c73b996a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.947844   760 ts_tablet_manager.cc:1434] T ba302d819a4c420b861764d4a6b5fed2 P 40919529b3d6492d82e76f9cb44e6542: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:57:52.949261   760 tablet_bootstrap.cc:492] T 8e1e26ad8acd4644857773d9c53d3ff2 P 40919529b3d6492d82e76f9cb44e6542: Bootstrap starting.
W20260709 12:57:52.956166   510 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:57:52.959862   758 tablet_bootstrap.cc:492] T 2c2a2160a9fd483da791a5a8beb07ac6 P d7fcf132cb774583bd7967a84b418048: No bootstrap required, opened a new log
I20260709 12:57:52.960290   760 tablet_bootstrap.cc:654] T 8e1e26ad8acd4644857773d9c53d3ff2 P 40919529b3d6492d82e76f9cb44e6542: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:52.960369   758 ts_tablet_manager.cc:1403] T 2c2a2160a9fd483da791a5a8beb07ac6 P d7fcf132cb774583bd7967a84b418048: Time spent bootstrapping tablet: real 0.050s	user 0.019s	sys 0.014s
I20260709 12:57:52.961531   759 ts_tablet_manager.cc:1434] T 3b933fbc94f143caae7395db46bfa15c P 833e299675134d28bcc13d2c73b996a6: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 12:57:52.962687   759 tablet_bootstrap.cc:492] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 833e299675134d28bcc13d2c73b996a6: Bootstrap starting.
I20260709 12:57:52.963480   758 raft_consensus.cc:359] T 2c2a2160a9fd483da791a5a8beb07ac6 P d7fcf132cb774583bd7967a84b418048 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.964465   758 raft_consensus.cc:385] T 2c2a2160a9fd483da791a5a8beb07ac6 P d7fcf132cb774583bd7967a84b418048 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:52.964862   758 raft_consensus.cc:740] T 2c2a2160a9fd483da791a5a8beb07ac6 P d7fcf132cb774583bd7967a84b418048 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7fcf132cb774583bd7967a84b418048, State: Initialized, Role: FOLLOWER
I20260709 12:57:52.965996   758 consensus_queue.cc:260] T 2c2a2160a9fd483da791a5a8beb07ac6 P d7fcf132cb774583bd7967a84b418048 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.968468   758 ts_tablet_manager.cc:1434] T 2c2a2160a9fd483da791a5a8beb07ac6 P d7fcf132cb774583bd7967a84b418048: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:57:52.969406   758 tablet_bootstrap.cc:492] T 741777b7834d4f5e80bd0187702907dc P d7fcf132cb774583bd7967a84b418048: Bootstrap starting.
I20260709 12:57:52.971697   759 tablet_bootstrap.cc:654] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 833e299675134d28bcc13d2c73b996a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:52.974668   766 raft_consensus.cc:493] T 2c2a2160a9fd483da791a5a8beb07ac6 P d7fcf132cb774583bd7967a84b418048 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:52.975203   766 raft_consensus.cc:515] T 2c2a2160a9fd483da791a5a8beb07ac6 P d7fcf132cb774583bd7967a84b418048 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.976025   758 tablet_bootstrap.cc:654] T 741777b7834d4f5e80bd0187702907dc P d7fcf132cb774583bd7967a84b418048: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:52.977756   766 leader_election.cc:290] T 2c2a2160a9fd483da791a5a8beb07ac6 P d7fcf132cb774583bd7967a84b418048 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193:34223), 833e299675134d28bcc13d2c73b996a6 (127.0.107.194:39403)
I20260709 12:57:52.980460   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2a2160a9fd483da791a5a8beb07ac6" candidate_uuid: "d7fcf132cb774583bd7967a84b418048" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40919529b3d6492d82e76f9cb44e6542" is_pre_election: true
I20260709 12:57:52.988198   759 tablet_bootstrap.cc:492] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 833e299675134d28bcc13d2c73b996a6: No bootstrap required, opened a new log
I20260709 12:57:52.988433   758 tablet_bootstrap.cc:492] T 741777b7834d4f5e80bd0187702907dc P d7fcf132cb774583bd7967a84b418048: No bootstrap required, opened a new log
I20260709 12:57:52.988677   759 ts_tablet_manager.cc:1403] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 833e299675134d28bcc13d2c73b996a6: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.005s
I20260709 12:57:52.988895   758 ts_tablet_manager.cc:1403] T 741777b7834d4f5e80bd0187702907dc P d7fcf132cb774583bd7967a84b418048: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.008s
I20260709 12:57:52.991333   759 raft_consensus.cc:359] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 833e299675134d28bcc13d2c73b996a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.991991   759 raft_consensus.cc:385] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 833e299675134d28bcc13d2c73b996a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:52.991632   758 raft_consensus.cc:359] T 741777b7834d4f5e80bd0187702907dc P d7fcf132cb774583bd7967a84b418048 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.992288   759 raft_consensus.cc:740] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 833e299675134d28bcc13d2c73b996a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 833e299675134d28bcc13d2c73b996a6, State: Initialized, Role: FOLLOWER
I20260709 12:57:52.992461   758 raft_consensus.cc:385] T 741777b7834d4f5e80bd0187702907dc P d7fcf132cb774583bd7967a84b418048 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:52.992815   758 raft_consensus.cc:740] T 741777b7834d4f5e80bd0187702907dc P d7fcf132cb774583bd7967a84b418048 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7fcf132cb774583bd7967a84b418048, State: Initialized, Role: FOLLOWER
I20260709 12:57:52.993014   798 raft_consensus.cc:493] T 3b933fbc94f143caae7395db46bfa15c P 833e299675134d28bcc13d2c73b996a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:52.993497   798 raft_consensus.cc:515] T 3b933fbc94f143caae7395db46bfa15c P 833e299675134d28bcc13d2c73b996a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.993592   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2a2160a9fd483da791a5a8beb07ac6" candidate_uuid: "d7fcf132cb774583bd7967a84b418048" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "833e299675134d28bcc13d2c73b996a6" is_pre_election: true
I20260709 12:57:52.993649   758 consensus_queue.cc:260] T 741777b7834d4f5e80bd0187702907dc P d7fcf132cb774583bd7967a84b418048 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.995226   794 raft_consensus.cc:493] T c48ae3b2d706406fad9295ac2ecdd688 P 40919529b3d6492d82e76f9cb44e6542 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:52.995546   798 leader_election.cc:290] T 3b933fbc94f143caae7395db46bfa15c P 833e299675134d28bcc13d2c73b996a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193:34223), d7fcf132cb774583bd7967a84b418048 (127.0.107.195:42711)
I20260709 12:57:52.993014   759 consensus_queue.cc:260] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 833e299675134d28bcc13d2c73b996a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.995723   794 raft_consensus.cc:515] T c48ae3b2d706406fad9295ac2ecdd688 P 40919529b3d6492d82e76f9cb44e6542 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:52.996179   758 ts_tablet_manager.cc:1434] T 741777b7834d4f5e80bd0187702907dc P d7fcf132cb774583bd7967a84b418048: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:57:53.003786   759 ts_tablet_manager.cc:1434] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 833e299675134d28bcc13d2c73b996a6: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
W20260709 12:57:53.004056   680 leader_election.cc:343] T 2c2a2160a9fd483da791a5a8beb07ac6 P d7fcf132cb774583bd7967a84b418048 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 833e299675134d28bcc13d2c73b996a6 (127.0.107.194:39403): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:53.004684   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b933fbc94f143caae7395db46bfa15c" candidate_uuid: "833e299675134d28bcc13d2c73b996a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40919529b3d6492d82e76f9cb44e6542" is_pre_election: true
W20260709 12:57:53.005183   680 leader_election.cc:343] T 2c2a2160a9fd483da791a5a8beb07ac6 P d7fcf132cb774583bd7967a84b418048 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193:34223): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:57:53.005640   680 leader_election.cc:304] T 2c2a2160a9fd483da791a5a8beb07ac6 P d7fcf132cb774583bd7967a84b418048 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7fcf132cb774583bd7967a84b418048; no voters: 40919529b3d6492d82e76f9cb44e6542, 833e299675134d28bcc13d2c73b996a6
I20260709 12:57:53.005980   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b933fbc94f143caae7395db46bfa15c" candidate_uuid: "833e299675134d28bcc13d2c73b996a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fcf132cb774583bd7967a84b418048" is_pre_election: true
I20260709 12:57:53.006742   715 raft_consensus.cc:2393] T 3b933fbc94f143caae7395db46bfa15c P d7fcf132cb774583bd7967a84b418048 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 833e299675134d28bcc13d2c73b996a6 in current term 1: Already voted for candidate 40919529b3d6492d82e76f9cb44e6542 in this term.
I20260709 12:57:53.008071   794 leader_election.cc:290] T c48ae3b2d706406fad9295ac2ecdd688 P 40919529b3d6492d82e76f9cb44e6542 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 833e299675134d28bcc13d2c73b996a6 (127.0.107.194:39403), d7fcf132cb774583bd7967a84b418048 (127.0.107.195:42711)
I20260709 12:57:53.008627   766 raft_consensus.cc:2749] T 2c2a2160a9fd483da791a5a8beb07ac6 P d7fcf132cb774583bd7967a84b418048 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:53.009137   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48ae3b2d706406fad9295ac2ecdd688" candidate_uuid: "40919529b3d6492d82e76f9cb44e6542" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "833e299675134d28bcc13d2c73b996a6" is_pre_election: true
I20260709 12:57:53.009714   640 raft_consensus.cc:2468] T c48ae3b2d706406fad9295ac2ecdd688 P 833e299675134d28bcc13d2c73b996a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40919529b3d6492d82e76f9cb44e6542 in term 0.
I20260709 12:57:53.010872   531 leader_election.cc:304] T c48ae3b2d706406fad9295ac2ecdd688 P 40919529b3d6492d82e76f9cb44e6542 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40919529b3d6492d82e76f9cb44e6542, 833e299675134d28bcc13d2c73b996a6; no voters: 
I20260709 12:57:53.013134   759 tablet_bootstrap.cc:492] T 2c2a2160a9fd483da791a5a8beb07ac6 P 833e299675134d28bcc13d2c73b996a6: Bootstrap starting.
I20260709 12:57:53.011670   794 raft_consensus.cc:2804] T c48ae3b2d706406fad9295ac2ecdd688 P 40919529b3d6492d82e76f9cb44e6542 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:53.013883   794 raft_consensus.cc:493] T c48ae3b2d706406fad9295ac2ecdd688 P 40919529b3d6492d82e76f9cb44e6542 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:53.014190   794 raft_consensus.cc:3060] T c48ae3b2d706406fad9295ac2ecdd688 P 40919529b3d6492d82e76f9cb44e6542 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:53.018858   605 leader_election.cc:304] T 3b933fbc94f143caae7395db46bfa15c P 833e299675134d28bcc13d2c73b996a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 833e299675134d28bcc13d2c73b996a6; no voters: 40919529b3d6492d82e76f9cb44e6542, d7fcf132cb774583bd7967a84b418048
I20260709 12:57:53.019691   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48ae3b2d706406fad9295ac2ecdd688" candidate_uuid: "40919529b3d6492d82e76f9cb44e6542" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fcf132cb774583bd7967a84b418048" is_pre_election: true
I20260709 12:57:53.019850   798 raft_consensus.cc:3060] T 3b933fbc94f143caae7395db46bfa15c P 833e299675134d28bcc13d2c73b996a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:53.020324   715 raft_consensus.cc:2468] T c48ae3b2d706406fad9295ac2ecdd688 P d7fcf132cb774583bd7967a84b418048 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40919529b3d6492d82e76f9cb44e6542 in term 0.
I20260709 12:57:53.024376   760 tablet_bootstrap.cc:492] T 8e1e26ad8acd4644857773d9c53d3ff2 P 40919529b3d6492d82e76f9cb44e6542: No bootstrap required, opened a new log
I20260709 12:57:53.024111   794 raft_consensus.cc:515] T c48ae3b2d706406fad9295ac2ecdd688 P 40919529b3d6492d82e76f9cb44e6542 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:53.024940   760 ts_tablet_manager.cc:1403] T 8e1e26ad8acd4644857773d9c53d3ff2 P 40919529b3d6492d82e76f9cb44e6542: Time spent bootstrapping tablet: real 0.076s	user 0.012s	sys 0.008s
I20260709 12:57:53.026705   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48ae3b2d706406fad9295ac2ecdd688" candidate_uuid: "40919529b3d6492d82e76f9cb44e6542" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "833e299675134d28bcc13d2c73b996a6"
I20260709 12:57:53.027231   640 raft_consensus.cc:3060] T c48ae3b2d706406fad9295ac2ecdd688 P 833e299675134d28bcc13d2c73b996a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:53.027901   798 raft_consensus.cc:2749] T 3b933fbc94f143caae7395db46bfa15c P 833e299675134d28bcc13d2c73b996a6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:53.028136   760 raft_consensus.cc:359] T 8e1e26ad8acd4644857773d9c53d3ff2 P 40919529b3d6492d82e76f9cb44e6542 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:53.028826   760 raft_consensus.cc:385] T 8e1e26ad8acd4644857773d9c53d3ff2 P 40919529b3d6492d82e76f9cb44e6542 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:53.029057   760 raft_consensus.cc:740] T 8e1e26ad8acd4644857773d9c53d3ff2 P 40919529b3d6492d82e76f9cb44e6542 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40919529b3d6492d82e76f9cb44e6542, State: Initialized, Role: FOLLOWER
I20260709 12:57:53.029573   760 consensus_queue.cc:260] T 8e1e26ad8acd4644857773d9c53d3ff2 P 40919529b3d6492d82e76f9cb44e6542 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:53.031716   760 ts_tablet_manager.cc:1434] T 8e1e26ad8acd4644857773d9c53d3ff2 P 40919529b3d6492d82e76f9cb44e6542: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:57:53.032575   760 tablet_bootstrap.cc:492] T 2c2a2160a9fd483da791a5a8beb07ac6 P 40919529b3d6492d82e76f9cb44e6542: Bootstrap starting.
I20260709 12:57:53.034125   640 raft_consensus.cc:2468] T c48ae3b2d706406fad9295ac2ecdd688 P 833e299675134d28bcc13d2c73b996a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40919529b3d6492d82e76f9cb44e6542 in term 1.
I20260709 12:57:53.035178   531 leader_election.cc:304] T c48ae3b2d706406fad9295ac2ecdd688 P 40919529b3d6492d82e76f9cb44e6542 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40919529b3d6492d82e76f9cb44e6542, 833e299675134d28bcc13d2c73b996a6; no voters: 
I20260709 12:57:53.035917   791 raft_consensus.cc:2804] T c48ae3b2d706406fad9295ac2ecdd688 P 40919529b3d6492d82e76f9cb44e6542 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:53.036366   791 raft_consensus.cc:697] T c48ae3b2d706406fad9295ac2ecdd688 P 40919529b3d6492d82e76f9cb44e6542 [term 1 LEADER]: Becoming Leader. State: Replica: 40919529b3d6492d82e76f9cb44e6542, State: Running, Role: LEADER
I20260709 12:57:53.037123   791 consensus_queue.cc:237] T c48ae3b2d706406fad9295ac2ecdd688 P 40919529b3d6492d82e76f9cb44e6542 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:53.037813   760 tablet_bootstrap.cc:654] T 2c2a2160a9fd483da791a5a8beb07ac6 P 40919529b3d6492d82e76f9cb44e6542: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:53.045915   794 leader_election.cc:290] T c48ae3b2d706406fad9295ac2ecdd688 P 40919529b3d6492d82e76f9cb44e6542 [CANDIDATE]: Term 1 election: Requested vote from peers 833e299675134d28bcc13d2c73b996a6 (127.0.107.194:39403), d7fcf132cb774583bd7967a84b418048 (127.0.107.195:42711)
I20260709 12:57:53.047546   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48ae3b2d706406fad9295ac2ecdd688" candidate_uuid: "40919529b3d6492d82e76f9cb44e6542" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fcf132cb774583bd7967a84b418048"
I20260709 12:57:53.048629   715 raft_consensus.cc:3060] T c48ae3b2d706406fad9295ac2ecdd688 P d7fcf132cb774583bd7967a84b418048 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:53.056632   759 tablet_bootstrap.cc:654] T 2c2a2160a9fd483da791a5a8beb07ac6 P 833e299675134d28bcc13d2c73b996a6: Neither blocks nor log segments found. Creating new log.
I20260709 12:57:53.065599   759 tablet_bootstrap.cc:492] T 2c2a2160a9fd483da791a5a8beb07ac6 P 833e299675134d28bcc13d2c73b996a6: No bootstrap required, opened a new log
I20260709 12:57:53.066039   759 ts_tablet_manager.cc:1403] T 2c2a2160a9fd483da791a5a8beb07ac6 P 833e299675134d28bcc13d2c73b996a6: Time spent bootstrapping tablet: real 0.053s	user 0.008s	sys 0.004s
I20260709 12:57:53.068456   759 raft_consensus.cc:359] T 2c2a2160a9fd483da791a5a8beb07ac6 P 833e299675134d28bcc13d2c73b996a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:53.069108   759 raft_consensus.cc:385] T 2c2a2160a9fd483da791a5a8beb07ac6 P 833e299675134d28bcc13d2c73b996a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:53.069367   759 raft_consensus.cc:740] T 2c2a2160a9fd483da791a5a8beb07ac6 P 833e299675134d28bcc13d2c73b996a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 833e299675134d28bcc13d2c73b996a6, State: Initialized, Role: FOLLOWER
I20260709 12:57:53.070011   759 consensus_queue.cc:260] T 2c2a2160a9fd483da791a5a8beb07ac6 P 833e299675134d28bcc13d2c73b996a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:53.064639   460 catalog_manager.cc:5697] T c48ae3b2d706406fad9295ac2ecdd688 P 40919529b3d6492d82e76f9cb44e6542 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "40919529b3d6492d82e76f9cb44e6542" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:53.074172   759 ts_tablet_manager.cc:1434] T 2c2a2160a9fd483da791a5a8beb07ac6 P 833e299675134d28bcc13d2c73b996a6: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:57:53.071945   760 tablet_bootstrap.cc:492] T 2c2a2160a9fd483da791a5a8beb07ac6 P 40919529b3d6492d82e76f9cb44e6542: No bootstrap required, opened a new log
I20260709 12:57:53.078219   760 ts_tablet_manager.cc:1403] T 2c2a2160a9fd483da791a5a8beb07ac6 P 40919529b3d6492d82e76f9cb44e6542: Time spent bootstrapping tablet: real 0.046s	user 0.016s	sys 0.022s
I20260709 12:57:53.081779   760 raft_consensus.cc:359] T 2c2a2160a9fd483da791a5a8beb07ac6 P 40919529b3d6492d82e76f9cb44e6542 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:53.082564   760 raft_consensus.cc:385] T 2c2a2160a9fd483da791a5a8beb07ac6 P 40919529b3d6492d82e76f9cb44e6542 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:57:53.082876   760 raft_consensus.cc:740] T 2c2a2160a9fd483da791a5a8beb07ac6 P 40919529b3d6492d82e76f9cb44e6542 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40919529b3d6492d82e76f9cb44e6542, State: Initialized, Role: FOLLOWER
I20260709 12:57:53.073418   715 raft_consensus.cc:2468] T c48ae3b2d706406fad9295ac2ecdd688 P d7fcf132cb774583bd7967a84b418048 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40919529b3d6492d82e76f9cb44e6542 in term 1.
I20260709 12:57:53.083585   760 consensus_queue.cc:260] T 2c2a2160a9fd483da791a5a8beb07ac6 P 40919529b3d6492d82e76f9cb44e6542 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:53.086130   760 ts_tablet_manager.cc:1434] T 2c2a2160a9fd483da791a5a8beb07ac6 P 40919529b3d6492d82e76f9cb44e6542: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:57:53.089092   798 raft_consensus.cc:493] T d3bc6327504f44dab50a3f1663e18ef4 P 833e299675134d28bcc13d2c73b996a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:53.089566   798 raft_consensus.cc:515] T d3bc6327504f44dab50a3f1663e18ef4 P 833e299675134d28bcc13d2c73b996a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:53.091609   798 leader_election.cc:290] T d3bc6327504f44dab50a3f1663e18ef4 P 833e299675134d28bcc13d2c73b996a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193:34223), d7fcf132cb774583bd7967a84b418048 (127.0.107.195:42711)
I20260709 12:57:53.092414   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3bc6327504f44dab50a3f1663e18ef4" candidate_uuid: "833e299675134d28bcc13d2c73b996a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40919529b3d6492d82e76f9cb44e6542" is_pre_election: true
I20260709 12:57:53.092819   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3bc6327504f44dab50a3f1663e18ef4" candidate_uuid: "833e299675134d28bcc13d2c73b996a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fcf132cb774583bd7967a84b418048" is_pre_election: true
I20260709 12:57:53.093887   715 raft_consensus.cc:2393] T d3bc6327504f44dab50a3f1663e18ef4 P d7fcf132cb774583bd7967a84b418048 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 833e299675134d28bcc13d2c73b996a6 in current term 1: Already voted for candidate 40919529b3d6492d82e76f9cb44e6542 in this term.
I20260709 12:57:53.097431   605 leader_election.cc:304] T d3bc6327504f44dab50a3f1663e18ef4 P 833e299675134d28bcc13d2c73b996a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 833e299675134d28bcc13d2c73b996a6; no voters: 40919529b3d6492d82e76f9cb44e6542, d7fcf132cb774583bd7967a84b418048
I20260709 12:57:53.098218   798 raft_consensus.cc:3060] T d3bc6327504f44dab50a3f1663e18ef4 P 833e299675134d28bcc13d2c73b996a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:53.104749   798 raft_consensus.cc:2749] T d3bc6327504f44dab50a3f1663e18ef4 P 833e299675134d28bcc13d2c73b996a6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:53.145398   766 raft_consensus.cc:493] T bd75112d105d4b269b9a7b422866104f P d7fcf132cb774583bd7967a84b418048 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:53.146123   766 raft_consensus.cc:515] T bd75112d105d4b269b9a7b422866104f P d7fcf132cb774583bd7967a84b418048 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:53.147929   766 leader_election.cc:290] T bd75112d105d4b269b9a7b422866104f P d7fcf132cb774583bd7967a84b418048 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193:34223), 833e299675134d28bcc13d2c73b996a6 (127.0.107.194:39403)
I20260709 12:57:53.148942   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd75112d105d4b269b9a7b422866104f" candidate_uuid: "d7fcf132cb774583bd7967a84b418048" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40919529b3d6492d82e76f9cb44e6542" is_pre_election: true
I20260709 12:57:53.149106   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd75112d105d4b269b9a7b422866104f" candidate_uuid: "d7fcf132cb774583bd7967a84b418048" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "833e299675134d28bcc13d2c73b996a6" is_pre_election: true
I20260709 12:57:53.149766   565 raft_consensus.cc:2393] T bd75112d105d4b269b9a7b422866104f P 40919529b3d6492d82e76f9cb44e6542 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7fcf132cb774583bd7967a84b418048 in current term 1: Already voted for candidate 833e299675134d28bcc13d2c73b996a6 in this term.
I20260709 12:57:53.151170   680 leader_election.cc:304] T bd75112d105d4b269b9a7b422866104f P d7fcf132cb774583bd7967a84b418048 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7fcf132cb774583bd7967a84b418048; no voters: 40919529b3d6492d82e76f9cb44e6542, 833e299675134d28bcc13d2c73b996a6
I20260709 12:57:53.151875   766 raft_consensus.cc:3060] T bd75112d105d4b269b9a7b422866104f P d7fcf132cb774583bd7967a84b418048 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:53.156627   766 raft_consensus.cc:2749] T bd75112d105d4b269b9a7b422866104f P d7fcf132cb774583bd7967a84b418048 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:53.161036   766 raft_consensus.cc:493] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P d7fcf132cb774583bd7967a84b418048 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:53.161459   766 raft_consensus.cc:515] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P d7fcf132cb774583bd7967a84b418048 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:53.163287   766 leader_election.cc:290] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P d7fcf132cb774583bd7967a84b418048 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193:34223), 833e299675134d28bcc13d2c73b996a6 (127.0.107.194:39403)
I20260709 12:57:53.164206   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf93bacf15045e3bbfc2b0d7c51dbd8" candidate_uuid: "d7fcf132cb774583bd7967a84b418048" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40919529b3d6492d82e76f9cb44e6542" is_pre_election: true
I20260709 12:57:53.164423   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf93bacf15045e3bbfc2b0d7c51dbd8" candidate_uuid: "d7fcf132cb774583bd7967a84b418048" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "833e299675134d28bcc13d2c73b996a6" is_pre_election: true
I20260709 12:57:53.164795   565 raft_consensus.cc:2468] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 40919529b3d6492d82e76f9cb44e6542 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7fcf132cb774583bd7967a84b418048 in term 0.
I20260709 12:57:53.165096   640 raft_consensus.cc:2468] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 833e299675134d28bcc13d2c73b996a6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7fcf132cb774583bd7967a84b418048 in term 0.
I20260709 12:57:53.166047   680 leader_election.cc:304] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P d7fcf132cb774583bd7967a84b418048 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40919529b3d6492d82e76f9cb44e6542, d7fcf132cb774583bd7967a84b418048; no voters: 
I20260709 12:57:53.167263   789 raft_consensus.cc:2804] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P d7fcf132cb774583bd7967a84b418048 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:53.167652   789 raft_consensus.cc:493] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P d7fcf132cb774583bd7967a84b418048 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:53.168030   789 raft_consensus.cc:3060] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P d7fcf132cb774583bd7967a84b418048 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:53.172879   789 raft_consensus.cc:515] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P d7fcf132cb774583bd7967a84b418048 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:53.175104   789 leader_election.cc:290] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P d7fcf132cb774583bd7967a84b418048 [CANDIDATE]: Term 1 election: Requested vote from peers 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193:34223), 833e299675134d28bcc13d2c73b996a6 (127.0.107.194:39403)
I20260709 12:57:53.175477   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf93bacf15045e3bbfc2b0d7c51dbd8" candidate_uuid: "d7fcf132cb774583bd7967a84b418048" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40919529b3d6492d82e76f9cb44e6542"
I20260709 12:57:53.176108   565 raft_consensus.cc:3060] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 40919529b3d6492d82e76f9cb44e6542 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:53.176678   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf93bacf15045e3bbfc2b0d7c51dbd8" candidate_uuid: "d7fcf132cb774583bd7967a84b418048" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "833e299675134d28bcc13d2c73b996a6"
I20260709 12:57:53.177218   640 raft_consensus.cc:3060] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 833e299675134d28bcc13d2c73b996a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:53.179652   792 consensus_queue.cc:1048] T 3b933fbc94f143caae7395db46bfa15c P 40919529b3d6492d82e76f9cb44e6542 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:53.183527   565 raft_consensus.cc:2468] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 40919529b3d6492d82e76f9cb44e6542 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7fcf132cb774583bd7967a84b418048 in term 1.
I20260709 12:57:53.184701   680 leader_election.cc:304] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P d7fcf132cb774583bd7967a84b418048 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40919529b3d6492d82e76f9cb44e6542, d7fcf132cb774583bd7967a84b418048; no voters: 
I20260709 12:57:53.184867   640 raft_consensus.cc:2468] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 833e299675134d28bcc13d2c73b996a6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7fcf132cb774583bd7967a84b418048 in term 1.
I20260709 12:57:53.186326   789 raft_consensus.cc:2804] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P d7fcf132cb774583bd7967a84b418048 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:53.186964   789 raft_consensus.cc:697] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P d7fcf132cb774583bd7967a84b418048 [term 1 LEADER]: Becoming Leader. State: Replica: d7fcf132cb774583bd7967a84b418048, State: Running, Role: LEADER
I20260709 12:57:53.187896   789 consensus_queue.cc:237] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P d7fcf132cb774583bd7967a84b418048 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:53.191256   565 raft_consensus.cc:3060] T 8e1e26ad8acd4644857773d9c53d3ff2 P 40919529b3d6492d82e76f9cb44e6542 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:53.203994   794 consensus_queue.cc:1048] T 3b933fbc94f143caae7395db46bfa15c P 40919529b3d6492d82e76f9cb44e6542 [LEADER]: Connected to new peer: Peer: permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:53.205269   791 raft_consensus.cc:493] T ba302d819a4c420b861764d4a6b5fed2 P 40919529b3d6492d82e76f9cb44e6542 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:53.205827   791 raft_consensus.cc:515] T ba302d819a4c420b861764d4a6b5fed2 P 40919529b3d6492d82e76f9cb44e6542 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:53.208263   791 leader_election.cc:290] T ba302d819a4c420b861764d4a6b5fed2 P 40919529b3d6492d82e76f9cb44e6542 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 833e299675134d28bcc13d2c73b996a6 (127.0.107.194:39403), d7fcf132cb774583bd7967a84b418048 (127.0.107.195:42711)
I20260709 12:57:53.210403   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba302d819a4c420b861764d4a6b5fed2" candidate_uuid: "40919529b3d6492d82e76f9cb44e6542" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "833e299675134d28bcc13d2c73b996a6" is_pre_election: true
I20260709 12:57:53.219933   789 consensus_queue.cc:1048] T 8e1e26ad8acd4644857773d9c53d3ff2 P d7fcf132cb774583bd7967a84b418048 [LEADER]: Connected to new peer: Peer: permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:53.221099   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba302d819a4c420b861764d4a6b5fed2" candidate_uuid: "40919529b3d6492d82e76f9cb44e6542" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fcf132cb774583bd7967a84b418048" is_pre_election: true
I20260709 12:57:53.220482   460 catalog_manager.cc:5697] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P d7fcf132cb774583bd7967a84b418048 reported cstate change: term changed from 0 to 1, leader changed from <none> to d7fcf132cb774583bd7967a84b418048 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "d7fcf132cb774583bd7967a84b418048" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:53.222384   715 raft_consensus.cc:2393] T ba302d819a4c420b861764d4a6b5fed2 P d7fcf132cb774583bd7967a84b418048 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40919529b3d6492d82e76f9cb44e6542 in current term 1: Already voted for candidate 833e299675134d28bcc13d2c73b996a6 in this term.
I20260709 12:57:53.222492   823 consensus_queue.cc:1048] T 8e1e26ad8acd4644857773d9c53d3ff2 P d7fcf132cb774583bd7967a84b418048 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:53.223941   530 leader_election.cc:304] T ba302d819a4c420b861764d4a6b5fed2 P 40919529b3d6492d82e76f9cb44e6542 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40919529b3d6492d82e76f9cb44e6542; no voters: 833e299675134d28bcc13d2c73b996a6, d7fcf132cb774583bd7967a84b418048
I20260709 12:57:53.225031   791 raft_consensus.cc:3060] T ba302d819a4c420b861764d4a6b5fed2 P 40919529b3d6492d82e76f9cb44e6542 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:53.235126   798 consensus_queue.cc:1048] T bd75112d105d4b269b9a7b422866104f P 833e299675134d28bcc13d2c73b996a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:53.235806   791 raft_consensus.cc:2749] T ba302d819a4c420b861764d4a6b5fed2 P 40919529b3d6492d82e76f9cb44e6542 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:53.268962   797 consensus_queue.cc:1048] T bd75112d105d4b269b9a7b422866104f P 833e299675134d28bcc13d2c73b996a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:53.273532   794 consensus_queue.cc:1048] T d3bc6327504f44dab50a3f1663e18ef4 P 40919529b3d6492d82e76f9cb44e6542 [LEADER]: Connected to new peer: Peer: permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:53.282377   797 consensus_queue.cc:1048] T ba302d819a4c420b861764d4a6b5fed2 P 833e299675134d28bcc13d2c73b996a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:53.308634   792 consensus_queue.cc:1048] T d3bc6327504f44dab50a3f1663e18ef4 P 40919529b3d6492d82e76f9cb44e6542 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:53.320454   797 consensus_queue.cc:1048] T ba302d819a4c420b861764d4a6b5fed2 P 833e299675134d28bcc13d2c73b996a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:53.375877   789 raft_consensus.cc:493] T 741777b7834d4f5e80bd0187702907dc P d7fcf132cb774583bd7967a84b418048 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:53.376377   789 raft_consensus.cc:515] T 741777b7834d4f5e80bd0187702907dc P d7fcf132cb774583bd7967a84b418048 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:53.377012   797 raft_consensus.cc:493] T 2c2a2160a9fd483da791a5a8beb07ac6 P 833e299675134d28bcc13d2c73b996a6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:53.377480   797 raft_consensus.cc:515] T 2c2a2160a9fd483da791a5a8beb07ac6 P 833e299675134d28bcc13d2c73b996a6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:53.378839   789 leader_election.cc:290] T 741777b7834d4f5e80bd0187702907dc P d7fcf132cb774583bd7967a84b418048 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193:34223), 833e299675134d28bcc13d2c73b996a6 (127.0.107.194:39403)
I20260709 12:57:53.380251   797 leader_election.cc:290] T 2c2a2160a9fd483da791a5a8beb07ac6 P 833e299675134d28bcc13d2c73b996a6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193:34223), d7fcf132cb774583bd7967a84b418048 (127.0.107.195:42711)
I20260709 12:57:53.380226   565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2a2160a9fd483da791a5a8beb07ac6" candidate_uuid: "833e299675134d28bcc13d2c73b996a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40919529b3d6492d82e76f9cb44e6542" is_pre_election: true
I20260709 12:57:53.379864   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "741777b7834d4f5e80bd0187702907dc" candidate_uuid: "d7fcf132cb774583bd7967a84b418048" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40919529b3d6492d82e76f9cb44e6542" is_pre_election: true
I20260709 12:57:53.381004   565 raft_consensus.cc:2468] T 2c2a2160a9fd483da791a5a8beb07ac6 P 40919529b3d6492d82e76f9cb44e6542 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 833e299675134d28bcc13d2c73b996a6 in term 0.
I20260709 12:57:53.381421   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2a2160a9fd483da791a5a8beb07ac6" candidate_uuid: "833e299675134d28bcc13d2c73b996a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fcf132cb774583bd7967a84b418048" is_pre_election: true
I20260709 12:57:53.381696   566 raft_consensus.cc:2393] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7fcf132cb774583bd7967a84b418048 in current term 1: Already voted for candidate 40919529b3d6492d82e76f9cb44e6542 in this term.
I20260709 12:57:53.382026   713 raft_consensus.cc:2468] T 2c2a2160a9fd483da791a5a8beb07ac6 P d7fcf132cb774583bd7967a84b418048 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 833e299675134d28bcc13d2c73b996a6 in term 0.
I20260709 12:57:53.382292   606 leader_election.cc:304] T 2c2a2160a9fd483da791a5a8beb07ac6 P 833e299675134d28bcc13d2c73b996a6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40919529b3d6492d82e76f9cb44e6542, 833e299675134d28bcc13d2c73b996a6; no voters: 
I20260709 12:57:53.383050   797 raft_consensus.cc:2804] T 2c2a2160a9fd483da791a5a8beb07ac6 P 833e299675134d28bcc13d2c73b996a6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:57:53.383291   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "741777b7834d4f5e80bd0187702907dc" candidate_uuid: "d7fcf132cb774583bd7967a84b418048" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "833e299675134d28bcc13d2c73b996a6" is_pre_election: true
I20260709 12:57:53.383461   797 raft_consensus.cc:493] T 2c2a2160a9fd483da791a5a8beb07ac6 P 833e299675134d28bcc13d2c73b996a6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:53.383841   797 raft_consensus.cc:3060] T 2c2a2160a9fd483da791a5a8beb07ac6 P 833e299675134d28bcc13d2c73b996a6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:53.384057   641 raft_consensus.cc:2393] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d7fcf132cb774583bd7967a84b418048 in current term 1: Already voted for candidate 833e299675134d28bcc13d2c73b996a6 in this term.
I20260709 12:57:53.385044   680 leader_election.cc:304] T 741777b7834d4f5e80bd0187702907dc P d7fcf132cb774583bd7967a84b418048 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d7fcf132cb774583bd7967a84b418048; no voters: 40919529b3d6492d82e76f9cb44e6542, 833e299675134d28bcc13d2c73b996a6
I20260709 12:57:53.385679   789 raft_consensus.cc:3060] T 741777b7834d4f5e80bd0187702907dc P d7fcf132cb774583bd7967a84b418048 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:53.390295   789 raft_consensus.cc:2749] T 741777b7834d4f5e80bd0187702907dc P d7fcf132cb774583bd7967a84b418048 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:57:53.390935   797 raft_consensus.cc:515] T 2c2a2160a9fd483da791a5a8beb07ac6 P 833e299675134d28bcc13d2c73b996a6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:53.393000   797 leader_election.cc:290] T 2c2a2160a9fd483da791a5a8beb07ac6 P 833e299675134d28bcc13d2c73b996a6 [CANDIDATE]: Term 1 election: Requested vote from peers 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193:34223), d7fcf132cb774583bd7967a84b418048 (127.0.107.195:42711)
I20260709 12:57:53.393764   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2a2160a9fd483da791a5a8beb07ac6" candidate_uuid: "833e299675134d28bcc13d2c73b996a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40919529b3d6492d82e76f9cb44e6542"
I20260709 12:57:53.394312   566 raft_consensus.cc:3060] T 2c2a2160a9fd483da791a5a8beb07ac6 P 40919529b3d6492d82e76f9cb44e6542 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:53.394193   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2a2160a9fd483da791a5a8beb07ac6" candidate_uuid: "833e299675134d28bcc13d2c73b996a6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fcf132cb774583bd7967a84b418048"
I20260709 12:57:53.394855   713 raft_consensus.cc:3060] T 2c2a2160a9fd483da791a5a8beb07ac6 P d7fcf132cb774583bd7967a84b418048 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:57:53.399343   566 raft_consensus.cc:2468] T 2c2a2160a9fd483da791a5a8beb07ac6 P 40919529b3d6492d82e76f9cb44e6542 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 833e299675134d28bcc13d2c73b996a6 in term 1.
I20260709 12:57:53.400327   606 leader_election.cc:304] T 2c2a2160a9fd483da791a5a8beb07ac6 P 833e299675134d28bcc13d2c73b996a6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40919529b3d6492d82e76f9cb44e6542, 833e299675134d28bcc13d2c73b996a6; no voters: 
I20260709 12:57:53.401067   797 raft_consensus.cc:2804] T 2c2a2160a9fd483da791a5a8beb07ac6 P 833e299675134d28bcc13d2c73b996a6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:57:53.401496   797 raft_consensus.cc:697] T 2c2a2160a9fd483da791a5a8beb07ac6 P 833e299675134d28bcc13d2c73b996a6 [term 1 LEADER]: Becoming Leader. State: Replica: 833e299675134d28bcc13d2c73b996a6, State: Running, Role: LEADER
I20260709 12:57:53.402309   797 consensus_queue.cc:237] T 2c2a2160a9fd483da791a5a8beb07ac6 P 833e299675134d28bcc13d2c73b996a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:53.402700   713 raft_consensus.cc:2468] T 2c2a2160a9fd483da791a5a8beb07ac6 P d7fcf132cb774583bd7967a84b418048 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 833e299675134d28bcc13d2c73b996a6 in term 1.
I20260709 12:57:53.411334   461 catalog_manager.cc:5697] T 2c2a2160a9fd483da791a5a8beb07ac6 P 833e299675134d28bcc13d2c73b996a6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 833e299675134d28bcc13d2c73b996a6 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "833e299675134d28bcc13d2c73b996a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:53.425462   792 consensus_queue.cc:1048] T c48ae3b2d706406fad9295ac2ecdd688 P 40919529b3d6492d82e76f9cb44e6542 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:53.437322   794 consensus_queue.cc:1048] T c48ae3b2d706406fad9295ac2ecdd688 P 40919529b3d6492d82e76f9cb44e6542 [LEADER]: Connected to new peer: Peer: permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:57:53.614755   789 consensus_queue.cc:1048] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P d7fcf132cb774583bd7967a84b418048 [LEADER]: Connected to new peer: Peer: permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:53.625269   823 consensus_queue.cc:1048] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P d7fcf132cb774583bd7967a84b418048 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:53.861012   797 consensus_queue.cc:1048] T 2c2a2160a9fd483da791a5a8beb07ac6 P 833e299675134d28bcc13d2c73b996a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:53.871105   797 consensus_queue.cc:1048] T 2c2a2160a9fd483da791a5a8beb07ac6 P 833e299675134d28bcc13d2c73b996a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:57:53.959405   510 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:57:54.443095   798 raft_consensus.cc:493] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:57:54.443699   798 raft_consensus.cc:515] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:54.445732   798 leader_election.cc:290] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193:34223), d7fcf132cb774583bd7967a84b418048 (127.0.107.195:42711)
I20260709 12:57:54.446409   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "741777b7834d4f5e80bd0187702907dc" candidate_uuid: "833e299675134d28bcc13d2c73b996a6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40919529b3d6492d82e76f9cb44e6542" is_pre_election: true
I20260709 12:57:54.446867   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "741777b7834d4f5e80bd0187702907dc" candidate_uuid: "833e299675134d28bcc13d2c73b996a6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fcf132cb774583bd7967a84b418048" is_pre_election: true
I20260709 12:57:54.446990   566 raft_consensus.cc:2468] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 833e299675134d28bcc13d2c73b996a6 in term 1.
I20260709 12:57:54.447548   713 raft_consensus.cc:2468] T 741777b7834d4f5e80bd0187702907dc P d7fcf132cb774583bd7967a84b418048 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 833e299675134d28bcc13d2c73b996a6 in term 1.
I20260709 12:57:54.448062   606 leader_election.cc:304] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40919529b3d6492d82e76f9cb44e6542, 833e299675134d28bcc13d2c73b996a6; no voters: 
I20260709 12:57:54.448822   798 raft_consensus.cc:2804] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:57:54.449225   798 raft_consensus.cc:493] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:57:54.449563   798 raft_consensus.cc:3060] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:54.454733   798 raft_consensus.cc:515] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:54.457012   798 leader_election.cc:290] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [CANDIDATE]: Term 2 election: Requested vote from peers 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193:34223), d7fcf132cb774583bd7967a84b418048 (127.0.107.195:42711)
I20260709 12:57:54.457165   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "741777b7834d4f5e80bd0187702907dc" candidate_uuid: "833e299675134d28bcc13d2c73b996a6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40919529b3d6492d82e76f9cb44e6542"
I20260709 12:57:54.457532   713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "741777b7834d4f5e80bd0187702907dc" candidate_uuid: "833e299675134d28bcc13d2c73b996a6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d7fcf132cb774583bd7967a84b418048"
I20260709 12:57:54.457719   566 raft_consensus.cc:3060] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:54.458098   713 raft_consensus.cc:3060] T 741777b7834d4f5e80bd0187702907dc P d7fcf132cb774583bd7967a84b418048 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:54.462637   713 raft_consensus.cc:2468] T 741777b7834d4f5e80bd0187702907dc P d7fcf132cb774583bd7967a84b418048 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 833e299675134d28bcc13d2c73b996a6 in term 2.
I20260709 12:57:54.463539   566 raft_consensus.cc:2468] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 833e299675134d28bcc13d2c73b996a6 in term 2.
I20260709 12:57:54.463644   605 leader_election.cc:304] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 833e299675134d28bcc13d2c73b996a6, d7fcf132cb774583bd7967a84b418048; no voters: 
I20260709 12:57:54.464511   798 raft_consensus.cc:2804] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:54.464969   798 raft_consensus.cc:697] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [term 2 LEADER]: Becoming Leader. State: Replica: 833e299675134d28bcc13d2c73b996a6, State: Running, Role: LEADER
I20260709 12:57:54.465721   798 consensus_queue.cc:237] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:54.471751   463 catalog_manager.cc:5697] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 reported cstate change: term changed from 0 to 2, leader changed from <none> to 833e299675134d28bcc13d2c73b996a6 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "833e299675134d28bcc13d2c73b996a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:54.556736   713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e1e26ad8acd4644857773d9c53d3ff2"
dest_uuid: "d7fcf132cb774583bd7967a84b418048"
mode: GRACEFUL
new_leader_uuid: "40919529b3d6492d82e76f9cb44e6542"
 from {username='slave'} at 127.0.0.1:55792
I20260709 12:57:54.557300   713 raft_consensus.cc:606] T 8e1e26ad8acd4644857773d9c53d3ff2 P d7fcf132cb774583bd7967a84b418048 [term 1 LEADER]: Received request to transfer leadership to TS 40919529b3d6492d82e76f9cb44e6542
I20260709 12:57:54.571008   641 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "741777b7834d4f5e80bd0187702907dc"
dest_uuid: "833e299675134d28bcc13d2c73b996a6"
mode: GRACEFUL
new_leader_uuid: "40919529b3d6492d82e76f9cb44e6542"
 from {username='slave'} at 127.0.0.1:40800
I20260709 12:57:54.571463   641 raft_consensus.cc:606] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [term 2 LEADER]: Received request to transfer leadership to TS 40919529b3d6492d82e76f9cb44e6542
I20260709 12:57:54.576344   641 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba302d819a4c420b861764d4a6b5fed2"
dest_uuid: "833e299675134d28bcc13d2c73b996a6"
mode: GRACEFUL
new_leader_uuid: "40919529b3d6492d82e76f9cb44e6542"
 from {username='slave'} at 127.0.0.1:40800
I20260709 12:57:54.576864   641 raft_consensus.cc:606] T ba302d819a4c420b861764d4a6b5fed2 P 833e299675134d28bcc13d2c73b996a6 [term 1 LEADER]: Received request to transfer leadership to TS 40919529b3d6492d82e76f9cb44e6542
I20260709 12:57:54.581265   713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ecf93bacf15045e3bbfc2b0d7c51dbd8"
dest_uuid: "d7fcf132cb774583bd7967a84b418048"
mode: GRACEFUL
new_leader_uuid: "40919529b3d6492d82e76f9cb44e6542"
 from {username='slave'} at 127.0.0.1:55792
I20260709 12:57:54.581773   713 raft_consensus.cc:606] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P d7fcf132cb774583bd7967a84b418048 [term 1 LEADER]: Received request to transfer leadership to TS 40919529b3d6492d82e76f9cb44e6542
I20260709 12:57:54.596657   566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b933fbc94f143caae7395db46bfa15c"
dest_uuid: "40919529b3d6492d82e76f9cb44e6542"
mode: GRACEFUL
new_leader_uuid: "833e299675134d28bcc13d2c73b996a6"
 from {username='slave'} at 127.0.0.1:41748
I20260709 12:57:54.597102   566 raft_consensus.cc:606] T 3b933fbc94f143caae7395db46bfa15c P 40919529b3d6492d82e76f9cb44e6542 [term 1 LEADER]: Received request to transfer leadership to TS 833e299675134d28bcc13d2c73b996a6
I20260709 12:57:54.601998   566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c48ae3b2d706406fad9295ac2ecdd688"
dest_uuid: "40919529b3d6492d82e76f9cb44e6542"
mode: GRACEFUL
new_leader_uuid: "833e299675134d28bcc13d2c73b996a6"
 from {username='slave'} at 127.0.0.1:41748
I20260709 12:57:54.602402   566 raft_consensus.cc:606] T c48ae3b2d706406fad9295ac2ecdd688 P 40919529b3d6492d82e76f9cb44e6542 [term 1 LEADER]: Received request to transfer leadership to TS 833e299675134d28bcc13d2c73b996a6
I20260709 12:57:54.607013   566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3bc6327504f44dab50a3f1663e18ef4"
dest_uuid: "40919529b3d6492d82e76f9cb44e6542"
mode: GRACEFUL
new_leader_uuid: "833e299675134d28bcc13d2c73b996a6"
 from {username='slave'} at 127.0.0.1:41748
I20260709 12:57:54.607419   566 raft_consensus.cc:606] T d3bc6327504f44dab50a3f1663e18ef4 P 40919529b3d6492d82e76f9cb44e6542 [term 1 LEADER]: Received request to transfer leadership to TS 833e299675134d28bcc13d2c73b996a6
I20260709 12:57:54.612015   641 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c2a2160a9fd483da791a5a8beb07ac6"
dest_uuid: "833e299675134d28bcc13d2c73b996a6"
mode: GRACEFUL
new_leader_uuid: "d7fcf132cb774583bd7967a84b418048"
 from {username='slave'} at 127.0.0.1:40800
I20260709 12:57:54.612592   641 raft_consensus.cc:606] T 2c2a2160a9fd483da791a5a8beb07ac6 P 833e299675134d28bcc13d2c73b996a6 [term 1 LEADER]: Received request to transfer leadership to TS d7fcf132cb774583bd7967a84b418048
I20260709 12:57:54.767885   766 raft_consensus.cc:993] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P d7fcf132cb774583bd7967a84b418048: : Instructing follower 40919529b3d6492d82e76f9cb44e6542 to start an election
I20260709 12:57:54.768332   859 raft_consensus.cc:1081] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P d7fcf132cb774583bd7967a84b418048 [term 1 LEADER]: Signalling peer 40919529b3d6492d82e76f9cb44e6542 to start an election
I20260709 12:57:54.769961   566 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ecf93bacf15045e3bbfc2b0d7c51dbd8"
dest_uuid: "40919529b3d6492d82e76f9cb44e6542"
 from {username='slave'} at 127.0.0.1:41744
I20260709 12:57:54.770421   566 raft_consensus.cc:493] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 40919529b3d6492d82e76f9cb44e6542 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:54.770663   566 raft_consensus.cc:3060] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 40919529b3d6492d82e76f9cb44e6542 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:54.774919   566 raft_consensus.cc:515] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 40919529b3d6492d82e76f9cb44e6542 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:54.776410   566 leader_election.cc:290] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 40919529b3d6492d82e76f9cb44e6542 [CANDIDATE]: Term 2 election: Requested vote from peers 833e299675134d28bcc13d2c73b996a6 (127.0.107.194:39403), d7fcf132cb774583bd7967a84b418048 (127.0.107.195:42711)
I20260709 12:57:54.777438   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf93bacf15045e3bbfc2b0d7c51dbd8" candidate_uuid: "40919529b3d6492d82e76f9cb44e6542" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "833e299675134d28bcc13d2c73b996a6"
I20260709 12:57:54.777655   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf93bacf15045e3bbfc2b0d7c51dbd8" candidate_uuid: "40919529b3d6492d82e76f9cb44e6542" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7fcf132cb774583bd7967a84b418048"
I20260709 12:57:54.778095   641 raft_consensus.cc:3060] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 833e299675134d28bcc13d2c73b996a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:54.778239   714 raft_consensus.cc:3055] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P d7fcf132cb774583bd7967a84b418048 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:54.778605   714 raft_consensus.cc:740] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P d7fcf132cb774583bd7967a84b418048 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d7fcf132cb774583bd7967a84b418048, State: Running, Role: LEADER
I20260709 12:57:54.779320   714 consensus_queue.cc:260] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P d7fcf132cb774583bd7967a84b418048 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:54.780292   714 raft_consensus.cc:3060] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P d7fcf132cb774583bd7967a84b418048 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:54.783427   641 raft_consensus.cc:2468] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 833e299675134d28bcc13d2c73b996a6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40919529b3d6492d82e76f9cb44e6542 in term 2.
I20260709 12:57:54.784471   714 raft_consensus.cc:2468] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P d7fcf132cb774583bd7967a84b418048 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40919529b3d6492d82e76f9cb44e6542 in term 2.
I20260709 12:57:54.784664   531 leader_election.cc:304] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 40919529b3d6492d82e76f9cb44e6542 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40919529b3d6492d82e76f9cb44e6542, 833e299675134d28bcc13d2c73b996a6; no voters: 
I20260709 12:57:54.785597   847 raft_consensus.cc:2804] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 40919529b3d6492d82e76f9cb44e6542 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:54.785924   847 raft_consensus.cc:697] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 40919529b3d6492d82e76f9cb44e6542 [term 2 LEADER]: Becoming Leader. State: Replica: 40919529b3d6492d82e76f9cb44e6542, State: Running, Role: LEADER
I20260709 12:57:54.786662   847 consensus_queue.cc:237] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 40919529b3d6492d82e76f9cb44e6542 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:54.792615   463 catalog_manager.cc:5697] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 40919529b3d6492d82e76f9cb44e6542 reported cstate change: term changed from 1 to 2, leader changed from d7fcf132cb774583bd7967a84b418048 (127.0.107.195) to 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "40919529b3d6492d82e76f9cb44e6542" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:54.807258   792 raft_consensus.cc:993] T 3b933fbc94f143caae7395db46bfa15c P 40919529b3d6492d82e76f9cb44e6542: : Instructing follower 833e299675134d28bcc13d2c73b996a6 to start an election
I20260709 12:57:54.807646   792 raft_consensus.cc:1081] T 3b933fbc94f143caae7395db46bfa15c P 40919529b3d6492d82e76f9cb44e6542 [term 1 LEADER]: Signalling peer 833e299675134d28bcc13d2c73b996a6 to start an election
I20260709 12:57:54.809073   641 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b933fbc94f143caae7395db46bfa15c"
dest_uuid: "833e299675134d28bcc13d2c73b996a6"
 from {username='slave'} at 127.0.0.1:40788
I20260709 12:57:54.809540   641 raft_consensus.cc:493] T 3b933fbc94f143caae7395db46bfa15c P 833e299675134d28bcc13d2c73b996a6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:54.809830   641 raft_consensus.cc:3060] T 3b933fbc94f143caae7395db46bfa15c P 833e299675134d28bcc13d2c73b996a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:54.813982   641 raft_consensus.cc:515] T 3b933fbc94f143caae7395db46bfa15c P 833e299675134d28bcc13d2c73b996a6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:54.815742   641 leader_election.cc:290] T 3b933fbc94f143caae7395db46bfa15c P 833e299675134d28bcc13d2c73b996a6 [CANDIDATE]: Term 2 election: Requested vote from peers 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193:34223), d7fcf132cb774583bd7967a84b418048 (127.0.107.195:42711)
I20260709 12:57:54.816560   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b933fbc94f143caae7395db46bfa15c" candidate_uuid: "833e299675134d28bcc13d2c73b996a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40919529b3d6492d82e76f9cb44e6542"
I20260709 12:57:54.817135   566 raft_consensus.cc:3055] T 3b933fbc94f143caae7395db46bfa15c P 40919529b3d6492d82e76f9cb44e6542 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:54.817167   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b933fbc94f143caae7395db46bfa15c" candidate_uuid: "833e299675134d28bcc13d2c73b996a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7fcf132cb774583bd7967a84b418048"
I20260709 12:57:54.817442   566 raft_consensus.cc:740] T 3b933fbc94f143caae7395db46bfa15c P 40919529b3d6492d82e76f9cb44e6542 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 40919529b3d6492d82e76f9cb44e6542, State: Running, Role: LEADER
I20260709 12:57:54.817873   714 raft_consensus.cc:3060] T 3b933fbc94f143caae7395db46bfa15c P d7fcf132cb774583bd7967a84b418048 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:54.818259   566 consensus_queue.cc:260] T 3b933fbc94f143caae7395db46bfa15c P 40919529b3d6492d82e76f9cb44e6542 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:54.819123   566 raft_consensus.cc:3060] T 3b933fbc94f143caae7395db46bfa15c P 40919529b3d6492d82e76f9cb44e6542 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:54.822965   714 raft_consensus.cc:2468] T 3b933fbc94f143caae7395db46bfa15c P d7fcf132cb774583bd7967a84b418048 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 833e299675134d28bcc13d2c73b996a6 in term 2.
I20260709 12:57:54.823316   566 raft_consensus.cc:2468] T 3b933fbc94f143caae7395db46bfa15c P 40919529b3d6492d82e76f9cb44e6542 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 833e299675134d28bcc13d2c73b996a6 in term 2.
I20260709 12:57:54.824146   605 leader_election.cc:304] T 3b933fbc94f143caae7395db46bfa15c P 833e299675134d28bcc13d2c73b996a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 833e299675134d28bcc13d2c73b996a6, d7fcf132cb774583bd7967a84b418048; no voters: 
I20260709 12:57:54.824944   854 raft_consensus.cc:2804] T 3b933fbc94f143caae7395db46bfa15c P 833e299675134d28bcc13d2c73b996a6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:54.825448   854 raft_consensus.cc:697] T 3b933fbc94f143caae7395db46bfa15c P 833e299675134d28bcc13d2c73b996a6 [term 2 LEADER]: Becoming Leader. State: Replica: 833e299675134d28bcc13d2c73b996a6, State: Running, Role: LEADER
I20260709 12:57:54.826277   854 consensus_queue.cc:237] T 3b933fbc94f143caae7395db46bfa15c P 833e299675134d28bcc13d2c73b996a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:54.833717   463 catalog_manager.cc:5697] T 3b933fbc94f143caae7395db46bfa15c P 833e299675134d28bcc13d2c73b996a6 reported cstate change: term changed from 1 to 2, leader changed from 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193) to 833e299675134d28bcc13d2c73b996a6 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "833e299675134d28bcc13d2c73b996a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:54.841331   766 raft_consensus.cc:993] T 8e1e26ad8acd4644857773d9c53d3ff2 P d7fcf132cb774583bd7967a84b418048: : Instructing follower 40919529b3d6492d82e76f9cb44e6542 to start an election
I20260709 12:57:54.841856   859 raft_consensus.cc:1081] T 8e1e26ad8acd4644857773d9c53d3ff2 P d7fcf132cb774583bd7967a84b418048 [term 1 LEADER]: Signalling peer 40919529b3d6492d82e76f9cb44e6542 to start an election
I20260709 12:57:54.843230   566 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8e1e26ad8acd4644857773d9c53d3ff2"
dest_uuid: "40919529b3d6492d82e76f9cb44e6542"
 from {username='slave'} at 127.0.0.1:41744
I20260709 12:57:54.843703   566 raft_consensus.cc:493] T 8e1e26ad8acd4644857773d9c53d3ff2 P 40919529b3d6492d82e76f9cb44e6542 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:54.843989   566 raft_consensus.cc:3060] T 8e1e26ad8acd4644857773d9c53d3ff2 P 40919529b3d6492d82e76f9cb44e6542 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:54.848485   566 raft_consensus.cc:515] T 8e1e26ad8acd4644857773d9c53d3ff2 P 40919529b3d6492d82e76f9cb44e6542 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:54.849995   566 leader_election.cc:290] T 8e1e26ad8acd4644857773d9c53d3ff2 P 40919529b3d6492d82e76f9cb44e6542 [CANDIDATE]: Term 2 election: Requested vote from peers 833e299675134d28bcc13d2c73b996a6 (127.0.107.194:39403), d7fcf132cb774583bd7967a84b418048 (127.0.107.195:42711)
I20260709 12:57:54.850800   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1e26ad8acd4644857773d9c53d3ff2" candidate_uuid: "40919529b3d6492d82e76f9cb44e6542" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "833e299675134d28bcc13d2c73b996a6"
I20260709 12:57:54.851150   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1e26ad8acd4644857773d9c53d3ff2" candidate_uuid: "40919529b3d6492d82e76f9cb44e6542" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7fcf132cb774583bd7967a84b418048"
I20260709 12:57:54.851253   641 raft_consensus.cc:3060] T 8e1e26ad8acd4644857773d9c53d3ff2 P 833e299675134d28bcc13d2c73b996a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:54.851650   714 raft_consensus.cc:3055] T 8e1e26ad8acd4644857773d9c53d3ff2 P d7fcf132cb774583bd7967a84b418048 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:54.851929   714 raft_consensus.cc:740] T 8e1e26ad8acd4644857773d9c53d3ff2 P d7fcf132cb774583bd7967a84b418048 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d7fcf132cb774583bd7967a84b418048, State: Running, Role: LEADER
I20260709 12:57:54.852607   714 consensus_queue.cc:260] T 8e1e26ad8acd4644857773d9c53d3ff2 P d7fcf132cb774583bd7967a84b418048 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:54.853456   714 raft_consensus.cc:3060] T 8e1e26ad8acd4644857773d9c53d3ff2 P d7fcf132cb774583bd7967a84b418048 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:54.855792   641 raft_consensus.cc:2468] T 8e1e26ad8acd4644857773d9c53d3ff2 P 833e299675134d28bcc13d2c73b996a6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40919529b3d6492d82e76f9cb44e6542 in term 2.
I20260709 12:57:54.856774   531 leader_election.cc:304] T 8e1e26ad8acd4644857773d9c53d3ff2 P 40919529b3d6492d82e76f9cb44e6542 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40919529b3d6492d82e76f9cb44e6542, 833e299675134d28bcc13d2c73b996a6; no voters: 
I20260709 12:57:54.857529   792 raft_consensus.cc:2804] T 8e1e26ad8acd4644857773d9c53d3ff2 P 40919529b3d6492d82e76f9cb44e6542 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:54.857911   792 raft_consensus.cc:697] T 8e1e26ad8acd4644857773d9c53d3ff2 P 40919529b3d6492d82e76f9cb44e6542 [term 2 LEADER]: Becoming Leader. State: Replica: 40919529b3d6492d82e76f9cb44e6542, State: Running, Role: LEADER
I20260709 12:57:54.858283   714 raft_consensus.cc:2468] T 8e1e26ad8acd4644857773d9c53d3ff2 P d7fcf132cb774583bd7967a84b418048 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40919529b3d6492d82e76f9cb44e6542 in term 2.
I20260709 12:57:54.858650   792 consensus_queue.cc:237] T 8e1e26ad8acd4644857773d9c53d3ff2 P 40919529b3d6492d82e76f9cb44e6542 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:54.864851   463 catalog_manager.cc:5697] T 8e1e26ad8acd4644857773d9c53d3ff2 P 40919529b3d6492d82e76f9cb44e6542 reported cstate change: term changed from 1 to 2, leader changed from d7fcf132cb774583bd7967a84b418048 (127.0.107.195) to 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "40919529b3d6492d82e76f9cb44e6542" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:54.883682   848 raft_consensus.cc:993] T ba302d819a4c420b861764d4a6b5fed2 P 833e299675134d28bcc13d2c73b996a6: : Instructing follower 40919529b3d6492d82e76f9cb44e6542 to start an election
I20260709 12:57:54.884132   854 raft_consensus.cc:1081] T ba302d819a4c420b861764d4a6b5fed2 P 833e299675134d28bcc13d2c73b996a6 [term 1 LEADER]: Signalling peer 40919529b3d6492d82e76f9cb44e6542 to start an election
I20260709 12:57:54.885537   566 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba302d819a4c420b861764d4a6b5fed2"
dest_uuid: "40919529b3d6492d82e76f9cb44e6542"
 from {username='slave'} at 127.0.0.1:41746
I20260709 12:57:54.886010   566 raft_consensus.cc:493] T ba302d819a4c420b861764d4a6b5fed2 P 40919529b3d6492d82e76f9cb44e6542 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:54.886312   566 raft_consensus.cc:3060] T ba302d819a4c420b861764d4a6b5fed2 P 40919529b3d6492d82e76f9cb44e6542 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:54.891142   566 raft_consensus.cc:515] T ba302d819a4c420b861764d4a6b5fed2 P 40919529b3d6492d82e76f9cb44e6542 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:54.892942   566 leader_election.cc:290] T ba302d819a4c420b861764d4a6b5fed2 P 40919529b3d6492d82e76f9cb44e6542 [CANDIDATE]: Term 2 election: Requested vote from peers 833e299675134d28bcc13d2c73b996a6 (127.0.107.194:39403), d7fcf132cb774583bd7967a84b418048 (127.0.107.195:42711)
I20260709 12:57:54.893874   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba302d819a4c420b861764d4a6b5fed2" candidate_uuid: "40919529b3d6492d82e76f9cb44e6542" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7fcf132cb774583bd7967a84b418048"
I20260709 12:57:54.893805   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba302d819a4c420b861764d4a6b5fed2" candidate_uuid: "40919529b3d6492d82e76f9cb44e6542" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "833e299675134d28bcc13d2c73b996a6"
I20260709 12:57:54.894480   714 raft_consensus.cc:3060] T ba302d819a4c420b861764d4a6b5fed2 P d7fcf132cb774583bd7967a84b418048 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:54.894548   641 raft_consensus.cc:3055] T ba302d819a4c420b861764d4a6b5fed2 P 833e299675134d28bcc13d2c73b996a6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:54.894948   641 raft_consensus.cc:740] T ba302d819a4c420b861764d4a6b5fed2 P 833e299675134d28bcc13d2c73b996a6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 833e299675134d28bcc13d2c73b996a6, State: Running, Role: LEADER
I20260709 12:57:54.895709   641 consensus_queue.cc:260] T ba302d819a4c420b861764d4a6b5fed2 P 833e299675134d28bcc13d2c73b996a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:54.896903   641 raft_consensus.cc:3060] T ba302d819a4c420b861764d4a6b5fed2 P 833e299675134d28bcc13d2c73b996a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:54.897842   847 raft_consensus.cc:993] T d3bc6327504f44dab50a3f1663e18ef4 P 40919529b3d6492d82e76f9cb44e6542: : Instructing follower 833e299675134d28bcc13d2c73b996a6 to start an election
I20260709 12:57:54.898239   847 raft_consensus.cc:1081] T d3bc6327504f44dab50a3f1663e18ef4 P 40919529b3d6492d82e76f9cb44e6542 [term 1 LEADER]: Signalling peer 833e299675134d28bcc13d2c73b996a6 to start an election
I20260709 12:57:54.899551   640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d3bc6327504f44dab50a3f1663e18ef4"
dest_uuid: "833e299675134d28bcc13d2c73b996a6"
 from {username='slave'} at 127.0.0.1:40788
I20260709 12:57:54.900009   640 raft_consensus.cc:493] T d3bc6327504f44dab50a3f1663e18ef4 P 833e299675134d28bcc13d2c73b996a6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:54.900333   640 raft_consensus.cc:3060] T d3bc6327504f44dab50a3f1663e18ef4 P 833e299675134d28bcc13d2c73b996a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:54.901007   714 raft_consensus.cc:2468] T ba302d819a4c420b861764d4a6b5fed2 P d7fcf132cb774583bd7967a84b418048 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40919529b3d6492d82e76f9cb44e6542 in term 2.
I20260709 12:57:54.902071   530 leader_election.cc:304] T ba302d819a4c420b861764d4a6b5fed2 P 40919529b3d6492d82e76f9cb44e6542 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40919529b3d6492d82e76f9cb44e6542, d7fcf132cb774583bd7967a84b418048; no voters: 
I20260709 12:57:54.902850   792 raft_consensus.cc:2804] T ba302d819a4c420b861764d4a6b5fed2 P 40919529b3d6492d82e76f9cb44e6542 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:54.903327   641 raft_consensus.cc:2468] T ba302d819a4c420b861764d4a6b5fed2 P 833e299675134d28bcc13d2c73b996a6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40919529b3d6492d82e76f9cb44e6542 in term 2.
I20260709 12:57:54.903517   792 raft_consensus.cc:697] T ba302d819a4c420b861764d4a6b5fed2 P 40919529b3d6492d82e76f9cb44e6542 [term 2 LEADER]: Becoming Leader. State: Replica: 40919529b3d6492d82e76f9cb44e6542, State: Running, Role: LEADER
I20260709 12:57:54.904713   792 consensus_queue.cc:237] T ba302d819a4c420b861764d4a6b5fed2 P 40919529b3d6492d82e76f9cb44e6542 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:54.906280   640 raft_consensus.cc:515] T d3bc6327504f44dab50a3f1663e18ef4 P 833e299675134d28bcc13d2c73b996a6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:54.909199   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3bc6327504f44dab50a3f1663e18ef4" candidate_uuid: "833e299675134d28bcc13d2c73b996a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40919529b3d6492d82e76f9cb44e6542"
I20260709 12:57:54.909576   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3bc6327504f44dab50a3f1663e18ef4" candidate_uuid: "833e299675134d28bcc13d2c73b996a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7fcf132cb774583bd7967a84b418048"
I20260709 12:57:54.909792   566 raft_consensus.cc:3055] T d3bc6327504f44dab50a3f1663e18ef4 P 40919529b3d6492d82e76f9cb44e6542 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:54.910120   566 raft_consensus.cc:740] T d3bc6327504f44dab50a3f1663e18ef4 P 40919529b3d6492d82e76f9cb44e6542 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 40919529b3d6492d82e76f9cb44e6542, State: Running, Role: LEADER
I20260709 12:57:54.910120   714 raft_consensus.cc:3060] T d3bc6327504f44dab50a3f1663e18ef4 P d7fcf132cb774583bd7967a84b418048 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:54.910182   640 leader_election.cc:290] T d3bc6327504f44dab50a3f1663e18ef4 P 833e299675134d28bcc13d2c73b996a6 [CANDIDATE]: Term 2 election: Requested vote from peers 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193:34223), d7fcf132cb774583bd7967a84b418048 (127.0.107.195:42711)
I20260709 12:57:54.911072   566 consensus_queue.cc:260] T d3bc6327504f44dab50a3f1663e18ef4 P 40919529b3d6492d82e76f9cb44e6542 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:54.912179   566 raft_consensus.cc:3060] T d3bc6327504f44dab50a3f1663e18ef4 P 40919529b3d6492d82e76f9cb44e6542 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:54.913066   463 catalog_manager.cc:5697] T ba302d819a4c420b861764d4a6b5fed2 P 40919529b3d6492d82e76f9cb44e6542 reported cstate change: term changed from 1 to 2, leader changed from 833e299675134d28bcc13d2c73b996a6 (127.0.107.194) to 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "40919529b3d6492d82e76f9cb44e6542" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:54.916726   714 raft_consensus.cc:2468] T d3bc6327504f44dab50a3f1663e18ef4 P d7fcf132cb774583bd7967a84b418048 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 833e299675134d28bcc13d2c73b996a6 in term 2.
I20260709 12:57:54.917203   566 raft_consensus.cc:2468] T d3bc6327504f44dab50a3f1663e18ef4 P 40919529b3d6492d82e76f9cb44e6542 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 833e299675134d28bcc13d2c73b996a6 in term 2.
I20260709 12:57:54.917713   605 leader_election.cc:304] T d3bc6327504f44dab50a3f1663e18ef4 P 833e299675134d28bcc13d2c73b996a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 833e299675134d28bcc13d2c73b996a6, d7fcf132cb774583bd7967a84b418048; no voters: 
I20260709 12:57:54.918467   854 raft_consensus.cc:2804] T d3bc6327504f44dab50a3f1663e18ef4 P 833e299675134d28bcc13d2c73b996a6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:54.918823   854 raft_consensus.cc:697] T d3bc6327504f44dab50a3f1663e18ef4 P 833e299675134d28bcc13d2c73b996a6 [term 2 LEADER]: Becoming Leader. State: Replica: 833e299675134d28bcc13d2c73b996a6, State: Running, Role: LEADER
I20260709 12:57:54.919575   854 consensus_queue.cc:237] T d3bc6327504f44dab50a3f1663e18ef4 P 833e299675134d28bcc13d2c73b996a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:54.924901   848 raft_consensus.cc:993] T 2c2a2160a9fd483da791a5a8beb07ac6 P 833e299675134d28bcc13d2c73b996a6: : Instructing follower d7fcf132cb774583bd7967a84b418048 to start an election
I20260709 12:57:54.925356   854 raft_consensus.cc:1081] T 2c2a2160a9fd483da791a5a8beb07ac6 P 833e299675134d28bcc13d2c73b996a6 [term 1 LEADER]: Signalling peer d7fcf132cb774583bd7967a84b418048 to start an election
I20260709 12:57:54.926838   714 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c2a2160a9fd483da791a5a8beb07ac6"
dest_uuid: "d7fcf132cb774583bd7967a84b418048"
 from {username='slave'} at 127.0.0.1:55784
I20260709 12:57:54.927345   714 raft_consensus.cc:493] T 2c2a2160a9fd483da791a5a8beb07ac6 P d7fcf132cb774583bd7967a84b418048 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:54.927671   714 raft_consensus.cc:3060] T 2c2a2160a9fd483da791a5a8beb07ac6 P d7fcf132cb774583bd7967a84b418048 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:54.927183   463 catalog_manager.cc:5697] T d3bc6327504f44dab50a3f1663e18ef4 P 833e299675134d28bcc13d2c73b996a6 reported cstate change: term changed from 1 to 2, leader changed from 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193) to 833e299675134d28bcc13d2c73b996a6 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "833e299675134d28bcc13d2c73b996a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:54.932194   714 raft_consensus.cc:515] T 2c2a2160a9fd483da791a5a8beb07ac6 P d7fcf132cb774583bd7967a84b418048 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:54.934154   714 leader_election.cc:290] T 2c2a2160a9fd483da791a5a8beb07ac6 P d7fcf132cb774583bd7967a84b418048 [CANDIDATE]: Term 2 election: Requested vote from peers 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193:34223), 833e299675134d28bcc13d2c73b996a6 (127.0.107.194:39403)
I20260709 12:57:54.936580   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2a2160a9fd483da791a5a8beb07ac6" candidate_uuid: "d7fcf132cb774583bd7967a84b418048" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "833e299675134d28bcc13d2c73b996a6"
I20260709 12:57:54.937094   640 raft_consensus.cc:3055] T 2c2a2160a9fd483da791a5a8beb07ac6 P 833e299675134d28bcc13d2c73b996a6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:54.937142   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c2a2160a9fd483da791a5a8beb07ac6" candidate_uuid: "d7fcf132cb774583bd7967a84b418048" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40919529b3d6492d82e76f9cb44e6542"
I20260709 12:57:54.937490   640 raft_consensus.cc:740] T 2c2a2160a9fd483da791a5a8beb07ac6 P 833e299675134d28bcc13d2c73b996a6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 833e299675134d28bcc13d2c73b996a6, State: Running, Role: LEADER
I20260709 12:57:54.937723   566 raft_consensus.cc:3060] T 2c2a2160a9fd483da791a5a8beb07ac6 P 40919529b3d6492d82e76f9cb44e6542 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:54.938421   640 consensus_queue.cc:260] T 2c2a2160a9fd483da791a5a8beb07ac6 P 833e299675134d28bcc13d2c73b996a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:54.939566   640 raft_consensus.cc:3060] T 2c2a2160a9fd483da791a5a8beb07ac6 P 833e299675134d28bcc13d2c73b996a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:54.939941   847 raft_consensus.cc:993] T c48ae3b2d706406fad9295ac2ecdd688 P 40919529b3d6492d82e76f9cb44e6542: : Instructing follower 833e299675134d28bcc13d2c73b996a6 to start an election
I20260709 12:57:54.940449   792 raft_consensus.cc:1081] T c48ae3b2d706406fad9295ac2ecdd688 P 40919529b3d6492d82e76f9cb44e6542 [term 1 LEADER]: Signalling peer 833e299675134d28bcc13d2c73b996a6 to start an election
I20260709 12:57:54.941963   641 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c48ae3b2d706406fad9295ac2ecdd688"
dest_uuid: "833e299675134d28bcc13d2c73b996a6"
 from {username='slave'} at 127.0.0.1:40788
I20260709 12:57:54.942445   641 raft_consensus.cc:493] T c48ae3b2d706406fad9295ac2ecdd688 P 833e299675134d28bcc13d2c73b996a6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:54.942787   641 raft_consensus.cc:3060] T c48ae3b2d706406fad9295ac2ecdd688 P 833e299675134d28bcc13d2c73b996a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:54.944334   566 raft_consensus.cc:2468] T 2c2a2160a9fd483da791a5a8beb07ac6 P 40919529b3d6492d82e76f9cb44e6542 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7fcf132cb774583bd7967a84b418048 in term 2.
I20260709 12:57:54.945480   680 leader_election.cc:304] T 2c2a2160a9fd483da791a5a8beb07ac6 P d7fcf132cb774583bd7967a84b418048 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40919529b3d6492d82e76f9cb44e6542, d7fcf132cb774583bd7967a84b418048; no voters: 
I20260709 12:57:54.946166   640 raft_consensus.cc:2468] T 2c2a2160a9fd483da791a5a8beb07ac6 P 833e299675134d28bcc13d2c73b996a6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7fcf132cb774583bd7967a84b418048 in term 2.
I20260709 12:57:54.946288   859 raft_consensus.cc:2804] T 2c2a2160a9fd483da791a5a8beb07ac6 P d7fcf132cb774583bd7967a84b418048 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:54.946841   859 raft_consensus.cc:697] T 2c2a2160a9fd483da791a5a8beb07ac6 P d7fcf132cb774583bd7967a84b418048 [term 2 LEADER]: Becoming Leader. State: Replica: d7fcf132cb774583bd7967a84b418048, State: Running, Role: LEADER
I20260709 12:57:54.947677   859 consensus_queue.cc:237] T 2c2a2160a9fd483da791a5a8beb07ac6 P d7fcf132cb774583bd7967a84b418048 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:54.948671   641 raft_consensus.cc:515] T c48ae3b2d706406fad9295ac2ecdd688 P 833e299675134d28bcc13d2c73b996a6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:54.950780   641 leader_election.cc:290] T c48ae3b2d706406fad9295ac2ecdd688 P 833e299675134d28bcc13d2c73b996a6 [CANDIDATE]: Term 2 election: Requested vote from peers 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193:34223), d7fcf132cb774583bd7967a84b418048 (127.0.107.195:42711)
I20260709 12:57:54.951843   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48ae3b2d706406fad9295ac2ecdd688" candidate_uuid: "833e299675134d28bcc13d2c73b996a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d7fcf132cb774583bd7967a84b418048"
I20260709 12:57:54.952476   714 raft_consensus.cc:3060] T c48ae3b2d706406fad9295ac2ecdd688 P d7fcf132cb774583bd7967a84b418048 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:54.951843   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48ae3b2d706406fad9295ac2ecdd688" candidate_uuid: "833e299675134d28bcc13d2c73b996a6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40919529b3d6492d82e76f9cb44e6542"
I20260709 12:57:54.956679   566 raft_consensus.cc:3055] T c48ae3b2d706406fad9295ac2ecdd688 P 40919529b3d6492d82e76f9cb44e6542 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:57:54.957015   566 raft_consensus.cc:740] T c48ae3b2d706406fad9295ac2ecdd688 P 40919529b3d6492d82e76f9cb44e6542 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 40919529b3d6492d82e76f9cb44e6542, State: Running, Role: LEADER
I20260709 12:57:54.957069   463 catalog_manager.cc:5697] T 2c2a2160a9fd483da791a5a8beb07ac6 P d7fcf132cb774583bd7967a84b418048 reported cstate change: term changed from 1 to 2, leader changed from 833e299675134d28bcc13d2c73b996a6 (127.0.107.194) to d7fcf132cb774583bd7967a84b418048 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "d7fcf132cb774583bd7967a84b418048" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:54.957862   566 consensus_queue.cc:260] T c48ae3b2d706406fad9295ac2ecdd688 P 40919529b3d6492d82e76f9cb44e6542 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:54.959057   566 raft_consensus.cc:3060] T c48ae3b2d706406fad9295ac2ecdd688 P 40919529b3d6492d82e76f9cb44e6542 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:57:54.959829   713 raft_consensus.cc:1275] T 741777b7834d4f5e80bd0187702907dc P d7fcf132cb774583bd7967a84b418048 [term 2 FOLLOWER]: Refusing update from remote peer 833e299675134d28bcc13d2c73b996a6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:57:54.962749   854 consensus_queue.cc:1048] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:54.965519   566 raft_consensus.cc:2468] T c48ae3b2d706406fad9295ac2ecdd688 P 40919529b3d6492d82e76f9cb44e6542 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 833e299675134d28bcc13d2c73b996a6 in term 2.
I20260709 12:57:54.966687   714 raft_consensus.cc:2468] T c48ae3b2d706406fad9295ac2ecdd688 P d7fcf132cb774583bd7967a84b418048 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 833e299675134d28bcc13d2c73b996a6 in term 2.
I20260709 12:57:54.967447   606 leader_election.cc:304] T c48ae3b2d706406fad9295ac2ecdd688 P 833e299675134d28bcc13d2c73b996a6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40919529b3d6492d82e76f9cb44e6542, 833e299675134d28bcc13d2c73b996a6; no voters: 
I20260709 12:57:54.968261   848 raft_consensus.cc:2804] T c48ae3b2d706406fad9295ac2ecdd688 P 833e299675134d28bcc13d2c73b996a6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:57:54.968717   848 raft_consensus.cc:697] T c48ae3b2d706406fad9295ac2ecdd688 P 833e299675134d28bcc13d2c73b996a6 [term 2 LEADER]: Becoming Leader. State: Replica: 833e299675134d28bcc13d2c73b996a6, State: Running, Role: LEADER
I20260709 12:57:54.969625   848 consensus_queue.cc:237] T c48ae3b2d706406fad9295ac2ecdd688 P 833e299675134d28bcc13d2c73b996a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:54.988101   463 catalog_manager.cc:5697] T c48ae3b2d706406fad9295ac2ecdd688 P 833e299675134d28bcc13d2c73b996a6 reported cstate change: term changed from 1 to 2, leader changed from 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193) to 833e299675134d28bcc13d2c73b996a6 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "833e299675134d28bcc13d2c73b996a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:54.989967   566 raft_consensus.cc:1275] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542 [term 2 FOLLOWER]: Refusing update from remote peer 833e299675134d28bcc13d2c73b996a6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:57:54.991397   854 consensus_queue.cc:1048] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:57:55.002435   854 raft_consensus.cc:993] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6: : Instructing follower 40919529b3d6492d82e76f9cb44e6542 to start an election
I20260709 12:57:55.002956   848 raft_consensus.cc:1081] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [term 2 LEADER]: Signalling peer 40919529b3d6492d82e76f9cb44e6542 to start an election
I20260709 12:57:55.004896   566 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "741777b7834d4f5e80bd0187702907dc"
dest_uuid: "40919529b3d6492d82e76f9cb44e6542"
 from {username='slave'} at 127.0.0.1:41746
I20260709 12:57:55.005589   566 raft_consensus.cc:493] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:55.006024   566 raft_consensus.cc:3060] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:55.016402   566 raft_consensus.cc:515] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:55.019310   566 leader_election.cc:290] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542 [CANDIDATE]: Term 3 election: Requested vote from peers 833e299675134d28bcc13d2c73b996a6 (127.0.107.194:39403), d7fcf132cb774583bd7967a84b418048 (127.0.107.195:42711)
I20260709 12:57:55.019620   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "741777b7834d4f5e80bd0187702907dc" candidate_uuid: "40919529b3d6492d82e76f9cb44e6542" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "833e299675134d28bcc13d2c73b996a6"
I20260709 12:57:55.020108   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "741777b7834d4f5e80bd0187702907dc" candidate_uuid: "40919529b3d6492d82e76f9cb44e6542" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "d7fcf132cb774583bd7967a84b418048"
I20260709 12:57:55.020293   641 raft_consensus.cc:3055] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:55.020795   715 raft_consensus.cc:3060] T 741777b7834d4f5e80bd0187702907dc P d7fcf132cb774583bd7967a84b418048 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:55.020733   641 raft_consensus.cc:740] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 833e299675134d28bcc13d2c73b996a6, State: Running, Role: LEADER
I20260709 12:57:55.021744   641 consensus_queue.cc:260] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:55.023095   641 raft_consensus.cc:3060] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:55.026472   715 raft_consensus.cc:2468] T 741777b7834d4f5e80bd0187702907dc P d7fcf132cb774583bd7967a84b418048 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40919529b3d6492d82e76f9cb44e6542 in term 3.
I20260709 12:57:55.027700   530 leader_election.cc:304] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40919529b3d6492d82e76f9cb44e6542, d7fcf132cb774583bd7967a84b418048; no voters: 
I20260709 12:57:55.028622   792 raft_consensus.cc:2804] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:55.029121   792 raft_consensus.cc:697] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542 [term 3 LEADER]: Becoming Leader. State: Replica: 40919529b3d6492d82e76f9cb44e6542, State: Running, Role: LEADER
I20260709 12:57:55.030494   641 raft_consensus.cc:2468] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40919529b3d6492d82e76f9cb44e6542 in term 3.
I20260709 12:57:55.030084   792 consensus_queue.cc:237] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:55.038250   462 catalog_manager.cc:5697] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542 reported cstate change: term changed from 2 to 3, leader changed from 833e299675134d28bcc13d2c73b996a6 (127.0.107.194) to 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "40919529b3d6492d82e76f9cb44e6542" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:55.211486   566 raft_consensus.cc:1275] T 3b933fbc94f143caae7395db46bfa15c P 40919529b3d6492d82e76f9cb44e6542 [term 2 FOLLOWER]: Refusing update from remote peer 833e299675134d28bcc13d2c73b996a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:55.212648   870 consensus_queue.cc:1048] T 3b933fbc94f143caae7395db46bfa15c P 833e299675134d28bcc13d2c73b996a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:55.220765   715 raft_consensus.cc:1275] T 3b933fbc94f143caae7395db46bfa15c P d7fcf132cb774583bd7967a84b418048 [term 2 FOLLOWER]: Refusing update from remote peer 833e299675134d28bcc13d2c73b996a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:55.222450   854 consensus_queue.cc:1048] T 3b933fbc94f143caae7395db46bfa15c P 833e299675134d28bcc13d2c73b996a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:55.286836   641 raft_consensus.cc:1275] T ba302d819a4c420b861764d4a6b5fed2 P 833e299675134d28bcc13d2c73b996a6 [term 2 FOLLOWER]: Refusing update from remote peer 40919529b3d6492d82e76f9cb44e6542: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:55.288210   792 consensus_queue.cc:1048] T ba302d819a4c420b861764d4a6b5fed2 P 40919529b3d6492d82e76f9cb44e6542 [LEADER]: Connected to new peer: Peer: permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:55.288769   641 raft_consensus.cc:1275] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 833e299675134d28bcc13d2c73b996a6 [term 2 FOLLOWER]: Refusing update from remote peer 40919529b3d6492d82e76f9cb44e6542: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:55.289907   792 consensus_queue.cc:1048] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 40919529b3d6492d82e76f9cb44e6542 [LEADER]: Connected to new peer: Peer: permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:55.298377   715 raft_consensus.cc:1275] T ba302d819a4c420b861764d4a6b5fed2 P d7fcf132cb774583bd7967a84b418048 [term 2 FOLLOWER]: Refusing update from remote peer 40919529b3d6492d82e76f9cb44e6542: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:55.299847   847 consensus_queue.cc:1048] T ba302d819a4c420b861764d4a6b5fed2 P 40919529b3d6492d82e76f9cb44e6542 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:55.306422   714 raft_consensus.cc:1275] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P d7fcf132cb774583bd7967a84b418048 [term 2 FOLLOWER]: Refusing update from remote peer 40919529b3d6492d82e76f9cb44e6542: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:55.308177   877 consensus_queue.cc:1048] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 40919529b3d6492d82e76f9cb44e6542 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:55.318948   566 raft_consensus.cc:1275] T d3bc6327504f44dab50a3f1663e18ef4 P 40919529b3d6492d82e76f9cb44e6542 [term 2 FOLLOWER]: Refusing update from remote peer 833e299675134d28bcc13d2c73b996a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:55.320353   854 consensus_queue.cc:1048] T d3bc6327504f44dab50a3f1663e18ef4 P 833e299675134d28bcc13d2c73b996a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:55.331143   714 raft_consensus.cc:1275] T d3bc6327504f44dab50a3f1663e18ef4 P d7fcf132cb774583bd7967a84b418048 [term 2 FOLLOWER]: Refusing update from remote peer 833e299675134d28bcc13d2c73b996a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:55.334436   870 consensus_queue.cc:1048] T d3bc6327504f44dab50a3f1663e18ef4 P 833e299675134d28bcc13d2c73b996a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:55.335951   640 raft_consensus.cc:1275] T 2c2a2160a9fd483da791a5a8beb07ac6 P 833e299675134d28bcc13d2c73b996a6 [term 2 FOLLOWER]: Refusing update from remote peer d7fcf132cb774583bd7967a84b418048: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:55.337747   859 consensus_queue.cc:1048] T 2c2a2160a9fd483da791a5a8beb07ac6 P d7fcf132cb774583bd7967a84b418048 [LEADER]: Connected to new peer: Peer: permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:55.353466   566 raft_consensus.cc:1275] T 2c2a2160a9fd483da791a5a8beb07ac6 P 40919529b3d6492d82e76f9cb44e6542 [term 2 FOLLOWER]: Refusing update from remote peer d7fcf132cb774583bd7967a84b418048: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:55.355119   859 consensus_queue.cc:1048] T 2c2a2160a9fd483da791a5a8beb07ac6 P d7fcf132cb774583bd7967a84b418048 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:55.364956   640 raft_consensus.cc:1275] T 8e1e26ad8acd4644857773d9c53d3ff2 P 833e299675134d28bcc13d2c73b996a6 [term 2 FOLLOWER]: Refusing update from remote peer 40919529b3d6492d82e76f9cb44e6542: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:55.366339   877 consensus_queue.cc:1048] T 8e1e26ad8acd4644857773d9c53d3ff2 P 40919529b3d6492d82e76f9cb44e6542 [LEADER]: Connected to new peer: Peer: permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:55.376041   714 raft_consensus.cc:1275] T 8e1e26ad8acd4644857773d9c53d3ff2 P d7fcf132cb774583bd7967a84b418048 [term 2 FOLLOWER]: Refusing update from remote peer 40919529b3d6492d82e76f9cb44e6542: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:55.377671   792 consensus_queue.cc:1048] T 8e1e26ad8acd4644857773d9c53d3ff2 P 40919529b3d6492d82e76f9cb44e6542 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:55.529069   714 raft_consensus.cc:1275] T c48ae3b2d706406fad9295ac2ecdd688 P d7fcf132cb774583bd7967a84b418048 [term 2 FOLLOWER]: Refusing update from remote peer 833e299675134d28bcc13d2c73b996a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:55.530272   870 consensus_queue.cc:1048] T c48ae3b2d706406fad9295ac2ecdd688 P 833e299675134d28bcc13d2c73b996a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:55.538558   566 raft_consensus.cc:1275] T c48ae3b2d706406fad9295ac2ecdd688 P 40919529b3d6492d82e76f9cb44e6542 [term 2 FOLLOWER]: Refusing update from remote peer 833e299675134d28bcc13d2c73b996a6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:57:55.540436   848 consensus_queue.cc:1048] T c48ae3b2d706406fad9295ac2ecdd688 P 833e299675134d28bcc13d2c73b996a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:55.583190   640 raft_consensus.cc:1275] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [term 3 FOLLOWER]: Refusing update from remote peer 40919529b3d6492d82e76f9cb44e6542: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:55.584951   714 raft_consensus.cc:1275] T 741777b7834d4f5e80bd0187702907dc P d7fcf132cb774583bd7967a84b418048 [term 3 FOLLOWER]: Refusing update from remote peer 40919529b3d6492d82e76f9cb44e6542: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:57:55.584625   792 consensus_queue.cc:1048] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542 [LEADER]: Connected to new peer: Peer: permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:57:55.586195   847 consensus_queue.cc:1048] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:57:57.641744   431 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 12:57:57.642518   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:57:57.663312   641 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b933fbc94f143caae7395db46bfa15c"
dest_uuid: "833e299675134d28bcc13d2c73b996a6"
mode: GRACEFUL
new_leader_uuid: "d7fcf132cb774583bd7967a84b418048"
 from {username='slave'} at 127.0.0.1:40808
I20260709 12:57:57.663928   641 raft_consensus.cc:606] T 3b933fbc94f143caae7395db46bfa15c P 833e299675134d28bcc13d2c73b996a6 [term 2 LEADER]: Received request to transfer leadership to TS d7fcf132cb774583bd7967a84b418048
I20260709 12:57:57.676277   566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ecf93bacf15045e3bbfc2b0d7c51dbd8"
dest_uuid: "40919529b3d6492d82e76f9cb44e6542"
mode: GRACEFUL
new_leader_uuid: "d7fcf132cb774583bd7967a84b418048"
 from {username='slave'} at 127.0.0.1:41754
I20260709 12:57:57.676930   566 raft_consensus.cc:606] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 40919529b3d6492d82e76f9cb44e6542 [term 2 LEADER]: Received request to transfer leadership to TS d7fcf132cb774583bd7967a84b418048
I20260709 12:57:57.678071   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:57:57.678601   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:57:57.771129   848 raft_consensus.cc:993] T 3b933fbc94f143caae7395db46bfa15c P 833e299675134d28bcc13d2c73b996a6: : Instructing follower d7fcf132cb774583bd7967a84b418048 to start an election
I20260709 12:57:57.771646   892 raft_consensus.cc:1081] T 3b933fbc94f143caae7395db46bfa15c P 833e299675134d28bcc13d2c73b996a6 [term 2 LEADER]: Signalling peer d7fcf132cb774583bd7967a84b418048 to start an election
I20260709 12:57:57.773176   714 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b933fbc94f143caae7395db46bfa15c"
dest_uuid: "d7fcf132cb774583bd7967a84b418048"
 from {username='slave'} at 127.0.0.1:55784
I20260709 12:57:57.773614   714 raft_consensus.cc:493] T 3b933fbc94f143caae7395db46bfa15c P d7fcf132cb774583bd7967a84b418048 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:57.773865   714 raft_consensus.cc:3060] T 3b933fbc94f143caae7395db46bfa15c P d7fcf132cb774583bd7967a84b418048 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:57.779563   714 raft_consensus.cc:515] T 3b933fbc94f143caae7395db46bfa15c P d7fcf132cb774583bd7967a84b418048 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:57.780871   714 leader_election.cc:290] T 3b933fbc94f143caae7395db46bfa15c P d7fcf132cb774583bd7967a84b418048 [CANDIDATE]: Term 3 election: Requested vote from peers 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193:34223), 833e299675134d28bcc13d2c73b996a6 (127.0.107.194:39403)
I20260709 12:57:57.781726   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b933fbc94f143caae7395db46bfa15c" candidate_uuid: "d7fcf132cb774583bd7967a84b418048" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "40919529b3d6492d82e76f9cb44e6542"
I20260709 12:57:57.782202   566 raft_consensus.cc:3060] T 3b933fbc94f143caae7395db46bfa15c P 40919529b3d6492d82e76f9cb44e6542 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:57.782021   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b933fbc94f143caae7395db46bfa15c" candidate_uuid: "d7fcf132cb774583bd7967a84b418048" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "833e299675134d28bcc13d2c73b996a6"
I20260709 12:57:57.782673   641 raft_consensus.cc:3055] T 3b933fbc94f143caae7395db46bfa15c P 833e299675134d28bcc13d2c73b996a6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:57.782945   641 raft_consensus.cc:740] T 3b933fbc94f143caae7395db46bfa15c P 833e299675134d28bcc13d2c73b996a6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 833e299675134d28bcc13d2c73b996a6, State: Running, Role: LEADER
I20260709 12:57:57.783537   641 consensus_queue.cc:260] T 3b933fbc94f143caae7395db46bfa15c P 833e299675134d28bcc13d2c73b996a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:57.784389   641 raft_consensus.cc:3060] T 3b933fbc94f143caae7395db46bfa15c P 833e299675134d28bcc13d2c73b996a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:57.786221   566 raft_consensus.cc:2468] T 3b933fbc94f143caae7395db46bfa15c P 40919529b3d6492d82e76f9cb44e6542 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7fcf132cb774583bd7967a84b418048 in term 3.
I20260709 12:57:57.787249   680 leader_election.cc:304] T 3b933fbc94f143caae7395db46bfa15c P d7fcf132cb774583bd7967a84b418048 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40919529b3d6492d82e76f9cb44e6542, d7fcf132cb774583bd7967a84b418048; no voters: 
I20260709 12:57:57.788023   859 raft_consensus.cc:2804] T 3b933fbc94f143caae7395db46bfa15c P d7fcf132cb774583bd7967a84b418048 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:57.789412   641 raft_consensus.cc:2468] T 3b933fbc94f143caae7395db46bfa15c P 833e299675134d28bcc13d2c73b996a6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7fcf132cb774583bd7967a84b418048 in term 3.
I20260709 12:57:57.789572   859 raft_consensus.cc:697] T 3b933fbc94f143caae7395db46bfa15c P d7fcf132cb774583bd7967a84b418048 [term 3 LEADER]: Becoming Leader. State: Replica: d7fcf132cb774583bd7967a84b418048, State: Running, Role: LEADER
I20260709 12:57:57.790408   859 consensus_queue.cc:237] T 3b933fbc94f143caae7395db46bfa15c P d7fcf132cb774583bd7967a84b418048 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:57.797228   895 raft_consensus.cc:993] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 40919529b3d6492d82e76f9cb44e6542: : Instructing follower d7fcf132cb774583bd7967a84b418048 to start an election
I20260709 12:57:57.797711   847 raft_consensus.cc:1081] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 40919529b3d6492d82e76f9cb44e6542 [term 2 LEADER]: Signalling peer d7fcf132cb774583bd7967a84b418048 to start an election
I20260709 12:57:57.797293   462 catalog_manager.cc:5697] T 3b933fbc94f143caae7395db46bfa15c P d7fcf132cb774583bd7967a84b418048 reported cstate change: term changed from 2 to 3, leader changed from 833e299675134d28bcc13d2c73b996a6 (127.0.107.194) to d7fcf132cb774583bd7967a84b418048 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "d7fcf132cb774583bd7967a84b418048" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:57.799136   714 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ecf93bacf15045e3bbfc2b0d7c51dbd8"
dest_uuid: "d7fcf132cb774583bd7967a84b418048"
 from {username='slave'} at 127.0.0.1:55772
I20260709 12:57:57.799538   714 raft_consensus.cc:493] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P d7fcf132cb774583bd7967a84b418048 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:57.799801   714 raft_consensus.cc:3060] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P d7fcf132cb774583bd7967a84b418048 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:57.805577   714 raft_consensus.cc:515] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P d7fcf132cb774583bd7967a84b418048 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:57.807358   714 leader_election.cc:290] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P d7fcf132cb774583bd7967a84b418048 [CANDIDATE]: Term 3 election: Requested vote from peers 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193:34223), 833e299675134d28bcc13d2c73b996a6 (127.0.107.194:39403)
I20260709 12:57:57.808082   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf93bacf15045e3bbfc2b0d7c51dbd8" candidate_uuid: "d7fcf132cb774583bd7967a84b418048" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "40919529b3d6492d82e76f9cb44e6542"
I20260709 12:57:57.808387   641 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf93bacf15045e3bbfc2b0d7c51dbd8" candidate_uuid: "d7fcf132cb774583bd7967a84b418048" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "833e299675134d28bcc13d2c73b996a6"
I20260709 12:57:57.808638   566 raft_consensus.cc:3055] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 40919529b3d6492d82e76f9cb44e6542 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:57.808960   641 raft_consensus.cc:3060] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 833e299675134d28bcc13d2c73b996a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:57.809028   566 raft_consensus.cc:740] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 40919529b3d6492d82e76f9cb44e6542 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 40919529b3d6492d82e76f9cb44e6542, State: Running, Role: LEADER
I20260709 12:57:57.809823   566 consensus_queue.cc:260] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 40919529b3d6492d82e76f9cb44e6542 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:57.810868   566 raft_consensus.cc:3060] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 40919529b3d6492d82e76f9cb44e6542 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:57.813582   641 raft_consensus.cc:2468] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 833e299675134d28bcc13d2c73b996a6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7fcf132cb774583bd7967a84b418048 in term 3.
I20260709 12:57:57.814626   680 leader_election.cc:304] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P d7fcf132cb774583bd7967a84b418048 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 833e299675134d28bcc13d2c73b996a6, d7fcf132cb774583bd7967a84b418048; no voters: 
I20260709 12:57:57.814960   566 raft_consensus.cc:2468] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 40919529b3d6492d82e76f9cb44e6542 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7fcf132cb774583bd7967a84b418048 in term 3.
I20260709 12:57:57.815348   859 raft_consensus.cc:2804] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P d7fcf132cb774583bd7967a84b418048 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:57.816381   859 raft_consensus.cc:697] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P d7fcf132cb774583bd7967a84b418048 [term 3 LEADER]: Becoming Leader. State: Replica: d7fcf132cb774583bd7967a84b418048, State: Running, Role: LEADER
I20260709 12:57:57.817159   859 consensus_queue.cc:237] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P d7fcf132cb774583bd7967a84b418048 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:57.823915   462 catalog_manager.cc:5697] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P d7fcf132cb774583bd7967a84b418048 reported cstate change: term changed from 2 to 3, leader changed from 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193) to d7fcf132cb774583bd7967a84b418048 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "d7fcf132cb774583bd7967a84b418048" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } health_report { overall_health: HEALTHY } } }
I20260709 12:57:58.286888   566 raft_consensus.cc:1275] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 40919529b3d6492d82e76f9cb44e6542 [term 3 FOLLOWER]: Refusing update from remote peer d7fcf132cb774583bd7967a84b418048: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:58.288151   859 consensus_queue.cc:1048] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P d7fcf132cb774583bd7967a84b418048 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:58.297749   641 raft_consensus.cc:1275] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 833e299675134d28bcc13d2c73b996a6 [term 3 FOLLOWER]: Refusing update from remote peer d7fcf132cb774583bd7967a84b418048: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:58.300359   859 consensus_queue.cc:1048] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P d7fcf132cb774583bd7967a84b418048 [LEADER]: Connected to new peer: Peer: permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:58.305806   640 raft_consensus.cc:1275] T 3b933fbc94f143caae7395db46bfa15c P 833e299675134d28bcc13d2c73b996a6 [term 3 FOLLOWER]: Refusing update from remote peer d7fcf132cb774583bd7967a84b418048: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:58.307272   893 consensus_queue.cc:1048] T 3b933fbc94f143caae7395db46bfa15c P d7fcf132cb774583bd7967a84b418048 [LEADER]: Connected to new peer: Peer: permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:58.323565   566 raft_consensus.cc:1275] T 3b933fbc94f143caae7395db46bfa15c P 40919529b3d6492d82e76f9cb44e6542 [term 3 FOLLOWER]: Refusing update from remote peer d7fcf132cb774583bd7967a84b418048: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:58.325569   859 consensus_queue.cc:1048] T 3b933fbc94f143caae7395db46bfa15c P d7fcf132cb774583bd7967a84b418048 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:58.679378   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:57:58.688805   566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e1e26ad8acd4644857773d9c53d3ff2"
dest_uuid: "40919529b3d6492d82e76f9cb44e6542"
mode: GRACEFUL
new_leader_uuid: "833e299675134d28bcc13d2c73b996a6"
 from {username='slave'} at 127.0.0.1:41748
I20260709 12:57:58.689321   566 raft_consensus.cc:606] T 8e1e26ad8acd4644857773d9c53d3ff2 P 40919529b3d6492d82e76f9cb44e6542 [term 2 LEADER]: Received request to transfer leadership to TS 833e299675134d28bcc13d2c73b996a6
I20260709 12:57:58.694039   566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "741777b7834d4f5e80bd0187702907dc"
dest_uuid: "40919529b3d6492d82e76f9cb44e6542"
mode: GRACEFUL
new_leader_uuid: "833e299675134d28bcc13d2c73b996a6"
 from {username='slave'} at 127.0.0.1:41748
I20260709 12:57:58.694636   566 raft_consensus.cc:606] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542 [term 3 LEADER]: Received request to transfer leadership to TS 833e299675134d28bcc13d2c73b996a6
I20260709 12:57:58.699010   566 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba302d819a4c420b861764d4a6b5fed2"
dest_uuid: "40919529b3d6492d82e76f9cb44e6542"
mode: GRACEFUL
new_leader_uuid: "833e299675134d28bcc13d2c73b996a6"
 from {username='slave'} at 127.0.0.1:41748
I20260709 12:57:58.699525   566 raft_consensus.cc:606] T ba302d819a4c420b861764d4a6b5fed2 P 40919529b3d6492d82e76f9cb44e6542 [term 2 LEADER]: Received request to transfer leadership to TS 833e299675134d28bcc13d2c73b996a6
I20260709 12:57:58.703886   714 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ecf93bacf15045e3bbfc2b0d7c51dbd8"
dest_uuid: "d7fcf132cb774583bd7967a84b418048"
mode: GRACEFUL
new_leader_uuid: "833e299675134d28bcc13d2c73b996a6"
 from {username='slave'} at 127.0.0.1:55792
I20260709 12:57:58.704319   714 raft_consensus.cc:606] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P d7fcf132cb774583bd7967a84b418048 [term 3 LEADER]: Received request to transfer leadership to TS 833e299675134d28bcc13d2c73b996a6
I20260709 12:57:58.711630   714 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3b933fbc94f143caae7395db46bfa15c"
dest_uuid: "d7fcf132cb774583bd7967a84b418048"
mode: GRACEFUL
new_leader_uuid: "833e299675134d28bcc13d2c73b996a6"
 from {username='slave'} at 127.0.0.1:55792
I20260709 12:57:58.712074   714 raft_consensus.cc:606] T 3b933fbc94f143caae7395db46bfa15c P d7fcf132cb774583bd7967a84b418048 [term 3 LEADER]: Received request to transfer leadership to TS 833e299675134d28bcc13d2c73b996a6
I20260709 12:57:58.724231   859 raft_consensus.cc:993] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P d7fcf132cb774583bd7967a84b418048: : Instructing follower 833e299675134d28bcc13d2c73b996a6 to start an election
I20260709 12:57:58.724681   893 raft_consensus.cc:1081] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P d7fcf132cb774583bd7967a84b418048 [term 3 LEADER]: Signalling peer 833e299675134d28bcc13d2c73b996a6 to start an election
I20260709 12:57:58.726248   640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ecf93bacf15045e3bbfc2b0d7c51dbd8"
dest_uuid: "833e299675134d28bcc13d2c73b996a6"
 from {username='slave'} at 127.0.0.1:40784
I20260709 12:57:58.726758   640 raft_consensus.cc:493] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 833e299675134d28bcc13d2c73b996a6 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:58.727186   640 raft_consensus.cc:3060] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 833e299675134d28bcc13d2c73b996a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:58.731837   640 raft_consensus.cc:515] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 833e299675134d28bcc13d2c73b996a6 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:58.733384   640 leader_election.cc:290] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 833e299675134d28bcc13d2c73b996a6 [CANDIDATE]: Term 4 election: Requested vote from peers 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193:34223), d7fcf132cb774583bd7967a84b418048 (127.0.107.195:42711)
I20260709 12:57:58.734305   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf93bacf15045e3bbfc2b0d7c51dbd8" candidate_uuid: "833e299675134d28bcc13d2c73b996a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d7fcf132cb774583bd7967a84b418048"
I20260709 12:57:58.734637   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf93bacf15045e3bbfc2b0d7c51dbd8" candidate_uuid: "833e299675134d28bcc13d2c73b996a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "40919529b3d6492d82e76f9cb44e6542"
I20260709 12:57:58.734851   714 raft_consensus.cc:3055] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P d7fcf132cb774583bd7967a84b418048 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:58.735119   566 raft_consensus.cc:3060] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 40919529b3d6492d82e76f9cb44e6542 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:58.735148   714 raft_consensus.cc:740] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P d7fcf132cb774583bd7967a84b418048 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d7fcf132cb774583bd7967a84b418048, State: Running, Role: LEADER
I20260709 12:57:58.735944   714 consensus_queue.cc:260] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P d7fcf132cb774583bd7967a84b418048 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:58.737025   714 raft_consensus.cc:3060] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P d7fcf132cb774583bd7967a84b418048 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:58.740932   566 raft_consensus.cc:2468] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 40919529b3d6492d82e76f9cb44e6542 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 833e299675134d28bcc13d2c73b996a6 in term 4.
I20260709 12:57:58.741880   606 leader_election.cc:304] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 833e299675134d28bcc13d2c73b996a6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40919529b3d6492d82e76f9cb44e6542, 833e299675134d28bcc13d2c73b996a6; no voters: 
I20260709 12:57:58.742621   892 raft_consensus.cc:2804] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 833e299675134d28bcc13d2c73b996a6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:58.742695   714 raft_consensus.cc:2468] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P d7fcf132cb774583bd7967a84b418048 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 833e299675134d28bcc13d2c73b996a6 in term 4.
I20260709 12:57:58.743158   892 raft_consensus.cc:697] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 833e299675134d28bcc13d2c73b996a6 [term 4 LEADER]: Becoming Leader. State: Replica: 833e299675134d28bcc13d2c73b996a6, State: Running, Role: LEADER
I20260709 12:57:58.744699   910 raft_consensus.cc:993] T ba302d819a4c420b861764d4a6b5fed2 P 40919529b3d6492d82e76f9cb44e6542: : Instructing follower 833e299675134d28bcc13d2c73b996a6 to start an election
I20260709 12:57:58.744179   892 consensus_queue.cc:237] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 833e299675134d28bcc13d2c73b996a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:58.745203   910 raft_consensus.cc:1081] T ba302d819a4c420b861764d4a6b5fed2 P 40919529b3d6492d82e76f9cb44e6542 [term 2 LEADER]: Signalling peer 833e299675134d28bcc13d2c73b996a6 to start an election
I20260709 12:57:58.746775   640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba302d819a4c420b861764d4a6b5fed2"
dest_uuid: "833e299675134d28bcc13d2c73b996a6"
 from {username='slave'} at 127.0.0.1:40788
I20260709 12:57:58.747274   640 raft_consensus.cc:493] T ba302d819a4c420b861764d4a6b5fed2 P 833e299675134d28bcc13d2c73b996a6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:58.747761   640 raft_consensus.cc:3060] T ba302d819a4c420b861764d4a6b5fed2 P 833e299675134d28bcc13d2c73b996a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:58.751329   462 catalog_manager.cc:5697] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 833e299675134d28bcc13d2c73b996a6 reported cstate change: term changed from 3 to 4, leader changed from d7fcf132cb774583bd7967a84b418048 (127.0.107.195) to 833e299675134d28bcc13d2c73b996a6 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "833e299675134d28bcc13d2c73b996a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:58.753268   640 raft_consensus.cc:515] T ba302d819a4c420b861764d4a6b5fed2 P 833e299675134d28bcc13d2c73b996a6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:58.754884   640 leader_election.cc:290] T ba302d819a4c420b861764d4a6b5fed2 P 833e299675134d28bcc13d2c73b996a6 [CANDIDATE]: Term 3 election: Requested vote from peers 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193:34223), d7fcf132cb774583bd7967a84b418048 (127.0.107.195:42711)
I20260709 12:57:58.755725   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba302d819a4c420b861764d4a6b5fed2" candidate_uuid: "833e299675134d28bcc13d2c73b996a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "40919529b3d6492d82e76f9cb44e6542"
I20260709 12:57:58.756108   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba302d819a4c420b861764d4a6b5fed2" candidate_uuid: "833e299675134d28bcc13d2c73b996a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d7fcf132cb774583bd7967a84b418048"
I20260709 12:57:58.756256   566 raft_consensus.cc:3055] T ba302d819a4c420b861764d4a6b5fed2 P 40919529b3d6492d82e76f9cb44e6542 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:58.756502   714 raft_consensus.cc:3060] T ba302d819a4c420b861764d4a6b5fed2 P d7fcf132cb774583bd7967a84b418048 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:58.756620   566 raft_consensus.cc:740] T ba302d819a4c420b861764d4a6b5fed2 P 40919529b3d6492d82e76f9cb44e6542 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 40919529b3d6492d82e76f9cb44e6542, State: Running, Role: LEADER
I20260709 12:57:58.757453   566 consensus_queue.cc:260] T ba302d819a4c420b861764d4a6b5fed2 P 40919529b3d6492d82e76f9cb44e6542 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:58.759035   566 raft_consensus.cc:3060] T ba302d819a4c420b861764d4a6b5fed2 P 40919529b3d6492d82e76f9cb44e6542 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:58.761914   714 raft_consensus.cc:2468] T ba302d819a4c420b861764d4a6b5fed2 P d7fcf132cb774583bd7967a84b418048 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 833e299675134d28bcc13d2c73b996a6 in term 3.
I20260709 12:57:58.762980   605 leader_election.cc:304] T ba302d819a4c420b861764d4a6b5fed2 P 833e299675134d28bcc13d2c73b996a6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 833e299675134d28bcc13d2c73b996a6, d7fcf132cb774583bd7967a84b418048; no voters: 
I20260709 12:57:58.763737   892 raft_consensus.cc:2804] T ba302d819a4c420b861764d4a6b5fed2 P 833e299675134d28bcc13d2c73b996a6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:58.764165   892 raft_consensus.cc:697] T ba302d819a4c420b861764d4a6b5fed2 P 833e299675134d28bcc13d2c73b996a6 [term 3 LEADER]: Becoming Leader. State: Replica: 833e299675134d28bcc13d2c73b996a6, State: Running, Role: LEADER
I20260709 12:57:58.764894   892 consensus_queue.cc:237] T ba302d819a4c420b861764d4a6b5fed2 P 833e299675134d28bcc13d2c73b996a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:58.765317   566 raft_consensus.cc:2468] T ba302d819a4c420b861764d4a6b5fed2 P 40919529b3d6492d82e76f9cb44e6542 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 833e299675134d28bcc13d2c73b996a6 in term 3.
I20260709 12:57:58.771610   462 catalog_manager.cc:5697] T ba302d819a4c420b861764d4a6b5fed2 P 833e299675134d28bcc13d2c73b996a6 reported cstate change: term changed from 2 to 3, leader changed from 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193) to 833e299675134d28bcc13d2c73b996a6 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "833e299675134d28bcc13d2c73b996a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:58.873636   859 raft_consensus.cc:993] T 3b933fbc94f143caae7395db46bfa15c P d7fcf132cb774583bd7967a84b418048: : Instructing follower 833e299675134d28bcc13d2c73b996a6 to start an election
I20260709 12:57:58.874115   893 raft_consensus.cc:1081] T 3b933fbc94f143caae7395db46bfa15c P d7fcf132cb774583bd7967a84b418048 [term 3 LEADER]: Signalling peer 833e299675134d28bcc13d2c73b996a6 to start an election
I20260709 12:57:58.875686   640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3b933fbc94f143caae7395db46bfa15c"
dest_uuid: "833e299675134d28bcc13d2c73b996a6"
 from {username='slave'} at 127.0.0.1:40784
I20260709 12:57:58.876186   640 raft_consensus.cc:493] T 3b933fbc94f143caae7395db46bfa15c P 833e299675134d28bcc13d2c73b996a6 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:58.876498   640 raft_consensus.cc:3060] T 3b933fbc94f143caae7395db46bfa15c P 833e299675134d28bcc13d2c73b996a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:58.880960   640 raft_consensus.cc:515] T 3b933fbc94f143caae7395db46bfa15c P 833e299675134d28bcc13d2c73b996a6 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:58.882516   640 leader_election.cc:290] T 3b933fbc94f143caae7395db46bfa15c P 833e299675134d28bcc13d2c73b996a6 [CANDIDATE]: Term 4 election: Requested vote from peers 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193:34223), d7fcf132cb774583bd7967a84b418048 (127.0.107.195:42711)
I20260709 12:57:58.883417   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b933fbc94f143caae7395db46bfa15c" candidate_uuid: "833e299675134d28bcc13d2c73b996a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "40919529b3d6492d82e76f9cb44e6542"
I20260709 12:57:58.883500   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3b933fbc94f143caae7395db46bfa15c" candidate_uuid: "833e299675134d28bcc13d2c73b996a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d7fcf132cb774583bd7967a84b418048"
I20260709 12:57:58.884105   566 raft_consensus.cc:3060] T 3b933fbc94f143caae7395db46bfa15c P 40919529b3d6492d82e76f9cb44e6542 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:58.884160   714 raft_consensus.cc:3055] T 3b933fbc94f143caae7395db46bfa15c P d7fcf132cb774583bd7967a84b418048 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:58.884557   714 raft_consensus.cc:740] T 3b933fbc94f143caae7395db46bfa15c P d7fcf132cb774583bd7967a84b418048 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: d7fcf132cb774583bd7967a84b418048, State: Running, Role: LEADER
I20260709 12:57:58.885150   714 consensus_queue.cc:260] T 3b933fbc94f143caae7395db46bfa15c P d7fcf132cb774583bd7967a84b418048 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:58.885942   714 raft_consensus.cc:3060] T 3b933fbc94f143caae7395db46bfa15c P d7fcf132cb774583bd7967a84b418048 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:58.888724   566 raft_consensus.cc:2468] T 3b933fbc94f143caae7395db46bfa15c P 40919529b3d6492d82e76f9cb44e6542 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 833e299675134d28bcc13d2c73b996a6 in term 4.
I20260709 12:57:58.889776   606 leader_election.cc:304] T 3b933fbc94f143caae7395db46bfa15c P 833e299675134d28bcc13d2c73b996a6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40919529b3d6492d82e76f9cb44e6542, 833e299675134d28bcc13d2c73b996a6; no voters: 
I20260709 12:57:58.889984   714 raft_consensus.cc:2468] T 3b933fbc94f143caae7395db46bfa15c P d7fcf132cb774583bd7967a84b418048 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 833e299675134d28bcc13d2c73b996a6 in term 4.
I20260709 12:57:58.890504   892 raft_consensus.cc:2804] T 3b933fbc94f143caae7395db46bfa15c P 833e299675134d28bcc13d2c73b996a6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:58.891017   892 raft_consensus.cc:697] T 3b933fbc94f143caae7395db46bfa15c P 833e299675134d28bcc13d2c73b996a6 [term 4 LEADER]: Becoming Leader. State: Replica: 833e299675134d28bcc13d2c73b996a6, State: Running, Role: LEADER
I20260709 12:57:58.891701   892 consensus_queue.cc:237] T 3b933fbc94f143caae7395db46bfa15c P 833e299675134d28bcc13d2c73b996a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:58.897653   462 catalog_manager.cc:5697] T 3b933fbc94f143caae7395db46bfa15c P 833e299675134d28bcc13d2c73b996a6 reported cstate change: term changed from 3 to 4, leader changed from d7fcf132cb774583bd7967a84b418048 (127.0.107.195) to 833e299675134d28bcc13d2c73b996a6 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "833e299675134d28bcc13d2c73b996a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:58.912842   847 raft_consensus.cc:993] T 8e1e26ad8acd4644857773d9c53d3ff2 P 40919529b3d6492d82e76f9cb44e6542: : Instructing follower 833e299675134d28bcc13d2c73b996a6 to start an election
I20260709 12:57:58.913241   910 raft_consensus.cc:1081] T 8e1e26ad8acd4644857773d9c53d3ff2 P 40919529b3d6492d82e76f9cb44e6542 [term 2 LEADER]: Signalling peer 833e299675134d28bcc13d2c73b996a6 to start an election
I20260709 12:57:58.914724   640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8e1e26ad8acd4644857773d9c53d3ff2"
dest_uuid: "833e299675134d28bcc13d2c73b996a6"
 from {username='slave'} at 127.0.0.1:40788
I20260709 12:57:58.915132   640 raft_consensus.cc:493] T 8e1e26ad8acd4644857773d9c53d3ff2 P 833e299675134d28bcc13d2c73b996a6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:58.915369   640 raft_consensus.cc:3060] T 8e1e26ad8acd4644857773d9c53d3ff2 P 833e299675134d28bcc13d2c73b996a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:58.919757   640 raft_consensus.cc:515] T 8e1e26ad8acd4644857773d9c53d3ff2 P 833e299675134d28bcc13d2c73b996a6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:58.921591   640 leader_election.cc:290] T 8e1e26ad8acd4644857773d9c53d3ff2 P 833e299675134d28bcc13d2c73b996a6 [CANDIDATE]: Term 3 election: Requested vote from peers 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193:34223), d7fcf132cb774583bd7967a84b418048 (127.0.107.195:42711)
I20260709 12:57:58.922403   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1e26ad8acd4644857773d9c53d3ff2" candidate_uuid: "833e299675134d28bcc13d2c73b996a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "40919529b3d6492d82e76f9cb44e6542"
I20260709 12:57:58.922447   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1e26ad8acd4644857773d9c53d3ff2" candidate_uuid: "833e299675134d28bcc13d2c73b996a6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d7fcf132cb774583bd7967a84b418048"
I20260709 12:57:58.923056   566 raft_consensus.cc:3055] T 8e1e26ad8acd4644857773d9c53d3ff2 P 40919529b3d6492d82e76f9cb44e6542 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:57:58.923121   714 raft_consensus.cc:3060] T 8e1e26ad8acd4644857773d9c53d3ff2 P d7fcf132cb774583bd7967a84b418048 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:58.923432   566 raft_consensus.cc:740] T 8e1e26ad8acd4644857773d9c53d3ff2 P 40919529b3d6492d82e76f9cb44e6542 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 40919529b3d6492d82e76f9cb44e6542, State: Running, Role: LEADER
I20260709 12:57:58.924141   566 consensus_queue.cc:260] T 8e1e26ad8acd4644857773d9c53d3ff2 P 40919529b3d6492d82e76f9cb44e6542 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:58.925226   566 raft_consensus.cc:3060] T 8e1e26ad8acd4644857773d9c53d3ff2 P 40919529b3d6492d82e76f9cb44e6542 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:57:58.928853   714 raft_consensus.cc:2468] T 8e1e26ad8acd4644857773d9c53d3ff2 P d7fcf132cb774583bd7967a84b418048 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 833e299675134d28bcc13d2c73b996a6 in term 3.
I20260709 12:57:58.929898   605 leader_election.cc:304] T 8e1e26ad8acd4644857773d9c53d3ff2 P 833e299675134d28bcc13d2c73b996a6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 833e299675134d28bcc13d2c73b996a6, d7fcf132cb774583bd7967a84b418048; no voters: 
I20260709 12:57:58.930719   892 raft_consensus.cc:2804] T 8e1e26ad8acd4644857773d9c53d3ff2 P 833e299675134d28bcc13d2c73b996a6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:57:58.930881   566 raft_consensus.cc:2468] T 8e1e26ad8acd4644857773d9c53d3ff2 P 40919529b3d6492d82e76f9cb44e6542 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 833e299675134d28bcc13d2c73b996a6 in term 3.
I20260709 12:57:58.931162   892 raft_consensus.cc:697] T 8e1e26ad8acd4644857773d9c53d3ff2 P 833e299675134d28bcc13d2c73b996a6 [term 3 LEADER]: Becoming Leader. State: Replica: 833e299675134d28bcc13d2c73b996a6, State: Running, Role: LEADER
I20260709 12:57:58.932057   892 consensus_queue.cc:237] T 8e1e26ad8acd4644857773d9c53d3ff2 P 833e299675134d28bcc13d2c73b996a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:58.939144   462 catalog_manager.cc:5697] T 8e1e26ad8acd4644857773d9c53d3ff2 P 833e299675134d28bcc13d2c73b996a6 reported cstate change: term changed from 2 to 3, leader changed from 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193) to 833e299675134d28bcc13d2c73b996a6 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "833e299675134d28bcc13d2c73b996a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:59.133459   566 raft_consensus.cc:1275] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 40919529b3d6492d82e76f9cb44e6542 [term 4 FOLLOWER]: Refusing update from remote peer 833e299675134d28bcc13d2c73b996a6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:57:59.134526   892 consensus_queue.cc:1048] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 833e299675134d28bcc13d2c73b996a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:59.144022   714 raft_consensus.cc:1275] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P d7fcf132cb774583bd7967a84b418048 [term 4 FOLLOWER]: Refusing update from remote peer 833e299675134d28bcc13d2c73b996a6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:57:59.145576   917 consensus_queue.cc:1048] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 833e299675134d28bcc13d2c73b996a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:59.162218   847 raft_consensus.cc:993] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542: : Instructing follower 833e299675134d28bcc13d2c73b996a6 to start an election
I20260709 12:57:59.162729   910 raft_consensus.cc:1081] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542 [term 3 LEADER]: Signalling peer 833e299675134d28bcc13d2c73b996a6 to start an election
I20260709 12:57:59.164156   640 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "741777b7834d4f5e80bd0187702907dc"
dest_uuid: "833e299675134d28bcc13d2c73b996a6"
 from {username='slave'} at 127.0.0.1:40788
I20260709 12:57:59.164701   640 raft_consensus.cc:493] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:57:59.165092   640 raft_consensus.cc:3060] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:59.169797   640 raft_consensus.cc:515] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:59.171435   640 leader_election.cc:290] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [CANDIDATE]: Term 4 election: Requested vote from peers 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193:34223), d7fcf132cb774583bd7967a84b418048 (127.0.107.195:42711)
I20260709 12:57:59.172199   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "741777b7834d4f5e80bd0187702907dc" candidate_uuid: "833e299675134d28bcc13d2c73b996a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "40919529b3d6492d82e76f9cb44e6542"
I20260709 12:57:59.172398   714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "741777b7834d4f5e80bd0187702907dc" candidate_uuid: "833e299675134d28bcc13d2c73b996a6" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "d7fcf132cb774583bd7967a84b418048"
I20260709 12:57:59.172719   566 raft_consensus.cc:3055] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:57:59.172894   714 raft_consensus.cc:3060] T 741777b7834d4f5e80bd0187702907dc P d7fcf132cb774583bd7967a84b418048 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:59.173074   566 raft_consensus.cc:740] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 40919529b3d6492d82e76f9cb44e6542, State: Running, Role: LEADER
I20260709 12:57:59.173799   566 consensus_queue.cc:260] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:59.174575   566 raft_consensus.cc:3060] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:57:59.177039   714 raft_consensus.cc:2468] T 741777b7834d4f5e80bd0187702907dc P d7fcf132cb774583bd7967a84b418048 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 833e299675134d28bcc13d2c73b996a6 in term 4.
I20260709 12:57:59.178293   605 leader_election.cc:304] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 833e299675134d28bcc13d2c73b996a6, d7fcf132cb774583bd7967a84b418048; no voters: 
I20260709 12:57:59.178658   566 raft_consensus.cc:2468] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 833e299675134d28bcc13d2c73b996a6 in term 4.
I20260709 12:57:59.178941   917 raft_consensus.cc:2804] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:57:59.179414   917 raft_consensus.cc:697] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [term 4 LEADER]: Becoming Leader. State: Replica: 833e299675134d28bcc13d2c73b996a6, State: Running, Role: LEADER
I20260709 12:57:59.180156   917 consensus_queue.cc:237] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:57:59.185670   714 raft_consensus.cc:1275] T ba302d819a4c420b861764d4a6b5fed2 P d7fcf132cb774583bd7967a84b418048 [term 3 FOLLOWER]: Refusing update from remote peer 833e299675134d28bcc13d2c73b996a6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:59.186861   917 consensus_queue.cc:1048] T ba302d819a4c420b861764d4a6b5fed2 P 833e299675134d28bcc13d2c73b996a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:59.186669   461 catalog_manager.cc:5697] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 reported cstate change: term changed from 3 to 4, leader changed from 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193) to 833e299675134d28bcc13d2c73b996a6 (127.0.107.194). New cstate: current_term: 4 leader_uuid: "833e299675134d28bcc13d2c73b996a6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } health_report { overall_health: UNKNOWN } } }
I20260709 12:57:59.198362   566 raft_consensus.cc:1275] T ba302d819a4c420b861764d4a6b5fed2 P 40919529b3d6492d82e76f9cb44e6542 [term 3 FOLLOWER]: Refusing update from remote peer 833e299675134d28bcc13d2c73b996a6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:59.200229   917 consensus_queue.cc:1048] T ba302d819a4c420b861764d4a6b5fed2 P 833e299675134d28bcc13d2c73b996a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:59.324214   714 raft_consensus.cc:1275] T 8e1e26ad8acd4644857773d9c53d3ff2 P d7fcf132cb774583bd7967a84b418048 [term 3 FOLLOWER]: Refusing update from remote peer 833e299675134d28bcc13d2c73b996a6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:59.326094   917 consensus_queue.cc:1048] T 8e1e26ad8acd4644857773d9c53d3ff2 P 833e299675134d28bcc13d2c73b996a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:59.339898   566 raft_consensus.cc:1275] T 8e1e26ad8acd4644857773d9c53d3ff2 P 40919529b3d6492d82e76f9cb44e6542 [term 3 FOLLOWER]: Refusing update from remote peer 833e299675134d28bcc13d2c73b996a6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:57:59.341804   917 consensus_queue.cc:1048] T 8e1e26ad8acd4644857773d9c53d3ff2 P 833e299675134d28bcc13d2c73b996a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:57:59.354271   566 raft_consensus.cc:1275] T 3b933fbc94f143caae7395db46bfa15c P 40919529b3d6492d82e76f9cb44e6542 [term 4 FOLLOWER]: Refusing update from remote peer 833e299675134d28bcc13d2c73b996a6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:57:59.355376   917 consensus_queue.cc:1048] T 3b933fbc94f143caae7395db46bfa15c P 833e299675134d28bcc13d2c73b996a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:59.364125   714 raft_consensus.cc:1275] T 3b933fbc94f143caae7395db46bfa15c P d7fcf132cb774583bd7967a84b418048 [term 4 FOLLOWER]: Refusing update from remote peer 833e299675134d28bcc13d2c73b996a6: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:57:59.365605   909 consensus_queue.cc:1048] T 3b933fbc94f143caae7395db46bfa15c P 833e299675134d28bcc13d2c73b996a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:57:59.642308   714 raft_consensus.cc:1275] T 741777b7834d4f5e80bd0187702907dc P d7fcf132cb774583bd7967a84b418048 [term 4 FOLLOWER]: Refusing update from remote peer 833e299675134d28bcc13d2c73b996a6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:59.644084   922 consensus_queue.cc:1048] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:57:59.655421   565 raft_consensus.cc:1275] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542 [term 4 FOLLOWER]: Refusing update from remote peer 833e299675134d28bcc13d2c73b996a6: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:57:59.657302   922 consensus_queue.cc:1048] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:58:01.068163   587 debug-util.cc:398] Leaking SignalData structure 0x7b08000e5060 after lost signal to thread 434
W20260709 12:58:01.069093   587 debug-util.cc:398] Leaking SignalData structure 0x7b08000e5740 after lost signal to thread 497
W20260709 12:58:01.069919   587 debug-util.cc:398] Leaking SignalData structure 0x7b08000a88c0 after lost signal to thread 590
W20260709 12:58:01.070670   587 debug-util.cc:398] Leaking SignalData structure 0x7b08001d2dc0 after lost signal to thread 665
W20260709 12:58:01.071414   587 debug-util.cc:398] Leaking SignalData structure 0x7b08001bffc0 after lost signal to thread 739
I20260709 12:58:01.780040   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:01.787192   640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "741777b7834d4f5e80bd0187702907dc"
dest_uuid: "833e299675134d28bcc13d2c73b996a6"
mode: GRACEFUL
new_leader_uuid: "40919529b3d6492d82e76f9cb44e6542"
 from {username='slave'} at 127.0.0.1:40808
I20260709 12:58:01.787869   640 raft_consensus.cc:606] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [term 4 LEADER]: Received request to transfer leadership to TS 40919529b3d6492d82e76f9cb44e6542
I20260709 12:58:01.790474   640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e1e26ad8acd4644857773d9c53d3ff2"
dest_uuid: "833e299675134d28bcc13d2c73b996a6"
mode: GRACEFUL
new_leader_uuid: "d7fcf132cb774583bd7967a84b418048"
 from {username='slave'} at 127.0.0.1:40808
I20260709 12:58:01.790938   640 raft_consensus.cc:606] T 8e1e26ad8acd4644857773d9c53d3ff2 P 833e299675134d28bcc13d2c73b996a6 [term 3 LEADER]: Received request to transfer leadership to TS d7fcf132cb774583bd7967a84b418048
I20260709 12:58:01.793293   640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba302d819a4c420b861764d4a6b5fed2"
dest_uuid: "833e299675134d28bcc13d2c73b996a6"
mode: GRACEFUL
new_leader_uuid: "40919529b3d6492d82e76f9cb44e6542"
 from {username='slave'} at 127.0.0.1:40808
I20260709 12:58:01.793843   640 raft_consensus.cc:606] T ba302d819a4c420b861764d4a6b5fed2 P 833e299675134d28bcc13d2c73b996a6 [term 3 LEADER]: Received request to transfer leadership to TS 40919529b3d6492d82e76f9cb44e6542
I20260709 12:58:01.796165   640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd75112d105d4b269b9a7b422866104f"
dest_uuid: "833e299675134d28bcc13d2c73b996a6"
mode: GRACEFUL
new_leader_uuid: "d7fcf132cb774583bd7967a84b418048"
 from {username='slave'} at 127.0.0.1:40808
I20260709 12:58:01.796612   640 raft_consensus.cc:606] T bd75112d105d4b269b9a7b422866104f P 833e299675134d28bcc13d2c73b996a6 [term 1 LEADER]: Received request to transfer leadership to TS d7fcf132cb774583bd7967a84b418048
I20260709 12:58:01.798905   640 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c48ae3b2d706406fad9295ac2ecdd688"
dest_uuid: "833e299675134d28bcc13d2c73b996a6"
mode: GRACEFUL
new_leader_uuid: "40919529b3d6492d82e76f9cb44e6542"
 from {username='slave'} at 127.0.0.1:40808
I20260709 12:58:01.799309   640 raft_consensus.cc:606] T c48ae3b2d706406fad9295ac2ecdd688 P 833e299675134d28bcc13d2c73b996a6 [term 2 LEADER]: Received request to transfer leadership to TS 40919529b3d6492d82e76f9cb44e6542
I20260709 12:58:01.800348   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:58:01.800966   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:58:01.865872   892 raft_consensus.cc:993] T ba302d819a4c420b861764d4a6b5fed2 P 833e299675134d28bcc13d2c73b996a6: : Instructing follower 40919529b3d6492d82e76f9cb44e6542 to start an election
I20260709 12:58:01.866425   931 raft_consensus.cc:1081] T ba302d819a4c420b861764d4a6b5fed2 P 833e299675134d28bcc13d2c73b996a6 [term 3 LEADER]: Signalling peer 40919529b3d6492d82e76f9cb44e6542 to start an election
I20260709 12:58:01.868013   566 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba302d819a4c420b861764d4a6b5fed2"
dest_uuid: "40919529b3d6492d82e76f9cb44e6542"
 from {username='slave'} at 127.0.0.1:41746
I20260709 12:58:01.868486   566 raft_consensus.cc:493] T ba302d819a4c420b861764d4a6b5fed2 P 40919529b3d6492d82e76f9cb44e6542 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:01.868806   566 raft_consensus.cc:3060] T ba302d819a4c420b861764d4a6b5fed2 P 40919529b3d6492d82e76f9cb44e6542 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:01.873261   566 raft_consensus.cc:515] T ba302d819a4c420b861764d4a6b5fed2 P 40919529b3d6492d82e76f9cb44e6542 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:58:01.874864   566 leader_election.cc:290] T ba302d819a4c420b861764d4a6b5fed2 P 40919529b3d6492d82e76f9cb44e6542 [CANDIDATE]: Term 4 election: Requested vote from peers 833e299675134d28bcc13d2c73b996a6 (127.0.107.194:39403), d7fcf132cb774583bd7967a84b418048 (127.0.107.195:42711)
I20260709 12:58:01.875733   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba302d819a4c420b861764d4a6b5fed2" candidate_uuid: "40919529b3d6492d82e76f9cb44e6542" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "833e299675134d28bcc13d2c73b996a6"
I20260709 12:58:01.876142   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba302d819a4c420b861764d4a6b5fed2" candidate_uuid: "40919529b3d6492d82e76f9cb44e6542" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "d7fcf132cb774583bd7967a84b418048"
I20260709 12:58:01.876423   640 raft_consensus.cc:3055] T ba302d819a4c420b861764d4a6b5fed2 P 833e299675134d28bcc13d2c73b996a6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:01.876813   715 raft_consensus.cc:3060] T ba302d819a4c420b861764d4a6b5fed2 P d7fcf132cb774583bd7967a84b418048 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:01.876789   640 raft_consensus.cc:740] T ba302d819a4c420b861764d4a6b5fed2 P 833e299675134d28bcc13d2c73b996a6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 833e299675134d28bcc13d2c73b996a6, State: Running, Role: LEADER
I20260709 12:58:01.877780   640 consensus_queue.cc:260] T ba302d819a4c420b861764d4a6b5fed2 P 833e299675134d28bcc13d2c73b996a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:58:01.879001   640 raft_consensus.cc:3060] T ba302d819a4c420b861764d4a6b5fed2 P 833e299675134d28bcc13d2c73b996a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:01.881743   715 raft_consensus.cc:2468] T ba302d819a4c420b861764d4a6b5fed2 P d7fcf132cb774583bd7967a84b418048 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40919529b3d6492d82e76f9cb44e6542 in term 4.
I20260709 12:58:01.883037   530 leader_election.cc:304] T ba302d819a4c420b861764d4a6b5fed2 P 40919529b3d6492d82e76f9cb44e6542 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40919529b3d6492d82e76f9cb44e6542, d7fcf132cb774583bd7967a84b418048; no voters: 
I20260709 12:58:01.884486   932 raft_consensus.cc:2804] T ba302d819a4c420b861764d4a6b5fed2 P 40919529b3d6492d82e76f9cb44e6542 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:01.885768   640 raft_consensus.cc:2468] T ba302d819a4c420b861764d4a6b5fed2 P 833e299675134d28bcc13d2c73b996a6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40919529b3d6492d82e76f9cb44e6542 in term 4.
I20260709 12:58:01.887025   932 raft_consensus.cc:697] T ba302d819a4c420b861764d4a6b5fed2 P 40919529b3d6492d82e76f9cb44e6542 [term 4 LEADER]: Becoming Leader. State: Replica: 40919529b3d6492d82e76f9cb44e6542, State: Running, Role: LEADER
I20260709 12:58:01.888025   932 consensus_queue.cc:237] T ba302d819a4c420b861764d4a6b5fed2 P 40919529b3d6492d82e76f9cb44e6542 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:58:01.897728   462 catalog_manager.cc:5697] T ba302d819a4c420b861764d4a6b5fed2 P 40919529b3d6492d82e76f9cb44e6542 reported cstate change: term changed from 3 to 4, leader changed from 833e299675134d28bcc13d2c73b996a6 (127.0.107.194) to 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "40919529b3d6492d82e76f9cb44e6542" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:01.955020   892 raft_consensus.cc:993] T c48ae3b2d706406fad9295ac2ecdd688 P 833e299675134d28bcc13d2c73b996a6: : Instructing follower 40919529b3d6492d82e76f9cb44e6542 to start an election
I20260709 12:58:01.955494   931 raft_consensus.cc:1081] T c48ae3b2d706406fad9295ac2ecdd688 P 833e299675134d28bcc13d2c73b996a6 [term 2 LEADER]: Signalling peer 40919529b3d6492d82e76f9cb44e6542 to start an election
I20260709 12:58:01.957296   566 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c48ae3b2d706406fad9295ac2ecdd688"
dest_uuid: "40919529b3d6492d82e76f9cb44e6542"
 from {username='slave'} at 127.0.0.1:41746
I20260709 12:58:01.957855   566 raft_consensus.cc:493] T c48ae3b2d706406fad9295ac2ecdd688 P 40919529b3d6492d82e76f9cb44e6542 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:01.958206   566 raft_consensus.cc:3060] T c48ae3b2d706406fad9295ac2ecdd688 P 40919529b3d6492d82e76f9cb44e6542 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:01.965059   566 raft_consensus.cc:515] T c48ae3b2d706406fad9295ac2ecdd688 P 40919529b3d6492d82e76f9cb44e6542 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:58:01.967061   566 leader_election.cc:290] T c48ae3b2d706406fad9295ac2ecdd688 P 40919529b3d6492d82e76f9cb44e6542 [CANDIDATE]: Term 3 election: Requested vote from peers 833e299675134d28bcc13d2c73b996a6 (127.0.107.194:39403), d7fcf132cb774583bd7967a84b418048 (127.0.107.195:42711)
I20260709 12:58:01.967762   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48ae3b2d706406fad9295ac2ecdd688" candidate_uuid: "40919529b3d6492d82e76f9cb44e6542" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "833e299675134d28bcc13d2c73b996a6"
I20260709 12:58:01.968326   640 raft_consensus.cc:3055] T c48ae3b2d706406fad9295ac2ecdd688 P 833e299675134d28bcc13d2c73b996a6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:01.968786   640 raft_consensus.cc:740] T c48ae3b2d706406fad9295ac2ecdd688 P 833e299675134d28bcc13d2c73b996a6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 833e299675134d28bcc13d2c73b996a6, State: Running, Role: LEADER
I20260709 12:58:01.968221   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c48ae3b2d706406fad9295ac2ecdd688" candidate_uuid: "40919529b3d6492d82e76f9cb44e6542" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d7fcf132cb774583bd7967a84b418048"
I20260709 12:58:01.969214   715 raft_consensus.cc:3060] T c48ae3b2d706406fad9295ac2ecdd688 P d7fcf132cb774583bd7967a84b418048 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:01.969514   640 consensus_queue.cc:260] T c48ae3b2d706406fad9295ac2ecdd688 P 833e299675134d28bcc13d2c73b996a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:58:01.970677   640 raft_consensus.cc:3060] T c48ae3b2d706406fad9295ac2ecdd688 P 833e299675134d28bcc13d2c73b996a6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:01.975852   715 raft_consensus.cc:2468] T c48ae3b2d706406fad9295ac2ecdd688 P d7fcf132cb774583bd7967a84b418048 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40919529b3d6492d82e76f9cb44e6542 in term 3.
I20260709 12:58:01.976737   640 raft_consensus.cc:2468] T c48ae3b2d706406fad9295ac2ecdd688 P 833e299675134d28bcc13d2c73b996a6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40919529b3d6492d82e76f9cb44e6542 in term 3.
I20260709 12:58:01.977145   530 leader_election.cc:304] T c48ae3b2d706406fad9295ac2ecdd688 P 40919529b3d6492d82e76f9cb44e6542 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40919529b3d6492d82e76f9cb44e6542, d7fcf132cb774583bd7967a84b418048; no voters: 
I20260709 12:58:01.977993   932 raft_consensus.cc:2804] T c48ae3b2d706406fad9295ac2ecdd688 P 40919529b3d6492d82e76f9cb44e6542 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:01.978502   932 raft_consensus.cc:697] T c48ae3b2d706406fad9295ac2ecdd688 P 40919529b3d6492d82e76f9cb44e6542 [term 3 LEADER]: Becoming Leader. State: Replica: 40919529b3d6492d82e76f9cb44e6542, State: Running, Role: LEADER
I20260709 12:58:01.979434   932 consensus_queue.cc:237] T c48ae3b2d706406fad9295ac2ecdd688 P 40919529b3d6492d82e76f9cb44e6542 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:58:01.987974   462 catalog_manager.cc:5697] T c48ae3b2d706406fad9295ac2ecdd688 P 40919529b3d6492d82e76f9cb44e6542 reported cstate change: term changed from 2 to 3, leader changed from 833e299675134d28bcc13d2c73b996a6 (127.0.107.194) to 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "40919529b3d6492d82e76f9cb44e6542" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:02.027359   892 raft_consensus.cc:993] T bd75112d105d4b269b9a7b422866104f P 833e299675134d28bcc13d2c73b996a6: : Instructing follower d7fcf132cb774583bd7967a84b418048 to start an election
I20260709 12:58:02.027845   931 raft_consensus.cc:1081] T bd75112d105d4b269b9a7b422866104f P 833e299675134d28bcc13d2c73b996a6 [term 1 LEADER]: Signalling peer d7fcf132cb774583bd7967a84b418048 to start an election
I20260709 12:58:02.029949   715 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd75112d105d4b269b9a7b422866104f"
dest_uuid: "d7fcf132cb774583bd7967a84b418048"
 from {username='slave'} at 127.0.0.1:55784
I20260709 12:58:02.030577   715 raft_consensus.cc:493] T bd75112d105d4b269b9a7b422866104f P d7fcf132cb774583bd7967a84b418048 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:02.030929   715 raft_consensus.cc:3060] T bd75112d105d4b269b9a7b422866104f P d7fcf132cb774583bd7967a84b418048 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:02.035856   715 raft_consensus.cc:515] T bd75112d105d4b269b9a7b422866104f P d7fcf132cb774583bd7967a84b418048 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:58:02.038192   715 leader_election.cc:290] T bd75112d105d4b269b9a7b422866104f P d7fcf132cb774583bd7967a84b418048 [CANDIDATE]: Term 2 election: Requested vote from peers 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193:34223), 833e299675134d28bcc13d2c73b996a6 (127.0.107.194:39403)
I20260709 12:58:02.039201   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd75112d105d4b269b9a7b422866104f" candidate_uuid: "d7fcf132cb774583bd7967a84b418048" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "833e299675134d28bcc13d2c73b996a6"
I20260709 12:58:02.039086   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd75112d105d4b269b9a7b422866104f" candidate_uuid: "d7fcf132cb774583bd7967a84b418048" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40919529b3d6492d82e76f9cb44e6542"
I20260709 12:58:02.039746   640 raft_consensus.cc:3055] T bd75112d105d4b269b9a7b422866104f P 833e299675134d28bcc13d2c73b996a6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:02.039852   566 raft_consensus.cc:3060] T bd75112d105d4b269b9a7b422866104f P 40919529b3d6492d82e76f9cb44e6542 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:02.040071   640 raft_consensus.cc:740] T bd75112d105d4b269b9a7b422866104f P 833e299675134d28bcc13d2c73b996a6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 833e299675134d28bcc13d2c73b996a6, State: Running, Role: LEADER
I20260709 12:58:02.040769   640 consensus_queue.cc:260] T bd75112d105d4b269b9a7b422866104f P 833e299675134d28bcc13d2c73b996a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:58:02.041857   640 raft_consensus.cc:3060] T bd75112d105d4b269b9a7b422866104f P 833e299675134d28bcc13d2c73b996a6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:02.045917   566 raft_consensus.cc:2468] T bd75112d105d4b269b9a7b422866104f P 40919529b3d6492d82e76f9cb44e6542 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7fcf132cb774583bd7967a84b418048 in term 2.
I20260709 12:58:02.047391   680 leader_election.cc:304] T bd75112d105d4b269b9a7b422866104f P d7fcf132cb774583bd7967a84b418048 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40919529b3d6492d82e76f9cb44e6542, d7fcf132cb774583bd7967a84b418048; no voters: 
I20260709 12:58:02.047770   640 raft_consensus.cc:2468] T bd75112d105d4b269b9a7b422866104f P 833e299675134d28bcc13d2c73b996a6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7fcf132cb774583bd7967a84b418048 in term 2.
I20260709 12:58:02.048373   893 raft_consensus.cc:2804] T bd75112d105d4b269b9a7b422866104f P d7fcf132cb774583bd7967a84b418048 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:02.049815   893 raft_consensus.cc:697] T bd75112d105d4b269b9a7b422866104f P d7fcf132cb774583bd7967a84b418048 [term 2 LEADER]: Becoming Leader. State: Replica: d7fcf132cb774583bd7967a84b418048, State: Running, Role: LEADER
I20260709 12:58:02.050967   893 consensus_queue.cc:237] T bd75112d105d4b269b9a7b422866104f P d7fcf132cb774583bd7967a84b418048 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:58:02.061978   462 catalog_manager.cc:5697] T bd75112d105d4b269b9a7b422866104f P d7fcf132cb774583bd7967a84b418048 reported cstate change: term changed from 1 to 2, leader changed from 833e299675134d28bcc13d2c73b996a6 (127.0.107.194) to d7fcf132cb774583bd7967a84b418048 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "d7fcf132cb774583bd7967a84b418048" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:02.126323   892 raft_consensus.cc:993] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6: : Instructing follower 40919529b3d6492d82e76f9cb44e6542 to start an election
I20260709 12:58:02.126823   931 raft_consensus.cc:1081] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [term 4 LEADER]: Signalling peer 40919529b3d6492d82e76f9cb44e6542 to start an election
I20260709 12:58:02.128376   566 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "741777b7834d4f5e80bd0187702907dc"
dest_uuid: "40919529b3d6492d82e76f9cb44e6542"
 from {username='slave'} at 127.0.0.1:41746
I20260709 12:58:02.128908   566 raft_consensus.cc:493] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:02.129179   566 raft_consensus.cc:3060] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:02.132898   566 raft_consensus.cc:515] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:58:02.134311   566 leader_election.cc:290] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542 [CANDIDATE]: Term 5 election: Requested vote from peers 833e299675134d28bcc13d2c73b996a6 (127.0.107.194:39403), d7fcf132cb774583bd7967a84b418048 (127.0.107.195:42711)
I20260709 12:58:02.135341   715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "741777b7834d4f5e80bd0187702907dc" candidate_uuid: "40919529b3d6492d82e76f9cb44e6542" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "d7fcf132cb774583bd7967a84b418048"
I20260709 12:58:02.135341   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "741777b7834d4f5e80bd0187702907dc" candidate_uuid: "40919529b3d6492d82e76f9cb44e6542" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "833e299675134d28bcc13d2c73b996a6"
I20260709 12:58:02.135931   715 raft_consensus.cc:3060] T 741777b7834d4f5e80bd0187702907dc P d7fcf132cb774583bd7967a84b418048 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:02.136171   640 raft_consensus.cc:3055] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:02.136462   640 raft_consensus.cc:740] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 833e299675134d28bcc13d2c73b996a6, State: Running, Role: LEADER
I20260709 12:58:02.137212   640 consensus_queue.cc:260] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:58:02.138558   640 raft_consensus.cc:3060] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:02.143208   715 raft_consensus.cc:2468] T 741777b7834d4f5e80bd0187702907dc P d7fcf132cb774583bd7967a84b418048 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40919529b3d6492d82e76f9cb44e6542 in term 5.
I20260709 12:58:02.144392   530 leader_election.cc:304] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40919529b3d6492d82e76f9cb44e6542, d7fcf132cb774583bd7967a84b418048; no voters: 
I20260709 12:58:02.145212   932 raft_consensus.cc:2804] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:02.145370   640 raft_consensus.cc:2468] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40919529b3d6492d82e76f9cb44e6542 in term 5.
I20260709 12:58:02.145738   932 raft_consensus.cc:697] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542 [term 5 LEADER]: Becoming Leader. State: Replica: 40919529b3d6492d82e76f9cb44e6542, State: Running, Role: LEADER
I20260709 12:58:02.147527   932 consensus_queue.cc:237] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:58:02.155638   462 catalog_manager.cc:5697] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542 reported cstate change: term changed from 4 to 5, leader changed from 833e299675134d28bcc13d2c73b996a6 (127.0.107.194) to 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193). New cstate: current_term: 5 leader_uuid: "40919529b3d6492d82e76f9cb44e6542" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:02.316134   892 raft_consensus.cc:993] T 8e1e26ad8acd4644857773d9c53d3ff2 P 833e299675134d28bcc13d2c73b996a6: : Instructing follower d7fcf132cb774583bd7967a84b418048 to start an election
I20260709 12:58:02.316677   892 raft_consensus.cc:1081] T 8e1e26ad8acd4644857773d9c53d3ff2 P 833e299675134d28bcc13d2c73b996a6 [term 3 LEADER]: Signalling peer d7fcf132cb774583bd7967a84b418048 to start an election
I20260709 12:58:02.318254   715 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8e1e26ad8acd4644857773d9c53d3ff2"
dest_uuid: "d7fcf132cb774583bd7967a84b418048"
 from {username='slave'} at 127.0.0.1:55784
I20260709 12:58:02.318745   715 raft_consensus.cc:493] T 8e1e26ad8acd4644857773d9c53d3ff2 P d7fcf132cb774583bd7967a84b418048 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:02.319193   715 raft_consensus.cc:3060] T 8e1e26ad8acd4644857773d9c53d3ff2 P d7fcf132cb774583bd7967a84b418048 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:02.324923   715 raft_consensus.cc:515] T 8e1e26ad8acd4644857773d9c53d3ff2 P d7fcf132cb774583bd7967a84b418048 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:58:02.326460   715 leader_election.cc:290] T 8e1e26ad8acd4644857773d9c53d3ff2 P d7fcf132cb774583bd7967a84b418048 [CANDIDATE]: Term 4 election: Requested vote from peers 833e299675134d28bcc13d2c73b996a6 (127.0.107.194:39403), 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193:34223)
I20260709 12:58:02.327194   640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1e26ad8acd4644857773d9c53d3ff2" candidate_uuid: "d7fcf132cb774583bd7967a84b418048" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "833e299675134d28bcc13d2c73b996a6"
I20260709 12:58:02.327917   640 raft_consensus.cc:3055] T 8e1e26ad8acd4644857773d9c53d3ff2 P 833e299675134d28bcc13d2c73b996a6 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:02.328249   640 raft_consensus.cc:740] T 8e1e26ad8acd4644857773d9c53d3ff2 P 833e299675134d28bcc13d2c73b996a6 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 833e299675134d28bcc13d2c73b996a6, State: Running, Role: LEADER
I20260709 12:58:02.327358   566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e1e26ad8acd4644857773d9c53d3ff2" candidate_uuid: "d7fcf132cb774583bd7967a84b418048" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "40919529b3d6492d82e76f9cb44e6542"
I20260709 12:58:02.328912   566 raft_consensus.cc:3060] T 8e1e26ad8acd4644857773d9c53d3ff2 P 40919529b3d6492d82e76f9cb44e6542 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:02.329036   640 consensus_queue.cc:260] T 8e1e26ad8acd4644857773d9c53d3ff2 P 833e299675134d28bcc13d2c73b996a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:58:02.330331   640 raft_consensus.cc:3060] T 8e1e26ad8acd4644857773d9c53d3ff2 P 833e299675134d28bcc13d2c73b996a6 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:02.332847   566 raft_consensus.cc:2468] T 8e1e26ad8acd4644857773d9c53d3ff2 P 40919529b3d6492d82e76f9cb44e6542 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7fcf132cb774583bd7967a84b418048 in term 4.
I20260709 12:58:02.333714   680 leader_election.cc:304] T 8e1e26ad8acd4644857773d9c53d3ff2 P d7fcf132cb774583bd7967a84b418048 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40919529b3d6492d82e76f9cb44e6542, d7fcf132cb774583bd7967a84b418048; no voters: 
I20260709 12:58:02.334328   893 raft_consensus.cc:2804] T 8e1e26ad8acd4644857773d9c53d3ff2 P d7fcf132cb774583bd7967a84b418048 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:02.334818   893 raft_consensus.cc:697] T 8e1e26ad8acd4644857773d9c53d3ff2 P d7fcf132cb774583bd7967a84b418048 [term 4 LEADER]: Becoming Leader. State: Replica: d7fcf132cb774583bd7967a84b418048, State: Running, Role: LEADER
I20260709 12:58:02.335785   893 consensus_queue.cc:237] T 8e1e26ad8acd4644857773d9c53d3ff2 P d7fcf132cb774583bd7967a84b418048 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } } peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } }
I20260709 12:58:02.338199   640 raft_consensus.cc:2468] T 8e1e26ad8acd4644857773d9c53d3ff2 P 833e299675134d28bcc13d2c73b996a6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7fcf132cb774583bd7967a84b418048 in term 4.
I20260709 12:58:02.344620   462 catalog_manager.cc:5697] T 8e1e26ad8acd4644857773d9c53d3ff2 P d7fcf132cb774583bd7967a84b418048 reported cstate change: term changed from 3 to 4, leader changed from 833e299675134d28bcc13d2c73b996a6 (127.0.107.194) to d7fcf132cb774583bd7967a84b418048 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "d7fcf132cb774583bd7967a84b418048" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:02.375629   715 raft_consensus.cc:1275] T ba302d819a4c420b861764d4a6b5fed2 P d7fcf132cb774583bd7967a84b418048 [term 4 FOLLOWER]: Refusing update from remote peer 40919529b3d6492d82e76f9cb44e6542: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:02.376982   932 consensus_queue.cc:1048] T ba302d819a4c420b861764d4a6b5fed2 P 40919529b3d6492d82e76f9cb44e6542 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:02.398116   640 raft_consensus.cc:1275] T ba302d819a4c420b861764d4a6b5fed2 P 833e299675134d28bcc13d2c73b996a6 [term 4 FOLLOWER]: Refusing update from remote peer 40919529b3d6492d82e76f9cb44e6542: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:02.399574   932 consensus_queue.cc:1048] T ba302d819a4c420b861764d4a6b5fed2 P 40919529b3d6492d82e76f9cb44e6542 [LEADER]: Connected to new peer: Peer: permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:02.538113   640 raft_consensus.cc:1275] T bd75112d105d4b269b9a7b422866104f P 833e299675134d28bcc13d2c73b996a6 [term 2 FOLLOWER]: Refusing update from remote peer d7fcf132cb774583bd7967a84b418048: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:02.539543   893 consensus_queue.cc:1048] T bd75112d105d4b269b9a7b422866104f P d7fcf132cb774583bd7967a84b418048 [LEADER]: Connected to new peer: Peer: permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:02.550141   566 raft_consensus.cc:1275] T bd75112d105d4b269b9a7b422866104f P 40919529b3d6492d82e76f9cb44e6542 [term 2 FOLLOWER]: Refusing update from remote peer d7fcf132cb774583bd7967a84b418048: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:02.551824   893 consensus_queue.cc:1048] T bd75112d105d4b269b9a7b422866104f P d7fcf132cb774583bd7967a84b418048 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40919529b3d6492d82e76f9cb44e6542" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34223 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:02.587285   640 raft_consensus.cc:1275] T c48ae3b2d706406fad9295ac2ecdd688 P 833e299675134d28bcc13d2c73b996a6 [term 3 FOLLOWER]: Refusing update from remote peer 40919529b3d6492d82e76f9cb44e6542: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:02.588411   932 consensus_queue.cc:1048] T c48ae3b2d706406fad9295ac2ecdd688 P 40919529b3d6492d82e76f9cb44e6542 [LEADER]: Connected to new peer: Peer: permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:02.597247   715 raft_consensus.cc:1275] T c48ae3b2d706406fad9295ac2ecdd688 P d7fcf132cb774583bd7967a84b418048 [term 3 FOLLOWER]: Refusing update from remote peer 40919529b3d6492d82e76f9cb44e6542: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:02.598910   933 consensus_queue.cc:1048] T c48ae3b2d706406fad9295ac2ecdd688 P 40919529b3d6492d82e76f9cb44e6542 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:02.742759   640 raft_consensus.cc:1275] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [term 5 FOLLOWER]: Refusing update from remote peer 40919529b3d6492d82e76f9cb44e6542: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:58:02.744146   933 consensus_queue.cc:1048] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542 [LEADER]: Connected to new peer: Peer: permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:02.752909   715 raft_consensus.cc:1275] T 741777b7834d4f5e80bd0187702907dc P d7fcf132cb774583bd7967a84b418048 [term 5 FOLLOWER]: Refusing update from remote peer 40919529b3d6492d82e76f9cb44e6542: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:58:02.755704   932 consensus_queue.cc:1048] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d7fcf132cb774583bd7967a84b418048" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 42711 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:02.801908   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:02.809218   641 raft_consensus.cc:1275] T 8e1e26ad8acd4644857773d9c53d3ff2 P 833e299675134d28bcc13d2c73b996a6 [term 4 FOLLOWER]: Refusing update from remote peer d7fcf132cb774583bd7967a84b418048: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:02.810887   952 consensus_queue.cc:1048] T 8e1e26ad8acd4644857773d9c53d3ff2 P d7fcf132cb774583bd7967a84b418048 [LEADER]: Connected to new peer: Peer: permanent_uuid: "833e299675134d28bcc13d2c73b996a6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:02.813794   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 12:58:02.817437   680 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:58:02.834506   680 consensus_peers.cc:597] T 8e1e26ad8acd4644857773d9c53d3ff2 P d7fcf132cb774583bd7967a84b418048 -> Peer 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193:34223): Couldn't send request to peer 40919529b3d6492d82e76f9cb44e6542. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:02.864419   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:58:02.865290   431 tablet_replica.cc:333] T 2c2a2160a9fd483da791a5a8beb07ac6 P 40919529b3d6492d82e76f9cb44e6542: stopping tablet replica
I20260709 12:58:02.866021   431 raft_consensus.cc:2243] T 2c2a2160a9fd483da791a5a8beb07ac6 P 40919529b3d6492d82e76f9cb44e6542 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:02.866501   431 raft_consensus.cc:2272] T 2c2a2160a9fd483da791a5a8beb07ac6 P 40919529b3d6492d82e76f9cb44e6542 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:02.869025   431 tablet_replica.cc:333] T 8e1e26ad8acd4644857773d9c53d3ff2 P 40919529b3d6492d82e76f9cb44e6542: stopping tablet replica
I20260709 12:58:02.869580   431 raft_consensus.cc:2243] T 8e1e26ad8acd4644857773d9c53d3ff2 P 40919529b3d6492d82e76f9cb44e6542 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:02.870054   431 raft_consensus.cc:2272] T 8e1e26ad8acd4644857773d9c53d3ff2 P 40919529b3d6492d82e76f9cb44e6542 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:02.871755   431 tablet_replica.cc:333] T ba302d819a4c420b861764d4a6b5fed2 P 40919529b3d6492d82e76f9cb44e6542: stopping tablet replica
I20260709 12:58:02.872330   431 raft_consensus.cc:2243] T ba302d819a4c420b861764d4a6b5fed2 P 40919529b3d6492d82e76f9cb44e6542 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:58:02.873131   431 raft_consensus.cc:2272] T ba302d819a4c420b861764d4a6b5fed2 P 40919529b3d6492d82e76f9cb44e6542 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:02.876626   431 tablet_replica.cc:333] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542: stopping tablet replica
I20260709 12:58:02.877332   431 raft_consensus.cc:2243] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542 [term 5 LEADER]: Raft consensus shutting down.
W20260709 12:58:02.877662   606 consensus_peers.cc:597] T 3b933fbc94f143caae7395db46bfa15c P 833e299675134d28bcc13d2c73b996a6 -> Peer 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193:34223): Couldn't send request to peer 40919529b3d6492d82e76f9cb44e6542. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:02.878190   431 raft_consensus.cc:2272] T 741777b7834d4f5e80bd0187702907dc P 40919529b3d6492d82e76f9cb44e6542 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:02.880235   431 tablet_replica.cc:333] T c48ae3b2d706406fad9295ac2ecdd688 P 40919529b3d6492d82e76f9cb44e6542: stopping tablet replica
I20260709 12:58:02.880831   431 raft_consensus.cc:2243] T c48ae3b2d706406fad9295ac2ecdd688 P 40919529b3d6492d82e76f9cb44e6542 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:58:02.881537   431 raft_consensus.cc:2272] T c48ae3b2d706406fad9295ac2ecdd688 P 40919529b3d6492d82e76f9cb44e6542 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:02.883469   431 tablet_replica.cc:333] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 40919529b3d6492d82e76f9cb44e6542: stopping tablet replica
I20260709 12:58:02.883950   431 raft_consensus.cc:2243] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 40919529b3d6492d82e76f9cb44e6542 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:02.884402   431 raft_consensus.cc:2272] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 40919529b3d6492d82e76f9cb44e6542 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:02.886053   431 tablet_replica.cc:333] T bd75112d105d4b269b9a7b422866104f P 40919529b3d6492d82e76f9cb44e6542: stopping tablet replica
I20260709 12:58:02.886523   431 raft_consensus.cc:2243] T bd75112d105d4b269b9a7b422866104f P 40919529b3d6492d82e76f9cb44e6542 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:02.886921   431 raft_consensus.cc:2272] T bd75112d105d4b269b9a7b422866104f P 40919529b3d6492d82e76f9cb44e6542 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:02.889113   431 tablet_replica.cc:333] T 3b933fbc94f143caae7395db46bfa15c P 40919529b3d6492d82e76f9cb44e6542: stopping tablet replica
I20260709 12:58:02.889601   431 raft_consensus.cc:2243] T 3b933fbc94f143caae7395db46bfa15c P 40919529b3d6492d82e76f9cb44e6542 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:02.890012   431 raft_consensus.cc:2272] T 3b933fbc94f143caae7395db46bfa15c P 40919529b3d6492d82e76f9cb44e6542 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:02.891748   431 tablet_replica.cc:333] T d3bc6327504f44dab50a3f1663e18ef4 P 40919529b3d6492d82e76f9cb44e6542: stopping tablet replica
I20260709 12:58:02.892184   431 raft_consensus.cc:2243] T d3bc6327504f44dab50a3f1663e18ef4 P 40919529b3d6492d82e76f9cb44e6542 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:02.892642   431 raft_consensus.cc:2272] T d3bc6327504f44dab50a3f1663e18ef4 P 40919529b3d6492d82e76f9cb44e6542 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:58:03.045578   606 consensus_peers.cc:597] T d3bc6327504f44dab50a3f1663e18ef4 P 833e299675134d28bcc13d2c73b996a6 -> Peer 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193:34223): Couldn't send request to peer 40919529b3d6492d82e76f9cb44e6542. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:58:03.122684   606 consensus_peers.cc:597] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 833e299675134d28bcc13d2c73b996a6 -> Peer 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193:34223): Couldn't send request to peer 40919529b3d6492d82e76f9cb44e6542. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:58:03.141368   680 consensus_peers.cc:597] T 2c2a2160a9fd483da791a5a8beb07ac6 P d7fcf132cb774583bd7967a84b418048 -> Peer 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193:34223): Couldn't send request to peer 40919529b3d6492d82e76f9cb44e6542. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:58:03.178397   680 consensus_peers.cc:597] T bd75112d105d4b269b9a7b422866104f P d7fcf132cb774583bd7967a84b418048 -> Peer 40919529b3d6492d82e76f9cb44e6542 (127.0.107.193:34223): Couldn't send request to peer 40919529b3d6492d82e76f9cb44e6542. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34223: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:03.513254   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
I20260709 12:58:03.533586   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 12:58:03.554656   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:58:03.555287   431 tablet_replica.cc:333] T 2c2a2160a9fd483da791a5a8beb07ac6 P 833e299675134d28bcc13d2c73b996a6: stopping tablet replica
I20260709 12:58:03.555863   431 raft_consensus.cc:2243] T 2c2a2160a9fd483da791a5a8beb07ac6 P 833e299675134d28bcc13d2c73b996a6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:03.556349   431 raft_consensus.cc:2272] T 2c2a2160a9fd483da791a5a8beb07ac6 P 833e299675134d28bcc13d2c73b996a6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:03.558036   431 tablet_replica.cc:333] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 833e299675134d28bcc13d2c73b996a6: stopping tablet replica
I20260709 12:58:03.558511   431 raft_consensus.cc:2243] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 833e299675134d28bcc13d2c73b996a6 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:58:03.559167   431 raft_consensus.cc:2272] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P 833e299675134d28bcc13d2c73b996a6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:03.560820   431 tablet_replica.cc:333] T c48ae3b2d706406fad9295ac2ecdd688 P 833e299675134d28bcc13d2c73b996a6: stopping tablet replica
I20260709 12:58:03.561273   431 raft_consensus.cc:2243] T c48ae3b2d706406fad9295ac2ecdd688 P 833e299675134d28bcc13d2c73b996a6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:03.561640   431 raft_consensus.cc:2272] T c48ae3b2d706406fad9295ac2ecdd688 P 833e299675134d28bcc13d2c73b996a6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:03.564189   431 tablet_replica.cc:333] T 3b933fbc94f143caae7395db46bfa15c P 833e299675134d28bcc13d2c73b996a6: stopping tablet replica
I20260709 12:58:03.564711   431 raft_consensus.cc:2243] T 3b933fbc94f143caae7395db46bfa15c P 833e299675134d28bcc13d2c73b996a6 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:58:03.565327   431 raft_consensus.cc:2272] T 3b933fbc94f143caae7395db46bfa15c P 833e299675134d28bcc13d2c73b996a6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:03.566766   431 tablet_replica.cc:333] T d3bc6327504f44dab50a3f1663e18ef4 P 833e299675134d28bcc13d2c73b996a6: stopping tablet replica
I20260709 12:58:03.567203   431 raft_consensus.cc:2243] T d3bc6327504f44dab50a3f1663e18ef4 P 833e299675134d28bcc13d2c73b996a6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:58:03.567806   431 raft_consensus.cc:2272] T d3bc6327504f44dab50a3f1663e18ef4 P 833e299675134d28bcc13d2c73b996a6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:03.569303   431 tablet_replica.cc:333] T bd75112d105d4b269b9a7b422866104f P 833e299675134d28bcc13d2c73b996a6: stopping tablet replica
I20260709 12:58:03.569741   431 raft_consensus.cc:2243] T bd75112d105d4b269b9a7b422866104f P 833e299675134d28bcc13d2c73b996a6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:03.570096   431 raft_consensus.cc:2272] T bd75112d105d4b269b9a7b422866104f P 833e299675134d28bcc13d2c73b996a6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:03.571508   431 tablet_replica.cc:333] T ba302d819a4c420b861764d4a6b5fed2 P 833e299675134d28bcc13d2c73b996a6: stopping tablet replica
I20260709 12:58:03.571951   431 raft_consensus.cc:2243] T ba302d819a4c420b861764d4a6b5fed2 P 833e299675134d28bcc13d2c73b996a6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:03.572306   431 raft_consensus.cc:2272] T ba302d819a4c420b861764d4a6b5fed2 P 833e299675134d28bcc13d2c73b996a6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:03.573922   431 tablet_replica.cc:333] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6: stopping tablet replica
I20260709 12:58:03.574342   431 raft_consensus.cc:2243] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:03.574697   431 raft_consensus.cc:2272] T 741777b7834d4f5e80bd0187702907dc P 833e299675134d28bcc13d2c73b996a6 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:03.576668   431 tablet_replica.cc:333] T 8e1e26ad8acd4644857773d9c53d3ff2 P 833e299675134d28bcc13d2c73b996a6: stopping tablet replica
I20260709 12:58:03.577075   431 raft_consensus.cc:2243] T 8e1e26ad8acd4644857773d9c53d3ff2 P 833e299675134d28bcc13d2c73b996a6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:03.577486   431 raft_consensus.cc:2272] T 8e1e26ad8acd4644857773d9c53d3ff2 P 833e299675134d28bcc13d2c73b996a6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:03.604441   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 12:58:03.620434   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 12:58:03.641954   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:58:03.642575   431 tablet_replica.cc:333] T 2c2a2160a9fd483da791a5a8beb07ac6 P d7fcf132cb774583bd7967a84b418048: stopping tablet replica
I20260709 12:58:03.643172   431 raft_consensus.cc:2243] T 2c2a2160a9fd483da791a5a8beb07ac6 P d7fcf132cb774583bd7967a84b418048 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:58:03.643909   431 raft_consensus.cc:2272] T 2c2a2160a9fd483da791a5a8beb07ac6 P d7fcf132cb774583bd7967a84b418048 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:03.645705   431 tablet_replica.cc:333] T bd75112d105d4b269b9a7b422866104f P d7fcf132cb774583bd7967a84b418048: stopping tablet replica
I20260709 12:58:03.646194   431 raft_consensus.cc:2243] T bd75112d105d4b269b9a7b422866104f P d7fcf132cb774583bd7967a84b418048 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:58:03.646848   431 raft_consensus.cc:2272] T bd75112d105d4b269b9a7b422866104f P d7fcf132cb774583bd7967a84b418048 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:03.648383   431 tablet_replica.cc:333] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P d7fcf132cb774583bd7967a84b418048: stopping tablet replica
I20260709 12:58:03.648859   431 raft_consensus.cc:2243] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P d7fcf132cb774583bd7967a84b418048 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:03.649241   431 raft_consensus.cc:2272] T ecf93bacf15045e3bbfc2b0d7c51dbd8 P d7fcf132cb774583bd7967a84b418048 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:03.650645   431 tablet_replica.cc:333] T c48ae3b2d706406fad9295ac2ecdd688 P d7fcf132cb774583bd7967a84b418048: stopping tablet replica
I20260709 12:58:03.651108   431 raft_consensus.cc:2243] T c48ae3b2d706406fad9295ac2ecdd688 P d7fcf132cb774583bd7967a84b418048 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:03.651474   431 raft_consensus.cc:2272] T c48ae3b2d706406fad9295ac2ecdd688 P d7fcf132cb774583bd7967a84b418048 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:03.653016   431 tablet_replica.cc:333] T d3bc6327504f44dab50a3f1663e18ef4 P d7fcf132cb774583bd7967a84b418048: stopping tablet replica
I20260709 12:58:03.653450   431 raft_consensus.cc:2243] T d3bc6327504f44dab50a3f1663e18ef4 P d7fcf132cb774583bd7967a84b418048 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:03.653828   431 raft_consensus.cc:2272] T d3bc6327504f44dab50a3f1663e18ef4 P d7fcf132cb774583bd7967a84b418048 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:03.655287   431 tablet_replica.cc:333] T 3b933fbc94f143caae7395db46bfa15c P d7fcf132cb774583bd7967a84b418048: stopping tablet replica
I20260709 12:58:03.655738   431 raft_consensus.cc:2243] T 3b933fbc94f143caae7395db46bfa15c P d7fcf132cb774583bd7967a84b418048 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:03.656162   431 raft_consensus.cc:2272] T 3b933fbc94f143caae7395db46bfa15c P d7fcf132cb774583bd7967a84b418048 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:03.657724   431 tablet_replica.cc:333] T 741777b7834d4f5e80bd0187702907dc P d7fcf132cb774583bd7967a84b418048: stopping tablet replica
I20260709 12:58:03.658185   431 raft_consensus.cc:2243] T 741777b7834d4f5e80bd0187702907dc P d7fcf132cb774583bd7967a84b418048 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:03.658545   431 raft_consensus.cc:2272] T 741777b7834d4f5e80bd0187702907dc P d7fcf132cb774583bd7967a84b418048 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:03.660387   431 tablet_replica.cc:333] T ba302d819a4c420b861764d4a6b5fed2 P d7fcf132cb774583bd7967a84b418048: stopping tablet replica
I20260709 12:58:03.660931   431 raft_consensus.cc:2243] T ba302d819a4c420b861764d4a6b5fed2 P d7fcf132cb774583bd7967a84b418048 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:03.661301   431 raft_consensus.cc:2272] T ba302d819a4c420b861764d4a6b5fed2 P d7fcf132cb774583bd7967a84b418048 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:03.662674   431 tablet_replica.cc:333] T 8e1e26ad8acd4644857773d9c53d3ff2 P d7fcf132cb774583bd7967a84b418048: stopping tablet replica
I20260709 12:58:03.663106   431 raft_consensus.cc:2243] T 8e1e26ad8acd4644857773d9c53d3ff2 P d7fcf132cb774583bd7967a84b418048 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:58:03.663786   431 raft_consensus.cc:2272] T 8e1e26ad8acd4644857773d9c53d3ff2 P d7fcf132cb774583bd7967a84b418048 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:03.691102   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 12:58:03.706436   431 master.cc:562] Master@127.0.107.254:37363 shutting down...
I20260709 12:58:03.834405   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 856e372ba0d841768d1bef2f847f7091 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:58:03.834892   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 856e372ba0d841768d1bef2f847f7091 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:03.835186   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 856e372ba0d841768d1bef2f847f7091: stopping tablet replica
I20260709 12:58:03.854306   431 master.cc:584] Master@127.0.107.254:37363 shutdown complete.
40919529b3d6492d82e76f9cb44e6542  4
833e299675134d28bcc13d2c73b996a6  4
d7fcf132cb774583bd7967a84b418048  1
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (14489 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:58:03.894177   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:41301
I20260709 12:58:03.895277   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:03.900661   965 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:03.901692   966 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:03.902122   968 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:03.902598   431 server_base.cc:1061] running on GCE node
I20260709 12:58:03.903363   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:03.903558   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:03.903700   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601883903687 us; error 0 us; skew 500 ppm
I20260709 12:58:03.904225   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:03.906955   431 webserver.cc:533] Webserver started at http://127.0.107.254:41491/ using document root <none> and password file <none>
I20260709 12:58:03.907435   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:03.907622   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:03.907895   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:03.909006   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601869227091-431-0/minicluster-data/master-0-root/instance:
uuid: "d3fd0d228a0f488d8ea861ce7325f864"
format_stamp: "Formatted at 2026-07-09 12:58:03 on dist-test-slave-5mzn"
I20260709 12:58:03.913084   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:58:03.916222   973 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:03.916916   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:58:03.917212   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601869227091-431-0/minicluster-data/master-0-root
uuid: "d3fd0d228a0f488d8ea861ce7325f864"
format_stamp: "Formatted at 2026-07-09 12:58:03 on dist-test-slave-5mzn"
I20260709 12:58:03.917461   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601869227091-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601869227091-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601869227091-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:03.933365   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:03.934561   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:03.971822   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:41301
I20260709 12:58:03.971971  1024 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:41301 every 8 connection(s)
I20260709 12:58:03.975987  1025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:03.986655  1025 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3fd0d228a0f488d8ea861ce7325f864: Bootstrap starting.
I20260709 12:58:03.991902  1025 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d3fd0d228a0f488d8ea861ce7325f864: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:03.996423  1025 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d3fd0d228a0f488d8ea861ce7325f864: No bootstrap required, opened a new log
I20260709 12:58:03.998708  1025 raft_consensus.cc:359] T 00000000000000000000000000000000 P d3fd0d228a0f488d8ea861ce7325f864 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3fd0d228a0f488d8ea861ce7325f864" member_type: VOTER }
I20260709 12:58:03.999111  1025 raft_consensus.cc:385] T 00000000000000000000000000000000 P d3fd0d228a0f488d8ea861ce7325f864 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:03.999325  1025 raft_consensus.cc:740] T 00000000000000000000000000000000 P d3fd0d228a0f488d8ea861ce7325f864 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3fd0d228a0f488d8ea861ce7325f864, State: Initialized, Role: FOLLOWER
I20260709 12:58:03.999948  1025 consensus_queue.cc:260] T 00000000000000000000000000000000 P d3fd0d228a0f488d8ea861ce7325f864 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3fd0d228a0f488d8ea861ce7325f864" member_type: VOTER }
I20260709 12:58:04.000430  1025 raft_consensus.cc:399] T 00000000000000000000000000000000 P d3fd0d228a0f488d8ea861ce7325f864 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:58:04.000677  1025 raft_consensus.cc:493] T 00000000000000000000000000000000 P d3fd0d228a0f488d8ea861ce7325f864 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:58:04.000916  1025 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d3fd0d228a0f488d8ea861ce7325f864 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:04.005291  1025 raft_consensus.cc:515] T 00000000000000000000000000000000 P d3fd0d228a0f488d8ea861ce7325f864 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3fd0d228a0f488d8ea861ce7325f864" member_type: VOTER }
I20260709 12:58:04.005817  1025 leader_election.cc:304] T 00000000000000000000000000000000 P d3fd0d228a0f488d8ea861ce7325f864 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d3fd0d228a0f488d8ea861ce7325f864; no voters: 
I20260709 12:58:04.007086  1025 leader_election.cc:290] T 00000000000000000000000000000000 P d3fd0d228a0f488d8ea861ce7325f864 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:58:04.007570  1028 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d3fd0d228a0f488d8ea861ce7325f864 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:04.009071  1028 raft_consensus.cc:697] T 00000000000000000000000000000000 P d3fd0d228a0f488d8ea861ce7325f864 [term 1 LEADER]: Becoming Leader. State: Replica: d3fd0d228a0f488d8ea861ce7325f864, State: Running, Role: LEADER
I20260709 12:58:04.009773  1028 consensus_queue.cc:237] T 00000000000000000000000000000000 P d3fd0d228a0f488d8ea861ce7325f864 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3fd0d228a0f488d8ea861ce7325f864" member_type: VOTER }
I20260709 12:58:04.010520  1025 sys_catalog.cc:565] T 00000000000000000000000000000000 P d3fd0d228a0f488d8ea861ce7325f864 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:58:04.014694  1029 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3fd0d228a0f488d8ea861ce7325f864 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d3fd0d228a0f488d8ea861ce7325f864" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3fd0d228a0f488d8ea861ce7325f864" member_type: VOTER } }
I20260709 12:58:04.015568  1029 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3fd0d228a0f488d8ea861ce7325f864 [sys.catalog]: This master's current role is: LEADER
I20260709 12:58:04.017097  1030 sys_catalog.cc:455] T 00000000000000000000000000000000 P d3fd0d228a0f488d8ea861ce7325f864 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d3fd0d228a0f488d8ea861ce7325f864. Latest consensus state: current_term: 1 leader_uuid: "d3fd0d228a0f488d8ea861ce7325f864" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d3fd0d228a0f488d8ea861ce7325f864" member_type: VOTER } }
I20260709 12:58:04.017724  1030 sys_catalog.cc:458] T 00000000000000000000000000000000 P d3fd0d228a0f488d8ea861ce7325f864 [sys.catalog]: This master's current role is: LEADER
I20260709 12:58:04.018018  1035 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:58:04.023660  1035 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:58:04.028501   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:58:04.033077  1035 catalog_manager.cc:1383] Generated new cluster ID: 1695aad8aec44fb2ae4381528bda549f
I20260709 12:58:04.033402  1035 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:58:04.049574  1035 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:58:04.050791  1035 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:58:04.066854  1035 catalog_manager.cc:6070] T 00000000000000000000000000000000 P d3fd0d228a0f488d8ea861ce7325f864: Generated new TSK 0
I20260709 12:58:04.067634  1035 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:58:04.096248   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:04.101751  1046 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:04.103035  1047 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:04.104409   431 server_base.cc:1061] running on GCE node
W20260709 12:58:04.105113  1049 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:04.105963   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:04.106178   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:04.106344   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601884106325 us; error 0 us; skew 500 ppm
I20260709 12:58:04.106915   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:04.109141   431 webserver.cc:533] Webserver started at http://127.0.107.193:44419/ using document root <none> and password file <none>
I20260709 12:58:04.109608   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:04.109804   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:04.110075   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:04.111083   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601869227091-431-0/minicluster-data/ts-0-root/instance:
uuid: "1434bfe58c7247788e5d93c7d2bd8de1"
format_stamp: "Formatted at 2026-07-09 12:58:04 on dist-test-slave-5mzn"
I20260709 12:58:04.115314   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:58:04.118340  1054 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:04.119040   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.001s
I20260709 12:58:04.119393   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601869227091-431-0/minicluster-data/ts-0-root
uuid: "1434bfe58c7247788e5d93c7d2bd8de1"
format_stamp: "Formatted at 2026-07-09 12:58:04 on dist-test-slave-5mzn"
I20260709 12:58:04.119675   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601869227091-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601869227091-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601869227091-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:04.142189   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:04.143599   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:04.145191   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:58:04.147572   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:58:04.147807   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:04.148065   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:58:04.148267   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:04.189724   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:34795
I20260709 12:58:04.189823  1116 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:34795 every 8 connection(s)
I20260709 12:58:04.194571   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:04.200752  1121 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:04.201759  1122 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:04.204476  1125 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:04.205090   431 server_base.cc:1061] running on GCE node
I20260709 12:58:04.205873   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:04.206053   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:04.206175   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601884206164 us; error 0 us; skew 500 ppm
I20260709 12:58:04.206627   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:04.209226   431 webserver.cc:533] Webserver started at http://127.0.107.194:43197/ using document root <none> and password file <none>
I20260709 12:58:04.209842   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:04.210081   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:04.210402   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:04.210618  1117 heartbeater.cc:344] Connected to a master server at 127.0.107.254:41301
I20260709 12:58:04.210906  1117 heartbeater.cc:461] Registering TS with master...
I20260709 12:58:04.211524   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601869227091-431-0/minicluster-data/ts-1-root/instance:
uuid: "bbfb7e6be0904729bcda079b53965aef"
format_stamp: "Formatted at 2026-07-09 12:58:04 on dist-test-slave-5mzn"
I20260709 12:58:04.211542  1117 heartbeater.cc:507] Master 127.0.107.254:41301 requested a full tablet report, sending...
I20260709 12:58:04.213797   990 ts_manager.cc:194] Registered new tserver with Master: 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193:34795)
I20260709 12:58:04.216022   990 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55362
I20260709 12:58:04.217180   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:58:04.220465  1129 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:04.221285   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:58:04.221779   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601869227091-431-0/minicluster-data/ts-1-root
uuid: "bbfb7e6be0904729bcda079b53965aef"
format_stamp: "Formatted at 2026-07-09 12:58:04 on dist-test-slave-5mzn"
I20260709 12:58:04.222074   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601869227091-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601869227091-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601869227091-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:04.245390   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:04.246579   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:04.248001   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:58:04.250129   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:58:04.250344   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:04.250581   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:58:04.250746   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:04.289783   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:45551
I20260709 12:58:04.289921  1191 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:45551 every 8 connection(s)
I20260709 12:58:04.294171   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:04.301345  1195 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:04.306939  1196 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:04.308857  1198 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:04.309458   431 server_base.cc:1061] running on GCE node
I20260709 12:58:04.309648  1192 heartbeater.cc:344] Connected to a master server at 127.0.107.254:41301
I20260709 12:58:04.310106  1192 heartbeater.cc:461] Registering TS with master...
I20260709 12:58:04.310612   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:04.310904   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:04.311086  1192 heartbeater.cc:507] Master 127.0.107.254:41301 requested a full tablet report, sending...
I20260709 12:58:04.311129   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601884311109 us; error 0 us; skew 500 ppm
I20260709 12:58:04.312150   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:04.313597   990 ts_manager.cc:194] Registered new tserver with Master: bbfb7e6be0904729bcda079b53965aef (127.0.107.194:45551)
I20260709 12:58:04.315176   431 webserver.cc:533] Webserver started at http://127.0.107.195:33543/ using document root <none> and password file <none>
I20260709 12:58:04.315230   990 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55366
I20260709 12:58:04.316165   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:04.316507   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:04.316938   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:04.318864   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601869227091-431-0/minicluster-data/ts-2-root/instance:
uuid: "c97e97cff3474b0fb542619cb94dcd8c"
format_stamp: "Formatted at 2026-07-09 12:58:04 on dist-test-slave-5mzn"
I20260709 12:58:04.325876   431 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.001s
I20260709 12:58:04.329236  1203 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:04.329911   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:58:04.330204   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601869227091-431-0/minicluster-data/ts-2-root
uuid: "c97e97cff3474b0fb542619cb94dcd8c"
format_stamp: "Formatted at 2026-07-09 12:58:04 on dist-test-slave-5mzn"
I20260709 12:58:04.330484   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601869227091-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601869227091-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783601869227091-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:04.352624   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:04.353816   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:04.355297   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:58:04.357419   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:58:04.357641   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:04.357877   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:58:04.358099   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:04.395720   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:43677
I20260709 12:58:04.395810  1265 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:43677 every 8 connection(s)
I20260709 12:58:04.409358  1266 heartbeater.cc:344] Connected to a master server at 127.0.107.254:41301
I20260709 12:58:04.409705  1266 heartbeater.cc:461] Registering TS with master...
I20260709 12:58:04.410398  1266 heartbeater.cc:507] Master 127.0.107.254:41301 requested a full tablet report, sending...
I20260709 12:58:04.412305   990 ts_manager.cc:194] Registered new tserver with Master: c97e97cff3474b0fb542619cb94dcd8c (127.0.107.195:43677)
I20260709 12:58:04.413247   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014452438s
I20260709 12:58:04.414093   990 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55374
I20260709 12:58:04.439359   990 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55388:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:58:04.442098   990 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:58:04.512428  1231 tablet_service.cc:1511] Processing CreateTablet for tablet bf5299056e9042429bd51aee9ccf6844 (DEFAULT_TABLE table=test-workload [id=045ecadae4d94d4784999b2959579470]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:58:04.513904  1231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf5299056e9042429bd51aee9ccf6844. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:04.514086  1228 tablet_service.cc:1511] Processing CreateTablet for tablet 36813a3559ff43a893c148b091a60090 (DEFAULT_TABLE table=test-workload [id=045ecadae4d94d4784999b2959579470]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:58:04.515405  1228 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36813a3559ff43a893c148b091a60090. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:04.516294  1227 tablet_service.cc:1511] Processing CreateTablet for tablet 38eeded1fce24dec92c5aa10aa9ac846 (DEFAULT_TABLE table=test-workload [id=045ecadae4d94d4784999b2959579470]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:58:04.517638  1227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38eeded1fce24dec92c5aa10aa9ac846. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:04.521283  1230 tablet_service.cc:1511] Processing CreateTablet for tablet 9574c9ab5cd1491cbc8b01f3c89d4149 (DEFAULT_TABLE table=test-workload [id=045ecadae4d94d4784999b2959579470]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:58:04.522507  1230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9574c9ab5cd1491cbc8b01f3c89d4149. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:04.524662  1157 tablet_service.cc:1511] Processing CreateTablet for tablet bf5299056e9042429bd51aee9ccf6844 (DEFAULT_TABLE table=test-workload [id=045ecadae4d94d4784999b2959579470]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:58:04.525949  1157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf5299056e9042429bd51aee9ccf6844. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:04.526403  1229 tablet_service.cc:1511] Processing CreateTablet for tablet 614a5c8953cf490b85161067f062e80c (DEFAULT_TABLE table=test-workload [id=045ecadae4d94d4784999b2959579470]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:58:04.527654  1229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 614a5c8953cf490b85161067f062e80c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:04.532716  1156 tablet_service.cc:1511] Processing CreateTablet for tablet 9574c9ab5cd1491cbc8b01f3c89d4149 (DEFAULT_TABLE table=test-workload [id=045ecadae4d94d4784999b2959579470]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:58:04.534578  1156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9574c9ab5cd1491cbc8b01f3c89d4149. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:04.534405  1155 tablet_service.cc:1511] Processing CreateTablet for tablet 614a5c8953cf490b85161067f062e80c (DEFAULT_TABLE table=test-workload [id=045ecadae4d94d4784999b2959579470]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:58:04.534852  1226 tablet_service.cc:1511] Processing CreateTablet for tablet 8edcf9960f41476794c70fe555756dbb (DEFAULT_TABLE table=test-workload [id=045ecadae4d94d4784999b2959579470]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:58:04.535720  1155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 614a5c8953cf490b85161067f062e80c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:04.538069  1225 tablet_service.cc:1511] Processing CreateTablet for tablet 6a0104eca382490a8ec51916203c8b59 (DEFAULT_TABLE table=test-workload [id=045ecadae4d94d4784999b2959579470]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:58:04.540897  1225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a0104eca382490a8ec51916203c8b59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:04.542114  1154 tablet_service.cc:1511] Processing CreateTablet for tablet 36813a3559ff43a893c148b091a60090 (DEFAULT_TABLE table=test-workload [id=045ecadae4d94d4784999b2959579470]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:58:04.543399  1154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36813a3559ff43a893c148b091a60090. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:04.544874  1226 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8edcf9960f41476794c70fe555756dbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:04.554649  1153 tablet_service.cc:1511] Processing CreateTablet for tablet 38eeded1fce24dec92c5aa10aa9ac846 (DEFAULT_TABLE table=test-workload [id=045ecadae4d94d4784999b2959579470]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:58:04.556489  1153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38eeded1fce24dec92c5aa10aa9ac846. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:04.566968  1152 tablet_service.cc:1511] Processing CreateTablet for tablet 8edcf9960f41476794c70fe555756dbb (DEFAULT_TABLE table=test-workload [id=045ecadae4d94d4784999b2959579470]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:58:04.570089  1151 tablet_service.cc:1511] Processing CreateTablet for tablet 6a0104eca382490a8ec51916203c8b59 (DEFAULT_TABLE table=test-workload [id=045ecadae4d94d4784999b2959579470]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:58:04.576898  1152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8edcf9960f41476794c70fe555756dbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:04.578246  1150 tablet_service.cc:1511] Processing CreateTablet for tablet 53866543b96a4b7c975007d75efde33e (DEFAULT_TABLE table=test-workload [id=045ecadae4d94d4784999b2959579470]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:58:04.580024  1150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53866543b96a4b7c975007d75efde33e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:04.580951  1151 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a0104eca382490a8ec51916203c8b59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:04.604961  1224 tablet_service.cc:1511] Processing CreateTablet for tablet 53866543b96a4b7c975007d75efde33e (DEFAULT_TABLE table=test-workload [id=045ecadae4d94d4784999b2959579470]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:58:04.606343  1224 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53866543b96a4b7c975007d75efde33e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:04.609148  1282 tablet_bootstrap.cc:492] T bf5299056e9042429bd51aee9ccf6844 P c97e97cff3474b0fb542619cb94dcd8c: Bootstrap starting.
I20260709 12:58:04.615020  1223 tablet_service.cc:1511] Processing CreateTablet for tablet 6eab0d4cbaa04172bc4320b9c3847715 (DEFAULT_TABLE table=test-workload [id=045ecadae4d94d4784999b2959579470]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:58:04.616369  1223 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6eab0d4cbaa04172bc4320b9c3847715. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:04.624212  1282 tablet_bootstrap.cc:654] T bf5299056e9042429bd51aee9ccf6844 P c97e97cff3474b0fb542619cb94dcd8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:04.632593  1281 tablet_bootstrap.cc:492] T 614a5c8953cf490b85161067f062e80c P bbfb7e6be0904729bcda079b53965aef: Bootstrap starting.
I20260709 12:58:04.633584  1155 tablet_service.cc:1511] Processing CreateTablet for tablet cf73b42e520b432098cf08c6c32141ba (DEFAULT_TABLE table=test-workload [id=045ecadae4d94d4784999b2959579470]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:58:04.634907  1155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf73b42e520b432098cf08c6c32141ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:04.637506  1154 tablet_service.cc:1511] Processing CreateTablet for tablet 6eab0d4cbaa04172bc4320b9c3847715 (DEFAULT_TABLE table=test-workload [id=045ecadae4d94d4784999b2959579470]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:58:04.638803  1154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6eab0d4cbaa04172bc4320b9c3847715. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:04.638648  1079 tablet_service.cc:1511] Processing CreateTablet for tablet 36813a3559ff43a893c148b091a60090 (DEFAULT_TABLE table=test-workload [id=045ecadae4d94d4784999b2959579470]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:58:04.639899  1079 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36813a3559ff43a893c148b091a60090. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:04.641675  1078 tablet_service.cc:1511] Processing CreateTablet for tablet 38eeded1fce24dec92c5aa10aa9ac846 (DEFAULT_TABLE table=test-workload [id=045ecadae4d94d4784999b2959579470]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:58:04.642906  1078 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38eeded1fce24dec92c5aa10aa9ac846. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:04.644290  1230 tablet_service.cc:1511] Processing CreateTablet for tablet cf73b42e520b432098cf08c6c32141ba (DEFAULT_TABLE table=test-workload [id=045ecadae4d94d4784999b2959579470]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:58:04.645138  1077 tablet_service.cc:1511] Processing CreateTablet for tablet 8edcf9960f41476794c70fe555756dbb (DEFAULT_TABLE table=test-workload [id=045ecadae4d94d4784999b2959579470]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:58:04.645524  1230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf73b42e520b432098cf08c6c32141ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:04.647215  1076 tablet_service.cc:1511] Processing CreateTablet for tablet 6a0104eca382490a8ec51916203c8b59 (DEFAULT_TABLE table=test-workload [id=045ecadae4d94d4784999b2959579470]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:58:04.634924  1082 tablet_service.cc:1511] Processing CreateTablet for tablet bf5299056e9042429bd51aee9ccf6844 (DEFAULT_TABLE table=test-workload [id=045ecadae4d94d4784999b2959579470]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:58:04.637511  1080 tablet_service.cc:1511] Processing CreateTablet for tablet 614a5c8953cf490b85161067f062e80c (DEFAULT_TABLE table=test-workload [id=045ecadae4d94d4784999b2959579470]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:58:04.635959  1081 tablet_service.cc:1511] Processing CreateTablet for tablet 9574c9ab5cd1491cbc8b01f3c89d4149 (DEFAULT_TABLE table=test-workload [id=045ecadae4d94d4784999b2959579470]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:58:04.652498  1075 tablet_service.cc:1511] Processing CreateTablet for tablet 53866543b96a4b7c975007d75efde33e (DEFAULT_TABLE table=test-workload [id=045ecadae4d94d4784999b2959579470]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:58:04.655360  1074 tablet_service.cc:1511] Processing CreateTablet for tablet 6eab0d4cbaa04172bc4320b9c3847715 (DEFAULT_TABLE table=test-workload [id=045ecadae4d94d4784999b2959579470]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:58:04.657996  1073 tablet_service.cc:1511] Processing CreateTablet for tablet cf73b42e520b432098cf08c6c32141ba (DEFAULT_TABLE table=test-workload [id=045ecadae4d94d4784999b2959579470]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:58:04.660880  1076 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a0104eca382490a8ec51916203c8b59. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:04.662333  1082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf5299056e9042429bd51aee9ccf6844. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:04.663702  1080 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 614a5c8953cf490b85161067f062e80c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:04.665066  1081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9574c9ab5cd1491cbc8b01f3c89d4149. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:04.666131  1075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53866543b96a4b7c975007d75efde33e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:04.666841  1077 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8edcf9960f41476794c70fe555756dbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:04.681793  1074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6eab0d4cbaa04172bc4320b9c3847715. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:04.692065  1073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf73b42e520b432098cf08c6c32141ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:04.703083  1282 tablet_bootstrap.cc:492] T bf5299056e9042429bd51aee9ccf6844 P c97e97cff3474b0fb542619cb94dcd8c: No bootstrap required, opened a new log
I20260709 12:58:04.703673  1282 ts_tablet_manager.cc:1403] T bf5299056e9042429bd51aee9ccf6844 P c97e97cff3474b0fb542619cb94dcd8c: Time spent bootstrapping tablet: real 0.095s	user 0.038s	sys 0.034s
I20260709 12:58:04.706684  1282 raft_consensus.cc:359] T bf5299056e9042429bd51aee9ccf6844 P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } } peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } }
I20260709 12:58:04.707471  1282 raft_consensus.cc:385] T bf5299056e9042429bd51aee9ccf6844 P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:04.707839  1282 raft_consensus.cc:740] T bf5299056e9042429bd51aee9ccf6844 P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c97e97cff3474b0fb542619cb94dcd8c, State: Initialized, Role: FOLLOWER
I20260709 12:58:04.708662  1282 consensus_queue.cc:260] T bf5299056e9042429bd51aee9ccf6844 P c97e97cff3474b0fb542619cb94dcd8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } } peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } }
I20260709 12:58:04.720356  1281 tablet_bootstrap.cc:654] T 614a5c8953cf490b85161067f062e80c P bbfb7e6be0904729bcda079b53965aef: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:04.739068  1281 tablet_bootstrap.cc:492] T 614a5c8953cf490b85161067f062e80c P bbfb7e6be0904729bcda079b53965aef: No bootstrap required, opened a new log
I20260709 12:58:04.739599  1281 ts_tablet_manager.cc:1403] T 614a5c8953cf490b85161067f062e80c P bbfb7e6be0904729bcda079b53965aef: Time spent bootstrapping tablet: real 0.108s	user 0.008s	sys 0.005s
I20260709 12:58:04.741760  1281 raft_consensus.cc:359] T 614a5c8953cf490b85161067f062e80c P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:04.742276  1281 raft_consensus.cc:385] T 614a5c8953cf490b85161067f062e80c P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:04.742530  1281 raft_consensus.cc:740] T 614a5c8953cf490b85161067f062e80c P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbfb7e6be0904729bcda079b53965aef, State: Initialized, Role: FOLLOWER
I20260709 12:58:04.743157  1281 consensus_queue.cc:260] T 614a5c8953cf490b85161067f062e80c P bbfb7e6be0904729bcda079b53965aef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:04.745601  1192 heartbeater.cc:499] Master 127.0.107.254:41301 was elected leader, sending a full tablet report...
I20260709 12:58:04.739574  1285 tablet_bootstrap.cc:492] T 36813a3559ff43a893c148b091a60090 P 1434bfe58c7247788e5d93c7d2bd8de1: Bootstrap starting.
I20260709 12:58:04.759346  1281 ts_tablet_manager.cc:1434] T 614a5c8953cf490b85161067f062e80c P bbfb7e6be0904729bcda079b53965aef: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.000s
I20260709 12:58:04.760437  1281 tablet_bootstrap.cc:492] T 36813a3559ff43a893c148b091a60090 P bbfb7e6be0904729bcda079b53965aef: Bootstrap starting.
I20260709 12:58:04.761843  1266 heartbeater.cc:499] Master 127.0.107.254:41301 was elected leader, sending a full tablet report...
I20260709 12:58:04.766888  1285 tablet_bootstrap.cc:654] T 36813a3559ff43a893c148b091a60090 P 1434bfe58c7247788e5d93c7d2bd8de1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:04.772944  1282 ts_tablet_manager.cc:1434] T bf5299056e9042429bd51aee9ccf6844 P c97e97cff3474b0fb542619cb94dcd8c: Time spent starting tablet: real 0.069s	user 0.030s	sys 0.026s
I20260709 12:58:04.776047  1281 tablet_bootstrap.cc:654] T 36813a3559ff43a893c148b091a60090 P bbfb7e6be0904729bcda079b53965aef: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:04.777302  1282 tablet_bootstrap.cc:492] T 36813a3559ff43a893c148b091a60090 P c97e97cff3474b0fb542619cb94dcd8c: Bootstrap starting.
I20260709 12:58:04.783641  1282 tablet_bootstrap.cc:654] T 36813a3559ff43a893c148b091a60090 P c97e97cff3474b0fb542619cb94dcd8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:04.796599  1287 raft_consensus.cc:493] T 614a5c8953cf490b85161067f062e80c P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:04.797096  1287 raft_consensus.cc:515] T 614a5c8953cf490b85161067f062e80c P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:04.798089  1285 tablet_bootstrap.cc:492] T 36813a3559ff43a893c148b091a60090 P 1434bfe58c7247788e5d93c7d2bd8de1: No bootstrap required, opened a new log
I20260709 12:58:04.798579  1285 ts_tablet_manager.cc:1403] T 36813a3559ff43a893c148b091a60090 P 1434bfe58c7247788e5d93c7d2bd8de1: Time spent bootstrapping tablet: real 0.059s	user 0.011s	sys 0.008s
I20260709 12:58:04.800985  1287 leader_election.cc:290] T 614a5c8953cf490b85161067f062e80c P bbfb7e6be0904729bcda079b53965aef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193:34795), c97e97cff3474b0fb542619cb94dcd8c (127.0.107.195:43677)
I20260709 12:58:04.801508  1285 raft_consensus.cc:359] T 36813a3559ff43a893c148b091a60090 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:04.802224  1285 raft_consensus.cc:385] T 36813a3559ff43a893c148b091a60090 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:04.802526  1285 raft_consensus.cc:740] T 36813a3559ff43a893c148b091a60090 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1434bfe58c7247788e5d93c7d2bd8de1, State: Initialized, Role: FOLLOWER
I20260709 12:58:04.803247  1285 consensus_queue.cc:260] T 36813a3559ff43a893c148b091a60090 P 1434bfe58c7247788e5d93c7d2bd8de1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:04.803846  1282 tablet_bootstrap.cc:492] T 36813a3559ff43a893c148b091a60090 P c97e97cff3474b0fb542619cb94dcd8c: No bootstrap required, opened a new log
I20260709 12:58:04.804330  1282 ts_tablet_manager.cc:1403] T 36813a3559ff43a893c148b091a60090 P c97e97cff3474b0fb542619cb94dcd8c: Time spent bootstrapping tablet: real 0.027s	user 0.003s	sys 0.009s
I20260709 12:58:04.807089  1281 tablet_bootstrap.cc:492] T 36813a3559ff43a893c148b091a60090 P bbfb7e6be0904729bcda079b53965aef: No bootstrap required, opened a new log
I20260709 12:58:04.807598  1281 ts_tablet_manager.cc:1403] T 36813a3559ff43a893c148b091a60090 P bbfb7e6be0904729bcda079b53965aef: Time spent bootstrapping tablet: real 0.047s	user 0.011s	sys 0.017s
I20260709 12:58:04.807931  1282 raft_consensus.cc:359] T 36813a3559ff43a893c148b091a60090 P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:04.809010  1282 raft_consensus.cc:385] T 36813a3559ff43a893c148b091a60090 P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:04.809454  1282 raft_consensus.cc:740] T 36813a3559ff43a893c148b091a60090 P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c97e97cff3474b0fb542619cb94dcd8c, State: Initialized, Role: FOLLOWER
I20260709 12:58:04.810582  1281 raft_consensus.cc:359] T 36813a3559ff43a893c148b091a60090 P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:04.811331  1281 raft_consensus.cc:385] T 36813a3559ff43a893c148b091a60090 P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:04.810678  1282 consensus_queue.cc:260] T 36813a3559ff43a893c148b091a60090 P c97e97cff3474b0fb542619cb94dcd8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:04.811383  1092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "614a5c8953cf490b85161067f062e80c" candidate_uuid: "bbfb7e6be0904729bcda079b53965aef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" is_pre_election: true
I20260709 12:58:04.811715  1281 raft_consensus.cc:740] T 36813a3559ff43a893c148b091a60090 P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbfb7e6be0904729bcda079b53965aef, State: Initialized, Role: FOLLOWER
I20260709 12:58:04.813109  1281 consensus_queue.cc:260] T 36813a3559ff43a893c148b091a60090 P bbfb7e6be0904729bcda079b53965aef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:04.814538  1282 ts_tablet_manager.cc:1434] T 36813a3559ff43a893c148b091a60090 P c97e97cff3474b0fb542619cb94dcd8c: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:58:04.816836  1281 ts_tablet_manager.cc:1434] T 36813a3559ff43a893c148b091a60090 P bbfb7e6be0904729bcda079b53965aef: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.005s
I20260709 12:58:04.817803  1281 tablet_bootstrap.cc:492] T bf5299056e9042429bd51aee9ccf6844 P bbfb7e6be0904729bcda079b53965aef: Bootstrap starting.
W20260709 12:58:04.819638  1133 leader_election.cc:343] T 614a5c8953cf490b85161067f062e80c P bbfb7e6be0904729bcda079b53965aef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193:34795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:04.823398  1282 tablet_bootstrap.cc:492] T 9574c9ab5cd1491cbc8b01f3c89d4149 P c97e97cff3474b0fb542619cb94dcd8c: Bootstrap starting.
I20260709 12:58:04.823915  1284 raft_consensus.cc:493] T bf5299056e9042429bd51aee9ccf6844 P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:04.824383  1284 raft_consensus.cc:515] T bf5299056e9042429bd51aee9ccf6844 P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } } peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } }
I20260709 12:58:04.832865  1281 tablet_bootstrap.cc:654] T bf5299056e9042429bd51aee9ccf6844 P bbfb7e6be0904729bcda079b53965aef: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:04.842294  1282 tablet_bootstrap.cc:654] T 9574c9ab5cd1491cbc8b01f3c89d4149 P c97e97cff3474b0fb542619cb94dcd8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:04.843642  1092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5299056e9042429bd51aee9ccf6844" candidate_uuid: "c97e97cff3474b0fb542619cb94dcd8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" is_pre_election: true
W20260709 12:58:04.846568  1207 leader_election.cc:343] T bf5299056e9042429bd51aee9ccf6844 P c97e97cff3474b0fb542619cb94dcd8c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193:34795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:04.848631  1285 ts_tablet_manager.cc:1434] T 36813a3559ff43a893c148b091a60090 P 1434bfe58c7247788e5d93c7d2bd8de1: Time spent starting tablet: real 0.050s	user 0.022s	sys 0.025s
I20260709 12:58:04.849599  1285 tablet_bootstrap.cc:492] T 8edcf9960f41476794c70fe555756dbb P 1434bfe58c7247788e5d93c7d2bd8de1: Bootstrap starting.
I20260709 12:58:04.840305  1284 leader_election.cc:290] T bf5299056e9042429bd51aee9ccf6844 P c97e97cff3474b0fb542619cb94dcd8c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193:34795), bbfb7e6be0904729bcda079b53965aef (127.0.107.194:45551)
I20260709 12:58:04.849658  1117 heartbeater.cc:499] Master 127.0.107.254:41301 was elected leader, sending a full tablet report...
I20260709 12:58:04.856209  1285 tablet_bootstrap.cc:654] T 8edcf9960f41476794c70fe555756dbb P 1434bfe58c7247788e5d93c7d2bd8de1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:04.864082  1281 tablet_bootstrap.cc:492] T bf5299056e9042429bd51aee9ccf6844 P bbfb7e6be0904729bcda079b53965aef: No bootstrap required, opened a new log
I20260709 12:58:04.865885  1281 ts_tablet_manager.cc:1403] T bf5299056e9042429bd51aee9ccf6844 P bbfb7e6be0904729bcda079b53965aef: Time spent bootstrapping tablet: real 0.048s	user 0.016s	sys 0.014s
I20260709 12:58:04.870671  1281 raft_consensus.cc:359] T bf5299056e9042429bd51aee9ccf6844 P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } } peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } }
I20260709 12:58:04.871321  1281 raft_consensus.cc:385] T bf5299056e9042429bd51aee9ccf6844 P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:04.871569  1281 raft_consensus.cc:740] T bf5299056e9042429bd51aee9ccf6844 P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbfb7e6be0904729bcda079b53965aef, State: Initialized, Role: FOLLOWER
I20260709 12:58:04.871919  1282 tablet_bootstrap.cc:492] T 9574c9ab5cd1491cbc8b01f3c89d4149 P c97e97cff3474b0fb542619cb94dcd8c: No bootstrap required, opened a new log
I20260709 12:58:04.872392  1282 ts_tablet_manager.cc:1403] T 9574c9ab5cd1491cbc8b01f3c89d4149 P c97e97cff3474b0fb542619cb94dcd8c: Time spent bootstrapping tablet: real 0.049s	user 0.011s	sys 0.007s
I20260709 12:58:04.872215  1281 consensus_queue.cc:260] T bf5299056e9042429bd51aee9ccf6844 P bbfb7e6be0904729bcda079b53965aef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } } peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } }
I20260709 12:58:04.872907  1241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "614a5c8953cf490b85161067f062e80c" candidate_uuid: "bbfb7e6be0904729bcda079b53965aef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c97e97cff3474b0fb542619cb94dcd8c" is_pre_election: true
I20260709 12:58:04.874881  1281 ts_tablet_manager.cc:1434] T bf5299056e9042429bd51aee9ccf6844 P bbfb7e6be0904729bcda079b53965aef: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
W20260709 12:58:04.875276  1132 leader_election.cc:343] T 614a5c8953cf490b85161067f062e80c P bbfb7e6be0904729bcda079b53965aef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c97e97cff3474b0fb542619cb94dcd8c (127.0.107.195:43677): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:04.875715  1132 leader_election.cc:304] T 614a5c8953cf490b85161067f062e80c P bbfb7e6be0904729bcda079b53965aef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bbfb7e6be0904729bcda079b53965aef; no voters: 1434bfe58c7247788e5d93c7d2bd8de1, c97e97cff3474b0fb542619cb94dcd8c
I20260709 12:58:04.875917  1281 tablet_bootstrap.cc:492] T 38eeded1fce24dec92c5aa10aa9ac846 P bbfb7e6be0904729bcda079b53965aef: Bootstrap starting.
I20260709 12:58:04.876451  1287 raft_consensus.cc:2749] T 614a5c8953cf490b85161067f062e80c P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:04.876338  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5299056e9042429bd51aee9ccf6844" candidate_uuid: "c97e97cff3474b0fb542619cb94dcd8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbfb7e6be0904729bcda079b53965aef" is_pre_election: true
I20260709 12:58:04.877079  1167 raft_consensus.cc:2468] T bf5299056e9042429bd51aee9ccf6844 P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c97e97cff3474b0fb542619cb94dcd8c in term 0.
I20260709 12:58:04.877764  1282 raft_consensus.cc:359] T 9574c9ab5cd1491cbc8b01f3c89d4149 P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:04.878283  1282 raft_consensus.cc:385] T 9574c9ab5cd1491cbc8b01f3c89d4149 P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:04.878520  1282 raft_consensus.cc:740] T 9574c9ab5cd1491cbc8b01f3c89d4149 P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c97e97cff3474b0fb542619cb94dcd8c, State: Initialized, Role: FOLLOWER
I20260709 12:58:04.879158  1282 consensus_queue.cc:260] T 9574c9ab5cd1491cbc8b01f3c89d4149 P c97e97cff3474b0fb542619cb94dcd8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:04.880748  1282 ts_tablet_manager.cc:1434] T 9574c9ab5cd1491cbc8b01f3c89d4149 P c97e97cff3474b0fb542619cb94dcd8c: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:58:04.882007  1282 tablet_bootstrap.cc:492] T 614a5c8953cf490b85161067f062e80c P c97e97cff3474b0fb542619cb94dcd8c: Bootstrap starting.
I20260709 12:58:04.882788  1281 tablet_bootstrap.cc:654] T 38eeded1fce24dec92c5aa10aa9ac846 P bbfb7e6be0904729bcda079b53965aef: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:04.886575  1285 tablet_bootstrap.cc:492] T 8edcf9960f41476794c70fe555756dbb P 1434bfe58c7247788e5d93c7d2bd8de1: No bootstrap required, opened a new log
I20260709 12:58:04.888579  1282 tablet_bootstrap.cc:654] T 614a5c8953cf490b85161067f062e80c P c97e97cff3474b0fb542619cb94dcd8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:04.889984  1285 ts_tablet_manager.cc:1403] T 8edcf9960f41476794c70fe555756dbb P 1434bfe58c7247788e5d93c7d2bd8de1: Time spent bootstrapping tablet: real 0.041s	user 0.007s	sys 0.008s
I20260709 12:58:04.889243  1204 leader_election.cc:304] T bf5299056e9042429bd51aee9ccf6844 P c97e97cff3474b0fb542619cb94dcd8c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bbfb7e6be0904729bcda079b53965aef, c97e97cff3474b0fb542619cb94dcd8c; no voters: 1434bfe58c7247788e5d93c7d2bd8de1
I20260709 12:58:04.891719  1284 raft_consensus.cc:2804] T bf5299056e9042429bd51aee9ccf6844 P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:04.892113  1284 raft_consensus.cc:493] T bf5299056e9042429bd51aee9ccf6844 P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:04.892490  1284 raft_consensus.cc:3060] T bf5299056e9042429bd51aee9ccf6844 P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:04.894343  1281 tablet_bootstrap.cc:492] T 38eeded1fce24dec92c5aa10aa9ac846 P bbfb7e6be0904729bcda079b53965aef: No bootstrap required, opened a new log
I20260709 12:58:04.894829  1281 ts_tablet_manager.cc:1403] T 38eeded1fce24dec92c5aa10aa9ac846 P bbfb7e6be0904729bcda079b53965aef: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 12:58:04.894474  1285 raft_consensus.cc:359] T 8edcf9960f41476794c70fe555756dbb P 1434bfe58c7247788e5d93c7d2bd8de1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:04.895677  1285 raft_consensus.cc:385] T 8edcf9960f41476794c70fe555756dbb P 1434bfe58c7247788e5d93c7d2bd8de1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:04.896142  1285 raft_consensus.cc:740] T 8edcf9960f41476794c70fe555756dbb P 1434bfe58c7247788e5d93c7d2bd8de1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1434bfe58c7247788e5d93c7d2bd8de1, State: Initialized, Role: FOLLOWER
I20260709 12:58:04.897305  1285 consensus_queue.cc:260] T 8edcf9960f41476794c70fe555756dbb P 1434bfe58c7247788e5d93c7d2bd8de1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:04.897768  1281 raft_consensus.cc:359] T 38eeded1fce24dec92c5aa10aa9ac846 P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:04.898476  1281 raft_consensus.cc:385] T 38eeded1fce24dec92c5aa10aa9ac846 P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:04.898772  1281 raft_consensus.cc:740] T 38eeded1fce24dec92c5aa10aa9ac846 P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbfb7e6be0904729bcda079b53965aef, State: Initialized, Role: FOLLOWER
I20260709 12:58:04.899394  1284 raft_consensus.cc:515] T bf5299056e9042429bd51aee9ccf6844 P c97e97cff3474b0fb542619cb94dcd8c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } } peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } }
I20260709 12:58:04.899597  1281 consensus_queue.cc:260] T 38eeded1fce24dec92c5aa10aa9ac846 P bbfb7e6be0904729bcda079b53965aef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:04.901906  1281 ts_tablet_manager.cc:1434] T 38eeded1fce24dec92c5aa10aa9ac846 P bbfb7e6be0904729bcda079b53965aef: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:58:04.902312  1092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5299056e9042429bd51aee9ccf6844" candidate_uuid: "c97e97cff3474b0fb542619cb94dcd8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1434bfe58c7247788e5d93c7d2bd8de1"
I20260709 12:58:04.902854  1281 tablet_bootstrap.cc:492] T 6a0104eca382490a8ec51916203c8b59 P bbfb7e6be0904729bcda079b53965aef: Bootstrap starting.
I20260709 12:58:04.903620  1284 leader_election.cc:290] T bf5299056e9042429bd51aee9ccf6844 P c97e97cff3474b0fb542619cb94dcd8c [CANDIDATE]: Term 1 election: Requested vote from peers 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193:34795), bbfb7e6be0904729bcda079b53965aef (127.0.107.194:45551)
W20260709 12:58:04.904157  1207 leader_election.cc:343] T bf5299056e9042429bd51aee9ccf6844 P c97e97cff3474b0fb542619cb94dcd8c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193:34795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:04.905176  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5299056e9042429bd51aee9ccf6844" candidate_uuid: "c97e97cff3474b0fb542619cb94dcd8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbfb7e6be0904729bcda079b53965aef"
I20260709 12:58:04.905485  1285 ts_tablet_manager.cc:1434] T 8edcf9960f41476794c70fe555756dbb P 1434bfe58c7247788e5d93c7d2bd8de1: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.004s
I20260709 12:58:04.905786  1167 raft_consensus.cc:3060] T bf5299056e9042429bd51aee9ccf6844 P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:04.906481  1285 tablet_bootstrap.cc:492] T 38eeded1fce24dec92c5aa10aa9ac846 P 1434bfe58c7247788e5d93c7d2bd8de1: Bootstrap starting.
I20260709 12:58:04.907256  1282 tablet_bootstrap.cc:492] T 614a5c8953cf490b85161067f062e80c P c97e97cff3474b0fb542619cb94dcd8c: No bootstrap required, opened a new log
I20260709 12:58:04.907742  1282 ts_tablet_manager.cc:1403] T 614a5c8953cf490b85161067f062e80c P c97e97cff3474b0fb542619cb94dcd8c: Time spent bootstrapping tablet: real 0.026s	user 0.008s	sys 0.016s
I20260709 12:58:04.910789  1282 raft_consensus.cc:359] T 614a5c8953cf490b85161067f062e80c P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:04.911536  1282 raft_consensus.cc:385] T 614a5c8953cf490b85161067f062e80c P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:04.911861  1282 raft_consensus.cc:740] T 614a5c8953cf490b85161067f062e80c P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c97e97cff3474b0fb542619cb94dcd8c, State: Initialized, Role: FOLLOWER
I20260709 12:58:04.912665  1282 consensus_queue.cc:260] T 614a5c8953cf490b85161067f062e80c P c97e97cff3474b0fb542619cb94dcd8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:04.913304  1285 tablet_bootstrap.cc:654] T 38eeded1fce24dec92c5aa10aa9ac846 P 1434bfe58c7247788e5d93c7d2bd8de1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:04.913677  1281 tablet_bootstrap.cc:654] T 6a0104eca382490a8ec51916203c8b59 P bbfb7e6be0904729bcda079b53965aef: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:04.915103  1282 ts_tablet_manager.cc:1434] T 614a5c8953cf490b85161067f062e80c P c97e97cff3474b0fb542619cb94dcd8c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:58:04.916400  1282 tablet_bootstrap.cc:492] T 38eeded1fce24dec92c5aa10aa9ac846 P c97e97cff3474b0fb542619cb94dcd8c: Bootstrap starting.
I20260709 12:58:04.924988  1282 tablet_bootstrap.cc:654] T 38eeded1fce24dec92c5aa10aa9ac846 P c97e97cff3474b0fb542619cb94dcd8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:04.938695  1167 raft_consensus.cc:2468] T bf5299056e9042429bd51aee9ccf6844 P bbfb7e6be0904729bcda079b53965aef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c97e97cff3474b0fb542619cb94dcd8c in term 1.
I20260709 12:58:04.941426  1204 leader_election.cc:304] T bf5299056e9042429bd51aee9ccf6844 P c97e97cff3474b0fb542619cb94dcd8c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bbfb7e6be0904729bcda079b53965aef, c97e97cff3474b0fb542619cb94dcd8c; no voters: 1434bfe58c7247788e5d93c7d2bd8de1
I20260709 12:58:04.942507  1284 raft_consensus.cc:2804] T bf5299056e9042429bd51aee9ccf6844 P c97e97cff3474b0fb542619cb94dcd8c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:04.942868  1287 raft_consensus.cc:493] T 36813a3559ff43a893c148b091a60090 P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:04.943354  1287 raft_consensus.cc:515] T 36813a3559ff43a893c148b091a60090 P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:04.945418  1287 leader_election.cc:290] T 36813a3559ff43a893c148b091a60090 P bbfb7e6be0904729bcda079b53965aef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193:34795), c97e97cff3474b0fb542619cb94dcd8c (127.0.107.195:43677)
I20260709 12:58:04.947912  1092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36813a3559ff43a893c148b091a60090" candidate_uuid: "bbfb7e6be0904729bcda079b53965aef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" is_pre_election: true
I20260709 12:58:04.948566  1092 raft_consensus.cc:2468] T 36813a3559ff43a893c148b091a60090 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbfb7e6be0904729bcda079b53965aef in term 0.
I20260709 12:58:04.948776  1241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36813a3559ff43a893c148b091a60090" candidate_uuid: "bbfb7e6be0904729bcda079b53965aef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c97e97cff3474b0fb542619cb94dcd8c" is_pre_election: true
I20260709 12:58:04.949136  1287 raft_consensus.cc:493] T 38eeded1fce24dec92c5aa10aa9ac846 P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:04.949429  1241 raft_consensus.cc:2468] T 36813a3559ff43a893c148b091a60090 P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbfb7e6be0904729bcda079b53965aef in term 0.
I20260709 12:58:04.949994  1282 tablet_bootstrap.cc:492] T 38eeded1fce24dec92c5aa10aa9ac846 P c97e97cff3474b0fb542619cb94dcd8c: No bootstrap required, opened a new log
I20260709 12:58:04.949790  1133 leader_election.cc:304] T 36813a3559ff43a893c148b091a60090 P bbfb7e6be0904729bcda079b53965aef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1434bfe58c7247788e5d93c7d2bd8de1, bbfb7e6be0904729bcda079b53965aef; no voters: 
I20260709 12:58:04.949715  1287 raft_consensus.cc:515] T 38eeded1fce24dec92c5aa10aa9ac846 P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:04.950937  1282 ts_tablet_manager.cc:1403] T 38eeded1fce24dec92c5aa10aa9ac846 P c97e97cff3474b0fb542619cb94dcd8c: Time spent bootstrapping tablet: real 0.035s	user 0.015s	sys 0.010s
I20260709 12:58:04.951757  1303 raft_consensus.cc:2804] T 36813a3559ff43a893c148b091a60090 P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:04.953692  1281 tablet_bootstrap.cc:492] T 6a0104eca382490a8ec51916203c8b59 P bbfb7e6be0904729bcda079b53965aef: No bootstrap required, opened a new log
I20260709 12:58:04.953761  1287 leader_election.cc:290] T 38eeded1fce24dec92c5aa10aa9ac846 P bbfb7e6be0904729bcda079b53965aef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193:34795), c97e97cff3474b0fb542619cb94dcd8c (127.0.107.195:43677)
I20260709 12:58:04.948776  1285 tablet_bootstrap.cc:492] T 38eeded1fce24dec92c5aa10aa9ac846 P 1434bfe58c7247788e5d93c7d2bd8de1: No bootstrap required, opened a new log
I20260709 12:58:04.954435  1281 ts_tablet_manager.cc:1403] T 6a0104eca382490a8ec51916203c8b59 P bbfb7e6be0904729bcda079b53965aef: Time spent bootstrapping tablet: real 0.052s	user 0.030s	sys 0.008s
I20260709 12:58:04.954685  1285 ts_tablet_manager.cc:1403] T 38eeded1fce24dec92c5aa10aa9ac846 P 1434bfe58c7247788e5d93c7d2bd8de1: Time spent bootstrapping tablet: real 0.048s	user 0.024s	sys 0.008s
I20260709 12:58:04.954845  1282 raft_consensus.cc:359] T 38eeded1fce24dec92c5aa10aa9ac846 P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:04.955698  1282 raft_consensus.cc:385] T 38eeded1fce24dec92c5aa10aa9ac846 P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:04.956080  1282 raft_consensus.cc:740] T 38eeded1fce24dec92c5aa10aa9ac846 P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c97e97cff3474b0fb542619cb94dcd8c, State: Initialized, Role: FOLLOWER
I20260709 12:58:04.953693  1092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38eeded1fce24dec92c5aa10aa9ac846" candidate_uuid: "bbfb7e6be0904729bcda079b53965aef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" is_pre_election: true
I20260709 12:58:04.956876  1282 consensus_queue.cc:260] T 38eeded1fce24dec92c5aa10aa9ac846 P c97e97cff3474b0fb542619cb94dcd8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:04.957336  1241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38eeded1fce24dec92c5aa10aa9ac846" candidate_uuid: "bbfb7e6be0904729bcda079b53965aef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c97e97cff3474b0fb542619cb94dcd8c" is_pre_election: true
I20260709 12:58:04.957854  1284 raft_consensus.cc:697] T bf5299056e9042429bd51aee9ccf6844 P c97e97cff3474b0fb542619cb94dcd8c [term 1 LEADER]: Becoming Leader. State: Replica: c97e97cff3474b0fb542619cb94dcd8c, State: Running, Role: LEADER
I20260709 12:58:04.957957  1281 raft_consensus.cc:359] T 6a0104eca382490a8ec51916203c8b59 P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
W20260709 12:58:04.957918  1133 leader_election.cc:343] T 38eeded1fce24dec92c5aa10aa9ac846 P bbfb7e6be0904729bcda079b53965aef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193:34795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:04.958622  1281 raft_consensus.cc:385] T 6a0104eca382490a8ec51916203c8b59 P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:04.959129  1281 raft_consensus.cc:740] T 6a0104eca382490a8ec51916203c8b59 P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbfb7e6be0904729bcda079b53965aef, State: Initialized, Role: FOLLOWER
I20260709 12:58:04.958724  1284 consensus_queue.cc:237] T bf5299056e9042429bd51aee9ccf6844 P c97e97cff3474b0fb542619cb94dcd8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } } peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } }
I20260709 12:58:04.959370  1285 raft_consensus.cc:359] T 38eeded1fce24dec92c5aa10aa9ac846 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:04.960085  1285 raft_consensus.cc:385] T 38eeded1fce24dec92c5aa10aa9ac846 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:04.960427  1285 raft_consensus.cc:740] T 38eeded1fce24dec92c5aa10aa9ac846 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1434bfe58c7247788e5d93c7d2bd8de1, State: Initialized, Role: FOLLOWER
I20260709 12:58:04.959978  1281 consensus_queue.cc:260] T 6a0104eca382490a8ec51916203c8b59 P bbfb7e6be0904729bcda079b53965aef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:04.957944  1241 raft_consensus.cc:2468] T 38eeded1fce24dec92c5aa10aa9ac846 P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbfb7e6be0904729bcda079b53965aef in term 0.
I20260709 12:58:04.962148  1132 leader_election.cc:304] T 38eeded1fce24dec92c5aa10aa9ac846 P bbfb7e6be0904729bcda079b53965aef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bbfb7e6be0904729bcda079b53965aef, c97e97cff3474b0fb542619cb94dcd8c; no voters: 1434bfe58c7247788e5d93c7d2bd8de1
I20260709 12:58:04.962476  1281 ts_tablet_manager.cc:1434] T 6a0104eca382490a8ec51916203c8b59 P bbfb7e6be0904729bcda079b53965aef: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:58:04.963351  1287 raft_consensus.cc:2804] T 38eeded1fce24dec92c5aa10aa9ac846 P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:04.952178  1303 raft_consensus.cc:493] T 36813a3559ff43a893c148b091a60090 P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:04.963771  1287 raft_consensus.cc:493] T 38eeded1fce24dec92c5aa10aa9ac846 P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:04.964115  1303 raft_consensus.cc:3060] T 36813a3559ff43a893c148b091a60090 P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:04.964139  1287 raft_consensus.cc:3060] T 38eeded1fce24dec92c5aa10aa9ac846 P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:04.964854  1282 ts_tablet_manager.cc:1434] T 38eeded1fce24dec92c5aa10aa9ac846 P c97e97cff3474b0fb542619cb94dcd8c: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 12:58:04.969043  1282 tablet_bootstrap.cc:492] T 8edcf9960f41476794c70fe555756dbb P c97e97cff3474b0fb542619cb94dcd8c: Bootstrap starting.
I20260709 12:58:04.971304  1287 raft_consensus.cc:515] T 38eeded1fce24dec92c5aa10aa9ac846 P bbfb7e6be0904729bcda079b53965aef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:04.971339  1303 raft_consensus.cc:515] T 36813a3559ff43a893c148b091a60090 P bbfb7e6be0904729bcda079b53965aef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:04.973505  1287 leader_election.cc:290] T 38eeded1fce24dec92c5aa10aa9ac846 P bbfb7e6be0904729bcda079b53965aef [CANDIDATE]: Term 1 election: Requested vote from peers 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193:34795), c97e97cff3474b0fb542619cb94dcd8c (127.0.107.195:43677)
I20260709 12:58:04.963454  1281 tablet_bootstrap.cc:492] T 9574c9ab5cd1491cbc8b01f3c89d4149 P bbfb7e6be0904729bcda079b53965aef: Bootstrap starting.
I20260709 12:58:04.975391  1282 tablet_bootstrap.cc:654] T 8edcf9960f41476794c70fe555756dbb P c97e97cff3474b0fb542619cb94dcd8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:04.975221  1241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36813a3559ff43a893c148b091a60090" candidate_uuid: "bbfb7e6be0904729bcda079b53965aef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c97e97cff3474b0fb542619cb94dcd8c"
I20260709 12:58:04.975898  1241 raft_consensus.cc:3060] T 36813a3559ff43a893c148b091a60090 P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:04.976199  1091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36813a3559ff43a893c148b091a60090" candidate_uuid: "bbfb7e6be0904729bcda079b53965aef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1434bfe58c7247788e5d93c7d2bd8de1"
I20260709 12:58:04.976501  1092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38eeded1fce24dec92c5aa10aa9ac846" candidate_uuid: "bbfb7e6be0904729bcda079b53965aef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1434bfe58c7247788e5d93c7d2bd8de1"
I20260709 12:58:04.976832  1091 raft_consensus.cc:3060] T 36813a3559ff43a893c148b091a60090 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:04.977917  1285 consensus_queue.cc:260] T 38eeded1fce24dec92c5aa10aa9ac846 P 1434bfe58c7247788e5d93c7d2bd8de1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:04.978902  1092 raft_consensus.cc:3060] T 38eeded1fce24dec92c5aa10aa9ac846 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:04.976199  1240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38eeded1fce24dec92c5aa10aa9ac846" candidate_uuid: "bbfb7e6be0904729bcda079b53965aef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c97e97cff3474b0fb542619cb94dcd8c"
I20260709 12:58:04.981204  1240 raft_consensus.cc:3060] T 38eeded1fce24dec92c5aa10aa9ac846 P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:04.981547  1281 tablet_bootstrap.cc:654] T 9574c9ab5cd1491cbc8b01f3c89d4149 P bbfb7e6be0904729bcda079b53965aef: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:04.984500  1241 raft_consensus.cc:2468] T 36813a3559ff43a893c148b091a60090 P c97e97cff3474b0fb542619cb94dcd8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbfb7e6be0904729bcda079b53965aef in term 1.
I20260709 12:58:04.986025  1303 leader_election.cc:290] T 36813a3559ff43a893c148b091a60090 P bbfb7e6be0904729bcda079b53965aef [CANDIDATE]: Term 1 election: Requested vote from peers 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193:34795), c97e97cff3474b0fb542619cb94dcd8c (127.0.107.195:43677)
I20260709 12:58:04.986074  1092 raft_consensus.cc:2468] T 38eeded1fce24dec92c5aa10aa9ac846 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbfb7e6be0904729bcda079b53965aef in term 1.
I20260709 12:58:04.989655  1132 leader_election.cc:304] T 36813a3559ff43a893c148b091a60090 P bbfb7e6be0904729bcda079b53965aef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bbfb7e6be0904729bcda079b53965aef, c97e97cff3474b0fb542619cb94dcd8c; no voters: 
I20260709 12:58:04.990960  1303 raft_consensus.cc:2804] T 36813a3559ff43a893c148b091a60090 P bbfb7e6be0904729bcda079b53965aef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:04.991542  1303 raft_consensus.cc:697] T 36813a3559ff43a893c148b091a60090 P bbfb7e6be0904729bcda079b53965aef [term 1 LEADER]: Becoming Leader. State: Replica: bbfb7e6be0904729bcda079b53965aef, State: Running, Role: LEADER
I20260709 12:58:04.992245  1091 raft_consensus.cc:2468] T 36813a3559ff43a893c148b091a60090 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbfb7e6be0904729bcda079b53965aef in term 1.
I20260709 12:58:04.992460  1303 consensus_queue.cc:237] T 36813a3559ff43a893c148b091a60090 P bbfb7e6be0904729bcda079b53965aef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:04.988451  1240 raft_consensus.cc:2468] T 38eeded1fce24dec92c5aa10aa9ac846 P c97e97cff3474b0fb542619cb94dcd8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbfb7e6be0904729bcda079b53965aef in term 1.
I20260709 12:58:04.994318  1132 leader_election.cc:304] T 38eeded1fce24dec92c5aa10aa9ac846 P bbfb7e6be0904729bcda079b53965aef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bbfb7e6be0904729bcda079b53965aef, c97e97cff3474b0fb542619cb94dcd8c; no voters: 
I20260709 12:58:04.995080  1287 raft_consensus.cc:2804] T 38eeded1fce24dec92c5aa10aa9ac846 P bbfb7e6be0904729bcda079b53965aef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:04.994822  1281 tablet_bootstrap.cc:492] T 9574c9ab5cd1491cbc8b01f3c89d4149 P bbfb7e6be0904729bcda079b53965aef: No bootstrap required, opened a new log
I20260709 12:58:04.999404  1285 ts_tablet_manager.cc:1434] T 38eeded1fce24dec92c5aa10aa9ac846 P 1434bfe58c7247788e5d93c7d2bd8de1: Time spent starting tablet: real 0.044s	user 0.009s	sys 0.000s
I20260709 12:58:04.999488  1281 ts_tablet_manager.cc:1403] T 9574c9ab5cd1491cbc8b01f3c89d4149 P bbfb7e6be0904729bcda079b53965aef: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.009s
I20260709 12:58:05.002600   989 catalog_manager.cc:5697] T bf5299056e9042429bd51aee9ccf6844 P c97e97cff3474b0fb542619cb94dcd8c reported cstate change: term changed from 0 to 1, leader changed from <none> to c97e97cff3474b0fb542619cb94dcd8c (127.0.107.195). New cstate: current_term: 1 leader_uuid: "c97e97cff3474b0fb542619cb94dcd8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:05.008931  1281 raft_consensus.cc:359] T 9574c9ab5cd1491cbc8b01f3c89d4149 P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.010697  1281 raft_consensus.cc:385] T 9574c9ab5cd1491cbc8b01f3c89d4149 P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:05.013072  1281 raft_consensus.cc:740] T 9574c9ab5cd1491cbc8b01f3c89d4149 P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbfb7e6be0904729bcda079b53965aef, State: Initialized, Role: FOLLOWER
I20260709 12:58:05.012611  1287 raft_consensus.cc:697] T 38eeded1fce24dec92c5aa10aa9ac846 P bbfb7e6be0904729bcda079b53965aef [term 1 LEADER]: Becoming Leader. State: Replica: bbfb7e6be0904729bcda079b53965aef, State: Running, Role: LEADER
I20260709 12:58:05.014160  1287 consensus_queue.cc:237] T 38eeded1fce24dec92c5aa10aa9ac846 P bbfb7e6be0904729bcda079b53965aef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.015540   988 catalog_manager.cc:5697] T 36813a3559ff43a893c148b091a60090 P bbfb7e6be0904729bcda079b53965aef reported cstate change: term changed from 0 to 1, leader changed from <none> to bbfb7e6be0904729bcda079b53965aef (127.0.107.194). New cstate: current_term: 1 leader_uuid: "bbfb7e6be0904729bcda079b53965aef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:05.017791  1281 consensus_queue.cc:260] T 9574c9ab5cd1491cbc8b01f3c89d4149 P bbfb7e6be0904729bcda079b53965aef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.021427  1281 ts_tablet_manager.cc:1434] T 9574c9ab5cd1491cbc8b01f3c89d4149 P bbfb7e6be0904729bcda079b53965aef: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260709 12:58:05.022398  1281 tablet_bootstrap.cc:492] T 53866543b96a4b7c975007d75efde33e P bbfb7e6be0904729bcda079b53965aef: Bootstrap starting.
W20260709 12:58:05.022485  1038 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:05.024541  1285 tablet_bootstrap.cc:492] T 9574c9ab5cd1491cbc8b01f3c89d4149 P 1434bfe58c7247788e5d93c7d2bd8de1: Bootstrap starting.
I20260709 12:58:05.028668  1284 raft_consensus.cc:493] T 614a5c8953cf490b85161067f062e80c P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:05.029179  1284 raft_consensus.cc:515] T 614a5c8953cf490b85161067f062e80c P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.029843  1281 tablet_bootstrap.cc:654] T 53866543b96a4b7c975007d75efde33e P bbfb7e6be0904729bcda079b53965aef: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:05.031337  1284 leader_election.cc:290] T 614a5c8953cf490b85161067f062e80c P c97e97cff3474b0fb542619cb94dcd8c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193:34795), bbfb7e6be0904729bcda079b53965aef (127.0.107.194:45551)
I20260709 12:58:05.031973  1285 tablet_bootstrap.cc:654] T 9574c9ab5cd1491cbc8b01f3c89d4149 P 1434bfe58c7247788e5d93c7d2bd8de1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:05.034161  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "614a5c8953cf490b85161067f062e80c" candidate_uuid: "c97e97cff3474b0fb542619cb94dcd8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbfb7e6be0904729bcda079b53965aef" is_pre_election: true
I20260709 12:58:05.034893  1167 raft_consensus.cc:2468] T 614a5c8953cf490b85161067f062e80c P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c97e97cff3474b0fb542619cb94dcd8c in term 0.
I20260709 12:58:05.035429  1092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "614a5c8953cf490b85161067f062e80c" candidate_uuid: "c97e97cff3474b0fb542619cb94dcd8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" is_pre_election: true
I20260709 12:58:05.036509  1204 leader_election.cc:304] T 614a5c8953cf490b85161067f062e80c P c97e97cff3474b0fb542619cb94dcd8c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bbfb7e6be0904729bcda079b53965aef, c97e97cff3474b0fb542619cb94dcd8c; no voters: 
I20260709 12:58:05.037019  1281 tablet_bootstrap.cc:492] T 53866543b96a4b7c975007d75efde33e P bbfb7e6be0904729bcda079b53965aef: No bootstrap required, opened a new log
W20260709 12:58:05.037222  1207 leader_election.cc:343] T 614a5c8953cf490b85161067f062e80c P c97e97cff3474b0fb542619cb94dcd8c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193:34795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:05.037511  1281 ts_tablet_manager.cc:1403] T 53866543b96a4b7c975007d75efde33e P bbfb7e6be0904729bcda079b53965aef: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 12:58:05.038221  1284 raft_consensus.cc:2804] T 614a5c8953cf490b85161067f062e80c P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:05.038741  1284 raft_consensus.cc:493] T 614a5c8953cf490b85161067f062e80c P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:05.039179  1284 raft_consensus.cc:3060] T 614a5c8953cf490b85161067f062e80c P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:05.040758  1281 raft_consensus.cc:359] T 53866543b96a4b7c975007d75efde33e P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.041540  1281 raft_consensus.cc:385] T 53866543b96a4b7c975007d75efde33e P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:05.041851  1281 raft_consensus.cc:740] T 53866543b96a4b7c975007d75efde33e P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbfb7e6be0904729bcda079b53965aef, State: Initialized, Role: FOLLOWER
I20260709 12:58:05.042788  1281 consensus_queue.cc:260] T 53866543b96a4b7c975007d75efde33e P bbfb7e6be0904729bcda079b53965aef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.044974  1281 ts_tablet_manager.cc:1434] T 53866543b96a4b7c975007d75efde33e P bbfb7e6be0904729bcda079b53965aef: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:58:05.045979  1281 tablet_bootstrap.cc:492] T 6eab0d4cbaa04172bc4320b9c3847715 P bbfb7e6be0904729bcda079b53965aef: Bootstrap starting.
I20260709 12:58:05.050305  1292 raft_consensus.cc:493] T 8edcf9960f41476794c70fe555756dbb P 1434bfe58c7247788e5d93c7d2bd8de1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:05.050833  1292 raft_consensus.cc:515] T 8edcf9960f41476794c70fe555756dbb P 1434bfe58c7247788e5d93c7d2bd8de1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.053241  1281 tablet_bootstrap.cc:654] T 6eab0d4cbaa04172bc4320b9c3847715 P bbfb7e6be0904729bcda079b53965aef: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:05.053334  1284 raft_consensus.cc:515] T 614a5c8953cf490b85161067f062e80c P c97e97cff3474b0fb542619cb94dcd8c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.056279  1285 tablet_bootstrap.cc:492] T 9574c9ab5cd1491cbc8b01f3c89d4149 P 1434bfe58c7247788e5d93c7d2bd8de1: No bootstrap required, opened a new log
I20260709 12:58:05.056109  1092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "614a5c8953cf490b85161067f062e80c" candidate_uuid: "c97e97cff3474b0fb542619cb94dcd8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1434bfe58c7247788e5d93c7d2bd8de1"
I20260709 12:58:05.056761  1292 leader_election.cc:290] T 8edcf9960f41476794c70fe555756dbb P 1434bfe58c7247788e5d93c7d2bd8de1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbfb7e6be0904729bcda079b53965aef (127.0.107.194:45551), c97e97cff3474b0fb542619cb94dcd8c (127.0.107.195:43677)
I20260709 12:58:05.056751  1285 ts_tablet_manager.cc:1403] T 9574c9ab5cd1491cbc8b01f3c89d4149 P 1434bfe58c7247788e5d93c7d2bd8de1: Time spent bootstrapping tablet: real 0.032s	user 0.017s	sys 0.003s
I20260709 12:58:05.058496  1282 tablet_bootstrap.cc:492] T 8edcf9960f41476794c70fe555756dbb P c97e97cff3474b0fb542619cb94dcd8c: No bootstrap required, opened a new log
I20260709 12:58:05.058943  1282 ts_tablet_manager.cc:1403] T 8edcf9960f41476794c70fe555756dbb P c97e97cff3474b0fb542619cb94dcd8c: Time spent bootstrapping tablet: real 0.090s	user 0.018s	sys 0.020s
I20260709 12:58:05.060168  1285 raft_consensus.cc:359] T 9574c9ab5cd1491cbc8b01f3c89d4149 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.065042  1285 raft_consensus.cc:385] T 9574c9ab5cd1491cbc8b01f3c89d4149 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:05.065330  1285 raft_consensus.cc:740] T 9574c9ab5cd1491cbc8b01f3c89d4149 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1434bfe58c7247788e5d93c7d2bd8de1, State: Initialized, Role: FOLLOWER
I20260709 12:58:05.065559  1281 tablet_bootstrap.cc:492] T 6eab0d4cbaa04172bc4320b9c3847715 P bbfb7e6be0904729bcda079b53965aef: No bootstrap required, opened a new log
I20260709 12:58:05.066012  1281 ts_tablet_manager.cc:1403] T 6eab0d4cbaa04172bc4320b9c3847715 P bbfb7e6be0904729bcda079b53965aef: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.007s
I20260709 12:58:05.062706  1282 raft_consensus.cc:359] T 8edcf9960f41476794c70fe555756dbb P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.066648  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "614a5c8953cf490b85161067f062e80c" candidate_uuid: "c97e97cff3474b0fb542619cb94dcd8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbfb7e6be0904729bcda079b53965aef"
I20260709 12:58:05.067008  1282 raft_consensus.cc:385] T 8edcf9960f41476794c70fe555756dbb P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:05.067169  1167 raft_consensus.cc:3060] T 614a5c8953cf490b85161067f062e80c P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:05.067327  1282 raft_consensus.cc:740] T 8edcf9960f41476794c70fe555756dbb P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c97e97cff3474b0fb542619cb94dcd8c, State: Initialized, Role: FOLLOWER
I20260709 12:58:05.068082  1282 consensus_queue.cc:260] T 8edcf9960f41476794c70fe555756dbb P c97e97cff3474b0fb542619cb94dcd8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.070263  1282 ts_tablet_manager.cc:1434] T 8edcf9960f41476794c70fe555756dbb P c97e97cff3474b0fb542619cb94dcd8c: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 12:58:05.071161  1282 tablet_bootstrap.cc:492] T 6a0104eca382490a8ec51916203c8b59 P c97e97cff3474b0fb542619cb94dcd8c: Bootstrap starting.
I20260709 12:58:05.073659  1281 raft_consensus.cc:359] T 6eab0d4cbaa04172bc4320b9c3847715 P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.074494  1281 raft_consensus.cc:385] T 6eab0d4cbaa04172bc4320b9c3847715 P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:05.075063  1281 raft_consensus.cc:740] T 6eab0d4cbaa04172bc4320b9c3847715 P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbfb7e6be0904729bcda079b53965aef, State: Initialized, Role: FOLLOWER
I20260709 12:58:05.075975  1281 consensus_queue.cc:260] T 6eab0d4cbaa04172bc4320b9c3847715 P bbfb7e6be0904729bcda079b53965aef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.066020  1285 consensus_queue.cc:260] T 9574c9ab5cd1491cbc8b01f3c89d4149 P 1434bfe58c7247788e5d93c7d2bd8de1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.077462  1167 raft_consensus.cc:2468] T 614a5c8953cf490b85161067f062e80c P bbfb7e6be0904729bcda079b53965aef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c97e97cff3474b0fb542619cb94dcd8c in term 1.
I20260709 12:58:05.078683  1204 leader_election.cc:304] T 614a5c8953cf490b85161067f062e80c P c97e97cff3474b0fb542619cb94dcd8c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bbfb7e6be0904729bcda079b53965aef, c97e97cff3474b0fb542619cb94dcd8c; no voters: 
I20260709 12:58:05.078851  1281 ts_tablet_manager.cc:1434] T 6eab0d4cbaa04172bc4320b9c3847715 P bbfb7e6be0904729bcda079b53965aef: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:58:05.077224   988 catalog_manager.cc:5697] T 38eeded1fce24dec92c5aa10aa9ac846 P bbfb7e6be0904729bcda079b53965aef reported cstate change: term changed from 0 to 1, leader changed from <none> to bbfb7e6be0904729bcda079b53965aef (127.0.107.194). New cstate: current_term: 1 leader_uuid: "bbfb7e6be0904729bcda079b53965aef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:05.079710  1302 raft_consensus.cc:2804] T 614a5c8953cf490b85161067f062e80c P c97e97cff3474b0fb542619cb94dcd8c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:05.079999  1281 tablet_bootstrap.cc:492] T 8edcf9960f41476794c70fe555756dbb P bbfb7e6be0904729bcda079b53965aef: Bootstrap starting.
I20260709 12:58:05.082829  1282 tablet_bootstrap.cc:654] T 6a0104eca382490a8ec51916203c8b59 P c97e97cff3474b0fb542619cb94dcd8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:05.086997  1281 tablet_bootstrap.cc:654] T 8edcf9960f41476794c70fe555756dbb P bbfb7e6be0904729bcda079b53965aef: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:05.080199  1284 leader_election.cc:290] T 614a5c8953cf490b85161067f062e80c P c97e97cff3474b0fb542619cb94dcd8c [CANDIDATE]: Term 1 election: Requested vote from peers 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193:34795), bbfb7e6be0904729bcda079b53965aef (127.0.107.194:45551)
I20260709 12:58:05.080648  1285 ts_tablet_manager.cc:1434] T 9574c9ab5cd1491cbc8b01f3c89d4149 P 1434bfe58c7247788e5d93c7d2bd8de1: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 12:58:05.090979  1285 tablet_bootstrap.cc:492] T 614a5c8953cf490b85161067f062e80c P 1434bfe58c7247788e5d93c7d2bd8de1: Bootstrap starting.
I20260709 12:58:05.097440  1302 raft_consensus.cc:697] T 614a5c8953cf490b85161067f062e80c P c97e97cff3474b0fb542619cb94dcd8c [term 1 LEADER]: Becoming Leader. State: Replica: c97e97cff3474b0fb542619cb94dcd8c, State: Running, Role: LEADER
I20260709 12:58:05.097729  1287 raft_consensus.cc:493] T 6eab0d4cbaa04172bc4320b9c3847715 P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:05.098488  1285 tablet_bootstrap.cc:654] T 614a5c8953cf490b85161067f062e80c P 1434bfe58c7247788e5d93c7d2bd8de1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:05.098345  1287 raft_consensus.cc:515] T 6eab0d4cbaa04172bc4320b9c3847715 P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.098425  1302 consensus_queue.cc:237] T 614a5c8953cf490b85161067f062e80c P c97e97cff3474b0fb542619cb94dcd8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.102823  1240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eab0d4cbaa04172bc4320b9c3847715" candidate_uuid: "bbfb7e6be0904729bcda079b53965aef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c97e97cff3474b0fb542619cb94dcd8c" is_pre_election: true
W20260709 12:58:05.104575  1132 leader_election.cc:343] T 6eab0d4cbaa04172bc4320b9c3847715 P bbfb7e6be0904729bcda079b53965aef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c97e97cff3474b0fb542619cb94dcd8c (127.0.107.195:43677): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:05.105130  1287 leader_election.cc:290] T 6eab0d4cbaa04172bc4320b9c3847715 P bbfb7e6be0904729bcda079b53965aef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193:34795), c97e97cff3474b0fb542619cb94dcd8c (127.0.107.195:43677)
I20260709 12:58:05.105773  1092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eab0d4cbaa04172bc4320b9c3847715" candidate_uuid: "bbfb7e6be0904729bcda079b53965aef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" is_pre_election: true
W20260709 12:58:05.107429  1133 leader_election.cc:343] T 6eab0d4cbaa04172bc4320b9c3847715 P bbfb7e6be0904729bcda079b53965aef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193:34795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:05.107954  1133 leader_election.cc:304] T 6eab0d4cbaa04172bc4320b9c3847715 P bbfb7e6be0904729bcda079b53965aef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bbfb7e6be0904729bcda079b53965aef; no voters: 1434bfe58c7247788e5d93c7d2bd8de1, c97e97cff3474b0fb542619cb94dcd8c
I20260709 12:58:05.109083  1287 raft_consensus.cc:2749] T 6eab0d4cbaa04172bc4320b9c3847715 P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:05.111327  1285 tablet_bootstrap.cc:492] T 614a5c8953cf490b85161067f062e80c P 1434bfe58c7247788e5d93c7d2bd8de1: No bootstrap required, opened a new log
I20260709 12:58:05.113408  1285 ts_tablet_manager.cc:1403] T 614a5c8953cf490b85161067f062e80c P 1434bfe58c7247788e5d93c7d2bd8de1: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.000s
I20260709 12:58:05.123876  1281 tablet_bootstrap.cc:492] T 8edcf9960f41476794c70fe555756dbb P bbfb7e6be0904729bcda079b53965aef: No bootstrap required, opened a new log
I20260709 12:58:05.123662  1285 raft_consensus.cc:359] T 614a5c8953cf490b85161067f062e80c P 1434bfe58c7247788e5d93c7d2bd8de1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.124284  1285 raft_consensus.cc:385] T 614a5c8953cf490b85161067f062e80c P 1434bfe58c7247788e5d93c7d2bd8de1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:05.124323  1281 ts_tablet_manager.cc:1403] T 8edcf9960f41476794c70fe555756dbb P bbfb7e6be0904729bcda079b53965aef: Time spent bootstrapping tablet: real 0.045s	user 0.025s	sys 0.004s
I20260709 12:58:05.124590  1285 raft_consensus.cc:740] T 614a5c8953cf490b85161067f062e80c P 1434bfe58c7247788e5d93c7d2bd8de1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1434bfe58c7247788e5d93c7d2bd8de1, State: Initialized, Role: FOLLOWER
I20260709 12:58:05.124043   990 catalog_manager.cc:5697] T 614a5c8953cf490b85161067f062e80c P c97e97cff3474b0fb542619cb94dcd8c reported cstate change: term changed from 0 to 1, leader changed from <none> to c97e97cff3474b0fb542619cb94dcd8c (127.0.107.195). New cstate: current_term: 1 leader_uuid: "c97e97cff3474b0fb542619cb94dcd8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:05.125753  1285 consensus_queue.cc:260] T 614a5c8953cf490b85161067f062e80c P 1434bfe58c7247788e5d93c7d2bd8de1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.126878  1281 raft_consensus.cc:359] T 8edcf9960f41476794c70fe555756dbb P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.127519  1281 raft_consensus.cc:385] T 8edcf9960f41476794c70fe555756dbb P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:05.127763  1281 raft_consensus.cc:740] T 8edcf9960f41476794c70fe555756dbb P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbfb7e6be0904729bcda079b53965aef, State: Initialized, Role: FOLLOWER
I20260709 12:58:05.128600  1285 ts_tablet_manager.cc:1434] T 614a5c8953cf490b85161067f062e80c P 1434bfe58c7247788e5d93c7d2bd8de1: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 12:58:05.128440  1281 consensus_queue.cc:260] T 8edcf9960f41476794c70fe555756dbb P bbfb7e6be0904729bcda079b53965aef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.129770  1285 tablet_bootstrap.cc:492] T 6a0104eca382490a8ec51916203c8b59 P 1434bfe58c7247788e5d93c7d2bd8de1: Bootstrap starting.
I20260709 12:58:05.130589  1281 ts_tablet_manager.cc:1434] T 8edcf9960f41476794c70fe555756dbb P bbfb7e6be0904729bcda079b53965aef: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:58:05.132179  1281 tablet_bootstrap.cc:492] T cf73b42e520b432098cf08c6c32141ba P bbfb7e6be0904729bcda079b53965aef: Bootstrap starting.
I20260709 12:58:05.139494  1281 tablet_bootstrap.cc:654] T cf73b42e520b432098cf08c6c32141ba P bbfb7e6be0904729bcda079b53965aef: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:05.143122  1285 tablet_bootstrap.cc:654] T 6a0104eca382490a8ec51916203c8b59 P 1434bfe58c7247788e5d93c7d2bd8de1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:05.151401  1281 tablet_bootstrap.cc:492] T cf73b42e520b432098cf08c6c32141ba P bbfb7e6be0904729bcda079b53965aef: No bootstrap required, opened a new log
I20260709 12:58:05.151975  1281 ts_tablet_manager.cc:1403] T cf73b42e520b432098cf08c6c32141ba P bbfb7e6be0904729bcda079b53965aef: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.003s
I20260709 12:58:05.154830  1281 raft_consensus.cc:359] T cf73b42e520b432098cf08c6c32141ba P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.155633  1281 raft_consensus.cc:385] T cf73b42e520b432098cf08c6c32141ba P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:05.155946  1281 raft_consensus.cc:740] T cf73b42e520b432098cf08c6c32141ba P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bbfb7e6be0904729bcda079b53965aef, State: Initialized, Role: FOLLOWER
I20260709 12:58:05.157078  1281 consensus_queue.cc:260] T cf73b42e520b432098cf08c6c32141ba P bbfb7e6be0904729bcda079b53965aef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.159305  1285 tablet_bootstrap.cc:492] T 6a0104eca382490a8ec51916203c8b59 P 1434bfe58c7247788e5d93c7d2bd8de1: No bootstrap required, opened a new log
I20260709 12:58:05.160002  1285 ts_tablet_manager.cc:1403] T 6a0104eca382490a8ec51916203c8b59 P 1434bfe58c7247788e5d93c7d2bd8de1: Time spent bootstrapping tablet: real 0.030s	user 0.008s	sys 0.011s
W20260709 12:58:05.160192  1207 leader_election.cc:343] T 614a5c8953cf490b85161067f062e80c P c97e97cff3474b0fb542619cb94dcd8c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193:34795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:05.163106  1281 ts_tablet_manager.cc:1434] T cf73b42e520b432098cf08c6c32141ba P bbfb7e6be0904729bcda079b53965aef: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.001s
I20260709 12:58:05.163048  1285 raft_consensus.cc:359] T 6a0104eca382490a8ec51916203c8b59 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.163923  1285 raft_consensus.cc:385] T 6a0104eca382490a8ec51916203c8b59 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:05.164242  1285 raft_consensus.cc:740] T 6a0104eca382490a8ec51916203c8b59 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1434bfe58c7247788e5d93c7d2bd8de1, State: Initialized, Role: FOLLOWER
I20260709 12:58:05.168421  1285 consensus_queue.cc:260] T 6a0104eca382490a8ec51916203c8b59 P 1434bfe58c7247788e5d93c7d2bd8de1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.177536  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8edcf9960f41476794c70fe555756dbb" candidate_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbfb7e6be0904729bcda079b53965aef" is_pre_election: true
I20260709 12:58:05.178248  1285 ts_tablet_manager.cc:1434] T 6a0104eca382490a8ec51916203c8b59 P 1434bfe58c7247788e5d93c7d2bd8de1: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.003s
I20260709 12:58:05.178390  1167 raft_consensus.cc:2468] T 8edcf9960f41476794c70fe555756dbb P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1434bfe58c7247788e5d93c7d2bd8de1 in term 0.
I20260709 12:58:05.179315  1285 tablet_bootstrap.cc:492] T bf5299056e9042429bd51aee9ccf6844 P 1434bfe58c7247788e5d93c7d2bd8de1: Bootstrap starting.
I20260709 12:58:05.180188  1055 leader_election.cc:304] T 8edcf9960f41476794c70fe555756dbb P 1434bfe58c7247788e5d93c7d2bd8de1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1434bfe58c7247788e5d93c7d2bd8de1, bbfb7e6be0904729bcda079b53965aef; no voters: 
I20260709 12:58:05.181262  1292 raft_consensus.cc:2804] T 8edcf9960f41476794c70fe555756dbb P 1434bfe58c7247788e5d93c7d2bd8de1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:05.181602  1292 raft_consensus.cc:493] T 8edcf9960f41476794c70fe555756dbb P 1434bfe58c7247788e5d93c7d2bd8de1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:05.181937  1292 raft_consensus.cc:3060] T 8edcf9960f41476794c70fe555756dbb P 1434bfe58c7247788e5d93c7d2bd8de1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:05.184741  1282 tablet_bootstrap.cc:492] T 6a0104eca382490a8ec51916203c8b59 P c97e97cff3474b0fb542619cb94dcd8c: No bootstrap required, opened a new log
I20260709 12:58:05.185171  1282 ts_tablet_manager.cc:1403] T 6a0104eca382490a8ec51916203c8b59 P c97e97cff3474b0fb542619cb94dcd8c: Time spent bootstrapping tablet: real 0.114s	user 0.029s	sys 0.027s
I20260709 12:58:05.187273  1282 raft_consensus.cc:359] T 6a0104eca382490a8ec51916203c8b59 P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.187842  1282 raft_consensus.cc:385] T 6a0104eca382490a8ec51916203c8b59 P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:05.188129  1282 raft_consensus.cc:740] T 6a0104eca382490a8ec51916203c8b59 P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c97e97cff3474b0fb542619cb94dcd8c, State: Initialized, Role: FOLLOWER
I20260709 12:58:05.188999  1282 consensus_queue.cc:260] T 6a0104eca382490a8ec51916203c8b59 P c97e97cff3474b0fb542619cb94dcd8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.189988  1292 raft_consensus.cc:515] T 8edcf9960f41476794c70fe555756dbb P 1434bfe58c7247788e5d93c7d2bd8de1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.191064  1287 raft_consensus.cc:493] T 6a0104eca382490a8ec51916203c8b59 P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:05.191538  1287 raft_consensus.cc:515] T 6a0104eca382490a8ec51916203c8b59 P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.192728  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8edcf9960f41476794c70fe555756dbb" candidate_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbfb7e6be0904729bcda079b53965aef"
I20260709 12:58:05.192961  1240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8edcf9960f41476794c70fe555756dbb" candidate_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c97e97cff3474b0fb542619cb94dcd8c" is_pre_election: true
I20260709 12:58:05.193280  1167 raft_consensus.cc:3060] T 8edcf9960f41476794c70fe555756dbb P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:05.193602  1240 raft_consensus.cc:2468] T 8edcf9960f41476794c70fe555756dbb P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1434bfe58c7247788e5d93c7d2bd8de1 in term 0.
I20260709 12:58:05.195086  1092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0104eca382490a8ec51916203c8b59" candidate_uuid: "bbfb7e6be0904729bcda079b53965aef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" is_pre_election: true
I20260709 12:58:05.195683  1092 raft_consensus.cc:2468] T 6a0104eca382490a8ec51916203c8b59 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbfb7e6be0904729bcda079b53965aef in term 0.
I20260709 12:58:05.196005  1282 ts_tablet_manager.cc:1434] T 6a0104eca382490a8ec51916203c8b59 P c97e97cff3474b0fb542619cb94dcd8c: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:58:05.196884  1133 leader_election.cc:304] T 6a0104eca382490a8ec51916203c8b59 P bbfb7e6be0904729bcda079b53965aef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1434bfe58c7247788e5d93c7d2bd8de1, bbfb7e6be0904729bcda079b53965aef; no voters: 
I20260709 12:58:05.196941  1240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0104eca382490a8ec51916203c8b59" candidate_uuid: "bbfb7e6be0904729bcda079b53965aef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c97e97cff3474b0fb542619cb94dcd8c" is_pre_election: true
I20260709 12:58:05.197630  1240 raft_consensus.cc:2468] T 6a0104eca382490a8ec51916203c8b59 P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbfb7e6be0904729bcda079b53965aef in term 0.
I20260709 12:58:05.198729  1306 raft_consensus.cc:2804] T 6a0104eca382490a8ec51916203c8b59 P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:05.199110  1306 raft_consensus.cc:493] T 6a0104eca382490a8ec51916203c8b59 P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:05.199450  1306 raft_consensus.cc:3060] T 6a0104eca382490a8ec51916203c8b59 P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:05.199616  1282 tablet_bootstrap.cc:492] T 53866543b96a4b7c975007d75efde33e P c97e97cff3474b0fb542619cb94dcd8c: Bootstrap starting.
I20260709 12:58:05.199988  1167 raft_consensus.cc:2468] T 8edcf9960f41476794c70fe555756dbb P bbfb7e6be0904729bcda079b53965aef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1434bfe58c7247788e5d93c7d2bd8de1 in term 1.
I20260709 12:58:05.200744  1285 tablet_bootstrap.cc:654] T bf5299056e9042429bd51aee9ccf6844 P 1434bfe58c7247788e5d93c7d2bd8de1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:05.201191  1055 leader_election.cc:304] T 8edcf9960f41476794c70fe555756dbb P 1434bfe58c7247788e5d93c7d2bd8de1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1434bfe58c7247788e5d93c7d2bd8de1, bbfb7e6be0904729bcda079b53965aef; no voters: 
I20260709 12:58:05.203634  1292 leader_election.cc:290] T 8edcf9960f41476794c70fe555756dbb P 1434bfe58c7247788e5d93c7d2bd8de1 [CANDIDATE]: Term 1 election: Requested vote from peers bbfb7e6be0904729bcda079b53965aef (127.0.107.194:45551), c97e97cff3474b0fb542619cb94dcd8c (127.0.107.195:43677)
I20260709 12:58:05.204314  1292 raft_consensus.cc:2804] T 8edcf9960f41476794c70fe555756dbb P 1434bfe58c7247788e5d93c7d2bd8de1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:05.204926  1292 raft_consensus.cc:697] T 8edcf9960f41476794c70fe555756dbb P 1434bfe58c7247788e5d93c7d2bd8de1 [term 1 LEADER]: Becoming Leader. State: Replica: 1434bfe58c7247788e5d93c7d2bd8de1, State: Running, Role: LEADER
I20260709 12:58:05.205955  1241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8edcf9960f41476794c70fe555756dbb" candidate_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c97e97cff3474b0fb542619cb94dcd8c"
I20260709 12:58:05.206946  1241 raft_consensus.cc:3060] T 8edcf9960f41476794c70fe555756dbb P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:05.193715  1287 leader_election.cc:290] T 6a0104eca382490a8ec51916203c8b59 P bbfb7e6be0904729bcda079b53965aef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193:34795), c97e97cff3474b0fb542619cb94dcd8c (127.0.107.195:43677)
I20260709 12:58:05.213271  1282 tablet_bootstrap.cc:654] T 53866543b96a4b7c975007d75efde33e P c97e97cff3474b0fb542619cb94dcd8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:05.219934  1306 raft_consensus.cc:515] T 6a0104eca382490a8ec51916203c8b59 P bbfb7e6be0904729bcda079b53965aef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.205960  1292 consensus_queue.cc:237] T 8edcf9960f41476794c70fe555756dbb P 1434bfe58c7247788e5d93c7d2bd8de1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.226653  1302 raft_consensus.cc:493] T 9574c9ab5cd1491cbc8b01f3c89d4149 P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:05.226977  1240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0104eca382490a8ec51916203c8b59" candidate_uuid: "bbfb7e6be0904729bcda079b53965aef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c97e97cff3474b0fb542619cb94dcd8c"
I20260709 12:58:05.227218  1302 raft_consensus.cc:515] T 9574c9ab5cd1491cbc8b01f3c89d4149 P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.227828  1240 raft_consensus.cc:3060] T 6a0104eca382490a8ec51916203c8b59 P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:05.225245  1092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0104eca382490a8ec51916203c8b59" candidate_uuid: "bbfb7e6be0904729bcda079b53965aef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1434bfe58c7247788e5d93c7d2bd8de1"
I20260709 12:58:05.223130  1306 leader_election.cc:290] T 6a0104eca382490a8ec51916203c8b59 P bbfb7e6be0904729bcda079b53965aef [CANDIDATE]: Term 1 election: Requested vote from peers 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193:34795), c97e97cff3474b0fb542619cb94dcd8c (127.0.107.195:43677)
I20260709 12:58:05.232168  1302 leader_election.cc:290] T 9574c9ab5cd1491cbc8b01f3c89d4149 P c97e97cff3474b0fb542619cb94dcd8c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193:34795), bbfb7e6be0904729bcda079b53965aef (127.0.107.194:45551)
I20260709 12:58:05.223904  1287 raft_consensus.cc:493] T 9574c9ab5cd1491cbc8b01f3c89d4149 P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:05.233557  1287 raft_consensus.cc:515] T 9574c9ab5cd1491cbc8b01f3c89d4149 P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.234193  1091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9574c9ab5cd1491cbc8b01f3c89d4149" candidate_uuid: "c97e97cff3474b0fb542619cb94dcd8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" is_pre_election: true
I20260709 12:58:05.235031  1091 raft_consensus.cc:2468] T 9574c9ab5cd1491cbc8b01f3c89d4149 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c97e97cff3474b0fb542619cb94dcd8c in term 0.
I20260709 12:58:05.237749  1207 leader_election.cc:304] T 9574c9ab5cd1491cbc8b01f3c89d4149 P c97e97cff3474b0fb542619cb94dcd8c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1434bfe58c7247788e5d93c7d2bd8de1, c97e97cff3474b0fb542619cb94dcd8c; no voters: 
I20260709 12:58:05.239144  1239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9574c9ab5cd1491cbc8b01f3c89d4149" candidate_uuid: "bbfb7e6be0904729bcda079b53965aef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c97e97cff3474b0fb542619cb94dcd8c" is_pre_election: true
I20260709 12:58:05.240216  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9574c9ab5cd1491cbc8b01f3c89d4149" candidate_uuid: "c97e97cff3474b0fb542619cb94dcd8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbfb7e6be0904729bcda079b53965aef" is_pre_election: true
I20260709 12:58:05.240733  1302 raft_consensus.cc:2804] T 9574c9ab5cd1491cbc8b01f3c89d4149 P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:05.231245  1092 raft_consensus.cc:3060] T 6a0104eca382490a8ec51916203c8b59 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:05.241298  1167 raft_consensus.cc:2468] T 9574c9ab5cd1491cbc8b01f3c89d4149 P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c97e97cff3474b0fb542619cb94dcd8c in term 0.
I20260709 12:58:05.238114  1287 leader_election.cc:290] T 9574c9ab5cd1491cbc8b01f3c89d4149 P bbfb7e6be0904729bcda079b53965aef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193:34795), c97e97cff3474b0fb542619cb94dcd8c (127.0.107.195:43677)
I20260709 12:58:05.244966  1091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9574c9ab5cd1491cbc8b01f3c89d4149" candidate_uuid: "bbfb7e6be0904729bcda079b53965aef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" is_pre_election: true
I20260709 12:58:05.245844  1091 raft_consensus.cc:2468] T 9574c9ab5cd1491cbc8b01f3c89d4149 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbfb7e6be0904729bcda079b53965aef in term 0.
I20260709 12:58:05.241266  1302 raft_consensus.cc:493] T 9574c9ab5cd1491cbc8b01f3c89d4149 P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:05.247172  1302 raft_consensus.cc:3060] T 9574c9ab5cd1491cbc8b01f3c89d4149 P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:05.247463  1133 leader_election.cc:304] T 9574c9ab5cd1491cbc8b01f3c89d4149 P bbfb7e6be0904729bcda079b53965aef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1434bfe58c7247788e5d93c7d2bd8de1, bbfb7e6be0904729bcda079b53965aef; no voters: 
I20260709 12:58:05.248723  1287 raft_consensus.cc:2804] T 9574c9ab5cd1491cbc8b01f3c89d4149 P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:05.249202  1287 raft_consensus.cc:493] T 9574c9ab5cd1491cbc8b01f3c89d4149 P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:05.249658  1287 raft_consensus.cc:3060] T 9574c9ab5cd1491cbc8b01f3c89d4149 P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:05.260389  1092 raft_consensus.cc:2468] T 6a0104eca382490a8ec51916203c8b59 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbfb7e6be0904729bcda079b53965aef in term 1.
I20260709 12:58:05.264508  1133 leader_election.cc:304] T 6a0104eca382490a8ec51916203c8b59 P bbfb7e6be0904729bcda079b53965aef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1434bfe58c7247788e5d93c7d2bd8de1, bbfb7e6be0904729bcda079b53965aef; no voters: 
I20260709 12:58:05.265359  1241 raft_consensus.cc:2468] T 8edcf9960f41476794c70fe555756dbb P c97e97cff3474b0fb542619cb94dcd8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1434bfe58c7247788e5d93c7d2bd8de1 in term 1.
I20260709 12:58:05.265736  1306 raft_consensus.cc:2804] T 6a0104eca382490a8ec51916203c8b59 P bbfb7e6be0904729bcda079b53965aef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:05.266408  1306 raft_consensus.cc:697] T 6a0104eca382490a8ec51916203c8b59 P bbfb7e6be0904729bcda079b53965aef [term 1 LEADER]: Becoming Leader. State: Replica: bbfb7e6be0904729bcda079b53965aef, State: Running, Role: LEADER
I20260709 12:58:05.267402  1306 consensus_queue.cc:237] T 6a0104eca382490a8ec51916203c8b59 P bbfb7e6be0904729bcda079b53965aef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.273561  1240 raft_consensus.cc:2468] T 6a0104eca382490a8ec51916203c8b59 P c97e97cff3474b0fb542619cb94dcd8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbfb7e6be0904729bcda079b53965aef in term 1.
I20260709 12:58:05.275789  1282 tablet_bootstrap.cc:492] T 53866543b96a4b7c975007d75efde33e P c97e97cff3474b0fb542619cb94dcd8c: No bootstrap required, opened a new log
I20260709 12:58:05.276274  1282 ts_tablet_manager.cc:1403] T 53866543b96a4b7c975007d75efde33e P c97e97cff3474b0fb542619cb94dcd8c: Time spent bootstrapping tablet: real 0.077s	user 0.026s	sys 0.028s
I20260709 12:58:05.271776  1302 raft_consensus.cc:515] T 9574c9ab5cd1491cbc8b01f3c89d4149 P c97e97cff3474b0fb542619cb94dcd8c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.277632  1287 raft_consensus.cc:515] T 9574c9ab5cd1491cbc8b01f3c89d4149 P bbfb7e6be0904729bcda079b53965aef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.278309  1326 raft_consensus.cc:493] T 614a5c8953cf490b85161067f062e80c P 1434bfe58c7247788e5d93c7d2bd8de1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:05.279963  1326 raft_consensus.cc:515] T 614a5c8953cf490b85161067f062e80c P 1434bfe58c7247788e5d93c7d2bd8de1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.280493  1239 raft_consensus.cc:2393] T 9574c9ab5cd1491cbc8b01f3c89d4149 P c97e97cff3474b0fb542619cb94dcd8c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bbfb7e6be0904729bcda079b53965aef in current term 1: Already voted for candidate c97e97cff3474b0fb542619cb94dcd8c in this term.
I20260709 12:58:05.282625  1287 leader_election.cc:290] T 9574c9ab5cd1491cbc8b01f3c89d4149 P bbfb7e6be0904729bcda079b53965aef [CANDIDATE]: Term 1 election: Requested vote from peers 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193:34795), c97e97cff3474b0fb542619cb94dcd8c (127.0.107.195:43677)
I20260709 12:58:05.279155  1285 tablet_bootstrap.cc:492] T bf5299056e9042429bd51aee9ccf6844 P 1434bfe58c7247788e5d93c7d2bd8de1: No bootstrap required, opened a new log
I20260709 12:58:05.279204  1282 raft_consensus.cc:359] T 53866543b96a4b7c975007d75efde33e P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.285394  1282 raft_consensus.cc:385] T 53866543b96a4b7c975007d75efde33e P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:05.285698  1282 raft_consensus.cc:740] T 53866543b96a4b7c975007d75efde33e P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c97e97cff3474b0fb542619cb94dcd8c, State: Initialized, Role: FOLLOWER
I20260709 12:58:05.286356  1282 consensus_queue.cc:260] T 53866543b96a4b7c975007d75efde33e P c97e97cff3474b0fb542619cb94dcd8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.286856  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "614a5c8953cf490b85161067f062e80c" candidate_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbfb7e6be0904729bcda079b53965aef" is_pre_election: true
I20260709 12:58:05.287739  1167 raft_consensus.cc:2393] T 614a5c8953cf490b85161067f062e80c P bbfb7e6be0904729bcda079b53965aef [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1434bfe58c7247788e5d93c7d2bd8de1 in current term 1: Already voted for candidate c97e97cff3474b0fb542619cb94dcd8c in this term.
I20260709 12:58:05.287652  1092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9574c9ab5cd1491cbc8b01f3c89d4149" candidate_uuid: "bbfb7e6be0904729bcda079b53965aef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1434bfe58c7247788e5d93c7d2bd8de1"
I20260709 12:58:05.285096  1285 ts_tablet_manager.cc:1403] T bf5299056e9042429bd51aee9ccf6844 P 1434bfe58c7247788e5d93c7d2bd8de1: Time spent bootstrapping tablet: real 0.106s	user 0.020s	sys 0.047s
I20260709 12:58:05.288872  1092 raft_consensus.cc:3060] T 9574c9ab5cd1491cbc8b01f3c89d4149 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:05.285151  1239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9574c9ab5cd1491cbc8b01f3c89d4149" candidate_uuid: "bbfb7e6be0904729bcda079b53965aef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c97e97cff3474b0fb542619cb94dcd8c"
I20260709 12:58:05.290409  1239 raft_consensus.cc:2393] T 9574c9ab5cd1491cbc8b01f3c89d4149 P c97e97cff3474b0fb542619cb94dcd8c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate bbfb7e6be0904729bcda079b53965aef in current term 1: Already voted for candidate c97e97cff3474b0fb542619cb94dcd8c in this term.
I20260709 12:58:05.282341  1326 leader_election.cc:290] T 614a5c8953cf490b85161067f062e80c P 1434bfe58c7247788e5d93c7d2bd8de1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbfb7e6be0904729bcda079b53965aef (127.0.107.194:45551), c97e97cff3474b0fb542619cb94dcd8c (127.0.107.195:43677)
I20260709 12:58:05.288352  1282 ts_tablet_manager.cc:1434] T 53866543b96a4b7c975007d75efde33e P c97e97cff3474b0fb542619cb94dcd8c: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.000s
I20260709 12:58:05.291306  1285 raft_consensus.cc:359] T bf5299056e9042429bd51aee9ccf6844 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } } peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } }
I20260709 12:58:05.291911  1282 tablet_bootstrap.cc:492] T 6eab0d4cbaa04172bc4320b9c3847715 P c97e97cff3474b0fb542619cb94dcd8c: Bootstrap starting.
I20260709 12:58:05.291992  1285 raft_consensus.cc:385] T bf5299056e9042429bd51aee9ccf6844 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:05.292093  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9574c9ab5cd1491cbc8b01f3c89d4149" candidate_uuid: "c97e97cff3474b0fb542619cb94dcd8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbfb7e6be0904729bcda079b53965aef"
I20260709 12:58:05.292565  1285 raft_consensus.cc:740] T bf5299056e9042429bd51aee9ccf6844 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1434bfe58c7247788e5d93c7d2bd8de1, State: Initialized, Role: FOLLOWER
I20260709 12:58:05.292994  1167 raft_consensus.cc:2393] T 9574c9ab5cd1491cbc8b01f3c89d4149 P bbfb7e6be0904729bcda079b53965aef [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c97e97cff3474b0fb542619cb94dcd8c in current term 1: Already voted for candidate bbfb7e6be0904729bcda079b53965aef in this term.
I20260709 12:58:05.294418  1302 leader_election.cc:290] T 9574c9ab5cd1491cbc8b01f3c89d4149 P c97e97cff3474b0fb542619cb94dcd8c [CANDIDATE]: Term 1 election: Requested vote from peers 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193:34795), bbfb7e6be0904729bcda079b53965aef (127.0.107.194:45551)
I20260709 12:58:05.293347  1285 consensus_queue.cc:260] T bf5299056e9042429bd51aee9ccf6844 P 1434bfe58c7247788e5d93c7d2bd8de1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } } peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } }
I20260709 12:58:05.296854  1285 ts_tablet_manager.cc:1434] T bf5299056e9042429bd51aee9ccf6844 P 1434bfe58c7247788e5d93c7d2bd8de1: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:58:05.297827  1285 tablet_bootstrap.cc:492] T 6eab0d4cbaa04172bc4320b9c3847715 P 1434bfe58c7247788e5d93c7d2bd8de1: Bootstrap starting.
I20260709 12:58:05.297705  1091 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9574c9ab5cd1491cbc8b01f3c89d4149" candidate_uuid: "c97e97cff3474b0fb542619cb94dcd8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1434bfe58c7247788e5d93c7d2bd8de1"
I20260709 12:58:05.298659  1282 tablet_bootstrap.cc:654] T 6eab0d4cbaa04172bc4320b9c3847715 P c97e97cff3474b0fb542619cb94dcd8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:05.301241  1207 leader_election.cc:304] T 9574c9ab5cd1491cbc8b01f3c89d4149 P c97e97cff3474b0fb542619cb94dcd8c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c97e97cff3474b0fb542619cb94dcd8c; no voters: 1434bfe58c7247788e5d93c7d2bd8de1, bbfb7e6be0904729bcda079b53965aef
I20260709 12:58:05.302295  1302 raft_consensus.cc:2749] T 9574c9ab5cd1491cbc8b01f3c89d4149 P c97e97cff3474b0fb542619cb94dcd8c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:58:05.303624   989 catalog_manager.cc:5697] T 6a0104eca382490a8ec51916203c8b59 P bbfb7e6be0904729bcda079b53965aef reported cstate change: term changed from 0 to 1, leader changed from <none> to bbfb7e6be0904729bcda079b53965aef (127.0.107.194). New cstate: current_term: 1 leader_uuid: "bbfb7e6be0904729bcda079b53965aef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:05.304576  1092 raft_consensus.cc:2468] T 9574c9ab5cd1491cbc8b01f3c89d4149 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbfb7e6be0904729bcda079b53965aef in term 1.
I20260709 12:58:05.305408  1285 tablet_bootstrap.cc:654] T 6eab0d4cbaa04172bc4320b9c3847715 P 1434bfe58c7247788e5d93c7d2bd8de1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:05.306499  1133 leader_election.cc:304] T 9574c9ab5cd1491cbc8b01f3c89d4149 P bbfb7e6be0904729bcda079b53965aef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1434bfe58c7247788e5d93c7d2bd8de1, bbfb7e6be0904729bcda079b53965aef; no voters: c97e97cff3474b0fb542619cb94dcd8c
I20260709 12:58:05.288143   988 catalog_manager.cc:5697] T 8edcf9960f41476794c70fe555756dbb P 1434bfe58c7247788e5d93c7d2bd8de1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:05.308188  1306 raft_consensus.cc:2804] T 9574c9ab5cd1491cbc8b01f3c89d4149 P bbfb7e6be0904729bcda079b53965aef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:05.309078  1306 raft_consensus.cc:697] T 9574c9ab5cd1491cbc8b01f3c89d4149 P bbfb7e6be0904729bcda079b53965aef [term 1 LEADER]: Becoming Leader. State: Replica: bbfb7e6be0904729bcda079b53965aef, State: Running, Role: LEADER
I20260709 12:58:05.310261  1306 consensus_queue.cc:237] T 9574c9ab5cd1491cbc8b01f3c89d4149 P bbfb7e6be0904729bcda079b53965aef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.332051  1287 raft_consensus.cc:493] T 53866543b96a4b7c975007d75efde33e P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:05.332612  1287 raft_consensus.cc:515] T 53866543b96a4b7c975007d75efde33e P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.334755  1287 leader_election.cc:290] T 53866543b96a4b7c975007d75efde33e P bbfb7e6be0904729bcda079b53965aef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193:34795), c97e97cff3474b0fb542619cb94dcd8c (127.0.107.195:43677)
I20260709 12:58:05.337136  1092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53866543b96a4b7c975007d75efde33e" candidate_uuid: "bbfb7e6be0904729bcda079b53965aef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" is_pre_election: true
I20260709 12:58:05.339857  1239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53866543b96a4b7c975007d75efde33e" candidate_uuid: "bbfb7e6be0904729bcda079b53965aef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c97e97cff3474b0fb542619cb94dcd8c" is_pre_election: true
W20260709 12:58:05.342293  1133 leader_election.cc:343] T 53866543b96a4b7c975007d75efde33e P bbfb7e6be0904729bcda079b53965aef [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193:34795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:05.340821  1239 raft_consensus.cc:2468] T 53866543b96a4b7c975007d75efde33e P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bbfb7e6be0904729bcda079b53965aef in term 0.
I20260709 12:58:05.345393  1132 leader_election.cc:304] T 53866543b96a4b7c975007d75efde33e P bbfb7e6be0904729bcda079b53965aef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bbfb7e6be0904729bcda079b53965aef, c97e97cff3474b0fb542619cb94dcd8c; no voters: 1434bfe58c7247788e5d93c7d2bd8de1
I20260709 12:58:05.346576  1287 raft_consensus.cc:2804] T 53866543b96a4b7c975007d75efde33e P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:05.346972  1287 raft_consensus.cc:493] T 53866543b96a4b7c975007d75efde33e P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:05.347332  1287 raft_consensus.cc:3060] T 53866543b96a4b7c975007d75efde33e P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:05.354290  1287 raft_consensus.cc:515] T 53866543b96a4b7c975007d75efde33e P bbfb7e6be0904729bcda079b53965aef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.336541  1240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "614a5c8953cf490b85161067f062e80c" candidate_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c97e97cff3474b0fb542619cb94dcd8c" is_pre_election: true
I20260709 12:58:05.357367  1092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53866543b96a4b7c975007d75efde33e" candidate_uuid: "bbfb7e6be0904729bcda079b53965aef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1434bfe58c7247788e5d93c7d2bd8de1"
I20260709 12:58:05.357730  1287 leader_election.cc:290] T 53866543b96a4b7c975007d75efde33e P bbfb7e6be0904729bcda079b53965aef [CANDIDATE]: Term 1 election: Requested vote from peers 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193:34795), c97e97cff3474b0fb542619cb94dcd8c (127.0.107.195:43677)
I20260709 12:58:05.358875  1057 leader_election.cc:304] T 614a5c8953cf490b85161067f062e80c P 1434bfe58c7247788e5d93c7d2bd8de1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1434bfe58c7247788e5d93c7d2bd8de1; no voters: bbfb7e6be0904729bcda079b53965aef, c97e97cff3474b0fb542619cb94dcd8c
I20260709 12:58:05.359982  1326 raft_consensus.cc:3060] T 614a5c8953cf490b85161067f062e80c P 1434bfe58c7247788e5d93c7d2bd8de1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:05.360937  1239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53866543b96a4b7c975007d75efde33e" candidate_uuid: "bbfb7e6be0904729bcda079b53965aef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c97e97cff3474b0fb542619cb94dcd8c"
I20260709 12:58:05.361784  1239 raft_consensus.cc:3060] T 53866543b96a4b7c975007d75efde33e P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:05.366219  1133 leader_election.cc:343] T 53866543b96a4b7c975007d75efde33e P bbfb7e6be0904729bcda079b53965aef [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193:34795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:05.373888  1326 raft_consensus.cc:2749] T 614a5c8953cf490b85161067f062e80c P 1434bfe58c7247788e5d93c7d2bd8de1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:05.376410  1239 raft_consensus.cc:2468] T 53866543b96a4b7c975007d75efde33e P c97e97cff3474b0fb542619cb94dcd8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbfb7e6be0904729bcda079b53965aef in term 1.
I20260709 12:58:05.379992  1132 leader_election.cc:304] T 53866543b96a4b7c975007d75efde33e P bbfb7e6be0904729bcda079b53965aef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bbfb7e6be0904729bcda079b53965aef, c97e97cff3474b0fb542619cb94dcd8c; no voters: 1434bfe58c7247788e5d93c7d2bd8de1
I20260709 12:58:05.381268  1306 raft_consensus.cc:2804] T 53866543b96a4b7c975007d75efde33e P bbfb7e6be0904729bcda079b53965aef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:05.381651  1282 tablet_bootstrap.cc:492] T 6eab0d4cbaa04172bc4320b9c3847715 P c97e97cff3474b0fb542619cb94dcd8c: No bootstrap required, opened a new log
I20260709 12:58:05.381832  1306 raft_consensus.cc:697] T 53866543b96a4b7c975007d75efde33e P bbfb7e6be0904729bcda079b53965aef [term 1 LEADER]: Becoming Leader. State: Replica: bbfb7e6be0904729bcda079b53965aef, State: Running, Role: LEADER
I20260709 12:58:05.382140  1282 ts_tablet_manager.cc:1403] T 6eab0d4cbaa04172bc4320b9c3847715 P c97e97cff3474b0fb542619cb94dcd8c: Time spent bootstrapping tablet: real 0.090s	user 0.033s	sys 0.054s
I20260709 12:58:05.381651  1285 tablet_bootstrap.cc:492] T 6eab0d4cbaa04172bc4320b9c3847715 P 1434bfe58c7247788e5d93c7d2bd8de1: No bootstrap required, opened a new log
I20260709 12:58:05.382966  1285 ts_tablet_manager.cc:1403] T 6eab0d4cbaa04172bc4320b9c3847715 P 1434bfe58c7247788e5d93c7d2bd8de1: Time spent bootstrapping tablet: real 0.085s	user 0.041s	sys 0.025s
I20260709 12:58:05.382812  1306 consensus_queue.cc:237] T 53866543b96a4b7c975007d75efde33e P bbfb7e6be0904729bcda079b53965aef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.384917  1282 raft_consensus.cc:359] T 6eab0d4cbaa04172bc4320b9c3847715 P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.385705  1285 raft_consensus.cc:359] T 6eab0d4cbaa04172bc4320b9c3847715 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.386168  1282 raft_consensus.cc:385] T 6eab0d4cbaa04172bc4320b9c3847715 P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:05.386500  1285 raft_consensus.cc:385] T 6eab0d4cbaa04172bc4320b9c3847715 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:05.385810   990 catalog_manager.cc:5697] T 9574c9ab5cd1491cbc8b01f3c89d4149 P bbfb7e6be0904729bcda079b53965aef reported cstate change: term changed from 0 to 1, leader changed from <none> to bbfb7e6be0904729bcda079b53965aef (127.0.107.194). New cstate: current_term: 1 leader_uuid: "bbfb7e6be0904729bcda079b53965aef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:05.386572  1282 raft_consensus.cc:740] T 6eab0d4cbaa04172bc4320b9c3847715 P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c97e97cff3474b0fb542619cb94dcd8c, State: Initialized, Role: FOLLOWER
I20260709 12:58:05.386919  1285 raft_consensus.cc:740] T 6eab0d4cbaa04172bc4320b9c3847715 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1434bfe58c7247788e5d93c7d2bd8de1, State: Initialized, Role: FOLLOWER
I20260709 12:58:05.387466  1282 consensus_queue.cc:260] T 6eab0d4cbaa04172bc4320b9c3847715 P c97e97cff3474b0fb542619cb94dcd8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.387784  1285 consensus_queue.cc:260] T 6eab0d4cbaa04172bc4320b9c3847715 P 1434bfe58c7247788e5d93c7d2bd8de1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.392514  1282 ts_tablet_manager.cc:1434] T 6eab0d4cbaa04172bc4320b9c3847715 P c97e97cff3474b0fb542619cb94dcd8c: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.002s
I20260709 12:58:05.392743  1285 ts_tablet_manager.cc:1434] T 6eab0d4cbaa04172bc4320b9c3847715 P 1434bfe58c7247788e5d93c7d2bd8de1: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260709 12:58:05.393455  1282 tablet_bootstrap.cc:492] T cf73b42e520b432098cf08c6c32141ba P c97e97cff3474b0fb542619cb94dcd8c: Bootstrap starting.
I20260709 12:58:05.393741  1285 tablet_bootstrap.cc:492] T 53866543b96a4b7c975007d75efde33e P 1434bfe58c7247788e5d93c7d2bd8de1: Bootstrap starting.
I20260709 12:58:05.398437  1282 tablet_bootstrap.cc:654] T cf73b42e520b432098cf08c6c32141ba P c97e97cff3474b0fb542619cb94dcd8c: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:05.400584  1285 tablet_bootstrap.cc:654] T 53866543b96a4b7c975007d75efde33e P 1434bfe58c7247788e5d93c7d2bd8de1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:05.402639  1282 tablet_bootstrap.cc:492] T cf73b42e520b432098cf08c6c32141ba P c97e97cff3474b0fb542619cb94dcd8c: No bootstrap required, opened a new log
I20260709 12:58:05.403162  1282 ts_tablet_manager.cc:1403] T cf73b42e520b432098cf08c6c32141ba P c97e97cff3474b0fb542619cb94dcd8c: Time spent bootstrapping tablet: real 0.010s	user 0.006s	sys 0.003s
I20260709 12:58:05.412983  1282 raft_consensus.cc:359] T cf73b42e520b432098cf08c6c32141ba P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.414184  1282 raft_consensus.cc:385] T cf73b42e520b432098cf08c6c32141ba P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:05.414613  1282 raft_consensus.cc:740] T cf73b42e520b432098cf08c6c32141ba P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c97e97cff3474b0fb542619cb94dcd8c, State: Initialized, Role: FOLLOWER
I20260709 12:58:05.415606  1282 consensus_queue.cc:260] T cf73b42e520b432098cf08c6c32141ba P c97e97cff3474b0fb542619cb94dcd8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.418278  1285 tablet_bootstrap.cc:492] T 53866543b96a4b7c975007d75efde33e P 1434bfe58c7247788e5d93c7d2bd8de1: No bootstrap required, opened a new log
I20260709 12:58:05.418748  1285 ts_tablet_manager.cc:1403] T 53866543b96a4b7c975007d75efde33e P 1434bfe58c7247788e5d93c7d2bd8de1: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.008s
I20260709 12:58:05.421561  1285 raft_consensus.cc:359] T 53866543b96a4b7c975007d75efde33e P 1434bfe58c7247788e5d93c7d2bd8de1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.421559  1306 consensus_queue.cc:1048] T 38eeded1fce24dec92c5aa10aa9ac846 P bbfb7e6be0904729bcda079b53965aef [LEADER]: Connected to new peer: Peer: permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:05.422370  1285 raft_consensus.cc:385] T 53866543b96a4b7c975007d75efde33e P 1434bfe58c7247788e5d93c7d2bd8de1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:05.422693  1285 raft_consensus.cc:740] T 53866543b96a4b7c975007d75efde33e P 1434bfe58c7247788e5d93c7d2bd8de1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1434bfe58c7247788e5d93c7d2bd8de1, State: Initialized, Role: FOLLOWER
I20260709 12:58:05.422819  1282 ts_tablet_manager.cc:1434] T cf73b42e520b432098cf08c6c32141ba P c97e97cff3474b0fb542619cb94dcd8c: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.004s
I20260709 12:58:05.423343  1285 consensus_queue.cc:260] T 53866543b96a4b7c975007d75efde33e P 1434bfe58c7247788e5d93c7d2bd8de1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.425326  1285 ts_tablet_manager.cc:1434] T 53866543b96a4b7c975007d75efde33e P 1434bfe58c7247788e5d93c7d2bd8de1: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:58:05.425951  1319 consensus_queue.cc:1048] T bf5299056e9042429bd51aee9ccf6844 P c97e97cff3474b0fb542619cb94dcd8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:05.427181   989 catalog_manager.cc:5697] T 53866543b96a4b7c975007d75efde33e P bbfb7e6be0904729bcda079b53965aef reported cstate change: term changed from 0 to 1, leader changed from <none> to bbfb7e6be0904729bcda079b53965aef (127.0.107.194). New cstate: current_term: 1 leader_uuid: "bbfb7e6be0904729bcda079b53965aef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:05.429320  1326 raft_consensus.cc:493] T bf5299056e9042429bd51aee9ccf6844 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:05.429816  1326 raft_consensus.cc:515] T bf5299056e9042429bd51aee9ccf6844 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } } peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } }
I20260709 12:58:05.428261  1285 tablet_bootstrap.cc:492] T cf73b42e520b432098cf08c6c32141ba P 1434bfe58c7247788e5d93c7d2bd8de1: Bootstrap starting.
I20260709 12:58:05.431895  1326 leader_election.cc:290] T bf5299056e9042429bd51aee9ccf6844 P 1434bfe58c7247788e5d93c7d2bd8de1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c97e97cff3474b0fb542619cb94dcd8c (127.0.107.195:43677), bbfb7e6be0904729bcda079b53965aef (127.0.107.194:45551)
I20260709 12:58:05.433514  1240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5299056e9042429bd51aee9ccf6844" candidate_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c97e97cff3474b0fb542619cb94dcd8c" is_pre_election: true
I20260709 12:58:05.435320  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5299056e9042429bd51aee9ccf6844" candidate_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbfb7e6be0904729bcda079b53965aef" is_pre_election: true
I20260709 12:58:05.437676  1055 leader_election.cc:304] T bf5299056e9042429bd51aee9ccf6844 P 1434bfe58c7247788e5d93c7d2bd8de1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1434bfe58c7247788e5d93c7d2bd8de1; no voters: bbfb7e6be0904729bcda079b53965aef, c97e97cff3474b0fb542619cb94dcd8c
I20260709 12:58:05.438478  1285 tablet_bootstrap.cc:654] T cf73b42e520b432098cf08c6c32141ba P 1434bfe58c7247788e5d93c7d2bd8de1: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:05.438860  1302 raft_consensus.cc:493] T cf73b42e520b432098cf08c6c32141ba P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:05.439390  1302 raft_consensus.cc:515] T cf73b42e520b432098cf08c6c32141ba P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.442730  1092 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf73b42e520b432098cf08c6c32141ba" candidate_uuid: "c97e97cff3474b0fb542619cb94dcd8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" is_pre_election: true
W20260709 12:58:05.444082  1207 leader_election.cc:343] T cf73b42e520b432098cf08c6c32141ba P c97e97cff3474b0fb542619cb94dcd8c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193:34795): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:05.444947  1302 leader_election.cc:290] T cf73b42e520b432098cf08c6c32141ba P c97e97cff3474b0fb542619cb94dcd8c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193:34795), bbfb7e6be0904729bcda079b53965aef (127.0.107.194:45551)
I20260709 12:58:05.445456  1326 raft_consensus.cc:2749] T bf5299056e9042429bd51aee9ccf6844 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:05.448900  1306 consensus_queue.cc:1048] T 36813a3559ff43a893c148b091a60090 P bbfb7e6be0904729bcda079b53965aef [LEADER]: Connected to new peer: Peer: permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:05.454891  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf73b42e520b432098cf08c6c32141ba" candidate_uuid: "c97e97cff3474b0fb542619cb94dcd8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbfb7e6be0904729bcda079b53965aef" is_pre_election: true
I20260709 12:58:05.455502  1166 raft_consensus.cc:2468] T cf73b42e520b432098cf08c6c32141ba P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c97e97cff3474b0fb542619cb94dcd8c in term 0.
I20260709 12:58:05.457442  1204 leader_election.cc:304] T cf73b42e520b432098cf08c6c32141ba P c97e97cff3474b0fb542619cb94dcd8c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bbfb7e6be0904729bcda079b53965aef, c97e97cff3474b0fb542619cb94dcd8c; no voters: 1434bfe58c7247788e5d93c7d2bd8de1
I20260709 12:58:05.460654  1285 tablet_bootstrap.cc:492] T cf73b42e520b432098cf08c6c32141ba P 1434bfe58c7247788e5d93c7d2bd8de1: No bootstrap required, opened a new log
I20260709 12:58:05.461766  1292 raft_consensus.cc:493] T 53866543b96a4b7c975007d75efde33e P 1434bfe58c7247788e5d93c7d2bd8de1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:05.461998  1285 ts_tablet_manager.cc:1403] T cf73b42e520b432098cf08c6c32141ba P 1434bfe58c7247788e5d93c7d2bd8de1: Time spent bootstrapping tablet: real 0.034s	user 0.020s	sys 0.008s
I20260709 12:58:05.462356  1302 raft_consensus.cc:2804] T cf73b42e520b432098cf08c6c32141ba P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:05.462284  1292 raft_consensus.cc:515] T 53866543b96a4b7c975007d75efde33e P 1434bfe58c7247788e5d93c7d2bd8de1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.462759  1302 raft_consensus.cc:493] T cf73b42e520b432098cf08c6c32141ba P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:05.463112  1302 raft_consensus.cc:3060] T cf73b42e520b432098cf08c6c32141ba P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:05.464496  1292 leader_election.cc:290] T 53866543b96a4b7c975007d75efde33e P 1434bfe58c7247788e5d93c7d2bd8de1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbfb7e6be0904729bcda079b53965aef (127.0.107.194:45551), c97e97cff3474b0fb542619cb94dcd8c (127.0.107.195:43677)
I20260709 12:58:05.476766  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53866543b96a4b7c975007d75efde33e" candidate_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbfb7e6be0904729bcda079b53965aef" is_pre_election: true
I20260709 12:58:05.477244  1287 consensus_queue.cc:1048] T 38eeded1fce24dec92c5aa10aa9ac846 P bbfb7e6be0904729bcda079b53965aef [LEADER]: Connected to new peer: Peer: permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:05.472610  1091 raft_consensus.cc:3060] T bf5299056e9042429bd51aee9ccf6844 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:05.474709  1240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53866543b96a4b7c975007d75efde33e" candidate_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c97e97cff3474b0fb542619cb94dcd8c" is_pre_election: true
I20260709 12:58:05.489127  1240 raft_consensus.cc:2393] T 53866543b96a4b7c975007d75efde33e P c97e97cff3474b0fb542619cb94dcd8c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1434bfe58c7247788e5d93c7d2bd8de1 in current term 1: Already voted for candidate bbfb7e6be0904729bcda079b53965aef in this term.
I20260709 12:58:05.490254  1057 leader_election.cc:304] T 53866543b96a4b7c975007d75efde33e P 1434bfe58c7247788e5d93c7d2bd8de1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1434bfe58c7247788e5d93c7d2bd8de1; no voters: bbfb7e6be0904729bcda079b53965aef, c97e97cff3474b0fb542619cb94dcd8c
I20260709 12:58:05.464908  1285 raft_consensus.cc:359] T cf73b42e520b432098cf08c6c32141ba P 1434bfe58c7247788e5d93c7d2bd8de1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.491997  1285 raft_consensus.cc:385] T cf73b42e520b432098cf08c6c32141ba P 1434bfe58c7247788e5d93c7d2bd8de1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:05.492285  1285 raft_consensus.cc:740] T cf73b42e520b432098cf08c6c32141ba P 1434bfe58c7247788e5d93c7d2bd8de1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1434bfe58c7247788e5d93c7d2bd8de1, State: Initialized, Role: FOLLOWER
I20260709 12:58:05.492650  1326 raft_consensus.cc:3060] T 53866543b96a4b7c975007d75efde33e P 1434bfe58c7247788e5d93c7d2bd8de1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:05.492973  1285 consensus_queue.cc:260] T cf73b42e520b432098cf08c6c32141ba P 1434bfe58c7247788e5d93c7d2bd8de1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.470059  1302 raft_consensus.cc:515] T cf73b42e520b432098cf08c6c32141ba P c97e97cff3474b0fb542619cb94dcd8c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.496033  1285 ts_tablet_manager.cc:1434] T cf73b42e520b432098cf08c6c32141ba P 1434bfe58c7247788e5d93c7d2bd8de1: Time spent starting tablet: real 0.034s	user 0.004s	sys 0.003s
I20260709 12:58:05.500777  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf73b42e520b432098cf08c6c32141ba" candidate_uuid: "c97e97cff3474b0fb542619cb94dcd8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbfb7e6be0904729bcda079b53965aef"
I20260709 12:58:05.497687  1302 leader_election.cc:290] T cf73b42e520b432098cf08c6c32141ba P c97e97cff3474b0fb542619cb94dcd8c [CANDIDATE]: Term 1 election: Requested vote from peers 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193:34795), bbfb7e6be0904729bcda079b53965aef (127.0.107.194:45551)
I20260709 12:58:05.499878  1284 consensus_queue.cc:1048] T bf5299056e9042429bd51aee9ccf6844 P c97e97cff3474b0fb542619cb94dcd8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:05.501571  1166 raft_consensus.cc:3060] T cf73b42e520b432098cf08c6c32141ba P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:05.500850  1089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf73b42e520b432098cf08c6c32141ba" candidate_uuid: "c97e97cff3474b0fb542619cb94dcd8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1434bfe58c7247788e5d93c7d2bd8de1"
I20260709 12:58:05.502513  1089 raft_consensus.cc:3060] T cf73b42e520b432098cf08c6c32141ba P 1434bfe58c7247788e5d93c7d2bd8de1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:05.498631  1287 consensus_queue.cc:1048] T 36813a3559ff43a893c148b091a60090 P bbfb7e6be0904729bcda079b53965aef [LEADER]: Connected to new peer: Peer: permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:05.508349  1326 raft_consensus.cc:2749] T 53866543b96a4b7c975007d75efde33e P 1434bfe58c7247788e5d93c7d2bd8de1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:05.511255  1089 raft_consensus.cc:2468] T cf73b42e520b432098cf08c6c32141ba P 1434bfe58c7247788e5d93c7d2bd8de1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c97e97cff3474b0fb542619cb94dcd8c in term 1.
I20260709 12:58:05.515280  1207 leader_election.cc:304] T cf73b42e520b432098cf08c6c32141ba P c97e97cff3474b0fb542619cb94dcd8c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1434bfe58c7247788e5d93c7d2bd8de1, c97e97cff3474b0fb542619cb94dcd8c; no voters: 
I20260709 12:58:05.516047  1302 raft_consensus.cc:2804] T cf73b42e520b432098cf08c6c32141ba P c97e97cff3474b0fb542619cb94dcd8c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:05.516760  1302 raft_consensus.cc:697] T cf73b42e520b432098cf08c6c32141ba P c97e97cff3474b0fb542619cb94dcd8c [term 1 LEADER]: Becoming Leader. State: Replica: c97e97cff3474b0fb542619cb94dcd8c, State: Running, Role: LEADER
I20260709 12:58:05.517625  1302 consensus_queue.cc:237] T cf73b42e520b432098cf08c6c32141ba P c97e97cff3474b0fb542619cb94dcd8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.523602  1166 raft_consensus.cc:2468] T cf73b42e520b432098cf08c6c32141ba P bbfb7e6be0904729bcda079b53965aef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c97e97cff3474b0fb542619cb94dcd8c in term 1.
I20260709 12:58:05.545862   989 catalog_manager.cc:5697] T cf73b42e520b432098cf08c6c32141ba P c97e97cff3474b0fb542619cb94dcd8c reported cstate change: term changed from 0 to 1, leader changed from <none> to c97e97cff3474b0fb542619cb94dcd8c (127.0.107.195). New cstate: current_term: 1 leader_uuid: "c97e97cff3474b0fb542619cb94dcd8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:05.556847  1326 raft_consensus.cc:493] T 6eab0d4cbaa04172bc4320b9c3847715 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:05.557381  1326 raft_consensus.cc:515] T 6eab0d4cbaa04172bc4320b9c3847715 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.559379  1326 leader_election.cc:290] T 6eab0d4cbaa04172bc4320b9c3847715 P 1434bfe58c7247788e5d93c7d2bd8de1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bbfb7e6be0904729bcda079b53965aef (127.0.107.194:45551), c97e97cff3474b0fb542619cb94dcd8c (127.0.107.195:43677)
I20260709 12:58:05.560187  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eab0d4cbaa04172bc4320b9c3847715" candidate_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbfb7e6be0904729bcda079b53965aef" is_pre_election: true
I20260709 12:58:05.560530  1239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eab0d4cbaa04172bc4320b9c3847715" candidate_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c97e97cff3474b0fb542619cb94dcd8c" is_pre_election: true
I20260709 12:58:05.560865  1166 raft_consensus.cc:2468] T 6eab0d4cbaa04172bc4320b9c3847715 P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1434bfe58c7247788e5d93c7d2bd8de1 in term 0.
I20260709 12:58:05.561193  1239 raft_consensus.cc:2468] T 6eab0d4cbaa04172bc4320b9c3847715 P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1434bfe58c7247788e5d93c7d2bd8de1 in term 0.
I20260709 12:58:05.561892  1055 leader_election.cc:304] T 6eab0d4cbaa04172bc4320b9c3847715 P 1434bfe58c7247788e5d93c7d2bd8de1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1434bfe58c7247788e5d93c7d2bd8de1, bbfb7e6be0904729bcda079b53965aef; no voters: 
I20260709 12:58:05.562759  1326 raft_consensus.cc:2804] T 6eab0d4cbaa04172bc4320b9c3847715 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:05.563119  1326 raft_consensus.cc:493] T 6eab0d4cbaa04172bc4320b9c3847715 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:05.563452  1326 raft_consensus.cc:3060] T 6eab0d4cbaa04172bc4320b9c3847715 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:05.568701  1326 raft_consensus.cc:515] T 6eab0d4cbaa04172bc4320b9c3847715 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.570185  1326 leader_election.cc:290] T 6eab0d4cbaa04172bc4320b9c3847715 P 1434bfe58c7247788e5d93c7d2bd8de1 [CANDIDATE]: Term 1 election: Requested vote from peers bbfb7e6be0904729bcda079b53965aef (127.0.107.194:45551), c97e97cff3474b0fb542619cb94dcd8c (127.0.107.195:43677)
I20260709 12:58:05.570915  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eab0d4cbaa04172bc4320b9c3847715" candidate_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bbfb7e6be0904729bcda079b53965aef"
I20260709 12:58:05.571098  1239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eab0d4cbaa04172bc4320b9c3847715" candidate_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c97e97cff3474b0fb542619cb94dcd8c"
I20260709 12:58:05.571473  1166 raft_consensus.cc:3060] T 6eab0d4cbaa04172bc4320b9c3847715 P bbfb7e6be0904729bcda079b53965aef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:05.571594  1239 raft_consensus.cc:3060] T 6eab0d4cbaa04172bc4320b9c3847715 P c97e97cff3474b0fb542619cb94dcd8c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:05.577916  1239 raft_consensus.cc:2468] T 6eab0d4cbaa04172bc4320b9c3847715 P c97e97cff3474b0fb542619cb94dcd8c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1434bfe58c7247788e5d93c7d2bd8de1 in term 1.
I20260709 12:58:05.577913  1166 raft_consensus.cc:2468] T 6eab0d4cbaa04172bc4320b9c3847715 P bbfb7e6be0904729bcda079b53965aef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1434bfe58c7247788e5d93c7d2bd8de1 in term 1.
I20260709 12:58:05.579190  1057 leader_election.cc:304] T 6eab0d4cbaa04172bc4320b9c3847715 P 1434bfe58c7247788e5d93c7d2bd8de1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1434bfe58c7247788e5d93c7d2bd8de1, c97e97cff3474b0fb542619cb94dcd8c; no voters: 
I20260709 12:58:05.579824  1326 raft_consensus.cc:2804] T 6eab0d4cbaa04172bc4320b9c3847715 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:05.580231  1326 raft_consensus.cc:697] T 6eab0d4cbaa04172bc4320b9c3847715 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 1 LEADER]: Becoming Leader. State: Replica: 1434bfe58c7247788e5d93c7d2bd8de1, State: Running, Role: LEADER
I20260709 12:58:05.580901  1326 consensus_queue.cc:237] T 6eab0d4cbaa04172bc4320b9c3847715 P 1434bfe58c7247788e5d93c7d2bd8de1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.587786   988 catalog_manager.cc:5697] T 6eab0d4cbaa04172bc4320b9c3847715 P 1434bfe58c7247788e5d93c7d2bd8de1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:05.614809  1239 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf5299056e9042429bd51aee9ccf6844"
dest_uuid: "c97e97cff3474b0fb542619cb94dcd8c"
mode: GRACEFUL
new_leader_uuid: "1434bfe58c7247788e5d93c7d2bd8de1"
 from {username='slave'} at 127.0.0.1:52916
I20260709 12:58:05.615270  1239 raft_consensus.cc:606] T bf5299056e9042429bd51aee9ccf6844 P c97e97cff3474b0fb542619cb94dcd8c [term 1 LEADER]: Received request to transfer leadership to TS 1434bfe58c7247788e5d93c7d2bd8de1
I20260709 12:58:05.628312  1166 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9574c9ab5cd1491cbc8b01f3c89d4149"
dest_uuid: "bbfb7e6be0904729bcda079b53965aef"
mode: GRACEFUL
new_leader_uuid: "1434bfe58c7247788e5d93c7d2bd8de1"
 from {username='slave'} at 127.0.0.1:53022
I20260709 12:58:05.628935  1166 raft_consensus.cc:606] T 9574c9ab5cd1491cbc8b01f3c89d4149 P bbfb7e6be0904729bcda079b53965aef [term 1 LEADER]: Received request to transfer leadership to TS 1434bfe58c7247788e5d93c7d2bd8de1
I20260709 12:58:05.630200  1326 consensus_queue.cc:1048] T 8edcf9960f41476794c70fe555756dbb P 1434bfe58c7247788e5d93c7d2bd8de1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:05.635392  1240 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "614a5c8953cf490b85161067f062e80c"
dest_uuid: "c97e97cff3474b0fb542619cb94dcd8c"
mode: GRACEFUL
new_leader_uuid: "1434bfe58c7247788e5d93c7d2bd8de1"
 from {username='slave'} at 127.0.0.1:52916
I20260709 12:58:05.636027  1240 raft_consensus.cc:606] T 614a5c8953cf490b85161067f062e80c P c97e97cff3474b0fb542619cb94dcd8c [term 1 LEADER]: Received request to transfer leadership to TS 1434bfe58c7247788e5d93c7d2bd8de1
I20260709 12:58:05.641069  1326 consensus_queue.cc:1048] T 8edcf9960f41476794c70fe555756dbb P 1434bfe58c7247788e5d93c7d2bd8de1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:05.641479  1166 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "36813a3559ff43a893c148b091a60090"
dest_uuid: "bbfb7e6be0904729bcda079b53965aef"
mode: GRACEFUL
new_leader_uuid: "1434bfe58c7247788e5d93c7d2bd8de1"
 from {username='slave'} at 127.0.0.1:53022
I20260709 12:58:05.641971  1166 raft_consensus.cc:606] T 36813a3559ff43a893c148b091a60090 P bbfb7e6be0904729bcda079b53965aef [term 1 LEADER]: Received request to transfer leadership to TS 1434bfe58c7247788e5d93c7d2bd8de1
I20260709 12:58:05.648123  1302 consensus_queue.cc:1048] T 614a5c8953cf490b85161067f062e80c P c97e97cff3474b0fb542619cb94dcd8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:05.648612  1167 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38eeded1fce24dec92c5aa10aa9ac846"
dest_uuid: "bbfb7e6be0904729bcda079b53965aef"
mode: GRACEFUL
new_leader_uuid: "1434bfe58c7247788e5d93c7d2bd8de1"
 from {username='slave'} at 127.0.0.1:53022
I20260709 12:58:05.649207  1167 raft_consensus.cc:606] T 38eeded1fce24dec92c5aa10aa9ac846 P bbfb7e6be0904729bcda079b53965aef [term 1 LEADER]: Received request to transfer leadership to TS 1434bfe58c7247788e5d93c7d2bd8de1
I20260709 12:58:05.664422  1302 raft_consensus.cc:993] T 614a5c8953cf490b85161067f062e80c P c97e97cff3474b0fb542619cb94dcd8c: : Instructing follower 1434bfe58c7247788e5d93c7d2bd8de1 to start an election
I20260709 12:58:05.664978  1302 raft_consensus.cc:1081] T 614a5c8953cf490b85161067f062e80c P c97e97cff3474b0fb542619cb94dcd8c [term 1 LEADER]: Signalling peer 1434bfe58c7247788e5d93c7d2bd8de1 to start an election
I20260709 12:58:05.667443  1090 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "614a5c8953cf490b85161067f062e80c"
dest_uuid: "1434bfe58c7247788e5d93c7d2bd8de1"
 from {username='slave'} at 127.0.0.1:36944
I20260709 12:58:05.668790  1090 raft_consensus.cc:493] T 614a5c8953cf490b85161067f062e80c P 1434bfe58c7247788e5d93c7d2bd8de1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:05.669202  1090 raft_consensus.cc:3060] T 614a5c8953cf490b85161067f062e80c P 1434bfe58c7247788e5d93c7d2bd8de1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:05.670645  1284 consensus_queue.cc:1048] T 614a5c8953cf490b85161067f062e80c P c97e97cff3474b0fb542619cb94dcd8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:05.676560  1089 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8edcf9960f41476794c70fe555756dbb"
dest_uuid: "1434bfe58c7247788e5d93c7d2bd8de1"
mode: GRACEFUL
new_leader_uuid: "bbfb7e6be0904729bcda079b53965aef"
 from {username='slave'} at 127.0.0.1:36950
I20260709 12:58:05.676558  1090 raft_consensus.cc:515] T 614a5c8953cf490b85161067f062e80c P 1434bfe58c7247788e5d93c7d2bd8de1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.677289  1089 raft_consensus.cc:606] T 8edcf9960f41476794c70fe555756dbb P 1434bfe58c7247788e5d93c7d2bd8de1 [term 1 LEADER]: Received request to transfer leadership to TS bbfb7e6be0904729bcda079b53965aef
I20260709 12:58:05.680260  1090 leader_election.cc:290] T 614a5c8953cf490b85161067f062e80c P 1434bfe58c7247788e5d93c7d2bd8de1 [CANDIDATE]: Term 2 election: Requested vote from peers bbfb7e6be0904729bcda079b53965aef (127.0.107.194:45551), c97e97cff3474b0fb542619cb94dcd8c (127.0.107.195:43677)
I20260709 12:58:05.680435  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "614a5c8953cf490b85161067f062e80c" candidate_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bbfb7e6be0904729bcda079b53965aef"
I20260709 12:58:05.681355  1240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "614a5c8953cf490b85161067f062e80c" candidate_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c97e97cff3474b0fb542619cb94dcd8c"
I20260709 12:58:05.681901  1240 raft_consensus.cc:3055] T 614a5c8953cf490b85161067f062e80c P c97e97cff3474b0fb542619cb94dcd8c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:05.682263  1240 raft_consensus.cc:740] T 614a5c8953cf490b85161067f062e80c P c97e97cff3474b0fb542619cb94dcd8c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c97e97cff3474b0fb542619cb94dcd8c, State: Running, Role: LEADER
I20260709 12:58:05.683117  1240 consensus_queue.cc:260] T 614a5c8953cf490b85161067f062e80c P c97e97cff3474b0fb542619cb94dcd8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.684021  1240 raft_consensus.cc:3060] T 614a5c8953cf490b85161067f062e80c P c97e97cff3474b0fb542619cb94dcd8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:05.691799  1240 raft_consensus.cc:2468] T 614a5c8953cf490b85161067f062e80c P c97e97cff3474b0fb542619cb94dcd8c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1434bfe58c7247788e5d93c7d2bd8de1 in term 2.
I20260709 12:58:05.693701  1057 leader_election.cc:304] T 614a5c8953cf490b85161067f062e80c P 1434bfe58c7247788e5d93c7d2bd8de1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1434bfe58c7247788e5d93c7d2bd8de1, c97e97cff3474b0fb542619cb94dcd8c; no voters: bbfb7e6be0904729bcda079b53965aef
I20260709 12:58:05.695029  1354 raft_consensus.cc:2804] T 614a5c8953cf490b85161067f062e80c P 1434bfe58c7247788e5d93c7d2bd8de1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:05.695500  1354 raft_consensus.cc:697] T 614a5c8953cf490b85161067f062e80c P 1434bfe58c7247788e5d93c7d2bd8de1 [term 2 LEADER]: Becoming Leader. State: Replica: 1434bfe58c7247788e5d93c7d2bd8de1, State: Running, Role: LEADER
I20260709 12:58:05.696271  1354 consensus_queue.cc:237] T 614a5c8953cf490b85161067f062e80c P 1434bfe58c7247788e5d93c7d2bd8de1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.697156  1090 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6eab0d4cbaa04172bc4320b9c3847715"
dest_uuid: "1434bfe58c7247788e5d93c7d2bd8de1"
mode: GRACEFUL
new_leader_uuid: "bbfb7e6be0904729bcda079b53965aef"
 from {username='slave'} at 127.0.0.1:36950
I20260709 12:58:05.697710  1090 raft_consensus.cc:606] T 6eab0d4cbaa04172bc4320b9c3847715 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 1 LEADER]: Received request to transfer leadership to TS bbfb7e6be0904729bcda079b53965aef
I20260709 12:58:05.703758   988 catalog_manager.cc:5697] T 614a5c8953cf490b85161067f062e80c P 1434bfe58c7247788e5d93c7d2bd8de1 reported cstate change: term changed from 1 to 2, leader changed from c97e97cff3474b0fb542619cb94dcd8c (127.0.107.195) to 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:05.704905  1287 consensus_queue.cc:1048] T 6a0104eca382490a8ec51916203c8b59 P bbfb7e6be0904729bcda079b53965aef [LEADER]: Connected to new peer: Peer: permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:05.717037  1306 consensus_queue.cc:1048] T 6a0104eca382490a8ec51916203c8b59 P bbfb7e6be0904729bcda079b53965aef [LEADER]: Connected to new peer: Peer: permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:05.819584  1306 consensus_queue.cc:1048] T 9574c9ab5cd1491cbc8b01f3c89d4149 P bbfb7e6be0904729bcda079b53965aef [LEADER]: Connected to new peer: Peer: permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:05.825961  1303 raft_consensus.cc:993] T 9574c9ab5cd1491cbc8b01f3c89d4149 P bbfb7e6be0904729bcda079b53965aef: : Instructing follower 1434bfe58c7247788e5d93c7d2bd8de1 to start an election
I20260709 12:58:05.826398  1287 raft_consensus.cc:1081] T 9574c9ab5cd1491cbc8b01f3c89d4149 P bbfb7e6be0904729bcda079b53965aef [term 1 LEADER]: Signalling peer 1434bfe58c7247788e5d93c7d2bd8de1 to start an election
I20260709 12:58:05.827872  1089 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9574c9ab5cd1491cbc8b01f3c89d4149"
dest_uuid: "1434bfe58c7247788e5d93c7d2bd8de1"
 from {username='slave'} at 127.0.0.1:36942
I20260709 12:58:05.828357  1089 raft_consensus.cc:493] T 9574c9ab5cd1491cbc8b01f3c89d4149 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:05.828752  1089 raft_consensus.cc:3060] T 9574c9ab5cd1491cbc8b01f3c89d4149 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:05.832523  1287 consensus_queue.cc:1048] T 9574c9ab5cd1491cbc8b01f3c89d4149 P bbfb7e6be0904729bcda079b53965aef [LEADER]: Connected to new peer: Peer: permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:05.834650  1089 raft_consensus.cc:515] T 9574c9ab5cd1491cbc8b01f3c89d4149 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.835703  1090 raft_consensus.cc:1240] T 9574c9ab5cd1491cbc8b01f3c89d4149 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 2 FOLLOWER]: Rejecting Update request from peer bbfb7e6be0904729bcda079b53965aef for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:05.837440  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9574c9ab5cd1491cbc8b01f3c89d4149" candidate_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bbfb7e6be0904729bcda079b53965aef"
I20260709 12:58:05.838001  1166 raft_consensus.cc:3055] T 9574c9ab5cd1491cbc8b01f3c89d4149 P bbfb7e6be0904729bcda079b53965aef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:05.838307  1166 raft_consensus.cc:740] T 9574c9ab5cd1491cbc8b01f3c89d4149 P bbfb7e6be0904729bcda079b53965aef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bbfb7e6be0904729bcda079b53965aef, State: Running, Role: LEADER
I20260709 12:58:05.839044  1166 consensus_queue.cc:260] T 9574c9ab5cd1491cbc8b01f3c89d4149 P bbfb7e6be0904729bcda079b53965aef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.840104  1166 raft_consensus.cc:3060] T 9574c9ab5cd1491cbc8b01f3c89d4149 P bbfb7e6be0904729bcda079b53965aef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:05.841130  1089 leader_election.cc:290] T 9574c9ab5cd1491cbc8b01f3c89d4149 P 1434bfe58c7247788e5d93c7d2bd8de1 [CANDIDATE]: Term 2 election: Requested vote from peers bbfb7e6be0904729bcda079b53965aef (127.0.107.194:45551), c97e97cff3474b0fb542619cb94dcd8c (127.0.107.195:43677)
I20260709 12:58:05.848227  1166 raft_consensus.cc:2468] T 9574c9ab5cd1491cbc8b01f3c89d4149 P bbfb7e6be0904729bcda079b53965aef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1434bfe58c7247788e5d93c7d2bd8de1 in term 2.
I20260709 12:58:05.848459  1240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9574c9ab5cd1491cbc8b01f3c89d4149" candidate_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c97e97cff3474b0fb542619cb94dcd8c"
W20260709 12:58:05.839928  1287 consensus_queue.cc:1175] T 9574c9ab5cd1491cbc8b01f3c89d4149 P bbfb7e6be0904729bcda079b53965aef [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 0 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer bbfb7e6be0904729bcda079b53965aef for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:58:05.849073  1240 raft_consensus.cc:3060] T 9574c9ab5cd1491cbc8b01f3c89d4149 P c97e97cff3474b0fb542619cb94dcd8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:05.849479  1055 leader_election.cc:304] T 9574c9ab5cd1491cbc8b01f3c89d4149 P 1434bfe58c7247788e5d93c7d2bd8de1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1434bfe58c7247788e5d93c7d2bd8de1, bbfb7e6be0904729bcda079b53965aef; no voters: 
I20260709 12:58:05.850124  1354 raft_consensus.cc:2804] T 9574c9ab5cd1491cbc8b01f3c89d4149 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:05.850551  1354 raft_consensus.cc:697] T 9574c9ab5cd1491cbc8b01f3c89d4149 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 2 LEADER]: Becoming Leader. State: Replica: 1434bfe58c7247788e5d93c7d2bd8de1, State: Running, Role: LEADER
I20260709 12:58:05.851327  1354 consensus_queue.cc:237] T 9574c9ab5cd1491cbc8b01f3c89d4149 P 1434bfe58c7247788e5d93c7d2bd8de1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.855651  1240 raft_consensus.cc:2468] T 9574c9ab5cd1491cbc8b01f3c89d4149 P c97e97cff3474b0fb542619cb94dcd8c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1434bfe58c7247788e5d93c7d2bd8de1 in term 2.
I20260709 12:58:05.858067   989 catalog_manager.cc:5697] T 9574c9ab5cd1491cbc8b01f3c89d4149 P 1434bfe58c7247788e5d93c7d2bd8de1 reported cstate change: term changed from 1 to 2, leader changed from bbfb7e6be0904729bcda079b53965aef (127.0.107.194) to 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:05.901341  1287 raft_consensus.cc:993] T 38eeded1fce24dec92c5aa10aa9ac846 P bbfb7e6be0904729bcda079b53965aef: : Instructing follower 1434bfe58c7247788e5d93c7d2bd8de1 to start an election
I20260709 12:58:05.901870  1306 raft_consensus.cc:1081] T 38eeded1fce24dec92c5aa10aa9ac846 P bbfb7e6be0904729bcda079b53965aef [term 1 LEADER]: Signalling peer 1434bfe58c7247788e5d93c7d2bd8de1 to start an election
I20260709 12:58:05.903241  1089 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "38eeded1fce24dec92c5aa10aa9ac846"
dest_uuid: "1434bfe58c7247788e5d93c7d2bd8de1"
 from {username='slave'} at 127.0.0.1:36942
I20260709 12:58:05.903690  1089 raft_consensus.cc:493] T 38eeded1fce24dec92c5aa10aa9ac846 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:05.903971  1089 raft_consensus.cc:3060] T 38eeded1fce24dec92c5aa10aa9ac846 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:05.908514  1089 raft_consensus.cc:515] T 38eeded1fce24dec92c5aa10aa9ac846 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.910205  1089 leader_election.cc:290] T 38eeded1fce24dec92c5aa10aa9ac846 P 1434bfe58c7247788e5d93c7d2bd8de1 [CANDIDATE]: Term 2 election: Requested vote from peers bbfb7e6be0904729bcda079b53965aef (127.0.107.194:45551), c97e97cff3474b0fb542619cb94dcd8c (127.0.107.195:43677)
I20260709 12:58:05.911042  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38eeded1fce24dec92c5aa10aa9ac846" candidate_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bbfb7e6be0904729bcda079b53965aef"
I20260709 12:58:05.911230  1240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38eeded1fce24dec92c5aa10aa9ac846" candidate_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c97e97cff3474b0fb542619cb94dcd8c"
I20260709 12:58:05.911653  1166 raft_consensus.cc:3055] T 38eeded1fce24dec92c5aa10aa9ac846 P bbfb7e6be0904729bcda079b53965aef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:05.911767  1240 raft_consensus.cc:3060] T 38eeded1fce24dec92c5aa10aa9ac846 P c97e97cff3474b0fb542619cb94dcd8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:05.912047  1166 raft_consensus.cc:740] T 38eeded1fce24dec92c5aa10aa9ac846 P bbfb7e6be0904729bcda079b53965aef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bbfb7e6be0904729bcda079b53965aef, State: Running, Role: LEADER
I20260709 12:58:05.912947  1166 consensus_queue.cc:260] T 38eeded1fce24dec92c5aa10aa9ac846 P bbfb7e6be0904729bcda079b53965aef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.913910  1166 raft_consensus.cc:3060] T 38eeded1fce24dec92c5aa10aa9ac846 P bbfb7e6be0904729bcda079b53965aef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:05.917534  1240 raft_consensus.cc:2468] T 38eeded1fce24dec92c5aa10aa9ac846 P c97e97cff3474b0fb542619cb94dcd8c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1434bfe58c7247788e5d93c7d2bd8de1 in term 2.
I20260709 12:58:05.918529  1057 leader_election.cc:304] T 38eeded1fce24dec92c5aa10aa9ac846 P 1434bfe58c7247788e5d93c7d2bd8de1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1434bfe58c7247788e5d93c7d2bd8de1, c97e97cff3474b0fb542619cb94dcd8c; no voters: 
I20260709 12:58:05.918908  1166 raft_consensus.cc:2468] T 38eeded1fce24dec92c5aa10aa9ac846 P bbfb7e6be0904729bcda079b53965aef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1434bfe58c7247788e5d93c7d2bd8de1 in term 2.
I20260709 12:58:05.919274  1354 raft_consensus.cc:2804] T 38eeded1fce24dec92c5aa10aa9ac846 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:05.919795  1354 raft_consensus.cc:697] T 38eeded1fce24dec92c5aa10aa9ac846 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 2 LEADER]: Becoming Leader. State: Replica: 1434bfe58c7247788e5d93c7d2bd8de1, State: Running, Role: LEADER
I20260709 12:58:05.920689  1354 consensus_queue.cc:237] T 38eeded1fce24dec92c5aa10aa9ac846 P 1434bfe58c7247788e5d93c7d2bd8de1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.923050  1287 raft_consensus.cc:993] T 36813a3559ff43a893c148b091a60090 P bbfb7e6be0904729bcda079b53965aef: : Instructing follower 1434bfe58c7247788e5d93c7d2bd8de1 to start an election
I20260709 12:58:05.923475  1306 raft_consensus.cc:1081] T 36813a3559ff43a893c148b091a60090 P bbfb7e6be0904729bcda079b53965aef [term 1 LEADER]: Signalling peer 1434bfe58c7247788e5d93c7d2bd8de1 to start an election
I20260709 12:58:05.925143  1089 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "36813a3559ff43a893c148b091a60090"
dest_uuid: "1434bfe58c7247788e5d93c7d2bd8de1"
 from {username='slave'} at 127.0.0.1:36942
I20260709 12:58:05.925647  1089 raft_consensus.cc:493] T 36813a3559ff43a893c148b091a60090 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:05.925954  1089 raft_consensus.cc:3060] T 36813a3559ff43a893c148b091a60090 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:05.927574   989 catalog_manager.cc:5697] T 38eeded1fce24dec92c5aa10aa9ac846 P 1434bfe58c7247788e5d93c7d2bd8de1 reported cstate change: term changed from 1 to 2, leader changed from bbfb7e6be0904729bcda079b53965aef (127.0.107.194) to 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:05.930444  1089 raft_consensus.cc:515] T 36813a3559ff43a893c148b091a60090 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.932324  1089 leader_election.cc:290] T 36813a3559ff43a893c148b091a60090 P 1434bfe58c7247788e5d93c7d2bd8de1 [CANDIDATE]: Term 2 election: Requested vote from peers bbfb7e6be0904729bcda079b53965aef (127.0.107.194:45551), c97e97cff3474b0fb542619cb94dcd8c (127.0.107.195:43677)
I20260709 12:58:05.933727  1240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36813a3559ff43a893c148b091a60090" candidate_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c97e97cff3474b0fb542619cb94dcd8c"
I20260709 12:58:05.934291  1240 raft_consensus.cc:3060] T 36813a3559ff43a893c148b091a60090 P c97e97cff3474b0fb542619cb94dcd8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:05.935227  1166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36813a3559ff43a893c148b091a60090" candidate_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bbfb7e6be0904729bcda079b53965aef"
I20260709 12:58:05.935678  1166 raft_consensus.cc:3055] T 36813a3559ff43a893c148b091a60090 P bbfb7e6be0904729bcda079b53965aef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:05.935940  1166 raft_consensus.cc:740] T 36813a3559ff43a893c148b091a60090 P bbfb7e6be0904729bcda079b53965aef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bbfb7e6be0904729bcda079b53965aef, State: Running, Role: LEADER
I20260709 12:58:05.936684  1166 consensus_queue.cc:260] T 36813a3559ff43a893c148b091a60090 P bbfb7e6be0904729bcda079b53965aef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.937744  1166 raft_consensus.cc:3060] T 36813a3559ff43a893c148b091a60090 P bbfb7e6be0904729bcda079b53965aef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:05.939567  1240 raft_consensus.cc:2468] T 36813a3559ff43a893c148b091a60090 P c97e97cff3474b0fb542619cb94dcd8c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1434bfe58c7247788e5d93c7d2bd8de1 in term 2.
I20260709 12:58:05.940476  1057 leader_election.cc:304] T 36813a3559ff43a893c148b091a60090 P 1434bfe58c7247788e5d93c7d2bd8de1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1434bfe58c7247788e5d93c7d2bd8de1, c97e97cff3474b0fb542619cb94dcd8c; no voters: 
I20260709 12:58:05.941238  1354 raft_consensus.cc:2804] T 36813a3559ff43a893c148b091a60090 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:05.941649  1354 raft_consensus.cc:697] T 36813a3559ff43a893c148b091a60090 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 2 LEADER]: Becoming Leader. State: Replica: 1434bfe58c7247788e5d93c7d2bd8de1, State: Running, Role: LEADER
I20260709 12:58:05.942363  1354 consensus_queue.cc:237] T 36813a3559ff43a893c148b091a60090 P 1434bfe58c7247788e5d93c7d2bd8de1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:05.942662  1166 raft_consensus.cc:2468] T 36813a3559ff43a893c148b091a60090 P bbfb7e6be0904729bcda079b53965aef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1434bfe58c7247788e5d93c7d2bd8de1 in term 2.
I20260709 12:58:05.948359   989 catalog_manager.cc:5697] T 36813a3559ff43a893c148b091a60090 P 1434bfe58c7247788e5d93c7d2bd8de1 reported cstate change: term changed from 1 to 2, leader changed from bbfb7e6be0904729bcda079b53965aef (127.0.107.194) to 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:05.975512  1306 consensus_queue.cc:1048] T 53866543b96a4b7c975007d75efde33e P bbfb7e6be0904729bcda079b53965aef [LEADER]: Connected to new peer: Peer: permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:05.980942  1354 consensus_queue.cc:1048] T 6eab0d4cbaa04172bc4320b9c3847715 P 1434bfe58c7247788e5d93c7d2bd8de1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:05.987243  1303 consensus_queue.cc:1048] T 53866543b96a4b7c975007d75efde33e P bbfb7e6be0904729bcda079b53965aef [LEADER]: Connected to new peer: Peer: permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:05.989576  1326 raft_consensus.cc:993] T 6eab0d4cbaa04172bc4320b9c3847715 P 1434bfe58c7247788e5d93c7d2bd8de1: : Instructing follower bbfb7e6be0904729bcda079b53965aef to start an election
I20260709 12:58:05.990047  1326 raft_consensus.cc:1081] T 6eab0d4cbaa04172bc4320b9c3847715 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 1 LEADER]: Signalling peer bbfb7e6be0904729bcda079b53965aef to start an election
I20260709 12:58:05.992260  1167 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6eab0d4cbaa04172bc4320b9c3847715"
dest_uuid: "bbfb7e6be0904729bcda079b53965aef"
 from {username='slave'} at 127.0.0.1:53016
I20260709 12:58:05.992918  1167 raft_consensus.cc:493] T 6eab0d4cbaa04172bc4320b9c3847715 P bbfb7e6be0904729bcda079b53965aef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:05.993291  1167 raft_consensus.cc:3060] T 6eab0d4cbaa04172bc4320b9c3847715 P bbfb7e6be0904729bcda079b53965aef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:05.999604  1354 consensus_queue.cc:1048] T 6eab0d4cbaa04172bc4320b9c3847715 P 1434bfe58c7247788e5d93c7d2bd8de1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:06.001076  1167 raft_consensus.cc:515] T 6eab0d4cbaa04172bc4320b9c3847715 P bbfb7e6be0904729bcda079b53965aef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:06.002519  1166 raft_consensus.cc:1240] T 6eab0d4cbaa04172bc4320b9c3847715 P bbfb7e6be0904729bcda079b53965aef [term 2 FOLLOWER]: Rejecting Update request from peer 1434bfe58c7247788e5d93c7d2bd8de1 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:06.005276  1089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eab0d4cbaa04172bc4320b9c3847715" candidate_uuid: "bbfb7e6be0904729bcda079b53965aef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1434bfe58c7247788e5d93c7d2bd8de1"
I20260709 12:58:06.005884  1089 raft_consensus.cc:3055] T 6eab0d4cbaa04172bc4320b9c3847715 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:06.006037  1239 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eab0d4cbaa04172bc4320b9c3847715" candidate_uuid: "bbfb7e6be0904729bcda079b53965aef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c97e97cff3474b0fb542619cb94dcd8c"
I20260709 12:58:06.006237  1089 raft_consensus.cc:740] T 6eab0d4cbaa04172bc4320b9c3847715 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1434bfe58c7247788e5d93c7d2bd8de1, State: Running, Role: LEADER
I20260709 12:58:06.007046  1089 consensus_queue.cc:260] T 6eab0d4cbaa04172bc4320b9c3847715 P 1434bfe58c7247788e5d93c7d2bd8de1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:06.008018  1089 raft_consensus.cc:3060] T 6eab0d4cbaa04172bc4320b9c3847715 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:58:06.008594  1354 consensus_queue.cc:1175] T 6eab0d4cbaa04172bc4320b9c3847715 P 1434bfe58c7247788e5d93c7d2bd8de1 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "bbfb7e6be0904729bcda079b53965aef" responder_term: 2 status { last_received { term: 1 index: 1 } last_committed_idx: 0 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 1434bfe58c7247788e5d93c7d2bd8de1 for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:58:06.009344  1167 leader_election.cc:290] T 6eab0d4cbaa04172bc4320b9c3847715 P bbfb7e6be0904729bcda079b53965aef [CANDIDATE]: Term 2 election: Requested vote from peers 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193:34795), c97e97cff3474b0fb542619cb94dcd8c (127.0.107.195:43677)
I20260709 12:58:06.016932  1089 raft_consensus.cc:2468] T 6eab0d4cbaa04172bc4320b9c3847715 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbfb7e6be0904729bcda079b53965aef in term 2.
I20260709 12:58:06.019527  1133 leader_election.cc:304] T 6eab0d4cbaa04172bc4320b9c3847715 P bbfb7e6be0904729bcda079b53965aef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1434bfe58c7247788e5d93c7d2bd8de1, bbfb7e6be0904729bcda079b53965aef; no voters: c97e97cff3474b0fb542619cb94dcd8c
I20260709 12:58:06.020335  1303 raft_consensus.cc:2804] T 6eab0d4cbaa04172bc4320b9c3847715 P bbfb7e6be0904729bcda079b53965aef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:06.020817  1303 raft_consensus.cc:697] T 6eab0d4cbaa04172bc4320b9c3847715 P bbfb7e6be0904729bcda079b53965aef [term 2 LEADER]: Becoming Leader. State: Replica: bbfb7e6be0904729bcda079b53965aef, State: Running, Role: LEADER
I20260709 12:58:06.021620  1303 consensus_queue.cc:237] T 6eab0d4cbaa04172bc4320b9c3847715 P bbfb7e6be0904729bcda079b53965aef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:06.028578   989 catalog_manager.cc:5697] T 6eab0d4cbaa04172bc4320b9c3847715 P bbfb7e6be0904729bcda079b53965aef reported cstate change: term changed from 1 to 2, leader changed from 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193) to bbfb7e6be0904729bcda079b53965aef (127.0.107.194). New cstate: current_term: 2 leader_uuid: "bbfb7e6be0904729bcda079b53965aef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:06.042486  1349 raft_consensus.cc:993] T bf5299056e9042429bd51aee9ccf6844 P c97e97cff3474b0fb542619cb94dcd8c: : Instructing follower 1434bfe58c7247788e5d93c7d2bd8de1 to start an election
I20260709 12:58:06.042528  1302 consensus_queue.cc:1048] T cf73b42e520b432098cf08c6c32141ba P c97e97cff3474b0fb542619cb94dcd8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:06.043143  1319 raft_consensus.cc:1081] T bf5299056e9042429bd51aee9ccf6844 P c97e97cff3474b0fb542619cb94dcd8c [term 1 LEADER]: Signalling peer 1434bfe58c7247788e5d93c7d2bd8de1 to start an election
I20260709 12:58:06.044569  1090 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bf5299056e9042429bd51aee9ccf6844"
dest_uuid: "1434bfe58c7247788e5d93c7d2bd8de1"
 from {username='slave'} at 127.0.0.1:36944
I20260709 12:58:06.045226  1090 raft_consensus.cc:493] T bf5299056e9042429bd51aee9ccf6844 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:06.045595  1090 raft_consensus.cc:3060] T bf5299056e9042429bd51aee9ccf6844 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:06.052165  1090 raft_consensus.cc:515] T bf5299056e9042429bd51aee9ccf6844 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } } peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } }
I20260709 12:58:06.053392  1319 consensus_queue.cc:1048] T cf73b42e520b432098cf08c6c32141ba P c97e97cff3474b0fb542619cb94dcd8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:06.054929  1090 leader_election.cc:290] T bf5299056e9042429bd51aee9ccf6844 P 1434bfe58c7247788e5d93c7d2bd8de1 [CANDIDATE]: Term 2 election: Requested vote from peers c97e97cff3474b0fb542619cb94dcd8c (127.0.107.195:43677), bbfb7e6be0904729bcda079b53965aef (127.0.107.194:45551)
I20260709 12:58:06.055100  1240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5299056e9042429bd51aee9ccf6844" candidate_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c97e97cff3474b0fb542619cb94dcd8c"
I20260709 12:58:06.055466  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5299056e9042429bd51aee9ccf6844" candidate_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bbfb7e6be0904729bcda079b53965aef"
I20260709 12:58:06.055689  1240 raft_consensus.cc:3055] T bf5299056e9042429bd51aee9ccf6844 P c97e97cff3474b0fb542619cb94dcd8c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:06.056012  1240 raft_consensus.cc:740] T bf5299056e9042429bd51aee9ccf6844 P c97e97cff3474b0fb542619cb94dcd8c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c97e97cff3474b0fb542619cb94dcd8c, State: Running, Role: LEADER
I20260709 12:58:06.056838  1240 consensus_queue.cc:260] T bf5299056e9042429bd51aee9ccf6844 P c97e97cff3474b0fb542619cb94dcd8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } } peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } }
I20260709 12:58:06.056012  1167 raft_consensus.cc:3060] T bf5299056e9042429bd51aee9ccf6844 P bbfb7e6be0904729bcda079b53965aef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:06.057999  1240 raft_consensus.cc:3060] T bf5299056e9042429bd51aee9ccf6844 P c97e97cff3474b0fb542619cb94dcd8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:06.066514  1326 raft_consensus.cc:993] T 8edcf9960f41476794c70fe555756dbb P 1434bfe58c7247788e5d93c7d2bd8de1: : Instructing follower bbfb7e6be0904729bcda079b53965aef to start an election
I20260709 12:58:06.066953  1326 raft_consensus.cc:1081] T 8edcf9960f41476794c70fe555756dbb P 1434bfe58c7247788e5d93c7d2bd8de1 [term 1 LEADER]: Signalling peer bbfb7e6be0904729bcda079b53965aef to start an election
I20260709 12:58:06.067876  1240 raft_consensus.cc:2468] T bf5299056e9042429bd51aee9ccf6844 P c97e97cff3474b0fb542619cb94dcd8c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1434bfe58c7247788e5d93c7d2bd8de1 in term 2.
I20260709 12:58:06.069196  1057 leader_election.cc:304] T bf5299056e9042429bd51aee9ccf6844 P 1434bfe58c7247788e5d93c7d2bd8de1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1434bfe58c7247788e5d93c7d2bd8de1, c97e97cff3474b0fb542619cb94dcd8c; no voters: 
I20260709 12:58:06.070127  1166 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8edcf9960f41476794c70fe555756dbb"
dest_uuid: "bbfb7e6be0904729bcda079b53965aef"
 from {username='slave'} at 127.0.0.1:53016
I20260709 12:58:06.070194  1167 raft_consensus.cc:2468] T bf5299056e9042429bd51aee9ccf6844 P bbfb7e6be0904729bcda079b53965aef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1434bfe58c7247788e5d93c7d2bd8de1 in term 2.
I20260709 12:58:06.070220  1292 raft_consensus.cc:2804] T bf5299056e9042429bd51aee9ccf6844 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:06.070772  1166 raft_consensus.cc:493] T 8edcf9960f41476794c70fe555756dbb P bbfb7e6be0904729bcda079b53965aef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:06.071049  1292 raft_consensus.cc:697] T bf5299056e9042429bd51aee9ccf6844 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 2 LEADER]: Becoming Leader. State: Replica: 1434bfe58c7247788e5d93c7d2bd8de1, State: Running, Role: LEADER
I20260709 12:58:06.071143  1166 raft_consensus.cc:3060] T 8edcf9960f41476794c70fe555756dbb P bbfb7e6be0904729bcda079b53965aef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:06.071929  1292 consensus_queue.cc:237] T bf5299056e9042429bd51aee9ccf6844 P 1434bfe58c7247788e5d93c7d2bd8de1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } } peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } }
I20260709 12:58:06.078128  1166 raft_consensus.cc:515] T 8edcf9960f41476794c70fe555756dbb P bbfb7e6be0904729bcda079b53965aef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:06.080147  1166 leader_election.cc:290] T 8edcf9960f41476794c70fe555756dbb P bbfb7e6be0904729bcda079b53965aef [CANDIDATE]: Term 2 election: Requested vote from peers 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193:34795), c97e97cff3474b0fb542619cb94dcd8c (127.0.107.195:43677)
I20260709 12:58:06.080670  1089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8edcf9960f41476794c70fe555756dbb" candidate_uuid: "bbfb7e6be0904729bcda079b53965aef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1434bfe58c7247788e5d93c7d2bd8de1"
I20260709 12:58:06.081251  1089 raft_consensus.cc:3055] T 8edcf9960f41476794c70fe555756dbb P 1434bfe58c7247788e5d93c7d2bd8de1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:06.081646  1089 raft_consensus.cc:740] T 8edcf9960f41476794c70fe555756dbb P 1434bfe58c7247788e5d93c7d2bd8de1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1434bfe58c7247788e5d93c7d2bd8de1, State: Running, Role: LEADER
I20260709 12:58:06.081171  1240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8edcf9960f41476794c70fe555756dbb" candidate_uuid: "bbfb7e6be0904729bcda079b53965aef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c97e97cff3474b0fb542619cb94dcd8c"
I20260709 12:58:06.082139  1240 raft_consensus.cc:3060] T 8edcf9960f41476794c70fe555756dbb P c97e97cff3474b0fb542619cb94dcd8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:06.082080   990 catalog_manager.cc:5697] T bf5299056e9042429bd51aee9ccf6844 P 1434bfe58c7247788e5d93c7d2bd8de1 reported cstate change: term changed from 1 to 2, leader changed from c97e97cff3474b0fb542619cb94dcd8c (127.0.107.195) to 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:06.082406  1089 consensus_queue.cc:260] T 8edcf9960f41476794c70fe555756dbb P 1434bfe58c7247788e5d93c7d2bd8de1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:06.083688  1089 raft_consensus.cc:3060] T 8edcf9960f41476794c70fe555756dbb P 1434bfe58c7247788e5d93c7d2bd8de1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:06.086867  1240 raft_consensus.cc:2468] T 8edcf9960f41476794c70fe555756dbb P c97e97cff3474b0fb542619cb94dcd8c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbfb7e6be0904729bcda079b53965aef in term 2.
I20260709 12:58:06.087955  1132 leader_election.cc:304] T 8edcf9960f41476794c70fe555756dbb P bbfb7e6be0904729bcda079b53965aef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bbfb7e6be0904729bcda079b53965aef, c97e97cff3474b0fb542619cb94dcd8c; no voters: 
I20260709 12:58:06.088698  1303 raft_consensus.cc:2804] T 8edcf9960f41476794c70fe555756dbb P bbfb7e6be0904729bcda079b53965aef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:06.089152  1303 raft_consensus.cc:697] T 8edcf9960f41476794c70fe555756dbb P bbfb7e6be0904729bcda079b53965aef [term 2 LEADER]: Becoming Leader. State: Replica: bbfb7e6be0904729bcda079b53965aef, State: Running, Role: LEADER
I20260709 12:58:06.090209  1089 raft_consensus.cc:2468] T 8edcf9960f41476794c70fe555756dbb P 1434bfe58c7247788e5d93c7d2bd8de1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbfb7e6be0904729bcda079b53965aef in term 2.
I20260709 12:58:06.089953  1303 consensus_queue.cc:237] T 8edcf9960f41476794c70fe555756dbb P bbfb7e6be0904729bcda079b53965aef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:06.096230   990 catalog_manager.cc:5697] T 8edcf9960f41476794c70fe555756dbb P bbfb7e6be0904729bcda079b53965aef reported cstate change: term changed from 1 to 2, leader changed from 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193) to bbfb7e6be0904729bcda079b53965aef (127.0.107.194). New cstate: current_term: 2 leader_uuid: "bbfb7e6be0904729bcda079b53965aef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:06.127607  1240 raft_consensus.cc:1275] T 614a5c8953cf490b85161067f062e80c P c97e97cff3474b0fb542619cb94dcd8c [term 2 FOLLOWER]: Refusing update from remote peer 1434bfe58c7247788e5d93c7d2bd8de1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:06.128867  1292 consensus_queue.cc:1048] T 614a5c8953cf490b85161067f062e80c P 1434bfe58c7247788e5d93c7d2bd8de1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:06.137288  1166 raft_consensus.cc:3060] T 614a5c8953cf490b85161067f062e80c P bbfb7e6be0904729bcda079b53965aef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:06.144266  1166 raft_consensus.cc:1275] T 614a5c8953cf490b85161067f062e80c P bbfb7e6be0904729bcda079b53965aef [term 2 FOLLOWER]: Refusing update from remote peer 1434bfe58c7247788e5d93c7d2bd8de1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:06.145823  1326 consensus_queue.cc:1048] T 614a5c8953cf490b85161067f062e80c P 1434bfe58c7247788e5d93c7d2bd8de1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:06.287863  1166 raft_consensus.cc:1275] T 9574c9ab5cd1491cbc8b01f3c89d4149 P bbfb7e6be0904729bcda079b53965aef [term 2 FOLLOWER]: Refusing update from remote peer 1434bfe58c7247788e5d93c7d2bd8de1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:06.289099  1326 consensus_queue.cc:1048] T 9574c9ab5cd1491cbc8b01f3c89d4149 P 1434bfe58c7247788e5d93c7d2bd8de1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:06.296747  1240 raft_consensus.cc:1275] T 9574c9ab5cd1491cbc8b01f3c89d4149 P c97e97cff3474b0fb542619cb94dcd8c [term 2 FOLLOWER]: Refusing update from remote peer 1434bfe58c7247788e5d93c7d2bd8de1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:06.298518  1326 consensus_queue.cc:1048] T 9574c9ab5cd1491cbc8b01f3c89d4149 P 1434bfe58c7247788e5d93c7d2bd8de1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:06.341084  1239 raft_consensus.cc:1275] T 36813a3559ff43a893c148b091a60090 P c97e97cff3474b0fb542619cb94dcd8c [term 2 FOLLOWER]: Refusing update from remote peer 1434bfe58c7247788e5d93c7d2bd8de1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:06.342083  1240 raft_consensus.cc:1275] T 38eeded1fce24dec92c5aa10aa9ac846 P c97e97cff3474b0fb542619cb94dcd8c [term 2 FOLLOWER]: Refusing update from remote peer 1434bfe58c7247788e5d93c7d2bd8de1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:06.342309  1292 consensus_queue.cc:1048] T 36813a3559ff43a893c148b091a60090 P 1434bfe58c7247788e5d93c7d2bd8de1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:06.343438  1326 consensus_queue.cc:1048] T 38eeded1fce24dec92c5aa10aa9ac846 P 1434bfe58c7247788e5d93c7d2bd8de1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:06.355821  1167 raft_consensus.cc:1275] T 38eeded1fce24dec92c5aa10aa9ac846 P bbfb7e6be0904729bcda079b53965aef [term 2 FOLLOWER]: Refusing update from remote peer 1434bfe58c7247788e5d93c7d2bd8de1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:06.357666  1326 consensus_queue.cc:1048] T 38eeded1fce24dec92c5aa10aa9ac846 P 1434bfe58c7247788e5d93c7d2bd8de1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:06.358577  1166 raft_consensus.cc:1275] T 36813a3559ff43a893c148b091a60090 P bbfb7e6be0904729bcda079b53965aef [term 2 FOLLOWER]: Refusing update from remote peer 1434bfe58c7247788e5d93c7d2bd8de1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:06.362686  1292 consensus_queue.cc:1048] T 36813a3559ff43a893c148b091a60090 P 1434bfe58c7247788e5d93c7d2bd8de1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:06.477922  1239 raft_consensus.cc:1275] T 8edcf9960f41476794c70fe555756dbb P c97e97cff3474b0fb542619cb94dcd8c [term 2 FOLLOWER]: Refusing update from remote peer bbfb7e6be0904729bcda079b53965aef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:06.479444  1306 consensus_queue.cc:1048] T 8edcf9960f41476794c70fe555756dbb P bbfb7e6be0904729bcda079b53965aef [LEADER]: Connected to new peer: Peer: permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:06.486583  1089 raft_consensus.cc:1275] T 8edcf9960f41476794c70fe555756dbb P 1434bfe58c7247788e5d93c7d2bd8de1 [term 2 FOLLOWER]: Refusing update from remote peer bbfb7e6be0904729bcda079b53965aef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:06.487751  1240 raft_consensus.cc:3060] T 6eab0d4cbaa04172bc4320b9c3847715 P c97e97cff3474b0fb542619cb94dcd8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:06.488688  1303 consensus_queue.cc:1048] T 8edcf9960f41476794c70fe555756dbb P bbfb7e6be0904729bcda079b53965aef [LEADER]: Connected to new peer: Peer: permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:06.493593  1241 raft_consensus.cc:1275] T bf5299056e9042429bd51aee9ccf6844 P c97e97cff3474b0fb542619cb94dcd8c [term 2 FOLLOWER]: Refusing update from remote peer 1434bfe58c7247788e5d93c7d2bd8de1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:06.495100  1240 raft_consensus.cc:1275] T 6eab0d4cbaa04172bc4320b9c3847715 P c97e97cff3474b0fb542619cb94dcd8c [term 2 FOLLOWER]: Refusing update from remote peer bbfb7e6be0904729bcda079b53965aef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:06.495918  1292 consensus_queue.cc:1048] T bf5299056e9042429bd51aee9ccf6844 P 1434bfe58c7247788e5d93c7d2bd8de1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:06.496768  1287 consensus_queue.cc:1048] T 6eab0d4cbaa04172bc4320b9c3847715 P bbfb7e6be0904729bcda079b53965aef [LEADER]: Connected to new peer: Peer: permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:06.507491  1167 raft_consensus.cc:1275] T bf5299056e9042429bd51aee9ccf6844 P bbfb7e6be0904729bcda079b53965aef [term 2 FOLLOWER]: Refusing update from remote peer 1434bfe58c7247788e5d93c7d2bd8de1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:06.508191  1089 raft_consensus.cc:1275] T 6eab0d4cbaa04172bc4320b9c3847715 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 2 FOLLOWER]: Refusing update from remote peer bbfb7e6be0904729bcda079b53965aef: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:06.509753  1326 consensus_queue.cc:1048] T bf5299056e9042429bd51aee9ccf6844 P 1434bfe58c7247788e5d93c7d2bd8de1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:06.509783  1306 consensus_queue.cc:1048] T 6eab0d4cbaa04172bc4320b9c3847715 P bbfb7e6be0904729bcda079b53965aef [LEADER]: Connected to new peer: Peer: permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:08.733810   431 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 12:58:08.734596   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:08.752166  1089 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38eeded1fce24dec92c5aa10aa9ac846"
dest_uuid: "1434bfe58c7247788e5d93c7d2bd8de1"
mode: GRACEFUL
new_leader_uuid: "c97e97cff3474b0fb542619cb94dcd8c"
 from {username='slave'} at 127.0.0.1:36966
I20260709 12:58:08.752704  1089 raft_consensus.cc:606] T 38eeded1fce24dec92c5aa10aa9ac846 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 2 LEADER]: Received request to transfer leadership to TS c97e97cff3474b0fb542619cb94dcd8c
I20260709 12:58:08.755000  1089 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9574c9ab5cd1491cbc8b01f3c89d4149"
dest_uuid: "1434bfe58c7247788e5d93c7d2bd8de1"
mode: GRACEFUL
new_leader_uuid: "c97e97cff3474b0fb542619cb94dcd8c"
 from {username='slave'} at 127.0.0.1:36966
I20260709 12:58:08.755456  1089 raft_consensus.cc:606] T 9574c9ab5cd1491cbc8b01f3c89d4149 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 2 LEADER]: Received request to transfer leadership to TS c97e97cff3474b0fb542619cb94dcd8c
I20260709 12:58:08.756474   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:58:08.756933   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:58:09.109975  1354 raft_consensus.cc:993] T 38eeded1fce24dec92c5aa10aa9ac846 P 1434bfe58c7247788e5d93c7d2bd8de1: : Instructing follower c97e97cff3474b0fb542619cb94dcd8c to start an election
I20260709 12:58:09.110399  1380 raft_consensus.cc:1081] T 38eeded1fce24dec92c5aa10aa9ac846 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 2 LEADER]: Signalling peer c97e97cff3474b0fb542619cb94dcd8c to start an election
I20260709 12:58:09.111824  1240 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "38eeded1fce24dec92c5aa10aa9ac846"
dest_uuid: "c97e97cff3474b0fb542619cb94dcd8c"
 from {username='slave'} at 127.0.0.1:52904
I20260709 12:58:09.112267  1240 raft_consensus.cc:493] T 38eeded1fce24dec92c5aa10aa9ac846 P c97e97cff3474b0fb542619cb94dcd8c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:09.112671  1240 raft_consensus.cc:3060] T 38eeded1fce24dec92c5aa10aa9ac846 P c97e97cff3474b0fb542619cb94dcd8c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:09.117539  1240 raft_consensus.cc:515] T 38eeded1fce24dec92c5aa10aa9ac846 P c97e97cff3474b0fb542619cb94dcd8c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:09.119637  1240 leader_election.cc:290] T 38eeded1fce24dec92c5aa10aa9ac846 P c97e97cff3474b0fb542619cb94dcd8c [CANDIDATE]: Term 3 election: Requested vote from peers 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193:34795), bbfb7e6be0904729bcda079b53965aef (127.0.107.194:45551)
I20260709 12:58:09.120595  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38eeded1fce24dec92c5aa10aa9ac846" candidate_uuid: "c97e97cff3474b0fb542619cb94dcd8c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bbfb7e6be0904729bcda079b53965aef"
I20260709 12:58:09.120620  1089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38eeded1fce24dec92c5aa10aa9ac846" candidate_uuid: "c97e97cff3474b0fb542619cb94dcd8c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1434bfe58c7247788e5d93c7d2bd8de1"
I20260709 12:58:09.121246  1167 raft_consensus.cc:3060] T 38eeded1fce24dec92c5aa10aa9ac846 P bbfb7e6be0904729bcda079b53965aef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:09.121310  1089 raft_consensus.cc:3055] T 38eeded1fce24dec92c5aa10aa9ac846 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:09.121742  1089 raft_consensus.cc:740] T 38eeded1fce24dec92c5aa10aa9ac846 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1434bfe58c7247788e5d93c7d2bd8de1, State: Running, Role: LEADER
I20260709 12:58:09.122447  1089 consensus_queue.cc:260] T 38eeded1fce24dec92c5aa10aa9ac846 P 1434bfe58c7247788e5d93c7d2bd8de1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:09.123447  1089 raft_consensus.cc:3060] T 38eeded1fce24dec92c5aa10aa9ac846 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:09.126214  1167 raft_consensus.cc:2468] T 38eeded1fce24dec92c5aa10aa9ac846 P bbfb7e6be0904729bcda079b53965aef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c97e97cff3474b0fb542619cb94dcd8c in term 3.
I20260709 12:58:09.127255  1204 leader_election.cc:304] T 38eeded1fce24dec92c5aa10aa9ac846 P c97e97cff3474b0fb542619cb94dcd8c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bbfb7e6be0904729bcda079b53965aef, c97e97cff3474b0fb542619cb94dcd8c; no voters: 
I20260709 12:58:09.128023  1376 raft_consensus.cc:2804] T 38eeded1fce24dec92c5aa10aa9ac846 P c97e97cff3474b0fb542619cb94dcd8c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:09.128386  1089 raft_consensus.cc:2468] T 38eeded1fce24dec92c5aa10aa9ac846 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c97e97cff3474b0fb542619cb94dcd8c in term 3.
I20260709 12:58:09.129904  1376 raft_consensus.cc:697] T 38eeded1fce24dec92c5aa10aa9ac846 P c97e97cff3474b0fb542619cb94dcd8c [term 3 LEADER]: Becoming Leader. State: Replica: c97e97cff3474b0fb542619cb94dcd8c, State: Running, Role: LEADER
I20260709 12:58:09.130815  1376 consensus_queue.cc:237] T 38eeded1fce24dec92c5aa10aa9ac846 P c97e97cff3474b0fb542619cb94dcd8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:09.137428   990 catalog_manager.cc:5697] T 38eeded1fce24dec92c5aa10aa9ac846 P c97e97cff3474b0fb542619cb94dcd8c reported cstate change: term changed from 2 to 3, leader changed from 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193) to c97e97cff3474b0fb542619cb94dcd8c (127.0.107.195). New cstate: current_term: 3 leader_uuid: "c97e97cff3474b0fb542619cb94dcd8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:09.224082  1354 raft_consensus.cc:993] T 9574c9ab5cd1491cbc8b01f3c89d4149 P 1434bfe58c7247788e5d93c7d2bd8de1: : Instructing follower c97e97cff3474b0fb542619cb94dcd8c to start an election
I20260709 12:58:09.224519  1380 raft_consensus.cc:1081] T 9574c9ab5cd1491cbc8b01f3c89d4149 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 2 LEADER]: Signalling peer c97e97cff3474b0fb542619cb94dcd8c to start an election
I20260709 12:58:09.225903  1240 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9574c9ab5cd1491cbc8b01f3c89d4149"
dest_uuid: "c97e97cff3474b0fb542619cb94dcd8c"
 from {username='slave'} at 127.0.0.1:52904
I20260709 12:58:09.226435  1240 raft_consensus.cc:493] T 9574c9ab5cd1491cbc8b01f3c89d4149 P c97e97cff3474b0fb542619cb94dcd8c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:09.226771  1240 raft_consensus.cc:3060] T 9574c9ab5cd1491cbc8b01f3c89d4149 P c97e97cff3474b0fb542619cb94dcd8c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:09.231362  1240 raft_consensus.cc:515] T 9574c9ab5cd1491cbc8b01f3c89d4149 P c97e97cff3474b0fb542619cb94dcd8c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:09.232936  1240 leader_election.cc:290] T 9574c9ab5cd1491cbc8b01f3c89d4149 P c97e97cff3474b0fb542619cb94dcd8c [CANDIDATE]: Term 3 election: Requested vote from peers 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193:34795), bbfb7e6be0904729bcda079b53965aef (127.0.107.194:45551)
I20260709 12:58:09.233783  1089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9574c9ab5cd1491cbc8b01f3c89d4149" candidate_uuid: "c97e97cff3474b0fb542619cb94dcd8c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1434bfe58c7247788e5d93c7d2bd8de1"
I20260709 12:58:09.233883  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9574c9ab5cd1491cbc8b01f3c89d4149" candidate_uuid: "c97e97cff3474b0fb542619cb94dcd8c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bbfb7e6be0904729bcda079b53965aef"
I20260709 12:58:09.234477  1089 raft_consensus.cc:3055] T 9574c9ab5cd1491cbc8b01f3c89d4149 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:09.234640  1167 raft_consensus.cc:3060] T 9574c9ab5cd1491cbc8b01f3c89d4149 P bbfb7e6be0904729bcda079b53965aef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:09.234784  1089 raft_consensus.cc:740] T 9574c9ab5cd1491cbc8b01f3c89d4149 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1434bfe58c7247788e5d93c7d2bd8de1, State: Running, Role: LEADER
I20260709 12:58:09.235605  1089 consensus_queue.cc:260] T 9574c9ab5cd1491cbc8b01f3c89d4149 P 1434bfe58c7247788e5d93c7d2bd8de1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:09.236495  1089 raft_consensus.cc:3060] T 9574c9ab5cd1491cbc8b01f3c89d4149 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:09.239907  1167 raft_consensus.cc:2468] T 9574c9ab5cd1491cbc8b01f3c89d4149 P bbfb7e6be0904729bcda079b53965aef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c97e97cff3474b0fb542619cb94dcd8c in term 3.
I20260709 12:58:09.240969  1089 raft_consensus.cc:2468] T 9574c9ab5cd1491cbc8b01f3c89d4149 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c97e97cff3474b0fb542619cb94dcd8c in term 3.
I20260709 12:58:09.240932  1204 leader_election.cc:304] T 9574c9ab5cd1491cbc8b01f3c89d4149 P c97e97cff3474b0fb542619cb94dcd8c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bbfb7e6be0904729bcda079b53965aef, c97e97cff3474b0fb542619cb94dcd8c; no voters: 
I20260709 12:58:09.242027  1381 raft_consensus.cc:2804] T 9574c9ab5cd1491cbc8b01f3c89d4149 P c97e97cff3474b0fb542619cb94dcd8c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:09.242458  1381 raft_consensus.cc:697] T 9574c9ab5cd1491cbc8b01f3c89d4149 P c97e97cff3474b0fb542619cb94dcd8c [term 3 LEADER]: Becoming Leader. State: Replica: c97e97cff3474b0fb542619cb94dcd8c, State: Running, Role: LEADER
I20260709 12:58:09.243288  1381 consensus_queue.cc:237] T 9574c9ab5cd1491cbc8b01f3c89d4149 P c97e97cff3474b0fb542619cb94dcd8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:09.250581   990 catalog_manager.cc:5697] T 9574c9ab5cd1491cbc8b01f3c89d4149 P c97e97cff3474b0fb542619cb94dcd8c reported cstate change: term changed from 2 to 3, leader changed from 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193) to c97e97cff3474b0fb542619cb94dcd8c (127.0.107.195). New cstate: current_term: 3 leader_uuid: "c97e97cff3474b0fb542619cb94dcd8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:09.696830  1089 raft_consensus.cc:1275] T 9574c9ab5cd1491cbc8b01f3c89d4149 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 3 FOLLOWER]: Refusing update from remote peer c97e97cff3474b0fb542619cb94dcd8c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:09.698572  1381 consensus_queue.cc:1048] T 9574c9ab5cd1491cbc8b01f3c89d4149 P c97e97cff3474b0fb542619cb94dcd8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:09.716876  1167 raft_consensus.cc:1275] T 9574c9ab5cd1491cbc8b01f3c89d4149 P bbfb7e6be0904729bcda079b53965aef [term 3 FOLLOWER]: Refusing update from remote peer c97e97cff3474b0fb542619cb94dcd8c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:09.718798  1376 consensus_queue.cc:1048] T 9574c9ab5cd1491cbc8b01f3c89d4149 P c97e97cff3474b0fb542619cb94dcd8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:09.735057  1166 raft_consensus.cc:1275] T 38eeded1fce24dec92c5aa10aa9ac846 P bbfb7e6be0904729bcda079b53965aef [term 3 FOLLOWER]: Refusing update from remote peer c97e97cff3474b0fb542619cb94dcd8c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:09.736363  1376 consensus_queue.cc:1048] T 38eeded1fce24dec92c5aa10aa9ac846 P c97e97cff3474b0fb542619cb94dcd8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:09.740518  1089 raft_consensus.cc:1275] T 38eeded1fce24dec92c5aa10aa9ac846 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 3 FOLLOWER]: Refusing update from remote peer c97e97cff3474b0fb542619cb94dcd8c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:09.741827  1376 consensus_queue.cc:1048] T 38eeded1fce24dec92c5aa10aa9ac846 P c97e97cff3474b0fb542619cb94dcd8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:09.759006   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:09.783921  1240 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9574c9ab5cd1491cbc8b01f3c89d4149"
dest_uuid: "c97e97cff3474b0fb542619cb94dcd8c"
mode: GRACEFUL
new_leader_uuid: "1434bfe58c7247788e5d93c7d2bd8de1"
 from {username='slave'} at 127.0.0.1:52916
I20260709 12:58:09.784701  1240 raft_consensus.cc:606] T 9574c9ab5cd1491cbc8b01f3c89d4149 P c97e97cff3474b0fb542619cb94dcd8c [term 3 LEADER]: Received request to transfer leadership to TS 1434bfe58c7247788e5d93c7d2bd8de1
I20260709 12:58:09.794951  1240 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38eeded1fce24dec92c5aa10aa9ac846"
dest_uuid: "c97e97cff3474b0fb542619cb94dcd8c"
mode: GRACEFUL
new_leader_uuid: "1434bfe58c7247788e5d93c7d2bd8de1"
 from {username='slave'} at 127.0.0.1:52916
I20260709 12:58:09.795401  1240 raft_consensus.cc:606] T 38eeded1fce24dec92c5aa10aa9ac846 P c97e97cff3474b0fb542619cb94dcd8c [term 3 LEADER]: Received request to transfer leadership to TS 1434bfe58c7247788e5d93c7d2bd8de1
I20260709 12:58:09.799948  1167 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8edcf9960f41476794c70fe555756dbb"
dest_uuid: "bbfb7e6be0904729bcda079b53965aef"
mode: GRACEFUL
new_leader_uuid: "1434bfe58c7247788e5d93c7d2bd8de1"
 from {username='slave'} at 127.0.0.1:53022
I20260709 12:58:09.800607  1167 raft_consensus.cc:606] T 8edcf9960f41476794c70fe555756dbb P bbfb7e6be0904729bcda079b53965aef [term 2 LEADER]: Received request to transfer leadership to TS 1434bfe58c7247788e5d93c7d2bd8de1
I20260709 12:58:09.805266  1167 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a0104eca382490a8ec51916203c8b59"
dest_uuid: "bbfb7e6be0904729bcda079b53965aef"
mode: GRACEFUL
new_leader_uuid: "1434bfe58c7247788e5d93c7d2bd8de1"
 from {username='slave'} at 127.0.0.1:53022
I20260709 12:58:09.805716  1167 raft_consensus.cc:606] T 6a0104eca382490a8ec51916203c8b59 P bbfb7e6be0904729bcda079b53965aef [term 1 LEADER]: Received request to transfer leadership to TS 1434bfe58c7247788e5d93c7d2bd8de1
I20260709 12:58:09.810168  1167 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "53866543b96a4b7c975007d75efde33e"
dest_uuid: "bbfb7e6be0904729bcda079b53965aef"
mode: GRACEFUL
new_leader_uuid: "1434bfe58c7247788e5d93c7d2bd8de1"
 from {username='slave'} at 127.0.0.1:53022
I20260709 12:58:09.810606  1167 raft_consensus.cc:606] T 53866543b96a4b7c975007d75efde33e P bbfb7e6be0904729bcda079b53965aef [term 1 LEADER]: Received request to transfer leadership to TS 1434bfe58c7247788e5d93c7d2bd8de1
I20260709 12:58:09.859984  1303 raft_consensus.cc:993] T 6a0104eca382490a8ec51916203c8b59 P bbfb7e6be0904729bcda079b53965aef: : Instructing follower 1434bfe58c7247788e5d93c7d2bd8de1 to start an election
I20260709 12:58:09.860562  1397 raft_consensus.cc:1081] T 6a0104eca382490a8ec51916203c8b59 P bbfb7e6be0904729bcda079b53965aef [term 1 LEADER]: Signalling peer 1434bfe58c7247788e5d93c7d2bd8de1 to start an election
I20260709 12:58:09.862124  1089 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a0104eca382490a8ec51916203c8b59"
dest_uuid: "1434bfe58c7247788e5d93c7d2bd8de1"
 from {username='slave'} at 127.0.0.1:36942
I20260709 12:58:09.862568  1089 raft_consensus.cc:493] T 6a0104eca382490a8ec51916203c8b59 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:09.862846  1089 raft_consensus.cc:3060] T 6a0104eca382490a8ec51916203c8b59 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:09.867933  1089 raft_consensus.cc:515] T 6a0104eca382490a8ec51916203c8b59 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:09.869496  1089 leader_election.cc:290] T 6a0104eca382490a8ec51916203c8b59 P 1434bfe58c7247788e5d93c7d2bd8de1 [CANDIDATE]: Term 2 election: Requested vote from peers bbfb7e6be0904729bcda079b53965aef (127.0.107.194:45551), c97e97cff3474b0fb542619cb94dcd8c (127.0.107.195:43677)
I20260709 12:58:09.870604  1240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0104eca382490a8ec51916203c8b59" candidate_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c97e97cff3474b0fb542619cb94dcd8c"
I20260709 12:58:09.870493  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0104eca382490a8ec51916203c8b59" candidate_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bbfb7e6be0904729bcda079b53965aef"
I20260709 12:58:09.871174  1240 raft_consensus.cc:3060] T 6a0104eca382490a8ec51916203c8b59 P c97e97cff3474b0fb542619cb94dcd8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:09.871225  1167 raft_consensus.cc:3055] T 6a0104eca382490a8ec51916203c8b59 P bbfb7e6be0904729bcda079b53965aef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:09.871594  1167 raft_consensus.cc:740] T 6a0104eca382490a8ec51916203c8b59 P bbfb7e6be0904729bcda079b53965aef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bbfb7e6be0904729bcda079b53965aef, State: Running, Role: LEADER
I20260709 12:58:09.872325  1167 consensus_queue.cc:260] T 6a0104eca382490a8ec51916203c8b59 P bbfb7e6be0904729bcda079b53965aef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:09.873363  1167 raft_consensus.cc:3060] T 6a0104eca382490a8ec51916203c8b59 P bbfb7e6be0904729bcda079b53965aef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:09.876264  1240 raft_consensus.cc:2468] T 6a0104eca382490a8ec51916203c8b59 P c97e97cff3474b0fb542619cb94dcd8c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1434bfe58c7247788e5d93c7d2bd8de1 in term 2.
I20260709 12:58:09.877637  1057 leader_election.cc:304] T 6a0104eca382490a8ec51916203c8b59 P 1434bfe58c7247788e5d93c7d2bd8de1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1434bfe58c7247788e5d93c7d2bd8de1, c97e97cff3474b0fb542619cb94dcd8c; no voters: 
I20260709 12:58:09.878490  1380 raft_consensus.cc:2804] T 6a0104eca382490a8ec51916203c8b59 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:09.878456  1167 raft_consensus.cc:2468] T 6a0104eca382490a8ec51916203c8b59 P bbfb7e6be0904729bcda079b53965aef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1434bfe58c7247788e5d93c7d2bd8de1 in term 2.
I20260709 12:58:09.879102  1380 raft_consensus.cc:697] T 6a0104eca382490a8ec51916203c8b59 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 2 LEADER]: Becoming Leader. State: Replica: 1434bfe58c7247788e5d93c7d2bd8de1, State: Running, Role: LEADER
I20260709 12:58:09.880012  1380 consensus_queue.cc:237] T 6a0104eca382490a8ec51916203c8b59 P 1434bfe58c7247788e5d93c7d2bd8de1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:09.886677   990 catalog_manager.cc:5697] T 6a0104eca382490a8ec51916203c8b59 P 1434bfe58c7247788e5d93c7d2bd8de1 reported cstate change: term changed from 1 to 2, leader changed from bbfb7e6be0904729bcda079b53965aef (127.0.107.194) to 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:09.899412  1303 raft_consensus.cc:993] T 53866543b96a4b7c975007d75efde33e P bbfb7e6be0904729bcda079b53965aef: : Instructing follower 1434bfe58c7247788e5d93c7d2bd8de1 to start an election
I20260709 12:58:09.899835  1397 raft_consensus.cc:1081] T 53866543b96a4b7c975007d75efde33e P bbfb7e6be0904729bcda079b53965aef [term 1 LEADER]: Signalling peer 1434bfe58c7247788e5d93c7d2bd8de1 to start an election
I20260709 12:58:09.901309  1089 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "53866543b96a4b7c975007d75efde33e"
dest_uuid: "1434bfe58c7247788e5d93c7d2bd8de1"
 from {username='slave'} at 127.0.0.1:36942
I20260709 12:58:09.901782  1089 raft_consensus.cc:493] T 53866543b96a4b7c975007d75efde33e P 1434bfe58c7247788e5d93c7d2bd8de1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:09.902109  1089 raft_consensus.cc:3060] T 53866543b96a4b7c975007d75efde33e P 1434bfe58c7247788e5d93c7d2bd8de1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:09.906324  1089 raft_consensus.cc:515] T 53866543b96a4b7c975007d75efde33e P 1434bfe58c7247788e5d93c7d2bd8de1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:09.907697  1089 leader_election.cc:290] T 53866543b96a4b7c975007d75efde33e P 1434bfe58c7247788e5d93c7d2bd8de1 [CANDIDATE]: Term 2 election: Requested vote from peers bbfb7e6be0904729bcda079b53965aef (127.0.107.194:45551), c97e97cff3474b0fb542619cb94dcd8c (127.0.107.195:43677)
I20260709 12:58:09.908664  1240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53866543b96a4b7c975007d75efde33e" candidate_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c97e97cff3474b0fb542619cb94dcd8c"
I20260709 12:58:09.908623  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53866543b96a4b7c975007d75efde33e" candidate_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "bbfb7e6be0904729bcda079b53965aef"
I20260709 12:58:09.909266  1240 raft_consensus.cc:3060] T 53866543b96a4b7c975007d75efde33e P c97e97cff3474b0fb542619cb94dcd8c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:09.909345  1167 raft_consensus.cc:3055] T 53866543b96a4b7c975007d75efde33e P bbfb7e6be0904729bcda079b53965aef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:09.909703  1167 raft_consensus.cc:740] T 53866543b96a4b7c975007d75efde33e P bbfb7e6be0904729bcda079b53965aef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: bbfb7e6be0904729bcda079b53965aef, State: Running, Role: LEADER
I20260709 12:58:09.910339  1167 consensus_queue.cc:260] T 53866543b96a4b7c975007d75efde33e P bbfb7e6be0904729bcda079b53965aef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:09.911227  1167 raft_consensus.cc:3060] T 53866543b96a4b7c975007d75efde33e P bbfb7e6be0904729bcda079b53965aef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:09.913800  1240 raft_consensus.cc:2468] T 53866543b96a4b7c975007d75efde33e P c97e97cff3474b0fb542619cb94dcd8c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1434bfe58c7247788e5d93c7d2bd8de1 in term 2.
I20260709 12:58:09.914871  1057 leader_election.cc:304] T 53866543b96a4b7c975007d75efde33e P 1434bfe58c7247788e5d93c7d2bd8de1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1434bfe58c7247788e5d93c7d2bd8de1, c97e97cff3474b0fb542619cb94dcd8c; no voters: 
I20260709 12:58:09.915536  1380 raft_consensus.cc:2804] T 53866543b96a4b7c975007d75efde33e P 1434bfe58c7247788e5d93c7d2bd8de1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:09.915982  1380 raft_consensus.cc:697] T 53866543b96a4b7c975007d75efde33e P 1434bfe58c7247788e5d93c7d2bd8de1 [term 2 LEADER]: Becoming Leader. State: Replica: 1434bfe58c7247788e5d93c7d2bd8de1, State: Running, Role: LEADER
I20260709 12:58:09.916471  1167 raft_consensus.cc:2468] T 53866543b96a4b7c975007d75efde33e P bbfb7e6be0904729bcda079b53965aef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1434bfe58c7247788e5d93c7d2bd8de1 in term 2.
I20260709 12:58:09.916870  1380 consensus_queue.cc:237] T 53866543b96a4b7c975007d75efde33e P 1434bfe58c7247788e5d93c7d2bd8de1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:09.924211   990 catalog_manager.cc:5697] T 53866543b96a4b7c975007d75efde33e P 1434bfe58c7247788e5d93c7d2bd8de1 reported cstate change: term changed from 1 to 2, leader changed from bbfb7e6be0904729bcda079b53965aef (127.0.107.194) to 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:10.054855  1303 raft_consensus.cc:993] T 8edcf9960f41476794c70fe555756dbb P bbfb7e6be0904729bcda079b53965aef: : Instructing follower 1434bfe58c7247788e5d93c7d2bd8de1 to start an election
I20260709 12:58:10.055327  1397 raft_consensus.cc:1081] T 8edcf9960f41476794c70fe555756dbb P bbfb7e6be0904729bcda079b53965aef [term 2 LEADER]: Signalling peer 1434bfe58c7247788e5d93c7d2bd8de1 to start an election
I20260709 12:58:10.056821  1089 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8edcf9960f41476794c70fe555756dbb"
dest_uuid: "1434bfe58c7247788e5d93c7d2bd8de1"
 from {username='slave'} at 127.0.0.1:36942
I20260709 12:58:10.057288  1089 raft_consensus.cc:493] T 8edcf9960f41476794c70fe555756dbb P 1434bfe58c7247788e5d93c7d2bd8de1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:10.057557  1089 raft_consensus.cc:3060] T 8edcf9960f41476794c70fe555756dbb P 1434bfe58c7247788e5d93c7d2bd8de1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:10.062377  1089 raft_consensus.cc:515] T 8edcf9960f41476794c70fe555756dbb P 1434bfe58c7247788e5d93c7d2bd8de1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:10.063915  1089 leader_election.cc:290] T 8edcf9960f41476794c70fe555756dbb P 1434bfe58c7247788e5d93c7d2bd8de1 [CANDIDATE]: Term 3 election: Requested vote from peers bbfb7e6be0904729bcda079b53965aef (127.0.107.194:45551), c97e97cff3474b0fb542619cb94dcd8c (127.0.107.195:43677)
I20260709 12:58:10.064801  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8edcf9960f41476794c70fe555756dbb" candidate_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bbfb7e6be0904729bcda079b53965aef"
I20260709 12:58:10.064963  1240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8edcf9960f41476794c70fe555756dbb" candidate_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c97e97cff3474b0fb542619cb94dcd8c"
I20260709 12:58:10.065346  1167 raft_consensus.cc:3055] T 8edcf9960f41476794c70fe555756dbb P bbfb7e6be0904729bcda079b53965aef [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:10.065478  1240 raft_consensus.cc:3060] T 8edcf9960f41476794c70fe555756dbb P c97e97cff3474b0fb542619cb94dcd8c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:10.065645  1167 raft_consensus.cc:740] T 8edcf9960f41476794c70fe555756dbb P bbfb7e6be0904729bcda079b53965aef [term 2 LEADER]: Becoming Follower/Learner. State: Replica: bbfb7e6be0904729bcda079b53965aef, State: Running, Role: LEADER
I20260709 12:58:10.066323  1167 consensus_queue.cc:260] T 8edcf9960f41476794c70fe555756dbb P bbfb7e6be0904729bcda079b53965aef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:10.067159  1167 raft_consensus.cc:3060] T 8edcf9960f41476794c70fe555756dbb P bbfb7e6be0904729bcda079b53965aef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:10.070508  1240 raft_consensus.cc:2468] T 8edcf9960f41476794c70fe555756dbb P c97e97cff3474b0fb542619cb94dcd8c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1434bfe58c7247788e5d93c7d2bd8de1 in term 3.
I20260709 12:58:10.070968  1167 raft_consensus.cc:2468] T 8edcf9960f41476794c70fe555756dbb P bbfb7e6be0904729bcda079b53965aef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1434bfe58c7247788e5d93c7d2bd8de1 in term 3.
I20260709 12:58:10.071614  1057 leader_election.cc:304] T 8edcf9960f41476794c70fe555756dbb P 1434bfe58c7247788e5d93c7d2bd8de1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1434bfe58c7247788e5d93c7d2bd8de1, c97e97cff3474b0fb542619cb94dcd8c; no voters: 
I20260709 12:58:10.072497  1380 raft_consensus.cc:2804] T 8edcf9960f41476794c70fe555756dbb P 1434bfe58c7247788e5d93c7d2bd8de1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:10.072913  1380 raft_consensus.cc:697] T 8edcf9960f41476794c70fe555756dbb P 1434bfe58c7247788e5d93c7d2bd8de1 [term 3 LEADER]: Becoming Leader. State: Replica: 1434bfe58c7247788e5d93c7d2bd8de1, State: Running, Role: LEADER
I20260709 12:58:10.073622  1380 consensus_queue.cc:237] T 8edcf9960f41476794c70fe555756dbb P 1434bfe58c7247788e5d93c7d2bd8de1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:10.080147   990 catalog_manager.cc:5697] T 8edcf9960f41476794c70fe555756dbb P 1434bfe58c7247788e5d93c7d2bd8de1 reported cstate change: term changed from 2 to 3, leader changed from bbfb7e6be0904729bcda079b53965aef (127.0.107.194) to 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:10.242947  1376 raft_consensus.cc:993] T 38eeded1fce24dec92c5aa10aa9ac846 P c97e97cff3474b0fb542619cb94dcd8c: : Instructing follower 1434bfe58c7247788e5d93c7d2bd8de1 to start an election
I20260709 12:58:10.243510  1395 raft_consensus.cc:1081] T 38eeded1fce24dec92c5aa10aa9ac846 P c97e97cff3474b0fb542619cb94dcd8c [term 3 LEADER]: Signalling peer 1434bfe58c7247788e5d93c7d2bd8de1 to start an election
I20260709 12:58:10.244830  1089 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "38eeded1fce24dec92c5aa10aa9ac846"
dest_uuid: "1434bfe58c7247788e5d93c7d2bd8de1"
 from {username='slave'} at 127.0.0.1:36944
I20260709 12:58:10.245221  1089 raft_consensus.cc:493] T 38eeded1fce24dec92c5aa10aa9ac846 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:10.245440  1089 raft_consensus.cc:3060] T 38eeded1fce24dec92c5aa10aa9ac846 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:10.249647  1089 raft_consensus.cc:515] T 38eeded1fce24dec92c5aa10aa9ac846 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:10.251171  1089 leader_election.cc:290] T 38eeded1fce24dec92c5aa10aa9ac846 P 1434bfe58c7247788e5d93c7d2bd8de1 [CANDIDATE]: Term 4 election: Requested vote from peers bbfb7e6be0904729bcda079b53965aef (127.0.107.194:45551), c97e97cff3474b0fb542619cb94dcd8c (127.0.107.195:43677)
I20260709 12:58:10.251606  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38eeded1fce24dec92c5aa10aa9ac846" candidate_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "bbfb7e6be0904729bcda079b53965aef"
I20260709 12:58:10.252120  1167 raft_consensus.cc:3060] T 38eeded1fce24dec92c5aa10aa9ac846 P bbfb7e6be0904729bcda079b53965aef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:10.252092  1240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38eeded1fce24dec92c5aa10aa9ac846" candidate_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c97e97cff3474b0fb542619cb94dcd8c"
I20260709 12:58:10.252700  1240 raft_consensus.cc:3055] T 38eeded1fce24dec92c5aa10aa9ac846 P c97e97cff3474b0fb542619cb94dcd8c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:10.252920  1240 raft_consensus.cc:740] T 38eeded1fce24dec92c5aa10aa9ac846 P c97e97cff3474b0fb542619cb94dcd8c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c97e97cff3474b0fb542619cb94dcd8c, State: Running, Role: LEADER
I20260709 12:58:10.253527  1240 consensus_queue.cc:260] T 38eeded1fce24dec92c5aa10aa9ac846 P c97e97cff3474b0fb542619cb94dcd8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:10.254333  1240 raft_consensus.cc:3060] T 38eeded1fce24dec92c5aa10aa9ac846 P c97e97cff3474b0fb542619cb94dcd8c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:10.256389  1167 raft_consensus.cc:2468] T 38eeded1fce24dec92c5aa10aa9ac846 P bbfb7e6be0904729bcda079b53965aef [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1434bfe58c7247788e5d93c7d2bd8de1 in term 4.
I20260709 12:58:10.257472  1055 leader_election.cc:304] T 38eeded1fce24dec92c5aa10aa9ac846 P 1434bfe58c7247788e5d93c7d2bd8de1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1434bfe58c7247788e5d93c7d2bd8de1, bbfb7e6be0904729bcda079b53965aef; no voters: 
I20260709 12:58:10.258095  1380 raft_consensus.cc:2804] T 38eeded1fce24dec92c5aa10aa9ac846 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:10.258569  1380 raft_consensus.cc:697] T 38eeded1fce24dec92c5aa10aa9ac846 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 4 LEADER]: Becoming Leader. State: Replica: 1434bfe58c7247788e5d93c7d2bd8de1, State: Running, Role: LEADER
I20260709 12:58:10.258596  1240 raft_consensus.cc:2468] T 38eeded1fce24dec92c5aa10aa9ac846 P c97e97cff3474b0fb542619cb94dcd8c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1434bfe58c7247788e5d93c7d2bd8de1 in term 4.
I20260709 12:58:10.259567  1380 consensus_queue.cc:237] T 38eeded1fce24dec92c5aa10aa9ac846 P 1434bfe58c7247788e5d93c7d2bd8de1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:10.268091   990 catalog_manager.cc:5697] T 38eeded1fce24dec92c5aa10aa9ac846 P 1434bfe58c7247788e5d93c7d2bd8de1 reported cstate change: term changed from 3 to 4, leader changed from c97e97cff3474b0fb542619cb94dcd8c (127.0.107.195) to 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:10.274657  1376 raft_consensus.cc:993] T 9574c9ab5cd1491cbc8b01f3c89d4149 P c97e97cff3474b0fb542619cb94dcd8c: : Instructing follower 1434bfe58c7247788e5d93c7d2bd8de1 to start an election
I20260709 12:58:10.275183  1395 raft_consensus.cc:1081] T 9574c9ab5cd1491cbc8b01f3c89d4149 P c97e97cff3474b0fb542619cb94dcd8c [term 3 LEADER]: Signalling peer 1434bfe58c7247788e5d93c7d2bd8de1 to start an election
I20260709 12:58:10.276842  1089 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9574c9ab5cd1491cbc8b01f3c89d4149"
dest_uuid: "1434bfe58c7247788e5d93c7d2bd8de1"
 from {username='slave'} at 127.0.0.1:36944
I20260709 12:58:10.277326  1089 raft_consensus.cc:493] T 9574c9ab5cd1491cbc8b01f3c89d4149 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:10.277624  1089 raft_consensus.cc:3060] T 9574c9ab5cd1491cbc8b01f3c89d4149 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:10.283082  1089 raft_consensus.cc:515] T 9574c9ab5cd1491cbc8b01f3c89d4149 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:10.284509  1089 leader_election.cc:290] T 9574c9ab5cd1491cbc8b01f3c89d4149 P 1434bfe58c7247788e5d93c7d2bd8de1 [CANDIDATE]: Term 4 election: Requested vote from peers bbfb7e6be0904729bcda079b53965aef (127.0.107.194:45551), c97e97cff3474b0fb542619cb94dcd8c (127.0.107.195:43677)
I20260709 12:58:10.285028  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9574c9ab5cd1491cbc8b01f3c89d4149" candidate_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "bbfb7e6be0904729bcda079b53965aef"
I20260709 12:58:10.285566  1167 raft_consensus.cc:3060] T 9574c9ab5cd1491cbc8b01f3c89d4149 P bbfb7e6be0904729bcda079b53965aef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:10.285634  1240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9574c9ab5cd1491cbc8b01f3c89d4149" candidate_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c97e97cff3474b0fb542619cb94dcd8c"
I20260709 12:58:10.286195  1240 raft_consensus.cc:3055] T 9574c9ab5cd1491cbc8b01f3c89d4149 P c97e97cff3474b0fb542619cb94dcd8c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:10.286429  1240 raft_consensus.cc:740] T 9574c9ab5cd1491cbc8b01f3c89d4149 P c97e97cff3474b0fb542619cb94dcd8c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c97e97cff3474b0fb542619cb94dcd8c, State: Running, Role: LEADER
I20260709 12:58:10.287052  1240 consensus_queue.cc:260] T 9574c9ab5cd1491cbc8b01f3c89d4149 P c97e97cff3474b0fb542619cb94dcd8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:10.287878  1240 raft_consensus.cc:3060] T 9574c9ab5cd1491cbc8b01f3c89d4149 P c97e97cff3474b0fb542619cb94dcd8c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:10.289678  1167 raft_consensus.cc:2468] T 9574c9ab5cd1491cbc8b01f3c89d4149 P bbfb7e6be0904729bcda079b53965aef [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1434bfe58c7247788e5d93c7d2bd8de1 in term 4.
I20260709 12:58:10.290530  1055 leader_election.cc:304] T 9574c9ab5cd1491cbc8b01f3c89d4149 P 1434bfe58c7247788e5d93c7d2bd8de1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1434bfe58c7247788e5d93c7d2bd8de1, bbfb7e6be0904729bcda079b53965aef; no voters: 
I20260709 12:58:10.291173  1380 raft_consensus.cc:2804] T 9574c9ab5cd1491cbc8b01f3c89d4149 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:10.291668  1380 raft_consensus.cc:697] T 9574c9ab5cd1491cbc8b01f3c89d4149 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 4 LEADER]: Becoming Leader. State: Replica: 1434bfe58c7247788e5d93c7d2bd8de1, State: Running, Role: LEADER
I20260709 12:58:10.292814  1240 raft_consensus.cc:2468] T 9574c9ab5cd1491cbc8b01f3c89d4149 P c97e97cff3474b0fb542619cb94dcd8c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1434bfe58c7247788e5d93c7d2bd8de1 in term 4.
I20260709 12:58:10.292654  1380 consensus_queue.cc:237] T 9574c9ab5cd1491cbc8b01f3c89d4149 P 1434bfe58c7247788e5d93c7d2bd8de1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:10.298235   990 catalog_manager.cc:5697] T 9574c9ab5cd1491cbc8b01f3c89d4149 P 1434bfe58c7247788e5d93c7d2bd8de1 reported cstate change: term changed from 3 to 4, leader changed from c97e97cff3474b0fb542619cb94dcd8c (127.0.107.195) to 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:10.368394  1167 raft_consensus.cc:1275] T 6a0104eca382490a8ec51916203c8b59 P bbfb7e6be0904729bcda079b53965aef [term 2 FOLLOWER]: Refusing update from remote peer 1434bfe58c7247788e5d93c7d2bd8de1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:10.369683  1380 consensus_queue.cc:1048] T 6a0104eca382490a8ec51916203c8b59 P 1434bfe58c7247788e5d93c7d2bd8de1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:10.378909  1240 raft_consensus.cc:1275] T 6a0104eca382490a8ec51916203c8b59 P c97e97cff3474b0fb542619cb94dcd8c [term 2 FOLLOWER]: Refusing update from remote peer 1434bfe58c7247788e5d93c7d2bd8de1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:10.381040  1406 consensus_queue.cc:1048] T 6a0104eca382490a8ec51916203c8b59 P 1434bfe58c7247788e5d93c7d2bd8de1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:10.466758  1167 raft_consensus.cc:1275] T 53866543b96a4b7c975007d75efde33e P bbfb7e6be0904729bcda079b53965aef [term 2 FOLLOWER]: Refusing update from remote peer 1434bfe58c7247788e5d93c7d2bd8de1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:10.468103  1406 consensus_queue.cc:1048] T 53866543b96a4b7c975007d75efde33e P 1434bfe58c7247788e5d93c7d2bd8de1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:10.477258  1240 raft_consensus.cc:1275] T 53866543b96a4b7c975007d75efde33e P c97e97cff3474b0fb542619cb94dcd8c [term 2 FOLLOWER]: Refusing update from remote peer 1434bfe58c7247788e5d93c7d2bd8de1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:10.480859  1411 consensus_queue.cc:1048] T 53866543b96a4b7c975007d75efde33e P 1434bfe58c7247788e5d93c7d2bd8de1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:10.532682  1240 raft_consensus.cc:1275] T 8edcf9960f41476794c70fe555756dbb P c97e97cff3474b0fb542619cb94dcd8c [term 3 FOLLOWER]: Refusing update from remote peer 1434bfe58c7247788e5d93c7d2bd8de1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:10.533797  1411 consensus_queue.cc:1048] T 8edcf9960f41476794c70fe555756dbb P 1434bfe58c7247788e5d93c7d2bd8de1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:10.542436  1167 raft_consensus.cc:1275] T 8edcf9960f41476794c70fe555756dbb P bbfb7e6be0904729bcda079b53965aef [term 3 FOLLOWER]: Refusing update from remote peer 1434bfe58c7247788e5d93c7d2bd8de1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:10.543869  1406 consensus_queue.cc:1048] T 8edcf9960f41476794c70fe555756dbb P 1434bfe58c7247788e5d93c7d2bd8de1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:10.755894  1167 raft_consensus.cc:1275] T 9574c9ab5cd1491cbc8b01f3c89d4149 P bbfb7e6be0904729bcda079b53965aef [term 4 FOLLOWER]: Refusing update from remote peer 1434bfe58c7247788e5d93c7d2bd8de1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:10.757182  1406 consensus_queue.cc:1048] T 9574c9ab5cd1491cbc8b01f3c89d4149 P 1434bfe58c7247788e5d93c7d2bd8de1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:10.767205  1240 raft_consensus.cc:1275] T 9574c9ab5cd1491cbc8b01f3c89d4149 P c97e97cff3474b0fb542619cb94dcd8c [term 4 FOLLOWER]: Refusing update from remote peer 1434bfe58c7247788e5d93c7d2bd8de1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:10.769126  1406 consensus_queue.cc:1048] T 9574c9ab5cd1491cbc8b01f3c89d4149 P 1434bfe58c7247788e5d93c7d2bd8de1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:10.784000  1240 raft_consensus.cc:1275] T 38eeded1fce24dec92c5aa10aa9ac846 P c97e97cff3474b0fb542619cb94dcd8c [term 4 FOLLOWER]: Refusing update from remote peer 1434bfe58c7247788e5d93c7d2bd8de1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:10.785261  1417 consensus_queue.cc:1048] T 38eeded1fce24dec92c5aa10aa9ac846 P 1434bfe58c7247788e5d93c7d2bd8de1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:10.789263  1167 raft_consensus.cc:1275] T 38eeded1fce24dec92c5aa10aa9ac846 P bbfb7e6be0904729bcda079b53965aef [term 4 FOLLOWER]: Refusing update from remote peer 1434bfe58c7247788e5d93c7d2bd8de1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:10.790455  1417 consensus_queue.cc:1048] T 38eeded1fce24dec92c5aa10aa9ac846 P 1434bfe58c7247788e5d93c7d2bd8de1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:12.817420   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:12.825821  1089 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38eeded1fce24dec92c5aa10aa9ac846"
dest_uuid: "1434bfe58c7247788e5d93c7d2bd8de1"
mode: GRACEFUL
new_leader_uuid: "bbfb7e6be0904729bcda079b53965aef"
 from {username='slave'} at 127.0.0.1:36966
I20260709 12:58:12.826339  1089 raft_consensus.cc:606] T 38eeded1fce24dec92c5aa10aa9ac846 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 4 LEADER]: Received request to transfer leadership to TS bbfb7e6be0904729bcda079b53965aef
I20260709 12:58:12.828728  1089 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a0104eca382490a8ec51916203c8b59"
dest_uuid: "1434bfe58c7247788e5d93c7d2bd8de1"
mode: GRACEFUL
new_leader_uuid: "c97e97cff3474b0fb542619cb94dcd8c"
 from {username='slave'} at 127.0.0.1:36966
I20260709 12:58:12.829201  1089 raft_consensus.cc:606] T 6a0104eca382490a8ec51916203c8b59 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 2 LEADER]: Received request to transfer leadership to TS c97e97cff3474b0fb542619cb94dcd8c
I20260709 12:58:12.831586  1089 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8edcf9960f41476794c70fe555756dbb"
dest_uuid: "1434bfe58c7247788e5d93c7d2bd8de1"
mode: GRACEFUL
new_leader_uuid: "c97e97cff3474b0fb542619cb94dcd8c"
 from {username='slave'} at 127.0.0.1:36966
I20260709 12:58:12.832063  1089 raft_consensus.cc:606] T 8edcf9960f41476794c70fe555756dbb P 1434bfe58c7247788e5d93c7d2bd8de1 [term 3 LEADER]: Received request to transfer leadership to TS c97e97cff3474b0fb542619cb94dcd8c
I20260709 12:58:12.834393  1089 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf5299056e9042429bd51aee9ccf6844"
dest_uuid: "1434bfe58c7247788e5d93c7d2bd8de1"
mode: GRACEFUL
new_leader_uuid: "bbfb7e6be0904729bcda079b53965aef"
 from {username='slave'} at 127.0.0.1:36966
I20260709 12:58:12.834923  1089 raft_consensus.cc:606] T bf5299056e9042429bd51aee9ccf6844 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 2 LEADER]: Received request to transfer leadership to TS bbfb7e6be0904729bcda079b53965aef
I20260709 12:58:12.835942   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:58:12.836402   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:58:12.853852  1421 raft_consensus.cc:993] T 6a0104eca382490a8ec51916203c8b59 P 1434bfe58c7247788e5d93c7d2bd8de1: : Instructing follower c97e97cff3474b0fb542619cb94dcd8c to start an election
I20260709 12:58:12.854409  1354 raft_consensus.cc:1081] T 6a0104eca382490a8ec51916203c8b59 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 2 LEADER]: Signalling peer c97e97cff3474b0fb542619cb94dcd8c to start an election
I20260709 12:58:12.855757  1241 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a0104eca382490a8ec51916203c8b59"
dest_uuid: "c97e97cff3474b0fb542619cb94dcd8c"
 from {username='slave'} at 127.0.0.1:52904
I20260709 12:58:12.856211  1241 raft_consensus.cc:493] T 6a0104eca382490a8ec51916203c8b59 P c97e97cff3474b0fb542619cb94dcd8c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:12.856588  1241 raft_consensus.cc:3060] T 6a0104eca382490a8ec51916203c8b59 P c97e97cff3474b0fb542619cb94dcd8c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:12.861136  1241 raft_consensus.cc:515] T 6a0104eca382490a8ec51916203c8b59 P c97e97cff3474b0fb542619cb94dcd8c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:12.862823  1241 leader_election.cc:290] T 6a0104eca382490a8ec51916203c8b59 P c97e97cff3474b0fb542619cb94dcd8c [CANDIDATE]: Term 3 election: Requested vote from peers 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193:34795), bbfb7e6be0904729bcda079b53965aef (127.0.107.194:45551)
I20260709 12:58:12.863547  1089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0104eca382490a8ec51916203c8b59" candidate_uuid: "c97e97cff3474b0fb542619cb94dcd8c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1434bfe58c7247788e5d93c7d2bd8de1"
I20260709 12:58:12.863945  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a0104eca382490a8ec51916203c8b59" candidate_uuid: "c97e97cff3474b0fb542619cb94dcd8c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "bbfb7e6be0904729bcda079b53965aef"
I20260709 12:58:12.864073  1089 raft_consensus.cc:3055] T 6a0104eca382490a8ec51916203c8b59 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:12.864490  1167 raft_consensus.cc:3060] T 6a0104eca382490a8ec51916203c8b59 P bbfb7e6be0904729bcda079b53965aef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:12.864447  1089 raft_consensus.cc:740] T 6a0104eca382490a8ec51916203c8b59 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1434bfe58c7247788e5d93c7d2bd8de1, State: Running, Role: LEADER
I20260709 12:58:12.865322  1089 consensus_queue.cc:260] T 6a0104eca382490a8ec51916203c8b59 P 1434bfe58c7247788e5d93c7d2bd8de1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:12.866377  1089 raft_consensus.cc:3060] T 6a0104eca382490a8ec51916203c8b59 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:12.870497  1167 raft_consensus.cc:2468] T 6a0104eca382490a8ec51916203c8b59 P bbfb7e6be0904729bcda079b53965aef [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c97e97cff3474b0fb542619cb94dcd8c in term 3.
I20260709 12:58:12.871783  1204 leader_election.cc:304] T 6a0104eca382490a8ec51916203c8b59 P c97e97cff3474b0fb542619cb94dcd8c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bbfb7e6be0904729bcda079b53965aef, c97e97cff3474b0fb542619cb94dcd8c; no voters: 
I20260709 12:58:12.872596  1089 raft_consensus.cc:2468] T 6a0104eca382490a8ec51916203c8b59 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c97e97cff3474b0fb542619cb94dcd8c in term 3.
I20260709 12:58:12.872577  1395 raft_consensus.cc:2804] T 6a0104eca382490a8ec51916203c8b59 P c97e97cff3474b0fb542619cb94dcd8c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:12.873740  1395 raft_consensus.cc:697] T 6a0104eca382490a8ec51916203c8b59 P c97e97cff3474b0fb542619cb94dcd8c [term 3 LEADER]: Becoming Leader. State: Replica: c97e97cff3474b0fb542619cb94dcd8c, State: Running, Role: LEADER
I20260709 12:58:12.874459  1395 consensus_queue.cc:237] T 6a0104eca382490a8ec51916203c8b59 P c97e97cff3474b0fb542619cb94dcd8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:12.880478   990 catalog_manager.cc:5697] T 6a0104eca382490a8ec51916203c8b59 P c97e97cff3474b0fb542619cb94dcd8c reported cstate change: term changed from 2 to 3, leader changed from 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193) to c97e97cff3474b0fb542619cb94dcd8c (127.0.107.195). New cstate: current_term: 3 leader_uuid: "c97e97cff3474b0fb542619cb94dcd8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:12.976383  1354 raft_consensus.cc:993] T 38eeded1fce24dec92c5aa10aa9ac846 P 1434bfe58c7247788e5d93c7d2bd8de1: : Instructing follower bbfb7e6be0904729bcda079b53965aef to start an election
I20260709 12:58:12.976840  1421 raft_consensus.cc:1081] T 38eeded1fce24dec92c5aa10aa9ac846 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 4 LEADER]: Signalling peer bbfb7e6be0904729bcda079b53965aef to start an election
I20260709 12:58:12.978382  1167 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "38eeded1fce24dec92c5aa10aa9ac846"
dest_uuid: "bbfb7e6be0904729bcda079b53965aef"
 from {username='slave'} at 127.0.0.1:53016
I20260709 12:58:12.978907  1167 raft_consensus.cc:493] T 38eeded1fce24dec92c5aa10aa9ac846 P bbfb7e6be0904729bcda079b53965aef [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:12.979198  1167 raft_consensus.cc:3060] T 38eeded1fce24dec92c5aa10aa9ac846 P bbfb7e6be0904729bcda079b53965aef [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:12.983635  1167 raft_consensus.cc:515] T 38eeded1fce24dec92c5aa10aa9ac846 P bbfb7e6be0904729bcda079b53965aef [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:12.985575  1167 leader_election.cc:290] T 38eeded1fce24dec92c5aa10aa9ac846 P bbfb7e6be0904729bcda079b53965aef [CANDIDATE]: Term 5 election: Requested vote from peers 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193:34795), c97e97cff3474b0fb542619cb94dcd8c (127.0.107.195:43677)
I20260709 12:58:12.986754  1241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38eeded1fce24dec92c5aa10aa9ac846" candidate_uuid: "bbfb7e6be0904729bcda079b53965aef" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "c97e97cff3474b0fb542619cb94dcd8c"
I20260709 12:58:12.986665  1089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38eeded1fce24dec92c5aa10aa9ac846" candidate_uuid: "bbfb7e6be0904729bcda079b53965aef" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "1434bfe58c7247788e5d93c7d2bd8de1"
I20260709 12:58:12.987344  1241 raft_consensus.cc:3060] T 38eeded1fce24dec92c5aa10aa9ac846 P c97e97cff3474b0fb542619cb94dcd8c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:12.987563  1089 raft_consensus.cc:3055] T 38eeded1fce24dec92c5aa10aa9ac846 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:58:12.987869  1089 raft_consensus.cc:740] T 38eeded1fce24dec92c5aa10aa9ac846 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1434bfe58c7247788e5d93c7d2bd8de1, State: Running, Role: LEADER
I20260709 12:58:12.988580  1089 consensus_queue.cc:260] T 38eeded1fce24dec92c5aa10aa9ac846 P 1434bfe58c7247788e5d93c7d2bd8de1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:12.989387  1089 raft_consensus.cc:3060] T 38eeded1fce24dec92c5aa10aa9ac846 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:58:12.992378  1241 raft_consensus.cc:2468] T 38eeded1fce24dec92c5aa10aa9ac846 P c97e97cff3474b0fb542619cb94dcd8c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbfb7e6be0904729bcda079b53965aef in term 5.
I20260709 12:58:12.993434  1089 raft_consensus.cc:2468] T 38eeded1fce24dec92c5aa10aa9ac846 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbfb7e6be0904729bcda079b53965aef in term 5.
I20260709 12:58:12.993702  1132 leader_election.cc:304] T 38eeded1fce24dec92c5aa10aa9ac846 P bbfb7e6be0904729bcda079b53965aef [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bbfb7e6be0904729bcda079b53965aef, c97e97cff3474b0fb542619cb94dcd8c; no voters: 
I20260709 12:58:12.994556  1397 raft_consensus.cc:2804] T 38eeded1fce24dec92c5aa10aa9ac846 P bbfb7e6be0904729bcda079b53965aef [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:58:12.995509  1397 raft_consensus.cc:697] T 38eeded1fce24dec92c5aa10aa9ac846 P bbfb7e6be0904729bcda079b53965aef [term 5 LEADER]: Becoming Leader. State: Replica: bbfb7e6be0904729bcda079b53965aef, State: Running, Role: LEADER
I20260709 12:58:12.996308  1397 consensus_queue.cc:237] T 38eeded1fce24dec92c5aa10aa9ac846 P bbfb7e6be0904729bcda079b53965aef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:13.002781   990 catalog_manager.cc:5697] T 38eeded1fce24dec92c5aa10aa9ac846 P bbfb7e6be0904729bcda079b53965aef reported cstate change: term changed from 4 to 5, leader changed from 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193) to bbfb7e6be0904729bcda079b53965aef (127.0.107.194). New cstate: current_term: 5 leader_uuid: "bbfb7e6be0904729bcda079b53965aef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:13.235620  1354 raft_consensus.cc:993] T bf5299056e9042429bd51aee9ccf6844 P 1434bfe58c7247788e5d93c7d2bd8de1: : Instructing follower bbfb7e6be0904729bcda079b53965aef to start an election
I20260709 12:58:13.236078  1354 raft_consensus.cc:1081] T bf5299056e9042429bd51aee9ccf6844 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 2 LEADER]: Signalling peer bbfb7e6be0904729bcda079b53965aef to start an election
I20260709 12:58:13.237730  1167 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bf5299056e9042429bd51aee9ccf6844"
dest_uuid: "bbfb7e6be0904729bcda079b53965aef"
 from {username='slave'} at 127.0.0.1:53016
I20260709 12:58:13.238214  1167 raft_consensus.cc:493] T bf5299056e9042429bd51aee9ccf6844 P bbfb7e6be0904729bcda079b53965aef [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:13.238516  1167 raft_consensus.cc:3060] T bf5299056e9042429bd51aee9ccf6844 P bbfb7e6be0904729bcda079b53965aef [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:13.243043  1167 raft_consensus.cc:515] T bf5299056e9042429bd51aee9ccf6844 P bbfb7e6be0904729bcda079b53965aef [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } } peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } }
I20260709 12:58:13.244624  1167 leader_election.cc:290] T bf5299056e9042429bd51aee9ccf6844 P bbfb7e6be0904729bcda079b53965aef [CANDIDATE]: Term 3 election: Requested vote from peers c97e97cff3474b0fb542619cb94dcd8c (127.0.107.195:43677), 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193:34795)
I20260709 12:58:13.245420  1241 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5299056e9042429bd51aee9ccf6844" candidate_uuid: "bbfb7e6be0904729bcda079b53965aef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c97e97cff3474b0fb542619cb94dcd8c"
I20260709 12:58:13.245743  1089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf5299056e9042429bd51aee9ccf6844" candidate_uuid: "bbfb7e6be0904729bcda079b53965aef" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1434bfe58c7247788e5d93c7d2bd8de1"
I20260709 12:58:13.246016  1241 raft_consensus.cc:3060] T bf5299056e9042429bd51aee9ccf6844 P c97e97cff3474b0fb542619cb94dcd8c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:13.246269  1089 raft_consensus.cc:3055] T bf5299056e9042429bd51aee9ccf6844 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:13.246608  1089 raft_consensus.cc:740] T bf5299056e9042429bd51aee9ccf6844 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1434bfe58c7247788e5d93c7d2bd8de1, State: Running, Role: LEADER
I20260709 12:58:13.247232  1089 consensus_queue.cc:260] T bf5299056e9042429bd51aee9ccf6844 P 1434bfe58c7247788e5d93c7d2bd8de1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } } peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } }
I20260709 12:58:13.248136  1089 raft_consensus.cc:3060] T bf5299056e9042429bd51aee9ccf6844 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:13.253558  1089 raft_consensus.cc:2468] T bf5299056e9042429bd51aee9ccf6844 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbfb7e6be0904729bcda079b53965aef in term 3.
I20260709 12:58:13.253630  1241 raft_consensus.cc:2468] T bf5299056e9042429bd51aee9ccf6844 P c97e97cff3474b0fb542619cb94dcd8c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bbfb7e6be0904729bcda079b53965aef in term 3.
I20260709 12:58:13.254650  1133 leader_election.cc:304] T bf5299056e9042429bd51aee9ccf6844 P bbfb7e6be0904729bcda079b53965aef [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1434bfe58c7247788e5d93c7d2bd8de1, bbfb7e6be0904729bcda079b53965aef; no voters: 
I20260709 12:58:13.255394  1397 raft_consensus.cc:2804] T bf5299056e9042429bd51aee9ccf6844 P bbfb7e6be0904729bcda079b53965aef [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:13.255905  1397 raft_consensus.cc:697] T bf5299056e9042429bd51aee9ccf6844 P bbfb7e6be0904729bcda079b53965aef [term 3 LEADER]: Becoming Leader. State: Replica: bbfb7e6be0904729bcda079b53965aef, State: Running, Role: LEADER
I20260709 12:58:13.256788  1397 consensus_queue.cc:237] T bf5299056e9042429bd51aee9ccf6844 P bbfb7e6be0904729bcda079b53965aef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } } peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } }
I20260709 12:58:13.263335   990 catalog_manager.cc:5697] T bf5299056e9042429bd51aee9ccf6844 P bbfb7e6be0904729bcda079b53965aef reported cstate change: term changed from 2 to 3, leader changed from 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193) to bbfb7e6be0904729bcda079b53965aef (127.0.107.194). New cstate: current_term: 3 leader_uuid: "bbfb7e6be0904729bcda079b53965aef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:13.326786  1421 raft_consensus.cc:993] T 8edcf9960f41476794c70fe555756dbb P 1434bfe58c7247788e5d93c7d2bd8de1: : Instructing follower c97e97cff3474b0fb542619cb94dcd8c to start an election
I20260709 12:58:13.327226  1354 raft_consensus.cc:1081] T 8edcf9960f41476794c70fe555756dbb P 1434bfe58c7247788e5d93c7d2bd8de1 [term 3 LEADER]: Signalling peer c97e97cff3474b0fb542619cb94dcd8c to start an election
I20260709 12:58:13.328707  1241 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8edcf9960f41476794c70fe555756dbb"
dest_uuid: "c97e97cff3474b0fb542619cb94dcd8c"
 from {username='slave'} at 127.0.0.1:52904
I20260709 12:58:13.329224  1241 raft_consensus.cc:493] T 8edcf9960f41476794c70fe555756dbb P c97e97cff3474b0fb542619cb94dcd8c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:13.329547  1241 raft_consensus.cc:3060] T 8edcf9960f41476794c70fe555756dbb P c97e97cff3474b0fb542619cb94dcd8c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:13.334125  1241 raft_consensus.cc:515] T 8edcf9960f41476794c70fe555756dbb P c97e97cff3474b0fb542619cb94dcd8c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:13.335659  1241 leader_election.cc:290] T 8edcf9960f41476794c70fe555756dbb P c97e97cff3474b0fb542619cb94dcd8c [CANDIDATE]: Term 4 election: Requested vote from peers 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193:34795), bbfb7e6be0904729bcda079b53965aef (127.0.107.194:45551)
I20260709 12:58:13.336293  1089 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8edcf9960f41476794c70fe555756dbb" candidate_uuid: "c97e97cff3474b0fb542619cb94dcd8c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1434bfe58c7247788e5d93c7d2bd8de1"
I20260709 12:58:13.336647  1167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8edcf9960f41476794c70fe555756dbb" candidate_uuid: "c97e97cff3474b0fb542619cb94dcd8c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "bbfb7e6be0904729bcda079b53965aef"
I20260709 12:58:13.336853  1089 raft_consensus.cc:3055] T 8edcf9960f41476794c70fe555756dbb P 1434bfe58c7247788e5d93c7d2bd8de1 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:58:13.337162  1167 raft_consensus.cc:3060] T 8edcf9960f41476794c70fe555756dbb P bbfb7e6be0904729bcda079b53965aef [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:13.337167  1089 raft_consensus.cc:740] T 8edcf9960f41476794c70fe555756dbb P 1434bfe58c7247788e5d93c7d2bd8de1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1434bfe58c7247788e5d93c7d2bd8de1, State: Running, Role: LEADER
I20260709 12:58:13.337883  1089 consensus_queue.cc:260] T 8edcf9960f41476794c70fe555756dbb P 1434bfe58c7247788e5d93c7d2bd8de1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:13.338722  1089 raft_consensus.cc:3060] T 8edcf9960f41476794c70fe555756dbb P 1434bfe58c7247788e5d93c7d2bd8de1 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:58:13.341491  1167 raft_consensus.cc:2468] T 8edcf9960f41476794c70fe555756dbb P bbfb7e6be0904729bcda079b53965aef [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c97e97cff3474b0fb542619cb94dcd8c in term 4.
I20260709 12:58:13.342516  1204 leader_election.cc:304] T 8edcf9960f41476794c70fe555756dbb P c97e97cff3474b0fb542619cb94dcd8c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bbfb7e6be0904729bcda079b53965aef, c97e97cff3474b0fb542619cb94dcd8c; no voters: 
I20260709 12:58:13.342739  1089 raft_consensus.cc:2468] T 8edcf9960f41476794c70fe555756dbb P 1434bfe58c7247788e5d93c7d2bd8de1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c97e97cff3474b0fb542619cb94dcd8c in term 4.
I20260709 12:58:13.343269  1395 raft_consensus.cc:2804] T 8edcf9960f41476794c70fe555756dbb P c97e97cff3474b0fb542619cb94dcd8c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:58:13.343756  1395 raft_consensus.cc:697] T 8edcf9960f41476794c70fe555756dbb P c97e97cff3474b0fb542619cb94dcd8c [term 4 LEADER]: Becoming Leader. State: Replica: c97e97cff3474b0fb542619cb94dcd8c, State: Running, Role: LEADER
I20260709 12:58:13.344470  1395 consensus_queue.cc:237] T 8edcf9960f41476794c70fe555756dbb P c97e97cff3474b0fb542619cb94dcd8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } }
I20260709 12:58:13.350626   990 catalog_manager.cc:5697] T 8edcf9960f41476794c70fe555756dbb P c97e97cff3474b0fb542619cb94dcd8c reported cstate change: term changed from 3 to 4, leader changed from 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193) to c97e97cff3474b0fb542619cb94dcd8c (127.0.107.195). New cstate: current_term: 4 leader_uuid: "c97e97cff3474b0fb542619cb94dcd8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:13.396807  1167 raft_consensus.cc:1275] T 6a0104eca382490a8ec51916203c8b59 P bbfb7e6be0904729bcda079b53965aef [term 3 FOLLOWER]: Refusing update from remote peer c97e97cff3474b0fb542619cb94dcd8c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:13.398257  1395 consensus_queue.cc:1048] T 6a0104eca382490a8ec51916203c8b59 P c97e97cff3474b0fb542619cb94dcd8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:13.410133  1089 raft_consensus.cc:1275] T 6a0104eca382490a8ec51916203c8b59 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 3 FOLLOWER]: Refusing update from remote peer c97e97cff3474b0fb542619cb94dcd8c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:13.411401  1422 consensus_queue.cc:1048] T 6a0104eca382490a8ec51916203c8b59 P c97e97cff3474b0fb542619cb94dcd8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:13.573062  1241 raft_consensus.cc:1275] T 38eeded1fce24dec92c5aa10aa9ac846 P c97e97cff3474b0fb542619cb94dcd8c [term 5 FOLLOWER]: Refusing update from remote peer bbfb7e6be0904729bcda079b53965aef: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:58:13.574168  1397 consensus_queue.cc:1048] T 38eeded1fce24dec92c5aa10aa9ac846 P bbfb7e6be0904729bcda079b53965aef [LEADER]: Connected to new peer: Peer: permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:13.583034  1089 raft_consensus.cc:1275] T 38eeded1fce24dec92c5aa10aa9ac846 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 5 FOLLOWER]: Refusing update from remote peer bbfb7e6be0904729bcda079b53965aef: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:58:13.584517  1428 consensus_queue.cc:1048] T 38eeded1fce24dec92c5aa10aa9ac846 P bbfb7e6be0904729bcda079b53965aef [LEADER]: Connected to new peer: Peer: permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:13.639217  1089 raft_consensus.cc:1275] T bf5299056e9042429bd51aee9ccf6844 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 3 FOLLOWER]: Refusing update from remote peer bbfb7e6be0904729bcda079b53965aef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:13.640460  1439 consensus_queue.cc:1048] T bf5299056e9042429bd51aee9ccf6844 P bbfb7e6be0904729bcda079b53965aef [LEADER]: Connected to new peer: Peer: permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:13.649196  1241 raft_consensus.cc:1275] T bf5299056e9042429bd51aee9ccf6844 P c97e97cff3474b0fb542619cb94dcd8c [term 3 FOLLOWER]: Refusing update from remote peer bbfb7e6be0904729bcda079b53965aef: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:13.650898  1397 consensus_queue.cc:1048] T bf5299056e9042429bd51aee9ccf6844 P bbfb7e6be0904729bcda079b53965aef [LEADER]: Connected to new peer: Peer: permanent_uuid: "c97e97cff3474b0fb542619cb94dcd8c" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:13.750610  1167 raft_consensus.cc:1275] T 8edcf9960f41476794c70fe555756dbb P bbfb7e6be0904729bcda079b53965aef [term 4 FOLLOWER]: Refusing update from remote peer c97e97cff3474b0fb542619cb94dcd8c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:13.751739  1422 consensus_queue.cc:1048] T 8edcf9960f41476794c70fe555756dbb P c97e97cff3474b0fb542619cb94dcd8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "bbfb7e6be0904729bcda079b53965aef" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 45551 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:13.760142  1089 raft_consensus.cc:1275] T 8edcf9960f41476794c70fe555756dbb P 1434bfe58c7247788e5d93c7d2bd8de1 [term 4 FOLLOWER]: Refusing update from remote peer c97e97cff3474b0fb542619cb94dcd8c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:58:13.761547  1422 consensus_queue.cc:1048] T 8edcf9960f41476794c70fe555756dbb P c97e97cff3474b0fb542619cb94dcd8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1434bfe58c7247788e5d93c7d2bd8de1" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34795 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:13.837158   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:13.842660   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 12:58:13.868000   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:58:13.868832   431 tablet_replica.cc:333] T bf5299056e9042429bd51aee9ccf6844 P 1434bfe58c7247788e5d93c7d2bd8de1: stopping tablet replica
I20260709 12:58:13.869423   431 raft_consensus.cc:2243] T bf5299056e9042429bd51aee9ccf6844 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:13.869895   431 raft_consensus.cc:2272] T bf5299056e9042429bd51aee9ccf6844 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:13.872109   431 tablet_replica.cc:333] T 6a0104eca382490a8ec51916203c8b59 P 1434bfe58c7247788e5d93c7d2bd8de1: stopping tablet replica
I20260709 12:58:13.872754   431 raft_consensus.cc:2243] T 6a0104eca382490a8ec51916203c8b59 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:13.873181   431 raft_consensus.cc:2272] T 6a0104eca382490a8ec51916203c8b59 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:13.875480   431 tablet_replica.cc:333] T 9574c9ab5cd1491cbc8b01f3c89d4149 P 1434bfe58c7247788e5d93c7d2bd8de1: stopping tablet replica
I20260709 12:58:13.876040   431 raft_consensus.cc:2243] T 9574c9ab5cd1491cbc8b01f3c89d4149 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:58:13.876864   431 raft_consensus.cc:2272] T 9574c9ab5cd1491cbc8b01f3c89d4149 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:13.878564   431 tablet_replica.cc:333] T 6eab0d4cbaa04172bc4320b9c3847715 P 1434bfe58c7247788e5d93c7d2bd8de1: stopping tablet replica
I20260709 12:58:13.879094   431 raft_consensus.cc:2243] T 6eab0d4cbaa04172bc4320b9c3847715 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:13.879544   431 raft_consensus.cc:2272] T 6eab0d4cbaa04172bc4320b9c3847715 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:13.881309   431 tablet_replica.cc:333] T 614a5c8953cf490b85161067f062e80c P 1434bfe58c7247788e5d93c7d2bd8de1: stopping tablet replica
I20260709 12:58:13.881843   431 raft_consensus.cc:2243] T 614a5c8953cf490b85161067f062e80c P 1434bfe58c7247788e5d93c7d2bd8de1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:58:13.882598   431 raft_consensus.cc:2272] T 614a5c8953cf490b85161067f062e80c P 1434bfe58c7247788e5d93c7d2bd8de1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:13.884262   431 tablet_replica.cc:333] T 38eeded1fce24dec92c5aa10aa9ac846 P 1434bfe58c7247788e5d93c7d2bd8de1: stopping tablet replica
I20260709 12:58:13.884848   431 raft_consensus.cc:2243] T 38eeded1fce24dec92c5aa10aa9ac846 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:13.885267   431 raft_consensus.cc:2272] T 38eeded1fce24dec92c5aa10aa9ac846 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:13.887328   431 tablet_replica.cc:333] T cf73b42e520b432098cf08c6c32141ba P 1434bfe58c7247788e5d93c7d2bd8de1: stopping tablet replica
I20260709 12:58:13.887862   431 raft_consensus.cc:2243] T cf73b42e520b432098cf08c6c32141ba P 1434bfe58c7247788e5d93c7d2bd8de1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:13.888320   431 raft_consensus.cc:2272] T cf73b42e520b432098cf08c6c32141ba P 1434bfe58c7247788e5d93c7d2bd8de1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:13.890048   431 tablet_replica.cc:333] T 53866543b96a4b7c975007d75efde33e P 1434bfe58c7247788e5d93c7d2bd8de1: stopping tablet replica
I20260709 12:58:13.890542   431 raft_consensus.cc:2243] T 53866543b96a4b7c975007d75efde33e P 1434bfe58c7247788e5d93c7d2bd8de1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:58:13.891232   431 raft_consensus.cc:2272] T 53866543b96a4b7c975007d75efde33e P 1434bfe58c7247788e5d93c7d2bd8de1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:13.892886   431 tablet_replica.cc:333] T 8edcf9960f41476794c70fe555756dbb P 1434bfe58c7247788e5d93c7d2bd8de1: stopping tablet replica
I20260709 12:58:13.893366   431 raft_consensus.cc:2243] T 8edcf9960f41476794c70fe555756dbb P 1434bfe58c7247788e5d93c7d2bd8de1 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:13.893775   431 raft_consensus.cc:2272] T 8edcf9960f41476794c70fe555756dbb P 1434bfe58c7247788e5d93c7d2bd8de1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:13.895714   431 tablet_replica.cc:333] T 36813a3559ff43a893c148b091a60090 P 1434bfe58c7247788e5d93c7d2bd8de1: stopping tablet replica
I20260709 12:58:13.896222   431 raft_consensus.cc:2243] T 36813a3559ff43a893c148b091a60090 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:58:13.897037   431 raft_consensus.cc:2272] T 36813a3559ff43a893c148b091a60090 P 1434bfe58c7247788e5d93c7d2bd8de1 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:58:13.904084  1133 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 9 similar messages]
W20260709 12:58:13.906989  1133 consensus_peers.cc:597] T 6eab0d4cbaa04172bc4320b9c3847715 P bbfb7e6be0904729bcda079b53965aef -> Peer 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193:34795): Couldn't send request to peer 1434bfe58c7247788e5d93c7d2bd8de1. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:13.919705   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
I20260709 12:58:13.939494   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 12:58:13.962577   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:58:13.963397   431 tablet_replica.cc:333] T cf73b42e520b432098cf08c6c32141ba P bbfb7e6be0904729bcda079b53965aef: stopping tablet replica
I20260709 12:58:13.964030   431 raft_consensus.cc:2243] T cf73b42e520b432098cf08c6c32141ba P bbfb7e6be0904729bcda079b53965aef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:13.964620   431 raft_consensus.cc:2272] T cf73b42e520b432098cf08c6c32141ba P bbfb7e6be0904729bcda079b53965aef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:13.966611   431 tablet_replica.cc:333] T 8edcf9960f41476794c70fe555756dbb P bbfb7e6be0904729bcda079b53965aef: stopping tablet replica
I20260709 12:58:13.967232   431 raft_consensus.cc:2243] T 8edcf9960f41476794c70fe555756dbb P bbfb7e6be0904729bcda079b53965aef [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:13.967732   431 raft_consensus.cc:2272] T 8edcf9960f41476794c70fe555756dbb P bbfb7e6be0904729bcda079b53965aef [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:13.970142   431 tablet_replica.cc:333] T 53866543b96a4b7c975007d75efde33e P bbfb7e6be0904729bcda079b53965aef: stopping tablet replica
I20260709 12:58:13.970726   431 raft_consensus.cc:2243] T 53866543b96a4b7c975007d75efde33e P bbfb7e6be0904729bcda079b53965aef [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:13.971168   431 raft_consensus.cc:2272] T 53866543b96a4b7c975007d75efde33e P bbfb7e6be0904729bcda079b53965aef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:13.973043   431 tablet_replica.cc:333] T 9574c9ab5cd1491cbc8b01f3c89d4149 P bbfb7e6be0904729bcda079b53965aef: stopping tablet replica
I20260709 12:58:13.973613   431 raft_consensus.cc:2243] T 9574c9ab5cd1491cbc8b01f3c89d4149 P bbfb7e6be0904729bcda079b53965aef [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:13.974035   431 raft_consensus.cc:2272] T 9574c9ab5cd1491cbc8b01f3c89d4149 P bbfb7e6be0904729bcda079b53965aef [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:13.975769   431 tablet_replica.cc:333] T 6a0104eca382490a8ec51916203c8b59 P bbfb7e6be0904729bcda079b53965aef: stopping tablet replica
I20260709 12:58:13.976361   431 raft_consensus.cc:2243] T 6a0104eca382490a8ec51916203c8b59 P bbfb7e6be0904729bcda079b53965aef [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:13.976898   431 raft_consensus.cc:2272] T 6a0104eca382490a8ec51916203c8b59 P bbfb7e6be0904729bcda079b53965aef [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:13.978873   431 tablet_replica.cc:333] T bf5299056e9042429bd51aee9ccf6844 P bbfb7e6be0904729bcda079b53965aef: stopping tablet replica
I20260709 12:58:13.979445   431 raft_consensus.cc:2243] T bf5299056e9042429bd51aee9ccf6844 P bbfb7e6be0904729bcda079b53965aef [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:58:13.980226   431 raft_consensus.cc:2272] T bf5299056e9042429bd51aee9ccf6844 P bbfb7e6be0904729bcda079b53965aef [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:13.982301   431 tablet_replica.cc:333] T 36813a3559ff43a893c148b091a60090 P bbfb7e6be0904729bcda079b53965aef: stopping tablet replica
I20260709 12:58:13.982869   431 raft_consensus.cc:2243] T 36813a3559ff43a893c148b091a60090 P bbfb7e6be0904729bcda079b53965aef [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:13.983366   431 raft_consensus.cc:2272] T 36813a3559ff43a893c148b091a60090 P bbfb7e6be0904729bcda079b53965aef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:13.985230   431 tablet_replica.cc:333] T 38eeded1fce24dec92c5aa10aa9ac846 P bbfb7e6be0904729bcda079b53965aef: stopping tablet replica
I20260709 12:58:13.985764   431 raft_consensus.cc:2243] T 38eeded1fce24dec92c5aa10aa9ac846 P bbfb7e6be0904729bcda079b53965aef [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:58:13.986544   431 raft_consensus.cc:2272] T 38eeded1fce24dec92c5aa10aa9ac846 P bbfb7e6be0904729bcda079b53965aef [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:13.988842   431 tablet_replica.cc:333] T 6eab0d4cbaa04172bc4320b9c3847715 P bbfb7e6be0904729bcda079b53965aef: stopping tablet replica
I20260709 12:58:13.989358   431 raft_consensus.cc:2243] T 6eab0d4cbaa04172bc4320b9c3847715 P bbfb7e6be0904729bcda079b53965aef [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:58:13.990115   431 raft_consensus.cc:2272] T 6eab0d4cbaa04172bc4320b9c3847715 P bbfb7e6be0904729bcda079b53965aef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:13.991854   431 tablet_replica.cc:333] T 614a5c8953cf490b85161067f062e80c P bbfb7e6be0904729bcda079b53965aef: stopping tablet replica
I20260709 12:58:13.992314   431 raft_consensus.cc:2243] T 614a5c8953cf490b85161067f062e80c P bbfb7e6be0904729bcda079b53965aef [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:13.992787   431 raft_consensus.cc:2272] T 614a5c8953cf490b85161067f062e80c P bbfb7e6be0904729bcda079b53965aef [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:58:14.016054  1207 consensus_peers.cc:597] T 6a0104eca382490a8ec51916203c8b59 P c97e97cff3474b0fb542619cb94dcd8c -> Peer 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193:34795): Couldn't send request to peer 1434bfe58c7247788e5d93c7d2bd8de1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34795: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:58:14.016654  1207 consensus_peers.cc:597] T cf73b42e520b432098cf08c6c32141ba P c97e97cff3474b0fb542619cb94dcd8c -> Peer 1434bfe58c7247788e5d93c7d2bd8de1 (127.0.107.193:34795): Couldn't send request to peer 1434bfe58c7247788e5d93c7d2bd8de1. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34795: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:14.019214   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
W20260709 12:58:14.019802  1204 consensus_peers.cc:597] T cf73b42e520b432098cf08c6c32141ba P c97e97cff3474b0fb542619cb94dcd8c -> Peer bbfb7e6be0904729bcda079b53965aef (127.0.107.194:45551): Couldn't send request to peer bbfb7e6be0904729bcda079b53965aef. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:45551: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:14.037416   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 12:58:14.062057   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:58:14.062963   431 tablet_replica.cc:333] T cf73b42e520b432098cf08c6c32141ba P c97e97cff3474b0fb542619cb94dcd8c: stopping tablet replica
I20260709 12:58:14.063719   431 raft_consensus.cc:2243] T cf73b42e520b432098cf08c6c32141ba P c97e97cff3474b0fb542619cb94dcd8c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:58:14.064431   431 raft_consensus.cc:2272] T cf73b42e520b432098cf08c6c32141ba P c97e97cff3474b0fb542619cb94dcd8c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:14.066174   431 tablet_replica.cc:333] T 53866543b96a4b7c975007d75efde33e P c97e97cff3474b0fb542619cb94dcd8c: stopping tablet replica
I20260709 12:58:14.066634   431 raft_consensus.cc:2243] T 53866543b96a4b7c975007d75efde33e P c97e97cff3474b0fb542619cb94dcd8c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:14.066984   431 raft_consensus.cc:2272] T 53866543b96a4b7c975007d75efde33e P c97e97cff3474b0fb542619cb94dcd8c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:14.068419   431 tablet_replica.cc:333] T 8edcf9960f41476794c70fe555756dbb P c97e97cff3474b0fb542619cb94dcd8c: stopping tablet replica
I20260709 12:58:14.068993   431 raft_consensus.cc:2243] T 8edcf9960f41476794c70fe555756dbb P c97e97cff3474b0fb542619cb94dcd8c [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:58:14.069635   431 raft_consensus.cc:2272] T 8edcf9960f41476794c70fe555756dbb P c97e97cff3474b0fb542619cb94dcd8c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:14.071617   431 tablet_replica.cc:333] T 38eeded1fce24dec92c5aa10aa9ac846 P c97e97cff3474b0fb542619cb94dcd8c: stopping tablet replica
I20260709 12:58:14.072037   431 raft_consensus.cc:2243] T 38eeded1fce24dec92c5aa10aa9ac846 P c97e97cff3474b0fb542619cb94dcd8c [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:14.072373   431 raft_consensus.cc:2272] T 38eeded1fce24dec92c5aa10aa9ac846 P c97e97cff3474b0fb542619cb94dcd8c [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:14.074947   431 tablet_replica.cc:333] T 6eab0d4cbaa04172bc4320b9c3847715 P c97e97cff3474b0fb542619cb94dcd8c: stopping tablet replica
I20260709 12:58:14.075390   431 raft_consensus.cc:2243] T 6eab0d4cbaa04172bc4320b9c3847715 P c97e97cff3474b0fb542619cb94dcd8c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:14.075737   431 raft_consensus.cc:2272] T 6eab0d4cbaa04172bc4320b9c3847715 P c97e97cff3474b0fb542619cb94dcd8c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:14.077283   431 tablet_replica.cc:333] T 614a5c8953cf490b85161067f062e80c P c97e97cff3474b0fb542619cb94dcd8c: stopping tablet replica
I20260709 12:58:14.077708   431 raft_consensus.cc:2243] T 614a5c8953cf490b85161067f062e80c P c97e97cff3474b0fb542619cb94dcd8c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:14.078045   431 raft_consensus.cc:2272] T 614a5c8953cf490b85161067f062e80c P c97e97cff3474b0fb542619cb94dcd8c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:14.079476   431 tablet_replica.cc:333] T 6a0104eca382490a8ec51916203c8b59 P c97e97cff3474b0fb542619cb94dcd8c: stopping tablet replica
I20260709 12:58:14.079892   431 raft_consensus.cc:2243] T 6a0104eca382490a8ec51916203c8b59 P c97e97cff3474b0fb542619cb94dcd8c [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:58:14.080596   431 raft_consensus.cc:2272] T 6a0104eca382490a8ec51916203c8b59 P c97e97cff3474b0fb542619cb94dcd8c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:14.082370   431 tablet_replica.cc:333] T bf5299056e9042429bd51aee9ccf6844 P c97e97cff3474b0fb542619cb94dcd8c: stopping tablet replica
I20260709 12:58:14.082783   431 raft_consensus.cc:2243] T bf5299056e9042429bd51aee9ccf6844 P c97e97cff3474b0fb542619cb94dcd8c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:14.083123   431 raft_consensus.cc:2272] T bf5299056e9042429bd51aee9ccf6844 P c97e97cff3474b0fb542619cb94dcd8c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:14.085043   431 tablet_replica.cc:333] T 9574c9ab5cd1491cbc8b01f3c89d4149 P c97e97cff3474b0fb542619cb94dcd8c: stopping tablet replica
I20260709 12:58:14.085457   431 raft_consensus.cc:2243] T 9574c9ab5cd1491cbc8b01f3c89d4149 P c97e97cff3474b0fb542619cb94dcd8c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:14.085800   431 raft_consensus.cc:2272] T 9574c9ab5cd1491cbc8b01f3c89d4149 P c97e97cff3474b0fb542619cb94dcd8c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:14.087138   431 tablet_replica.cc:333] T 36813a3559ff43a893c148b091a60090 P c97e97cff3474b0fb542619cb94dcd8c: stopping tablet replica
I20260709 12:58:14.087500   431 raft_consensus.cc:2243] T 36813a3559ff43a893c148b091a60090 P c97e97cff3474b0fb542619cb94dcd8c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:14.087831   431 raft_consensus.cc:2272] T 36813a3559ff43a893c148b091a60090 P c97e97cff3474b0fb542619cb94dcd8c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:14.116768   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 12:58:14.137079   431 master.cc:562] Master@127.0.107.254:41301 shutting down...
I20260709 12:58:14.159344   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P d3fd0d228a0f488d8ea861ce7325f864 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:58:14.159996   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P d3fd0d228a0f488d8ea861ce7325f864 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:14.160326   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P d3fd0d228a0f488d8ea861ce7325f864: stopping tablet replica
I20260709 12:58:14.181738   431 master.cc:584] Master@127.0.107.254:41301 shutdown complete.
1434bfe58c7247788e5d93c7d2bd8de1  5
bbfb7e6be0904729bcda079b53965aef  4
c97e97cff3474b0fb542619cb94dcd8c  1
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (10331 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:58:14.226398   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:42827
I20260709 12:58:14.227689   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:14.234249  1450 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:14.234345  1449 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:14.234705  1452 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:14.237639   431 server_base.cc:1061] running on GCE node
I20260709 12:58:14.238379   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:14.238611   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:14.238730   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601894238718 us; error 0 us; skew 500 ppm
I20260709 12:58:14.239177   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:14.241648   431 webserver.cc:533] Webserver started at http://127.0.107.254:37825/ using document root <none> and password file <none>
I20260709 12:58:14.242079   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:14.242233   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:14.242463   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:14.243491   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601869227091-431-0/minicluster-data/master-0-root/instance:
uuid: "fcfaa17e55ae48e194c5d95ca24a659f"
format_stamp: "Formatted at 2026-07-09 12:58:14 on dist-test-slave-5mzn"
I20260709 12:58:14.247836   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.005s
I20260709 12:58:14.251240  1457 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:14.251952   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 12:58:14.252243   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601869227091-431-0/minicluster-data/master-0-root
uuid: "fcfaa17e55ae48e194c5d95ca24a659f"
format_stamp: "Formatted at 2026-07-09 12:58:14 on dist-test-slave-5mzn"
I20260709 12:58:14.252554   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601869227091-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601869227091-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601869227091-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:14.294342   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:14.296162   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:14.342926   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:42827
I20260709 12:58:14.343034  1508 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:42827 every 8 connection(s)
I20260709 12:58:14.347190  1509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:14.358053  1509 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fcfaa17e55ae48e194c5d95ca24a659f: Bootstrap starting.
I20260709 12:58:14.363173  1509 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fcfaa17e55ae48e194c5d95ca24a659f: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:14.367535  1509 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fcfaa17e55ae48e194c5d95ca24a659f: No bootstrap required, opened a new log
I20260709 12:58:14.369829  1509 raft_consensus.cc:359] T 00000000000000000000000000000000 P fcfaa17e55ae48e194c5d95ca24a659f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcfaa17e55ae48e194c5d95ca24a659f" member_type: VOTER }
I20260709 12:58:14.370241  1509 raft_consensus.cc:385] T 00000000000000000000000000000000 P fcfaa17e55ae48e194c5d95ca24a659f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:14.370440  1509 raft_consensus.cc:740] T 00000000000000000000000000000000 P fcfaa17e55ae48e194c5d95ca24a659f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fcfaa17e55ae48e194c5d95ca24a659f, State: Initialized, Role: FOLLOWER
I20260709 12:58:14.370945  1509 consensus_queue.cc:260] T 00000000000000000000000000000000 P fcfaa17e55ae48e194c5d95ca24a659f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcfaa17e55ae48e194c5d95ca24a659f" member_type: VOTER }
I20260709 12:58:14.371389  1509 raft_consensus.cc:399] T 00000000000000000000000000000000 P fcfaa17e55ae48e194c5d95ca24a659f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:58:14.371608  1509 raft_consensus.cc:493] T 00000000000000000000000000000000 P fcfaa17e55ae48e194c5d95ca24a659f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:58:14.371838  1509 raft_consensus.cc:3060] T 00000000000000000000000000000000 P fcfaa17e55ae48e194c5d95ca24a659f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:14.410436  1509 raft_consensus.cc:515] T 00000000000000000000000000000000 P fcfaa17e55ae48e194c5d95ca24a659f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcfaa17e55ae48e194c5d95ca24a659f" member_type: VOTER }
I20260709 12:58:14.411038  1509 leader_election.cc:304] T 00000000000000000000000000000000 P fcfaa17e55ae48e194c5d95ca24a659f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fcfaa17e55ae48e194c5d95ca24a659f; no voters: 
I20260709 12:58:14.412320  1509 leader_election.cc:290] T 00000000000000000000000000000000 P fcfaa17e55ae48e194c5d95ca24a659f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:58:14.412745  1512 raft_consensus.cc:2804] T 00000000000000000000000000000000 P fcfaa17e55ae48e194c5d95ca24a659f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:14.415122  1509 sys_catalog.cc:565] T 00000000000000000000000000000000 P fcfaa17e55ae48e194c5d95ca24a659f [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:58:14.416391  1512 raft_consensus.cc:697] T 00000000000000000000000000000000 P fcfaa17e55ae48e194c5d95ca24a659f [term 1 LEADER]: Becoming Leader. State: Replica: fcfaa17e55ae48e194c5d95ca24a659f, State: Running, Role: LEADER
I20260709 12:58:14.417104  1512 consensus_queue.cc:237] T 00000000000000000000000000000000 P fcfaa17e55ae48e194c5d95ca24a659f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcfaa17e55ae48e194c5d95ca24a659f" member_type: VOTER }
I20260709 12:58:14.421866  1514 sys_catalog.cc:455] T 00000000000000000000000000000000 P fcfaa17e55ae48e194c5d95ca24a659f [sys.catalog]: SysCatalogTable state changed. Reason: New leader fcfaa17e55ae48e194c5d95ca24a659f. Latest consensus state: current_term: 1 leader_uuid: "fcfaa17e55ae48e194c5d95ca24a659f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcfaa17e55ae48e194c5d95ca24a659f" member_type: VOTER } }
I20260709 12:58:14.422660  1514 sys_catalog.cc:458] T 00000000000000000000000000000000 P fcfaa17e55ae48e194c5d95ca24a659f [sys.catalog]: This master's current role is: LEADER
I20260709 12:58:14.422382  1513 sys_catalog.cc:455] T 00000000000000000000000000000000 P fcfaa17e55ae48e194c5d95ca24a659f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fcfaa17e55ae48e194c5d95ca24a659f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fcfaa17e55ae48e194c5d95ca24a659f" member_type: VOTER } }
I20260709 12:58:14.423830  1513 sys_catalog.cc:458] T 00000000000000000000000000000000 P fcfaa17e55ae48e194c5d95ca24a659f [sys.catalog]: This master's current role is: LEADER
I20260709 12:58:14.426715  1522 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:58:14.434429  1522 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:58:14.435423   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:58:14.442991  1522 catalog_manager.cc:1383] Generated new cluster ID: dd77c6745cc84f00ac8f883b1b1831ad
I20260709 12:58:14.443254  1522 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:58:14.458890  1522 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:58:14.460358  1522 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:58:14.475529  1522 catalog_manager.cc:6070] T 00000000000000000000000000000000 P fcfaa17e55ae48e194c5d95ca24a659f: Generated new TSK 0
I20260709 12:58:14.476048  1522 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:58:14.502383   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:14.508060  1530 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:14.509210  1531 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:14.511354  1533 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:14.514222   431 server_base.cc:1061] running on GCE node
I20260709 12:58:14.515031   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:14.515232   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:14.515419   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601894515374 us; error 0 us; skew 500 ppm
I20260709 12:58:14.516227   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:14.518810   431 webserver.cc:533] Webserver started at http://127.0.107.193:40579/ using document root <none> and password file <none>
I20260709 12:58:14.519286   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:14.519486   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:14.519758   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:14.520860   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601869227091-431-0/minicluster-data/ts-0-root/instance:
uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
format_stamp: "Formatted at 2026-07-09 12:58:14 on dist-test-slave-5mzn"
I20260709 12:58:14.525571   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:58:14.529059  1538 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:14.530040   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.002s
I20260709 12:58:14.530308   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601869227091-431-0/minicluster-data/ts-0-root
uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
format_stamp: "Formatted at 2026-07-09 12:58:14 on dist-test-slave-5mzn"
I20260709 12:58:14.530604   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601869227091-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601869227091-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601869227091-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:14.545917   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:14.547254   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:14.548873   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:58:14.551323   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:58:14.551544   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:14.551870   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:58:14.552065   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:14.597260   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:34373
I20260709 12:58:14.597342  1600 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:34373 every 8 connection(s)
I20260709 12:58:14.602555   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:14.610570  1605 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:14.611498  1606 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:14.615455   431 server_base.cc:1061] running on GCE node
W20260709 12:58:14.615531  1608 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:14.617141   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:14.617359   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:14.617527   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601894617513 us; error 0 us; skew 500 ppm
I20260709 12:58:14.618170   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:14.620877   431 webserver.cc:533] Webserver started at http://127.0.107.194:43873/ using document root <none> and password file <none>
I20260709 12:58:14.621421   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:14.621660   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:14.621816  1601 heartbeater.cc:344] Connected to a master server at 127.0.107.254:42827
I20260709 12:58:14.621970   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:14.622205  1601 heartbeater.cc:461] Registering TS with master...
I20260709 12:58:14.622968  1601 heartbeater.cc:507] Master 127.0.107.254:42827 requested a full tablet report, sending...
I20260709 12:58:14.623268   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601869227091-431-0/minicluster-data/ts-1-root/instance:
uuid: "4dbe7d47a2374afca075d3a98583b49e"
format_stamp: "Formatted at 2026-07-09 12:58:14 on dist-test-slave-5mzn"
I20260709 12:58:14.625100  1474 ts_manager.cc:194] Registered new tserver with Master: 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373)
I20260709 12:58:14.626936  1474 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55606
I20260709 12:58:14.628508   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.000s	sys 0.007s
I20260709 12:58:14.632337  1613 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:14.633201   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:58:14.633569   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601869227091-431-0/minicluster-data/ts-1-root
uuid: "4dbe7d47a2374afca075d3a98583b49e"
format_stamp: "Formatted at 2026-07-09 12:58:14 on dist-test-slave-5mzn"
I20260709 12:58:14.633867   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601869227091-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601869227091-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601869227091-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:14.645869   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:14.647032   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:14.648430   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:58:14.650615   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:58:14.650835   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:14.651077   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:58:14.651281   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:14.695719   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:37391
I20260709 12:58:14.695815  1675 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:37391 every 8 connection(s)
I20260709 12:58:14.700585   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:14.707775  1679 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:14.709761  1680 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:14.713538  1676 heartbeater.cc:344] Connected to a master server at 127.0.107.254:42827
I20260709 12:58:14.713943  1676 heartbeater.cc:461] Registering TS with master...
W20260709 12:58:14.713786  1682 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:14.714629   431 server_base.cc:1061] running on GCE node
I20260709 12:58:14.714910  1676 heartbeater.cc:507] Master 127.0.107.254:42827 requested a full tablet report, sending...
I20260709 12:58:14.715648   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:14.715943   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:14.716156   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601894716108 us; error 0 us; skew 500 ppm
I20260709 12:58:14.716918   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:14.717388  1474 ts_manager.cc:194] Registered new tserver with Master: 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:14.719769   431 webserver.cc:533] Webserver started at http://127.0.107.195:33007/ using document root <none> and password file <none>
I20260709 12:58:14.720153  1474 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55620
I20260709 12:58:14.720412   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:14.720713   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:14.721028   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:14.722524   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601869227091-431-0/minicluster-data/ts-2-root/instance:
uuid: "0c7751452c4b46afa95251b9df7169d4"
format_stamp: "Formatted at 2026-07-09 12:58:14 on dist-test-slave-5mzn"
I20260709 12:58:14.728169   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 12:58:14.731941  1687 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:14.732848   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:58:14.733150   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601869227091-431-0/minicluster-data/ts-2-root
uuid: "0c7751452c4b46afa95251b9df7169d4"
format_stamp: "Formatted at 2026-07-09 12:58:14 on dist-test-slave-5mzn"
I20260709 12:58:14.733387   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601869227091-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601869227091-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601869227091-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:14.745257   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:14.746510   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:14.747953   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:58:14.750330   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:58:14.750555   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:14.750844   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:58:14.751053   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:14.795737   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:45473
I20260709 12:58:14.795825  1749 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:45473 every 8 connection(s)
I20260709 12:58:14.811067  1750 heartbeater.cc:344] Connected to a master server at 127.0.107.254:42827
I20260709 12:58:14.811498  1750 heartbeater.cc:461] Registering TS with master...
I20260709 12:58:14.812156  1750 heartbeater.cc:507] Master 127.0.107.254:42827 requested a full tablet report, sending...
I20260709 12:58:14.814046  1474 ts_manager.cc:194] Registered new tserver with Master: 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:14.815148   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015133995s
I20260709 12:58:14.815276  1474 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55626
I20260709 12:58:14.841773  1474 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55640:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:58:14.847772  1474 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:58:15.077641  1712 tablet_service.cc:1511] Processing CreateTablet for tablet 3ba8e707693e4af2b8347a4bad4dfd67 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:58:15.079169  1712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ba8e707693e4af2b8347a4bad4dfd67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.080360  1713 tablet_service.cc:1511] Processing CreateTablet for tablet 9ec2114c988b4a38a63b42293dcf1757 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:58:15.081789  1713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ec2114c988b4a38a63b42293dcf1757. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.082746  1715 tablet_service.cc:1511] Processing CreateTablet for tablet 66c434748d1745f7ab1d4bf5a8d9e85d (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:58:15.084122  1715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66c434748d1745f7ab1d4bf5a8d9e85d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.084286  1566 tablet_service.cc:1511] Processing CreateTablet for tablet 66c434748d1745f7ab1d4bf5a8d9e85d (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:58:15.085636  1566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66c434748d1745f7ab1d4bf5a8d9e85d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.091010  1714 tablet_service.cc:1511] Processing CreateTablet for tablet cb7e5d62da7842a3829b9f8247d9899c (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:58:15.092423  1714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb7e5d62da7842a3829b9f8247d9899c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.093643  1640 tablet_service.cc:1511] Processing CreateTablet for tablet cb7e5d62da7842a3829b9f8247d9899c (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:58:15.095044  1640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb7e5d62da7842a3829b9f8247d9899c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.097787  1565 tablet_service.cc:1511] Processing CreateTablet for tablet cb7e5d62da7842a3829b9f8247d9899c (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:58:15.099120  1565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb7e5d62da7842a3829b9f8247d9899c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.100055  1560 tablet_service.cc:1511] Processing CreateTablet for tablet 091ce8e86e49437b8fffb903bd5ce2fb (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:58:15.100594  1711 tablet_service.cc:1511] Processing CreateTablet for tablet dfcb63b9010d4a77ad8748087fa07f8a (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:58:15.100890  1713 tablet_service.cc:1511] Processing CreateTablet for tablet a0203dcfbe4440c790f2bf709bd16179 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:58:15.101547  1560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 091ce8e86e49437b8fffb903bd5ce2fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.102121  1711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfcb63b9010d4a77ad8748087fa07f8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.106269  1765 tablet_bootstrap.cc:492] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4: Bootstrap starting.
I20260709 12:58:15.105806  1639 tablet_service.cc:1511] Processing CreateTablet for tablet 9ec2114c988b4a38a63b42293dcf1757 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:58:15.106932  1564 tablet_service.cc:1511] Processing CreateTablet for tablet 9ec2114c988b4a38a63b42293dcf1757 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:58:15.107899  1639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ec2114c988b4a38a63b42293dcf1757. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.108186  1564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ec2114c988b4a38a63b42293dcf1757. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.109650  1638 tablet_service.cc:1511] Processing CreateTablet for tablet 3ba8e707693e4af2b8347a4bad4dfd67 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:58:15.110980  1638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ba8e707693e4af2b8347a4bad4dfd67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.105806  1561 tablet_service.cc:1511] Processing CreateTablet for tablet dfcb63b9010d4a77ad8748087fa07f8a (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:58:15.113332  1561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfcb63b9010d4a77ad8748087fa07f8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.113644  1563 tablet_service.cc:1511] Processing CreateTablet for tablet 3ba8e707693e4af2b8347a4bad4dfd67 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:58:15.114291  1765 tablet_bootstrap.cc:654] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:15.114918  1563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ba8e707693e4af2b8347a4bad4dfd67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.117694  1562 tablet_service.cc:1511] Processing CreateTablet for tablet a0203dcfbe4440c790f2bf709bd16179 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:58:15.122980  1637 tablet_service.cc:1511] Processing CreateTablet for tablet a0203dcfbe4440c790f2bf709bd16179 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:58:15.123580  1641 tablet_service.cc:1511] Processing CreateTablet for tablet 66c434748d1745f7ab1d4bf5a8d9e85d (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:58:15.124329  1637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0203dcfbe4440c790f2bf709bd16179. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.120404  1636 tablet_service.cc:1511] Processing CreateTablet for tablet dfcb63b9010d4a77ad8748087fa07f8a (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:58:15.125782  1636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfcb63b9010d4a77ad8748087fa07f8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.129333  1562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0203dcfbe4440c790f2bf709bd16179. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.131399  1641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 66c434748d1745f7ab1d4bf5a8d9e85d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.153740  1712 tablet_service.cc:1511] Processing CreateTablet for tablet 091ce8e86e49437b8fffb903bd5ce2fb (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:58:15.153784  1635 tablet_service.cc:1511] Processing CreateTablet for tablet 091ce8e86e49437b8fffb903bd5ce2fb (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:58:15.156548  1635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 091ce8e86e49437b8fffb903bd5ce2fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.155144  1712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 091ce8e86e49437b8fffb903bd5ce2fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.172082  1559 tablet_service.cc:1511] Processing CreateTablet for tablet 6eb51aa4d3bf4882a502ada4948b2cc2 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:58:15.173527  1559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6eb51aa4d3bf4882a502ada4948b2cc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.175547  1710 tablet_service.cc:1511] Processing CreateTablet for tablet 6eb51aa4d3bf4882a502ada4948b2cc2 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:58:15.179267  1634 tablet_service.cc:1511] Processing CreateTablet for tablet 6eb51aa4d3bf4882a502ada4948b2cc2 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:58:15.180748  1634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6eb51aa4d3bf4882a502ada4948b2cc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.188841  1633 tablet_service.cc:1511] Processing CreateTablet for tablet 4bc29cd0261846b7847f38862b494d0b (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:58:15.192975  1633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bc29cd0261846b7847f38862b494d0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.187922  1713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0203dcfbe4440c790f2bf709bd16179. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.196653  1710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6eb51aa4d3bf4882a502ada4948b2cc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.197806  1765 tablet_bootstrap.cc:492] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4: No bootstrap required, opened a new log
I20260709 12:58:15.198369  1765 ts_tablet_manager.cc:1403] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4: Time spent bootstrapping tablet: real 0.092s	user 0.024s	sys 0.019s
I20260709 12:58:15.206256  1714 tablet_service.cc:1511] Processing CreateTablet for tablet 4bc29cd0261846b7847f38862b494d0b (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:58:15.207628  1714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bc29cd0261846b7847f38862b494d0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.211155  1765 raft_consensus.cc:359] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:15.213711  1765 raft_consensus.cc:385] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:15.223628  1768 tablet_bootstrap.cc:492] T 9ec2114c988b4a38a63b42293dcf1757 P 4dbe7d47a2374afca075d3a98583b49e: Bootstrap starting.
I20260709 12:58:15.238481  1711 tablet_service.cc:1511] Processing CreateTablet for tablet 477960faa15b4001a5a6361558d69294 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:58:15.240787  1711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 477960faa15b4001a5a6361558d69294. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.248248  1565 tablet_service.cc:1511] Processing CreateTablet for tablet 477960faa15b4001a5a6361558d69294 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:58:15.249634  1565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 477960faa15b4001a5a6361558d69294. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.254307  1562 tablet_service.cc:1511] Processing CreateTablet for tablet 62c04bf03d764babb1a5e3b102527e5f (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:58:15.255641  1562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62c04bf03d764babb1a5e3b102527e5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.255720  1636 tablet_service.cc:1511] Processing CreateTablet for tablet 62c04bf03d764babb1a5e3b102527e5f (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:58:15.257115  1636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62c04bf03d764babb1a5e3b102527e5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.258608  1637 tablet_service.cc:1511] Processing CreateTablet for tablet 477960faa15b4001a5a6361558d69294 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:58:15.259871  1637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 477960faa15b4001a5a6361558d69294. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.269788  1715 tablet_service.cc:1511] Processing CreateTablet for tablet 62c04bf03d764babb1a5e3b102527e5f (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:58:15.270953  1715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62c04bf03d764babb1a5e3b102527e5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.222144  1765 raft_consensus.cc:740] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Initialized, Role: FOLLOWER
I20260709 12:58:15.273324  1765 consensus_queue.cc:260] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:15.232630  1561 tablet_service.cc:1511] Processing CreateTablet for tablet 4bc29cd0261846b7847f38862b494d0b (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:58:15.288177  1562 tablet_service.cc:1511] Processing CreateTablet for tablet f964296f18474862b1eee102af9116f4 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:58:15.292272  1710 tablet_service.cc:1511] Processing CreateTablet for tablet f964296f18474862b1eee102af9116f4 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:58:15.293783  1710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f964296f18474862b1eee102af9116f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.301318  1641 tablet_service.cc:1511] Processing CreateTablet for tablet f964296f18474862b1eee102af9116f4 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:58:15.302487  1768 tablet_bootstrap.cc:654] T 9ec2114c988b4a38a63b42293dcf1757 P 4dbe7d47a2374afca075d3a98583b49e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:15.302707  1641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f964296f18474862b1eee102af9116f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.305244  1560 tablet_service.cc:1511] Processing CreateTablet for tablet c998894dcb744ba3825db19244f8207e (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:58:15.307833  1712 tablet_service.cc:1511] Processing CreateTablet for tablet c998894dcb744ba3825db19244f8207e (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:58:15.309140  1712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c998894dcb744ba3825db19244f8207e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.309237  1767 tablet_bootstrap.cc:492] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Bootstrap starting.
I20260709 12:58:15.320518  1709 tablet_service.cc:1511] Processing CreateTablet for tablet 1aa00507899e41f9b595f503add14c8c (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:58:15.321898  1709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aa00507899e41f9b595f503add14c8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.323161  1638 tablet_service.cc:1511] Processing CreateTablet for tablet c998894dcb744ba3825db19244f8207e (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:58:15.324635  1638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c998894dcb744ba3825db19244f8207e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.327033  1765 ts_tablet_manager.cc:1434] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4: Time spent starting tablet: real 0.128s	user 0.016s	sys 0.007s
I20260709 12:58:15.326759  1634 tablet_service.cc:1511] Processing CreateTablet for tablet 1aa00507899e41f9b595f503add14c8c (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:58:15.320566  1562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f964296f18474862b1eee102af9116f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.327740  1750 heartbeater.cc:499] Master 127.0.107.254:42827 was elected leader, sending a full tablet report...
I20260709 12:58:15.328001  1765 tablet_bootstrap.cc:492] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4: Bootstrap starting.
I20260709 12:58:15.328089  1634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aa00507899e41f9b595f503add14c8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.328840  1560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c998894dcb744ba3825db19244f8207e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.329562  1561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bc29cd0261846b7847f38862b494d0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.321518  1564 tablet_service.cc:1511] Processing CreateTablet for tablet 05713611987147e49a96fdf32bb28649 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:58:15.333343  1564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05713611987147e49a96fdf32bb28649. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.350744  1566 tablet_service.cc:1511] Processing CreateTablet for tablet 1aa00507899e41f9b595f503add14c8c (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:58:15.356787  1765 tablet_bootstrap.cc:654] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:15.362550  1639 tablet_service.cc:1511] Processing CreateTablet for tablet 05713611987147e49a96fdf32bb28649 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:58:15.364130  1639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05713611987147e49a96fdf32bb28649. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.367355  1640 tablet_service.cc:1511] Processing CreateTablet for tablet f8c04e2c99384254b275d20e6d27467b (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:58:15.368625  1640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8c04e2c99384254b275d20e6d27467b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.363831  1559 tablet_service.cc:1511] Processing CreateTablet for tablet f8c04e2c99384254b275d20e6d27467b (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:58:15.381441  1559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8c04e2c99384254b275d20e6d27467b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.410087  1767 tablet_bootstrap.cc:654] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:15.418551  1711 tablet_service.cc:1511] Processing CreateTablet for tablet f8c04e2c99384254b275d20e6d27467b (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:58:15.420849  1711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8c04e2c99384254b275d20e6d27467b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.420892  1563 tablet_service.cc:1511] Processing CreateTablet for tablet 475f4ce2905344b0803209ce7b2e9386 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:58:15.422452  1563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 475f4ce2905344b0803209ce7b2e9386. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:58:15.427150  1521 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:15.433163  1638 tablet_service.cc:1511] Processing CreateTablet for tablet 475f4ce2905344b0803209ce7b2e9386 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:58:15.437027  1566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aa00507899e41f9b595f503add14c8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.437526  1638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 475f4ce2905344b0803209ce7b2e9386. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.455961  1710 tablet_service.cc:1511] Processing CreateTablet for tablet 05713611987147e49a96fdf32bb28649 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:58:15.456514  1768 tablet_bootstrap.cc:492] T 9ec2114c988b4a38a63b42293dcf1757 P 4dbe7d47a2374afca075d3a98583b49e: No bootstrap required, opened a new log
I20260709 12:58:15.460992  1768 ts_tablet_manager.cc:1403] T 9ec2114c988b4a38a63b42293dcf1757 P 4dbe7d47a2374afca075d3a98583b49e: Time spent bootstrapping tablet: real 0.238s	user 0.016s	sys 0.009s
I20260709 12:58:15.461939  1710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05713611987147e49a96fdf32bb28649. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.464244  1768 raft_consensus.cc:359] T 9ec2114c988b4a38a63b42293dcf1757 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:15.465037  1768 raft_consensus.cc:385] T 9ec2114c988b4a38a63b42293dcf1757 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:15.457691  1765 tablet_bootstrap.cc:492] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4: No bootstrap required, opened a new log
I20260709 12:58:15.465353  1768 raft_consensus.cc:740] T 9ec2114c988b4a38a63b42293dcf1757 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Initialized, Role: FOLLOWER
I20260709 12:58:15.467669  1768 consensus_queue.cc:260] T 9ec2114c988b4a38a63b42293dcf1757 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:15.469084  1765 ts_tablet_manager.cc:1403] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4: Time spent bootstrapping tablet: real 0.141s	user 0.022s	sys 0.062s
I20260709 12:58:15.480913  1560 tablet_service.cc:1511] Processing CreateTablet for tablet 2f8dd5957a2647058190fd52f31ec088 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:58:15.482725  1560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f8dd5957a2647058190fd52f31ec088. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.490118  1676 heartbeater.cc:499] Master 127.0.107.254:42827 was elected leader, sending a full tablet report...
I20260709 12:58:15.496997  1765 raft_consensus.cc:359] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:15.497886  1765 raft_consensus.cc:385] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:15.497610  1711 tablet_service.cc:1511] Processing CreateTablet for tablet 475f4ce2905344b0803209ce7b2e9386 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:58:15.498220  1765 raft_consensus.cc:740] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Initialized, Role: FOLLOWER
I20260709 12:58:15.499029  1711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 475f4ce2905344b0803209ce7b2e9386. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.490136  1768 ts_tablet_manager.cc:1434] T 9ec2114c988b4a38a63b42293dcf1757 P 4dbe7d47a2374afca075d3a98583b49e: Time spent starting tablet: real 0.029s	user 0.008s	sys 0.001s
I20260709 12:58:15.506155  1765 consensus_queue.cc:260] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:15.508661  1765 ts_tablet_manager.cc:1434] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4: Time spent starting tablet: real 0.039s	user 0.004s	sys 0.003s
I20260709 12:58:15.508327  1640 tablet_service.cc:1511] Processing CreateTablet for tablet 2f8dd5957a2647058190fd52f31ec088 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:58:15.509723  1765 tablet_bootstrap.cc:492] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4: Bootstrap starting.
I20260709 12:58:15.509889  1640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f8dd5957a2647058190fd52f31ec088. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.510075  1768 tablet_bootstrap.cc:492] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e: Bootstrap starting.
I20260709 12:58:15.527853  1765 tablet_bootstrap.cc:654] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:15.537467  1767 tablet_bootstrap.cc:492] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226: No bootstrap required, opened a new log
I20260709 12:58:15.537940  1767 ts_tablet_manager.cc:1403] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent bootstrapping tablet: real 0.229s	user 0.025s	sys 0.022s
I20260709 12:58:15.542279  1564 tablet_service.cc:1511] Processing CreateTablet for tablet 216561bf1aef403280c36c1e716ca3ad (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:58:15.542806  1640 tablet_service.cc:1511] Processing CreateTablet for tablet 216561bf1aef403280c36c1e716ca3ad (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:58:15.543849  1564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 216561bf1aef403280c36c1e716ca3ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.544184  1640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 216561bf1aef403280c36c1e716ca3ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.547161  1767 raft_consensus.cc:359] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 12:58:15.547976  1767 raft_consensus.cc:385] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:15.548287  1767 raft_consensus.cc:740] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Initialized, Role: FOLLOWER
I20260709 12:58:15.549284  1767 consensus_queue.cc:260] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 12:58:15.550071  1709 tablet_service.cc:1511] Processing CreateTablet for tablet 216561bf1aef403280c36c1e716ca3ad (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:58:15.551340  1709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 216561bf1aef403280c36c1e716ca3ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.551697  1710 tablet_service.cc:1511] Processing CreateTablet for tablet 2f8dd5957a2647058190fd52f31ec088 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:58:15.553864  1710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f8dd5957a2647058190fd52f31ec088. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.564041  1765 tablet_bootstrap.cc:492] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4: No bootstrap required, opened a new log
I20260709 12:58:15.564677  1765 ts_tablet_manager.cc:1403] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4: Time spent bootstrapping tablet: real 0.055s	user 0.012s	sys 0.005s
I20260709 12:58:15.565840  1559 tablet_service.cc:1511] Processing CreateTablet for tablet a5bf40aa94d24ad9b858ebb61a527c4e (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:58:15.570067  1559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5bf40aa94d24ad9b858ebb61a527c4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.570531  1633 tablet_service.cc:1511] Processing CreateTablet for tablet a5bf40aa94d24ad9b858ebb61a527c4e (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:58:15.571707  1767 ts_tablet_manager.cc:1434] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.003s
I20260709 12:58:15.572475  1601 heartbeater.cc:499] Master 127.0.107.254:42827 was elected leader, sending a full tablet report...
I20260709 12:58:15.576050  1712 tablet_service.cc:1511] Processing CreateTablet for tablet a5bf40aa94d24ad9b858ebb61a527c4e (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:58:15.577402  1712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5bf40aa94d24ad9b858ebb61a527c4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.572475  1633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5bf40aa94d24ad9b858ebb61a527c4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.568050  1765 raft_consensus.cc:359] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:15.577435  1560 tablet_service.cc:1511] Processing CreateTablet for tablet 57e6243cbccc4e5fa84d8a5fd5a78af0 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:58:15.582584  1560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57e6243cbccc4e5fa84d8a5fd5a78af0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.580879  1765 raft_consensus.cc:385] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:15.587116  1765 raft_consensus.cc:740] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Initialized, Role: FOLLOWER
I20260709 12:58:15.596051  1768 tablet_bootstrap.cc:654] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:15.596625  1767 tablet_bootstrap.cc:492] T dfcb63b9010d4a77ad8748087fa07f8a P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Bootstrap starting.
I20260709 12:58:15.599092  1765 consensus_queue.cc:260] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:15.601181  1765 ts_tablet_manager.cc:1434] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 12:58:15.602216  1765 tablet_bootstrap.cc:492] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4: Bootstrap starting.
I20260709 12:58:15.608654  1640 tablet_service.cc:1511] Processing CreateTablet for tablet 57e6243cbccc4e5fa84d8a5fd5a78af0 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:58:15.616573  1640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57e6243cbccc4e5fa84d8a5fd5a78af0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.636089  1564 tablet_service.cc:1511] Processing CreateTablet for tablet 2ec61eb41a88487585d7738d4f5636dc (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:58:15.637480  1564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ec61eb41a88487585d7738d4f5636dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.637267  1633 tablet_service.cc:1511] Processing CreateTablet for tablet 2ec61eb41a88487585d7738d4f5636dc (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:58:15.638667  1633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ec61eb41a88487585d7738d4f5636dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.639681  1767 tablet_bootstrap.cc:654] T dfcb63b9010d4a77ad8748087fa07f8a P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:15.644883  1710 tablet_service.cc:1511] Processing CreateTablet for tablet 2ec61eb41a88487585d7738d4f5636dc (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:58:15.646162  1710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ec61eb41a88487585d7738d4f5636dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.646718  1768 tablet_bootstrap.cc:492] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e: No bootstrap required, opened a new log
I20260709 12:58:15.647231  1768 ts_tablet_manager.cc:1403] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e: Time spent bootstrapping tablet: real 0.142s	user 0.009s	sys 0.003s
I20260709 12:58:15.648676  1775 raft_consensus.cc:493] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:15.649114  1712 tablet_service.cc:1511] Processing CreateTablet for tablet 57e6243cbccc4e5fa84d8a5fd5a78af0 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:58:15.649132  1775 raft_consensus.cc:515] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 12:58:15.650420  1712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57e6243cbccc4e5fa84d8a5fd5a78af0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.651791  1775 leader_election.cc:290] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:15.656831  1765 tablet_bootstrap.cc:654] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:15.672389  1633 tablet_service.cc:1511] Processing CreateTablet for tablet a7bcbc7b936b4bdca8a41d00f9ecdd5f (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:58:15.674311  1633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7bcbc7b936b4bdca8a41d00f9ecdd5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.678377  1773 raft_consensus.cc:493] T 9ec2114c988b4a38a63b42293dcf1757 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:15.678956  1773 raft_consensus.cc:515] T 9ec2114c988b4a38a63b42293dcf1757 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:15.680737  1711 tablet_service.cc:1511] Processing CreateTablet for tablet a7bcbc7b936b4bdca8a41d00f9ecdd5f (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:58:15.682256  1711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7bcbc7b936b4bdca8a41d00f9ecdd5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.684216  1769 raft_consensus.cc:493] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:15.684899  1769 raft_consensus.cc:515] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:15.693634  1709 tablet_service.cc:1511] Processing CreateTablet for tablet 4ab0461976fc466a8162014a633d32d2 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:58:15.694247  1634 tablet_service.cc:1511] Processing CreateTablet for tablet 4ab0461976fc466a8162014a633d32d2 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:58:15.695019  1709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ab0461976fc466a8162014a633d32d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.695634  1634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ab0461976fc466a8162014a633d32d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.696769  1769 leader_election.cc:290] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:15.683687  1773 leader_election.cc:290] T 9ec2114c988b4a38a63b42293dcf1757 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:15.740813  1769 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:15.729929  1768 raft_consensus.cc:359] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:15.750270  1768 raft_consensus.cc:385] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:15.749078  1769 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:15.755826  1564 tablet_service.cc:1511] Processing CreateTablet for tablet a7bcbc7b936b4bdca8a41d00f9ecdd5f (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:58:15.763844  1713 tablet_service.cc:1511] Processing CreateTablet for tablet 73452eca85a147fb9d862dd08d54e340 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:58:15.764689  1564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7bcbc7b936b4bdca8a41d00f9ecdd5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.765180  1713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73452eca85a147fb9d862dd08d54e340. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.757586  1559 tablet_service.cc:1511] Processing CreateTablet for tablet 73452eca85a147fb9d862dd08d54e340 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:58:15.762892  1639 tablet_service.cc:1511] Processing CreateTablet for tablet 93e6c991440c40c8a8c8050982e85eeb (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:58:15.769345  1559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73452eca85a147fb9d862dd08d54e340. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.770026  1639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93e6c991440c40c8a8c8050982e85eeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.759738  1561 tablet_service.cc:1511] Processing CreateTablet for tablet 93e6c991440c40c8a8c8050982e85eeb (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:58:15.758188  1560 tablet_service.cc:1511] Processing CreateTablet for tablet 4ab0461976fc466a8162014a633d32d2 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:58:15.759084  1638 tablet_service.cc:1511] Processing CreateTablet for tablet 73452eca85a147fb9d862dd08d54e340 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:58:15.776502  1638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73452eca85a147fb9d862dd08d54e340. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.776903  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:15.777453  1561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93e6c991440c40c8a8c8050982e85eeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.778213  1765 tablet_bootstrap.cc:492] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4: No bootstrap required, opened a new log
I20260709 12:58:15.778674  1765 ts_tablet_manager.cc:1403] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4: Time spent bootstrapping tablet: real 0.177s	user 0.024s	sys 0.038s
I20260709 12:58:15.761857  1715 tablet_service.cc:1511] Processing CreateTablet for tablet 93e6c991440c40c8a8c8050982e85eeb (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:58:15.781289  1715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93e6c991440c40c8a8c8050982e85eeb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:58:15.781658  1539 leader_election.cc:343] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:15.783535  1560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4ab0461976fc466a8162014a633d32d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.763667  1769 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:15.788692  1765 raft_consensus.cc:359] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:15.789458  1765 raft_consensus.cc:385] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:15.789772  1765 raft_consensus.cc:740] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Initialized, Role: FOLLOWER
I20260709 12:58:15.790556  1765 consensus_queue.cc:260] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:15.792789  1765 ts_tablet_manager.cc:1434] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:58:15.793548  1765 tablet_bootstrap.cc:492] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4: Bootstrap starting.
I20260709 12:58:15.760493  1768 raft_consensus.cc:740] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Initialized, Role: FOLLOWER
I20260709 12:58:15.797276  1768 consensus_queue.cc:260] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:15.799408  1768 ts_tablet_manager.cc:1434] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e: Time spent starting tablet: real 0.152s	user 0.003s	sys 0.005s
I20260709 12:58:15.800359  1768 tablet_bootstrap.cc:492] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e: Bootstrap starting.
I20260709 12:58:15.802268  1767 tablet_bootstrap.cc:492] T dfcb63b9010d4a77ad8748087fa07f8a P 89ac9d5e2fbc4536b03a1ff1dd3eb226: No bootstrap required, opened a new log
I20260709 12:58:15.802887  1767 ts_tablet_manager.cc:1403] T dfcb63b9010d4a77ad8748087fa07f8a P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent bootstrapping tablet: real 0.219s	user 0.015s	sys 0.025s
I20260709 12:58:15.806384  1767 raft_consensus.cc:359] T dfcb63b9010d4a77ad8748087fa07f8a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:15.807153  1767 raft_consensus.cc:385] T dfcb63b9010d4a77ad8748087fa07f8a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:15.807479  1767 raft_consensus.cc:740] T dfcb63b9010d4a77ad8748087fa07f8a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Initialized, Role: FOLLOWER
I20260709 12:58:15.808241  1767 consensus_queue.cc:260] T dfcb63b9010d4a77ad8748087fa07f8a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:15.813585  1768 tablet_bootstrap.cc:654] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:15.827139  1765 tablet_bootstrap.cc:654] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:15.861734  1634 tablet_service.cc:1511] Processing CreateTablet for tablet 3e702e5dcf7541a2a4c0dc32d68625c6 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:58:15.863054  1634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e702e5dcf7541a2a4c0dc32d68625c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.863076  1768 tablet_bootstrap.cc:492] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e: No bootstrap required, opened a new log
I20260709 12:58:15.863714  1768 ts_tablet_manager.cc:1403] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e: Time spent bootstrapping tablet: real 0.064s	user 0.015s	sys 0.004s
I20260709 12:58:15.863216  1713 tablet_service.cc:1511] Processing CreateTablet for tablet 3e702e5dcf7541a2a4c0dc32d68625c6 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:58:15.864785  1713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e702e5dcf7541a2a4c0dc32d68625c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.873692  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:15.875339  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:58:15.876679  1688 leader_election.cc:343] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:15.877604  1688 leader_election.cc:343] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:15.878887  1633 tablet_service.cc:1511] Processing CreateTablet for tablet 88a45cba73f148359b7ac85f9f702819 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:58:15.880266  1633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88a45cba73f148359b7ac85f9f702819. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.881122  1767 ts_tablet_manager.cc:1434] T dfcb63b9010d4a77ad8748087fa07f8a P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent starting tablet: real 0.078s	user 0.007s	sys 0.002s
I20260709 12:58:15.882444  1767 tablet_bootstrap.cc:492] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Bootstrap starting.
I20260709 12:58:15.885141  1559 tablet_service.cc:1511] Processing CreateTablet for tablet 3e702e5dcf7541a2a4c0dc32d68625c6 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:58:15.886826  1559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e702e5dcf7541a2a4c0dc32d68625c6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.892728  1711 tablet_service.cc:1511] Processing CreateTablet for tablet 88a45cba73f148359b7ac85f9f702819 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:58:15.894078  1711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88a45cba73f148359b7ac85f9f702819. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.901419  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 12:58:15.903182  1615 leader_election.cc:343] T 9ec2114c988b4a38a63b42293dcf1757 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:15.905121  1769 raft_consensus.cc:493] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:15.905622  1769 raft_consensus.cc:515] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:15.908562  1769 leader_election.cc:290] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:15.910897  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:15.911546  1651 raft_consensus.cc:2468] T 9ec2114c988b4a38a63b42293dcf1757 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 0.
I20260709 12:58:15.912797  1688 leader_election.cc:304] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:58:15.913647  1769 raft_consensus.cc:2804] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:15.914171  1769 raft_consensus.cc:493] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:15.914495  1769 raft_consensus.cc:3060] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:15.913617  1768 raft_consensus.cc:359] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:15.918165  1768 raft_consensus.cc:385] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:15.918527  1768 raft_consensus.cc:740] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Initialized, Role: FOLLOWER
I20260709 12:58:15.923830  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:15.921339  1769 raft_consensus.cc:515] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:15.922926  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:15.924078  1768 consensus_queue.cc:260] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:15.925349  1725 raft_consensus.cc:2393] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 1: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:58:15.926188  1715 tablet_service.cc:1511] Processing CreateTablet for tablet ecf79110f7ff4e8b8bf2e0e4ea3c6def (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:58:15.935387  1715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecf79110f7ff4e8b8bf2e0e4ea3c6def. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.935616  1768 ts_tablet_manager.cc:1434] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e: Time spent starting tablet: real 0.072s	user 0.006s	sys 0.001s
I20260709 12:58:15.936736  1768 tablet_bootstrap.cc:492] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e: Bootstrap starting.
I20260709 12:58:15.939441  1765 tablet_bootstrap.cc:492] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4: No bootstrap required, opened a new log
I20260709 12:58:15.939898  1765 ts_tablet_manager.cc:1403] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4: Time spent bootstrapping tablet: real 0.147s	user 0.014s	sys 0.004s
I20260709 12:58:15.928232  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:15.941458  1617 leader_election.cc:304] T 9ec2114c988b4a38a63b42293dcf1757 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:15.941679  1651 raft_consensus.cc:3060] T 9ec2114c988b4a38a63b42293dcf1757 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:15.935566  1639 tablet_service.cc:1511] Processing CreateTablet for tablet 55eef501fb844a5097694ea43dc740c7 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:58:15.944136  1639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55eef501fb844a5097694ea43dc740c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.944016  1765 raft_consensus.cc:359] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:15.944993  1765 raft_consensus.cc:385] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:15.945349  1765 raft_consensus.cc:740] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Initialized, Role: FOLLOWER
I20260709 12:58:15.946277  1765 consensus_queue.cc:260] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:15.929239  1769 leader_election.cc:290] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:15.931336  1767 tablet_bootstrap.cc:654] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:15.934043  1634 tablet_service.cc:1511] Processing CreateTablet for tablet ecf79110f7ff4e8b8bf2e0e4ea3c6def (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
W20260709 12:58:15.955245  1542 leader_election.cc:343] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:15.965101  1768 tablet_bootstrap.cc:654] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:15.963833  1712 tablet_service.cc:1511] Processing CreateTablet for tablet 55eef501fb844a5097694ea43dc740c7 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:58:15.966331  1712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55eef501fb844a5097694ea43dc740c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.971141  1633 tablet_service.cc:1511] Processing CreateTablet for tablet 896a5554fe0949399b16eb646b6446b8 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:58:15.958531  1634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecf79110f7ff4e8b8bf2e0e4ea3c6def. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.955789  1542 leader_election.cc:304] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:58:15.982409  1633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 896a5554fe0949399b16eb646b6446b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.982609  1775 raft_consensus.cc:2749] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:15.984858  1559 tablet_service.cc:1511] Processing CreateTablet for tablet 88a45cba73f148359b7ac85f9f702819 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:58:15.985460  1564 tablet_service.cc:1511] Processing CreateTablet for tablet 55eef501fb844a5097694ea43dc740c7 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:58:15.986115  1559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88a45cba73f148359b7ac85f9f702819. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.979022  1713 tablet_service.cc:1511] Processing CreateTablet for tablet 896a5554fe0949399b16eb646b6446b8 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:58:15.987636  1564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55eef501fb844a5097694ea43dc740c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.988081  1713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 896a5554fe0949399b16eb646b6446b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.990437  1638 tablet_service.cc:1511] Processing CreateTablet for tablet bbdad022d10c452fb5c104373d7cd035 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:58:15.990752  1711 tablet_service.cc:1511] Processing CreateTablet for tablet bbdad022d10c452fb5c104373d7cd035 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:58:15.991720  1638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbdad022d10c452fb5c104373d7cd035. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.991974  1711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbdad022d10c452fb5c104373d7cd035. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.995024  1561 tablet_service.cc:1511] Processing CreateTablet for tablet 896a5554fe0949399b16eb646b6446b8 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:58:15.996301  1561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 896a5554fe0949399b16eb646b6446b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:15.997254  1768 tablet_bootstrap.cc:492] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e: No bootstrap required, opened a new log
I20260709 12:58:15.997777  1768 ts_tablet_manager.cc:1403] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e: Time spent bootstrapping tablet: real 0.061s	user 0.012s	sys 0.008s
I20260709 12:58:15.999625  1709 tablet_service.cc:1511] Processing CreateTablet for tablet 4fa306a802914bb9b8d54b7bfe53009c (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:58:16.000350  1640 tablet_service.cc:1511] Processing CreateTablet for tablet 4fa306a802914bb9b8d54b7bfe53009c (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:58:16.000962  1709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fa306a802914bb9b8d54b7bfe53009c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.001570  1640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fa306a802914bb9b8d54b7bfe53009c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.003902  1562 tablet_service.cc:1511] Processing CreateTablet for tablet bbdad022d10c452fb5c104373d7cd035 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:58:16.005119  1562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbdad022d10c452fb5c104373d7cd035. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.013427  1765 ts_tablet_manager.cc:1434] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4: Time spent starting tablet: real 0.073s	user 0.008s	sys 0.015s
I20260709 12:58:16.014469  1765 tablet_bootstrap.cc:492] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4: Bootstrap starting.
I20260709 12:58:16.017781  1565 tablet_service.cc:1511] Processing CreateTablet for tablet 4fa306a802914bb9b8d54b7bfe53009c (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:58:16.019026  1565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fa306a802914bb9b8d54b7bfe53009c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.020270  1651 raft_consensus.cc:2468] T 9ec2114c988b4a38a63b42293dcf1757 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 1.
I20260709 12:58:16.021680  1688 leader_election.cc:304] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:58:16.022197  1767 tablet_bootstrap.cc:492] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226: No bootstrap required, opened a new log
I20260709 12:58:16.017552  1560 tablet_service.cc:1511] Processing CreateTablet for tablet ecf79110f7ff4e8b8bf2e0e4ea3c6def (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:58:16.022471  1773 raft_consensus.cc:2749] T 9ec2114c988b4a38a63b42293dcf1757 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:16.022778  1793 raft_consensus.cc:2804] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:16.028904  1793 raft_consensus.cc:697] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:58:16.029829  1793 consensus_queue.cc:237] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:16.032366  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:16.026926  1560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecf79110f7ff4e8b8bf2e0e4ea3c6def. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.034646  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:16.025993  1767 ts_tablet_manager.cc:1403] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent bootstrapping tablet: real 0.144s	user 0.013s	sys 0.007s
I20260709 12:58:16.031662  1768 raft_consensus.cc:359] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:16.042268  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:16.036211  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 12:58:16.044490  1689 leader_election.cc:343] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:16.045001  1689 leader_election.cc:304] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:16.045222  1566 tablet_service.cc:1511] Processing CreateTablet for tablet 3beb4a9a0afa4337be3366fb9ee9c2fd (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:58:16.045583  1635 tablet_service.cc:1511] Processing CreateTablet for tablet 3beb4a9a0afa4337be3366fb9ee9c2fd (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
W20260709 12:58:16.046170  1689 leader_election.cc:343] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:16.046492  1566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3beb4a9a0afa4337be3366fb9ee9c2fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.046790  1635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3beb4a9a0afa4337be3366fb9ee9c2fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.046612  1689 leader_election.cc:304] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:16.047562  1769 raft_consensus.cc:2749] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:16.048193  1769 raft_consensus.cc:2749] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:16.053571  1712 tablet_service.cc:1511] Processing CreateTablet for tablet 3beb4a9a0afa4337be3366fb9ee9c2fd (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:58:16.054986  1712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3beb4a9a0afa4337be3366fb9ee9c2fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.055315  1767 raft_consensus.cc:359] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:16.056118  1767 raft_consensus.cc:385] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:16.056555  1767 raft_consensus.cc:740] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Initialized, Role: FOLLOWER
I20260709 12:58:16.057335  1767 consensus_queue.cc:260] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:16.059480  1767 ts_tablet_manager.cc:1434] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.000s
I20260709 12:58:16.059166  1563 tablet_service.cc:1511] Processing CreateTablet for tablet bfb3b560711b4d7eb23f2aff3e4ca991 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:58:16.060426  1563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfb3b560711b4d7eb23f2aff3e4ca991. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.063191  1768 raft_consensus.cc:385] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:16.066624  1769 raft_consensus.cc:493] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:16.066890  1768 raft_consensus.cc:740] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Initialized, Role: FOLLOWER
I20260709 12:58:16.067086  1769 raft_consensus.cc:515] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:16.067714  1768 consensus_queue.cc:260] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:16.069973  1768 ts_tablet_manager.cc:1434] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e: Time spent starting tablet: real 0.072s	user 0.003s	sys 0.003s
I20260709 12:58:16.071026  1768 tablet_bootstrap.cc:492] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e: Bootstrap starting.
I20260709 12:58:16.074340  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:16.076999  1765 tablet_bootstrap.cc:654] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4: Neither blocks nor log segments found. Creating new log.
W20260709 12:58:16.091075  1688 leader_election.cc:343] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:16.095160  1773 raft_consensus.cc:493] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:16.095705  1773 raft_consensus.cc:515] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:16.097645  1768 tablet_bootstrap.cc:654] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:16.097894  1773 leader_election.cc:290] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:16.088937  1769 leader_election.cc:290] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:16.060451  1767 tablet_bootstrap.cc:492] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Bootstrap starting.
W20260709 12:58:16.114131  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 67950.1us
I20260709 12:58:16.111796  1773 raft_consensus.cc:493] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:16.115208  1773 raft_consensus.cc:515] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:16.116690  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:16.119565  1773 leader_election.cc:290] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:16.122471  1713 tablet_service.cc:1511] Processing CreateTablet for tablet bfb3b560711b4d7eb23f2aff3e4ca991 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:58:16.123760  1713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfb3b560711b4d7eb23f2aff3e4ca991. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.126262  1562 tablet_service.cc:1511] Processing CreateTablet for tablet 85dedac1c89a4e76846055d543df7f16 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:58:16.134719  1634 tablet_service.cc:1511] Processing CreateTablet for tablet 85dedac1c89a4e76846055d543df7f16 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:58:16.136279  1634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85dedac1c89a4e76846055d543df7f16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.135960  1715 tablet_service.cc:1511] Processing CreateTablet for tablet 85dedac1c89a4e76846055d543df7f16 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:58:16.137458  1715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85dedac1c89a4e76846055d543df7f16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.141692  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:16.142531  1574 raft_consensus.cc:2468] T dfcb63b9010d4a77ad8748087fa07f8a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 0.
I20260709 12:58:16.143193  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:16.145689  1575 raft_consensus.cc:2468] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 0.
I20260709 12:58:16.145877  1615 leader_election.cc:304] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:58:16.146529  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:16.147681  1562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85dedac1c89a4e76846055d543df7f16. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:58:16.150460  1615 leader_election.cc:343] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:16.149632  1773 raft_consensus.cc:2804] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:16.151057  1773 raft_consensus.cc:493] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:16.151391  1773 raft_consensus.cc:3060] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:16.157721  1559 tablet_service.cc:1511] Processing CreateTablet for tablet 776886dda1a14393a13f8003a58c45d0 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:58:16.161031  1559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 776886dda1a14393a13f8003a58c45d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.162190  1765 tablet_bootstrap.cc:492] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4: No bootstrap required, opened a new log
I20260709 12:58:16.162837  1765 ts_tablet_manager.cc:1403] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4: Time spent bootstrapping tablet: real 0.149s	user 0.016s	sys 0.006s
I20260709 12:58:16.143177  1633 tablet_service.cc:1511] Processing CreateTablet for tablet bfb3b560711b4d7eb23f2aff3e4ca991 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:58:16.165444  1633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfb3b560711b4d7eb23f2aff3e4ca991. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.166107  1768 tablet_bootstrap.cc:492] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e: No bootstrap required, opened a new log
I20260709 12:58:16.166594  1768 ts_tablet_manager.cc:1403] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e: Time spent bootstrapping tablet: real 0.096s	user 0.002s	sys 0.014s
I20260709 12:58:16.167536  1765 raft_consensus.cc:359] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:16.172370  1765 raft_consensus.cc:385] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:16.172842  1765 raft_consensus.cc:740] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Initialized, Role: FOLLOWER
I20260709 12:58:16.173764  1765 consensus_queue.cc:260] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:58:16.151722  1689 leader_election.cc:343] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:16.172027  1767 tablet_bootstrap.cc:654] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:16.169480  1768 raft_consensus.cc:359] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 12:58:16.175809  1768 raft_consensus.cc:385] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:58:16.176082  1689 leader_election.cc:343] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:16.176240  1768 raft_consensus.cc:740] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Initialized, Role: FOLLOWER
I20260709 12:58:16.176362  1638 tablet_service.cc:1511] Processing CreateTablet for tablet 776886dda1a14393a13f8003a58c45d0 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:58:16.177155  1689 leader_election.cc:304] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:58:16.177790  1638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 776886dda1a14393a13f8003a58c45d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.177335  1768 consensus_queue.cc:260] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 12:58:16.182824  1765 ts_tablet_manager.cc:1434] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:58:16.184492  1796 raft_consensus.cc:2804] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:16.184913  1796 raft_consensus.cc:493] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:16.185256  1796 raft_consensus.cc:3060] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:16.186594  1765 tablet_bootstrap.cc:492] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4: Bootstrap starting.
I20260709 12:58:16.193488  1765 tablet_bootstrap.cc:654] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4: Neither blocks nor log segments found. Creating new log.
W20260709 12:58:16.194103  1617 leader_election.cc:343] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:16.194655  1617 leader_election.cc:304] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:16.197767  1715 tablet_service.cc:1511] Processing CreateTablet for tablet 776886dda1a14393a13f8003a58c45d0 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:58:16.199044  1715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 776886dda1a14393a13f8003a58c45d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.199097  1562 tablet_service.cc:1511] Processing CreateTablet for tablet dfdb9ea6c3bf4001aeecb5c37e0d6baf (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:58:16.200779  1562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfdb9ea6c3bf4001aeecb5c37e0d6baf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.206646  1709 tablet_service.cc:1511] Processing CreateTablet for tablet dfdb9ea6c3bf4001aeecb5c37e0d6baf (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:58:16.207865  1709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfdb9ea6c3bf4001aeecb5c37e0d6baf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.208097  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:16.208860  1725 raft_consensus.cc:2468] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 0.
I20260709 12:58:16.210107  1566 tablet_service.cc:1511] Processing CreateTablet for tablet d74b61b1f30d43f5a2c32ade6f2b8f2a (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:58:16.211364  1566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d74b61b1f30d43f5a2c32ade6f2b8f2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.212337  1474 catalog_manager.cc:5697] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:16.216810  1799 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:16.217383  1712 tablet_service.cc:1511] Processing CreateTablet for tablet 65524f4fe7be481b9f069829076b7dc3 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:58:16.213522  1559 tablet_service.cc:1511] Processing CreateTablet for tablet 65524f4fe7be481b9f069829076b7dc3 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:58:16.217290  1799 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:16.219074  1712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65524f4fe7be481b9f069829076b7dc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.219535  1559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65524f4fe7be481b9f069829076b7dc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.208343  1768 ts_tablet_manager.cc:1434] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e: Time spent starting tablet: real 0.041s	user 0.004s	sys 0.011s
I20260709 12:58:16.224988  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:16.226539  1767 tablet_bootstrap.cc:492] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: No bootstrap required, opened a new log
I20260709 12:58:16.227063  1767 ts_tablet_manager.cc:1403] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent bootstrapping tablet: real 0.167s	user 0.009s	sys 0.008s
I20260709 12:58:16.229386  1639 tablet_service.cc:1511] Processing CreateTablet for tablet dfdb9ea6c3bf4001aeecb5c37e0d6baf (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:58:16.224925  1773 raft_consensus.cc:515] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:16.230648  1639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfdb9ea6c3bf4001aeecb5c37e0d6baf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.231762  1773 leader_election.cc:290] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:16.232323  1773 raft_consensus.cc:2749] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:16.233779  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:16.234377  1576 raft_consensus.cc:3060] T dfcb63b9010d4a77ad8748087fa07f8a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:16.238453  1768 tablet_bootstrap.cc:492] T 3ba8e707693e4af2b8347a4bad4dfd67 P 4dbe7d47a2374afca075d3a98583b49e: Bootstrap starting.
I20260709 12:58:16.225045  1796 raft_consensus.cc:515] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:58:16.235942  1615 leader_election.cc:343] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:16.240149  1796 leader_election.cc:290] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:16.241809  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
W20260709 12:58:16.243471  1688 leader_election.cc:343] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:16.248282  1560 tablet_service.cc:1511] Processing CreateTablet for tablet e66a330b7dae4036b80d239969d5a260 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:58:16.248373  1713 tablet_service.cc:1511] Processing CreateTablet for tablet d74b61b1f30d43f5a2c32ade6f2b8f2a (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:58:16.249620  1560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e66a330b7dae4036b80d239969d5a260. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.250658  1640 tablet_service.cc:1511] Processing CreateTablet for tablet 65524f4fe7be481b9f069829076b7dc3 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:58:16.251906  1640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65524f4fe7be481b9f069829076b7dc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.253945  1563 tablet_service.cc:1511] Processing CreateTablet for tablet 86d7fe1cfa574972b0302d36ac77568b (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:58:16.255143  1563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86d7fe1cfa574972b0302d36ac77568b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.259088  1711 tablet_service.cc:1511] Processing CreateTablet for tablet e66a330b7dae4036b80d239969d5a260 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:58:16.249624  1713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d74b61b1f30d43f5a2c32ade6f2b8f2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.261631  1635 tablet_service.cc:1511] Processing CreateTablet for tablet d74b61b1f30d43f5a2c32ade6f2b8f2a (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:58:16.235659  1799 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:16.261806  1561 tablet_service.cc:1511] Processing CreateTablet for tablet 650a39124682440d83bb93bb83f15979 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:58:16.263370  1635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d74b61b1f30d43f5a2c32ade6f2b8f2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.264643  1710 tablet_service.cc:1511] Processing CreateTablet for tablet 86d7fe1cfa574972b0302d36ac77568b (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:58:16.236356  1767 raft_consensus.cc:359] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:16.270565  1561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 650a39124682440d83bb93bb83f15979. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.270316  1767 raft_consensus.cc:385] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:16.271099  1767 raft_consensus.cc:740] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Initialized, Role: FOLLOWER
I20260709 12:58:16.265494  1711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e66a330b7dae4036b80d239969d5a260. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.267429  1634 tablet_service.cc:1511] Processing CreateTablet for tablet e66a330b7dae4036b80d239969d5a260 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:58:16.277554  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:58:16.278164  1725 raft_consensus.cc:3060] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:16.279228  1714 tablet_service.cc:1511] Processing CreateTablet for tablet 650a39124682440d83bb93bb83f15979 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:58:16.280961  1714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 650a39124682440d83bb93bb83f15979. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.284364  1796 raft_consensus.cc:493] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:16.285537  1796 raft_consensus.cc:515] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:16.286556  1708 tablet_service.cc:1511] Processing CreateTablet for tablet cfe7eb675393487f87b528a12f16e16e (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:58:16.287319  1639 tablet_service.cc:1511] Processing CreateTablet for tablet 650a39124682440d83bb93bb83f15979 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:58:16.288687  1710 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86d7fe1cfa574972b0302d36ac77568b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.288992  1796 leader_election.cc:290] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:16.289512  1564 tablet_service.cc:1511] Processing CreateTablet for tablet 8e94ee9035214526808abfaab11799fe (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:58:16.296857  1708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfe7eb675393487f87b528a12f16e16e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.297389  1564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e94ee9035214526808abfaab11799fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.297261  1565 tablet_service.cc:1511] Processing CreateTablet for tablet df63a7a2acf448379066cf6e352a511e (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:58:16.284924  1633 tablet_service.cc:1511] Processing CreateTablet for tablet 86d7fe1cfa574972b0302d36ac77568b (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:58:16.291133  1562 tablet_service.cc:1511] Processing CreateTablet for tablet cfe7eb675393487f87b528a12f16e16e (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:58:16.295212  1707 tablet_service.cc:1511] Processing CreateTablet for tablet 8e94ee9035214526808abfaab11799fe (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:58:16.261831  1576 raft_consensus.cc:2468] T dfcb63b9010d4a77ad8748087fa07f8a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 1.
I20260709 12:58:16.303021  1707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e94ee9035214526808abfaab11799fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.303479  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:16.304188  1724 raft_consensus.cc:2468] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 0.
I20260709 12:58:16.309029  1767 consensus_queue.cc:260] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:16.311754  1617 leader_election.cc:304] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:16.313009  1799 raft_consensus.cc:2804] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:16.313390  1799 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:16.313532  1767 ts_tablet_manager.cc:1434] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent starting tablet: real 0.086s	user 0.006s	sys 0.003s
I20260709 12:58:16.313804  1799 raft_consensus.cc:3060] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:16.314349  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:16.314963  1575 raft_consensus.cc:3060] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:16.292423  1768 tablet_bootstrap.cc:654] T 3ba8e707693e4af2b8347a4bad4dfd67 P 4dbe7d47a2374afca075d3a98583b49e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:16.322444  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:16.305473  1565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df63a7a2acf448379066cf6e352a511e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.334982  1767 tablet_bootstrap.cc:492] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Bootstrap starting.
I20260709 12:58:16.335776  1641 tablet_service.cc:1511] Processing CreateTablet for tablet cfe7eb675393487f87b528a12f16e16e (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:58:16.330754  1615 leader_election.cc:304] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:58:16.340296  1802 raft_consensus.cc:2804] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:16.341074  1802 raft_consensus.cc:697] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:58:16.341285  1706 tablet_service.cc:1511] Processing CreateTablet for tablet df63a7a2acf448379066cf6e352a511e (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:58:16.342823  1706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df63a7a2acf448379066cf6e352a511e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.342342  1802 consensus_queue.cc:237] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:16.345903  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:16.347224  1575 raft_consensus.cc:2468] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 1.
W20260709 12:58:16.348119  1688 leader_election.cc:343] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:16.348773  1801 raft_consensus.cc:493] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:16.354116  1801 raft_consensus.cc:515] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 12:58:16.349462  1558 tablet_service.cc:1511] Processing CreateTablet for tablet d5eec36d47dc40c5a83cc72207d9c310 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:58:16.351428  1557 tablet_service.cc:1511] Processing CreateTablet for tablet df3a0b1701574816b4c9766063c65f8f (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:58:16.351838  1711 tablet_service.cc:1511] Processing CreateTablet for tablet d5eec36d47dc40c5a83cc72207d9c310 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:58:16.358553  1711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5eec36d47dc40c5a83cc72207d9c310. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.361496  1634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e66a330b7dae4036b80d239969d5a260. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.370806  1801 leader_election.cc:290] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373)
W20260709 12:58:16.364398  1689 leader_election.cc:343] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:16.381812  1638 tablet_service.cc:1511] Processing CreateTablet for tablet 8e94ee9035214526808abfaab11799fe (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:58:16.382157  1799 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:16.376262  1562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfe7eb675393487f87b528a12f16e16e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.392479  1641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfe7eb675393487f87b528a12f16e16e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.397495  1639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 650a39124682440d83bb93bb83f15979. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.399322  1711 tablet_service.cc:1511] Processing CreateTablet for tablet df3a0b1701574816b4c9766063c65f8f (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:58:16.399829  1557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df3a0b1701574816b4c9766063c65f8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.400244  1638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e94ee9035214526808abfaab11799fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.400701  1711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df3a0b1701574816b4c9766063c65f8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.402271  1558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5eec36d47dc40c5a83cc72207d9c310. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.379660  1689 leader_election.cc:304] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:16.408700  1633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86d7fe1cfa574972b0302d36ac77568b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.414173  1796 raft_consensus.cc:2749] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:58:16.415208  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 52394.2us
I20260709 12:58:16.416671  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:16.417933  1689 leader_election.cc:304] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:58:16.418752  1796 raft_consensus.cc:2804] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:16.419188  1796 raft_consensus.cc:697] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:58:16.420109  1796 consensus_queue.cc:237] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:16.422472  1765 tablet_bootstrap.cc:492] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4: No bootstrap required, opened a new log
I20260709 12:58:16.422947  1765 ts_tablet_manager.cc:1403] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4: Time spent bootstrapping tablet: real 0.237s	user 0.029s	sys 0.007s
I20260709 12:58:16.433568  1636 tablet_service.cc:1511] Processing CreateTablet for tablet df63a7a2acf448379066cf6e352a511e (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
W20260709 12:58:16.434119  1617 leader_election.cc:343] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:16.434898  1636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df63a7a2acf448379066cf6e352a511e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.437184  1562 tablet_service.cc:1511] Processing CreateTablet for tablet a4e8f73323404a27b6ef964e10902d91 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:58:16.438396  1562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4e8f73323404a27b6ef964e10902d91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.443781  1799 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:16.445540  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 12:58:16.447360  1615 leader_election.cc:343] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:16.387203  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:16.448710  1575 raft_consensus.cc:2468] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 0.
I20260709 12:58:16.449182  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:58:16.494282  1615 leader_election.cc:304] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 12:58:16.496234  1724 raft_consensus.cc:3060] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:16.500209  1521 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:16.501493  1799 raft_consensus.cc:2804] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:16.501413  1633 tablet_service.cc:1511] Processing CreateTablet for tablet d5eec36d47dc40c5a83cc72207d9c310 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:58:16.501915  1799 raft_consensus.cc:493] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:16.502276  1799 raft_consensus.cc:3060] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:16.502668  1633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5eec36d47dc40c5a83cc72207d9c310. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.508374  1637 tablet_service.cc:1511] Processing CreateTablet for tablet df3a0b1701574816b4c9766063c65f8f (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:58:16.510082  1637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df3a0b1701574816b4c9766063c65f8f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.514961  1709 tablet_service.cc:1511] Processing CreateTablet for tablet a4e8f73323404a27b6ef964e10902d91 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:58:16.516263  1709 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4e8f73323404a27b6ef964e10902d91. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:58:16.519131  1689 consensus_peers.cc:597] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:16.525811  1768 tablet_bootstrap.cc:492] T 3ba8e707693e4af2b8347a4bad4dfd67 P 4dbe7d47a2374afca075d3a98583b49e: No bootstrap required, opened a new log
I20260709 12:58:16.526361  1768 ts_tablet_manager.cc:1403] T 3ba8e707693e4af2b8347a4bad4dfd67 P 4dbe7d47a2374afca075d3a98583b49e: Time spent bootstrapping tablet: real 0.288s	user 0.018s	sys 0.027s
I20260709 12:58:16.529302  1768 raft_consensus.cc:359] T 3ba8e707693e4af2b8347a4bad4dfd67 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:16.532800  1471 catalog_manager.cc:5697] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 0 to 1, leader changed from <none> to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:16.425866  1765 raft_consensus.cc:359] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 12:58:16.533866  1632 tablet_service.cc:1511] Processing CreateTablet for tablet a4e8f73323404a27b6ef964e10902d91 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:58:16.528258  1725 raft_consensus.cc:2468] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 1.
I20260709 12:58:16.536489  1767 tablet_bootstrap.cc:654] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:16.556298  1799 raft_consensus.cc:515] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 12:58:16.558485  1799 leader_election.cc:290] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373)
I20260709 12:58:16.559674  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:16.560243  1575 raft_consensus.cc:3060] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:16.565438  1559 tablet_service.cc:1511] Processing CreateTablet for tablet 03f18dbd16bd4b9eb22229aed3da4413 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:58:16.566658  1559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03f18dbd16bd4b9eb22229aed3da4413. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.570223  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:58:16.550904  1768 raft_consensus.cc:385] T 3ba8e707693e4af2b8347a4bad4dfd67 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:16.550189  1765 raft_consensus.cc:385] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:16.572676  1765 raft_consensus.cc:740] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Initialized, Role: FOLLOWER
I20260709 12:58:16.573467  1765 consensus_queue.cc:260] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 12:58:16.578533  1765 ts_tablet_manager.cc:1434] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4: Time spent starting tablet: real 0.155s	user 0.007s	sys 0.000s
I20260709 12:58:16.579264  1723 raft_consensus.cc:3060] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:16.579835  1796 consensus_queue.cc:1048] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:16.585275  1714 tablet_service.cc:1511] Processing CreateTablet for tablet 725a29842f534310a9c0bb9d5c7892a2 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:58:16.586547  1714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 725a29842f534310a9c0bb9d5c7892a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.544477  1724 raft_consensus.cc:2468] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 1.
I20260709 12:58:16.589282  1632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4e8f73323404a27b6ef964e10902d91. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.592870  1617 leader_election.cc:304] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:16.594893  1799 raft_consensus.cc:2804] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:16.595438  1799 raft_consensus.cc:697] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:58:16.572397  1768 raft_consensus.cc:740] T 3ba8e707693e4af2b8347a4bad4dfd67 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Initialized, Role: FOLLOWER
I20260709 12:58:16.596315  1799 consensus_queue.cc:237] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:16.596791  1564 tablet_service.cc:1511] Processing CreateTablet for tablet 454808fe3b6f48ab9fed193478d28abc (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:58:16.597363  1768 consensus_queue.cc:260] T 3ba8e707693e4af2b8347a4bad4dfd67 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:16.605183  1711 tablet_service.cc:1511] Processing CreateTablet for tablet 03f18dbd16bd4b9eb22229aed3da4413 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:58:16.607084  1711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03f18dbd16bd4b9eb22229aed3da4413. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.617892  1564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 454808fe3b6f48ab9fed193478d28abc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.642827  1635 tablet_service.cc:1511] Processing CreateTablet for tablet 03f18dbd16bd4b9eb22229aed3da4413 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:58:16.644189  1635 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03f18dbd16bd4b9eb22229aed3da4413. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.645366  1715 tablet_service.cc:1511] Processing CreateTablet for tablet 454808fe3b6f48ab9fed193478d28abc (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:58:16.646909  1715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 454808fe3b6f48ab9fed193478d28abc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.658188  1765 tablet_bootstrap.cc:492] T a0203dcfbe4440c790f2bf709bd16179 P 0c7751452c4b46afa95251b9df7169d4: Bootstrap starting.
I20260709 12:58:16.661657  1559 tablet_service.cc:1511] Processing CreateTablet for tablet 71e68bb03bc047dfadd595f2484ca8f8 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:58:16.661774  1558 tablet_service.cc:1511] Processing CreateTablet for tablet 06376ae55ce745738b930c75f0dcdf5e (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:58:16.662972  1767 tablet_bootstrap.cc:492] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226: No bootstrap required, opened a new log
I20260709 12:58:16.663188  1559 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71e68bb03bc047dfadd595f2484ca8f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.663513  1767 ts_tablet_manager.cc:1403] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent bootstrapping tablet: real 0.329s	user 0.014s	sys 0.017s
I20260709 12:58:16.663962  1558 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06376ae55ce745738b930c75f0dcdf5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.665882  1565 tablet_service.cc:1511] Processing CreateTablet for tablet 608abea191d946228bed666c5560fd0a (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:58:16.667176  1712 tablet_service.cc:1511] Processing CreateTablet for tablet 06376ae55ce745738b930c75f0dcdf5e (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:58:16.669018  1712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06376ae55ce745738b930c75f0dcdf5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.669534  1708 tablet_service.cc:1511] Processing CreateTablet for tablet 71e68bb03bc047dfadd595f2484ca8f8 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:58:16.671021  1711 tablet_service.cc:1511] Processing CreateTablet for tablet 608abea191d946228bed666c5560fd0a (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:58:16.683120  1633 tablet_service.cc:1511] Processing CreateTablet for tablet 725a29842f534310a9c0bb9d5c7892a2 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:58:16.684544  1633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 725a29842f534310a9c0bb9d5c7892a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.685257  1565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 608abea191d946228bed666c5560fd0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.691258  1767 raft_consensus.cc:359] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:16.692123  1767 raft_consensus.cc:385] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:16.692198  1708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71e68bb03bc047dfadd595f2484ca8f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.693948  1636 tablet_service.cc:1511] Processing CreateTablet for tablet 71e68bb03bc047dfadd595f2484ca8f8 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:58:16.695689  1636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71e68bb03bc047dfadd595f2484ca8f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.695505  1637 tablet_service.cc:1511] Processing CreateTablet for tablet 454808fe3b6f48ab9fed193478d28abc (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:58:16.700851  1711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 608abea191d946228bed666c5560fd0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.701759  1706 tablet_service.cc:1511] Processing CreateTablet for tablet 589a395c6abe4eec80fca6d6210acf0d (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:58:16.703033  1706 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 589a395c6abe4eec80fca6d6210acf0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.703104  1563 tablet_service.cc:1511] Processing CreateTablet for tablet 725a29842f534310a9c0bb9d5c7892a2 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:58:16.704473  1563 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 725a29842f534310a9c0bb9d5c7892a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.705034  1560 tablet_service.cc:1511] Processing CreateTablet for tablet cf2ade0033864199b5ced11fc9b5c6ad (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:58:16.705322  1566 tablet_service.cc:1511] Processing CreateTablet for tablet 589a395c6abe4eec80fca6d6210acf0d (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:58:16.706878  1560 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf2ade0033864199b5ced11fc9b5c6ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.707607  1566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 589a395c6abe4eec80fca6d6210acf0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.710012  1768 ts_tablet_manager.cc:1434] T 3ba8e707693e4af2b8347a4bad4dfd67 P 4dbe7d47a2374afca075d3a98583b49e: Time spent starting tablet: real 0.183s	user 0.004s	sys 0.004s
I20260709 12:58:16.711562  1767 raft_consensus.cc:740] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Initialized, Role: FOLLOWER
I20260709 12:58:16.717306  1767 consensus_queue.cc:260] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:16.719604  1767 ts_tablet_manager.cc:1434] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent starting tablet: real 0.056s	user 0.007s	sys 0.000s
I20260709 12:58:16.720880  1707 tablet_service.cc:1511] Processing CreateTablet for tablet cf2ade0033864199b5ced11fc9b5c6ad (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:58:16.722654  1707 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf2ade0033864199b5ced11fc9b5c6ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.721668  1634 tablet_service.cc:1511] Processing CreateTablet for tablet 608abea191d946228bed666c5560fd0a (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:58:16.733217  1773 consensus_queue.cc:1048] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:58:16.740157  1575 raft_consensus.cc:2468] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 1.
I20260709 12:58:16.742554  1615 leader_election.cc:304] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:58:16.745908  1775 raft_consensus.cc:493] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:16.746462  1775 raft_consensus.cc:515] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:16.751927  1773 raft_consensus.cc:2804] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:16.766938  1767 tablet_bootstrap.cc:492] T 62c04bf03d764babb1a5e3b102527e5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Bootstrap starting.
I20260709 12:58:16.767510  1640 tablet_service.cc:1511] Processing CreateTablet for tablet 06376ae55ce745738b930c75f0dcdf5e (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:58:16.769817  1641 tablet_service.cc:1511] Processing CreateTablet for tablet 589a395c6abe4eec80fca6d6210acf0d (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:58:16.770538  1775 leader_election.cc:290] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:16.771661  1768 tablet_bootstrap.cc:492] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e: Bootstrap starting.
I20260709 12:58:16.772181  1633 tablet_service.cc:1511] Processing CreateTablet for tablet cf2ade0033864199b5ced11fc9b5c6ad (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:58:16.773337  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:16.773795  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:16.774641  1650 raft_consensus.cc:2468] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 0.
I20260709 12:58:16.775454  1562 tablet_service.cc:1511] Processing CreateTablet for tablet ecb8dc1ca7644ad598779a7fe5419ad5 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:58:16.769871  1561 tablet_service.cc:1511] Processing CreateTablet for tablet 566c1a1cfdfa47a2aee520e28f352064 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:58:16.777619  1711 tablet_service.cc:1511] Processing CreateTablet for tablet 566c1a1cfdfa47a2aee520e28f352064 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:58:16.775947  1539 leader_election.cc:304] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:58:16.778831  1711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 566c1a1cfdfa47a2aee520e28f352064. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.781469  1773 raft_consensus.cc:697] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:58:16.782822  1765 tablet_bootstrap.cc:654] T a0203dcfbe4440c790f2bf709bd16179 P 0c7751452c4b46afa95251b9df7169d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:16.782500  1773 consensus_queue.cc:237] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 12:58:16.784442  1637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 454808fe3b6f48ab9fed193478d28abc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.786531  1640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06376ae55ce745738b930c75f0dcdf5e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.788910  1633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf2ade0033864199b5ced11fc9b5c6ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.791966  1768 tablet_bootstrap.cc:654] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:16.792830  1641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 589a395c6abe4eec80fca6d6210acf0d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:58:16.778755  1542 leader_election.cc:343] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:16.799721  1562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecb8dc1ca7644ad598779a7fe5419ad5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.801952  1775 raft_consensus.cc:2804] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:16.802366  1775 raft_consensus.cc:493] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:16.802683  1775 raft_consensus.cc:3060] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:16.866554  1765 tablet_bootstrap.cc:492] T a0203dcfbe4440c790f2bf709bd16179 P 0c7751452c4b46afa95251b9df7169d4: No bootstrap required, opened a new log
I20260709 12:58:16.867944  1765 ts_tablet_manager.cc:1403] T a0203dcfbe4440c790f2bf709bd16179 P 0c7751452c4b46afa95251b9df7169d4: Time spent bootstrapping tablet: real 0.232s	user 0.036s	sys 0.028s
I20260709 12:58:16.872435  1639 tablet_service.cc:1511] Processing CreateTablet for tablet 566c1a1cfdfa47a2aee520e28f352064 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:58:16.846344  1561 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 566c1a1cfdfa47a2aee520e28f352064. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.898432  1633 tablet_service.cc:1511] Processing CreateTablet for tablet ecb8dc1ca7644ad598779a7fe5419ad5 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:58:16.901526  1765 raft_consensus.cc:359] T a0203dcfbe4440c790f2bf709bd16179 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:16.902285  1765 raft_consensus.cc:385] T a0203dcfbe4440c790f2bf709bd16179 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:16.902595  1765 raft_consensus.cc:740] T a0203dcfbe4440c790f2bf709bd16179 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Initialized, Role: FOLLOWER
I20260709 12:58:16.883437  1799 raft_consensus.cc:493] T 3ba8e707693e4af2b8347a4bad4dfd67 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:58:16.910241  1813 log.cc:927] Time spent T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:58:16.911513  1711 tablet_service.cc:1511] Processing CreateTablet for tablet ecb8dc1ca7644ad598779a7fe5419ad5 (DEFAULT_TABLE table=test-workload [id=2e230675e851429db50863dfed56dde5]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:58:16.916709  1711 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecb8dc1ca7644ad598779a7fe5419ad5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.918035  1765 consensus_queue.cc:260] T a0203dcfbe4440c790f2bf709bd16179 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:16.923978  1767 tablet_bootstrap.cc:654] T 62c04bf03d764babb1a5e3b102527e5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:16.935853  1765 ts_tablet_manager.cc:1434] T a0203dcfbe4440c790f2bf709bd16179 P 0c7751452c4b46afa95251b9df7169d4: Time spent starting tablet: real 0.067s	user 0.006s	sys 0.002s
I20260709 12:58:16.921156  1634 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 608abea191d946228bed666c5560fd0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.957975  1633 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecb8dc1ca7644ad598779a7fe5419ad5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:16.920482  1799 raft_consensus.cc:515] T 3ba8e707693e4af2b8347a4bad4dfd67 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:16.971824  1801 consensus_queue.cc:1048] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:16.975347  1723 raft_consensus.cc:2468] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 1.
I20260709 12:58:16.993880  1799 leader_election.cc:290] T 3ba8e707693e4af2b8347a4bad4dfd67 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:16.994251  1768 tablet_bootstrap.cc:492] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e: No bootstrap required, opened a new log
I20260709 12:58:16.994731  1768 ts_tablet_manager.cc:1403] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e: Time spent bootstrapping tablet: real 0.223s	user 0.026s	sys 0.022s
I20260709 12:58:16.998056  1768 raft_consensus.cc:359] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:16.998904  1768 raft_consensus.cc:385] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:16.999392  1768 raft_consensus.cc:740] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Initialized, Role: FOLLOWER
I20260709 12:58:17.000348  1768 consensus_queue.cc:260] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.004276  1768 ts_tablet_manager.cc:1434] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:58:17.026654  1639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 566c1a1cfdfa47a2aee520e28f352064. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:17.023095  1793 consensus_queue.cc:1048] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:58:17.032220  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:17.033282  1799 raft_consensus.cc:493] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:17.033771  1799 raft_consensus.cc:515] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:58:17.038602  1615 leader_election.cc:343] T 3ba8e707693e4af2b8347a4bad4dfd67 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:17.043725  1474 catalog_manager.cc:5697] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 0 to 1, leader changed from <none> to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:17.045220  1474 catalog_manager.cc:5697] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 0 to 1, leader changed from <none> to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:17.039979  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:17.041337  1799 leader_election.cc:290] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:16.983234  1775 raft_consensus.cc:515] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:58:17.059660  1615 leader_election.cc:343] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:17.062058  1767 tablet_bootstrap.cc:492] T 62c04bf03d764babb1a5e3b102527e5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226: No bootstrap required, opened a new log
I20260709 12:58:17.063436  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:17.066490  1651 raft_consensus.cc:3060] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:17.076683  1768 tablet_bootstrap.cc:492] T 477960faa15b4001a5a6361558d69294 P 4dbe7d47a2374afca075d3a98583b49e: Bootstrap starting.
I20260709 12:58:17.063359  1775 leader_election.cc:290] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:17.078363  1765 tablet_bootstrap.cc:492] T 4bc29cd0261846b7847f38862b494d0b P 0c7751452c4b46afa95251b9df7169d4: Bootstrap starting.
I20260709 12:58:17.083144  1767 ts_tablet_manager.cc:1403] T 62c04bf03d764babb1a5e3b102527e5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent bootstrapping tablet: real 0.324s	user 0.020s	sys 0.000s
W20260709 12:58:17.085780  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 114026us
I20260709 12:58:17.086344  1823 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:17.086826  1823 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.089993  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:58:17.090597  1688 consensus_peers.cc:597] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 -> Peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Couldn't send request to peer 4dbe7d47a2374afca075d3a98583b49e. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:58:17.091027  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 65016.7us
I20260709 12:58:17.094656  1651 raft_consensus.cc:2468] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 1.
I20260709 12:58:17.095108  1767 raft_consensus.cc:359] T 62c04bf03d764babb1a5e3b102527e5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.095878  1767 raft_consensus.cc:385] T 62c04bf03d764babb1a5e3b102527e5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:17.095961  1539 leader_election.cc:304] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:58:17.096295  1767 raft_consensus.cc:740] T 62c04bf03d764babb1a5e3b102527e5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Initialized, Role: FOLLOWER
I20260709 12:58:17.096964  1822 raft_consensus.cc:2804] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:17.097481  1822 raft_consensus.cc:697] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:58:17.098781  1822 consensus_queue.cc:237] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.099762  1473 catalog_manager.cc:5697] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:17.101341  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:58:17.102177  1723 raft_consensus.cc:3060] T a0203dcfbe4440c790f2bf709bd16179 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:17.102232  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:17.103142  1724 raft_consensus.cc:2393] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 1: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:58:17.106712  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:17.106588  1542 leader_election.cc:304] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:58:17.107244  1725 raft_consensus.cc:2468] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 0.
I20260709 12:58:17.108464  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:17.111290  1722 raft_consensus.cc:2468] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 0.
I20260709 12:58:17.111629  1617 leader_election.cc:304] T 3ba8e707693e4af2b8347a4bad4dfd67 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:17.112349  1775 raft_consensus.cc:3060] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:17.118355  1723 raft_consensus.cc:2468] T a0203dcfbe4440c790f2bf709bd16179 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 1.
I20260709 12:58:17.118664  1799 raft_consensus.cc:2804] T 3ba8e707693e4af2b8347a4bad4dfd67 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:17.119249  1799 raft_consensus.cc:493] T 3ba8e707693e4af2b8347a4bad4dfd67 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:17.119709  1799 raft_consensus.cc:3060] T 3ba8e707693e4af2b8347a4bad4dfd67 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:17.112412  1823 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:17.122063  1775 raft_consensus.cc:2749] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:17.110344  1765 tablet_bootstrap.cc:654] T 4bc29cd0261846b7847f38862b494d0b P 0c7751452c4b46afa95251b9df7169d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:17.123494  1617 leader_election.cc:304] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:17.129943  1801 raft_consensus.cc:2804] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:17.131011  1801 raft_consensus.cc:493] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:17.132063  1768 tablet_bootstrap.cc:654] T 477960faa15b4001a5a6361558d69294 P 4dbe7d47a2374afca075d3a98583b49e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:17.132040  1801 raft_consensus.cc:3060] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:17.131341  1767 consensus_queue.cc:260] T 62c04bf03d764babb1a5e3b102527e5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.137925  1767 ts_tablet_manager.cc:1434] T 62c04bf03d764babb1a5e3b102527e5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.000s
I20260709 12:58:17.138931  1767 tablet_bootstrap.cc:492] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Bootstrap starting.
I20260709 12:58:17.145905  1801 raft_consensus.cc:515] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.146801  1799 raft_consensus.cc:515] T 3ba8e707693e4af2b8347a4bad4dfd67 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.145358  1471 catalog_manager.cc:5697] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:17.149428  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 12:58:17.151645  1615 leader_election.cc:343] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:17.153628  1767 tablet_bootstrap.cc:654] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:17.158142  1802 consensus_queue.cc:1048] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:17.163734  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:58:17.163865  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:17.164619  1724 raft_consensus.cc:3060] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:17.165462  1615 leader_election.cc:343] T 3ba8e707693e4af2b8347a4bad4dfd67 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:17.168208  1799 leader_election.cc:290] T 3ba8e707693e4af2b8347a4bad4dfd67 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:17.169360  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:58:17.169981  1722 raft_consensus.cc:3060] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:17.170228  1765 tablet_bootstrap.cc:492] T 4bc29cd0261846b7847f38862b494d0b P 0c7751452c4b46afa95251b9df7169d4: No bootstrap required, opened a new log
I20260709 12:58:17.173763  1765 ts_tablet_manager.cc:1403] T 4bc29cd0261846b7847f38862b494d0b P 0c7751452c4b46afa95251b9df7169d4: Time spent bootstrapping tablet: real 0.096s	user 0.017s	sys 0.000s
I20260709 12:58:17.175858  1801 leader_election.cc:290] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:17.179950  1724 raft_consensus.cc:2468] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 1.
I20260709 12:58:17.185886  1617 leader_election.cc:304] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:17.187047  1773 raft_consensus.cc:2804] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:17.183701  1768 tablet_bootstrap.cc:492] T 477960faa15b4001a5a6361558d69294 P 4dbe7d47a2374afca075d3a98583b49e: No bootstrap required, opened a new log
I20260709 12:58:17.187738  1768 ts_tablet_manager.cc:1403] T 477960faa15b4001a5a6361558d69294 P 4dbe7d47a2374afca075d3a98583b49e: Time spent bootstrapping tablet: real 0.111s	user 0.009s	sys 0.010s
I20260709 12:58:17.190375  1801 consensus_queue.cc:1048] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:17.198791  1773 raft_consensus.cc:697] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:58:17.199793  1773 consensus_queue.cc:237] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.204309  1768 raft_consensus.cc:359] T 477960faa15b4001a5a6361558d69294 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.207371  1768 raft_consensus.cc:385] T 477960faa15b4001a5a6361558d69294 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:17.208787  1768 raft_consensus.cc:740] T 477960faa15b4001a5a6361558d69294 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Initialized, Role: FOLLOWER
I20260709 12:58:17.181667  1722 raft_consensus.cc:2468] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 1.
I20260709 12:58:17.183636  1765 raft_consensus.cc:359] T 4bc29cd0261846b7847f38862b494d0b P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.213049  1765 raft_consensus.cc:385] T 4bc29cd0261846b7847f38862b494d0b P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:17.213482  1765 raft_consensus.cc:740] T 4bc29cd0261846b7847f38862b494d0b P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Initialized, Role: FOLLOWER
I20260709 12:58:17.214315  1765 consensus_queue.cc:260] T 4bc29cd0261846b7847f38862b494d0b P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.209877  1767 tablet_bootstrap.cc:492] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: No bootstrap required, opened a new log
I20260709 12:58:17.215306  1617 leader_election.cc:304] T 3ba8e707693e4af2b8347a4bad4dfd67 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:17.211228  1768 consensus_queue.cc:260] T 477960faa15b4001a5a6361558d69294 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.216236  1801 raft_consensus.cc:2804] T 3ba8e707693e4af2b8347a4bad4dfd67 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:17.216874  1801 raft_consensus.cc:697] T 3ba8e707693e4af2b8347a4bad4dfd67 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:58:17.217784  1801 consensus_queue.cc:237] T 3ba8e707693e4af2b8347a4bad4dfd67 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.215544  1767 ts_tablet_manager.cc:1403] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent bootstrapping tablet: real 0.077s	user 0.013s	sys 0.000s
I20260709 12:58:17.218871  1768 ts_tablet_manager.cc:1434] T 477960faa15b4001a5a6361558d69294 P 4dbe7d47a2374afca075d3a98583b49e: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 12:58:17.220512  1765 ts_tablet_manager.cc:1434] T 4bc29cd0261846b7847f38862b494d0b P 0c7751452c4b46afa95251b9df7169d4: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.000s
I20260709 12:58:17.221506  1765 tablet_bootstrap.cc:492] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4: Bootstrap starting.
I20260709 12:58:17.224686  1768 tablet_bootstrap.cc:492] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e: Bootstrap starting.
I20260709 12:58:17.225230  1471 catalog_manager.cc:5697] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 0 to 1, leader changed from <none> to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:17.231469  1768 tablet_bootstrap.cc:654] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:17.233050  1767 raft_consensus.cc:359] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.233886  1767 raft_consensus.cc:385] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:17.234201  1767 raft_consensus.cc:740] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Initialized, Role: FOLLOWER
I20260709 12:58:17.231560  1765 tablet_bootstrap.cc:654] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:17.236449  1767 consensus_queue.cc:260] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.238127  1768 tablet_bootstrap.cc:492] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e: No bootstrap required, opened a new log
I20260709 12:58:17.238580  1768 ts_tablet_manager.cc:1403] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 12:58:17.240010  1767 ts_tablet_manager.cc:1434] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:58:17.241422  1767 tablet_bootstrap.cc:492] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Bootstrap starting.
I20260709 12:58:17.241384  1768 raft_consensus.cc:359] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.242180  1768 raft_consensus.cc:385] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:17.242458  1768 raft_consensus.cc:740] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Initialized, Role: FOLLOWER
I20260709 12:58:17.243148  1768 consensus_queue.cc:260] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.243852  1828 raft_consensus.cc:493] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:17.244608  1828 raft_consensus.cc:515] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.245558  1768 ts_tablet_manager.cc:1434] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:58:17.246402  1768 tablet_bootstrap.cc:492] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e: Bootstrap starting.
I20260709 12:58:17.248384  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:17.250059  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:17.250790  1722 raft_consensus.cc:2393] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 1: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:58:17.252166  1768 tablet_bootstrap.cc:654] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:17.251953  1542 leader_election.cc:304] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:58:17.252789  1822 raft_consensus.cc:3060] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:17.253417  1773 raft_consensus.cc:493] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:17.253863  1773 raft_consensus.cc:515] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.252942  1828 leader_election.cc:290] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:17.256661  1773 leader_election.cc:290] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:17.258075  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:17.258797  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:17.259668  1575 raft_consensus.cc:2468] T 62c04bf03d764babb1a5e3b102527e5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 0.
W20260709 12:58:17.259899  1617 leader_election.cc:343] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:17.261548  1615 leader_election.cc:304] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 12:58:17.263078  1773 raft_consensus.cc:2804] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:17.263589  1773 raft_consensus.cc:493] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:17.264164  1773 raft_consensus.cc:3060] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:17.264676  1767 tablet_bootstrap.cc:654] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Neither blocks nor log segments found. Creating new log.
W20260709 12:58:17.268086  1838 log.cc:927] Time spent T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:58:17.270752  1768 tablet_bootstrap.cc:492] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e: No bootstrap required, opened a new log
I20260709 12:58:17.271262  1768 ts_tablet_manager.cc:1403] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.005s
I20260709 12:58:17.274089  1768 raft_consensus.cc:359] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.274497  1822 raft_consensus.cc:2749] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:17.274809  1768 raft_consensus.cc:385] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:17.275154  1768 raft_consensus.cc:740] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Initialized, Role: FOLLOWER
I20260709 12:58:17.275815  1768 consensus_queue.cc:260] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.277037  1825 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:17.278184  1825 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.279973  1768 ts_tablet_manager.cc:1434] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 12:58:17.280282  1765 tablet_bootstrap.cc:492] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4: No bootstrap required, opened a new log
I20260709 12:58:17.280825  1825 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:17.280817  1765 ts_tablet_manager.cc:1403] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4: Time spent bootstrapping tablet: real 0.060s	user 0.016s	sys 0.025s
I20260709 12:58:17.281533  1768 tablet_bootstrap.cc:492] T 091ce8e86e49437b8fffb903bd5ce2fb P 4dbe7d47a2374afca075d3a98583b49e: Bootstrap starting.
I20260709 12:58:17.282954  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:17.284179  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:17.284032  1765 raft_consensus.cc:359] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.284799  1765 raft_consensus.cc:385] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:17.285104  1765 raft_consensus.cc:740] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Initialized, Role: FOLLOWER
W20260709 12:58:17.286197  1688 leader_election.cc:343] T 4bc29cd0261846b7847f38862b494d0b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:17.287146  1689 leader_election.cc:343] T 4bc29cd0261846b7847f38862b494d0b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:17.287623  1689 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:17.288807  1825 raft_consensus.cc:2749] T 4bc29cd0261846b7847f38862b494d0b P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:17.286356  1765 consensus_queue.cc:260] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.290139  1768 tablet_bootstrap.cc:654] T 091ce8e86e49437b8fffb903bd5ce2fb P 4dbe7d47a2374afca075d3a98583b49e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:17.293107  1773 raft_consensus.cc:515] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.296216  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:17.296854  1576 raft_consensus.cc:3060] T 62c04bf03d764babb1a5e3b102527e5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:17.296638  1471 catalog_manager.cc:5697] T 3ba8e707693e4af2b8347a4bad4dfd67 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 0 to 1, leader changed from <none> to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:17.299970  1765 ts_tablet_manager.cc:1434] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4: Time spent starting tablet: real 0.018s	user 0.004s	sys 0.002s
I20260709 12:58:17.307204  1801 consensus_queue.cc:1048] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:17.309127  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:58:17.309070  1773 leader_election.cc:290] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:58:17.310587  1617 leader_election.cc:343] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:17.311405  1765 tablet_bootstrap.cc:492] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4: Bootstrap starting.
I20260709 12:58:17.317373  1773 consensus_queue.cc:1048] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:17.318347  1576 raft_consensus.cc:2468] T 62c04bf03d764babb1a5e3b102527e5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 1.
I20260709 12:58:17.327800  1765 tablet_bootstrap.cc:654] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:17.325651  1615 leader_election.cc:304] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 12:58:17.334132  1773 raft_consensus.cc:2804] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:17.336365  1773 raft_consensus.cc:697] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:58:17.338025  1768 tablet_bootstrap.cc:492] T 091ce8e86e49437b8fffb903bd5ce2fb P 4dbe7d47a2374afca075d3a98583b49e: No bootstrap required, opened a new log
I20260709 12:58:17.338454  1768 ts_tablet_manager.cc:1403] T 091ce8e86e49437b8fffb903bd5ce2fb P 4dbe7d47a2374afca075d3a98583b49e: Time spent bootstrapping tablet: real 0.057s	user 0.018s	sys 0.017s
I20260709 12:58:17.341771  1767 tablet_bootstrap.cc:492] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: No bootstrap required, opened a new log
I20260709 12:58:17.342242  1767 ts_tablet_manager.cc:1403] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent bootstrapping tablet: real 0.101s	user 0.022s	sys 0.000s
I20260709 12:58:17.344825  1765 tablet_bootstrap.cc:492] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4: No bootstrap required, opened a new log
I20260709 12:58:17.344517  1768 raft_consensus.cc:359] T 091ce8e86e49437b8fffb903bd5ce2fb P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.345294  1765 ts_tablet_manager.cc:1403] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.000s
I20260709 12:58:17.345404  1768 raft_consensus.cc:385] T 091ce8e86e49437b8fffb903bd5ce2fb P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:17.345885  1768 raft_consensus.cc:740] T 091ce8e86e49437b8fffb903bd5ce2fb P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Initialized, Role: FOLLOWER
I20260709 12:58:17.347420  1768 consensus_queue.cc:260] T 091ce8e86e49437b8fffb903bd5ce2fb P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.347713  1767 raft_consensus.cc:359] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.348271  1767 raft_consensus.cc:385] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:17.348582  1767 raft_consensus.cc:740] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Initialized, Role: FOLLOWER
I20260709 12:58:17.337283  1773 consensus_queue.cc:237] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.349246  1767 consensus_queue.cc:260] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.351783  1767 ts_tablet_manager.cc:1434] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:58:17.353821  1768 ts_tablet_manager.cc:1434] T 091ce8e86e49437b8fffb903bd5ce2fb P 4dbe7d47a2374afca075d3a98583b49e: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 12:58:17.354909  1768 tablet_bootstrap.cc:492] T c998894dcb744ba3825db19244f8207e P 4dbe7d47a2374afca075d3a98583b49e: Bootstrap starting.
I20260709 12:58:17.355458  1767 tablet_bootstrap.cc:492] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Bootstrap starting.
I20260709 12:58:17.358453  1765 raft_consensus.cc:359] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.359272  1765 raft_consensus.cc:385] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:17.359584  1765 raft_consensus.cc:740] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Initialized, Role: FOLLOWER
I20260709 12:58:17.360289  1765 consensus_queue.cc:260] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.361886  1768 tablet_bootstrap.cc:654] T c998894dcb744ba3825db19244f8207e P 4dbe7d47a2374afca075d3a98583b49e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:17.367990  1835 raft_consensus.cc:493] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:17.368608  1835 raft_consensus.cc:515] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.371517  1835 leader_election.cc:290] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:17.373426  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:17.376519  1765 ts_tablet_manager.cc:1434] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 12:58:17.380003  1765 tablet_bootstrap.cc:492] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4: Bootstrap starting.
W20260709 12:58:17.380180  1615 leader_election.cc:343] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:17.385385  1767 tablet_bootstrap.cc:654] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:17.387434  1835 raft_consensus.cc:493] T 477960faa15b4001a5a6361558d69294 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:17.387967  1835 raft_consensus.cc:515] T 477960faa15b4001a5a6361558d69294 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.390089  1768 tablet_bootstrap.cc:492] T c998894dcb744ba3825db19244f8207e P 4dbe7d47a2374afca075d3a98583b49e: No bootstrap required, opened a new log
I20260709 12:58:17.390352  1835 leader_election.cc:290] T 477960faa15b4001a5a6361558d69294 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:17.390561  1768 ts_tablet_manager.cc:1403] T c998894dcb744ba3825db19244f8207e P 4dbe7d47a2374afca075d3a98583b49e: Time spent bootstrapping tablet: real 0.036s	user 0.020s	sys 0.003s
I20260709 12:58:17.387584  1765 tablet_bootstrap.cc:654] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:17.378420  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:17.392969  1722 raft_consensus.cc:2468] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 0.
I20260709 12:58:17.393240  1768 raft_consensus.cc:359] T c998894dcb744ba3825db19244f8207e P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.393950  1768 raft_consensus.cc:385] T c998894dcb744ba3825db19244f8207e P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:17.394220  1768 raft_consensus.cc:740] T c998894dcb744ba3825db19244f8207e P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Initialized, Role: FOLLOWER
I20260709 12:58:17.394871  1768 consensus_queue.cc:260] T c998894dcb744ba3825db19244f8207e P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.395489  1617 leader_election.cc:304] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:17.396746  1834 raft_consensus.cc:2804] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:17.397037  1768 ts_tablet_manager.cc:1434] T c998894dcb744ba3825db19244f8207e P 4dbe7d47a2374afca075d3a98583b49e: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:58:17.397176  1834 raft_consensus.cc:493] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:17.397450  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:17.397640  1834 raft_consensus.cc:3060] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:17.398005  1768 tablet_bootstrap.cc:492] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e: Bootstrap starting.
I20260709 12:58:17.399627  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:17.411052  1834 raft_consensus.cc:515] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:58:17.400337  1615 leader_election.cc:343] T 477960faa15b4001a5a6361558d69294 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:17.424314  1617 leader_election.cc:343] T 477960faa15b4001a5a6361558d69294 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:17.424597  1767 tablet_bootstrap.cc:492] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: No bootstrap required, opened a new log
I20260709 12:58:17.424834  1617 leader_election.cc:304] T 477960faa15b4001a5a6361558d69294 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:17.425239  1767 ts_tablet_manager.cc:1403] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent bootstrapping tablet: real 0.070s	user 0.009s	sys 0.005s
I20260709 12:58:17.426739  1768 tablet_bootstrap.cc:654] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:17.425220  1834 leader_election.cc:290] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:17.427357  1834 raft_consensus.cc:2749] T 477960faa15b4001a5a6361558d69294 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:17.428894  1767 raft_consensus.cc:359] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.429666  1767 raft_consensus.cc:385] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:17.430069  1765 tablet_bootstrap.cc:492] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4: No bootstrap required, opened a new log
I20260709 12:58:17.429999  1767 raft_consensus.cc:740] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Initialized, Role: FOLLOWER
I20260709 12:58:17.430604  1765 ts_tablet_manager.cc:1403] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4: Time spent bootstrapping tablet: real 0.051s	user 0.024s	sys 0.010s
I20260709 12:58:17.431063  1767 consensus_queue.cc:260] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.433885  1765 raft_consensus.cc:359] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.434643  1765 raft_consensus.cc:385] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:17.435045  1765 raft_consensus.cc:740] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Initialized, Role: FOLLOWER
I20260709 12:58:17.434108  1471 catalog_manager.cc:5697] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 0 to 1, leader changed from <none> to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:17.436614  1765 consensus_queue.cc:260] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.438225  1768 tablet_bootstrap.cc:492] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e: No bootstrap required, opened a new log
I20260709 12:58:17.438655  1768 ts_tablet_manager.cc:1403] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e: Time spent bootstrapping tablet: real 0.041s	user 0.021s	sys 0.017s
I20260709 12:58:17.438520  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:58:17.438819  1765 ts_tablet_manager.cc:1434] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:58:17.439043  1722 raft_consensus.cc:3060] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:17.439798  1765 tablet_bootstrap.cc:492] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4: Bootstrap starting.
I20260709 12:58:17.441962  1768 raft_consensus.cc:359] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.442564  1768 raft_consensus.cc:385] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:17.442885  1768 raft_consensus.cc:740] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Initialized, Role: FOLLOWER
I20260709 12:58:17.443594  1768 consensus_queue.cc:260] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.445945  1768 ts_tablet_manager.cc:1434] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:58:17.446784  1768 tablet_bootstrap.cc:492] T f8c04e2c99384254b275d20e6d27467b P 4dbe7d47a2374afca075d3a98583b49e: Bootstrap starting.
I20260709 12:58:17.446904  1765 tablet_bootstrap.cc:654] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:17.447049  1722 raft_consensus.cc:2468] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 1.
I20260709 12:58:17.452639  1765 tablet_bootstrap.cc:492] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4: No bootstrap required, opened a new log
I20260709 12:58:17.452724  1768 tablet_bootstrap.cc:654] T f8c04e2c99384254b275d20e6d27467b P 4dbe7d47a2374afca075d3a98583b49e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:17.453158  1765 ts_tablet_manager.cc:1403] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.004s
I20260709 12:58:17.452755  1617 leader_election.cc:304] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:58:17.454232  1773 raft_consensus.cc:2804] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:17.454743  1773 raft_consensus.cc:697] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:58:17.455881  1765 raft_consensus.cc:359] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.456804  1765 raft_consensus.cc:385] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:17.457162  1765 raft_consensus.cc:740] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Initialized, Role: FOLLOWER
I20260709 12:58:17.457780  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:17.458022  1765 consensus_queue.cc:260] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.455639  1773 consensus_queue.cc:237] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:58:17.459766  1615 leader_election.cc:343] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:17.460830  1765 ts_tablet_manager.cc:1434] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:58:17.461927  1765 tablet_bootstrap.cc:492] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4: Bootstrap starting.
I20260709 12:58:17.464461  1768 tablet_bootstrap.cc:492] T f8c04e2c99384254b275d20e6d27467b P 4dbe7d47a2374afca075d3a98583b49e: No bootstrap required, opened a new log
I20260709 12:58:17.464983  1768 ts_tablet_manager.cc:1403] T f8c04e2c99384254b275d20e6d27467b P 4dbe7d47a2374afca075d3a98583b49e: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.008s
I20260709 12:58:17.466398  1767 ts_tablet_manager.cc:1434] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.000s
I20260709 12:58:17.467545  1768 raft_consensus.cc:359] T f8c04e2c99384254b275d20e6d27467b P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.468084  1765 tablet_bootstrap.cc:654] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:17.468242  1768 raft_consensus.cc:385] T f8c04e2c99384254b275d20e6d27467b P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:17.468538  1768 raft_consensus.cc:740] T f8c04e2c99384254b275d20e6d27467b P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Initialized, Role: FOLLOWER
I20260709 12:58:17.469359  1768 consensus_queue.cc:260] T f8c04e2c99384254b275d20e6d27467b P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.472229  1768 ts_tablet_manager.cc:1434] T f8c04e2c99384254b275d20e6d27467b P 4dbe7d47a2374afca075d3a98583b49e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:58:17.473515  1768 tablet_bootstrap.cc:492] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e: Bootstrap starting.
I20260709 12:58:17.475837  1767 tablet_bootstrap.cc:492] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Bootstrap starting.
I20260709 12:58:17.490001  1651 raft_consensus.cc:3060] T 091ce8e86e49437b8fffb903bd5ce2fb P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:17.494051  1768 tablet_bootstrap.cc:654] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:17.496414  1576 raft_consensus.cc:3060] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:17.499377  1767 tablet_bootstrap.cc:654] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:17.500671  1765 tablet_bootstrap.cc:492] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4: No bootstrap required, opened a new log
I20260709 12:58:17.501284  1765 ts_tablet_manager.cc:1403] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4: Time spent bootstrapping tablet: real 0.040s	user 0.015s	sys 0.016s
I20260709 12:58:17.504772  1765 raft_consensus.cc:359] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.505334  1765 raft_consensus.cc:385] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:17.505595  1765 raft_consensus.cc:740] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Initialized, Role: FOLLOWER
I20260709 12:58:17.506537  1768 tablet_bootstrap.cc:492] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e: No bootstrap required, opened a new log
I20260709 12:58:17.506399  1765 consensus_queue.cc:260] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.506965  1768 ts_tablet_manager.cc:1403] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e: Time spent bootstrapping tablet: real 0.034s	user 0.018s	sys 0.000s
I20260709 12:58:17.508409  1765 ts_tablet_manager.cc:1434] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:58:17.509761  1765 tablet_bootstrap.cc:492] T 1aa00507899e41f9b595f503add14c8c P 0c7751452c4b46afa95251b9df7169d4: Bootstrap starting.
I20260709 12:58:17.510172  1768 raft_consensus.cc:359] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.510816  1768 raft_consensus.cc:385] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:17.511066  1768 raft_consensus.cc:740] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Initialized, Role: FOLLOWER
I20260709 12:58:17.516269  1768 consensus_queue.cc:260] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.517462  1767 tablet_bootstrap.cc:492] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: No bootstrap required, opened a new log
I20260709 12:58:17.517920  1767 ts_tablet_manager.cc:1403] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent bootstrapping tablet: real 0.042s	user 0.014s	sys 0.002s
I20260709 12:58:17.518643  1765 tablet_bootstrap.cc:654] T 1aa00507899e41f9b595f503add14c8c P 0c7751452c4b46afa95251b9df7169d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:17.518718  1768 ts_tablet_manager.cc:1434] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.004s
I20260709 12:58:17.520390  1768 tablet_bootstrap.cc:492] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e: Bootstrap starting.
I20260709 12:58:17.523739  1767 raft_consensus.cc:359] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.524293  1767 raft_consensus.cc:385] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:17.524466  1767 raft_consensus.cc:740] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Initialized, Role: FOLLOWER
I20260709 12:58:17.525669  1767 consensus_queue.cc:260] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.528306  1767 ts_tablet_manager.cc:1434] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:58:17.529528  1767 tablet_bootstrap.cc:492] T 475f4ce2905344b0803209ce7b2e9386 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Bootstrap starting.
I20260709 12:58:17.530851  1768 tablet_bootstrap.cc:654] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:17.531229  1825 raft_consensus.cc:493] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:17.531713  1825 raft_consensus.cc:515] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.534252  1825 leader_election.cc:290] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:17.515974  1472 catalog_manager.cc:5697] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 0 to 1, leader changed from <none> to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:17.536269  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:17.536284  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:17.539180  1650 raft_consensus.cc:2468] T f8c04e2c99384254b275d20e6d27467b P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 0.
W20260709 12:58:17.541654  1521 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:17.543192  1688 leader_election.cc:304] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:58:17.546347  1825 raft_consensus.cc:2804] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:17.546716  1825 raft_consensus.cc:493] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:17.546993  1689 leader_election.cc:343] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:17.547019  1825 raft_consensus.cc:3060] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:17.560753  1825 raft_consensus.cc:515] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.566354  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:17.567157  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:17.567925  1650 raft_consensus.cc:3060] T f8c04e2c99384254b275d20e6d27467b P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:17.568709  1767 tablet_bootstrap.cc:654] T 475f4ce2905344b0803209ce7b2e9386 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Neither blocks nor log segments found. Creating new log.
W20260709 12:58:17.569849  1689 leader_election.cc:343] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:17.571462  1825 leader_election.cc:290] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:17.576575  1650 raft_consensus.cc:2468] T f8c04e2c99384254b275d20e6d27467b P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 1.
I20260709 12:58:17.577862  1688 leader_election.cc:304] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:17.579079  1825 raft_consensus.cc:2804] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:17.579800  1825 raft_consensus.cc:697] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:58:17.583050  1825 consensus_queue.cc:237] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.584255  1793 raft_consensus.cc:493] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:17.584771  1793 raft_consensus.cc:515] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.586850  1793 leader_election.cc:290] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:17.586978  1768 tablet_bootstrap.cc:492] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e: No bootstrap required, opened a new log
I20260709 12:58:17.587297  1765 tablet_bootstrap.cc:492] T 1aa00507899e41f9b595f503add14c8c P 0c7751452c4b46afa95251b9df7169d4: No bootstrap required, opened a new log
I20260709 12:58:17.587671  1768 ts_tablet_manager.cc:1403] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e: Time spent bootstrapping tablet: real 0.068s	user 0.009s	sys 0.022s
I20260709 12:58:17.588130  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:17.588492  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:17.588912  1651 raft_consensus.cc:2468] T c998894dcb744ba3825db19244f8207e P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 0.
I20260709 12:58:17.589359  1576 raft_consensus.cc:2468] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 0.
I20260709 12:58:17.590124  1688 leader_election.cc:304] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:58:17.587761  1765 ts_tablet_manager.cc:1403] T 1aa00507899e41f9b595f503add14c8c P 0c7751452c4b46afa95251b9df7169d4: Time spent bootstrapping tablet: real 0.078s	user 0.026s	sys 0.020s
I20260709 12:58:17.590540  1835 raft_consensus.cc:493] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:17.591042  1835 raft_consensus.cc:515] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.591150  1793 raft_consensus.cc:2804] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:17.592032  1793 raft_consensus.cc:493] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:17.592430  1793 raft_consensus.cc:3060] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:17.592180  1768 raft_consensus.cc:359] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.596035  1768 raft_consensus.cc:385] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:17.593343  1767 tablet_bootstrap.cc:492] T 475f4ce2905344b0803209ce7b2e9386 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: No bootstrap required, opened a new log
I20260709 12:58:17.595129  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:17.596674  1768 raft_consensus.cc:740] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Initialized, Role: FOLLOWER
I20260709 12:58:17.597364  1767 ts_tablet_manager.cc:1403] T 475f4ce2905344b0803209ce7b2e9386 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent bootstrapping tablet: real 0.068s	user 0.009s	sys 0.005s
W20260709 12:58:17.597613  1617 leader_election.cc:343] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:17.597637  1768 consensus_queue.cc:260] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.595283  1765 raft_consensus.cc:359] T 1aa00507899e41f9b595f503add14c8c P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.600505  1765 raft_consensus.cc:385] T 1aa00507899e41f9b595f503add14c8c P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:17.600888  1765 raft_consensus.cc:740] T 1aa00507899e41f9b595f503add14c8c P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Initialized, Role: FOLLOWER
I20260709 12:58:17.600328  1767 raft_consensus.cc:359] T 475f4ce2905344b0803209ce7b2e9386 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.601862  1767 raft_consensus.cc:385] T 475f4ce2905344b0803209ce7b2e9386 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:17.601550  1765 consensus_queue.cc:260] T 1aa00507899e41f9b595f503add14c8c P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.602152  1767 raft_consensus.cc:740] T 475f4ce2905344b0803209ce7b2e9386 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Initialized, Role: FOLLOWER
I20260709 12:58:17.603598  1765 ts_tablet_manager.cc:1434] T 1aa00507899e41f9b595f503add14c8c P 0c7751452c4b46afa95251b9df7169d4: Time spent starting tablet: real 0.013s	user 0.001s	sys 0.002s
I20260709 12:58:17.604501  1765 tablet_bootstrap.cc:492] T 05713611987147e49a96fdf32bb28649 P 0c7751452c4b46afa95251b9df7169d4: Bootstrap starting.
I20260709 12:58:17.600329  1793 raft_consensus.cc:515] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.605154  1768 ts_tablet_manager.cc:1434] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e: Time spent starting tablet: real 0.017s	user 0.001s	sys 0.006s
I20260709 12:58:17.606173  1768 tablet_bootstrap.cc:492] T 2f8dd5957a2647058190fd52f31ec088 P 4dbe7d47a2374afca075d3a98583b49e: Bootstrap starting.
I20260709 12:58:17.607116  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:17.607764  1575 raft_consensus.cc:3060] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:17.595992  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:17.593089  1835 leader_election.cc:290] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:17.609143  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:17.609768  1651 raft_consensus.cc:3060] T c998894dcb744ba3825db19244f8207e P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:17.611065  1765 tablet_bootstrap.cc:654] T 05713611987147e49a96fdf32bb28649 P 0c7751452c4b46afa95251b9df7169d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:17.618198  1651 raft_consensus.cc:2468] T c998894dcb744ba3825db19244f8207e P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 1.
I20260709 12:58:17.619428  1688 leader_election.cc:304] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:58:17.604036  1767 consensus_queue.cc:260] T 475f4ce2905344b0803209ce7b2e9386 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.620352  1824 raft_consensus.cc:2804] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:17.620460  1822 consensus_queue.cc:1048] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:17.623009  1767 ts_tablet_manager.cc:1434] T 475f4ce2905344b0803209ce7b2e9386 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 12:58:17.624130  1767 tablet_bootstrap.cc:492] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Bootstrap starting.
I20260709 12:58:17.620774  1576 raft_consensus.cc:2468] T 475f4ce2905344b0803209ce7b2e9386 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 0.
I20260709 12:58:17.620559  1793 leader_election.cc:290] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:17.628787  1615 leader_election.cc:304] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 12:58:17.632395  1835 raft_consensus.cc:2804] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:17.632954  1835 raft_consensus.cc:493] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:17.633397  1835 raft_consensus.cc:3060] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:17.654050  1767 tablet_bootstrap.cc:654] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:17.650790  1575 raft_consensus.cc:2468] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 1.
I20260709 12:58:17.666771  1765 tablet_bootstrap.cc:492] T 05713611987147e49a96fdf32bb28649 P 0c7751452c4b46afa95251b9df7169d4: No bootstrap required, opened a new log
I20260709 12:58:17.667003  1824 raft_consensus.cc:697] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:58:17.667634  1765 ts_tablet_manager.cc:1403] T 05713611987147e49a96fdf32bb28649 P 0c7751452c4b46afa95251b9df7169d4: Time spent bootstrapping tablet: real 0.063s	user 0.030s	sys 0.029s
I20260709 12:58:17.667965  1824 consensus_queue.cc:237] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.678828  1828 consensus_queue.cc:1048] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:17.681267  1768 tablet_bootstrap.cc:654] T 2f8dd5957a2647058190fd52f31ec088 P 4dbe7d47a2374afca075d3a98583b49e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:17.677469  1835 raft_consensus.cc:515] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.684831  1835 leader_election.cc:290] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:17.685520  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:17.686100  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 12:58:17.691004  1617 leader_election.cc:343] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:17.686363  1575 raft_consensus.cc:3060] T 475f4ce2905344b0803209ce7b2e9386 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:17.694748  1773 consensus_queue.cc:1048] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:17.689177  1765 raft_consensus.cc:359] T 05713611987147e49a96fdf32bb28649 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.697572  1765 raft_consensus.cc:385] T 05713611987147e49a96fdf32bb28649 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:17.697916  1765 raft_consensus.cc:740] T 05713611987147e49a96fdf32bb28649 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Initialized, Role: FOLLOWER
I20260709 12:58:17.697665  1773 consensus_queue.cc:1048] T 3ba8e707693e4af2b8347a4bad4dfd67 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:17.698465  1575 raft_consensus.cc:2468] T 475f4ce2905344b0803209ce7b2e9386 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 1.
I20260709 12:58:17.698943  1765 consensus_queue.cc:260] T 05713611987147e49a96fdf32bb28649 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.699636  1615 leader_election.cc:304] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 12:58:17.700739  1835 raft_consensus.cc:2804] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:17.701548  1765 ts_tablet_manager.cc:1434] T 05713611987147e49a96fdf32bb28649 P 0c7751452c4b46afa95251b9df7169d4: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 12:58:17.702678  1765 tablet_bootstrap.cc:492] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4: Bootstrap starting.
I20260709 12:58:17.728472  1834 raft_consensus.cc:493] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:17.729123  1834 raft_consensus.cc:515] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.717701  1835 raft_consensus.cc:697] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:58:17.736905  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:17.741400  1834 leader_election.cc:290] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:17.747521  1866 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:17.751314  1866 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:58:17.753955  1615 leader_election.cc:343] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:17.754140  1866 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:17.755954  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:17.756384  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:17.757012  1723 raft_consensus.cc:2468] T 05713611987147e49a96fdf32bb28649 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 0.
W20260709 12:58:17.757580  1689 leader_election.cc:343] T 1aa00507899e41f9b595f503add14c8c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:17.758244  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:17.758664  1617 leader_election.cc:304] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:17.760443  1773 raft_consensus.cc:2804] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:58:17.760823  1688 leader_election.cc:343] T 1aa00507899e41f9b595f503add14c8c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:17.761615  1688 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:17.760821  1773 raft_consensus.cc:493] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:17.762735  1835 consensus_queue.cc:237] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.763532  1773 raft_consensus.cc:3060] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:17.767038  1767 tablet_bootstrap.cc:492] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226: No bootstrap required, opened a new log
I20260709 12:58:17.767437  1767 ts_tablet_manager.cc:1403] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent bootstrapping tablet: real 0.144s	user 0.017s	sys 0.001s
I20260709 12:58:17.774060  1866 raft_consensus.cc:2749] T 1aa00507899e41f9b595f503add14c8c P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:17.787127  1767 raft_consensus.cc:359] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.787858  1767 raft_consensus.cc:385] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:17.788141  1767 raft_consensus.cc:740] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Initialized, Role: FOLLOWER
I20260709 12:58:17.789952  1767 consensus_queue.cc:260] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.792173  1835 consensus_queue.cc:1048] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:17.792747  1765 tablet_bootstrap.cc:654] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:17.792645  1576 raft_consensus.cc:3060] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:17.804760  1824 raft_consensus.cc:493] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:17.805547  1824 raft_consensus.cc:515] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.807044  1866 raft_consensus.cc:493] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:17.807569  1866 raft_consensus.cc:515] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.809056  1768 tablet_bootstrap.cc:492] T 2f8dd5957a2647058190fd52f31ec088 P 4dbe7d47a2374afca075d3a98583b49e: No bootstrap required, opened a new log
I20260709 12:58:17.809536  1768 ts_tablet_manager.cc:1403] T 2f8dd5957a2647058190fd52f31ec088 P 4dbe7d47a2374afca075d3a98583b49e: Time spent bootstrapping tablet: real 0.204s	user 0.027s	sys 0.032s
I20260709 12:58:17.810201  1866 leader_election.cc:290] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:17.811233  1767 ts_tablet_manager.cc:1434] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.001s
I20260709 12:58:17.812125  1767 tablet_bootstrap.cc:492] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Bootstrap starting.
I20260709 12:58:17.811606  1472 catalog_manager.cc:5697] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:17.813102  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:17.812891  1768 raft_consensus.cc:359] T 2f8dd5957a2647058190fd52f31ec088 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.814385  1768 raft_consensus.cc:385] T 2f8dd5957a2647058190fd52f31ec088 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:17.814985  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:58:17.815455  1689 leader_election.cc:343] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:17.815606  1650 raft_consensus.cc:2468] T 477960faa15b4001a5a6361558d69294 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 0.
I20260709 12:58:17.814698  1768 raft_consensus.cc:740] T 2f8dd5957a2647058190fd52f31ec088 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Initialized, Role: FOLLOWER
I20260709 12:58:17.817287  1768 consensus_queue.cc:260] T 2f8dd5957a2647058190fd52f31ec088 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.818014  1688 leader_election.cc:304] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:17.819504  1768 ts_tablet_manager.cc:1434] T 2f8dd5957a2647058190fd52f31ec088 P 4dbe7d47a2374afca075d3a98583b49e: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:58:17.825750  1866 raft_consensus.cc:2804] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:17.826980  1866 raft_consensus.cc:493] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:17.827808  1866 raft_consensus.cc:3060] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:17.816715  1773 raft_consensus.cc:515] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.829726  1773 leader_election.cc:290] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:17.830930  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:17.835925  1869 raft_consensus.cc:493] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:17.836512  1869 raft_consensus.cc:515] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.838595  1869 leader_election.cc:290] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:17.838860  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:58:17.839490  1723 raft_consensus.cc:3060] T 05713611987147e49a96fdf32bb28649 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:17.840586  1615 leader_election.cc:343] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:17.841137  1866 raft_consensus.cc:515] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.843546  1866 leader_election.cc:290] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:17.845333  1801 consensus_queue.cc:1048] T 3ba8e707693e4af2b8347a4bad4dfd67 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:17.848975  1765 tablet_bootstrap.cc:492] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4: No bootstrap required, opened a new log
I20260709 12:58:17.849493  1765 ts_tablet_manager.cc:1403] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4: Time spent bootstrapping tablet: real 0.147s	user 0.008s	sys 0.007s
I20260709 12:58:17.849843  1767 tablet_bootstrap.cc:654] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:17.851068  1723 raft_consensus.cc:2468] T 05713611987147e49a96fdf32bb28649 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 1.
I20260709 12:58:17.851969  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:17.853317  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:17.854233  1651 raft_consensus.cc:3060] T 477960faa15b4001a5a6361558d69294 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:17.855916  1765 raft_consensus.cc:359] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.856676  1765 raft_consensus.cc:385] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:17.856976  1765 raft_consensus.cc:740] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Initialized, Role: FOLLOWER
I20260709 12:58:17.859649  1765 consensus_queue.cc:260] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.861236  1768 tablet_bootstrap.cc:492] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e: Bootstrap starting.
I20260709 12:58:17.861927  1765 ts_tablet_manager.cc:1434] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 12:58:17.862869  1765 tablet_bootstrap.cc:492] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4: Bootstrap starting.
I20260709 12:58:17.864892  1824 leader_election.cc:290] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:17.867415  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:17.868685  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:17.869503  1576 raft_consensus.cc:2393] T 62c04bf03d764babb1a5e3b102527e5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 1: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:58:17.870730  1689 leader_election.cc:304] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:17.871940  1824 raft_consensus.cc:3060] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:17.874948  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:17.875039  1617 leader_election.cc:304] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:17.875928  1773 raft_consensus.cc:2804] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:17.876425  1773 raft_consensus.cc:697] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:58:17.874187  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:17.877262  1773 consensus_queue.cc:237] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.867938  1651 raft_consensus.cc:2468] T 477960faa15b4001a5a6361558d69294 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 1.
W20260709 12:58:17.880725  1689 leader_election.cc:343] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:17.882675  1802 raft_consensus.cc:493] T 2f8dd5957a2647058190fd52f31ec088 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:17.882769  1688 leader_election.cc:304] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:17.883287  1802 raft_consensus.cc:515] T 2f8dd5957a2647058190fd52f31ec088 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.885469  1866 raft_consensus.cc:2804] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:17.885913  1802 leader_election.cc:290] T 2f8dd5957a2647058190fd52f31ec088 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:17.886025  1866 raft_consensus.cc:697] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:58:17.887053  1866 consensus_queue.cc:237] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.891979  1474 catalog_manager.cc:5697] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 0 to 1, leader changed from <none> to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:17.893791  1802 consensus_queue.cc:1048] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:17.891997  1542 leader_election.cc:304] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:58:17.898787  1869 raft_consensus.cc:2749] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:17.899710  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:17.916707  1768 tablet_bootstrap.cc:654] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:17.915858  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:17.915817  1471 catalog_manager.cc:5697] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
W20260709 12:58:17.918603  1617 leader_election.cc:343] T 2f8dd5957a2647058190fd52f31ec088 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:17.919425  1615 leader_election.cc:343] T 2f8dd5957a2647058190fd52f31ec088 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:17.919813  1615 leader_election.cc:304] T 2f8dd5957a2647058190fd52f31ec088 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:17.920499  1802 raft_consensus.cc:2749] T 2f8dd5957a2647058190fd52f31ec088 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:17.927937  1767 tablet_bootstrap.cc:492] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: No bootstrap required, opened a new log
I20260709 12:58:17.928442  1767 ts_tablet_manager.cc:1403] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent bootstrapping tablet: real 0.117s	user 0.016s	sys 0.029s
I20260709 12:58:17.935406  1767 raft_consensus.cc:359] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.936486  1767 raft_consensus.cc:385] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:17.936873  1767 raft_consensus.cc:740] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Initialized, Role: FOLLOWER
I20260709 12:58:17.937724  1767 consensus_queue.cc:260] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.941113  1767 ts_tablet_manager.cc:1434] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.003s
I20260709 12:58:17.942318  1767 tablet_bootstrap.cc:492] T f964296f18474862b1eee102af9116f4 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Bootstrap starting.
I20260709 12:58:17.952772  1834 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:17.954020  1824 raft_consensus.cc:2749] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:17.953461  1834 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.961843  1869 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:17.962437  1869 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.965260  1869 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:17.967748  1767 tablet_bootstrap.cc:654] T f964296f18474862b1eee102af9116f4 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:17.970981  1834 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:17.971415  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:58:17.973003  1539 leader_election.cc:343] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:17.977613  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:17.978793  1824 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:17.977974  1472 catalog_manager.cc:5697] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 0 to 1, leader changed from <none> to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:17.979285  1765 tablet_bootstrap.cc:654] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:17.980043  1824 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:17.981669  1768 tablet_bootstrap.cc:492] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e: No bootstrap required, opened a new log
I20260709 12:58:17.985729  1768 ts_tablet_manager.cc:1403] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e: Time spent bootstrapping tablet: real 0.125s	user 0.027s	sys 0.020s
W20260709 12:58:17.991786  1615 leader_election.cc:343] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:17.993492  1615 consensus_peers.cc:597] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:17.993558  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:17.994388  1723 raft_consensus.cc:2468] T 4bc29cd0261846b7847f38862b494d0b P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 0.
I20260709 12:58:17.994391  1773 consensus_queue.cc:1048] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:17.995810  1834 consensus_queue.cc:1048] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:18.002987  1768 raft_consensus.cc:359] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:18.322665  1768 raft_consensus.cc:385] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:18.323053  1768 raft_consensus.cc:740] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Initialized, Role: FOLLOWER
I20260709 12:58:18.323916  1768 consensus_queue.cc:260] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:18.316202  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:18.317575  1824 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:18.355242  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:18.385944  1768 ts_tablet_manager.cc:1434] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e: Time spent starting tablet: real 0.399s	user 0.023s	sys 0.066s
I20260709 12:58:18.392063  1768 tablet_bootstrap.cc:492] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e: Bootstrap starting.
I20260709 12:58:18.365571  1722 raft_consensus.cc:2468] T 1aa00507899e41f9b595f503add14c8c P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 0.
I20260709 12:58:18.414148  1765 tablet_bootstrap.cc:492] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4: No bootstrap required, opened a new log
I20260709 12:58:18.414327  1767 tablet_bootstrap.cc:492] T f964296f18474862b1eee102af9116f4 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: No bootstrap required, opened a new log
I20260709 12:58:18.414687  1765 ts_tablet_manager.cc:1403] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4: Time spent bootstrapping tablet: real 0.552s	user 0.009s	sys 0.037s
I20260709 12:58:18.414904  1767 ts_tablet_manager.cc:1403] T f964296f18474862b1eee102af9116f4 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent bootstrapping tablet: real 0.473s	user 0.031s	sys 0.045s
I20260709 12:58:18.415333  1768 tablet_bootstrap.cc:654] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:18.417923  1767 raft_consensus.cc:359] T f964296f18474862b1eee102af9116f4 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:18.418702  1767 raft_consensus.cc:385] T f964296f18474862b1eee102af9116f4 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:18.418309  1765 raft_consensus.cc:359] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:18.419029  1767 raft_consensus.cc:740] T f964296f18474862b1eee102af9116f4 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Initialized, Role: FOLLOWER
I20260709 12:58:18.419178  1765 raft_consensus.cc:385] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:18.419689  1765 raft_consensus.cc:740] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Initialized, Role: FOLLOWER
I20260709 12:58:18.420215  1767 consensus_queue.cc:260] T f964296f18474862b1eee102af9116f4 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:18.420675  1765 consensus_queue.cc:260] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:18.422298  1767 ts_tablet_manager.cc:1434] T f964296f18474862b1eee102af9116f4 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:58:18.422855  1765 ts_tablet_manager.cc:1434] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:58:18.423306  1767 tablet_bootstrap.cc:492] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Bootstrap starting.
I20260709 12:58:18.423988  1765 tablet_bootstrap.cc:492] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4: Bootstrap starting.
I20260709 12:58:18.430814  1767 tablet_bootstrap.cc:654] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:18.442914  1767 tablet_bootstrap.cc:492] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226: No bootstrap required, opened a new log
I20260709 12:58:18.443360  1767 ts_tablet_manager.cc:1403] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.007s
I20260709 12:58:18.446448  1767 raft_consensus.cc:359] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:18.447218  1767 raft_consensus.cc:385] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:18.447523  1767 raft_consensus.cc:740] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Initialized, Role: FOLLOWER
I20260709 12:58:18.448242  1767 consensus_queue.cc:260] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:18.457181  1767 ts_tablet_manager.cc:1434] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.004s
I20260709 12:58:17.996050  1617 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:18.458150  1767 tablet_bootstrap.cc:492] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Bootstrap starting.
I20260709 12:58:18.534137  1889 raft_consensus.cc:493] T f964296f18474862b1eee102af9116f4 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:18.534812  1889 raft_consensus.cc:515] T f964296f18474862b1eee102af9116f4 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:18.537577  1889 leader_election.cc:290] T f964296f18474862b1eee102af9116f4 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:18.594146  1768 tablet_bootstrap.cc:492] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e: No bootstrap required, opened a new log
I20260709 12:58:18.594763  1768 ts_tablet_manager.cc:1403] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e: Time spent bootstrapping tablet: real 0.203s	user 0.049s	sys 0.033s
I20260709 12:58:18.638366  1890 raft_consensus.cc:493] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:18.638734  1542 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:58:18.638865  1890 raft_consensus.cc:515] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:18.639537  1889 raft_consensus.cc:2804] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:18.639961  1889 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:18.640466  1890 leader_election.cc:290] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:18.640780  1889 raft_consensus.cc:3060] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:18.644996  1572 raft_consensus.cc:3060] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:18.649296  1889 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:18.653096  1889 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:18.663020  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:18.667702  1767 tablet_bootstrap.cc:654] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:18.397083  1651 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 0.
I20260709 12:58:18.674796  1767 tablet_bootstrap.cc:492] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: No bootstrap required, opened a new log
I20260709 12:58:18.675213  1767 ts_tablet_manager.cc:1403] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent bootstrapping tablet: real 0.217s	user 0.017s	sys 0.000s
I20260709 12:58:18.677778  1767 raft_consensus.cc:359] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:18.678457  1767 raft_consensus.cc:385] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:18.678738  1767 raft_consensus.cc:740] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Initialized, Role: FOLLOWER
I20260709 12:58:18.679456  1765 tablet_bootstrap.cc:654] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:18.679441  1767 consensus_queue.cc:260] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:18.681931  1767 ts_tablet_manager.cc:1434] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:58:18.682164  1866 consensus_queue.cc:1048] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:18.682855  1767 tablet_bootstrap.cc:492] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Bootstrap starting.
W20260709 12:58:18.682322  1689 consensus_peers.cc:597] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:58:18.684437  1689 leader_election.cc:343] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:18.685675  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:18.686628  1825 consensus_queue.cc:1048] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:58:18.688503  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 692502us
I20260709 12:58:18.689476  1768 raft_consensus.cc:359] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:18.689963  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:18.690294  1768 raft_consensus.cc:385] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:18.690609  1768 raft_consensus.cc:740] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Initialized, Role: FOLLOWER
I20260709 12:58:18.691282  1768 consensus_queue.cc:260] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:18.692848  1885 raft_consensus.cc:2804] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:18.693029  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:58:18.693262  1885 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:18.694077  1885 raft_consensus.cc:3060] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:18.701817  1768 ts_tablet_manager.cc:1434] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e: Time spent starting tablet: real 0.107s	user 0.007s	sys 0.000s
I20260709 12:58:18.702739  1768 tablet_bootstrap.cc:492] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e: Bootstrap starting.
I20260709 12:58:18.707118  1885 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:18.707808  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:18.709190  1885 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:58:18.711547  1615 consensus_peers.cc:597] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:18.712482  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:18.713424  1650 raft_consensus.cc:3060] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:18.713675  1767 tablet_bootstrap.cc:654] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:18.693715  1723 raft_consensus.cc:3060] T 1aa00507899e41f9b595f503add14c8c P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:18.717813  1768 tablet_bootstrap.cc:654] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:18.720165  1539 leader_election.cc:304] T f964296f18474862b1eee102af9116f4 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:58:18.720702  1773 consensus_queue.cc:1048] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:18.721573  1889 raft_consensus.cc:2749] T f964296f18474862b1eee102af9116f4 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:58:18.725183  1521 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:18.725795  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:18.729553  1575 raft_consensus.cc:3060] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:18.732007  1723 raft_consensus.cc:2468] T 1aa00507899e41f9b595f503add14c8c P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 1.
I20260709 12:58:18.712865  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:18.733050  1649 raft_consensus.cc:2393] T 477960faa15b4001a5a6361558d69294 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 1: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:58:18.733882  1688 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:18.734865  1824 consensus_queue.cc:1048] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:18.734777  1650 raft_consensus.cc:2468] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 1.
I20260709 12:58:18.736338  1824 consensus_queue.cc:1048] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:18.712821  1474 catalog_manager.cc:5697] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:18.737562  1824 raft_consensus.cc:2804] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:18.738516  1824 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:18.738873  1824 raft_consensus.cc:3060] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:18.739831  1575 raft_consensus.cc:2468] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 1.
I20260709 12:58:18.741703  1539 leader_election.cc:304] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:58:18.744180  1539 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:58:18.745524  1890 raft_consensus.cc:2804] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:18.745954  1890 raft_consensus.cc:697] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:58:18.746835  1890 consensus_queue.cc:237] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:18.747140  1824 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:18.749979  1824 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:18.736510  1768 tablet_bootstrap.cc:492] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e: No bootstrap required, opened a new log
I20260709 12:58:18.751030  1768 ts_tablet_manager.cc:1403] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e: Time spent bootstrapping tablet: real 0.048s	user 0.013s	sys 0.002s
I20260709 12:58:18.756827  1572 raft_consensus.cc:3060] T f964296f18474862b1eee102af9116f4 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:18.754640  1768 raft_consensus.cc:359] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:18.761336  1615 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:58:18.761888  1768 raft_consensus.cc:385] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:18.762231  1768 raft_consensus.cc:740] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Initialized, Role: FOLLOWER
I20260709 12:58:18.763319  1773 raft_consensus.cc:2804] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:18.764171  1773 raft_consensus.cc:697] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:58:18.765130  1773 consensus_queue.cc:237] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:58:18.739923  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 47378.8us
I20260709 12:58:18.767297  1768 consensus_queue.cc:260] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:18.769742  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:18.770242  1866 raft_consensus.cc:493] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:18.770785  1866 raft_consensus.cc:515] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:18.772047  1768 ts_tablet_manager.cc:1434] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.003s
I20260709 12:58:18.774233  1866 leader_election.cc:290] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:18.774732  1768 tablet_bootstrap.cc:492] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e: Bootstrap starting.
I20260709 12:58:18.787624  1768 tablet_bootstrap.cc:654] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:18.797662  1765 tablet_bootstrap.cc:492] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4: No bootstrap required, opened a new log
I20260709 12:58:18.798100  1765 ts_tablet_manager.cc:1403] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4: Time spent bootstrapping tablet: real 0.374s	user 0.015s	sys 0.020s
I20260709 12:58:18.800160  1765 raft_consensus.cc:359] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:18.809930  1765 raft_consensus.cc:385] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:18.810273  1765 raft_consensus.cc:740] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Initialized, Role: FOLLOWER
I20260709 12:58:18.810930  1765 consensus_queue.cc:260] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:18.814690  1768 tablet_bootstrap.cc:492] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e: No bootstrap required, opened a new log
I20260709 12:58:18.815179  1768 ts_tablet_manager.cc:1403] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e: Time spent bootstrapping tablet: real 0.041s	user 0.015s	sys 0.000s
I20260709 12:58:18.817714  1765 ts_tablet_manager.cc:1434] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:58:18.818271  1768 raft_consensus.cc:359] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:18.818670  1765 tablet_bootstrap.cc:492] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4: Bootstrap starting.
I20260709 12:58:18.818892  1768 raft_consensus.cc:385] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:18.819186  1768 raft_consensus.cc:740] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Initialized, Role: FOLLOWER
I20260709 12:58:18.819823  1768 consensus_queue.cc:260] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:58:18.824447  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 90655.7us
I20260709 12:58:18.826025  1824 consensus_queue.cc:1048] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:18.828899  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:58:18.829537  1722 raft_consensus.cc:3060] T 4bc29cd0261846b7847f38862b494d0b P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:18.834134  1768 ts_tablet_manager.cc:1434] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:58:18.835474  1768 tablet_bootstrap.cc:492] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e: Bootstrap starting.
I20260709 12:58:18.839731  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:18.840330  1651 raft_consensus.cc:3060] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:18.840790  1722 raft_consensus.cc:2468] T 4bc29cd0261846b7847f38862b494d0b P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 1.
I20260709 12:58:18.848798  1869 raft_consensus.cc:2749] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:18.855305  1765 tablet_bootstrap.cc:654] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:18.861932  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:18.863765  1648 raft_consensus.cc:2468] T 2f8dd5957a2647058190fd52f31ec088 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 0.
W20260709 12:58:18.871691  1617 consensus_peers.cc:597] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Couldn't send request to peer 0c7751452c4b46afa95251b9df7169d4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:58:18.871819  1689 leader_election.cc:343] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:18.875959  1688 leader_election.cc:304] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:58:18.881474  1899 raft_consensus.cc:2804] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:18.882017  1899 raft_consensus.cc:493] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:18.883038  1899 raft_consensus.cc:3060] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:18.892517  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:18.894313  1572 raft_consensus.cc:2468] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 0.
I20260709 12:58:18.868980  1651 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 1.
I20260709 12:58:18.896235  1835 consensus_queue.cc:1048] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:58:18.918604  1688 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:18.927891  1767 tablet_bootstrap.cc:492] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: No bootstrap required, opened a new log
I20260709 12:58:18.928399  1767 ts_tablet_manager.cc:1403] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent bootstrapping tablet: real 0.246s	user 0.044s	sys 0.021s
I20260709 12:58:18.938292  1768 tablet_bootstrap.cc:654] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:18.954497  1767 raft_consensus.cc:359] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:18.955410  1767 raft_consensus.cc:385] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:18.955749  1767 raft_consensus.cc:740] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Initialized, Role: FOLLOWER
I20260709 12:58:18.950915  1471 catalog_manager.cc:5697] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:18.958624  1767 consensus_queue.cc:260] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:18.966995  1765 tablet_bootstrap.cc:492] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4: No bootstrap required, opened a new log
I20260709 12:58:18.967676  1765 ts_tablet_manager.cc:1403] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4: Time spent bootstrapping tablet: real 0.149s	user 0.014s	sys 0.021s
I20260709 12:58:18.973439  1767 ts_tablet_manager.cc:1434] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.000s
I20260709 12:58:18.974200  1767 tablet_bootstrap.cc:492] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Bootstrap starting.
I20260709 12:58:18.978967  1899 raft_consensus.cc:515] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:58:18.968775  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 52071.9us
I20260709 12:58:18.997690  1915 raft_consensus.cc:2804] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:18.999696  1915 raft_consensus.cc:697] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:58:19.000790  1915 consensus_queue.cc:237] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.002893  1765 raft_consensus.cc:359] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.005475  1765 raft_consensus.cc:385] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:19.005966  1765 raft_consensus.cc:740] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Initialized, Role: FOLLOWER
I20260709 12:58:19.005275  1472 catalog_manager.cc:5697] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 0 to 1, leader changed from <none> to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
W20260709 12:58:19.013372  1914 log.cc:927] Time spent T 477960faa15b4001a5a6361558d69294 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:58:19.022114  1768 tablet_bootstrap.cc:492] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e: No bootstrap required, opened a new log
I20260709 12:58:19.022518  1768 ts_tablet_manager.cc:1403] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e: Time spent bootstrapping tablet: real 0.187s	user 0.018s	sys 0.002s
I20260709 12:58:19.030381  1765 consensus_queue.cc:260] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.030915  1768 raft_consensus.cc:359] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.031589  1768 raft_consensus.cc:385] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:19.031857  1768 raft_consensus.cc:740] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Initialized, Role: FOLLOWER
I20260709 12:58:19.032474  1768 consensus_queue.cc:260] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.041013  1899 leader_election.cc:290] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:19.032670  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:19.041971  1572 raft_consensus.cc:3060] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:19.045285  1767 tablet_bootstrap.cc:654] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:19.045526  1765 ts_tablet_manager.cc:1434] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4: Time spent starting tablet: real 0.078s	user 0.013s	sys 0.001s
I20260709 12:58:19.046734  1765 tablet_bootstrap.cc:492] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4: Bootstrap starting.
I20260709 12:58:19.049801  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:19.050398  1648 raft_consensus.cc:3060] T 2f8dd5957a2647058190fd52f31ec088 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:19.067461  1768 ts_tablet_manager.cc:1434] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e: Time spent starting tablet: real 0.045s	user 0.004s	sys 0.004s
I20260709 12:58:19.068301  1768 tablet_bootstrap.cc:492] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e: Bootstrap starting.
I20260709 12:58:19.072878  1648 raft_consensus.cc:2468] T 2f8dd5957a2647058190fd52f31ec088 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 1.
I20260709 12:58:19.072894  1891 raft_consensus.cc:493] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:19.077152  1891 raft_consensus.cc:515] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.083935  1891 leader_election.cc:290] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:19.085389  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 12:58:19.086738  1615 leader_election.cc:343] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:19.086796  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:19.087504  1688 leader_election.cc:304] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:58:19.096091  1834 raft_consensus.cc:493] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:19.099221  1911 raft_consensus.cc:2804] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:19.099295  1834 raft_consensus.cc:515] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.100421  1911 raft_consensus.cc:697] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:58:19.101733  1911 consensus_queue.cc:237] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.102535  1834 leader_election.cc:290] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:19.104651  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 12:58:19.106249  1615 leader_election.cc:343] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:19.106859  1765 tablet_bootstrap.cc:654] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:19.107044  1572 raft_consensus.cc:2468] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 1.
W20260709 12:58:19.106889  1617 leader_election.cc:343] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:19.110524  1617 leader_election.cc:304] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:19.115939  1773 raft_consensus.cc:2749] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:19.120131  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:58:19.123076  1617 leader_election.cc:343] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:19.125690  1767 tablet_bootstrap.cc:492] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226: No bootstrap required, opened a new log
I20260709 12:58:19.126189  1767 ts_tablet_manager.cc:1403] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent bootstrapping tablet: real 0.152s	user 0.015s	sys 0.018s
I20260709 12:58:19.126871  1768 tablet_bootstrap.cc:654] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:19.130038  1767 raft_consensus.cc:359] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.130861  1767 raft_consensus.cc:385] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:19.131167  1767 raft_consensus.cc:740] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Initialized, Role: FOLLOWER
I20260709 12:58:19.131947  1767 consensus_queue.cc:260] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.123520  1617 leader_election.cc:304] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:19.133360  1885 raft_consensus.cc:2749] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:19.137322  1767 ts_tablet_manager.cc:1434] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:58:19.139439  1869 raft_consensus.cc:493] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:19.139925  1869 raft_consensus.cc:515] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.143527  1869 leader_election.cc:290] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:19.145066  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:19.146291  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:19.149407  1539 leader_election.cc:304] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:58:19.151315  1768 tablet_bootstrap.cc:492] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e: No bootstrap required, opened a new log
I20260709 12:58:19.151760  1768 ts_tablet_manager.cc:1403] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e: Time spent bootstrapping tablet: real 0.084s	user 0.014s	sys 0.009s
I20260709 12:58:19.152216  1869 raft_consensus.cc:2749] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:19.152100  1471 catalog_manager.cc:5697] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:19.157200  1767 tablet_bootstrap.cc:492] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Bootstrap starting.
I20260709 12:58:19.156849  1768 raft_consensus.cc:359] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.158473  1768 raft_consensus.cc:385] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:19.158762  1768 raft_consensus.cc:740] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Initialized, Role: FOLLOWER
I20260709 12:58:19.159454  1768 consensus_queue.cc:260] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.161616  1768 ts_tablet_manager.cc:1434] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:58:19.162431  1765 tablet_bootstrap.cc:492] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4: No bootstrap required, opened a new log
I20260709 12:58:19.162436  1768 tablet_bootstrap.cc:492] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 4dbe7d47a2374afca075d3a98583b49e: Bootstrap starting.
I20260709 12:58:19.162974  1765 ts_tablet_manager.cc:1403] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4: Time spent bootstrapping tablet: real 0.116s	user 0.012s	sys 0.002s
I20260709 12:58:19.153962  1471 catalog_manager.cc:5697] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:19.165803  1869 raft_consensus.cc:493] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:19.166275  1869 raft_consensus.cc:515] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.168421  1869 leader_election.cc:290] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:19.168188  1765 raft_consensus.cc:359] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.168898  1765 raft_consensus.cc:385] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:19.169348  1768 tablet_bootstrap.cc:654] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 4dbe7d47a2374afca075d3a98583b49e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:19.170643  1765 raft_consensus.cc:740] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Initialized, Role: FOLLOWER
I20260709 12:58:19.171633  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:19.171516  1765 consensus_queue.cc:260] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.174311  1765 ts_tablet_manager.cc:1434] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:58:19.175488  1765 tablet_bootstrap.cc:492] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4: Bootstrap starting.
I20260709 12:58:19.176405  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:19.178247  1539 leader_election.cc:304] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:58:19.179499  1885 raft_consensus.cc:493] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:19.179546  1890 consensus_queue.cc:1048] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:19.180142  1885 raft_consensus.cc:515] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.181008  1890 raft_consensus.cc:2749] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:19.181509  1768 tablet_bootstrap.cc:492] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 4dbe7d47a2374afca075d3a98583b49e: No bootstrap required, opened a new log
I20260709 12:58:19.181957  1768 ts_tablet_manager.cc:1403] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 4dbe7d47a2374afca075d3a98583b49e: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.008s
I20260709 12:58:19.183897  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:19.184867  1765 tablet_bootstrap.cc:654] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:19.184473  1768 raft_consensus.cc:359] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.185921  1768 raft_consensus.cc:385] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:19.186195  1768 raft_consensus.cc:740] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Initialized, Role: FOLLOWER
W20260709 12:58:19.186319  1615 leader_election.cc:343] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:19.186872  1768 consensus_queue.cc:260] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.187992  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:19.188645  1723 raft_consensus.cc:2468] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 0.
I20260709 12:58:19.189664  1768 ts_tablet_manager.cc:1434] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 4dbe7d47a2374afca075d3a98583b49e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:58:19.189987  1617 leader_election.cc:304] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:19.190825  1885 leader_election.cc:290] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:19.191730  1885 raft_consensus.cc:2804] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:19.192342  1885 raft_consensus.cc:493] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:19.192818  1885 raft_consensus.cc:3060] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:19.196851  1768 tablet_bootstrap.cc:492] T 73452eca85a147fb9d862dd08d54e340 P 4dbe7d47a2374afca075d3a98583b49e: Bootstrap starting.
I20260709 12:58:19.216879  1911 raft_consensus.cc:493] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:19.217437  1911 raft_consensus.cc:515] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.218941  1765 tablet_bootstrap.cc:492] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4: No bootstrap required, opened a new log
I20260709 12:58:19.219427  1765 ts_tablet_manager.cc:1403] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4: Time spent bootstrapping tablet: real 0.044s	user 0.012s	sys 0.005s
I20260709 12:58:19.222774  1911 leader_election.cc:290] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:19.225487  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:19.225915  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:19.226119  1649 raft_consensus.cc:2468] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 0.
I20260709 12:58:19.227458  1688 leader_election.cc:304] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:58:19.228242  1911 raft_consensus.cc:2804] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:19.228163  1885 raft_consensus.cc:515] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.228719  1911 raft_consensus.cc:493] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:58:19.228881  1689 leader_election.cc:343] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:19.229153  1911 raft_consensus.cc:3060] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:19.234408  1765 raft_consensus.cc:359] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.235091  1765 raft_consensus.cc:385] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:19.235353  1765 raft_consensus.cc:740] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Initialized, Role: FOLLOWER
I20260709 12:58:19.236244  1765 consensus_queue.cc:260] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.239897  1911 raft_consensus.cc:515] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.245525  1765 ts_tablet_manager.cc:1434] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4: Time spent starting tablet: real 0.026s	user 0.003s	sys 0.002s
I20260709 12:58:19.246555  1765 tablet_bootstrap.cc:492] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4: Bootstrap starting.
I20260709 12:58:19.249490  1911 leader_election.cc:290] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:19.250799  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:19.250890  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:19.251379  1649 raft_consensus.cc:3060] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:19.252061  1768 tablet_bootstrap.cc:654] T 73452eca85a147fb9d862dd08d54e340 P 4dbe7d47a2374afca075d3a98583b49e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:19.253312  1885 leader_election.cc:290] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:19.260179  1649 raft_consensus.cc:2468] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 1.
I20260709 12:58:19.260624  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 12:58:19.265331  1689 leader_election.cc:343] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:19.265374  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:58:19.268429  1723 raft_consensus.cc:3060] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:19.268628  1615 leader_election.cc:343] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:19.274591  1723 raft_consensus.cc:2468] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 1.
I20260709 12:58:19.274633  1688 leader_election.cc:304] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:19.275655  1911 raft_consensus.cc:2804] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:19.276121  1911 raft_consensus.cc:697] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:58:19.277149  1767 tablet_bootstrap.cc:654] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:19.277010  1617 leader_election.cc:304] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:19.276139  1869 consensus_queue.cc:1048] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:58:19.279754  1834 raft_consensus.cc:2804] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:19.280478  1834 raft_consensus.cc:697] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:58:19.281342  1834 consensus_queue.cc:237] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.276966  1911 consensus_queue.cc:237] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.284418  1768 tablet_bootstrap.cc:492] T 73452eca85a147fb9d862dd08d54e340 P 4dbe7d47a2374afca075d3a98583b49e: No bootstrap required, opened a new log
I20260709 12:58:19.284709  1765 tablet_bootstrap.cc:654] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:19.284915  1768 ts_tablet_manager.cc:1403] T 73452eca85a147fb9d862dd08d54e340 P 4dbe7d47a2374afca075d3a98583b49e: Time spent bootstrapping tablet: real 0.094s	user 0.010s	sys 0.003s
I20260709 12:58:19.287523  1768 raft_consensus.cc:359] T 73452eca85a147fb9d862dd08d54e340 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.288218  1768 raft_consensus.cc:385] T 73452eca85a147fb9d862dd08d54e340 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:19.291145  1768 raft_consensus.cc:740] T 73452eca85a147fb9d862dd08d54e340 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Initialized, Role: FOLLOWER
I20260709 12:58:19.291392  1765 tablet_bootstrap.cc:492] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4: No bootstrap required, opened a new log
I20260709 12:58:19.291882  1765 ts_tablet_manager.cc:1403] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4: Time spent bootstrapping tablet: real 0.046s	user 0.007s	sys 0.005s
I20260709 12:58:19.291980  1768 consensus_queue.cc:260] T 73452eca85a147fb9d862dd08d54e340 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.294291  1768 ts_tablet_manager.cc:1434] T 73452eca85a147fb9d862dd08d54e340 P 4dbe7d47a2374afca075d3a98583b49e: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:58:19.295171  1768 tablet_bootstrap.cc:492] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e: Bootstrap starting.
I20260709 12:58:19.297042  1915 raft_consensus.cc:493] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:19.298347  1915 raft_consensus.cc:515] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.300443  1767 tablet_bootstrap.cc:492] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226: No bootstrap required, opened a new log
I20260709 12:58:19.300976  1767 ts_tablet_manager.cc:1403] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent bootstrapping tablet: real 0.144s	user 0.008s	sys 0.005s
I20260709 12:58:19.302367  1915 leader_election.cc:290] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:19.303838  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:19.310336  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:19.312659  1765 raft_consensus.cc:359] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.313645  1765 raft_consensus.cc:385] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:19.314004  1765 raft_consensus.cc:740] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Initialized, Role: FOLLOWER
I20260709 12:58:19.316371  1765 consensus_queue.cc:260] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.317883  1689 leader_election.cc:304] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:19.323688  1915 raft_consensus.cc:2749] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:19.327286  1471 catalog_manager.cc:5697] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 0 to 1, leader changed from <none> to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:19.330770  1768 tablet_bootstrap.cc:654] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:19.331046  1767 raft_consensus.cc:359] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.332005  1767 raft_consensus.cc:385] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:19.332286  1767 raft_consensus.cc:740] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Initialized, Role: FOLLOWER
I20260709 12:58:19.333827  1767 consensus_queue.cc:260] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.338070  1773 consensus_queue.cc:1048] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:19.340405  1474 catalog_manager.cc:5697] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:19.343025  1885 consensus_queue.cc:1048] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:19.346854  1722 raft_consensus.cc:3060] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:19.349043  1765 ts_tablet_manager.cc:1434] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4: Time spent starting tablet: real 0.057s	user 0.009s	sys 0.000s
I20260709 12:58:19.349916  1765 tablet_bootstrap.cc:492] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4: Bootstrap starting.
I20260709 12:58:19.353436  1767 ts_tablet_manager.cc:1434] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent starting tablet: real 0.052s	user 0.008s	sys 0.000s
I20260709 12:58:19.355634  1767 tablet_bootstrap.cc:492] T a5bf40aa94d24ad9b858ebb61a527c4e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Bootstrap starting.
I20260709 12:58:19.393054  1767 tablet_bootstrap.cc:654] T a5bf40aa94d24ad9b858ebb61a527c4e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:19.390386  1573 raft_consensus.cc:3060] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:19.400435  1768 tablet_bootstrap.cc:492] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e: No bootstrap required, opened a new log
I20260709 12:58:19.401002  1768 ts_tablet_manager.cc:1403] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e: Time spent bootstrapping tablet: real 0.106s	user 0.015s	sys 0.034s
I20260709 12:58:19.413930  1768 raft_consensus.cc:359] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.414858  1768 raft_consensus.cc:385] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:19.415216  1768 raft_consensus.cc:740] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Initialized, Role: FOLLOWER
I20260709 12:58:19.421648  1768 consensus_queue.cc:260] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.429839  1767 tablet_bootstrap.cc:492] T a5bf40aa94d24ad9b858ebb61a527c4e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: No bootstrap required, opened a new log
I20260709 12:58:19.430490  1767 ts_tablet_manager.cc:1403] T a5bf40aa94d24ad9b858ebb61a527c4e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent bootstrapping tablet: real 0.076s	user 0.012s	sys 0.005s
I20260709 12:58:19.431212  1765 tablet_bootstrap.cc:654] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:19.435410  1768 ts_tablet_manager.cc:1434] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.001s
I20260709 12:58:19.436407  1768 tablet_bootstrap.cc:492] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e: Bootstrap starting.
I20260709 12:58:19.448454  1767 raft_consensus.cc:359] T a5bf40aa94d24ad9b858ebb61a527c4e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.449635  1767 raft_consensus.cc:385] T a5bf40aa94d24ad9b858ebb61a527c4e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:19.450059  1767 raft_consensus.cc:740] T a5bf40aa94d24ad9b858ebb61a527c4e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Initialized, Role: FOLLOWER
I20260709 12:58:19.450981  1767 consensus_queue.cc:260] T a5bf40aa94d24ad9b858ebb61a527c4e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.454777  1767 ts_tablet_manager.cc:1434] T a5bf40aa94d24ad9b858ebb61a527c4e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 12:58:19.454900  1768 tablet_bootstrap.cc:654] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:19.455612  1767 tablet_bootstrap.cc:492] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Bootstrap starting.
I20260709 12:58:19.461050  1765 tablet_bootstrap.cc:492] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4: No bootstrap required, opened a new log
I20260709 12:58:19.461596  1765 ts_tablet_manager.cc:1403] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4: Time spent bootstrapping tablet: real 0.112s	user 0.012s	sys 0.002s
I20260709 12:58:19.461619  1767 tablet_bootstrap.cc:654] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:19.465049  1765 raft_consensus.cc:359] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.467082  1765 raft_consensus.cc:385] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:19.467391  1765 raft_consensus.cc:740] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Initialized, Role: FOLLOWER
I20260709 12:58:19.468082  1765 consensus_queue.cc:260] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.470916  1835 raft_consensus.cc:493] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:19.471402  1835 raft_consensus.cc:515] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.473407  1835 leader_election.cc:290] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:19.474835  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:19.475450  1722 raft_consensus.cc:2468] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 0.
I20260709 12:58:19.477041  1617 leader_election.cc:304] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:58:19.478333  1885 raft_consensus.cc:2804] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:19.478681  1885 raft_consensus.cc:493] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:19.479003  1885 raft_consensus.cc:3060] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:19.480019  1767 tablet_bootstrap.cc:492] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: No bootstrap required, opened a new log
I20260709 12:58:19.480037  1573 raft_consensus.cc:3060] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:19.485380  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:19.489466  1767 ts_tablet_manager.cc:1403] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.004s
W20260709 12:58:19.491742  1615 leader_election.cc:343] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:19.493002  1765 ts_tablet_manager.cc:1434] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 12:58:19.493921  1765 tablet_bootstrap.cc:492] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4: Bootstrap starting.
I20260709 12:58:19.499212  1869 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:19.499769  1869 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.500068  1767 raft_consensus.cc:359] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.505751  1767 raft_consensus.cc:385] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:19.506609  1768 tablet_bootstrap.cc:492] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e: No bootstrap required, opened a new log
I20260709 12:58:19.509182  1767 raft_consensus.cc:740] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Initialized, Role: FOLLOWER
I20260709 12:58:19.508795  1765 tablet_bootstrap.cc:654] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:19.510138  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:19.510934  1649 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 1.
I20260709 12:58:19.510185  1767 consensus_queue.cc:260] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.506933  1885 raft_consensus.cc:515] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.512270  1539 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:58:19.509388  1768 ts_tablet_manager.cc:1403] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e: Time spent bootstrapping tablet: real 0.073s	user 0.007s	sys 0.019s
I20260709 12:58:19.513159  1890 raft_consensus.cc:2804] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:19.513540  1890 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:19.513896  1890 raft_consensus.cc:3060] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:19.514359  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:19.515144  1768 raft_consensus.cc:359] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.515801  1768 raft_consensus.cc:385] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:19.516079  1768 raft_consensus.cc:740] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Initialized, Role: FOLLOWER
W20260709 12:58:19.516355  1615 leader_election.cc:343] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:19.516747  1768 consensus_queue.cc:260] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.518668  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:58:19.519204  1722 raft_consensus.cc:3060] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:19.519379  1768 ts_tablet_manager.cc:1434] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:58:19.519920  1767 ts_tablet_manager.cc:1434] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.003s
I20260709 12:58:19.520345  1768 tablet_bootstrap.cc:492] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e: Bootstrap starting.
I20260709 12:58:19.521829  1767 tablet_bootstrap.cc:492] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Bootstrap starting.
W20260709 12:58:19.521749  1672 debug-util.cc:398] Leaking SignalData structure 0x7b08000e44a0 after lost signal to thread 434
W20260709 12:58:19.523437  1672 debug-util.cc:398] Leaking SignalData structure 0x7b080017bb20 after lost signal to thread 1508
W20260709 12:58:19.524703  1672 debug-util.cc:398] Leaking SignalData structure 0x7b08001db6e0 after lost signal to thread 1600
W20260709 12:58:19.526212  1672 debug-util.cc:398] Leaking SignalData structure 0x7b080020dba0 after lost signal to thread 1675
I20260709 12:58:19.526634  1768 tablet_bootstrap.cc:654] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e: Neither blocks nor log segments found. Creating new log.
W20260709 12:58:19.527417  1672 debug-util.cc:398] Leaking SignalData structure 0x7b08000d87c0 after lost signal to thread 1749
W20260709 12:58:19.527967  1672 debug-util.cc:398] Leaking SignalData structure 0x7b08000e2d60 after lost signal to thread 1814
W20260709 12:58:19.528258  1672 debug-util.cc:398] Leaking SignalData structure 0x7b0800096a40 after lost signal to thread 1819
I20260709 12:58:19.529109  1767 tablet_bootstrap.cc:654] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:19.531898  1722 raft_consensus.cc:2468] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 1.
I20260709 12:58:19.533087  1617 leader_election.cc:304] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:19.534189  1835 raft_consensus.cc:2804] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:19.534771  1835 raft_consensus.cc:697] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:58:19.535115  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:19.535866  1835 consensus_queue.cc:237] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.540333  1869 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:19.541787  1885 leader_election.cc:290] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:19.548272  1890 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.560983  1915 consensus_queue.cc:1048] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:19.562968  1474 catalog_manager.cc:5697] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 0 to 1, leader changed from <none> to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:19.564399  1572 raft_consensus.cc:1240] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:58:19.571266  1915 consensus_queue.cc:1059] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:58:19.575412  1915 raft_consensus.cc:3055] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:19.576277  1915 raft_consensus.cc:740] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:58:19.576004  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:19.576879  1649 raft_consensus.cc:3060] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:19.577069  1915 consensus_queue.cc:260] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.578101  1915 raft_consensus.cc:3060] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:19.571549  1869 raft_consensus.cc:493] T a5bf40aa94d24ad9b858ebb61a527c4e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:19.583613  1869 raft_consensus.cc:515] T a5bf40aa94d24ad9b858ebb61a527c4e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.585702  1869 leader_election.cc:290] T a5bf40aa94d24ad9b858ebb61a527c4e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:19.588789  1765 tablet_bootstrap.cc:492] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4: No bootstrap required, opened a new log
I20260709 12:58:19.589267  1765 ts_tablet_manager.cc:1403] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4: Time spent bootstrapping tablet: real 0.096s	user 0.017s	sys 0.012s
I20260709 12:58:19.590818  1767 tablet_bootstrap.cc:492] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226: No bootstrap required, opened a new log
I20260709 12:58:19.590977  1768 tablet_bootstrap.cc:492] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e: No bootstrap required, opened a new log
I20260709 12:58:19.591368  1767 ts_tablet_manager.cc:1403] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent bootstrapping tablet: real 0.070s	user 0.007s	sys 0.042s
I20260709 12:58:19.591495  1768 ts_tablet_manager.cc:1403] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e: Time spent bootstrapping tablet: real 0.071s	user 0.012s	sys 0.021s
I20260709 12:58:19.591815  1765 raft_consensus.cc:359] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.592489  1765 raft_consensus.cc:385] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:19.592787  1765 raft_consensus.cc:740] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Initialized, Role: FOLLOWER
I20260709 12:58:19.593537  1765 consensus_queue.cc:260] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.594272  1768 raft_consensus.cc:359] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.594977  1768 raft_consensus.cc:385] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:19.594579  1767 raft_consensus.cc:359] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.595291  1768 raft_consensus.cc:740] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Initialized, Role: FOLLOWER
I20260709 12:58:19.595450  1767 raft_consensus.cc:385] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:19.595896  1767 raft_consensus.cc:740] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Initialized, Role: FOLLOWER
I20260709 12:58:19.596627  1767 consensus_queue.cc:260] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.596845  1890 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:19.595561  1765 ts_tablet_manager.cc:1434] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:58:19.595988  1768 consensus_queue.cc:260] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.600132  1767 ts_tablet_manager.cc:1434] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:58:19.599257  1765 tablet_bootstrap.cc:492] T 93e6c991440c40c8a8c8050982e85eeb P 0c7751452c4b46afa95251b9df7169d4: Bootstrap starting.
I20260709 12:58:19.601325  1767 tablet_bootstrap.cc:492] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Bootstrap starting.
I20260709 12:58:19.601815  1768 ts_tablet_manager.cc:1434] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:58:19.602663  1768 tablet_bootstrap.cc:492] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e: Bootstrap starting.
I20260709 12:58:19.653940  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:19.672170  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:19.673431  1722 raft_consensus.cc:2393] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 1: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:58:19.674167  1956 raft_consensus.cc:493] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:19.674902  1956 raft_consensus.cc:515] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.675206  1542 leader_election.cc:304] T a5bf40aa94d24ad9b858ebb61a527c4e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:58:19.677667  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:58:19.678257  1956 leader_election.cc:290] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:19.678942  1725 raft_consensus.cc:2410] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0.
I20260709 12:58:19.682580  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:19.683537  1650 raft_consensus.cc:2468] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 0.
I20260709 12:58:19.685159  1688 leader_election.cc:304] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:58:19.687507  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:19.687984  1956 consensus_queue.cc:1048] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:19.688663  1573 raft_consensus.cc:2468] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 0.
I20260709 12:58:19.692086  1957 raft_consensus.cc:493] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:19.693192  1573 raft_consensus.cc:3060] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:19.692866  1957 raft_consensus.cc:515] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.697042  1956 raft_consensus.cc:493] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:19.697702  1956 raft_consensus.cc:515] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.698199  1957 leader_election.cc:290] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:19.700966  1957 raft_consensus.cc:2804] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:19.701870  1956 leader_election.cc:290] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:19.701329  1957 raft_consensus.cc:493] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:19.702564  1957 raft_consensus.cc:3060] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:19.707779  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:19.708617  1648 raft_consensus.cc:2468] T 73452eca85a147fb9d862dd08d54e340 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 0.
I20260709 12:58:19.710551  1688 leader_election.cc:304] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:58:19.713438  1957 raft_consensus.cc:515] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.718341  1956 raft_consensus.cc:2804] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:19.718912  1956 raft_consensus.cc:493] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:19.719357  1956 raft_consensus.cc:3060] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:19.712318  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:19.730540  1869 raft_consensus.cc:493] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:19.731185  1869 raft_consensus.cc:515] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.749370  1835 raft_consensus.cc:493] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:19.740331  1890 raft_consensus.cc:3060] T a5bf40aa94d24ad9b858ebb61a527c4e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:19.764974  1834 raft_consensus.cc:493] T 73452eca85a147fb9d862dd08d54e340 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:19.765656  1834 raft_consensus.cc:515] T 73452eca85a147fb9d862dd08d54e340 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.767184  1824 consensus_queue.cc:1048] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:19.805351  1889 raft_consensus.cc:493] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:19.741117  1650 raft_consensus.cc:2468] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 0.
I20260709 12:58:19.882545  1891 raft_consensus.cc:493] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:19.883342  1891 raft_consensus.cc:515] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.886513  1773 raft_consensus.cc:493] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:19.887152  1773 raft_consensus.cc:515] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:19.919405  1957 leader_election.cc:290] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 12:58:20.007715  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 138679us
I20260709 12:58:20.001363  1835 raft_consensus.cc:515] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:20.010354  1958 raft_consensus.cc:493] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:20.011256  1958 raft_consensus.cc:515] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:20.016853  1834 leader_election.cc:290] T 73452eca85a147fb9d862dd08d54e340 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:20.021916  1649 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 2.
I20260709 12:58:20.025602  1869 leader_election.cc:290] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:19.806192  1889 raft_consensus.cc:515] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:20.012274  1835 leader_election.cc:290] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:20.023381  1773 leader_election.cc:290] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:20.033710  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:20.034180  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:20.039958  1958 leader_election.cc:290] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:20.039878  1688 leader_election.cc:304] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:58:20.041401  1956 raft_consensus.cc:515] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:20.042369  1915 raft_consensus.cc:2804] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:20.043738  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:20.045251  1915 raft_consensus.cc:493] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:20.046000  1915 raft_consensus.cc:3060] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:20.048209  1722 raft_consensus.cc:2393] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 1: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:58:20.055262  1956 leader_election.cc:290] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 12:58:20.063217  1617 leader_election.cc:343] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:20.068200  1889 leader_election.cc:290] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:20.072661  1891 leader_election.cc:290] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:20.098181  1915 raft_consensus.cc:515] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:20.098954  1765 tablet_bootstrap.cc:654] T 93e6c991440c40c8a8c8050982e85eeb P 0c7751452c4b46afa95251b9df7169d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:20.099270  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:20.100871  1649 raft_consensus.cc:3060] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:20.113741  1767 tablet_bootstrap.cc:654] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Neither blocks nor log segments found. Creating new log.
W20260709 12:58:20.118345  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 105587us
I20260709 12:58:20.110448  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:20.120621  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:20.121093  1723 raft_consensus.cc:2393] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 1: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:58:20.107216  1961 consensus_queue.cc:1048] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.048s
I20260709 12:58:20.123401  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 12:58:20.113358  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 84067.5us
I20260709 12:58:20.129771  1890 raft_consensus.cc:2749] T a5bf40aa94d24ad9b858ebb61a527c4e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:20.131995  1539 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 12:58:20.136415  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:20.136649  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:20.136448  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:20.137398  1575 raft_consensus.cc:3060] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:20.138542  1915 leader_election.cc:290] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:20.142272  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 12:58:20.153842  1617 leader_election.cc:343] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:20.156091  1890 raft_consensus.cc:2804] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:20.158741  1890 raft_consensus.cc:697] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
W20260709 12:58:20.169874  1617 leader_election.cc:343] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:20.174726  1576 raft_consensus.cc:3060] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:20.175835  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:20.180166  1768 tablet_bootstrap.cc:654] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:20.170363  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:20.184894  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:20.160113  1890 consensus_queue.cc:237] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:20.186451  1649 raft_consensus.cc:2468] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 1.
I20260709 12:58:20.187251  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:20.196931  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:20.197695  1648 raft_consensus.cc:3060] T 73452eca85a147fb9d862dd08d54e340 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:20.198132  1647 raft_consensus.cc:3060] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:20.204943  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:20.205493  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 12:58:20.209038  1689 leader_election.cc:343] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:20.210109  1689 leader_election.cc:343] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:20.225472  1688 leader_election.cc:304] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:58:20.227409  1911 consensus_queue.cc:1048] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:20.201017  1891 consensus_queue.cc:1048] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:20.211865  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:20.231992  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:20.232405  1649 raft_consensus.cc:2393] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 1: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:58:20.227402  1957 raft_consensus.cc:2804] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:58:20.234426  1689 leader_election.cc:343] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:20.239025  1957 raft_consensus.cc:697] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
W20260709 12:58:20.244807  1969 log.cc:927] Time spent T 2f8dd5957a2647058190fd52f31ec088 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:58:20.243907  1646 raft_consensus.cc:2393] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 1: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
W20260709 12:58:20.250875  1521 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:58:20.251173  1615 leader_election.cc:343] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:20.251832  1615 leader_election.cc:304] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:20.252362  1765 tablet_bootstrap.cc:492] T 93e6c991440c40c8a8c8050982e85eeb P 0c7751452c4b46afa95251b9df7169d4: No bootstrap required, opened a new log
I20260709 12:58:20.252947  1765 ts_tablet_manager.cc:1403] T 93e6c991440c40c8a8c8050982e85eeb P 0c7751452c4b46afa95251b9df7169d4: Time spent bootstrapping tablet: real 0.654s	user 0.027s	sys 0.047s
I20260709 12:58:20.258543  1765 raft_consensus.cc:359] T 93e6c991440c40c8a8c8050982e85eeb P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:20.259195  1765 raft_consensus.cc:385] T 93e6c991440c40c8a8c8050982e85eeb P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:20.259452  1765 raft_consensus.cc:740] T 93e6c991440c40c8a8c8050982e85eeb P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Initialized, Role: FOLLOWER
I20260709 12:58:20.260082  1765 consensus_queue.cc:260] T 93e6c991440c40c8a8c8050982e85eeb P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:58:20.247412  1689 leader_election.cc:343] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:20.253628  1575 raft_consensus.cc:2468] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 1.
I20260709 12:58:20.245276  1957 consensus_queue.cc:237] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:20.253640  1834 raft_consensus.cc:2749] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:20.264084  1960 consensus_queue.cc:1048] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:58:20.272122  1647 raft_consensus.cc:2468] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 1.
W20260709 12:58:20.273195  1615 leader_election.cc:343] T 73452eca85a147fb9d862dd08d54e340 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:20.291035  1688 leader_election.cc:304] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:20.307082  1767 tablet_bootstrap.cc:492] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: No bootstrap required, opened a new log
I20260709 12:58:20.307626  1767 ts_tablet_manager.cc:1403] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent bootstrapping tablet: real 0.707s	user 0.026s	sys 0.041s
I20260709 12:58:20.304766  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:20.305668  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:20.310753  1911 raft_consensus.cc:2804] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:20.312996  1911 raft_consensus.cc:697] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:58:20.318931  1915 consensus_queue.cc:1048] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:20.324857  1765 ts_tablet_manager.cc:1434] T 93e6c991440c40c8a8c8050982e85eeb P 0c7751452c4b46afa95251b9df7169d4: Time spent starting tablet: real 0.072s	user 0.007s	sys 0.000s
I20260709 12:58:20.327773  1767 raft_consensus.cc:359] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:20.328598  1767 raft_consensus.cc:385] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:20.328896  1767 raft_consensus.cc:740] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Initialized, Role: FOLLOWER
I20260709 12:58:20.329588  1767 consensus_queue.cc:260] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:20.331606  1765 tablet_bootstrap.cc:492] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4: Bootstrap starting.
I20260709 12:58:20.308456  1615 leader_election.cc:304] T 73452eca85a147fb9d862dd08d54e340 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:20.343147  1648 raft_consensus.cc:2468] T 73452eca85a147fb9d862dd08d54e340 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 1.
I20260709 12:58:20.353452  1474 catalog_manager.cc:5697] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 1 to 2, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:20.356665  1961 raft_consensus.cc:2749] T 73452eca85a147fb9d862dd08d54e340 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:20.355937  1911 consensus_queue.cc:237] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:58:20.375168  1973 log.cc:927] Time spent T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
W20260709 12:58:20.369550  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 98867.3us
I20260709 12:58:20.386775  1767 ts_tablet_manager.cc:1434] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent starting tablet: real 0.079s	user 0.009s	sys 0.000s
I20260709 12:58:20.368871  1688 leader_election.cc:304] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:20.405342  1957 raft_consensus.cc:2804] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:20.409940  1767 tablet_bootstrap.cc:492] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Bootstrap starting.
I20260709 12:58:20.409790  1957 raft_consensus.cc:697] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:58:20.410879  1957 consensus_queue.cc:237] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:20.409157  1768 tablet_bootstrap.cc:492] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e: No bootstrap required, opened a new log
I20260709 12:58:20.412781  1768 ts_tablet_manager.cc:1403] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e: Time spent bootstrapping tablet: real 0.810s	user 0.020s	sys 0.022s
I20260709 12:58:20.427353  1869 raft_consensus.cc:493] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:20.428120  1869 raft_consensus.cc:515] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:20.428876  1768 raft_consensus.cc:359] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:20.429589  1768 raft_consensus.cc:385] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:20.429942  1768 raft_consensus.cc:740] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Initialized, Role: FOLLOWER
I20260709 12:58:20.430195  1869 leader_election.cc:290] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:20.430694  1768 consensus_queue.cc:260] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:20.432888  1768 ts_tablet_manager.cc:1434] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
W20260709 12:58:20.433198  1977 log.cc:927] Time spent T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:58:20.434177  1768 tablet_bootstrap.cc:492] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e: Bootstrap starting.
W20260709 12:58:20.418538  1615 leader_election.cc:343] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:20.435144  1615 leader_election.cc:304] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:20.437964  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:20.444978  1960 raft_consensus.cc:2749] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:58:20.476454  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 59124.2us
W20260709 12:58:20.477968  1615 leader_election.cc:343] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:20.478482  1615 leader_election.cc:304] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:20.482910  1767 tablet_bootstrap.cc:654] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:20.483899  1834 raft_consensus.cc:2749] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:20.491511  1765 tablet_bootstrap.cc:654] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:20.512378  1768 tablet_bootstrap.cc:654] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:20.515273  1767 tablet_bootstrap.cc:492] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226: No bootstrap required, opened a new log
I20260709 12:58:20.515717  1767 ts_tablet_manager.cc:1403] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent bootstrapping tablet: real 0.106s	user 0.006s	sys 0.016s
W20260709 12:58:20.511443  1615 leader_election.cc:343] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:20.516999  1615 leader_election.cc:304] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:20.518558  1960 raft_consensus.cc:2749] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:20.520613  1472 catalog_manager.cc:5697] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
W20260709 12:58:20.521654  1615 consensus_peers.cc:597] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:20.522487  1472 catalog_manager.cc:5697] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:20.524994  1539 leader_election.cc:304] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:58:20.530191  1767 raft_consensus.cc:359] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:20.525362  1472 catalog_manager.cc:5697] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:20.531064  1767 raft_consensus.cc:385] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:20.536440  1767 raft_consensus.cc:740] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Initialized, Role: FOLLOWER
I20260709 12:58:20.537952  1890 raft_consensus.cc:2749] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:20.551004  1539 leader_election.cc:304] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:58:20.552160  1869 raft_consensus.cc:2749] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:20.556880  1767 consensus_queue.cc:260] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:20.567405  1767 ts_tablet_manager.cc:1434] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.000s
I20260709 12:58:20.568979  1869 raft_consensus.cc:493] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:20.569649  1869 raft_consensus.cc:515] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:20.573863  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:20.574738  1722 raft_consensus.cc:2468] T 93e6c991440c40c8a8c8050982e85eeb P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 0.
I20260709 12:58:20.577751  1542 leader_election.cc:304] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:58:20.578809  1890 raft_consensus.cc:2804] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:20.579273  1890 raft_consensus.cc:493] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:20.579707  1890 raft_consensus.cc:3060] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:20.572445  1869 leader_election.cc:290] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:20.617817  1767 tablet_bootstrap.cc:492] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Bootstrap starting.
I20260709 12:58:20.652416  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:20.653223  1646 raft_consensus.cc:2468] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 0.
I20260709 12:58:20.654428  1765 tablet_bootstrap.cc:492] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4: No bootstrap required, opened a new log
I20260709 12:58:20.654510  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:20.655033  1765 ts_tablet_manager.cc:1403] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4: Time spent bootstrapping tablet: real 0.324s	user 0.073s	sys 0.064s
I20260709 12:58:20.655372  1650 raft_consensus.cc:2393] T 73452eca85a147fb9d862dd08d54e340 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 1: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:58:20.655520  1834 raft_consensus.cc:493] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:20.655968  1834 raft_consensus.cc:515] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:20.657804  1834 leader_election.cc:290] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:20.657913  1765 raft_consensus.cc:359] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:20.658725  1765 raft_consensus.cc:385] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:20.658967  1765 raft_consensus.cc:740] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Initialized, Role: FOLLOWER
I20260709 12:58:20.659659  1765 consensus_queue.cc:260] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:20.661981  1765 ts_tablet_manager.cc:1434] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:58:20.662370  1768 tablet_bootstrap.cc:492] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e: No bootstrap required, opened a new log
I20260709 12:58:20.648911  1890 raft_consensus.cc:515] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:20.662807  1768 ts_tablet_manager.cc:1403] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e: Time spent bootstrapping tablet: real 0.229s	user 0.009s	sys 0.024s
I20260709 12:58:20.663141  1765 tablet_bootstrap.cc:492] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4: Bootstrap starting.
I20260709 12:58:20.664214  1890 leader_election.cc:290] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:20.665745  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:20.668349  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:58:20.669853  1723 raft_consensus.cc:3060] T 93e6c991440c40c8a8c8050982e85eeb P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:20.670969  1617 leader_election.cc:343] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:20.673467  1765 tablet_bootstrap.cc:654] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:20.678385  1539 leader_election.cc:304] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:58:20.680310  1890 raft_consensus.cc:3060] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:20.680869  1768 raft_consensus.cc:359] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:20.682336  1768 raft_consensus.cc:385] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:20.682614  1768 raft_consensus.cc:740] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Initialized, Role: FOLLOWER
I20260709 12:58:20.683235  1768 consensus_queue.cc:260] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:20.685540  1768 ts_tablet_manager.cc:1434] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 12:58:20.686471  1768 tablet_bootstrap.cc:492] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e: Bootstrap starting.
I20260709 12:58:20.678841  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:20.689991  1648 raft_consensus.cc:3060] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:20.695638  1768 tablet_bootstrap.cc:654] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:20.699739  1723 raft_consensus.cc:2468] T 93e6c991440c40c8a8c8050982e85eeb P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 1.
I20260709 12:58:20.701727  1824 consensus_queue.cc:1048] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:20.709592  1767 tablet_bootstrap.cc:654] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:20.726828  1767 tablet_bootstrap.cc:492] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226: No bootstrap required, opened a new log
I20260709 12:58:20.727316  1767 ts_tablet_manager.cc:1403] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent bootstrapping tablet: real 0.159s	user 0.015s	sys 0.000s
I20260709 12:58:20.729950  1767 raft_consensus.cc:359] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:20.730640  1767 raft_consensus.cc:385] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:20.730906  1767 raft_consensus.cc:740] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Initialized, Role: FOLLOWER
I20260709 12:58:20.731503  1767 consensus_queue.cc:260] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:20.732623  1542 leader_election.cc:304] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:58:20.736634  1768 tablet_bootstrap.cc:492] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e: No bootstrap required, opened a new log
I20260709 12:58:20.737143  1768 ts_tablet_manager.cc:1403] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e: Time spent bootstrapping tablet: real 0.051s	user 0.010s	sys 0.004s
I20260709 12:58:20.739919  1768 raft_consensus.cc:359] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:20.740643  1768 raft_consensus.cc:385] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:20.740921  1768 raft_consensus.cc:740] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Initialized, Role: FOLLOWER
I20260709 12:58:20.733371  1824 consensus_queue.cc:1048] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:58:20.749693  1768 consensus_queue.cc:260] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:20.759037  1648 raft_consensus.cc:2468] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 1.
I20260709 12:58:20.754892  1965 raft_consensus.cc:2804] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:20.766304  1965 raft_consensus.cc:697] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:58:20.767220  1965 consensus_queue.cc:237] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:20.775063  1767 ts_tablet_manager.cc:1434] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.004s
I20260709 12:58:20.783764  1890 raft_consensus.cc:2749] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:20.749693  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:20.791322  1768 ts_tablet_manager.cc:1434] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e: Time spent starting tablet: real 0.054s	user 0.003s	sys 0.004s
I20260709 12:58:20.798833  1648 raft_consensus.cc:1275] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:58:20.803401  1768 tablet_bootstrap.cc:492] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e: Bootstrap starting.
I20260709 12:58:20.805755  1890 consensus_queue.cc:1048] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:20.808348  1767 tablet_bootstrap.cc:492] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Bootstrap starting.
I20260709 12:58:20.810104  1765 tablet_bootstrap.cc:492] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4: No bootstrap required, opened a new log
I20260709 12:58:20.810603  1765 ts_tablet_manager.cc:1403] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4: Time spent bootstrapping tablet: real 0.148s	user 0.049s	sys 0.080s
I20260709 12:58:20.827772  1965 raft_consensus.cc:493] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:20.829226  1965 raft_consensus.cc:515] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:20.831609  1965 leader_election.cc:290] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:58:20.830288  1615 leader_election.cc:343] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:20.832834  1722 raft_consensus.cc:1275] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 12:58:20.833263  1722 pending_rounds.cc:85] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4: Aborting all ops after (but not including) 0
I20260709 12:58:20.833027  1615 leader_election.cc:304] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:20.833611  1722 pending_rounds.cc:107] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:58:20.833989  1722 raft_consensus.cc:2889] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:20.834326  1963 raft_consensus.cc:2749] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:20.838567  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:20.839669  1650 raft_consensus.cc:2393] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 1: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:58:20.839483  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:20.852057  1765 raft_consensus.cc:359] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:20.852841  1765 raft_consensus.cc:385] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:20.853122  1765 raft_consensus.cc:740] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Initialized, Role: FOLLOWER
I20260709 12:58:20.853833  1765 consensus_queue.cc:260] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:20.854449  1767 tablet_bootstrap.cc:654] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:20.855820  1765 ts_tablet_manager.cc:1434] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4: Time spent starting tablet: real 0.045s	user 0.005s	sys 0.002s
I20260709 12:58:20.858884  1965 consensus_queue.cc:1048] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:58:20.865445  1768 tablet_bootstrap.cc:654] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:20.869099  1765 tablet_bootstrap.cc:492] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4: Bootstrap starting.
I20260709 12:58:20.873070  1542 leader_election.cc:304] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:58:20.876376  2001 raft_consensus.cc:3060] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:20.889346  1765 tablet_bootstrap.cc:654] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:20.891736  1824 consensus_queue.cc:1048] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:20.894613  1956 consensus_queue.cc:1048] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:20.897533  1471 catalog_manager.cc:5697] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:20.916623  2001 raft_consensus.cc:2749] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:20.920047  1824 consensus_queue.cc:1048] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:20.936367  1768 tablet_bootstrap.cc:492] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e: No bootstrap required, opened a new log
I20260709 12:58:20.939257  1768 ts_tablet_manager.cc:1403] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e: Time spent bootstrapping tablet: real 0.137s	user 0.012s	sys 0.016s
I20260709 12:58:20.942021  1768 raft_consensus.cc:359] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:20.942685  1768 raft_consensus.cc:385] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:20.942963  1768 raft_consensus.cc:740] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Initialized, Role: FOLLOWER
I20260709 12:58:20.943687  1768 consensus_queue.cc:260] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:20.953231  1767 tablet_bootstrap.cc:492] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: No bootstrap required, opened a new log
I20260709 12:58:20.953745  1768 ts_tablet_manager.cc:1434] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:58:20.956316  1768 tablet_bootstrap.cc:492] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e: Bootstrap starting.
I20260709 12:58:20.963073  1824 consensus_queue.cc:1048] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:20.953790  1767 ts_tablet_manager.cc:1403] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent bootstrapping tablet: real 0.146s	user 0.017s	sys 0.020s
I20260709 12:58:20.969245  1824 raft_consensus.cc:493] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:20.969858  1824 raft_consensus.cc:515] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:20.970949  1915 raft_consensus.cc:493] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:20.971455  1915 raft_consensus.cc:515] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:20.973663  1915 leader_election.cc:290] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:20.973713  1767 raft_consensus.cc:359] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:20.974709  1767 raft_consensus.cc:385] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:20.975090  1767 raft_consensus.cc:740] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Initialized, Role: FOLLOWER
I20260709 12:58:20.975963  1767 consensus_queue.cc:260] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:20.976490  1824 leader_election.cc:290] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:20.978096  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:20.978348  1767 ts_tablet_manager.cc:1434] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 12:58:20.978879  1646 raft_consensus.cc:2468] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 0.
I20260709 12:58:20.979554  1767 tablet_bootstrap.cc:492] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Bootstrap starting.
I20260709 12:58:20.980211  1688 leader_election.cc:304] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:58:20.963332  1768 tablet_bootstrap.cc:654] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:20.981137  1961 raft_consensus.cc:493] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:20.981348  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:20.981732  1961 raft_consensus.cc:515] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:20.982121  1648 raft_consensus.cc:2468] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 0.
I20260709 12:58:20.983502  1688 leader_election.cc:304] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:58:20.984102  1961 leader_election.cc:290] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:20.984326  1956 raft_consensus.cc:2804] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:20.984706  1956 raft_consensus.cc:493] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:20.985183  1956 raft_consensus.cc:3060] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:20.992851  1767 tablet_bootstrap.cc:654] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:20.993705  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:20.997816  1956 raft_consensus.cc:515] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.000029  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:21.001461  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:21.002767  1648 raft_consensus.cc:3060] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:21.004141  1615 leader_election.cc:343] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:21.004701  1824 raft_consensus.cc:2804] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:21.005178  1824 raft_consensus.cc:493] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:21.005689  1824 raft_consensus.cc:3060] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:21.007836  1768 tablet_bootstrap.cc:492] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e: No bootstrap required, opened a new log
I20260709 12:58:21.008426  1768 ts_tablet_manager.cc:1403] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e: Time spent bootstrapping tablet: real 0.052s	user 0.014s	sys 0.005s
I20260709 12:58:21.012107  1768 raft_consensus.cc:359] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.012853  1768 raft_consensus.cc:385] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:21.013134  1768 raft_consensus.cc:740] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Initialized, Role: FOLLOWER
I20260709 12:58:21.017210  1767 tablet_bootstrap.cc:492] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: No bootstrap required, opened a new log
I20260709 12:58:21.017817  1767 ts_tablet_manager.cc:1403] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent bootstrapping tablet: real 0.039s	user 0.014s	sys 0.000s
I20260709 12:58:21.017977  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:21.021741  1767 raft_consensus.cc:359] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.022687  1767 raft_consensus.cc:385] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:21.023056  1767 raft_consensus.cc:740] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Initialized, Role: FOLLOWER
I20260709 12:58:21.023906  1767 consensus_queue.cc:260] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.022332  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:21.025983  1568 raft_consensus.cc:2468] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 0.
I20260709 12:58:21.026394  1767 ts_tablet_manager.cc:1434] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
W20260709 12:58:21.024469  1689 leader_election.cc:343] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:21.027596  1767 tablet_bootstrap.cc:492] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Bootstrap starting.
I20260709 12:58:21.028960  1768 consensus_queue.cc:260] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.031301  1768 ts_tablet_manager.cc:1434] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.000s
I20260709 12:58:21.031838  1765 tablet_bootstrap.cc:492] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4: No bootstrap required, opened a new log
I20260709 12:58:21.032444  1765 ts_tablet_manager.cc:1403] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4: Time spent bootstrapping tablet: real 0.174s	user 0.028s	sys 0.024s
I20260709 12:58:21.033788  1768 tablet_bootstrap.cc:492] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e: Bootstrap starting.
I20260709 12:58:21.034550  1648 raft_consensus.cc:2468] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 1.
I20260709 12:58:21.038749  1688 leader_election.cc:304] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:58:21.039124  1765 raft_consensus.cc:359] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.039796  1765 raft_consensus.cc:385] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:21.039901  1915 raft_consensus.cc:2804] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:21.040477  1915 raft_consensus.cc:697] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:58:21.040189  1765 raft_consensus.cc:740] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Initialized, Role: FOLLOWER
I20260709 12:58:21.041337  1915 consensus_queue.cc:237] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.041333  1765 consensus_queue.cc:260] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:58:21.044972  1689 leader_election.cc:343] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:21.045627  1765 ts_tablet_manager.cc:1434] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 12:58:21.046581  1765 tablet_bootstrap.cc:492] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4: Bootstrap starting.
I20260709 12:58:21.038720  1956 leader_election.cc:290] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:21.045639  1768 tablet_bootstrap.cc:654] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:21.052342  1765 tablet_bootstrap.cc:654] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:21.051111  1824 raft_consensus.cc:515] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.054190  1767 tablet_bootstrap.cc:654] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:21.054575  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:58:21.064194  1617 leader_election.cc:343] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:21.064641  1617 leader_election.cc:304] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:21.065768  1834 raft_consensus.cc:2749] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:21.070621  1768 tablet_bootstrap.cc:492] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e: No bootstrap required, opened a new log
I20260709 12:58:21.071046  1768 ts_tablet_manager.cc:1403] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e: Time spent bootstrapping tablet: real 0.037s	user 0.007s	sys 0.011s
I20260709 12:58:21.071408  1765 tablet_bootstrap.cc:492] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4: No bootstrap required, opened a new log
I20260709 12:58:21.071846  1765 ts_tablet_manager.cc:1403] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4: Time spent bootstrapping tablet: real 0.025s	user 0.007s	sys 0.002s
I20260709 12:58:21.073838  1768 raft_consensus.cc:359] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.074700  1768 raft_consensus.cc:385] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:21.074999  1768 raft_consensus.cc:740] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Initialized, Role: FOLLOWER
I20260709 12:58:21.078938  1768 consensus_queue.cc:260] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.082916  1767 tablet_bootstrap.cc:492] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: No bootstrap required, opened a new log
I20260709 12:58:21.083454  1767 ts_tablet_manager.cc:1403] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent bootstrapping tablet: real 0.056s	user 0.009s	sys 0.006s
I20260709 12:58:21.075807  1765 raft_consensus.cc:359] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.084849  1765 raft_consensus.cc:385] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:21.085165  1765 raft_consensus.cc:740] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Initialized, Role: FOLLOWER
I20260709 12:58:21.085817  1768 ts_tablet_manager.cc:1434] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.002s
I20260709 12:58:21.085837  1765 consensus_queue.cc:260] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.086994  1768 tablet_bootstrap.cc:492] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e: Bootstrap starting.
I20260709 12:58:21.088212  1765 ts_tablet_manager.cc:1434] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:58:21.089215  1765 tablet_bootstrap.cc:492] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4: Bootstrap starting.
I20260709 12:58:21.094316  1824 leader_election.cc:290] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:21.095223  1765 tablet_bootstrap.cc:654] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:21.094818  1767 raft_consensus.cc:359] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.095582  1767 raft_consensus.cc:385] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:21.095877  1767 raft_consensus.cc:740] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Initialized, Role: FOLLOWER
I20260709 12:58:21.096695  1767 consensus_queue.cc:260] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.097512  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:21.097604  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:21.098204  1568 raft_consensus.cc:3060] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:21.098235  1650 raft_consensus.cc:3060] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:21.099572  1767 ts_tablet_manager.cc:1434] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.002s
I20260709 12:58:21.100807  1767 tablet_bootstrap.cc:492] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Bootstrap starting.
I20260709 12:58:21.105237  1568 raft_consensus.cc:2468] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 1.
I20260709 12:58:21.106511  1689 leader_election.cc:304] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:58:21.107515  1767 tablet_bootstrap.cc:654] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:21.109000  1956 raft_consensus.cc:2804] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:21.109530  1768 tablet_bootstrap.cc:654] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:21.109778  1956 raft_consensus.cc:697] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:58:21.110719  1956 consensus_queue.cc:237] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.118840  1472 catalog_manager.cc:5697] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:21.122280  1767 tablet_bootstrap.cc:492] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226: No bootstrap required, opened a new log
I20260709 12:58:21.120680  1650 raft_consensus.cc:2468] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 1.
I20260709 12:58:21.132721  1568 raft_consensus.cc:3060] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:21.132797  1767 ts_tablet_manager.cc:1403] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.004s
I20260709 12:58:21.136616  1767 raft_consensus.cc:359] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.137384  1767 raft_consensus.cc:385] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:21.137727  1767 raft_consensus.cc:740] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Initialized, Role: FOLLOWER
I20260709 12:58:21.138736  1765 tablet_bootstrap.cc:492] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4: No bootstrap required, opened a new log
I20260709 12:58:21.138401  1767 consensus_queue.cc:260] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.139227  1765 ts_tablet_manager.cc:1403] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4: Time spent bootstrapping tablet: real 0.050s	user 0.011s	sys 0.007s
I20260709 12:58:21.141520  1768 tablet_bootstrap.cc:492] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e: No bootstrap required, opened a new log
I20260709 12:58:21.142007  1768 ts_tablet_manager.cc:1403] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e: Time spent bootstrapping tablet: real 0.055s	user 0.017s	sys 0.000s
I20260709 12:58:21.142261  1765 raft_consensus.cc:359] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.142963  1765 raft_consensus.cc:385] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:21.143577  1765 raft_consensus.cc:740] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Initialized, Role: FOLLOWER
I20260709 12:58:21.144281  1765 consensus_queue.cc:260] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.144924  1768 raft_consensus.cc:359] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.145620  1768 raft_consensus.cc:385] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:21.145897  1768 raft_consensus.cc:740] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Initialized, Role: FOLLOWER
I20260709 12:58:21.146725  1765 ts_tablet_manager.cc:1434] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:58:21.146767  1768 consensus_queue.cc:260] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.147904  1765 tablet_bootstrap.cc:492] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4: Bootstrap starting.
I20260709 12:58:21.149762  1767 ts_tablet_manager.cc:1434] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:58:21.150825  1767 tablet_bootstrap.cc:492] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Bootstrap starting.
I20260709 12:58:21.156571  1765 tablet_bootstrap.cc:654] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:21.160091  1768 ts_tablet_manager.cc:1434] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:58:21.162801  1834 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:21.163403  1834 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.166608  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:21.167336  1576 raft_consensus.cc:2468] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 0.
I20260709 12:58:21.171007  1834 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:21.172097  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:21.173702  1615 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 12:58:21.174826  1617 leader_election.cc:343] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:21.179162  1767 tablet_bootstrap.cc:654] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:21.180960  1768 tablet_bootstrap.cc:492] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e: Bootstrap starting.
I20260709 12:58:21.180496  1963 raft_consensus.cc:2804] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:21.181767  1963 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:21.182121  1963 raft_consensus.cc:3060] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:21.185846  1824 raft_consensus.cc:493] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:21.187114  1824 raft_consensus.cc:515] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.187789  1765 tablet_bootstrap.cc:492] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4: No bootstrap required, opened a new log
I20260709 12:58:21.188256  1765 ts_tablet_manager.cc:1403] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4: Time spent bootstrapping tablet: real 0.041s	user 0.013s	sys 0.001s
I20260709 12:58:21.190985  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:21.191241  1963 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.191634  1650 raft_consensus.cc:2468] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 0.
I20260709 12:58:21.192317  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:21.193565  1963 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:58:21.193637  1689 leader_election.cc:343] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:21.194815  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:21.195267  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:58:21.195605  1576 raft_consensus.cc:3060] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:21.197467  1617 leader_election.cc:343] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:21.191594  1824 leader_election.cc:290] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:21.199179  1765 raft_consensus.cc:359] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.199898  1765 raft_consensus.cc:385] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:21.200222  1765 raft_consensus.cc:740] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Initialized, Role: FOLLOWER
I20260709 12:58:21.200937  1688 leader_election.cc:304] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:21.202299  1956 raft_consensus.cc:2804] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:21.204349  1956 raft_consensus.cc:493] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:21.204753  1956 raft_consensus.cc:3060] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:21.205931  1768 tablet_bootstrap.cc:654] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:21.208566  1765 consensus_queue.cc:260] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.203316  1473 catalog_manager.cc:5697] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:21.218307  1765 ts_tablet_manager.cc:1434] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 12:58:21.219478  1765 tablet_bootstrap.cc:492] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4: Bootstrap starting.
I20260709 12:58:21.222790  1956 raft_consensus.cc:515] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.225951  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:21.226022  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:21.226689  1650 raft_consensus.cc:3060] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:21.227600  1689 leader_election.cc:343] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:21.215530  1576 raft_consensus.cc:2468] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 1.
I20260709 12:58:21.230907  1956 leader_election.cc:290] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:21.233279  1615 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 12:58:21.234107  1767 tablet_bootstrap.cc:492] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: No bootstrap required, opened a new log
I20260709 12:58:21.234581  1767 ts_tablet_manager.cc:1403] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent bootstrapping tablet: real 0.084s	user 0.012s	sys 0.007s
I20260709 12:58:21.238011  1834 raft_consensus.cc:2804] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:21.238683  1834 raft_consensus.cc:697] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:58:21.239615  1834 consensus_queue.cc:237] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.241830  1650 raft_consensus.cc:2468] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 1.
I20260709 12:58:21.243938  1765 tablet_bootstrap.cc:654] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:21.243796  1688 leader_election.cc:304] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:21.245687  1824 raft_consensus.cc:2804] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:21.246614  1824 raft_consensus.cc:697] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:58:21.247576  1824 consensus_queue.cc:237] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.250699  1767 raft_consensus.cc:359] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.251441  1767 raft_consensus.cc:385] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:21.251734  1767 raft_consensus.cc:740] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Initialized, Role: FOLLOWER
I20260709 12:58:21.252517  1767 consensus_queue.cc:260] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.259591  1767 ts_tablet_manager.cc:1434] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent starting tablet: real 0.025s	user 0.001s	sys 0.005s
I20260709 12:58:21.260635  1767 tablet_bootstrap.cc:492] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Bootstrap starting.
I20260709 12:58:21.265643  1765 tablet_bootstrap.cc:492] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4: No bootstrap required, opened a new log
I20260709 12:58:21.266134  1765 ts_tablet_manager.cc:1403] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4: Time spent bootstrapping tablet: real 0.047s	user 0.008s	sys 0.003s
I20260709 12:58:21.269413  1765 raft_consensus.cc:359] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.271054  1963 raft_consensus.cc:493] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:21.271382  1765 raft_consensus.cc:385] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:21.271827  1765 raft_consensus.cc:740] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Initialized, Role: FOLLOWER
I20260709 12:58:21.271576  1963 raft_consensus.cc:515] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.272502  1765 consensus_queue.cc:260] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.273672  1963 leader_election.cc:290] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:21.277771  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:21.278415  1576 raft_consensus.cc:2468] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 0.
I20260709 12:58:21.278576  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:21.279295  1722 raft_consensus.cc:2468] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 0.
I20260709 12:58:21.279745  1615 leader_election.cc:304] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:58:21.281257  1765 ts_tablet_manager.cc:1434] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.006s
I20260709 12:58:21.282706  1963 raft_consensus.cc:2804] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:21.283054  1963 raft_consensus.cc:493] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:21.283406  1963 raft_consensus.cc:3060] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:21.283550  1765 tablet_bootstrap.cc:492] T bfb3b560711b4d7eb23f2aff3e4ca991 P 0c7751452c4b46afa95251b9df7169d4: Bootstrap starting.
I20260709 12:58:21.287688  1472 catalog_manager.cc:5697] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:21.298501  1767 tablet_bootstrap.cc:654] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:21.301432  1963 raft_consensus.cc:515] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.304088  1963 leader_election.cc:290] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:21.315333  1768 tablet_bootstrap.cc:492] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e: No bootstrap required, opened a new log
I20260709 12:58:21.308399  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:58:21.316937  1722 raft_consensus.cc:3060] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:21.304667  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:21.317734  1568 raft_consensus.cc:3060] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:21.319557  1768 ts_tablet_manager.cc:1403] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e: Time spent bootstrapping tablet: real 0.147s	user 0.016s	sys 0.012s
I20260709 12:58:21.324759  1768 raft_consensus.cc:359] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.325774  1768 raft_consensus.cc:385] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:21.326356  1768 raft_consensus.cc:740] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Initialized, Role: FOLLOWER
I20260709 12:58:21.327029  1768 consensus_queue.cc:260] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.329741  1768 ts_tablet_manager.cc:1434] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.003s
I20260709 12:58:21.330725  1768 tablet_bootstrap.cc:492] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e: Bootstrap starting.
I20260709 12:58:21.328619  1568 raft_consensus.cc:2468] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 1.
I20260709 12:58:21.331748  1615 leader_election.cc:304] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:58:21.333464  1963 raft_consensus.cc:2804] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:21.334017  1963 raft_consensus.cc:697] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:58:21.335004  1963 consensus_queue.cc:237] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.336614  1472 catalog_manager.cc:5697] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 0 to 1, leader changed from <none> to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:21.339846  2001 consensus_queue.cc:1048] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:21.342868  1722 raft_consensus.cc:2468] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 1.
I20260709 12:58:21.409945  2001 consensus_queue.cc:1048] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:21.415531  1834 raft_consensus.cc:493] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:21.416209  1768 tablet_bootstrap.cc:654] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:21.416026  1834 raft_consensus.cc:515] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.418833  1834 leader_election.cc:290] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:21.423072  1767 tablet_bootstrap.cc:492] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: No bootstrap required, opened a new log
I20260709 12:58:21.423650  1767 ts_tablet_manager.cc:1403] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent bootstrapping tablet: real 0.163s	user 0.021s	sys 0.011s
I20260709 12:58:21.425302  1765 tablet_bootstrap.cc:654] T bfb3b560711b4d7eb23f2aff3e4ca991 P 0c7751452c4b46afa95251b9df7169d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:21.432735  2001 raft_consensus.cc:493] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:21.433223  2001 raft_consensus.cc:515] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.433333  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:21.429414  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:58:21.440110  1615 leader_election.cc:343] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:21.446945  1472 catalog_manager.cc:5697] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 0 to 1, leader changed from <none> to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:21.439908  1723 raft_consensus.cc:2468] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 0.
I20260709 12:58:21.451669  1617 leader_election.cc:304] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:21.452582  2001 leader_election.cc:290] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:21.452776  1834 raft_consensus.cc:2804] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:21.453158  1834 raft_consensus.cc:493] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:21.453485  1834 raft_consensus.cc:3060] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:21.454222  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:21.454222  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:21.454983  1721 raft_consensus.cc:2468] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 0.
I20260709 12:58:21.455011  1646 raft_consensus.cc:2468] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 0.
I20260709 12:58:21.456233  1542 leader_election.cc:304] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:58:21.456988  1869 raft_consensus.cc:2804] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:21.457351  1869 raft_consensus.cc:493] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:21.457645  1869 raft_consensus.cc:3060] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:21.462232  1869 raft_consensus.cc:515] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:58:21.463697  1521 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:21.459980  1767 raft_consensus.cc:359] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.465850  1767 raft_consensus.cc:385] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:21.466138  1767 raft_consensus.cc:740] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Initialized, Role: FOLLOWER
I20260709 12:58:21.466589  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:58:21.467201  1721 raft_consensus.cc:3060] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:21.460139  1834 raft_consensus.cc:515] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.467790  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:21.470988  1650 raft_consensus.cc:3060] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:21.471805  1767 consensus_queue.cc:260] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.476564  1767 ts_tablet_manager.cc:1434] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent starting tablet: real 0.053s	user 0.004s	sys 0.004s
I20260709 12:58:21.479419  1767 tablet_bootstrap.cc:492] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Bootstrap starting.
I20260709 12:58:21.481707  1834 leader_election.cc:290] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:21.471912  1869 leader_election.cc:290] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:21.485011  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:58:21.487535  1723 raft_consensus.cc:3060] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:21.488202  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 12:58:21.490434  1615 leader_election.cc:343] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:21.493717  1650 raft_consensus.cc:2468] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 1.
I20260709 12:58:21.497153  1963 raft_consensus.cc:493] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:21.497689  1963 raft_consensus.cc:515] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.499922  1963 leader_election.cc:290] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:21.501570  1765 tablet_bootstrap.cc:492] T bfb3b560711b4d7eb23f2aff3e4ca991 P 0c7751452c4b46afa95251b9df7169d4: No bootstrap required, opened a new log
I20260709 12:58:21.502161  1765 ts_tablet_manager.cc:1403] T bfb3b560711b4d7eb23f2aff3e4ca991 P 0c7751452c4b46afa95251b9df7169d4: Time spent bootstrapping tablet: real 0.219s	user 0.011s	sys 0.005s
I20260709 12:58:21.513162  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 12:58:21.515405  1615 leader_election.cc:343] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:21.506673  1721 raft_consensus.cc:2468] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 1.
I20260709 12:58:21.517930  1768 tablet_bootstrap.cc:492] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e: No bootstrap required, opened a new log
I20260709 12:58:21.518520  1768 ts_tablet_manager.cc:1403] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e: Time spent bootstrapping tablet: real 0.188s	user 0.011s	sys 0.002s
I20260709 12:58:21.521557  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:58:21.525527  1617 leader_election.cc:343] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:21.525964  1617 leader_election.cc:304] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:21.527884  1767 tablet_bootstrap.cc:654] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:21.529557  1542 leader_election.cc:304] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:58:21.530702  2037 raft_consensus.cc:2804] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:21.531193  2037 raft_consensus.cc:697] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:58:21.531817  2037 consensus_queue.cc:237] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.535401  1911 consensus_queue.cc:1048] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:21.545581  1723 raft_consensus.cc:2468] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 1.
I20260709 12:58:21.547111  1765 raft_consensus.cc:359] T bfb3b560711b4d7eb23f2aff3e4ca991 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.548573  1617 leader_election.cc:304] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:21.529114  1963 raft_consensus.cc:2749] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:21.550329  1765 raft_consensus.cc:385] T bfb3b560711b4d7eb23f2aff3e4ca991 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:21.554096  1765 raft_consensus.cc:740] T bfb3b560711b4d7eb23f2aff3e4ca991 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Initialized, Role: FOLLOWER
I20260709 12:58:21.554936  1768 raft_consensus.cc:359] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.555954  1768 raft_consensus.cc:385] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:21.554862  1765 consensus_queue.cc:260] T bfb3b560711b4d7eb23f2aff3e4ca991 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.556311  1768 raft_consensus.cc:740] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Initialized, Role: FOLLOWER
I20260709 12:58:21.556854  1961 raft_consensus.cc:2804] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:21.556975  1768 consensus_queue.cc:260] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.557464  1961 raft_consensus.cc:697] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:58:21.558385  1961 consensus_queue.cc:237] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.559445  1768 ts_tablet_manager.cc:1434] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.002s
I20260709 12:58:21.560489  1768 tablet_bootstrap.cc:492] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e: Bootstrap starting.
I20260709 12:58:21.566908  1765 ts_tablet_manager.cc:1434] T bfb3b560711b4d7eb23f2aff3e4ca991 P 0c7751452c4b46afa95251b9df7169d4: Time spent starting tablet: real 0.064s	user 0.009s	sys 0.001s
I20260709 12:58:21.568784  1765 tablet_bootstrap.cc:492] T 4fa306a802914bb9b8d54b7bfe53009c P 0c7751452c4b46afa95251b9df7169d4: Bootstrap starting.
W20260709 12:58:21.570962  1689 consensus_peers.cc:597] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:21.577003  1768 tablet_bootstrap.cc:654] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:21.594651  1824 consensus_queue.cc:1048] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:21.599617  1472 catalog_manager.cc:5697] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:21.602694  1767 tablet_bootstrap.cc:492] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: No bootstrap required, opened a new log
I20260709 12:58:21.603166  1767 ts_tablet_manager.cc:1403] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent bootstrapping tablet: real 0.126s	user 0.021s	sys 0.014s
I20260709 12:58:21.611908  1824 consensus_queue.cc:1048] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:21.617887  1767 raft_consensus.cc:359] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.620057  1767 raft_consensus.cc:385] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:21.621129  1765 tablet_bootstrap.cc:654] T 4fa306a802914bb9b8d54b7bfe53009c P 0c7751452c4b46afa95251b9df7169d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:21.620232  1471 catalog_manager.cc:5697] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 0 to 1, leader changed from <none> to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:21.621845  1963 raft_consensus.cc:493] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:21.623039  1963 raft_consensus.cc:515] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.625627  1963 leader_election.cc:290] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:21.626703  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:21.627036  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:58:21.628297  1617 leader_election.cc:343] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:21.629431  1615 leader_election.cc:343] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:21.632221  1615 leader_election.cc:304] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:21.633330  1961 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:21.633850  1834 raft_consensus.cc:2749] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:58:21.636926  1617 consensus_peers.cc:597] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e -> Peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Couldn't send request to peer 0c7751452c4b46afa95251b9df7169d4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:21.633787  1961 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.642455  1961 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:21.642796  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:21.643422  1724 raft_consensus.cc:2468] T bfb3b560711b4d7eb23f2aff3e4ca991 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 0.
I20260709 12:58:21.622421  1767 raft_consensus.cc:740] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Initialized, Role: FOLLOWER
I20260709 12:58:21.646428  1915 raft_consensus.cc:493] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:21.648234  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:21.648742  1915 raft_consensus.cc:515] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:58:21.650089  1615 leader_election.cc:343] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:21.650655  1915 leader_election.cc:290] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:21.651252  1767 consensus_queue.cc:260] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.652884  1617 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:21.653306  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:21.653657  1767 ts_tablet_manager.cc:1434] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent starting tablet: real 0.050s	user 0.004s	sys 0.004s
I20260709 12:58:21.654770  1767 tablet_bootstrap.cc:492] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Bootstrap starting.
W20260709 12:58:21.654672  1689 leader_election.cc:343] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:21.654901  1961 raft_consensus.cc:2804] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:21.655449  1961 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:21.655895  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:21.656504  1961 raft_consensus.cc:3060] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:21.656777  1646 raft_consensus.cc:2468] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 0.
I20260709 12:58:21.664106  1688 leader_election.cc:304] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:21.665731  1915 raft_consensus.cc:2804] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:21.666145  1915 raft_consensus.cc:493] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:21.666541  1915 raft_consensus.cc:3060] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:21.668092  1765 tablet_bootstrap.cc:492] T 4fa306a802914bb9b8d54b7bfe53009c P 0c7751452c4b46afa95251b9df7169d4: No bootstrap required, opened a new log
I20260709 12:58:21.668592  1765 ts_tablet_manager.cc:1403] T 4fa306a802914bb9b8d54b7bfe53009c P 0c7751452c4b46afa95251b9df7169d4: Time spent bootstrapping tablet: real 0.100s	user 0.016s	sys 0.001s
I20260709 12:58:21.671370  1765 raft_consensus.cc:359] T 4fa306a802914bb9b8d54b7bfe53009c P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.672070  1765 raft_consensus.cc:385] T 4fa306a802914bb9b8d54b7bfe53009c P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:21.672348  1765 raft_consensus.cc:740] T 4fa306a802914bb9b8d54b7bfe53009c P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Initialized, Role: FOLLOWER
I20260709 12:58:21.673018  1765 consensus_queue.cc:260] T 4fa306a802914bb9b8d54b7bfe53009c P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.675506  1765 ts_tablet_manager.cc:1434] T 4fa306a802914bb9b8d54b7bfe53009c P 0c7751452c4b46afa95251b9df7169d4: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:58:21.675779  1767 tablet_bootstrap.cc:654] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:21.676322  1961 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.684788  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:21.685525  1961 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:21.690863  1768 tablet_bootstrap.cc:492] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e: No bootstrap required, opened a new log
I20260709 12:58:21.691378  1768 ts_tablet_manager.cc:1403] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e: Time spent bootstrapping tablet: real 0.131s	user 0.011s	sys 0.003s
W20260709 12:58:21.693567  1615 leader_election.cc:343] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:21.694507  1768 raft_consensus.cc:359] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.695250  1768 raft_consensus.cc:385] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:21.694819  1915 raft_consensus.cc:515] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.695590  1768 raft_consensus.cc:740] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Initialized, Role: FOLLOWER
I20260709 12:58:21.700803  1768 consensus_queue.cc:260] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.702749  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:21.703068  1768 ts_tablet_manager.cc:1434] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.003s
W20260709 12:58:21.704164  1689 leader_election.cc:343] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:21.705183  1765 tablet_bootstrap.cc:492] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4: Bootstrap starting.
I20260709 12:58:21.705366  1767 tablet_bootstrap.cc:492] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: No bootstrap required, opened a new log
I20260709 12:58:21.705864  1767 ts_tablet_manager.cc:1403] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.004s
I20260709 12:58:21.709163  1767 raft_consensus.cc:359] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.709988  1767 raft_consensus.cc:385] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:21.710296  1767 raft_consensus.cc:740] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Initialized, Role: FOLLOWER
I20260709 12:58:21.710814  1576 raft_consensus.cc:3060] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:21.710945  1767 consensus_queue.cc:260] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.713707  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:58:21.715775  1723 raft_consensus.cc:3060] T bfb3b560711b4d7eb23f2aff3e4ca991 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:21.722481  1723 raft_consensus.cc:2468] T bfb3b560711b4d7eb23f2aff3e4ca991 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 1.
I20260709 12:58:21.723475  1767 ts_tablet_manager.cc:1434] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:58:21.725335  1768 tablet_bootstrap.cc:492] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e: Bootstrap starting.
I20260709 12:58:21.727361  1617 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:21.737458  1767 tablet_bootstrap.cc:492] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Bootstrap starting.
I20260709 12:58:21.733345  1963 raft_consensus.cc:2804] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:21.740067  1963 raft_consensus.cc:697] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:58:21.739163  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:21.740664  1646 raft_consensus.cc:3060] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:21.741024  1963 consensus_queue.cc:237] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.734859  1915 leader_election.cc:290] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:21.745711  1960 consensus_queue.cc:1048] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:21.747332  1765 tablet_bootstrap.cc:654] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:21.770743  1768 tablet_bootstrap.cc:654] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:21.770464  2049 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:21.772614  1824 consensus_queue.cc:1048] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:21.772730  2049 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.773782  1915 consensus_queue.cc:1048] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:21.775010  2049 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:21.778141  1646 raft_consensus.cc:2468] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 1.
I20260709 12:58:21.780365  1688 leader_election.cc:304] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:21.781198  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:21.783233  1956 raft_consensus.cc:2804] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:21.784657  1576 raft_consensus.cc:2393] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 1: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:58:21.784840  1956 raft_consensus.cc:697] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:58:21.787024  1956 consensus_queue.cc:237] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.787748  1767 tablet_bootstrap.cc:654] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:21.806348  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:21.813701  1688 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:21.814761  1915 raft_consensus.cc:3060] T 4fa306a802914bb9b8d54b7bfe53009c P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:21.822824  1768 tablet_bootstrap.cc:492] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e: No bootstrap required, opened a new log
I20260709 12:58:21.823812  1768 ts_tablet_manager.cc:1403] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e: Time spent bootstrapping tablet: real 0.099s	user 0.007s	sys 0.010s
I20260709 12:58:21.820675  1473 catalog_manager.cc:5697] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:21.832623  1765 tablet_bootstrap.cc:492] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4: No bootstrap required, opened a new log
I20260709 12:58:21.833089  1765 ts_tablet_manager.cc:1403] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4: Time spent bootstrapping tablet: real 0.128s	user 0.009s	sys 0.015s
I20260709 12:58:21.829754  2037 raft_consensus.cc:493] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:21.834277  2037 raft_consensus.cc:515] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.835160  1765 raft_consensus.cc:359] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.835615  1765 raft_consensus.cc:385] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:21.835783  1765 raft_consensus.cc:740] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Initialized, Role: FOLLOWER
I20260709 12:58:21.836374  1765 consensus_queue.cc:260] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.839286  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:21.844157  1765 ts_tablet_manager.cc:1434] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:58:21.845566  1765 tablet_bootstrap.cc:492] T e66a330b7dae4036b80d239969d5a260 P 0c7751452c4b46afa95251b9df7169d4: Bootstrap starting.
I20260709 12:58:21.848182  2037 leader_election.cc:290] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:21.851394  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:21.853641  1542 leader_election.cc:304] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:58:21.855369  2037 raft_consensus.cc:2749] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:21.861764  1768 raft_consensus.cc:359] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.863029  1768 raft_consensus.cc:385] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:21.863374  1768 raft_consensus.cc:740] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Initialized, Role: FOLLOWER
I20260709 12:58:21.856812  1915 raft_consensus.cc:2749] T 4fa306a802914bb9b8d54b7bfe53009c P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:21.872007  1768 consensus_queue.cc:260] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.875254  1768 ts_tablet_manager.cc:1434] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e: Time spent starting tablet: real 0.051s	user 0.003s	sys 0.003s
I20260709 12:58:21.876353  1471 catalog_manager.cc:5697] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 0 to 1, leader changed from <none> to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:21.878363  1960 consensus_queue.cc:1048] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:21.889214  1765 tablet_bootstrap.cc:654] T e66a330b7dae4036b80d239969d5a260 P 0c7751452c4b46afa95251b9df7169d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:21.893070  1768 tablet_bootstrap.cc:492] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e: Bootstrap starting.
I20260709 12:58:21.898067  1767 tablet_bootstrap.cc:492] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 89ac9d5e2fbc4536b03a1ff1dd3eb226: No bootstrap required, opened a new log
I20260709 12:58:21.898495  1767 ts_tablet_manager.cc:1403] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent bootstrapping tablet: real 0.167s	user 0.019s	sys 0.009s
I20260709 12:58:21.903759  1961 consensus_queue.cc:1048] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:21.913908  1768 tablet_bootstrap.cc:654] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:21.914297  1767 raft_consensus.cc:359] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.914827  1767 raft_consensus.cc:385] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:21.915040  1767 raft_consensus.cc:740] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Initialized, Role: FOLLOWER
I20260709 12:58:21.916712  1767 consensus_queue.cc:260] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.933730  1767 ts_tablet_manager.cc:1434] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260709 12:58:21.942152  1767 tablet_bootstrap.cc:492] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Bootstrap starting.
I20260709 12:58:21.944181  1765 tablet_bootstrap.cc:492] T e66a330b7dae4036b80d239969d5a260 P 0c7751452c4b46afa95251b9df7169d4: No bootstrap required, opened a new log
I20260709 12:58:21.944680  1765 ts_tablet_manager.cc:1403] T e66a330b7dae4036b80d239969d5a260 P 0c7751452c4b46afa95251b9df7169d4: Time spent bootstrapping tablet: real 0.099s	user 0.017s	sys 0.002s
I20260709 12:58:21.947345  1768 tablet_bootstrap.cc:492] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e: No bootstrap required, opened a new log
I20260709 12:58:21.948370  1765 raft_consensus.cc:359] T e66a330b7dae4036b80d239969d5a260 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.949156  1765 raft_consensus.cc:385] T e66a330b7dae4036b80d239969d5a260 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:21.952164  1765 raft_consensus.cc:740] T e66a330b7dae4036b80d239969d5a260 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Initialized, Role: FOLLOWER
I20260709 12:58:21.949229  1768 ts_tablet_manager.cc:1403] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e: Time spent bootstrapping tablet: real 0.066s	user 0.008s	sys 0.007s
I20260709 12:58:21.954769  1765 consensus_queue.cc:260] T e66a330b7dae4036b80d239969d5a260 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.960204  1768 raft_consensus.cc:359] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.960986  1768 raft_consensus.cc:385] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:21.961237  1768 raft_consensus.cc:740] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Initialized, Role: FOLLOWER
I20260709 12:58:21.963385  1765 ts_tablet_manager.cc:1434] T e66a330b7dae4036b80d239969d5a260 P 0c7751452c4b46afa95251b9df7169d4: Time spent starting tablet: real 0.018s	user 0.012s	sys 0.000s
I20260709 12:58:21.963951  1767 tablet_bootstrap.cc:654] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:21.964818  1765 tablet_bootstrap.cc:492] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4: Bootstrap starting.
I20260709 12:58:21.967449  1768 consensus_queue.cc:260] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.971161  1765 tablet_bootstrap.cc:654] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:21.974246  1768 ts_tablet_manager.cc:1434] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.001s
I20260709 12:58:21.975224  1768 tablet_bootstrap.cc:492] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e: Bootstrap starting.
I20260709 12:58:21.983004  1765 tablet_bootstrap.cc:492] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4: No bootstrap required, opened a new log
I20260709 12:58:21.983513  1765 ts_tablet_manager.cc:1403] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 12:58:21.986198  1765 raft_consensus.cc:359] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:21.986909  1765 raft_consensus.cc:385] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:21.987185  1765 raft_consensus.cc:740] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Initialized, Role: FOLLOWER
I20260709 12:58:21.988159  1768 tablet_bootstrap.cc:654] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:21.987876  1765 consensus_queue.cc:260] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:22.000248  1767 tablet_bootstrap.cc:492] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226: No bootstrap required, opened a new log
I20260709 12:58:22.000726  1767 ts_tablet_manager.cc:1403] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent bootstrapping tablet: real 0.059s	user 0.011s	sys 0.005s
I20260709 12:58:22.001046  1576 raft_consensus.cc:3060] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:22.003750  1767 raft_consensus.cc:359] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:22.004560  1767 raft_consensus.cc:385] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:22.004829  1767 raft_consensus.cc:740] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Initialized, Role: FOLLOWER
I20260709 12:58:22.005086  1765 ts_tablet_manager.cc:1434] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:58:22.006673  1765 tablet_bootstrap.cc:492] T 65524f4fe7be481b9f069829076b7dc3 P 0c7751452c4b46afa95251b9df7169d4: Bootstrap starting.
I20260709 12:58:22.011835  1834 consensus_queue.cc:1048] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:22.005496  1767 consensus_queue.cc:260] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:22.012777  1765 tablet_bootstrap.cc:654] T 65524f4fe7be481b9f069829076b7dc3 P 0c7751452c4b46afa95251b9df7169d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:22.014333  1911 raft_consensus.cc:493] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:22.014791  1911 raft_consensus.cc:515] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:22.017901  1911 leader_election.cc:290] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:22.018011  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:22.019635  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:58:22.019784  1689 leader_election.cc:343] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:22.019907  1767 ts_tablet_manager.cc:1434] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:58:22.020223  1646 raft_consensus.cc:2468] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 0.
I20260709 12:58:22.021139  1767 tablet_bootstrap.cc:492] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Bootstrap starting.
I20260709 12:58:22.021448  1688 leader_election.cc:304] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:22.022409  1911 raft_consensus.cc:2804] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:22.022771  1911 raft_consensus.cc:493] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:22.023104  1911 raft_consensus.cc:3060] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:22.023229  1963 consensus_queue.cc:1048] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:22.031191  1911 raft_consensus.cc:515] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:22.033121  1768 tablet_bootstrap.cc:492] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e: No bootstrap required, opened a new log
I20260709 12:58:22.033603  1768 ts_tablet_manager.cc:1403] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e: Time spent bootstrapping tablet: real 0.059s	user 0.009s	sys 0.002s
I20260709 12:58:22.035698  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:22.036010  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:22.036588  1646 raft_consensus.cc:3060] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:22.038281  1768 raft_consensus.cc:359] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:58:22.038722  1689 leader_election.cc:343] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:22.038918  1768 raft_consensus.cc:385] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:22.039213  1768 raft_consensus.cc:740] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Initialized, Role: FOLLOWER
I20260709 12:58:22.039801  1768 consensus_queue.cc:260] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:22.041781  1768 ts_tablet_manager.cc:1434] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:58:22.043318  1646 raft_consensus.cc:2468] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 1.
I20260709 12:58:22.044389  1688 leader_election.cc:304] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:22.045140  1915 raft_consensus.cc:2804] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:22.045579  1915 raft_consensus.cc:697] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:58:22.043329  1768 tablet_bootstrap.cc:492] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e: Bootstrap starting.
I20260709 12:58:22.046404  1915 consensus_queue.cc:237] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:22.053362  1768 tablet_bootstrap.cc:654] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:22.054073  2037 consensus_queue.cc:1048] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:22.055672  1767 tablet_bootstrap.cc:654] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:22.055838  1911 leader_election.cc:290] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:22.056142  1834 raft_consensus.cc:493] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:22.060343  1834 raft_consensus.cc:515] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:22.064457  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:22.065171  1768 tablet_bootstrap.cc:492] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e: No bootstrap required, opened a new log
I20260709 12:58:22.065274  1724 raft_consensus.cc:2468] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 0.
I20260709 12:58:22.066115  1768 ts_tablet_manager.cc:1403] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.007s
I20260709 12:58:22.066869  1617 leader_election.cc:304] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:58:22.067739  1963 raft_consensus.cc:2804] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:22.068085  1963 raft_consensus.cc:493] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:22.068418  1963 raft_consensus.cc:3060] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:22.068636  1765 tablet_bootstrap.cc:492] T 65524f4fe7be481b9f069829076b7dc3 P 0c7751452c4b46afa95251b9df7169d4: No bootstrap required, opened a new log
I20260709 12:58:22.069067  1765 ts_tablet_manager.cc:1403] T 65524f4fe7be481b9f069829076b7dc3 P 0c7751452c4b46afa95251b9df7169d4: Time spent bootstrapping tablet: real 0.063s	user 0.006s	sys 0.014s
I20260709 12:58:22.068789  1768 raft_consensus.cc:359] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:22.069535  1768 raft_consensus.cc:385] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:22.069826  1768 raft_consensus.cc:740] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Initialized, Role: FOLLOWER
I20260709 12:58:22.070537  1768 consensus_queue.cc:260] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:22.073673  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:22.079774  1765 raft_consensus.cc:359] T 65524f4fe7be481b9f069829076b7dc3 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:22.080487  1765 raft_consensus.cc:385] T 65524f4fe7be481b9f069829076b7dc3 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:22.080878  1765 raft_consensus.cc:740] T 65524f4fe7be481b9f069829076b7dc3 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Initialized, Role: FOLLOWER
I20260709 12:58:22.084182  1765 consensus_queue.cc:260] T 65524f4fe7be481b9f069829076b7dc3 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:58:22.094700  1615 leader_election.cc:343] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:22.116724  2039 consensus_queue.cc:1048] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:22.120312  2039 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:22.131165  1768 ts_tablet_manager.cc:1434] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e: Time spent starting tablet: real 0.065s	user 0.036s	sys 0.027s
I20260709 12:58:22.132104  1765 ts_tablet_manager.cc:1434] T 65524f4fe7be481b9f069829076b7dc3 P 0c7751452c4b46afa95251b9df7169d4: Time spent starting tablet: real 0.063s	user 0.012s	sys 0.003s
I20260709 12:58:22.132664  1960 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:22.132325  1768 tablet_bootstrap.cc:492] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e: Bootstrap starting.
I20260709 12:58:22.133405  1960 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:22.136166  1765 tablet_bootstrap.cc:492] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4: Bootstrap starting.
I20260709 12:58:22.135995  2039 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:22.139001  1767 tablet_bootstrap.cc:492] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: No bootstrap required, opened a new log
I20260709 12:58:22.139910  1767 ts_tablet_manager.cc:1403] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent bootstrapping tablet: real 0.119s	user 0.013s	sys 0.010s
I20260709 12:58:22.145584  1960 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:22.145428  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:22.146844  2039 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:22.135658  1963 raft_consensus.cc:515] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:22.151638  1963 leader_election.cc:290] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:22.154565  1721 raft_consensus.cc:2393] T bfb3b560711b4d7eb23f2aff3e4ca991 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 1: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:58:22.154017  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:22.146708  1834 leader_election.cc:290] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:22.156203  2039 raft_consensus.cc:493] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:22.179059  1539 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:58:22.180384  2037 raft_consensus.cc:3060] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:22.169131  2073 raft_consensus.cc:493] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:22.185472  1768 tablet_bootstrap.cc:654] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:22.184777  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:22.189316  1574 raft_consensus.cc:3060] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:22.185431  2073 raft_consensus.cc:515] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:22.191331  2073 leader_election.cc:290] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:22.191242  1767 raft_consensus.cc:359] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:22.193285  1767 raft_consensus.cc:385] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:22.193562  1767 raft_consensus.cc:740] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Initialized, Role: FOLLOWER
I20260709 12:58:22.195288  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:22.195246  1767 consensus_queue.cc:260] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:22.196667  1570 raft_consensus.cc:2468] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 0.
I20260709 12:58:22.194787  1721 raft_consensus.cc:2468] T e66a330b7dae4036b80d239969d5a260 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 0.
I20260709 12:58:22.198218  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:58:22.198817  1723 raft_consensus.cc:3060] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:22.202257  1615 leader_election.cc:304] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:58:22.204694  2037 raft_consensus.cc:2749] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:22.177300  2039 raft_consensus.cc:515] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:22.209440  2073 raft_consensus.cc:2804] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:22.209915  2073 raft_consensus.cc:493] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:22.210317  2073 raft_consensus.cc:3060] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:22.211051  2039 leader_election.cc:290] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:22.188361  1834 raft_consensus.cc:493] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:22.225312  1963 raft_consensus.cc:493] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:22.227169  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:22.227108  1963 raft_consensus.cc:515] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:22.227938  1767 ts_tablet_manager.cc:1434] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent starting tablet: real 0.088s	user 0.020s	sys 0.009s
I20260709 12:58:22.237013  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:22.225732  1834 raft_consensus.cc:515] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:22.240979  1767 tablet_bootstrap.cc:492] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Bootstrap starting.
I20260709 12:58:22.241571  1472 catalog_manager.cc:5697] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:22.242353  1834 leader_election.cc:290] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:58:22.267778  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 64731.7us
I20260709 12:58:22.216976  1617 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:58:22.285163  1767 tablet_bootstrap.cc:654] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:22.289072  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:58:22.290570  2069 log.cc:927] Time spent T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:58:22.283821  1961 raft_consensus.cc:2804] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:22.293143  1765 tablet_bootstrap.cc:654] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:22.297154  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:58:22.284044  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 67163.1us
I20260709 12:58:22.300384  1648 raft_consensus.cc:2393] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 1: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:58:22.293628  1961 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:22.301806  1961 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:22.305787  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:22.307461  1963 leader_election.cc:290] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:58:22.309557  1615 leader_election.cc:343] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:22.308449  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:22.313544  2080 raft_consensus.cc:493] T 65524f4fe7be481b9f069829076b7dc3 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:22.314029  2080 raft_consensus.cc:515] T 65524f4fe7be481b9f069829076b7dc3 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:58:22.323571  1615 leader_election.cc:343] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:22.325367  2080 leader_election.cc:290] T 65524f4fe7be481b9f069829076b7dc3 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 12:58:22.330238  1615 leader_election.cc:343] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:22.331003  1615 leader_election.cc:343] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:22.338824  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:22.339776  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:58:22.344178  1688 leader_election.cc:343] T 65524f4fe7be481b9f069829076b7dc3 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:22.332145  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:22.353614  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:58:22.354811  1617 leader_election.cc:343] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:22.354699  2073 raft_consensus.cc:515] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:22.369652  1573 raft_consensus.cc:3060] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:22.370890  1542 leader_election.cc:304] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:58:22.375990  2073 leader_election.cc:290] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:22.372911  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:22.364004  1617 leader_election.cc:304] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:22.382434  1963 raft_consensus.cc:2749] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:22.383440  1768 tablet_bootstrap.cc:492] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e: No bootstrap required, opened a new log
I20260709 12:58:22.384090  1768 ts_tablet_manager.cc:1403] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e: Time spent bootstrapping tablet: real 0.252s	user 0.017s	sys 0.009s
I20260709 12:58:22.386842  1723 raft_consensus.cc:2468] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 1.
I20260709 12:58:22.390354  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:22.391500  1567 raft_consensus.cc:3060] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:22.392331  1751 tablet.cc:2406] T 65524f4fe7be481b9f069829076b7dc3 P 0c7751452c4b46afa95251b9df7169d4: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260709 12:58:22.398304  1689 leader_election.cc:343] T 65524f4fe7be481b9f069829076b7dc3 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:22.398721  1689 leader_election.cc:304] T 65524f4fe7be481b9f069829076b7dc3 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 12:58:22.385115  1617 leader_election.cc:343] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:22.403894  1617 leader_election.cc:343] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:22.404297  1617 leader_election.cc:304] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:22.405337  1617 leader_election.cc:304] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:22.405603  2079 raft_consensus.cc:2749] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:22.406605  2077 raft_consensus.cc:2749] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:22.406873  1834 raft_consensus.cc:2804] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:22.407404  1834 raft_consensus.cc:697] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:58:22.412140  1765 tablet_bootstrap.cc:492] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4: No bootstrap required, opened a new log
I20260709 12:58:22.412628  1765 ts_tablet_manager.cc:1403] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4: Time spent bootstrapping tablet: real 0.277s	user 0.021s	sys 0.015s
I20260709 12:58:22.415297  1961 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:22.416694  2073 consensus_queue.cc:1048] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:22.414211  1824 raft_consensus.cc:2749] T 65524f4fe7be481b9f069829076b7dc3 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:22.420601  1768 raft_consensus.cc:359] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:22.421283  1768 raft_consensus.cc:385] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:22.421543  1768 raft_consensus.cc:740] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Initialized, Role: FOLLOWER
I20260709 12:58:22.422127  1768 consensus_queue.cc:260] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:22.422561  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:22.424085  1768 ts_tablet_manager.cc:1434] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e: Time spent starting tablet: real 0.040s	user 0.003s	sys 0.000s
W20260709 12:58:22.424566  1615 leader_election.cc:343] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:22.411366  1834 consensus_queue.cc:237] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:22.434131  1765 raft_consensus.cc:359] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:22.434706  1765 raft_consensus.cc:385] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:22.434976  1765 raft_consensus.cc:740] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Initialized, Role: FOLLOWER
I20260709 12:58:22.435528  1765 consensus_queue.cc:260] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:22.441789  1915 consensus_queue.cc:1048] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:22.445755  1765 ts_tablet_manager.cc:1434] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.001s
I20260709 12:58:22.446736  1768 tablet_bootstrap.cc:492] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e: Bootstrap starting.
I20260709 12:58:22.451052  1824 consensus_queue.cc:1048] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:22.448457  1961 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:22.442384  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:58:22.459600  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:58:22.459686  1722 raft_consensus.cc:3060] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:22.460217  1723 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:22.458994  1961 raft_consensus.cc:493] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:22.460661  1963 consensus_queue.cc:1048] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:22.464162  1961 raft_consensus.cc:515] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:22.466629  1961 leader_election.cc:290] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:22.472172  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 12:58:22.474764  1615 leader_election.cc:343] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:22.476794  1765 tablet_bootstrap.cc:492] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4: Bootstrap starting.
I20260709 12:58:22.481050  1723 raft_consensus.cc:2468] T e66a330b7dae4036b80d239969d5a260 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 1.
I20260709 12:58:22.484927  1617 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:22.483387  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:22.476799  1567 raft_consensus.cc:2468] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 1.
I20260709 12:58:22.489797  1963 raft_consensus.cc:2804] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:22.519187  1722 raft_consensus.cc:2468] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 1.
I20260709 12:58:22.526324  1963 raft_consensus.cc:697] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:58:22.532578  1963 consensus_queue.cc:237] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:58:22.550846  1617 leader_election.cc:343] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:22.553218  1617 leader_election.cc:304] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:22.557279  1767 tablet_bootstrap.cc:492] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: No bootstrap required, opened a new log
I20260709 12:58:22.557778  1767 ts_tablet_manager.cc:1403] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent bootstrapping tablet: real 0.317s	user 0.022s	sys 0.008s
I20260709 12:58:22.548732  2080 consensus_queue.cc:1048] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:58:22.568486  2073 raft_consensus.cc:2749] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:22.577487  1615 leader_election.cc:304] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:58:22.579583  1765 tablet_bootstrap.cc:654] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:22.588228  2093 raft_consensus.cc:2804] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:22.603487  1767 raft_consensus.cc:359] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:22.604100  1768 tablet_bootstrap.cc:654] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:22.604544  1767 raft_consensus.cc:385] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:22.604912  1767 raft_consensus.cc:740] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Initialized, Role: FOLLOWER
W20260709 12:58:22.605129  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 54703.1us
I20260709 12:58:22.605749  1767 consensus_queue.cc:260] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:22.617753  1765 tablet_bootstrap.cc:492] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4: No bootstrap required, opened a new log
I20260709 12:58:22.618310  1765 ts_tablet_manager.cc:1403] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4: Time spent bootstrapping tablet: real 0.157s	user 0.007s	sys 0.016s
I20260709 12:58:22.627172  1767 ts_tablet_manager.cc:1434] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent starting tablet: real 0.069s	user 0.010s	sys 0.000s
I20260709 12:58:22.637892  1767 tablet_bootstrap.cc:492] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Bootstrap starting.
I20260709 12:58:22.625147  2093 raft_consensus.cc:697] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:58:22.662895  2093 consensus_queue.cc:237] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:22.671859  1568 raft_consensus.cc:3060] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:22.678709  1471 catalog_manager.cc:5697] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 0 to 1, leader changed from <none> to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:22.683210  1765 raft_consensus.cc:359] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:22.684003  1765 raft_consensus.cc:385] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:58:22.689889  1521 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:22.684300  1765 raft_consensus.cc:740] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Initialized, Role: FOLLOWER
I20260709 12:58:22.706579  1915 consensus_queue.cc:1048] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:22.707365  1765 consensus_queue.cc:260] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:22.709115  1765 ts_tablet_manager.cc:1434] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4: Time spent starting tablet: real 0.090s	user 0.008s	sys 0.000s
I20260709 12:58:22.710184  1765 tablet_bootstrap.cc:492] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4: Bootstrap starting.
I20260709 12:58:22.719230  1768 tablet_bootstrap.cc:492] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e: No bootstrap required, opened a new log
I20260709 12:58:22.720005  1767 tablet_bootstrap.cc:654] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:22.720261  1768 ts_tablet_manager.cc:1403] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e: Time spent bootstrapping tablet: real 0.277s	user 0.033s	sys 0.015s
I20260709 12:58:22.733093  1471 catalog_manager.cc:5697] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 0 to 1, leader changed from <none> to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:22.735280  1471 catalog_manager.cc:5697] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 0 to 1, leader changed from <none> to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:22.736250  1768 raft_consensus.cc:359] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:22.736975  1768 raft_consensus.cc:385] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:22.737273  1768 raft_consensus.cc:740] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Initialized, Role: FOLLOWER
I20260709 12:58:22.767868  1765 tablet_bootstrap.cc:654] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:22.809252  1768 consensus_queue.cc:260] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:22.811893  1768 ts_tablet_manager.cc:1434] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e: Time spent starting tablet: real 0.091s	user 0.022s	sys 0.031s
I20260709 12:58:22.813043  1768 tablet_bootstrap.cc:492] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e: Bootstrap starting.
I20260709 12:58:22.816047  1767 tablet_bootstrap.cc:492] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226: No bootstrap required, opened a new log
I20260709 12:58:22.816605  1767 ts_tablet_manager.cc:1403] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent bootstrapping tablet: real 0.179s	user 0.011s	sys 0.019s
I20260709 12:58:22.821594  1767 raft_consensus.cc:359] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:22.823016  1767 raft_consensus.cc:385] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:22.823379  1767 raft_consensus.cc:740] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Initialized, Role: FOLLOWER
I20260709 12:58:22.824193  1767 consensus_queue.cc:260] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:22.826140  1767 ts_tablet_manager.cc:1434] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:58:22.829047  1767 tablet_bootstrap.cc:492] T cfe7eb675393487f87b528a12f16e16e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Bootstrap starting.
I20260709 12:58:22.838049  1768 tablet_bootstrap.cc:654] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:22.844302  1768 tablet_bootstrap.cc:492] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e: No bootstrap required, opened a new log
I20260709 12:58:22.844820  1768 ts_tablet_manager.cc:1403] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.003s
I20260709 12:58:22.846719  1765 tablet_bootstrap.cc:492] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4: No bootstrap required, opened a new log
I20260709 12:58:22.847247  1765 ts_tablet_manager.cc:1403] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4: Time spent bootstrapping tablet: real 0.137s	user 0.007s	sys 0.007s
I20260709 12:58:22.848692  1768 raft_consensus.cc:359] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:22.849828  1768 raft_consensus.cc:385] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:22.850507  1768 raft_consensus.cc:740] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Initialized, Role: FOLLOWER
I20260709 12:58:22.850656  1765 raft_consensus.cc:359] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:22.851414  1765 raft_consensus.cc:385] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:22.851194  1768 consensus_queue.cc:260] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:22.851709  1765 raft_consensus.cc:740] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Initialized, Role: FOLLOWER
I20260709 12:58:22.854482  1768 ts_tablet_manager.cc:1434] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:58:22.855489  1768 tablet_bootstrap.cc:492] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e: Bootstrap starting.
I20260709 12:58:22.855829  1767 tablet_bootstrap.cc:654] T cfe7eb675393487f87b528a12f16e16e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:22.862715  1768 tablet_bootstrap.cc:654] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:22.852423  1765 consensus_queue.cc:260] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:22.869217  1768 tablet_bootstrap.cc:492] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e: No bootstrap required, opened a new log
I20260709 12:58:22.869675  1768 ts_tablet_manager.cc:1403] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e: Time spent bootstrapping tablet: real 0.014s	user 0.013s	sys 0.000s
I20260709 12:58:22.871273  1765 ts_tablet_manager.cc:1434] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 12:58:22.872331  1768 raft_consensus.cc:359] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:22.873131  1768 raft_consensus.cc:385] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:22.873422  1768 raft_consensus.cc:740] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Initialized, Role: FOLLOWER
I20260709 12:58:22.874276  1765 tablet_bootstrap.cc:492] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4: Bootstrap starting.
I20260709 12:58:22.874152  1768 consensus_queue.cc:260] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:22.880648  1768 ts_tablet_manager.cc:1434] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:58:22.882007  1768 tablet_bootstrap.cc:492] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e: Bootstrap starting.
I20260709 12:58:22.885010  1767 tablet_bootstrap.cc:492] T cfe7eb675393487f87b528a12f16e16e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: No bootstrap required, opened a new log
I20260709 12:58:22.885546  1767 ts_tablet_manager.cc:1403] T cfe7eb675393487f87b528a12f16e16e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent bootstrapping tablet: real 0.057s	user 0.007s	sys 0.005s
I20260709 12:58:22.887542  2103 consensus_queue.cc:1048] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:22.888342  1767 raft_consensus.cc:359] T cfe7eb675393487f87b528a12f16e16e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:22.889097  1767 raft_consensus.cc:385] T cfe7eb675393487f87b528a12f16e16e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:22.889379  1767 raft_consensus.cc:740] T cfe7eb675393487f87b528a12f16e16e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Initialized, Role: FOLLOWER
I20260709 12:58:22.890027  1767 consensus_queue.cc:260] T cfe7eb675393487f87b528a12f16e16e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:22.893587  1767 ts_tablet_manager.cc:1434] T cfe7eb675393487f87b528a12f16e16e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:58:22.893592  1768 tablet_bootstrap.cc:654] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:22.898193  2037 raft_consensus.cc:493] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:22.898906  2037 raft_consensus.cc:515] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:22.901051  1767 tablet_bootstrap.cc:492] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Bootstrap starting.
I20260709 12:58:22.903394  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:22.903656  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:22.904132  1722 raft_consensus.cc:2468] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 0.
I20260709 12:58:22.904295  1650 raft_consensus.cc:2468] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 0.
I20260709 12:58:22.906019  1539 leader_election.cc:304] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:58:22.906780  1768 tablet_bootstrap.cc:492] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e: No bootstrap required, opened a new log
I20260709 12:58:22.907758  1768 ts_tablet_manager.cc:1403] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.000s
I20260709 12:58:22.907817  2077 raft_consensus.cc:2804] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:22.908272  2077 raft_consensus.cc:493] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:22.908710  2077 raft_consensus.cc:3060] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:22.909627  1767 tablet_bootstrap.cc:654] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:22.910988  1768 raft_consensus.cc:359] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:22.911840  1768 raft_consensus.cc:385] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:22.912596  1768 raft_consensus.cc:740] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Initialized, Role: FOLLOWER
I20260709 12:58:22.913415  2103 raft_consensus.cc:493] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:22.913311  1768 consensus_queue.cc:260] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:22.913869  2103 raft_consensus.cc:515] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:22.918696  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 12:58:22.920403  1615 leader_election.cc:343] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:22.922227  1768 ts_tablet_manager.cc:1434] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.003s
I20260709 12:58:22.922240  2037 leader_election.cc:290] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:22.922326  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:22.923346  1768 tablet_bootstrap.cc:492] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e: Bootstrap starting.
W20260709 12:58:22.924324  1617 leader_election.cc:343] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:22.924800  1617 leader_election.cc:304] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:22.925510  2102 raft_consensus.cc:2749] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:22.927533  1767 tablet_bootstrap.cc:492] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: No bootstrap required, opened a new log
I20260709 12:58:22.928088  1767 ts_tablet_manager.cc:1403] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent bootstrapping tablet: real 0.027s	user 0.006s	sys 0.012s
I20260709 12:58:22.930414  1768 tablet_bootstrap.cc:654] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:22.930155  2077 raft_consensus.cc:515] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:22.931397  2103 leader_election.cc:290] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:22.933449  2077 leader_election.cc:290] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:22.934049  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:22.938872  1767 raft_consensus.cc:359] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:22.940917  1767 raft_consensus.cc:385] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:22.940958  1650 raft_consensus.cc:3060] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:22.941438  1767 raft_consensus.cc:740] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Initialized, Role: FOLLOWER
I20260709 12:58:22.942073  1767 consensus_queue.cc:260] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:22.944540  1767 ts_tablet_manager.cc:1434] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:58:22.945390  1765 tablet_bootstrap.cc:654] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:22.945562  1767 tablet_bootstrap.cc:492] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Bootstrap starting.
I20260709 12:58:22.948551  2103 raft_consensus.cc:493] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:22.949651  2103 raft_consensus.cc:515] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:22.953022  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:22.953624  1574 raft_consensus.cc:2468] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 0.
I20260709 12:58:22.955621  1768 tablet_bootstrap.cc:492] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e: No bootstrap required, opened a new log
I20260709 12:58:22.956123  1768 ts_tablet_manager.cc:1403] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.007s
I20260709 12:58:22.959048  1768 raft_consensus.cc:359] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:22.959776  1768 raft_consensus.cc:385] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:22.960054  1768 raft_consensus.cc:740] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Initialized, Role: FOLLOWER
I20260709 12:58:22.961222  2103 leader_election.cc:290] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:22.963896  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:22.964411  1767 tablet_bootstrap.cc:654] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:22.964588  1722 raft_consensus.cc:2468] T 65524f4fe7be481b9f069829076b7dc3 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 0.
I20260709 12:58:22.963631  1615 leader_election.cc:304] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:58:22.966782  1768 consensus_queue.cc:260] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:22.967653  1650 raft_consensus.cc:2468] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 1.
I20260709 12:58:22.967715  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:58:22.968675  1724 raft_consensus.cc:3060] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:22.969496  2093 raft_consensus.cc:2804] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:22.969866  2093 raft_consensus.cc:493] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:22.970206  2093 raft_consensus.cc:3060] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:22.973407  1768 ts_tablet_manager.cc:1434] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e: Time spent starting tablet: real 0.017s	user 0.004s	sys 0.004s
I20260709 12:58:22.974651  1768 tablet_bootstrap.cc:492] T cf2ade0033864199b5ced11fc9b5c6ad P 4dbe7d47a2374afca075d3a98583b49e: Bootstrap starting.
I20260709 12:58:22.969002  1539 leader_election.cc:304] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:58:22.980542  1765 tablet_bootstrap.cc:492] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4: No bootstrap required, opened a new log
I20260709 12:58:22.981068  1765 ts_tablet_manager.cc:1403] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4: Time spent bootstrapping tablet: real 0.107s	user 0.014s	sys 0.005s
I20260709 12:58:22.984267  1767 tablet_bootstrap.cc:492] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: No bootstrap required, opened a new log
I20260709 12:58:22.985280  1767 ts_tablet_manager.cc:1403] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent bootstrapping tablet: real 0.040s	user 0.013s	sys 0.000s
W20260709 12:58:22.986330  1615 consensus_peers.cc:597] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:22.987206  2115 raft_consensus.cc:2804] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:22.993453  2115 raft_consensus.cc:697] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:58:22.993665  1767 raft_consensus.cc:359] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:22.994397  1767 raft_consensus.cc:385] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:22.994679  1767 raft_consensus.cc:740] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Initialized, Role: FOLLOWER
I20260709 12:58:22.994771  2115 consensus_queue.cc:237] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:22.995383  1767 consensus_queue.cc:260] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:22.997213  1724 raft_consensus.cc:2468] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 1.
I20260709 12:58:22.998046  2079 consensus_queue.cc:1048] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:22.999790  1767 ts_tablet_manager.cc:1434] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:58:23.000824  1767 tablet_bootstrap.cc:492] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Bootstrap starting.
I20260709 12:58:22.987937  1768 tablet_bootstrap.cc:654] T cf2ade0033864199b5ced11fc9b5c6ad P 4dbe7d47a2374afca075d3a98583b49e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:22.988274  2103 raft_consensus.cc:493] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:23.009702  2103 raft_consensus.cc:515] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:23.010793  1767 tablet_bootstrap.cc:654] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:23.002969  2093 raft_consensus.cc:515] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:23.012506  2103 leader_election.cc:290] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:22.990757  1765 raft_consensus.cc:359] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:23.014626  1765 raft_consensus.cc:385] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:23.014946  1765 raft_consensus.cc:740] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Initialized, Role: FOLLOWER
I20260709 12:58:23.015822  1765 consensus_queue.cc:260] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:23.018250  1765 ts_tablet_manager.cc:1434] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260709 12:58:23.019284  1765 tablet_bootstrap.cc:492] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4: Bootstrap starting.
I20260709 12:58:23.025418  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:23.026335  1568 raft_consensus.cc:3060] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:23.026253  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:23.028894  1574 raft_consensus.cc:2468] T cfe7eb675393487f87b528a12f16e16e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 0.
I20260709 12:58:23.029743  1765 tablet_bootstrap.cc:654] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:23.031430  1615 leader_election.cc:304] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:58:23.034123  1824 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:23.034518  2103 raft_consensus.cc:2804] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:23.034979  2103 raft_consensus.cc:493] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:23.035502  2103 raft_consensus.cc:3060] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:23.036113  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:23.036811  1722 raft_consensus.cc:2468] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 0.
I20260709 12:58:23.034868  1824 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:23.042701  1824 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:23.043982  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:23.044770  2093 leader_election.cc:290] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:23.044958  1648 raft_consensus.cc:2468] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 0.
I20260709 12:58:23.047241  2103 raft_consensus.cc:515] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:23.048985  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:23.047613  1688 leader_election.cc:304] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:58:23.051906  2103 leader_election.cc:290] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:23.055940  1824 raft_consensus.cc:2804] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:23.057114  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:58:23.061160  2115 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:23.061479  1824 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:23.061676  1722 raft_consensus.cc:3060] T 65524f4fe7be481b9f069829076b7dc3 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:23.061909  1824 raft_consensus.cc:3060] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:23.061705  2115 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:23.064425  1567 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:23.066931  1568 raft_consensus.cc:2468] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 1.
I20260709 12:58:23.068504  1615 leader_election.cc:304] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:58:23.070268  2103 raft_consensus.cc:2804] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:23.070784  2103 raft_consensus.cc:697] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:58:23.072099  2115 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:23.058444  1768 tablet_bootstrap.cc:492] T cf2ade0033864199b5ced11fc9b5c6ad P 4dbe7d47a2374afca075d3a98583b49e: No bootstrap required, opened a new log
I20260709 12:58:23.059644  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:23.071693  2103 consensus_queue.cc:237] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:23.072816  1574 raft_consensus.cc:3060] T cfe7eb675393487f87b528a12f16e16e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:23.072816  1768 ts_tablet_manager.cc:1403] T cf2ade0033864199b5ced11fc9b5c6ad P 4dbe7d47a2374afca075d3a98583b49e: Time spent bootstrapping tablet: real 0.098s	user 0.023s	sys 0.015s
W20260709 12:58:23.076164  1689 leader_election.cc:343] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:23.074466  1722 raft_consensus.cc:2468] T 65524f4fe7be481b9f069829076b7dc3 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 1.
I20260709 12:58:23.078807  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:23.082152  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:58:23.082815  1719 raft_consensus.cc:3060] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:23.082755  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:23.085361  1824 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:23.089737  1824 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:23.090672  2100 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:23.091322  2100 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:23.092303  1472 catalog_manager.cc:5697] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:23.100565  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:23.101215  1648 raft_consensus.cc:3060] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:23.106128  2100 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:23.107313  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 12:58:23.110208  1615 leader_election.cc:343] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:23.113605  1648 raft_consensus.cc:2468] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 1.
I20260709 12:58:23.114873  1688 leader_election.cc:304] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:58:23.115717  1824 raft_consensus.cc:2804] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:23.116163  1768 raft_consensus.cc:359] T cf2ade0033864199b5ced11fc9b5c6ad P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:23.117002  1768 raft_consensus.cc:385] T cf2ade0033864199b5ced11fc9b5c6ad P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:23.116178  1824 raft_consensus.cc:697] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:58:23.117671  1768 raft_consensus.cc:740] T cf2ade0033864199b5ced11fc9b5c6ad P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Initialized, Role: FOLLOWER
I20260709 12:58:23.118119  1824 consensus_queue.cc:237] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:23.118548  1768 consensus_queue.cc:260] T cf2ade0033864199b5ced11fc9b5c6ad P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:23.122908  1539 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:58:23.123452  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:23.124490  2115 raft_consensus.cc:2749] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:23.127283  1719 raft_consensus.cc:2468] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 1.
W20260709 12:58:23.134045  1689 leader_election.cc:343] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:23.136606  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:23.138332  1617 leader_election.cc:304] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:58:23.141911  2092 raft_consensus.cc:2804] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:58:23.141181  1617 leader_election.cc:343] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:23.146693  2073 consensus_queue.cc:1048] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:23.150044  2092 raft_consensus.cc:697] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:58:23.151357  2092 consensus_queue.cc:237] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:23.145255  1617 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:23.159948  1768 ts_tablet_manager.cc:1434] T cf2ade0033864199b5ced11fc9b5c6ad P 4dbe7d47a2374afca075d3a98583b49e: Time spent starting tablet: real 0.085s	user 0.007s	sys 0.001s
I20260709 12:58:23.167598  1765 tablet_bootstrap.cc:492] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4: No bootstrap required, opened a new log
I20260709 12:58:23.168083  1765 ts_tablet_manager.cc:1403] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4: Time spent bootstrapping tablet: real 0.149s	user 0.027s	sys 0.021s
I20260709 12:58:23.159598  2103 raft_consensus.cc:2749] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:23.176946  1765 raft_consensus.cc:359] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:23.177610  1765 raft_consensus.cc:385] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:23.177874  1765 raft_consensus.cc:740] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Initialized, Role: FOLLOWER
I20260709 12:58:23.178472  1765 consensus_queue.cc:260] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:23.181810  1574 raft_consensus.cc:2468] T cfe7eb675393487f87b528a12f16e16e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 1.
I20260709 12:58:23.182844  1767 tablet_bootstrap.cc:492] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226: No bootstrap required, opened a new log
I20260709 12:58:23.183334  1767 ts_tablet_manager.cc:1403] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent bootstrapping tablet: real 0.183s	user 0.022s	sys 0.018s
I20260709 12:58:23.186383  1767 raft_consensus.cc:359] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:23.187117  1767 raft_consensus.cc:385] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:23.187408  1767 raft_consensus.cc:740] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Initialized, Role: FOLLOWER
I20260709 12:58:23.193010  1765 ts_tablet_manager.cc:1434] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4: Time spent starting tablet: real 0.025s	user 0.003s	sys 0.003s
I20260709 12:58:23.196676  1767 consensus_queue.cc:260] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:23.198518  1765 tablet_bootstrap.cc:492] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4: Bootstrap starting.
I20260709 12:58:23.199335  1768 tablet_bootstrap.cc:492] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e: Bootstrap starting.
I20260709 12:58:23.199630  1767 ts_tablet_manager.cc:1434] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
I20260709 12:58:23.191665  1834 consensus_queue.cc:1048] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
I20260709 12:58:23.212126  1471 catalog_manager.cc:5697] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:23.214260  1767 tablet_bootstrap.cc:492] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Bootstrap starting.
I20260709 12:58:23.213268  1472 catalog_manager.cc:5697] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 0 to 1, leader changed from <none> to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:23.238219  1834 consensus_queue.cc:1048] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:23.243866  1768 tablet_bootstrap.cc:654] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:23.245380  1767 tablet_bootstrap.cc:654] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:23.248939  1765 tablet_bootstrap.cc:654] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:23.265774  1472 catalog_manager.cc:5697] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 0 to 1, leader changed from <none> to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:23.294801  1768 tablet_bootstrap.cc:492] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e: No bootstrap required, opened a new log
I20260709 12:58:23.295362  1768 ts_tablet_manager.cc:1403] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e: Time spent bootstrapping tablet: real 0.096s	user 0.030s	sys 0.012s
I20260709 12:58:23.298211  1768 raft_consensus.cc:359] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:23.298993  1768 raft_consensus.cc:385] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:23.299283  1768 raft_consensus.cc:740] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Initialized, Role: FOLLOWER
I20260709 12:58:23.301604  1765 tablet_bootstrap.cc:492] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4: No bootstrap required, opened a new log
I20260709 12:58:23.302172  1765 ts_tablet_manager.cc:1403] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4: Time spent bootstrapping tablet: real 0.104s	user 0.011s	sys 0.007s
I20260709 12:58:23.306799  2115 raft_consensus.cc:493] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:23.307686  2115 raft_consensus.cc:515] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:23.307893  1765 raft_consensus.cc:359] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:23.308943  1765 raft_consensus.cc:385] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:23.309284  1765 raft_consensus.cc:740] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Initialized, Role: FOLLOWER
I20260709 12:58:23.309769  2115 leader_election.cc:290] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:23.311172  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:23.311748  1648 raft_consensus.cc:2468] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 0.
I20260709 12:58:23.312778  1768 consensus_queue.cc:260] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:23.312796  1539 leader_election.cc:304] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:58:23.309994  1765 consensus_queue.cc:260] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:23.310981  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:23.315539  1768 ts_tablet_manager.cc:1434] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.006s
I20260709 12:58:23.315943  2115 raft_consensus.cc:2804] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:58:23.316347  1542 leader_election.cc:343] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:23.316617  1768 tablet_bootstrap.cc:492] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e: Bootstrap starting.
I20260709 12:58:23.316375  2115 raft_consensus.cc:493] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:23.317098  2115 raft_consensus.cc:3060] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:23.324100  1768 tablet_bootstrap.cc:654] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:23.314389  1767 tablet_bootstrap.cc:492] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226: No bootstrap required, opened a new log
I20260709 12:58:23.330715  1767 ts_tablet_manager.cc:1403] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent bootstrapping tablet: real 0.117s	user 0.018s	sys 0.005s
I20260709 12:58:23.334535  1765 ts_tablet_manager.cc:1434] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4: Time spent starting tablet: real 0.023s	user 0.002s	sys 0.004s
I20260709 12:58:23.335690  1765 tablet_bootstrap.cc:492] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4: Bootstrap starting.
I20260709 12:58:23.328240  2115 raft_consensus.cc:515] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:23.339332  2115 leader_election.cc:290] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:23.336889  1767 raft_consensus.cc:359] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:23.340011  1767 raft_consensus.cc:385] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:23.339933  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:23.340443  1767 raft_consensus.cc:740] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Initialized, Role: FOLLOWER
I20260709 12:58:23.340678  1648 raft_consensus.cc:3060] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:23.341215  1767 consensus_queue.cc:260] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:23.347046  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 12:58:23.348621  1542 leader_election.cc:343] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:23.349428  1767 ts_tablet_manager.cc:1434] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.002s
I20260709 12:58:23.350553  1767 tablet_bootstrap.cc:492] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Bootstrap starting.
I20260709 12:58:23.352421  1648 raft_consensus.cc:2468] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 1.
I20260709 12:58:23.360062  1539 leader_election.cc:304] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 12:58:23.362162  2075 raft_consensus.cc:493] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:23.362663  2075 raft_consensus.cc:515] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:23.364733  2037 raft_consensus.cc:2804] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:23.365051  2075 leader_election.cc:290] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:23.365329  2037 raft_consensus.cc:697] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:58:23.366329  2037 consensus_queue.cc:237] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:23.368490  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:23.369263  1646 raft_consensus.cc:2468] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 0.
I20260709 12:58:23.371167  1688 leader_election.cc:304] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:58:23.372946  2075 raft_consensus.cc:2804] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:23.374266  2075 raft_consensus.cc:493] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:23.374719  2075 raft_consensus.cc:3060] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:23.375265  1768 tablet_bootstrap.cc:492] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e: No bootstrap required, opened a new log
I20260709 12:58:23.373689  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:23.375799  1768 ts_tablet_manager.cc:1403] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e: Time spent bootstrapping tablet: real 0.059s	user 0.008s	sys 0.008s
W20260709 12:58:23.376710  1689 leader_election.cc:343] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:23.381456  1768 raft_consensus.cc:359] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:23.382182  1768 raft_consensus.cc:385] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:23.382476  1768 raft_consensus.cc:740] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Initialized, Role: FOLLOWER
I20260709 12:58:23.383508  1765 tablet_bootstrap.cc:654] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:23.386255  2075 raft_consensus.cc:515] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:23.392737  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 12:58:23.395437  1689 leader_election.cc:343] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:23.398015  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:23.398835  1648 raft_consensus.cc:3060] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:23.405251  2115 consensus_queue.cc:1048] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:23.403911  1473 catalog_manager.cc:5697] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:23.413761  1768 consensus_queue.cc:260] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:23.415709  1767 tablet_bootstrap.cc:654] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:23.420696  1768 ts_tablet_manager.cc:1434] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e: Time spent starting tablet: real 0.045s	user 0.009s	sys 0.000s
I20260709 12:58:23.423652  1768 tablet_bootstrap.cc:492] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e: Bootstrap starting.
I20260709 12:58:23.429543  2037 consensus_queue.cc:1048] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:23.431875  1768 tablet_bootstrap.cc:654] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:23.442191  1648 raft_consensus.cc:2468] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 1.
I20260709 12:58:23.448644  2075 leader_election.cc:290] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:23.458137  1765 tablet_bootstrap.cc:492] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4: No bootstrap required, opened a new log
I20260709 12:58:23.461961  1767 tablet_bootstrap.cc:492] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226: No bootstrap required, opened a new log
I20260709 12:58:23.504415  1765 ts_tablet_manager.cc:1403] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4: Time spent bootstrapping tablet: real 0.169s	user 0.022s	sys 0.022s
I20260709 12:58:23.504824  1688 leader_election.cc:304] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:23.504485  1767 ts_tablet_manager.cc:1403] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent bootstrapping tablet: real 0.154s	user 0.012s	sys 0.000s
I20260709 12:58:23.506422  2075 raft_consensus.cc:2804] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:23.506910  2075 raft_consensus.cc:697] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:58:23.507725  2075 consensus_queue.cc:237] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:23.508248  1767 raft_consensus.cc:359] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:23.508955  1767 raft_consensus.cc:385] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:23.509235  1767 raft_consensus.cc:740] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Initialized, Role: FOLLOWER
I20260709 12:58:23.509874  1767 consensus_queue.cc:260] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:23.511808  1765 raft_consensus.cc:359] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:23.512962  1765 raft_consensus.cc:385] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:23.513229  1765 raft_consensus.cc:740] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Initialized, Role: FOLLOWER
I20260709 12:58:23.513969  1765 consensus_queue.cc:260] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:23.516295  1765 ts_tablet_manager.cc:1434] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:58:23.517221  1765 tablet_bootstrap.cc:492] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4: Bootstrap starting.
I20260709 12:58:23.517834  1768 tablet_bootstrap.cc:492] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e: No bootstrap required, opened a new log
I20260709 12:58:23.518235  1768 ts_tablet_manager.cc:1403] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e: Time spent bootstrapping tablet: real 0.095s	user 0.021s	sys 0.019s
I20260709 12:58:23.521328  1767 ts_tablet_manager.cc:1434] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:58:23.522553  1767 tablet_bootstrap.cc:492] T d5eec36d47dc40c5a83cc72207d9c310 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Bootstrap starting.
I20260709 12:58:23.520385  1768 raft_consensus.cc:359] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:23.525310  1768 raft_consensus.cc:385] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:23.525599  1768 raft_consensus.cc:740] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Initialized, Role: FOLLOWER
I20260709 12:58:23.526288  1768 consensus_queue.cc:260] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:23.528378  1768 ts_tablet_manager.cc:1434] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 12:58:23.530803  1767 tablet_bootstrap.cc:654] T d5eec36d47dc40c5a83cc72207d9c310 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:23.536350  1768 tablet_bootstrap.cc:492] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e: Bootstrap starting.
I20260709 12:58:23.543144  1824 raft_consensus.cc:493] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:23.543807  1824 raft_consensus.cc:515] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:23.546829  1767 tablet_bootstrap.cc:492] T d5eec36d47dc40c5a83cc72207d9c310 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: No bootstrap required, opened a new log
I20260709 12:58:23.547341  1767 ts_tablet_manager.cc:1403] T d5eec36d47dc40c5a83cc72207d9c310 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.006s
I20260709 12:58:23.547017  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:23.547814  1648 raft_consensus.cc:2468] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 0.
I20260709 12:58:23.547091  1473 catalog_manager.cc:5697] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:23.549047  1688 leader_election.cc:304] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:58:23.549799  2075 raft_consensus.cc:2804] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:23.550177  2075 raft_consensus.cc:493] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:23.550508  2075 raft_consensus.cc:3060] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:23.550824  1767 raft_consensus.cc:359] T d5eec36d47dc40c5a83cc72207d9c310 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:23.551524  1767 raft_consensus.cc:385] T d5eec36d47dc40c5a83cc72207d9c310 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:23.551772  1767 raft_consensus.cc:740] T d5eec36d47dc40c5a83cc72207d9c310 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Initialized, Role: FOLLOWER
I20260709 12:58:23.556056  1768 tablet_bootstrap.cc:654] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:23.556149  1765 tablet_bootstrap.cc:654] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:23.557796  1824 leader_election.cc:290] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:23.561822  2103 raft_consensus.cc:493] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:23.562294  2103 raft_consensus.cc:515] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:23.563220  1767 consensus_queue.cc:260] T d5eec36d47dc40c5a83cc72207d9c310 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:23.564119  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:23.564508  2075 raft_consensus.cc:515] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:23.565795  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:23.564302  2103 leader_election.cc:290] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:23.566717  2075 leader_election.cc:290] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 12:58:23.567618  1617 leader_election.cc:343] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:23.567713  1689 leader_election.cc:343] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:23.567773  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:23.566738  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:23.568954  1648 raft_consensus.cc:3060] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:23.569185  1615 leader_election.cc:343] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:23.569597  1615 leader_election.cc:304] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:23.570827  2092 raft_consensus.cc:2749] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:23.569526  1767 ts_tablet_manager.cc:1434] T d5eec36d47dc40c5a83cc72207d9c310 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent starting tablet: real 0.022s	user 0.008s	sys 0.001s
I20260709 12:58:23.573626  1767 tablet_bootstrap.cc:492] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Bootstrap starting.
I20260709 12:58:23.582316  1767 tablet_bootstrap.cc:654] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:23.582348  2103 consensus_queue.cc:1048] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:58:23.584718  2037 raft_consensus.cc:493] T d5eec36d47dc40c5a83cc72207d9c310 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:23.585386  2037 raft_consensus.cc:515] T d5eec36d47dc40c5a83cc72207d9c310 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:23.590541  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:23.592971  2037 leader_election.cc:290] T d5eec36d47dc40c5a83cc72207d9c310 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:23.593533  1834 consensus_queue.cc:1048] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:23.600095  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:23.614369  2103 raft_consensus.cc:493] T cf2ade0033864199b5ced11fc9b5c6ad P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:23.615185  2103 raft_consensus.cc:515] T cf2ade0033864199b5ced11fc9b5c6ad P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:23.622816  2103 leader_election.cc:290] T cf2ade0033864199b5ced11fc9b5c6ad P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:23.623078  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:23.619362  1648 raft_consensus.cc:2468] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 1.
W20260709 12:58:23.668753  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 49432.1us
W20260709 12:58:23.677727  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 53166.8us
W20260709 12:58:23.678527  1689 leader_election.cc:343] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:23.680301  1767 tablet_bootstrap.cc:492] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: No bootstrap required, opened a new log
I20260709 12:58:23.680794  1767 ts_tablet_manager.cc:1403] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent bootstrapping tablet: real 0.107s	user 0.012s	sys 0.010s
I20260709 12:58:23.680794  1768 tablet_bootstrap.cc:492] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e: No bootstrap required, opened a new log
I20260709 12:58:23.682005  1768 ts_tablet_manager.cc:1403] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e: Time spent bootstrapping tablet: real 0.146s	user 0.019s	sys 0.022s
I20260709 12:58:23.687597  1542 leader_election.cc:304] T d5eec36d47dc40c5a83cc72207d9c310 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:58:23.690639  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:23.686133  2037 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:23.689368  2077 raft_consensus.cc:2749] T d5eec36d47dc40c5a83cc72207d9c310 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:23.696956  2037 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:23.698737  1767 raft_consensus.cc:359] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:23.699414  1767 raft_consensus.cc:385] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:23.699680  1767 raft_consensus.cc:740] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Initialized, Role: FOLLOWER
I20260709 12:58:23.700282  1767 consensus_queue.cc:260] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:23.702787  1688 leader_election.cc:304] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 12:58:23.705247  1617 leader_election.cc:343] T cf2ade0033864199b5ced11fc9b5c6ad P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:23.707010  1765 tablet_bootstrap.cc:492] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4: No bootstrap required, opened a new log
I20260709 12:58:23.707477  1765 ts_tablet_manager.cc:1403] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4: Time spent bootstrapping tablet: real 0.190s	user 0.031s	sys 0.009s
I20260709 12:58:23.707418  2081 raft_consensus.cc:2804] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:23.707594  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:23.708719  2081 raft_consensus.cc:697] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:58:23.708854  2037 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:23.711347  1767 ts_tablet_manager.cc:1434] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.001s
W20260709 12:58:23.711849  1689 consensus_peers.cc:597] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:23.716566  1765 raft_consensus.cc:359] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:23.717268  1765 raft_consensus.cc:385] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:23.717563  1765 raft_consensus.cc:740] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Initialized, Role: FOLLOWER
I20260709 12:58:23.724406  1767 tablet_bootstrap.cc:492] T df63a7a2acf448379066cf6e352a511e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Bootstrap starting.
I20260709 12:58:23.725647  1765 consensus_queue.cc:260] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:58:23.719270  1615 leader_election.cc:343] T cf2ade0033864199b5ced11fc9b5c6ad P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:23.727008  1615 leader_election.cc:304] T cf2ade0033864199b5ced11fc9b5c6ad P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:23.728066  1834 raft_consensus.cc:2749] T cf2ade0033864199b5ced11fc9b5c6ad P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:23.727267  2093 consensus_queue.cc:1048] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:58:23.735685  2075 consensus_queue.cc:1048] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:23.735970  1765 ts_tablet_manager.cc:1434] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.002s
I20260709 12:58:23.724900  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:23.731379  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:23.709602  2081 consensus_queue.cc:237] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:23.747632  1768 raft_consensus.cc:359] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:58:23.750831  1539 leader_election.cc:343] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:23.751910  1542 leader_election.cc:343] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:23.752347  1542 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:58:23.752414  2093 raft_consensus.cc:493] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:23.748374  1768 raft_consensus.cc:385] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:58:23.745069  1521 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:23.757485  1768 raft_consensus.cc:740] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Initialized, Role: FOLLOWER
I20260709 12:58:23.756767  2077 raft_consensus.cc:493] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:23.763739  2077 raft_consensus.cc:515] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:23.765651  1765 tablet_bootstrap.cc:492] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4: Bootstrap starting.
I20260709 12:58:23.765908  2077 leader_election.cc:290] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:23.756999  2037 raft_consensus.cc:2749] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:23.767640  2093 raft_consensus.cc:515] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:23.770881  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:23.771456  1647 raft_consensus.cc:2468] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 0.
I20260709 12:58:23.773022  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:23.773784  1723 raft_consensus.cc:2468] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 0.
I20260709 12:58:23.773842  1539 leader_election.cc:304] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:58:23.789021  2037 raft_consensus.cc:2804] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:23.789474  2037 raft_consensus.cc:493] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:23.789842  2037 raft_consensus.cc:3060] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:23.840019  1767 tablet_bootstrap.cc:654] T df63a7a2acf448379066cf6e352a511e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Neither blocks nor log segments found. Creating new log.
W20260709 12:58:23.822875  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 47091.7us
I20260709 12:58:23.836263  1768 consensus_queue.cc:260] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:23.803861  2115 raft_consensus.cc:493] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:23.860997  2115 raft_consensus.cc:515] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:23.796026  2077 consensus_queue.cc:1048] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.085s
I20260709 12:58:23.866645  2092 raft_consensus.cc:493] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:23.884950  1768 ts_tablet_manager.cc:1434] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e: Time spent starting tablet: real 0.203s	user 0.008s	sys 0.000s
I20260709 12:58:23.894830  2092 raft_consensus.cc:515] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:23.903239  2092 leader_election.cc:290] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:23.911520  2093 leader_election.cc:290] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:23.918648  1768 tablet_bootstrap.cc:492] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e: Bootstrap starting.
I20260709 12:58:23.931371  1824 raft_consensus.cc:493] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:23.931869  1824 raft_consensus.cc:515] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:23.941677  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:23.951328  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:23.956307  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:23.966334  2037 raft_consensus.cc:515] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:24.003068  1834 consensus_queue.cc:1048] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:24.014376  1824 leader_election.cc:290] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:24.018239  1767 tablet_bootstrap.cc:492] T df63a7a2acf448379066cf6e352a511e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: No bootstrap required, opened a new log
W20260709 12:58:23.977665  1617 leader_election.cc:343] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:24.018002  1473 catalog_manager.cc:5697] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:24.018743  1767 ts_tablet_manager.cc:1403] T df63a7a2acf448379066cf6e352a511e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent bootstrapping tablet: real 0.303s	user 0.027s	sys 0.011s
W20260709 12:58:24.018857  1615 leader_election.cc:343] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:24.019026  1617 leader_election.cc:343] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:24.021123  1576 raft_consensus.cc:3060] T d5eec36d47dc40c5a83cc72207d9c310 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:24.024889  1615 leader_election.cc:304] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:24.013906  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:24.015739  2115 leader_election.cc:290] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:58:24.032805  1542 consensus_peers.cc:597] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 -> Peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Couldn't send request to peer 0c7751452c4b46afa95251b9df7169d4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:24.015765  2037 leader_election.cc:290] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:24.035508  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:24.041230  1765 tablet_bootstrap.cc:654] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.024397  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 12:58:24.051579  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 58568.2us
I20260709 12:58:24.043865  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:24.052925  1725 raft_consensus.cc:2468] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 0.
I20260709 12:58:24.034024  2092 raft_consensus.cc:2749] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:24.049571  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 12:58:24.064138  1539 leader_election.cc:343] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:24.057081  1569 raft_consensus.cc:2468] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 0.
I20260709 12:58:24.067687  1721 raft_consensus.cc:3060] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:24.069686  1689 leader_election.cc:304] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:58:24.074041  1767 raft_consensus.cc:359] T df63a7a2acf448379066cf6e352a511e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:24.074810  1767 raft_consensus.cc:385] T df63a7a2acf448379066cf6e352a511e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.075117  1767 raft_consensus.cc:740] T df63a7a2acf448379066cf6e352a511e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.076857  1767 consensus_queue.cc:260] T df63a7a2acf448379066cf6e352a511e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:24.080539  2075 raft_consensus.cc:2804] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:24.080912  2075 raft_consensus.cc:493] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:24.081570  2075 raft_consensus.cc:3060] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:24.083382  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:24.083963  1649 raft_consensus.cc:3060] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:24.085152  1615 leader_election.cc:343] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:24.086972  1615 leader_election.cc:304] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:24.089571  1768 tablet_bootstrap.cc:654] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.093935  1767 ts_tablet_manager.cc:1434] T df63a7a2acf448379066cf6e352a511e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent starting tablet: real 0.075s	user 0.008s	sys 0.000s
I20260709 12:58:24.088724  2093 raft_consensus.cc:2749] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:24.102398  1649 raft_consensus.cc:2468] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 1.
I20260709 12:58:24.105499  1539 leader_election.cc:304] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:58:24.106825  2152 raft_consensus.cc:2804] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:24.107196  1721 raft_consensus.cc:2468] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 1.
I20260709 12:58:24.107542  2152 raft_consensus.cc:697] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:58:24.107484  2075 raft_consensus.cc:515] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:24.110189  2075 leader_election.cc:290] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:24.108678  2152 consensus_queue.cc:237] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:24.127437  1767 tablet_bootstrap.cc:492] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Bootstrap starting.
I20260709 12:58:24.132784  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:58:24.136474  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 66882.2us
I20260709 12:58:24.140162  1542 leader_election.cc:304] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:58:24.150542  1575 raft_consensus.cc:3060] T df63a7a2acf448379066cf6e352a511e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:24.151355  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:24.160734  2155 raft_consensus.cc:2804] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:24.163054  2155 raft_consensus.cc:493] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:24.163522  2155 raft_consensus.cc:3060] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:24.173897  2159 consensus_queue.cc:1048] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:24.186496  1765 tablet_bootstrap.cc:492] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4: No bootstrap required, opened a new log
I20260709 12:58:24.187009  1765 ts_tablet_manager.cc:1403] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4: Time spent bootstrapping tablet: real 0.429s	user 0.009s	sys 0.025s
I20260709 12:58:24.187321  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
W20260709 12:58:24.192281  1688 leader_election.cc:343] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:24.192421  1765 raft_consensus.cc:359] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:58:24.194278  1688 leader_election.cc:343] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:24.194604  1956 consensus_queue.cc:1048] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:24.193420  1765 raft_consensus.cc:385] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.196342  2093 raft_consensus.cc:493] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.196892  2093 raft_consensus.cc:515] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:24.196543  1765 raft_consensus.cc:740] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.217336  2093 leader_election.cc:290] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:24.218866  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 12:58:24.221220  1615 leader_election.cc:343] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:24.229090  1765 consensus_queue.cc:260] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:24.236554  1767 tablet_bootstrap.cc:654] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.238902  1768 tablet_bootstrap.cc:492] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e: No bootstrap required, opened a new log
I20260709 12:58:24.239418  1768 ts_tablet_manager.cc:1403] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e: Time spent bootstrapping tablet: real 0.321s	user 0.015s	sys 0.008s
I20260709 12:58:24.240664  2155 raft_consensus.cc:515] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:24.241734  1765 ts_tablet_manager.cc:1434] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.000s
I20260709 12:58:24.243256  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:24.243628  1570 raft_consensus.cc:2393] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 1: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:58:24.244299  1768 raft_consensus.cc:359] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:24.245198  1768 raft_consensus.cc:385] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.245561  1768 raft_consensus.cc:740] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.246346  1768 consensus_queue.cc:260] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:24.247545  2155 leader_election.cc:290] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:24.247727  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:24.248204  1768 ts_tablet_manager.cc:1434] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:58:24.249497  1768 tablet_bootstrap.cc:492] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e: Bootstrap starting.
I20260709 12:58:24.248262  1646 raft_consensus.cc:3060] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:24.252826  1765 tablet_bootstrap.cc:492] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4: Bootstrap starting.
I20260709 12:58:24.255934  1689 leader_election.cc:304] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:24.256754  2165 raft_consensus.cc:2749] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:58:24.258410  2159 consensus_queue.cc:1048] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:24.258141  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:58:24.260746  1719 raft_consensus.cc:2393] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 1: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:58:24.237450  1473 catalog_manager.cc:5697] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:24.264838  1765 tablet_bootstrap.cc:654] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4: Neither blocks nor log segments found. Creating new log.
W20260709 12:58:24.270396  1617 leader_election.cc:343] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:24.270970  1617 leader_election.cc:304] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:24.272395  2093 raft_consensus.cc:2749] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:24.307339  1646 raft_consensus.cc:2468] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 1.
W20260709 12:58:24.307664  1689 consensus_peers.cc:597] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:24.313345  1539 leader_election.cc:304] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 12:58:24.320163  2156 raft_consensus.cc:2804] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:24.327039  2156 raft_consensus.cc:697] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:58:24.328621  1765 tablet_bootstrap.cc:492] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4: No bootstrap required, opened a new log
I20260709 12:58:24.329085  1765 ts_tablet_manager.cc:1403] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4: Time spent bootstrapping tablet: real 0.076s	user 0.016s	sys 0.008s
I20260709 12:58:24.330189  1768 tablet_bootstrap.cc:654] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.328452  2156 consensus_queue.cc:237] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:24.334537  1767 tablet_bootstrap.cc:492] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: No bootstrap required, opened a new log
I20260709 12:58:24.335001  1767 ts_tablet_manager.cc:1403] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent bootstrapping tablet: real 0.208s	user 0.016s	sys 0.014s
I20260709 12:58:24.337884  1767 raft_consensus.cc:359] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:24.338569  1767 raft_consensus.cc:385] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.338814  1767 raft_consensus.cc:740] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.354384  1765 raft_consensus.cc:359] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:24.358949  1765 raft_consensus.cc:385] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.359304  1765 raft_consensus.cc:740] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.361550  1767 consensus_queue.cc:260] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:24.364974  1767 ts_tablet_manager.cc:1434] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent starting tablet: real 0.030s	user 0.014s	sys 0.009s
I20260709 12:58:24.365595  1765 consensus_queue.cc:260] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:24.369830  1767 tablet_bootstrap.cc:492] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Bootstrap starting.
I20260709 12:58:24.372615  1765 ts_tablet_manager.cc:1434] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.002s
I20260709 12:58:24.370411  1768 tablet_bootstrap.cc:492] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e: No bootstrap required, opened a new log
I20260709 12:58:24.373328  1768 ts_tablet_manager.cc:1403] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e: Time spent bootstrapping tablet: real 0.124s	user 0.006s	sys 0.008s
I20260709 12:58:24.373812  1765 tablet_bootstrap.cc:492] T 725a29842f534310a9c0bb9d5c7892a2 P 0c7751452c4b46afa95251b9df7169d4: Bootstrap starting.
I20260709 12:58:24.382557  1768 raft_consensus.cc:359] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:24.388453  1765 tablet_bootstrap.cc:654] T 725a29842f534310a9c0bb9d5c7892a2 P 0c7751452c4b46afa95251b9df7169d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.389683  1471 catalog_manager.cc:5697] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:24.383301  1768 raft_consensus.cc:385] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.391388  1768 raft_consensus.cc:740] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.414180  1768 consensus_queue.cc:260] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:24.417654  1767 tablet_bootstrap.cc:654] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.433012  2165 raft_consensus.cc:493] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.434418  1768 ts_tablet_manager.cc:1434] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e: Time spent starting tablet: real 0.061s	user 0.004s	sys 0.003s
I20260709 12:58:24.433609  2165 raft_consensus.cc:515] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:24.441753  2165 leader_election.cc:290] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:24.442397  1768 tablet_bootstrap.cc:492] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e: Bootstrap starting.
I20260709 12:58:24.443210  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:24.446508  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:24.451376  1765 tablet_bootstrap.cc:492] T 725a29842f534310a9c0bb9d5c7892a2 P 0c7751452c4b46afa95251b9df7169d4: No bootstrap required, opened a new log
I20260709 12:58:24.451812  1765 ts_tablet_manager.cc:1403] T 725a29842f534310a9c0bb9d5c7892a2 P 0c7751452c4b46afa95251b9df7169d4: Time spent bootstrapping tablet: real 0.078s	user 0.019s	sys 0.028s
I20260709 12:58:24.456166  1689 leader_election.cc:304] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:24.456897  2165 raft_consensus.cc:2749] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:24.459630  1765 raft_consensus.cc:359] T 725a29842f534310a9c0bb9d5c7892a2 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:24.460342  1765 raft_consensus.cc:385] T 725a29842f534310a9c0bb9d5c7892a2 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.460659  1765 raft_consensus.cc:740] T 725a29842f534310a9c0bb9d5c7892a2 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.461580  1768 tablet_bootstrap.cc:654] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.461890  1767 tablet_bootstrap.cc:492] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: No bootstrap required, opened a new log
I20260709 12:58:24.462393  1767 ts_tablet_manager.cc:1403] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent bootstrapping tablet: real 0.093s	user 0.013s	sys 0.002s
I20260709 12:58:24.461313  1765 consensus_queue.cc:260] T 725a29842f534310a9c0bb9d5c7892a2 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:24.467425  1765 ts_tablet_manager.cc:1434] T 725a29842f534310a9c0bb9d5c7892a2 P 0c7751452c4b46afa95251b9df7169d4: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:58:24.468473  1765 tablet_bootstrap.cc:492] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4: Bootstrap starting.
I20260709 12:58:24.470350  1767 raft_consensus.cc:359] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:24.471048  1767 raft_consensus.cc:385] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.471326  1767 raft_consensus.cc:740] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.471961  1767 consensus_queue.cc:260] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:24.483260  1768 tablet_bootstrap.cc:492] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e: No bootstrap required, opened a new log
I20260709 12:58:24.483832  1768 ts_tablet_manager.cc:1403] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e: Time spent bootstrapping tablet: real 0.042s	user 0.008s	sys 0.003s
I20260709 12:58:24.486523  1768 raft_consensus.cc:359] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:24.486989  1767 ts_tablet_manager.cc:1434] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260709 12:58:24.487300  1768 raft_consensus.cc:385] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.487685  1768 raft_consensus.cc:740] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.488622  1767 tablet_bootstrap.cc:492] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Bootstrap starting.
I20260709 12:58:24.488343  1768 consensus_queue.cc:260] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:24.490350  1768 ts_tablet_manager.cc:1434] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:58:24.495043  1767 tablet_bootstrap.cc:654] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.496672  1768 tablet_bootstrap.cc:492] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e: Bootstrap starting.
I20260709 12:58:24.498086  1765 tablet_bootstrap.cc:654] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.500456  1725 raft_consensus.cc:3060] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:24.590098  1765 tablet_bootstrap.cc:492] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4: No bootstrap required, opened a new log
I20260709 12:58:24.590688  1765 ts_tablet_manager.cc:1403] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4: Time spent bootstrapping tablet: real 0.122s	user 0.015s	sys 0.016s
I20260709 12:58:24.608186  1765 raft_consensus.cc:359] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:24.609279  1765 raft_consensus.cc:385] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.609583  1765 raft_consensus.cc:740] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.610193  1765 consensus_queue.cc:260] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:24.611428  1765 ts_tablet_manager.cc:1434] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4: Time spent starting tablet: real 0.020s	user 0.000s	sys 0.004s
I20260709 12:58:24.613549  2156 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.614056  2156 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:24.616328  2156 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:24.619411  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:24.612442  1765 tablet_bootstrap.cc:492] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4: Bootstrap starting.
I20260709 12:58:24.626369  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:24.627974  1542 leader_election.cc:304] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:58:24.629048  2155 raft_consensus.cc:2749] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:24.643004  1572 raft_consensus.cc:3060] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:24.648553  2156 consensus_queue.cc:1048] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:24.649772  1767 tablet_bootstrap.cc:492] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: No bootstrap required, opened a new log
I20260709 12:58:24.649955  1768 tablet_bootstrap.cc:654] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.650297  1767 ts_tablet_manager.cc:1403] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent bootstrapping tablet: real 0.162s	user 0.012s	sys 0.017s
I20260709 12:58:24.658718  1765 tablet_bootstrap.cc:654] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.662386  1767 raft_consensus.cc:359] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:24.668076  1767 raft_consensus.cc:385] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.668382  1767 raft_consensus.cc:740] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.669050  1767 consensus_queue.cc:260] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:24.671039  1767 ts_tablet_manager.cc:1434] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.003s
I20260709 12:58:24.671183  2156 consensus_queue.cc:1048] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:24.674753  1767 tablet_bootstrap.cc:492] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Bootstrap starting.
I20260709 12:58:24.681128  1768 tablet_bootstrap.cc:492] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e: No bootstrap required, opened a new log
I20260709 12:58:24.681550  1768 ts_tablet_manager.cc:1403] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e: Time spent bootstrapping tablet: real 0.185s	user 0.011s	sys 0.003s
I20260709 12:58:24.685019  1768 raft_consensus.cc:359] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:24.685535  1768 raft_consensus.cc:385] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.685883  1768 raft_consensus.cc:740] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.688752  1768 consensus_queue.cc:260] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:24.693537  1765 tablet_bootstrap.cc:492] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4: No bootstrap required, opened a new log
I20260709 12:58:24.695294  1768 ts_tablet_manager.cc:1434] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:58:24.695070  1767 tablet_bootstrap.cc:654] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.696861  1765 ts_tablet_manager.cc:1403] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4: Time spent bootstrapping tablet: real 0.085s	user 0.009s	sys 0.003s
I20260709 12:58:24.697981  1768 tablet_bootstrap.cc:492] T 608abea191d946228bed666c5560fd0a P 4dbe7d47a2374afca075d3a98583b49e: Bootstrap starting.
I20260709 12:58:24.716835  2159 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.717418  2159 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:24.720166  1768 tablet_bootstrap.cc:654] T 608abea191d946228bed666c5560fd0a P 4dbe7d47a2374afca075d3a98583b49e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.720767  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:24.721479  1649 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 0.
I20260709 12:58:24.721596  1765 raft_consensus.cc:359] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:24.722693  1765 raft_consensus.cc:385] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.722963  1765 raft_consensus.cc:740] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.722900  1688 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:58:24.723875  2160 raft_consensus.cc:2804] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:24.723765  1765 consensus_queue.cc:260] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:24.724291  2160 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:24.724697  2160 raft_consensus.cc:3060] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:24.726390  1765 ts_tablet_manager.cc:1434] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 12:58:24.727560  1765 tablet_bootstrap.cc:492] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4: Bootstrap starting.
I20260709 12:58:24.729719  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:24.730391  1570 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 0.
I20260709 12:58:24.737056  2093 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.737597  2093 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:24.738546  2159 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:24.739167  1767 tablet_bootstrap.cc:492] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226: No bootstrap required, opened a new log
I20260709 12:58:24.739697  1767 ts_tablet_manager.cc:1403] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent bootstrapping tablet: real 0.065s	user 0.010s	sys 0.003s
I20260709 12:58:24.739842  2093 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:24.742744  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:24.743661  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:24.744234  1725 raft_consensus.cc:2468] T 725a29842f534310a9c0bb9d5c7892a2 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 0.
W20260709 12:58:24.744356  1615 leader_election.cc:343] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:24.744644  1765 tablet_bootstrap.cc:654] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.745851  1617 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:24.746909  2097 raft_consensus.cc:2804] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:24.747277  2097 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:24.747649  2097 raft_consensus.cc:3060] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:24.742982  1767 raft_consensus.cc:359] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:24.760264  1767 raft_consensus.cc:385] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.760551  1767 raft_consensus.cc:740] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.761161  1767 consensus_queue.cc:260] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:24.742969  2160 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:24.763691  1767 ts_tablet_manager.cc:1434] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 12:58:24.760807  2097 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:24.764776  1767 tablet_bootstrap.cc:492] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Bootstrap starting.
I20260709 12:58:24.766037  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:24.766664  1649 raft_consensus.cc:3060] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:24.773104  1767 tablet_bootstrap.cc:654] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.790530  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:24.791203  1570 raft_consensus.cc:3060] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:24.793752  1765 tablet_bootstrap.cc:492] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4: No bootstrap required, opened a new log
I20260709 12:58:24.794217  1765 ts_tablet_manager.cc:1403] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4: Time spent bootstrapping tablet: real 0.067s	user 0.011s	sys 0.001s
I20260709 12:58:24.794541  2097 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:24.796567  2155 raft_consensus.cc:493] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.796785  1765 raft_consensus.cc:359] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:24.797106  2155 raft_consensus.cc:515] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:24.797596  1765 raft_consensus.cc:385] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.797996  1765 raft_consensus.cc:740] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.800402  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 12:58:24.801642  1615 leader_election.cc:343] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:24.798624  1765 consensus_queue.cc:260] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:24.814770  2155 leader_election.cc:290] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:24.816644  1765 ts_tablet_manager.cc:1434] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:58:24.809391  1915 raft_consensus.cc:493] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.799423  2160 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 12:58:24.823240  1521 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:24.825608  1765 tablet_bootstrap.cc:492] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4: Bootstrap starting.
I20260709 12:58:24.823608  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:24.825012  1915 raft_consensus.cc:515] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:24.837571  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:58:24.850823  1725 raft_consensus.cc:3060] T 725a29842f534310a9c0bb9d5c7892a2 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:24.853844  1767 tablet_bootstrap.cc:492] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: No bootstrap required, opened a new log
I20260709 12:58:24.836910  1647 raft_consensus.cc:2468] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 0.
I20260709 12:58:24.838464  1649 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 1.
I20260709 12:58:24.843546  1768 tablet_bootstrap.cc:492] T 608abea191d946228bed666c5560fd0a P 4dbe7d47a2374afca075d3a98583b49e: No bootstrap required, opened a new log
I20260709 12:58:24.863205  1539 leader_election.cc:304] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:58:24.863557  1768 ts_tablet_manager.cc:1403] T 608abea191d946228bed666c5560fd0a P 4dbe7d47a2374afca075d3a98583b49e: Time spent bootstrapping tablet: real 0.166s	user 0.014s	sys 0.034s
I20260709 12:58:24.864039  2155 raft_consensus.cc:2804] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:24.847586  1915 leader_election.cc:290] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:24.848454  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:24.865309  1650 raft_consensus.cc:2468] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 0.
I20260709 12:58:24.839493  2115 raft_consensus.cc:493] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.866137  2115 raft_consensus.cc:515] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:24.852386  1570 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 1.
I20260709 12:58:24.860450  1767 ts_tablet_manager.cc:1403] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent bootstrapping tablet: real 0.096s	user 0.020s	sys 0.005s
I20260709 12:58:24.862556  1688 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:58:24.864459  1765 tablet_bootstrap.cc:654] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.869688  2115 leader_election.cc:290] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:24.871928  1915 raft_consensus.cc:2804] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:24.872507  1915 raft_consensus.cc:697] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:58:24.873256  1688 leader_election.cc:304] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:58:24.874212  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:24.875823  1650 raft_consensus.cc:2468] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 0.
I20260709 12:58:24.876650  1768 raft_consensus.cc:359] T 608abea191d946228bed666c5560fd0a P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:24.876876  1539 leader_election.cc:304] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:58:24.877251  1768 raft_consensus.cc:385] T 608abea191d946228bed666c5560fd0a P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.877540  1768 raft_consensus.cc:740] T 608abea191d946228bed666c5560fd0a P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.876426  1915 consensus_queue.cc:237] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:24.878136  1768 consensus_queue.cc:260] T 608abea191d946228bed666c5560fd0a P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:24.879052  1725 raft_consensus.cc:2468] T 725a29842f534310a9c0bb9d5c7892a2 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 1.
I20260709 12:58:24.880113  2164 raft_consensus.cc:2804] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:24.880690  2164 raft_consensus.cc:493] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:24.880786  1768 ts_tablet_manager.cc:1434] T 608abea191d946228bed666c5560fd0a P 4dbe7d47a2374afca075d3a98583b49e: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 12:58:24.881035  2164 raft_consensus.cc:3060] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:24.881884  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:24.884047  1768 tablet_bootstrap.cc:492] T 566c1a1cfdfa47a2aee520e28f352064 P 4dbe7d47a2374afca075d3a98583b49e: Bootstrap starting.
I20260709 12:58:24.884976  2115 raft_consensus.cc:2804] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:24.885381  2115 raft_consensus.cc:493] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:24.885710  2115 raft_consensus.cc:3060] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:24.864460  2155 raft_consensus.cc:493] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:24.886644  2155 raft_consensus.cc:3060] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:24.884860  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:24.894142  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:24.895044  2164 raft_consensus.cc:515] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:24.895777  2155 raft_consensus.cc:515] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:24.896903  1572 raft_consensus.cc:2393] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 1: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:58:24.897894  2155 leader_election.cc:290] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:24.896163  1725 raft_consensus.cc:2393] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 1: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:58:24.903905  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:24.904946  1650 raft_consensus.cc:3060] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:24.908646  1617 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:24.908797  1767 raft_consensus.cc:359] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:24.909250  2156 consensus_queue.cc:1048] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:24.909533  1767 raft_consensus.cc:385] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:24.910851  1767 raft_consensus.cc:740] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Initialized, Role: FOLLOWER
I20260709 12:58:24.911010  2161 raft_consensus.cc:2804] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:24.911477  2161 raft_consensus.cc:697] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:58:24.911463  1767 consensus_queue.cc:260] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:24.921285  1767 ts_tablet_manager.cc:1434] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent starting tablet: real 0.052s	user 0.006s	sys 0.000s
W20260709 12:58:24.923240  1542 leader_election.cc:343] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:24.916721  2161 consensus_queue.cc:237] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:24.938475  1650 raft_consensus.cc:2468] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 1.
I20260709 12:58:24.945008  1767 tablet_bootstrap.cc:492] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Bootstrap starting.
I20260709 12:58:24.934069  2194 raft_consensus.cc:493] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:24.959244  2164 leader_election.cc:290] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:24.951540  2194 raft_consensus.cc:515] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:24.961061  2194 leader_election.cc:290] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:24.962517  1768 tablet_bootstrap.cc:654] T 566c1a1cfdfa47a2aee520e28f352064 P 4dbe7d47a2374afca075d3a98583b49e: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.948282  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:58:24.966689  2115 raft_consensus.cc:515] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:24.968813  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:24.969791  1647 raft_consensus.cc:2393] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 1: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:58:24.970057  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:24.970785  1572 raft_consensus.cc:2393] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 1: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:58:24.970727  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:24.971588  1649 raft_consensus.cc:2468] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 0.
I20260709 12:58:24.972828  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:24.950181  1539 leader_election.cc:304] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:58:24.975806  2156 raft_consensus.cc:2804] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:24.976320  2156 raft_consensus.cc:697] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:58:24.977125  2156 consensus_queue.cc:237] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:24.978729  1688 leader_election.cc:304] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:58:24.979542  2159 raft_consensus.cc:2804] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:24.979882  2159 raft_consensus.cc:493] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:24.980218  2159 raft_consensus.cc:3060] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:24.982547  2115 leader_election.cc:290] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:24.980052  1689 leader_election.cc:304] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:24.985306  2164 raft_consensus.cc:2749] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:58:24.987049  1765 tablet_bootstrap.cc:492] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4: No bootstrap required, opened a new log
I20260709 12:58:24.989660  1765 ts_tablet_manager.cc:1403] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4: Time spent bootstrapping tablet: real 0.167s	user 0.011s	sys 0.008s
I20260709 12:58:24.988184  2159 raft_consensus.cc:515] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:58:24.987409  1689 leader_election.cc:343] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:24.995539  1767 tablet_bootstrap.cc:654] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:24.997529  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 12:58:24.999670  1542 leader_election.cc:343] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:25.000095  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:25.000885  1649 raft_consensus.cc:3060] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:25.001472  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:25.001876  2159 leader_election.cc:290] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 12:58:25.003413  1689 leader_election.cc:343] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:25.012282  1649 raft_consensus.cc:2468] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 1.
I20260709 12:58:25.000072  1765 raft_consensus.cc:359] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:58:25.014737  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 60966.2us
I20260709 12:58:25.015327  1765 raft_consensus.cc:385] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:25.015841  1765 raft_consensus.cc:740] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Initialized, Role: FOLLOWER
I20260709 12:58:25.004159  1473 catalog_manager.cc:5697] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:25.016515  1765 consensus_queue.cc:260] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:25.018584  1765 ts_tablet_manager.cc:1434] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.000s
I20260709 12:58:25.015483  1768 tablet_bootstrap.cc:492] T 566c1a1cfdfa47a2aee520e28f352064 P 4dbe7d47a2374afca075d3a98583b49e: No bootstrap required, opened a new log
I20260709 12:58:25.019524  1768 ts_tablet_manager.cc:1403] T 566c1a1cfdfa47a2aee520e28f352064 P 4dbe7d47a2374afca075d3a98583b49e: Time spent bootstrapping tablet: real 0.136s	user 0.018s	sys 0.000s
I20260709 12:58:25.024940  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:25.025669  1650 raft_consensus.cc:3060] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:25.041038  1650 raft_consensus.cc:2468] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 1.
I20260709 12:58:25.041400  1688 leader_election.cc:304] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:25.042208  1765 tablet_bootstrap.cc:492] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4: Bootstrap starting.
I20260709 12:58:25.042781  2159 raft_consensus.cc:2804] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:25.043284  2159 raft_consensus.cc:697] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:58:25.044293  2159 consensus_queue.cc:237] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:25.044030  1768 raft_consensus.cc:359] T 566c1a1cfdfa47a2aee520e28f352064 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:25.047196  1768 raft_consensus.cc:385] T 566c1a1cfdfa47a2aee520e28f352064 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:25.047438  1768 raft_consensus.cc:740] T 566c1a1cfdfa47a2aee520e28f352064 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Initialized, Role: FOLLOWER
I20260709 12:58:25.048089  1768 consensus_queue.cc:260] T 566c1a1cfdfa47a2aee520e28f352064 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:25.053404  1539 leader_election.cc:304] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 12:58:25.055408  2115 raft_consensus.cc:2804] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:25.055843  2115 raft_consensus.cc:697] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:58:25.056720  2115 consensus_queue.cc:237] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:25.057334  1471 catalog_manager.cc:5697] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:25.063262  1472 catalog_manager.cc:5697] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 0 to 1, leader changed from <none> to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:25.071509  1768 ts_tablet_manager.cc:1434] T 566c1a1cfdfa47a2aee520e28f352064 P 4dbe7d47a2374afca075d3a98583b49e: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
I20260709 12:58:25.077188  2156 raft_consensus.cc:493] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:25.075201  2193 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:25.077696  2156 raft_consensus.cc:515] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:25.079800  2193 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:25.085345  2197 consensus_queue.cc:1048] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:58:25.088275  2193 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:25.089653  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:25.093760  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 12:58:25.094305  1617 leader_election.cc:343] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:58:25.095995  1615 leader_election.cc:343] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:25.096377  1615 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:25.099224  2193 raft_consensus.cc:2749] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:25.104044  1767 tablet_bootstrap.cc:492] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226: No bootstrap required, opened a new log
I20260709 12:58:25.104748  1767 ts_tablet_manager.cc:1403] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent bootstrapping tablet: real 0.160s	user 0.010s	sys 0.003s
I20260709 12:58:25.104878  1765 tablet_bootstrap.cc:654] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:25.104579  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:25.106726  1646 raft_consensus.cc:2468] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 0.
I20260709 12:58:25.108204  1539 leader_election.cc:304] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:58:25.109272  2155 raft_consensus.cc:2804] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:25.109727  2155 raft_consensus.cc:493] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:25.110087  2155 raft_consensus.cc:3060] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:25.111245  1767 raft_consensus.cc:359] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:25.111886  1767 raft_consensus.cc:385] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:25.112151  1767 raft_consensus.cc:740] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Initialized, Role: FOLLOWER
I20260709 12:58:25.114322  1767 consensus_queue.cc:260] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:25.131753  2156 leader_election.cc:290] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:25.132858  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:25.134086  1767 ts_tablet_manager.cc:1434] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.001s
W20260709 12:58:25.134582  1542 leader_election.cc:343] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:25.137080  1767 tablet_bootstrap.cc:492] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Bootstrap starting.
I20260709 12:58:25.142858  2155 raft_consensus.cc:515] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:25.148094  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:25.148702  1646 raft_consensus.cc:3060] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:25.161085  1765 tablet_bootstrap.cc:492] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4: No bootstrap required, opened a new log
I20260709 12:58:25.161769  1765 ts_tablet_manager.cc:1403] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4: Time spent bootstrapping tablet: real 0.129s	user 0.009s	sys 0.011s
I20260709 12:58:25.160125  1646 raft_consensus.cc:2468] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 1.
I20260709 12:58:25.166620  1765 raft_consensus.cc:359] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:25.167243  1765 raft_consensus.cc:385] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:25.167070  2155 leader_election.cc:290] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:25.168073  1767 tablet_bootstrap.cc:654] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:25.168851  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 12:58:25.170246  1542 leader_election.cc:343] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:25.167618  1765 raft_consensus.cc:740] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Initialized, Role: FOLLOWER
I20260709 12:58:25.174078  1539 leader_election.cc:304] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 12:58:25.175362  1915 raft_consensus.cc:493] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:25.175987  1915 raft_consensus.cc:515] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:25.174801  1765 consensus_queue.cc:260] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:25.179157  2197 raft_consensus.cc:2804] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:25.179819  2197 raft_consensus.cc:697] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:58:25.180935  2197 consensus_queue.cc:237] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:25.178639  1765 ts_tablet_manager.cc:1434] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4: Time spent starting tablet: real 0.017s	user 0.002s	sys 0.003s
I20260709 12:58:25.189663  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:25.190596  1647 raft_consensus.cc:2468] T 608abea191d946228bed666c5560fd0a P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 0.
I20260709 12:58:25.192705  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:25.194017  1765 tablet_bootstrap.cc:492] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4: Bootstrap starting.
I20260709 12:58:25.197077  1688 leader_election.cc:304] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:58:25.198359  2164 raft_consensus.cc:2804] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:25.198925  2164 raft_consensus.cc:493] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:25.199465  2164 raft_consensus.cc:3060] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:25.201640  1765 tablet_bootstrap.cc:654] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:25.195286  1915 leader_election.cc:290] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:25.218345  1765 tablet_bootstrap.cc:492] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4: No bootstrap required, opened a new log
I20260709 12:58:25.218935  1765 ts_tablet_manager.cc:1403] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.008s
I20260709 12:58:25.221771  1765 raft_consensus.cc:359] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:25.222465  1765 raft_consensus.cc:385] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:25.222779  1765 raft_consensus.cc:740] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Initialized, Role: FOLLOWER
I20260709 12:58:25.223440  1765 consensus_queue.cc:260] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:25.225144  1765 ts_tablet_manager.cc:1434] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
W20260709 12:58:25.204778  1689 leader_election.cc:343] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:25.226534  1765 tablet_bootstrap.cc:492] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4: Bootstrap starting.
I20260709 12:58:25.238394  1765 tablet_bootstrap.cc:654] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:25.260005  1765 tablet_bootstrap.cc:492] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4: No bootstrap required, opened a new log
I20260709 12:58:25.260632  1765 ts_tablet_manager.cc:1403] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.003s
I20260709 12:58:25.263362  1765 raft_consensus.cc:359] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:25.264218  1765 raft_consensus.cc:385] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:25.264505  1765 raft_consensus.cc:740] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Initialized, Role: FOLLOWER
I20260709 12:58:25.265194  1765 consensus_queue.cc:260] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:25.273190  1765 ts_tablet_manager.cc:1434] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.002s
I20260709 12:58:25.274569  1765 tablet_bootstrap.cc:492] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4: Bootstrap starting.
I20260709 12:58:25.283735  1765 tablet_bootstrap.cc:654] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:25.296252  1765 tablet_bootstrap.cc:492] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4: No bootstrap required, opened a new log
I20260709 12:58:25.296766  1765 ts_tablet_manager.cc:1403] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.001s
I20260709 12:58:25.299552  1765 raft_consensus.cc:359] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:25.300303  1765 raft_consensus.cc:385] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:25.300624  1765 raft_consensus.cc:740] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Initialized, Role: FOLLOWER
I20260709 12:58:25.301316  1765 consensus_queue.cc:260] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:25.302977  1765 ts_tablet_manager.cc:1434] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:58:25.304000  1765 tablet_bootstrap.cc:492] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4: Bootstrap starting.
I20260709 12:58:25.315469  2164 raft_consensus.cc:515] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:25.323071  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:25.323357  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:25.323758  1649 raft_consensus.cc:3060] T 608abea191d946228bed666c5560fd0a P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:25.324111  1765 tablet_bootstrap.cc:654] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4: Neither blocks nor log segments found. Creating new log.
W20260709 12:58:25.325875  1689 leader_election.cc:343] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:25.328933  1767 tablet_bootstrap.cc:492] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226: No bootstrap required, opened a new log
I20260709 12:58:25.330498  1767 ts_tablet_manager.cc:1403] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent bootstrapping tablet: real 0.194s	user 0.013s	sys 0.001s
I20260709 12:58:25.333344  2164 leader_election.cc:290] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:25.337954  1767 raft_consensus.cc:359] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:25.341310  1767 raft_consensus.cc:385] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:25.341979  1767 raft_consensus.cc:740] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Initialized, Role: FOLLOWER
I20260709 12:58:25.359730  1767 consensus_queue.cc:260] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:25.362718  2160 raft_consensus.cc:493] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:25.365557  2160 raft_consensus.cc:515] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:25.367311  1767 ts_tablet_manager.cc:1434] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 12:58:25.357973  1473 catalog_manager.cc:5697] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:25.367766  2160 leader_election.cc:290] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:25.368368  1767 tablet_bootstrap.cc:492] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Bootstrap starting.
I20260709 12:58:25.371740  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:25.372714  1765 tablet_bootstrap.cc:492] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4: No bootstrap required, opened a new log
I20260709 12:58:25.375710  1765 ts_tablet_manager.cc:1403] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4: Time spent bootstrapping tablet: real 0.072s	user 0.008s	sys 0.018s
W20260709 12:58:25.380816  1689 leader_election.cc:343] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:25.386103  2194 consensus_queue.cc:1048] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:25.391693  1649 raft_consensus.cc:2468] T 608abea191d946228bed666c5560fd0a P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 1.
I20260709 12:58:25.394831  1765 raft_consensus.cc:359] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:25.419667  1765 raft_consensus.cc:385] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:25.418450  1471 catalog_manager.cc:5697] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:25.420007  1765 raft_consensus.cc:740] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Initialized, Role: FOLLOWER
W20260709 12:58:25.397058  1615 consensus_peers.cc:597] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:25.397675  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:25.401852  2156 raft_consensus.cc:493] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:25.423602  2156 raft_consensus.cc:515] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:25.425595  2156 leader_election.cc:290] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:25.405815  2165 consensus_queue.cc:1048] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:25.423237  1767 tablet_bootstrap.cc:654] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:25.428364  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:25.429100  1647 raft_consensus.cc:2468] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 0.
I20260709 12:58:25.425697  1765 consensus_queue.cc:260] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:25.438256  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:25.438733  2192 consensus_queue.cc:1048] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:25.439003  1539 leader_election.cc:304] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:58:25.440263  2156 raft_consensus.cc:2804] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:25.440644  2156 raft_consensus.cc:493] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:25.440963  2156 raft_consensus.cc:3060] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:25.438880  1719 raft_consensus.cc:2468] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 0.
I20260709 12:58:25.443568  1646 raft_consensus.cc:2468] T 566c1a1cfdfa47a2aee520e28f352064 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 0.
I20260709 12:58:25.445070  1688 leader_election.cc:304] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:25.445751  1765 ts_tablet_manager.cc:1434] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4: Time spent starting tablet: real 0.070s	user 0.006s	sys 0.001s
I20260709 12:58:25.445955  2164 raft_consensus.cc:2804] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:25.446354  2164 raft_consensus.cc:493] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:25.446772  2164 raft_consensus.cc:3060] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:25.447896  2197 consensus_queue.cc:1048] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:25.449173  2093 raft_consensus.cc:493] T 566c1a1cfdfa47a2aee520e28f352064 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:25.449658  2093 raft_consensus.cc:515] T 566c1a1cfdfa47a2aee520e28f352064 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:25.453857  1719 raft_consensus.cc:3060] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:25.454713  2093 leader_election.cc:290] T 566c1a1cfdfa47a2aee520e28f352064 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:25.456852  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 12:58:25.460646  1615 leader_election.cc:343] T 566c1a1cfdfa47a2aee520e28f352064 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:25.464636  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:25.468322  2156 raft_consensus.cc:515] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:58:25.470052  1689 consensus_peers.cc:597] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:25.471066  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:25.471784  1648 raft_consensus.cc:3060] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:25.472105  1688 leader_election.cc:304] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:25.472318  2220 raft_consensus.cc:493] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:25.473081  2160 raft_consensus.cc:2804] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:25.473421  2156 leader_election.cc:290] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:25.472790  2220 raft_consensus.cc:515] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:25.473507  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:58:25.473726  2160 raft_consensus.cc:697] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:58:25.474236  1725 raft_consensus.cc:3060] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:25.474575  2160 consensus_queue.cc:237] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:25.476431  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:25.477063  1649 raft_consensus.cc:2468] T cf2ade0033864199b5ced11fc9b5c6ad P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 0.
I20260709 12:58:25.478637  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:25.479218  1575 raft_consensus.cc:2468] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 0.
I20260709 12:58:25.479595  1688 leader_election.cc:304] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:58:25.480290  1915 raft_consensus.cc:2804] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:25.480638  1915 raft_consensus.cc:493] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:25.480934  1915 raft_consensus.cc:3060] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:25.482249  1648 raft_consensus.cc:2468] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 1.
I20260709 12:58:25.470817  1767 tablet_bootstrap.cc:492] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226: No bootstrap required, opened a new log
I20260709 12:58:25.483230  1767 ts_tablet_manager.cc:1403] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent bootstrapping tablet: real 0.115s	user 0.010s	sys 0.004s
I20260709 12:58:25.483418  1539 leader_election.cc:304] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:58:25.489946  2156 raft_consensus.cc:2804] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:25.490762  2156 raft_consensus.cc:697] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:58:25.495546  2155 consensus_queue.cc:1048] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:25.496690  2156 consensus_queue.cc:237] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:25.501247  1915 raft_consensus.cc:515] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:25.480947  2220 leader_election.cc:290] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:25.507391  2159 raft_consensus.cc:493] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:25.508140  2159 raft_consensus.cc:515] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:25.509222  1767 raft_consensus.cc:359] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:25.510109  1767 raft_consensus.cc:385] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:25.510484  1767 raft_consensus.cc:740] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Initialized, Role: FOLLOWER
I20260709 12:58:25.511322  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:25.511890  1648 raft_consensus.cc:2468] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 1.
I20260709 12:58:25.513033  1688 leader_election.cc:304] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:58:25.510380  2159 leader_election.cc:290] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:25.511344  1767 consensus_queue.cc:260] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:25.517846  1473 catalog_manager.cc:5697] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:25.519961  1915 leader_election.cc:290] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:25.534782  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:25.535470  1648 raft_consensus.cc:3060] T cf2ade0033864199b5ced11fc9b5c6ad P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:25.548463  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:25.549196  1570 raft_consensus.cc:3060] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:25.552191  1725 raft_consensus.cc:2468] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 1.
I20260709 12:58:25.558494  1767 ts_tablet_manager.cc:1434] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent starting tablet: real 0.075s	user 0.009s	sys 0.000s
I20260709 12:58:25.560376  1648 raft_consensus.cc:2468] T cf2ade0033864199b5ced11fc9b5c6ad P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 1.
I20260709 12:58:25.522231  2164 raft_consensus.cc:515] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:25.538295  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:25.570673  1767 tablet_bootstrap.cc:492] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Bootstrap starting.
I20260709 12:58:25.560483  2220 raft_consensus.cc:2804] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:58:25.575886  1688 leader_election.cc:304] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:58:25.578038  1724 raft_consensus.cc:2393] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 1: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:58:25.583458  2164 leader_election.cc:290] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:25.584118  2165 raft_consensus.cc:2804] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:25.584503  1570 raft_consensus.cc:2468] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 1.
I20260709 12:58:25.584635  2165 raft_consensus.cc:697] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:58:25.585733  2165 consensus_queue.cc:237] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:25.572902  2220 raft_consensus.cc:493] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:25.598398  2220 raft_consensus.cc:3060] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:25.611959  1617 leader_election.cc:304] T 566c1a1cfdfa47a2aee520e28f352064 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:25.609745  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:25.649976  2156 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:25.659222  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:25.651257  2161 raft_consensus.cc:3060] T 566c1a1cfdfa47a2aee520e28f352064 P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:25.650221  2197 consensus_queue.cc:1048] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
W20260709 12:58:25.673367  2221 log.cc:927] Time spent T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 12:58:25.690147  1915 raft_consensus.cc:493] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:25.690891  1915 raft_consensus.cc:515] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:58:25.693720  2226 log.cc:927] Time spent T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:58:25.709528  1915 leader_election.cc:290] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:25.663826  2156 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:58:25.732263  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 62095.9us
I20260709 12:58:25.770802  2155 consensus_queue.cc:1048] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:25.807708  1767 tablet_bootstrap.cc:654] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:25.828092  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:25.829001  1648 raft_consensus.cc:2393] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 1: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
W20260709 12:58:25.829597  1689 leader_election.cc:343] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:58:25.834082  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:25.860234  2240 consensus_queue.cc:1048] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:58:25.815223  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 112643us
I20260709 12:58:25.865506  2233 raft_consensus.cc:493] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:25.866289  2233 raft_consensus.cc:515] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:58:25.885162  2229 log.cc:927] Time spent T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.126s	user 0.004s	sys 0.000s
I20260709 12:58:25.878716  2156 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:58:25.898259  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 65006.5us
I20260709 12:58:25.900832  2220 raft_consensus.cc:515] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:25.903155  1719 raft_consensus.cc:1240] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:58:25.904799  2233 leader_election.cc:290] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:25.905939  2161 raft_consensus.cc:2749] T 566c1a1cfdfa47a2aee520e28f352064 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:25.911988  1647 raft_consensus.cc:2468] T 566c1a1cfdfa47a2aee520e28f352064 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 1.
I20260709 12:58:25.891379  2240 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:25.914065  2240 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:25.927711  2240 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:25.903041  2220 leader_election.cc:290] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:25.941915  1689 leader_election.cc:304] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:25.944994  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:25.950397  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:25.953066  2155 consensus_queue.cc:1059] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:25.954592  2233 raft_consensus.cc:3055] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:25.954960  2233 raft_consensus.cc:740] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:58:25.955349  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:25.955981  1724 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 0.
I20260709 12:58:25.955754  2233 consensus_queue.cc:260] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:25.956894  2233 raft_consensus.cc:3060] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:25.948045  2164 raft_consensus.cc:3060] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:25.964128  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 262138us
I20260709 12:58:25.970059  1542 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:58:25.974601  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:26.000689  1649 raft_consensus.cc:3060] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:26.010044  2232 raft_consensus.cc:2804] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:26.024118  2232 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:26.024680  2232 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:58:26.026623  1521 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:58:26.000206  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:26.067409  1767 tablet_bootstrap.cc:492] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: No bootstrap required, opened a new log
I20260709 12:58:26.068264  1645 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 0.
I20260709 12:58:26.082654  2164 raft_consensus.cc:2749] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:26.098889  1574 raft_consensus.cc:3060] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:26.102748  1472 catalog_manager.cc:5697] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:26.106029  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:26.138981  2232 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:26.140658  1568 raft_consensus.cc:2393] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 1: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
W20260709 12:58:26.149662  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 152825us
I20260709 12:58:26.164913  1688 leader_election.cc:304] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:26.165848  2164 raft_consensus.cc:2804] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:26.166702  2164 raft_consensus.cc:697] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:58:26.167673  2164 consensus_queue.cc:237] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:26.174178  1767 ts_tablet_manager.cc:1403] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent bootstrapping tablet: real 0.604s	user 0.039s	sys 0.050s
I20260709 12:58:26.178915  1767 raft_consensus.cc:359] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:26.179908  1767 raft_consensus.cc:385] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:26.180969  1767 raft_consensus.cc:740] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Initialized, Role: FOLLOWER
I20260709 12:58:26.181922  1767 consensus_queue.cc:260] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:26.194113  1688 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:58:26.195940  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:26.196240  1915 raft_consensus.cc:2804] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:58:26.196648  1650 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 0.
I20260709 12:58:26.196856  1915 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:58:26.197347  1915 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:26.201541  2244 consensus_queue.cc:1048] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:26.205926  1767 ts_tablet_manager.cc:1434] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.000s
I20260709 12:58:26.207093  1767 tablet_bootstrap.cc:492] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Bootstrap starting.
W20260709 12:58:26.254763  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 59473.1us
I20260709 12:58:26.259639  1915 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:26.223943  2197 consensus_queue.cc:1048] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.029s
I20260709 12:58:26.261778  1915 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:26.246912  2234 consensus_queue.cc:1048] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:58:26.248431  2232 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:26.253374  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:26.276923  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:26.277576  1642 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:26.281560  1649 raft_consensus.cc:2468] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 2.
I20260709 12:58:26.282449  1650 raft_consensus.cc:1240] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:26.283535  2197 raft_consensus.cc:493] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:26.283990  2197 raft_consensus.cc:515] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:26.286876  2197 leader_election.cc:290] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:26.286345  1767 tablet_bootstrap.cc:654] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:26.299486  1572 raft_consensus.cc:3060] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:26.293556  2159 consensus_queue.cc:1048] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:58:26.317660  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
W20260709 12:58:26.329603  1689 consensus_peers.cc:597] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:26.350636  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:26.353982  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:58:26.354914  1722 raft_consensus.cc:2393] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 1: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
W20260709 12:58:26.336467  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:26.361521  1688 leader_election.cc:304] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:26.363193  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:26.364032  1573 raft_consensus.cc:2393] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 1: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:58:26.337150  2156 consensus_queue.cc:1048] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.039s
I20260709 12:58:26.390957  1473 catalog_manager.cc:5697] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 0 to 1, leader changed from <none> to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:26.381510  2159 raft_consensus.cc:2804] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:26.396824  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:26.399770  1539 leader_election.cc:304] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:58:26.411676  1642 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 1.
I20260709 12:58:26.404912  2159 raft_consensus.cc:697] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 2 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:58:26.412973  2159 consensus_queue.cc:237] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:26.419018  1688 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:26.424502  1915 raft_consensus.cc:2804] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:58:26.428273  1915 raft_consensus.cc:697] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:58:26.429265  1915 consensus_queue.cc:237] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:26.427825  2156 raft_consensus.cc:2749] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:26.447006  1767 tablet_bootstrap.cc:492] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: No bootstrap required, opened a new log
I20260709 12:58:26.447909  1767 ts_tablet_manager.cc:1403] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent bootstrapping tablet: real 0.241s	user 0.012s	sys 0.020s
I20260709 12:58:26.469292  1767 raft_consensus.cc:359] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:26.470005  1767 raft_consensus.cc:385] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:26.470283  1767 raft_consensus.cc:740] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Initialized, Role: FOLLOWER
I20260709 12:58:26.446560  1539 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:58:26.484550  2239 consensus_queue.cc:1048] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.037s
I20260709 12:58:26.476133  2233 raft_consensus.cc:2749] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:58:26.499220  1539 leader_election.cc:304] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:58:26.532166  2203 raft_consensus.cc:2749] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:26.516290  1767 consensus_queue.cc:260] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:26.547637  1767 ts_tablet_manager.cc:1434] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent starting tablet: real 0.099s	user 0.007s	sys 0.000s
I20260709 12:58:26.561666  2203 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:26.562219  2203 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:26.564692  2203 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:26.601830  1767 tablet_bootstrap.cc:492] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Bootstrap starting.
I20260709 12:58:26.604473  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:26.611868  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:26.683161  1472 catalog_manager.cc:5697] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:26.693099  1472 catalog_manager.cc:5697] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:26.702505  1767 tablet_bootstrap.cc:654] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:26.709205  1915 consensus_queue.cc:1048] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:26.724620  1542 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:58:26.726467  2203 raft_consensus.cc:2749] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:26.746910  1568 raft_consensus.cc:3060] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:26.785387  1767 tablet_bootstrap.cc:492] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226: No bootstrap required, opened a new log
I20260709 12:58:26.785863  1767 ts_tablet_manager.cc:1403] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent bootstrapping tablet: real 0.189s	user 0.018s	sys 0.012s
I20260709 12:58:26.788422  1767 raft_consensus.cc:359] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:26.789156  1767 raft_consensus.cc:385] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:26.789430  1767 raft_consensus.cc:740] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Initialized, Role: FOLLOWER
I20260709 12:58:26.790066  1767 consensus_queue.cc:260] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:26.798882  2203 raft_consensus.cc:493] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:58:26.799397  2203 raft_consensus.cc:515] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:26.801446  2203 leader_election.cc:290] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:26.805305  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:26.805989  1767 ts_tablet_manager.cc:1434] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:58:26.806941  1767 tablet_bootstrap.cc:492] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Bootstrap starting.
I20260709 12:58:26.813990  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:58:26.824463  1689 consensus_peers.cc:597] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:26.828378  1542 leader_election.cc:304] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:58:26.829505  2203 raft_consensus.cc:2749] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:58:26.845016  1472 catalog_manager.cc:5697] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:26.847149  1472 catalog_manager.cc:5697] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 1 to 2, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:26.860746  1767 tablet_bootstrap.cc:654] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Neither blocks nor log segments found. Creating new log.
I20260709 12:58:26.875047  2159 consensus_queue.cc:1048] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:26.875733  1767 tablet_bootstrap.cc:492] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: No bootstrap required, opened a new log
I20260709 12:58:26.876616  1767 ts_tablet_manager.cc:1403] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent bootstrapping tablet: real 0.070s	user 0.008s	sys 0.007s
I20260709 12:58:26.887849  1767 raft_consensus.cc:359] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:26.888548  1767 raft_consensus.cc:385] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:58:26.888820  1767 raft_consensus.cc:740] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Initialized, Role: FOLLOWER
I20260709 12:58:26.889405  1767 consensus_queue.cc:260] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:26.901556  1767 ts_tablet_manager.cc:1434] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 12:58:26.924749  1645 raft_consensus.cc:1275] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:58:26.926213  2159 consensus_queue.cc:1048] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:58:26.944661  2164 consensus_queue.cc:1048] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:58:26.958832  1575 raft_consensus.cc:1275] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 12:58:26.959189  1575 pending_rounds.cc:85] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting all ops after (but not including) 0
I20260709 12:58:26.959398  1575 pending_rounds.cc:107] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:58:26.959599  1575 raft_consensus.cc:2889] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:58:26.982982  1915 consensus_queue.cc:1048] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:58:27.064458  1575 raft_consensus.cc:3060] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:27.099817   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:58:27.135628  2285 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:27.137169  2286 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:58:27.139691  2288 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:58:27.142546   431 server_base.cc:1061] running on GCE node
I20260709 12:58:27.144677   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:58:27.144980   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:58:27.145252   431 hybrid_clock.cc:648] HybridClock initialized: now 1783601907145232 us; error 0 us; skew 500 ppm
I20260709 12:58:27.146353   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:58:27.149708   431 webserver.cc:533] Webserver started at http://127.0.107.196:41093/ using document root <none> and password file <none>
I20260709 12:58:27.150347   431 fs_manager.cc:362] Metadata directory not provided
I20260709 12:58:27.150652   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:58:27.151088   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:58:27.152642   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601869227091-431-0/minicluster-data/ts-3-root/instance:
uuid: "05476b84d8f84d76a9a1f51b620a3c66"
format_stamp: "Formatted at 2026-07-09 12:58:27 on dist-test-slave-5mzn"
I20260709 12:58:27.159446   431 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.002s	sys 0.004s
I20260709 12:58:27.164157  2293 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:27.166253   431 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.000s	sys 0.003s
I20260709 12:58:27.166697   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601869227091-431-0/minicluster-data/ts-3-root
uuid: "05476b84d8f84d76a9a1f51b620a3c66"
format_stamp: "Formatted at 2026-07-09 12:58:27 on dist-test-slave-5mzn"
I20260709 12:58:27.167114   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601869227091-431-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601869227091-431-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601869227091-431-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:58:27.179690  1575 raft_consensus.cc:3060] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:58:27.241215   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:58:27.243224   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:58:27.280496   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:58:27.283922   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:58:27.284251   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:27.284619   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:58:27.284857   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:58:27.407743   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.196:34423
I20260709 12:58:27.407847  2356 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.196:34423 every 8 connection(s)
I20260709 12:58:27.443814   431 auto_leader_rebalancer-test.cc:384] add a tserver: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:58:27.478228  2357 heartbeater.cc:344] Connected to a master server at 127.0.107.254:42827
I20260709 12:58:27.479328  2357 heartbeater.cc:461] Registering TS with master...
I20260709 12:58:27.481364  2357 heartbeater.cc:507] Master 127.0.107.254:42827 requested a full tablet report, sending...
I20260709 12:58:27.486021  1473 ts_manager.cc:194] Registered new tserver with Master: 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:58:27.488015  1473 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48478
I20260709 12:58:28.182047  1645 consensus_queue.cc:237] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:28.189193  1724 raft_consensus.cc:1275] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:28.190809  2361 consensus_queue.cc:1048] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:28.206501  1575 raft_consensus.cc:1275] T cfe7eb675393487f87b528a12f16e16e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:28.208127  2361 consensus_queue.cc:1048] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:28.215047  2361 raft_consensus.cc:2955] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:28.220069  1724 raft_consensus.cc:2955] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
W20260709 12:58:28.227627  1615 consensus_peers.cc:597] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e -> Peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423): Couldn't send request to peer 05476b84d8f84d76a9a1f51b620a3c66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cfe7eb675393487f87b528a12f16e16e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:28.244750  1575 raft_consensus.cc:2955] T cfe7eb675393487f87b528a12f16e16e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:28.252013  1473 catalog_manager.cc:5697] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:28.271652  1724 consensus_queue.cc:237] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:28.352820  1643 raft_consensus.cc:1275] T 566c1a1cfdfa47a2aee520e28f352064 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:28.363035  2375 consensus_queue.cc:1048] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:28.381477  1575 raft_consensus.cc:1275] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:28.394275  2377 raft_consensus.cc:2955] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:28.399678  1915 consensus_queue.cc:1048] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:28.407393  1645 raft_consensus.cc:2955] T 566c1a1cfdfa47a2aee520e28f352064 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
W20260709 12:58:28.427842  1689 consensus_peers.cc:597] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423): Couldn't send request to peer 05476b84d8f84d76a9a1f51b620a3c66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 566c1a1cfdfa47a2aee520e28f352064. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:28.430400  1648 consensus_queue.cc:237] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:28.425495  1471 catalog_manager.cc:5697] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:28.420042  1575 raft_consensus.cc:2955] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:28.458798  1720 raft_consensus.cc:1275] T 05713611987147e49a96fdf32bb28649 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:28.464092  2093 consensus_queue.cc:1048] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:58:28.466717  1615 consensus_peers.cc:597] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423): Couldn't send request to peer 05476b84d8f84d76a9a1f51b620a3c66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 05713611987147e49a96fdf32bb28649. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:28.471762  1575 raft_consensus.cc:1275] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:28.483528  2093 consensus_queue.cc:1048] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:28.491050  2357 heartbeater.cc:499] Master 127.0.107.254:42827 was elected leader, sending a full tablet report...
I20260709 12:58:28.523165  2193 raft_consensus.cc:2955] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:28.526944  1568 raft_consensus.cc:2955] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:28.553879  1472 catalog_manager.cc:5697] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:28.562839  1724 consensus_queue.cc:237] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:28.581316  1648 raft_consensus.cc:1275] T c998894dcb744ba3825db19244f8207e P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:58:28.582314  1689 consensus_peers.cc:597] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 -> Peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423): Couldn't send request to peer 05476b84d8f84d76a9a1f51b620a3c66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c998894dcb744ba3825db19244f8207e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:28.583969  2375 consensus_queue.cc:1048] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:28.585250  1574 raft_consensus.cc:1275] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:58:28.586948  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 47396.4us
I20260709 12:58:28.594911  2379 consensus_queue.cc:1048] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:28.605893  2377 raft_consensus.cc:2955] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:28.618561  1645 raft_consensus.cc:2955] T c998894dcb744ba3825db19244f8207e P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:28.634819  1724 raft_consensus.cc:2955] T 05713611987147e49a96fdf32bb28649 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:28.648113  1471 catalog_manager.cc:5697] T c998894dcb744ba3825db19244f8207e P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:28.672426  1574 raft_consensus.cc:2955] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:28.769270  2388 ts_tablet_manager.cc:933] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66: Initiating tablet copy from peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:28.771459  2388 tablet_copy_client.cc:323] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:37391
I20260709 12:58:28.821908  2392 ts_tablet_manager.cc:933] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66: Initiating tablet copy from peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:28.832276  1661 tablet_copy_service.cc:140] P 4dbe7d47a2374afca075d3a98583b49e: Received BeginTabletCopySession request for tablet cfe7eb675393487f87b528a12f16e16e from peer 05476b84d8f84d76a9a1f51b620a3c66 ({username='slave'} at 127.0.0.1:57912)
I20260709 12:58:28.833001  1661 tablet_copy_service.cc:161] P 4dbe7d47a2374afca075d3a98583b49e: Beginning new tablet copy session on tablet cfe7eb675393487f87b528a12f16e16e from peer 05476b84d8f84d76a9a1f51b620a3c66 at {username='slave'} at 127.0.0.1:57912: session id = 05476b84d8f84d76a9a1f51b620a3c66-cfe7eb675393487f87b528a12f16e16e
I20260709 12:58:28.845116  1661 tablet_copy_source_session.cc:215] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:28.848578  2392 tablet_copy_client.cc:323] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:45473
I20260709 12:58:28.849795  2388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfe7eb675393487f87b528a12f16e16e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:28.888252  1735 tablet_copy_service.cc:140] P 0c7751452c4b46afa95251b9df7169d4: Received BeginTabletCopySession request for tablet 566c1a1cfdfa47a2aee520e28f352064 from peer 05476b84d8f84d76a9a1f51b620a3c66 ({username='slave'} at 127.0.0.1:58782)
I20260709 12:58:28.888948  1735 tablet_copy_service.cc:161] P 0c7751452c4b46afa95251b9df7169d4: Beginning new tablet copy session on tablet 566c1a1cfdfa47a2aee520e28f352064 from peer 05476b84d8f84d76a9a1f51b620a3c66 at {username='slave'} at 127.0.0.1:58782: session id = 05476b84d8f84d76a9a1f51b620a3c66-566c1a1cfdfa47a2aee520e28f352064
I20260709 12:58:28.903152  1735 tablet_copy_source_session.cc:215] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:28.903959  2388 tablet_copy_client.cc:806] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:28.906150  2388 tablet_copy_client.cc:670] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:28.932658  2388 tablet_copy_client.cc:538] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:28.937965  2392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 566c1a1cfdfa47a2aee520e28f352064. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:28.950485  2388 tablet_bootstrap.cc:492] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap starting.
I20260709 12:58:28.966681  2392 tablet_copy_client.cc:806] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:28.967428  2392 tablet_copy_client.cc:670] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:28.974602  2392 tablet_copy_client.cc:538] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:28.986439  2392 tablet_bootstrap.cc:492] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap starting.
I20260709 12:58:29.012576  2388 tablet_bootstrap.cc:492] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:29.013625  2388 tablet_bootstrap.cc:492] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap complete.
I20260709 12:58:29.017315  2388 ts_tablet_manager.cc:1403] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66: Time spent bootstrapping tablet: real 0.067s	user 0.020s	sys 0.012s
I20260709 12:58:29.022284  2388 raft_consensus.cc:359] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:29.023205  2388 raft_consensus.cc:740] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Initialized, Role: LEARNER
I20260709 12:58:29.024232  2388 consensus_queue.cc:260] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:29.089836  2398 ts_tablet_manager.cc:933] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66: Initiating tablet copy from peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:29.095882  2392 tablet_bootstrap.cc:492] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:29.101971  2392 tablet_bootstrap.cc:492] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap complete.
I20260709 12:58:29.102825  2392 ts_tablet_manager.cc:1403] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent bootstrapping tablet: real 0.117s	user 0.025s	sys 0.017s
I20260709 12:58:29.106123  2398 tablet_copy_client.cc:323] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:37391
I20260709 12:58:29.106565  2388 ts_tablet_manager.cc:1434] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66: Time spent starting tablet: real 0.089s	user 0.021s	sys 0.024s
I20260709 12:58:29.108232  1661 tablet_copy_service.cc:140] P 4dbe7d47a2374afca075d3a98583b49e: Received BeginTabletCopySession request for tablet 05713611987147e49a96fdf32bb28649 from peer 05476b84d8f84d76a9a1f51b620a3c66 ({username='slave'} at 127.0.0.1:57912)
I20260709 12:58:29.108774  1661 tablet_copy_service.cc:161] P 4dbe7d47a2374afca075d3a98583b49e: Beginning new tablet copy session on tablet 05713611987147e49a96fdf32bb28649 from peer 05476b84d8f84d76a9a1f51b620a3c66 at {username='slave'} at 127.0.0.1:57912: session id = 05476b84d8f84d76a9a1f51b620a3c66-05713611987147e49a96fdf32bb28649
I20260709 12:58:29.117094  1661 tablet_copy_source_session.cc:215] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:29.105792  2392 raft_consensus.cc:359] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:29.120034  2392 raft_consensus.cc:740] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Initialized, Role: LEARNER
I20260709 12:58:29.120478  2398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 05713611987147e49a96fdf32bb28649. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:29.120791  2392 consensus_queue.cc:260] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:29.123034  2392 ts_tablet_manager.cc:1434] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent starting tablet: real 0.020s	user 0.002s	sys 0.002s
I20260709 12:58:29.124941  1735 tablet_copy_service.cc:342] P 0c7751452c4b46afa95251b9df7169d4: Request end of tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-566c1a1cfdfa47a2aee520e28f352064 received from {username='slave'} at 127.0.0.1:58782
I20260709 12:58:29.125413  1735 tablet_copy_service.cc:434] P 0c7751452c4b46afa95251b9df7169d4: ending tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-566c1a1cfdfa47a2aee520e28f352064 on tablet 566c1a1cfdfa47a2aee520e28f352064 with peer 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:58:29.128645  1661 tablet_copy_service.cc:342] P 4dbe7d47a2374afca075d3a98583b49e: Request end of tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-cfe7eb675393487f87b528a12f16e16e received from {username='slave'} at 127.0.0.1:57912
I20260709 12:58:29.129158  1661 tablet_copy_service.cc:434] P 4dbe7d47a2374afca075d3a98583b49e: ending tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-cfe7eb675393487f87b528a12f16e16e on tablet cfe7eb675393487f87b528a12f16e16e with peer 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:58:29.164000  2398 tablet_copy_client.cc:806] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:29.164836  2398 tablet_copy_client.cc:670] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:29.179888  2388 ts_tablet_manager.cc:933] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66: Initiating tablet copy from peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:29.180994  2398 tablet_copy_client.cc:538] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:29.204433  2398 tablet_bootstrap.cc:492] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap starting.
I20260709 12:58:29.229401  2388 tablet_copy_client.cc:323] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:45473
I20260709 12:58:29.231529  1735 tablet_copy_service.cc:140] P 0c7751452c4b46afa95251b9df7169d4: Received BeginTabletCopySession request for tablet c998894dcb744ba3825db19244f8207e from peer 05476b84d8f84d76a9a1f51b620a3c66 ({username='slave'} at 127.0.0.1:58782)
I20260709 12:58:29.232110  1735 tablet_copy_service.cc:161] P 0c7751452c4b46afa95251b9df7169d4: Beginning new tablet copy session on tablet c998894dcb744ba3825db19244f8207e from peer 05476b84d8f84d76a9a1f51b620a3c66 at {username='slave'} at 127.0.0.1:58782: session id = 05476b84d8f84d76a9a1f51b620a3c66-c998894dcb744ba3825db19244f8207e
I20260709 12:58:29.255827  1735 tablet_copy_source_session.cc:215] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:29.259572  2388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c998894dcb744ba3825db19244f8207e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:29.278102  2388 tablet_copy_client.cc:806] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:29.278829  2388 tablet_copy_client.cc:670] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:29.287540  2332 raft_consensus.cc:1217] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:29.312143  2388 tablet_copy_client.cc:538] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:29.344758  2398 tablet_bootstrap.cc:492] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:29.347283  2332 raft_consensus.cc:1217] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:29.349792  2398 tablet_bootstrap.cc:492] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap complete.
I20260709 12:58:29.350446  2388 tablet_bootstrap.cc:492] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap starting.
I20260709 12:58:29.350632  2398 ts_tablet_manager.cc:1403] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent bootstrapping tablet: real 0.146s	user 0.013s	sys 0.020s
I20260709 12:58:29.353921  2398 raft_consensus.cc:359] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:29.354992  2398 raft_consensus.cc:740] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Initialized, Role: LEARNER
I20260709 12:58:29.355836  2398 consensus_queue.cc:260] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:29.364605  2398 ts_tablet_manager.cc:1434] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:58:29.367168  1661 tablet_copy_service.cc:342] P 4dbe7d47a2374afca075d3a98583b49e: Request end of tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-05713611987147e49a96fdf32bb28649 received from {username='slave'} at 127.0.0.1:57912
I20260709 12:58:29.367630  1661 tablet_copy_service.cc:434] P 4dbe7d47a2374afca075d3a98583b49e: ending tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-05713611987147e49a96fdf32bb28649 on tablet 05713611987147e49a96fdf32bb28649 with peer 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:58:29.388228  2388 tablet_bootstrap.cc:492] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:29.389653  2388 tablet_bootstrap.cc:492] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap complete.
I20260709 12:58:29.395151  2388 ts_tablet_manager.cc:1403] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66: Time spent bootstrapping tablet: real 0.045s	user 0.018s	sys 0.012s
I20260709 12:58:29.398463  2388 raft_consensus.cc:359] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:29.399291  2388 raft_consensus.cc:740] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Initialized, Role: LEARNER
I20260709 12:58:29.399988  2388 consensus_queue.cc:260] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:29.402868  2388 ts_tablet_manager.cc:1434] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:58:29.404698  1735 tablet_copy_service.cc:342] P 0c7751452c4b46afa95251b9df7169d4: Request end of tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-c998894dcb744ba3825db19244f8207e received from {username='slave'} at 127.0.0.1:58782
I20260709 12:58:29.405174  1735 tablet_copy_service.cc:434] P 0c7751452c4b46afa95251b9df7169d4: ending tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-c998894dcb744ba3825db19244f8207e on tablet c998894dcb744ba3825db19244f8207e with peer 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:58:29.460594  2332 raft_consensus.cc:1217] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:29.568799  2332 raft_consensus.cc:1217] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:29.807713  2159 raft_consensus.cc:1064] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4: attempting to promote NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 to VOTER
I20260709 12:58:29.810724  2159 consensus_queue.cc:237] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:29.866894  2332 raft_consensus.cc:1275] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:29.868383  1645 raft_consensus.cc:1275] T 566c1a1cfdfa47a2aee520e28f352064 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:29.868896  2403 consensus_queue.cc:1048] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:29.870878  2403 consensus_queue.cc:1048] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:29.879688  1568 raft_consensus.cc:1275] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:29.969818  2413 consensus_queue.cc:1048] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:29.945966  2375 raft_consensus.cc:2955] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:29.984764  2413 raft_consensus.cc:1064] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4: attempting to promote NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 to VOTER
I20260709 12:58:29.950470  2332 raft_consensus.cc:2955] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:29.994879  2413 consensus_queue.cc:237] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:30.028369  2402 raft_consensus.cc:1064] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e: attempting to promote NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 to VOTER
I20260709 12:58:30.033453  2384 raft_consensus.cc:1064] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e: attempting to promote NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 to VOTER
I20260709 12:58:30.032294  2402 consensus_queue.cc:237] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:30.040891  2384 consensus_queue.cc:237] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:30.043995  1575 raft_consensus.cc:2955] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:30.058030  2332 raft_consensus.cc:1275] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:30.063052  2159 consensus_queue.cc:1048] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:30.067903  1472 catalog_manager.cc:5697] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:30.073887  1568 raft_consensus.cc:1275] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:30.076794  2403 consensus_queue.cc:1048] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:30.088845  1643 raft_consensus.cc:1275] T c998894dcb744ba3825db19244f8207e P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:30.099591  1643 raft_consensus.cc:2955] T 566c1a1cfdfa47a2aee520e28f352064 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:30.107488  2413 consensus_queue.cc:1048] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:30.175746  2375 raft_consensus.cc:2955] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:30.183805  2332 raft_consensus.cc:2955] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:30.213732  1716 raft_consensus.cc:1275] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:30.218451  2331 raft_consensus.cc:1275] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:30.221959  1568 raft_consensus.cc:1275] T cfe7eb675393487f87b528a12f16e16e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:30.222414  1574 raft_consensus.cc:1275] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:30.223743  1724 raft_consensus.cc:1275] T 05713611987147e49a96fdf32bb28649 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:30.224203  2361 consensus_queue.cc:1048] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:30.226311  2361 consensus_queue.cc:1048] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:30.228358  2414 consensus_queue.cc:1048] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:30.228047  2423 consensus_queue.cc:1048] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:30.249264  2332 raft_consensus.cc:1275] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:30.237746  2361 consensus_queue.cc:1048] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:58:30.258379  2414 consensus_queue.cc:1048] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:30.279568  1569 raft_consensus.cc:2955] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:30.263574  1645 raft_consensus.cc:2955] T c998894dcb744ba3825db19244f8207e P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
W20260709 12:58:30.455230  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 89068.7us
W20260709 12:58:30.488080  2426 log.cc:927] Time spent T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 12:58:30.496183  2427 log.cc:927] Time spent T cfe7eb675393487f87b528a12f16e16e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
W20260709 12:58:30.549643  2422 log.cc:927] Time spent T c998894dcb744ba3825db19244f8207e P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.068s	user 0.004s	sys 0.000s
W20260709 12:58:30.564368  2432 log.cc:927] Time spent T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.077s	user 0.003s	sys 0.000s
W20260709 12:58:30.568053  2434 log.cc:927] Time spent T 05713611987147e49a96fdf32bb28649 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.090s	user 0.001s	sys 0.001s
W20260709 12:58:30.581429  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 102274us
I20260709 12:58:30.601190  2439 raft_consensus.cc:2955] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:30.619839  2384 raft_consensus.cc:2955] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:30.647255  2332 raft_consensus.cc:2955] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:30.653677  2331 raft_consensus.cc:2955] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:30.658242  1574 raft_consensus.cc:2955] T cfe7eb675393487f87b528a12f16e16e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:30.666674  1716 raft_consensus.cc:2955] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:30.667274  1474 catalog_manager.cc:5697] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:30.669742  1720 raft_consensus.cc:2955] T 05713611987147e49a96fdf32bb28649 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:30.689888  1471 catalog_manager.cc:5697] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:30.695446  1474 catalog_manager.cc:5697] T cfe7eb675393487f87b528a12f16e16e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:30.728611  1574 raft_consensus.cc:2955] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:30.769557  1651 consensus_queue.cc:237] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:30.788126  1651 consensus_queue.cc:237] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:30.793959  2332 raft_consensus.cc:1275] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:30.802537  2431 consensus_queue.cc:1048] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:30.802826  2332 raft_consensus.cc:1275] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:30.806965  1572 raft_consensus.cc:1275] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:30.804651  2442 consensus_queue.cc:1048] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:30.810765  2442 consensus_queue.cc:1048] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:30.811578  2436 raft_consensus.cc:2955] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:30.820060  2331 raft_consensus.cc:2955] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:30.838877  1724 raft_consensus.cc:1275] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:30.844244  2332 raft_consensus.cc:2955] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:30.845418  2442 raft_consensus.cc:2955] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:30.861227  1471 catalog_manager.cc:5697] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: config changed from index 3 to 4, VOTER 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:30.855820  1572 raft_consensus.cc:2955] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:30.864673  1721 consensus_queue.cc:237] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:30.865841  1724 consensus_queue.cc:237] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:30.876132  2439 consensus_queue.cc:1048] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:30.880338  2331 raft_consensus.cc:1275] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:30.880676  1573 raft_consensus.cc:1275] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:30.883690  1574 raft_consensus.cc:1275] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:30.884581  1471 catalog_manager.cc:5697] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: config changed from index 3 to 4, VOTER 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:30.886893  1565 tablet_service.cc:1558] Processing DeleteTablet for tablet cfe7eb675393487f87b528a12f16e16e with delete_type TABLET_DATA_TOMBSTONED (TS 89ac9d5e2fbc4536b03a1ff1dd3eb226 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36626
I20260709 12:58:30.887971  2435 consensus_queue.cc:1048] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:30.890612  2433 consensus_queue.cc:1048] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:30.892133  2435 consensus_queue.cc:1048] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:30.892045  1721 raft_consensus.cc:2955] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:30.898988  2332 raft_consensus.cc:1275] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:30.931591  1458 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cfe7eb675393487f87b528a12f16e16e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:30.931852  1706 tablet_service.cc:1558] Processing DeleteTablet for tablet 05713611987147e49a96fdf32bb28649 with delete_type TABLET_DATA_TOMBSTONED (TS 0c7751452c4b46afa95251b9df7169d4 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49982
I20260709 12:58:30.932677  1458 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 05713611987147e49a96fdf32bb28649 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:30.949352  2404 raft_consensus.cc:2955] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:30.949997  1572 raft_consensus.cc:2955] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:30.961094  2430 raft_consensus.cc:2955] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:30.966316  2412 consensus_queue.cc:1048] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:58:30.981741  1569 raft_consensus.cc:2955] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:30.991333  2331 raft_consensus.cc:2955] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:31.005661  2332 raft_consensus.cc:2955] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
W20260709 12:58:31.031956  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 43897.9us
I20260709 12:58:31.034001  1471 catalog_manager.cc:5697] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: config changed from index 3 to 4, VOTER 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:31.048364  1473 catalog_manager.cc:5697] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: config changed from index 3 to 4, VOTER 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:31.071596  1461 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 566c1a1cfdfa47a2aee520e28f352064 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:31.077378  1634 tablet_service.cc:1558] Processing DeleteTablet for tablet 566c1a1cfdfa47a2aee520e28f352064 with delete_type TABLET_DATA_TOMBSTONED (TS 4dbe7d47a2374afca075d3a98583b49e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45134
I20260709 12:58:31.077970  1639 tablet_service.cc:1558] Processing DeleteTablet for tablet c998894dcb744ba3825db19244f8207e with delete_type TABLET_DATA_TOMBSTONED (TS 4dbe7d47a2374afca075d3a98583b49e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45134
I20260709 12:58:31.096437  2446 tablet_replica.cc:333] T 05713611987147e49a96fdf32bb28649 P 0c7751452c4b46afa95251b9df7169d4: stopping tablet replica
I20260709 12:58:31.076625  2445 tablet_replica.cc:333] T cfe7eb675393487f87b528a12f16e16e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: stopping tablet replica
I20260709 12:58:31.098644  2445 raft_consensus.cc:2243] T cfe7eb675393487f87b528a12f16e16e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:31.099596  2445 raft_consensus.cc:2272] T cfe7eb675393487f87b528a12f16e16e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:31.100554  1461 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c998894dcb744ba3825db19244f8207e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:31.109755  2448 tablet_replica.cc:333] T 566c1a1cfdfa47a2aee520e28f352064 P 4dbe7d47a2374afca075d3a98583b49e: stopping tablet replica
I20260709 12:58:31.113003  2445 ts_tablet_manager.cc:1916] T cfe7eb675393487f87b528a12f16e16e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:31.132085  2445 ts_tablet_manager.cc:1929] T cfe7eb675393487f87b528a12f16e16e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:31.133107  2445 log.cc:1199] T cfe7eb675393487f87b528a12f16e16e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Deleting WAL directory at /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601869227091-431-0/minicluster-data/ts-0-root/wals/cfe7eb675393487f87b528a12f16e16e
I20260709 12:58:31.149410  2446 raft_consensus.cc:2243] T 05713611987147e49a96fdf32bb28649 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:31.146174  1459 catalog_manager.cc:5028] TS 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): tablet cfe7eb675393487f87b528a12f16e16e (table test-workload [id=2e230675e851429db50863dfed56dde5]) successfully deleted
I20260709 12:58:31.156968  2446 raft_consensus.cc:2272] T 05713611987147e49a96fdf32bb28649 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:31.159667  2448 raft_consensus.cc:2243] T 566c1a1cfdfa47a2aee520e28f352064 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:31.160517  2448 raft_consensus.cc:2272] T 566c1a1cfdfa47a2aee520e28f352064 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:31.165048  2448 ts_tablet_manager.cc:1916] T 566c1a1cfdfa47a2aee520e28f352064 P 4dbe7d47a2374afca075d3a98583b49e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:31.171746  2446 ts_tablet_manager.cc:1916] T 05713611987147e49a96fdf32bb28649 P 0c7751452c4b46afa95251b9df7169d4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:31.187433  2448 ts_tablet_manager.cc:1929] T 566c1a1cfdfa47a2aee520e28f352064 P 4dbe7d47a2374afca075d3a98583b49e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:31.188097  2448 log.cc:1199] T 566c1a1cfdfa47a2aee520e28f352064 P 4dbe7d47a2374afca075d3a98583b49e: Deleting WAL directory at /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601869227091-431-0/minicluster-data/ts-1-root/wals/566c1a1cfdfa47a2aee520e28f352064
I20260709 12:58:31.197671  1458 catalog_manager.cc:5028] TS 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): tablet 566c1a1cfdfa47a2aee520e28f352064 (table test-workload [id=2e230675e851429db50863dfed56dde5]) successfully deleted
I20260709 12:58:31.217342  2448 tablet_replica.cc:333] T c998894dcb744ba3825db19244f8207e P 4dbe7d47a2374afca075d3a98583b49e: stopping tablet replica
I20260709 12:58:31.218641  2448 raft_consensus.cc:2243] T c998894dcb744ba3825db19244f8207e P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:31.219520  2448 raft_consensus.cc:2272] T c998894dcb744ba3825db19244f8207e P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:31.225565  2448 ts_tablet_manager.cc:1916] T c998894dcb744ba3825db19244f8207e P 4dbe7d47a2374afca075d3a98583b49e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:31.245649  2448 ts_tablet_manager.cc:1929] T c998894dcb744ba3825db19244f8207e P 4dbe7d47a2374afca075d3a98583b49e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:31.246411  2448 log.cc:1199] T c998894dcb744ba3825db19244f8207e P 4dbe7d47a2374afca075d3a98583b49e: Deleting WAL directory at /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601869227091-431-0/minicluster-data/ts-1-root/wals/c998894dcb744ba3825db19244f8207e
I20260709 12:58:31.248888  1458 catalog_manager.cc:5028] TS 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): tablet c998894dcb744ba3825db19244f8207e (table test-workload [id=2e230675e851429db50863dfed56dde5]) successfully deleted
I20260709 12:58:31.254222  2446 ts_tablet_manager.cc:1929] T 05713611987147e49a96fdf32bb28649 P 0c7751452c4b46afa95251b9df7169d4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:31.254823  2446 log.cc:1199] T 05713611987147e49a96fdf32bb28649 P 0c7751452c4b46afa95251b9df7169d4: Deleting WAL directory at /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601869227091-431-0/minicluster-data/ts-2-root/wals/05713611987147e49a96fdf32bb28649
I20260709 12:58:31.256932  1461 catalog_manager.cc:5028] TS 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): tablet 05713611987147e49a96fdf32bb28649 (table test-workload [id=2e230675e851429db50863dfed56dde5]) successfully deleted
I20260709 12:58:32.193614  1651 consensus_queue.cc:237] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
W20260709 12:58:32.217128  1615 consensus_peers.cc:597] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e -> Peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423): Couldn't send request to peer 05476b84d8f84d76a9a1f51b620a3c66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dfcb63b9010d4a77ad8748087fa07f8a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:32.217760  1574 raft_consensus.cc:1275] T dfcb63b9010d4a77ad8748087fa07f8a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:32.220131  2441 consensus_queue.cc:1048] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:32.224650  1716 raft_consensus.cc:1275] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:32.227716  2442 consensus_queue.cc:1048] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:32.235996  2442 raft_consensus.cc:2955] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:32.241021  1573 raft_consensus.cc:2955] T dfcb63b9010d4a77ad8748087fa07f8a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:32.258690  1651 consensus_queue.cc:237] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:32.264787  1471 catalog_manager.cc:5697] T dfcb63b9010d4a77ad8748087fa07f8a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:32.310900  1573 raft_consensus.cc:1275] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:32.323734  2442 consensus_queue.cc:1048] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:32.329202  1724 raft_consensus.cc:1275] T e66a330b7dae4036b80d239969d5a260 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:58:32.330264  1615 consensus_peers.cc:597] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423): Couldn't send request to peer 05476b84d8f84d76a9a1f51b620a3c66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e66a330b7dae4036b80d239969d5a260. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:32.334353  2442 consensus_queue.cc:1048] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:32.337957  1716 raft_consensus.cc:2955] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:32.351775  2442 raft_consensus.cc:2955] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:32.353804  1572 raft_consensus.cc:2955] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:32.369582  1720 raft_consensus.cc:2955] T e66a330b7dae4036b80d239969d5a260 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:32.387920  1471 catalog_manager.cc:5697] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:32.397639  1651 consensus_queue.cc:237] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
W20260709 12:58:32.412863  1615 consensus_peers.cc:597] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e -> Peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423): Couldn't send request to peer 05476b84d8f84d76a9a1f51b620a3c66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4bc29cd0261846b7847f38862b494d0b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:32.414469  1572 raft_consensus.cc:1275] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:32.415995  2449 consensus_queue.cc:1048] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:32.428053  1716 raft_consensus.cc:1275] T 4bc29cd0261846b7847f38862b494d0b P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:32.430846  2463 raft_consensus.cc:2955] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:32.434445  1573 raft_consensus.cc:2955] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:32.448766  2441 consensus_queue.cc:1048] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:32.459327  1644 consensus_queue.cc:237] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:32.465822  1473 catalog_manager.cc:5697] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
W20260709 12:58:32.484144  1615 consensus_peers.cc:597] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423): Couldn't send request to peer 05476b84d8f84d76a9a1f51b620a3c66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f964296f18474862b1eee102af9116f4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:32.484548  1573 raft_consensus.cc:1275] T f964296f18474862b1eee102af9116f4 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:32.486178  2449 consensus_queue.cc:1048] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:32.490074  1720 raft_consensus.cc:2955] T 4bc29cd0261846b7847f38862b494d0b P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:32.499454  1716 raft_consensus.cc:1275] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:32.500900  2449 consensus_queue.cc:1048] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:32.509856  2449 raft_consensus.cc:2955] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:32.513265  1569 raft_consensus.cc:2955] T f964296f18474862b1eee102af9116f4 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:32.529999  1724 raft_consensus.cc:2955] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:32.557934  1473 catalog_manager.cc:5697] T f964296f18474862b1eee102af9116f4 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:32.623800  2472 ts_tablet_manager.cc:933] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66: Initiating tablet copy from peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:32.626616  2472 tablet_copy_client.cc:323] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:37391
I20260709 12:58:32.628798  1661 tablet_copy_service.cc:140] P 4dbe7d47a2374afca075d3a98583b49e: Received BeginTabletCopySession request for tablet dfcb63b9010d4a77ad8748087fa07f8a from peer 05476b84d8f84d76a9a1f51b620a3c66 ({username='slave'} at 127.0.0.1:57912)
I20260709 12:58:32.629391  1661 tablet_copy_service.cc:161] P 4dbe7d47a2374afca075d3a98583b49e: Beginning new tablet copy session on tablet dfcb63b9010d4a77ad8748087fa07f8a from peer 05476b84d8f84d76a9a1f51b620a3c66 at {username='slave'} at 127.0.0.1:57912: session id = 05476b84d8f84d76a9a1f51b620a3c66-dfcb63b9010d4a77ad8748087fa07f8a
I20260709 12:58:32.639040  1661 tablet_copy_source_session.cc:215] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:32.642935  2472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfcb63b9010d4a77ad8748087fa07f8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:32.677301  2472 tablet_copy_client.cc:806] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:32.678326  2472 tablet_copy_client.cc:670] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:32.684655  2472 tablet_copy_client.cc:538] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:32.693903  2472 tablet_bootstrap.cc:492] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap starting.
I20260709 12:58:32.726876  2472 tablet_bootstrap.cc:492] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:32.727877  2472 tablet_bootstrap.cc:492] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap complete.
I20260709 12:58:32.728686  2472 ts_tablet_manager.cc:1403] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66: Time spent bootstrapping tablet: real 0.035s	user 0.025s	sys 0.005s
I20260709 12:58:32.733800  2472 raft_consensus.cc:359] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:32.734761  2472 raft_consensus.cc:740] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Initialized, Role: LEARNER
I20260709 12:58:32.735548  2472 consensus_queue.cc:260] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:32.745587  2472 ts_tablet_manager.cc:1434] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66: Time spent starting tablet: real 0.017s	user 0.012s	sys 0.001s
I20260709 12:58:32.747673  1661 tablet_copy_service.cc:342] P 4dbe7d47a2374afca075d3a98583b49e: Request end of tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-dfcb63b9010d4a77ad8748087fa07f8a received from {username='slave'} at 127.0.0.1:57912
I20260709 12:58:32.748174  1661 tablet_copy_service.cc:434] P 4dbe7d47a2374afca075d3a98583b49e: ending tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-dfcb63b9010d4a77ad8748087fa07f8a on tablet dfcb63b9010d4a77ad8748087fa07f8a with peer 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:58:32.754200  2472 ts_tablet_manager.cc:933] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66: Initiating tablet copy from peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:32.887385  2472 tablet_copy_client.cc:323] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:37391
I20260709 12:58:32.889117  1661 tablet_copy_service.cc:140] P 4dbe7d47a2374afca075d3a98583b49e: Received BeginTabletCopySession request for tablet e66a330b7dae4036b80d239969d5a260 from peer 05476b84d8f84d76a9a1f51b620a3c66 ({username='slave'} at 127.0.0.1:57912)
I20260709 12:58:32.889740  1661 tablet_copy_service.cc:161] P 4dbe7d47a2374afca075d3a98583b49e: Beginning new tablet copy session on tablet e66a330b7dae4036b80d239969d5a260 from peer 05476b84d8f84d76a9a1f51b620a3c66 at {username='slave'} at 127.0.0.1:57912: session id = 05476b84d8f84d76a9a1f51b620a3c66-e66a330b7dae4036b80d239969d5a260
I20260709 12:58:32.927086  1661 tablet_copy_source_session.cc:215] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:32.931607  2472 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e66a330b7dae4036b80d239969d5a260. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:32.938555  2474 ts_tablet_manager.cc:933] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66: Initiating tablet copy from peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:32.958990  2474 tablet_copy_client.cc:323] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:37391
I20260709 12:58:32.960891  1661 tablet_copy_service.cc:140] P 4dbe7d47a2374afca075d3a98583b49e: Received BeginTabletCopySession request for tablet f964296f18474862b1eee102af9116f4 from peer 05476b84d8f84d76a9a1f51b620a3c66 ({username='slave'} at 127.0.0.1:57912)
I20260709 12:58:32.961411  1661 tablet_copy_service.cc:161] P 4dbe7d47a2374afca075d3a98583b49e: Beginning new tablet copy session on tablet f964296f18474862b1eee102af9116f4 from peer 05476b84d8f84d76a9a1f51b620a3c66 at {username='slave'} at 127.0.0.1:57912: session id = 05476b84d8f84d76a9a1f51b620a3c66-f964296f18474862b1eee102af9116f4
I20260709 12:58:32.973170  1661 tablet_copy_source_session.cc:215] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:32.979766  2474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f964296f18474862b1eee102af9116f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:33.003912  2474 tablet_copy_client.cc:806] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:33.004033  2481 ts_tablet_manager.cc:933] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66: Initiating tablet copy from peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:33.004626  2474 tablet_copy_client.cc:670] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:33.012732  2474 tablet_copy_client.cc:538] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:33.025774  2481 tablet_copy_client.cc:323] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:37391
I20260709 12:58:33.026105  2474 tablet_bootstrap.cc:492] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap starting.
I20260709 12:58:33.027841  1661 tablet_copy_service.cc:140] P 4dbe7d47a2374afca075d3a98583b49e: Received BeginTabletCopySession request for tablet 4bc29cd0261846b7847f38862b494d0b from peer 05476b84d8f84d76a9a1f51b620a3c66 ({username='slave'} at 127.0.0.1:57912)
I20260709 12:58:33.028177  2472 tablet_copy_client.cc:806] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:33.028550  1661 tablet_copy_service.cc:161] P 4dbe7d47a2374afca075d3a98583b49e: Beginning new tablet copy session on tablet 4bc29cd0261846b7847f38862b494d0b from peer 05476b84d8f84d76a9a1f51b620a3c66 at {username='slave'} at 127.0.0.1:57912: session id = 05476b84d8f84d76a9a1f51b620a3c66-4bc29cd0261846b7847f38862b494d0b
I20260709 12:58:33.028832  2472 tablet_copy_client.cc:670] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:33.035028  2472 tablet_copy_client.cc:538] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:33.039052  1661 tablet_copy_source_session.cc:215] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:33.042433  2481 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4bc29cd0261846b7847f38862b494d0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:33.081202  2472 tablet_bootstrap.cc:492] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap starting.
I20260709 12:58:33.094774  2474 tablet_bootstrap.cc:492] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:33.095808  2474 tablet_bootstrap.cc:492] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap complete.
I20260709 12:58:33.096586  2474 ts_tablet_manager.cc:1403] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent bootstrapping tablet: real 0.071s	user 0.023s	sys 0.007s
I20260709 12:58:33.099699  2474 raft_consensus.cc:359] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:33.100597  2474 raft_consensus.cc:740] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Initialized, Role: LEARNER
I20260709 12:58:33.112870  2474 consensus_queue.cc:260] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:33.125541  2474 ts_tablet_manager.cc:1434] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 12:58:33.128876  2481 tablet_copy_client.cc:806] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:33.131453  2481 tablet_copy_client.cc:670] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:33.133752  1661 tablet_copy_service.cc:342] P 4dbe7d47a2374afca075d3a98583b49e: Request end of tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-f964296f18474862b1eee102af9116f4 received from {username='slave'} at 127.0.0.1:57912
I20260709 12:58:33.134277  1661 tablet_copy_service.cc:434] P 4dbe7d47a2374afca075d3a98583b49e: ending tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-f964296f18474862b1eee102af9116f4 on tablet f964296f18474862b1eee102af9116f4 with peer 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:58:33.144316  2481 tablet_copy_client.cc:538] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:33.153537  2481 tablet_bootstrap.cc:492] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap starting.
I20260709 12:58:33.169078  2472 tablet_bootstrap.cc:492] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:33.170032  2472 tablet_bootstrap.cc:492] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap complete.
I20260709 12:58:33.170743  2472 ts_tablet_manager.cc:1403] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent bootstrapping tablet: real 0.090s	user 0.023s	sys 0.006s
I20260709 12:58:33.173730  2472 raft_consensus.cc:359] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:33.174588  2472 raft_consensus.cc:740] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Initialized, Role: LEARNER
I20260709 12:58:33.176362  2472 consensus_queue.cc:260] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:33.179212  2472 ts_tablet_manager.cc:1434] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:58:33.181521  2481 tablet_bootstrap.cc:492] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:33.182674  1661 tablet_copy_service.cc:342] P 4dbe7d47a2374afca075d3a98583b49e: Request end of tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-e66a330b7dae4036b80d239969d5a260 received from {username='slave'} at 127.0.0.1:57912
I20260709 12:58:33.183085  2481 tablet_bootstrap.cc:492] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap complete.
I20260709 12:58:33.183200  1661 tablet_copy_service.cc:434] P 4dbe7d47a2374afca075d3a98583b49e: ending tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-e66a330b7dae4036b80d239969d5a260 on tablet e66a330b7dae4036b80d239969d5a260 with peer 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:58:33.183882  2481 ts_tablet_manager.cc:1403] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66: Time spent bootstrapping tablet: real 0.031s	user 0.024s	sys 0.004s
I20260709 12:58:33.187148  2481 raft_consensus.cc:359] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:33.188122  2481 raft_consensus.cc:740] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Initialized, Role: LEARNER
I20260709 12:58:33.188947  2481 consensus_queue.cc:260] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:33.191823  2481 ts_tablet_manager.cc:1434] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:58:33.193692  1661 tablet_copy_service.cc:342] P 4dbe7d47a2374afca075d3a98583b49e: Request end of tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-4bc29cd0261846b7847f38862b494d0b received from {username='slave'} at 127.0.0.1:57912
I20260709 12:58:33.194283  1661 tablet_copy_service.cc:434] P 4dbe7d47a2374afca075d3a98583b49e: ending tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-4bc29cd0261846b7847f38862b494d0b on tablet 4bc29cd0261846b7847f38862b494d0b with peer 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:58:33.213230  2331 raft_consensus.cc:1217] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:33.236055  2331 raft_consensus.cc:1217] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:33.280726  2331 raft_consensus.cc:1217] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:33.312192  2331 raft_consensus.cc:1217] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:33.726116  2467 raft_consensus.cc:1064] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e: attempting to promote NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 to VOTER
I20260709 12:58:33.728147  2467 consensus_queue.cc:237] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:33.741467  1720 raft_consensus.cc:1275] T 4bc29cd0261846b7847f38862b494d0b P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:33.743633  2332 raft_consensus.cc:1275] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:33.745070  1573 raft_consensus.cc:1275] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:33.746656  2486 consensus_queue.cc:1048] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:33.748227  2442 raft_consensus.cc:1064] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e: attempting to promote NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 to VOTER
I20260709 12:58:33.750771  2442 consensus_queue.cc:237] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:33.751685  2463 consensus_queue.cc:1048] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:33.752772  2441 consensus_queue.cc:1048] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:33.780418  2330 raft_consensus.cc:1275] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:33.793030  1716 raft_consensus.cc:1275] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:33.796192  2442 consensus_queue.cc:1048] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:33.807497  2442 consensus_queue.cc:1048] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:33.808426  1569 raft_consensus.cc:1275] T f964296f18474862b1eee102af9116f4 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:33.809511  2488 raft_consensus.cc:1064] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e: attempting to promote NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 to VOTER
I20260709 12:58:33.809835  2486 raft_consensus.cc:1064] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e: attempting to promote NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 to VOTER
I20260709 12:58:33.812031  2488 consensus_queue.cc:237] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:33.826072  2486 consensus_queue.cc:237] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:33.862293  1716 raft_consensus.cc:1275] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:33.890688  2488 consensus_queue.cc:1048] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:33.894455  2330 raft_consensus.cc:1275] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:33.909549  1569 raft_consensus.cc:1275] T dfcb63b9010d4a77ad8748087fa07f8a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:33.943223  2488 consensus_queue.cc:1048] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:33.973043  2488 consensus_queue.cc:1048] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:33.975047  2463 consensus_queue.cc:1048] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:34.002074  1721 raft_consensus.cc:1275] T e66a330b7dae4036b80d239969d5a260 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:34.007135  1574 raft_consensus.cc:1275] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:34.011053  2488 consensus_queue.cc:1048] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:34.011976  2490 raft_consensus.cc:2955] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:34.012257  2463 raft_consensus.cc:2955] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:34.027616  2332 raft_consensus.cc:1275] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:34.027807  2467 consensus_queue.cc:1048] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:34.039013  1574 raft_consensus.cc:2955] T f964296f18474862b1eee102af9116f4 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:34.031092  2330 raft_consensus.cc:2955] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:34.033530  2329 raft_consensus.cc:2955] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:34.045560  1721 raft_consensus.cc:2955] T 4bc29cd0261846b7847f38862b494d0b P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:34.049186  1724 raft_consensus.cc:2955] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:34.039312  1471 catalog_manager.cc:5697] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:34.058653  2486 consensus_queue.cc:1048] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:58:34.061798  2499 log.cc:927] Time spent T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:58:34.065089  1573 raft_consensus.cc:2955] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:34.082453  2488 raft_consensus.cc:2955] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:34.100603  2442 raft_consensus.cc:2955] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:34.100587  1573 raft_consensus.cc:2955] T dfcb63b9010d4a77ad8748087fa07f8a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:34.116266  2332 raft_consensus.cc:2955] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:34.130754  1569 raft_consensus.cc:2955] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:34.137782  1724 raft_consensus.cc:2955] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:34.138859  1716 raft_consensus.cc:2955] T e66a330b7dae4036b80d239969d5a260 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:34.156597  2331 raft_consensus.cc:2955] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:34.183287  1472 catalog_manager.cc:5697] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:34.211829  1471 catalog_manager.cc:5697] T dfcb63b9010d4a77ad8748087fa07f8a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:34.218190  1471 catalog_manager.cc:5697] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:34.247023  1648 consensus_queue.cc:237] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:34.256287  2331 raft_consensus.cc:1275] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:34.257311  1574 raft_consensus.cc:1275] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:34.258705  2486 consensus_queue.cc:1048] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:34.260471  2486 consensus_queue.cc:1048] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:34.267108  1644 consensus_queue.cc:237] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:34.268481  2488 raft_consensus.cc:2955] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:34.273665  1648 consensus_queue.cc:237] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:34.275424  2331 raft_consensus.cc:1275] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:34.275187  2332 raft_consensus.cc:2955] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:34.277434  2467 consensus_queue.cc:1048] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:34.278262  1574 raft_consensus.cc:2955] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:34.300992  1716 raft_consensus.cc:1275] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:34.303323  1458 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4bc29cd0261846b7847f38862b494d0b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:34.307631  2332 raft_consensus.cc:1275] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:34.310999  2467 consensus_queue.cc:1048] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:34.316226  2486 consensus_queue.cc:1048] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:34.319633  1716 raft_consensus.cc:1275] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:34.326079  2441 raft_consensus.cc:2955] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:34.328431  2463 raft_consensus.cc:2955] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:34.333554  1471 catalog_manager.cc:5697] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: config changed from index 3 to 4, VOTER 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:34.337838  1458 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f964296f18474862b1eee102af9116f4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:34.308379  1644 consensus_queue.cc:237] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:34.348950  2332 raft_consensus.cc:2955] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:34.353190  1706 tablet_service.cc:1558] Processing DeleteTablet for tablet 4bc29cd0261846b7847f38862b494d0b with delete_type TABLET_DATA_TOMBSTONED (TS 0c7751452c4b46afa95251b9df7169d4 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49982
I20260709 12:58:34.358884  2331 raft_consensus.cc:2955] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:34.363361  1458 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet dfcb63b9010d4a77ad8748087fa07f8a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:34.370806  2488 consensus_queue.cc:1048] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:34.378510  2329 raft_consensus.cc:1275] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:34.380916  1569 raft_consensus.cc:1275] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:34.385504  2488 consensus_queue.cc:1048] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:34.388366  2441 consensus_queue.cc:1048] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:34.389086  1471 catalog_manager.cc:5697] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: config changed from index 3 to 4, VOTER 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:34.391078  1471 catalog_manager.cc:5697] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: config changed from index 3 to 4, VOTER 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:34.406131  2513 tablet_replica.cc:333] T 4bc29cd0261846b7847f38862b494d0b P 0c7751452c4b46afa95251b9df7169d4: stopping tablet replica
I20260709 12:58:34.413383  2513 raft_consensus.cc:2243] T 4bc29cd0261846b7847f38862b494d0b P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:34.419453  1561 tablet_service.cc:1558] Processing DeleteTablet for tablet dfcb63b9010d4a77ad8748087fa07f8a with delete_type TABLET_DATA_TOMBSTONED (TS 89ac9d5e2fbc4536b03a1ff1dd3eb226 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36626
I20260709 12:58:34.419740  2513 raft_consensus.cc:2272] T 4bc29cd0261846b7847f38862b494d0b P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.414451  1565 tablet_service.cc:1558] Processing DeleteTablet for tablet f964296f18474862b1eee102af9116f4 with delete_type TABLET_DATA_TOMBSTONED (TS 89ac9d5e2fbc4536b03a1ff1dd3eb226 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36626
I20260709 12:58:34.407476  2441 raft_consensus.cc:2955] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:34.417313  1574 raft_consensus.cc:2955] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:34.450184  2513 ts_tablet_manager.cc:1916] T 4bc29cd0261846b7847f38862b494d0b P 0c7751452c4b46afa95251b9df7169d4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:34.459488  2332 raft_consensus.cc:2955] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:34.460772  2514 tablet_replica.cc:333] T dfcb63b9010d4a77ad8748087fa07f8a P 89ac9d5e2fbc4536b03a1ff1dd3eb226: stopping tablet replica
I20260709 12:58:34.470523  2514 raft_consensus.cc:2243] T dfcb63b9010d4a77ad8748087fa07f8a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:34.473130  1724 raft_consensus.cc:2955] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:34.473476  1716 raft_consensus.cc:2955] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:34.501904  1474 catalog_manager.cc:5697] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: config changed from index 3 to 4, VOTER 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:34.506824  1458 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e66a330b7dae4036b80d239969d5a260 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:34.520026  1706 tablet_service.cc:1558] Processing DeleteTablet for tablet e66a330b7dae4036b80d239969d5a260 with delete_type TABLET_DATA_TOMBSTONED (TS 0c7751452c4b46afa95251b9df7169d4 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49982
I20260709 12:58:34.524142  2514 raft_consensus.cc:2272] T dfcb63b9010d4a77ad8748087fa07f8a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.532471  2514 ts_tablet_manager.cc:1916] T dfcb63b9010d4a77ad8748087fa07f8a P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:34.548882  2513 ts_tablet_manager.cc:1929] T 4bc29cd0261846b7847f38862b494d0b P 0c7751452c4b46afa95251b9df7169d4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:34.549475  2513 log.cc:1199] T 4bc29cd0261846b7847f38862b494d0b P 0c7751452c4b46afa95251b9df7169d4: Deleting WAL directory at /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601869227091-431-0/minicluster-data/ts-2-root/wals/4bc29cd0261846b7847f38862b494d0b
I20260709 12:58:34.552865  2513 tablet_replica.cc:333] T e66a330b7dae4036b80d239969d5a260 P 0c7751452c4b46afa95251b9df7169d4: stopping tablet replica
I20260709 12:58:34.554033  2513 raft_consensus.cc:2243] T e66a330b7dae4036b80d239969d5a260 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:34.555012  2513 raft_consensus.cc:2272] T e66a330b7dae4036b80d239969d5a260 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.553131  1461 catalog_manager.cc:5028] TS 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): tablet 4bc29cd0261846b7847f38862b494d0b (table test-workload [id=2e230675e851429db50863dfed56dde5]) successfully deleted
I20260709 12:58:34.560926  2513 ts_tablet_manager.cc:1916] T e66a330b7dae4036b80d239969d5a260 P 0c7751452c4b46afa95251b9df7169d4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:34.571120  2514 ts_tablet_manager.cc:1929] T dfcb63b9010d4a77ad8748087fa07f8a P 89ac9d5e2fbc4536b03a1ff1dd3eb226: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:34.571674  2514 log.cc:1199] T dfcb63b9010d4a77ad8748087fa07f8a P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Deleting WAL directory at /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601869227091-431-0/minicluster-data/ts-0-root/wals/dfcb63b9010d4a77ad8748087fa07f8a
I20260709 12:58:34.574975  2514 tablet_replica.cc:333] T f964296f18474862b1eee102af9116f4 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: stopping tablet replica
I20260709 12:58:34.575193  1459 catalog_manager.cc:5028] TS 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): tablet dfcb63b9010d4a77ad8748087fa07f8a (table test-workload [id=2e230675e851429db50863dfed56dde5]) successfully deleted
I20260709 12:58:34.576138  2514 raft_consensus.cc:2243] T f964296f18474862b1eee102af9116f4 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:34.577804  2514 raft_consensus.cc:2272] T f964296f18474862b1eee102af9116f4 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:34.581246  2514 ts_tablet_manager.cc:1916] T f964296f18474862b1eee102af9116f4 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:34.600088  2514 ts_tablet_manager.cc:1929] T f964296f18474862b1eee102af9116f4 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:34.600581  2514 log.cc:1199] T f964296f18474862b1eee102af9116f4 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Deleting WAL directory at /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601869227091-431-0/minicluster-data/ts-0-root/wals/f964296f18474862b1eee102af9116f4
I20260709 12:58:34.602794  1459 catalog_manager.cc:5028] TS 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): tablet f964296f18474862b1eee102af9116f4 (table test-workload [id=2e230675e851429db50863dfed56dde5]) successfully deleted
I20260709 12:58:34.602445  2513 ts_tablet_manager.cc:1929] T e66a330b7dae4036b80d239969d5a260 P 0c7751452c4b46afa95251b9df7169d4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:34.603869  2513 log.cc:1199] T e66a330b7dae4036b80d239969d5a260 P 0c7751452c4b46afa95251b9df7169d4: Deleting WAL directory at /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601869227091-431-0/minicluster-data/ts-2-root/wals/e66a330b7dae4036b80d239969d5a260
I20260709 12:58:34.605508  1461 catalog_manager.cc:5028] TS 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): tablet e66a330b7dae4036b80d239969d5a260 (table test-workload [id=2e230675e851429db50863dfed56dde5]) successfully deleted
I20260709 12:58:35.591747  1720 consensus_queue.cc:237] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:35.598968  1645 raft_consensus.cc:1275] T 73452eca85a147fb9d862dd08d54e340 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:58:35.599471  1689 consensus_peers.cc:597] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423): Couldn't send request to peer 05476b84d8f84d76a9a1f51b620a3c66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 73452eca85a147fb9d862dd08d54e340. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:35.600107  1572 raft_consensus.cc:1275] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:35.600642  2452 consensus_queue.cc:1048] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:35.601608  2458 consensus_queue.cc:1048] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:35.614174  1572 raft_consensus.cc:2955] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:35.619158  1645 raft_consensus.cc:2955] T 73452eca85a147fb9d862dd08d54e340 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:35.610962  2517 raft_consensus.cc:2955] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:35.634888  1474 catalog_manager.cc:5697] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:35.643260  1645 consensus_queue.cc:237] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:35.651081  1724 raft_consensus.cc:1275] T bfb3b560711b4d7eb23f2aff3e4ca991 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:58:35.651418  1615 consensus_peers.cc:597] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423): Couldn't send request to peer 05476b84d8f84d76a9a1f51b620a3c66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bfb3b560711b4d7eb23f2aff3e4ca991. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:35.652078  1572 raft_consensus.cc:1275] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:35.652835  2518 consensus_queue.cc:1048] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:35.653856  2441 consensus_queue.cc:1048] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:35.671092  2518 raft_consensus.cc:2955] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:35.679328  1569 raft_consensus.cc:2955] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:35.698187  1471 catalog_manager.cc:5697] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:35.692057  1720 consensus_queue.cc:237] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:35.709882  1724 raft_consensus.cc:2955] T bfb3b560711b4d7eb23f2aff3e4ca991 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:35.711781  1645 raft_consensus.cc:1275] T cf2ade0033864199b5ced11fc9b5c6ad P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:35.713405  2517 consensus_queue.cc:1048] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:35.717644  1569 raft_consensus.cc:1275] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:35.719437  2517 consensus_queue.cc:1048] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:58:35.721189  1689 consensus_peers.cc:597] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 -> Peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423): Couldn't send request to peer 05476b84d8f84d76a9a1f51b620a3c66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cf2ade0033864199b5ced11fc9b5c6ad. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:35.735936  2452 raft_consensus.cc:2955] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:35.737910  1651 raft_consensus.cc:2955] T cf2ade0033864199b5ced11fc9b5c6ad P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:35.742175  1569 raft_consensus.cc:2955] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:35.762967  1645 consensus_queue.cc:237] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:35.763648  1471 catalog_manager.cc:5697] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:35.778033  1724 raft_consensus.cc:1275] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:58:35.780205  1615 consensus_peers.cc:597] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e -> Peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423): Couldn't send request to peer 05476b84d8f84d76a9a1f51b620a3c66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ecf79110f7ff4e8b8bf2e0e4ea3c6def. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:35.782514  2486 consensus_queue.cc:1048] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:35.793354  1572 raft_consensus.cc:1275] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:35.794904  2441 consensus_queue.cc:1048] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:35.794816  2518 raft_consensus.cc:2955] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:35.802219  1572 raft_consensus.cc:2955] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:35.808935  1724 raft_consensus.cc:2955] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:35.824294  1474 catalog_manager.cc:5697] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:36.191110  2535 ts_tablet_manager.cc:933] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66: Initiating tablet copy from peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:36.192952  2535 tablet_copy_client.cc:323] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:45473
I20260709 12:58:36.194669  1735 tablet_copy_service.cc:140] P 0c7751452c4b46afa95251b9df7169d4: Received BeginTabletCopySession request for tablet 73452eca85a147fb9d862dd08d54e340 from peer 05476b84d8f84d76a9a1f51b620a3c66 ({username='slave'} at 127.0.0.1:58782)
I20260709 12:58:36.195238  1735 tablet_copy_service.cc:161] P 0c7751452c4b46afa95251b9df7169d4: Beginning new tablet copy session on tablet 73452eca85a147fb9d862dd08d54e340 from peer 05476b84d8f84d76a9a1f51b620a3c66 at {username='slave'} at 127.0.0.1:58782: session id = 05476b84d8f84d76a9a1f51b620a3c66-73452eca85a147fb9d862dd08d54e340
I20260709 12:58:36.201628  1735 tablet_copy_source_session.cc:215] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:36.205546  2535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73452eca85a147fb9d862dd08d54e340. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.210918  2537 ts_tablet_manager.cc:933] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66: Initiating tablet copy from peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:36.212989  2537 tablet_copy_client.cc:323] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:45473
I20260709 12:58:36.214684  1735 tablet_copy_service.cc:140] P 0c7751452c4b46afa95251b9df7169d4: Received BeginTabletCopySession request for tablet cf2ade0033864199b5ced11fc9b5c6ad from peer 05476b84d8f84d76a9a1f51b620a3c66 ({username='slave'} at 127.0.0.1:58782)
I20260709 12:58:36.215229  1735 tablet_copy_service.cc:161] P 0c7751452c4b46afa95251b9df7169d4: Beginning new tablet copy session on tablet cf2ade0033864199b5ced11fc9b5c6ad from peer 05476b84d8f84d76a9a1f51b620a3c66 at {username='slave'} at 127.0.0.1:58782: session id = 05476b84d8f84d76a9a1f51b620a3c66-cf2ade0033864199b5ced11fc9b5c6ad
I20260709 12:58:36.237828  1735 tablet_copy_source_session.cc:215] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:36.239319  2535 tablet_copy_client.cc:806] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:36.240103  2535 tablet_copy_client.cc:670] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:36.243343  2537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf2ade0033864199b5ced11fc9b5c6ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.244305  2535 tablet_copy_client.cc:538] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:36.254468  2535 tablet_bootstrap.cc:492] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap starting.
I20260709 12:58:36.261714  2537 tablet_copy_client.cc:806] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:36.262382  2537 tablet_copy_client.cc:670] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:36.266253  2537 tablet_copy_client.cc:538] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:36.284785  2539 ts_tablet_manager.cc:933] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66: Initiating tablet copy from peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:36.305569  2535 tablet_bootstrap.cc:492] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:36.310424  2535 tablet_bootstrap.cc:492] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap complete.
I20260709 12:58:36.311221  2535 ts_tablet_manager.cc:1403] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent bootstrapping tablet: real 0.057s	user 0.026s	sys 0.013s
I20260709 12:58:36.311861  2537 tablet_bootstrap.cc:492] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap starting.
I20260709 12:58:36.315492  2535 raft_consensus.cc:359] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:36.316593  2535 raft_consensus.cc:740] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Initialized, Role: LEARNER
I20260709 12:58:36.317396  2535 consensus_queue.cc:260] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:36.332059  2539 tablet_copy_client.cc:323] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:37391
I20260709 12:58:36.334924  1661 tablet_copy_service.cc:140] P 4dbe7d47a2374afca075d3a98583b49e: Received BeginTabletCopySession request for tablet bfb3b560711b4d7eb23f2aff3e4ca991 from peer 05476b84d8f84d76a9a1f51b620a3c66 ({username='slave'} at 127.0.0.1:57912)
I20260709 12:58:36.335465  1661 tablet_copy_service.cc:161] P 4dbe7d47a2374afca075d3a98583b49e: Beginning new tablet copy session on tablet bfb3b560711b4d7eb23f2aff3e4ca991 from peer 05476b84d8f84d76a9a1f51b620a3c66 at {username='slave'} at 127.0.0.1:57912: session id = 05476b84d8f84d76a9a1f51b620a3c66-bfb3b560711b4d7eb23f2aff3e4ca991
I20260709 12:58:36.344916  1661 tablet_copy_source_session.cc:215] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:36.352599  2544 ts_tablet_manager.cc:933] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66: Initiating tablet copy from peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:36.360731  2544 tablet_copy_client.cc:323] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:37391
I20260709 12:58:36.362576  1661 tablet_copy_service.cc:140] P 4dbe7d47a2374afca075d3a98583b49e: Received BeginTabletCopySession request for tablet ecf79110f7ff4e8b8bf2e0e4ea3c6def from peer 05476b84d8f84d76a9a1f51b620a3c66 ({username='slave'} at 127.0.0.1:57912)
I20260709 12:58:36.363142  1661 tablet_copy_service.cc:161] P 4dbe7d47a2374afca075d3a98583b49e: Beginning new tablet copy session on tablet ecf79110f7ff4e8b8bf2e0e4ea3c6def from peer 05476b84d8f84d76a9a1f51b620a3c66 at {username='slave'} at 127.0.0.1:57912: session id = 05476b84d8f84d76a9a1f51b620a3c66-ecf79110f7ff4e8b8bf2e0e4ea3c6def
I20260709 12:58:36.364379  2539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfb3b560711b4d7eb23f2aff3e4ca991. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.366210  2537 tablet_bootstrap.cc:492] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:36.367177  2537 tablet_bootstrap.cc:492] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap complete.
I20260709 12:58:36.368047  2537 ts_tablet_manager.cc:1403] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66: Time spent bootstrapping tablet: real 0.056s	user 0.021s	sys 0.006s
I20260709 12:58:36.372315  1661 tablet_copy_source_session.cc:215] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:36.375773  2544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ecf79110f7ff4e8b8bf2e0e4ea3c6def. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:36.375504  2537 raft_consensus.cc:359] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:36.378005  2535 ts_tablet_manager.cc:1434] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent starting tablet: real 0.066s	user 0.011s	sys 0.009s
I20260709 12:58:36.378073  2537 raft_consensus.cc:740] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Initialized, Role: LEARNER
I20260709 12:58:36.380175  2537 consensus_queue.cc:260] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:36.383097  2537 ts_tablet_manager.cc:1434] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66: Time spent starting tablet: real 0.015s	user 0.010s	sys 0.000s
I20260709 12:58:36.390754  1735 tablet_copy_service.cc:342] P 0c7751452c4b46afa95251b9df7169d4: Request end of tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-73452eca85a147fb9d862dd08d54e340 received from {username='slave'} at 127.0.0.1:58782
I20260709 12:58:36.391276  1735 tablet_copy_service.cc:434] P 0c7751452c4b46afa95251b9df7169d4: ending tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-73452eca85a147fb9d862dd08d54e340 on tablet 73452eca85a147fb9d862dd08d54e340 with peer 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:58:36.392482  1734 tablet_copy_service.cc:342] P 0c7751452c4b46afa95251b9df7169d4: Request end of tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-cf2ade0033864199b5ced11fc9b5c6ad received from {username='slave'} at 127.0.0.1:58782
I20260709 12:58:36.392938  1734 tablet_copy_service.cc:434] P 0c7751452c4b46afa95251b9df7169d4: ending tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-cf2ade0033864199b5ced11fc9b5c6ad on tablet cf2ade0033864199b5ced11fc9b5c6ad with peer 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:58:36.393102  2544 tablet_copy_client.cc:806] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:36.393661  2544 tablet_copy_client.cc:670] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:36.393937  2539 tablet_copy_client.cc:806] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:36.394543  2539 tablet_copy_client.cc:670] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:36.400187  2544 tablet_copy_client.cc:538] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:36.408329  2539 tablet_copy_client.cc:538] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:36.411826  2544 tablet_bootstrap.cc:492] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap starting.
I20260709 12:58:36.440860  2544 tablet_bootstrap.cc:492] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:36.441664  2544 tablet_bootstrap.cc:492] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap complete.
I20260709 12:58:36.442235  2539 tablet_bootstrap.cc:492] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap starting.
I20260709 12:58:36.442322  2544 ts_tablet_manager.cc:1403] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66: Time spent bootstrapping tablet: real 0.031s	user 0.020s	sys 0.012s
I20260709 12:58:36.445449  2544 raft_consensus.cc:359] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:36.446909  2544 raft_consensus.cc:740] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Initialized, Role: LEARNER
I20260709 12:58:36.447654  2544 consensus_queue.cc:260] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:36.450506  2544 ts_tablet_manager.cc:1434] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:58:36.452360  1661 tablet_copy_service.cc:342] P 4dbe7d47a2374afca075d3a98583b49e: Request end of tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-ecf79110f7ff4e8b8bf2e0e4ea3c6def received from {username='slave'} at 127.0.0.1:57912
I20260709 12:58:36.452792  1661 tablet_copy_service.cc:434] P 4dbe7d47a2374afca075d3a98583b49e: ending tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-ecf79110f7ff4e8b8bf2e0e4ea3c6def on tablet ecf79110f7ff4e8b8bf2e0e4ea3c6def with peer 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:58:36.474399  2539 tablet_bootstrap.cc:492] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:36.477181  2539 tablet_bootstrap.cc:492] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap complete.
I20260709 12:58:36.477978  2539 ts_tablet_manager.cc:1403] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent bootstrapping tablet: real 0.036s	user 0.025s	sys 0.007s
I20260709 12:58:36.481096  2539 raft_consensus.cc:359] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:36.481981  2539 raft_consensus.cc:740] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Initialized, Role: LEARNER
I20260709 12:58:36.482632  2539 consensus_queue.cc:260] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:36.485476  2539 ts_tablet_manager.cc:1434] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:58:36.487550  1661 tablet_copy_service.cc:342] P 4dbe7d47a2374afca075d3a98583b49e: Request end of tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-bfb3b560711b4d7eb23f2aff3e4ca991 received from {username='slave'} at 127.0.0.1:57912
I20260709 12:58:36.487944  1661 tablet_copy_service.cc:434] P 4dbe7d47a2374afca075d3a98583b49e: ending tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-bfb3b560711b4d7eb23f2aff3e4ca991 on tablet bfb3b560711b4d7eb23f2aff3e4ca991 with peer 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:58:36.669191  2332 raft_consensus.cc:1217] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:36.720865  2332 raft_consensus.cc:1217] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:36.783928  2332 raft_consensus.cc:1217] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:36.807878  2332 raft_consensus.cc:1217] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:37.184832  2548 raft_consensus.cc:1064] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4: attempting to promote NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 to VOTER
I20260709 12:58:37.186964  2548 consensus_queue.cc:237] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:37.194223  1648 raft_consensus.cc:1275] T 73452eca85a147fb9d862dd08d54e340 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:37.194254  2331 raft_consensus.cc:1275] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:37.195374  1572 raft_consensus.cc:1275] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:37.195777  2548 consensus_queue.cc:1048] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:37.203795  2452 consensus_queue.cc:1048] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:37.207597  2452 consensus_queue.cc:1048] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:37.244449  2452 raft_consensus.cc:2955] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:37.276142  2549 raft_consensus.cc:1064] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4: attempting to promote NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 to VOTER
I20260709 12:58:37.277475  2463 raft_consensus.cc:1064] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e: attempting to promote NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 to VOTER
I20260709 12:58:37.281886  2463 consensus_queue.cc:237] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:37.291124  2331 raft_consensus.cc:1275] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:37.292049  1572 raft_consensus.cc:1275] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:37.292044  1645 raft_consensus.cc:2955] T 73452eca85a147fb9d862dd08d54e340 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:37.297713  2518 consensus_queue.cc:1048] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:37.299516  2518 consensus_queue.cc:1048] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:37.307073  2549 consensus_queue.cc:237] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:37.325205  1474 catalog_manager.cc:5697] T 73452eca85a147fb9d862dd08d54e340 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
W20260709 12:58:37.327071  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 89847us
I20260709 12:58:37.385329  1645 raft_consensus.cc:1275] T cf2ade0033864199b5ced11fc9b5c6ad P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:58:37.391780  2559 log.cc:927] Time spent T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:58:37.394299  2332 raft_consensus.cc:2955] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:37.395089  2549 consensus_queue.cc:1048] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:37.401772  1574 raft_consensus.cc:2955] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:37.410046  1720 raft_consensus.cc:1275] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:37.413503  2331 raft_consensus.cc:1275] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:37.424955  2463 raft_consensus.cc:2955] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:37.430361  2486 raft_consensus.cc:1064] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e: attempting to promote NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 to VOTER
I20260709 12:58:37.435169  1569 raft_consensus.cc:2955] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:37.435940  2548 consensus_queue.cc:1048] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:37.441602  2486 consensus_queue.cc:237] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:37.471133  2518 consensus_queue.cc:1048] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:37.486433  1569 raft_consensus.cc:1275] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:37.487377  2332 raft_consensus.cc:1275] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:37.491472  2560 raft_consensus.cc:2955] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:37.496182  1716 raft_consensus.cc:1275] T bfb3b560711b4d7eb23f2aff3e4ca991 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:37.499032  1573 raft_consensus.cc:1275] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:37.500794  2486 consensus_queue.cc:1048] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:37.502630  2486 consensus_queue.cc:1048] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:37.503794  2555 consensus_queue.cc:1048] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:37.508570  1719 raft_consensus.cc:2955] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:37.510031  1648 raft_consensus.cc:2955] T cf2ade0033864199b5ced11fc9b5c6ad P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:37.522763  2571 consensus_queue.cc:1048] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:37.524853  1573 raft_consensus.cc:2955] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:37.544018  2332 raft_consensus.cc:2955] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:37.547297  2331 raft_consensus.cc:2955] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:37.559966  2574 raft_consensus.cc:2955] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:37.561904  1719 raft_consensus.cc:2955] T bfb3b560711b4d7eb23f2aff3e4ca991 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:37.574054  1470 catalog_manager.cc:5697] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:37.578517  1470 catalog_manager.cc:5697] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:37.574138  2332 raft_consensus.cc:2955] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:37.589574  1573 raft_consensus.cc:2955] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:37.613785  1719 consensus_queue.cc:237] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:37.614389  1720 consensus_queue.cc:237] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:37.615360  1471 catalog_manager.cc:5697] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:37.625893  1573 raft_consensus.cc:1275] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:37.626490  1574 raft_consensus.cc:1275] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:37.626636  2332 raft_consensus.cc:1275] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:37.627408  2556 consensus_queue.cc:1048] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:37.628089  2331 raft_consensus.cc:1275] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:37.631474  2556 consensus_queue.cc:1048] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:37.633541  2548 consensus_queue.cc:1048] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:37.634426  2555 consensus_queue.cc:1048] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:37.637976  1648 consensus_queue.cc:237] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:37.645046  1572 raft_consensus.cc:1275] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:37.646425  2576 consensus_queue.cc:1048] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:37.647619  2557 raft_consensus.cc:2955] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:37.649511  1572 raft_consensus.cc:2955] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:37.647648  2555 raft_consensus.cc:2955] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:37.658120  2573 raft_consensus.cc:2955] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:37.656903  2329 raft_consensus.cc:1275] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:37.661957  1461 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 73452eca85a147fb9d862dd08d54e340 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:37.663944  2518 consensus_queue.cc:1048] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:37.671197  2329 raft_consensus.cc:2955] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:37.677989  1574 raft_consensus.cc:2955] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:37.681048  2331 raft_consensus.cc:2955] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:37.663409  1573 raft_consensus.cc:2955] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:37.657356  2332 raft_consensus.cc:2955] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:37.687336  1458 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bfb3b560711b4d7eb23f2aff3e4ca991 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:37.704481  1461 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cf2ade0033864199b5ced11fc9b5c6ad with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:37.710649  1471 catalog_manager.cc:5697] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: config changed from index 3 to 4, VOTER 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:37.693639  1474 catalog_manager.cc:5697] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: config changed from index 3 to 4, VOTER 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:37.736392  1634 tablet_service.cc:1558] Processing DeleteTablet for tablet 73452eca85a147fb9d862dd08d54e340 with delete_type TABLET_DATA_TOMBSTONED (TS 4dbe7d47a2374afca075d3a98583b49e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45134
I20260709 12:58:37.742883  1706 tablet_service.cc:1558] Processing DeleteTablet for tablet bfb3b560711b4d7eb23f2aff3e4ca991 with delete_type TABLET_DATA_TOMBSTONED (TS 0c7751452c4b46afa95251b9df7169d4 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49982
I20260709 12:58:37.755342  2586 tablet_replica.cc:333] T bfb3b560711b4d7eb23f2aff3e4ca991 P 0c7751452c4b46afa95251b9df7169d4: stopping tablet replica
I20260709 12:58:37.756417  2586 raft_consensus.cc:2243] T bfb3b560711b4d7eb23f2aff3e4ca991 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:37.757177  2586 raft_consensus.cc:2272] T bfb3b560711b4d7eb23f2aff3e4ca991 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:37.758426  1474 catalog_manager.cc:5697] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: config changed from index 3 to 4, VOTER 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:37.767769  2586 ts_tablet_manager.cc:1916] T bfb3b560711b4d7eb23f2aff3e4ca991 P 0c7751452c4b46afa95251b9df7169d4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:37.777786  1639 tablet_service.cc:1558] Processing DeleteTablet for tablet cf2ade0033864199b5ced11fc9b5c6ad with delete_type TABLET_DATA_TOMBSTONED (TS 4dbe7d47a2374afca075d3a98583b49e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45134
I20260709 12:58:37.797415  2585 tablet_replica.cc:333] T 73452eca85a147fb9d862dd08d54e340 P 4dbe7d47a2374afca075d3a98583b49e: stopping tablet replica
I20260709 12:58:37.799676  2585 raft_consensus.cc:2243] T 73452eca85a147fb9d862dd08d54e340 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:37.809274  2585 raft_consensus.cc:2272] T 73452eca85a147fb9d862dd08d54e340 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:37.815723  2586 ts_tablet_manager.cc:1929] T bfb3b560711b4d7eb23f2aff3e4ca991 P 0c7751452c4b46afa95251b9df7169d4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:37.815745  2585 ts_tablet_manager.cc:1916] T 73452eca85a147fb9d862dd08d54e340 P 4dbe7d47a2374afca075d3a98583b49e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:37.816195  2586 log.cc:1199] T bfb3b560711b4d7eb23f2aff3e4ca991 P 0c7751452c4b46afa95251b9df7169d4: Deleting WAL directory at /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601869227091-431-0/minicluster-data/ts-2-root/wals/bfb3b560711b4d7eb23f2aff3e4ca991
I20260709 12:58:37.817698  1461 catalog_manager.cc:5028] TS 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): tablet bfb3b560711b4d7eb23f2aff3e4ca991 (table test-workload [id=2e230675e851429db50863dfed56dde5]) successfully deleted
I20260709 12:58:37.829960  2585 ts_tablet_manager.cc:1929] T 73452eca85a147fb9d862dd08d54e340 P 4dbe7d47a2374afca075d3a98583b49e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:37.830456  2585 log.cc:1199] T 73452eca85a147fb9d862dd08d54e340 P 4dbe7d47a2374afca075d3a98583b49e: Deleting WAL directory at /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601869227091-431-0/minicluster-data/ts-1-root/wals/73452eca85a147fb9d862dd08d54e340
I20260709 12:58:37.832029  1458 catalog_manager.cc:5028] TS 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): tablet 73452eca85a147fb9d862dd08d54e340 (table test-workload [id=2e230675e851429db50863dfed56dde5]) successfully deleted
I20260709 12:58:37.832044  2585 tablet_replica.cc:333] T cf2ade0033864199b5ced11fc9b5c6ad P 4dbe7d47a2374afca075d3a98583b49e: stopping tablet replica
I20260709 12:58:37.833331  2585 raft_consensus.cc:2243] T cf2ade0033864199b5ced11fc9b5c6ad P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:37.833923  2585 raft_consensus.cc:2272] T cf2ade0033864199b5ced11fc9b5c6ad P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:37.837436  2585 ts_tablet_manager.cc:1916] T cf2ade0033864199b5ced11fc9b5c6ad P 4dbe7d47a2374afca075d3a98583b49e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:37.850648  2585 ts_tablet_manager.cc:1929] T cf2ade0033864199b5ced11fc9b5c6ad P 4dbe7d47a2374afca075d3a98583b49e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:37.851094  2585 log.cc:1199] T cf2ade0033864199b5ced11fc9b5c6ad P 4dbe7d47a2374afca075d3a98583b49e: Deleting WAL directory at /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601869227091-431-0/minicluster-data/ts-1-root/wals/cf2ade0033864199b5ced11fc9b5c6ad
I20260709 12:58:37.852576  1458 catalog_manager.cc:5028] TS 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): tablet cf2ade0033864199b5ced11fc9b5c6ad (table test-workload [id=2e230675e851429db50863dfed56dde5]) successfully deleted
I20260709 12:58:37.981390  1645 consensus_queue.cc:237] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:37.985739  2332 raft_consensus.cc:1275] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:37.985975  1720 raft_consensus.cc:1275] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:37.987257  2518 consensus_queue.cc:1048] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:37.988260  2574 consensus_queue.cc:1048] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:37.996119  2573 raft_consensus.cc:2955] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:37.999900  1720 raft_consensus.cc:2955] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:38.002797  2332 raft_consensus.cc:2955] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:38.007548  1458 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ecf79110f7ff4e8b8bf2e0e4ea3c6def with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:38.017120  1473 catalog_manager.cc:5697] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: config changed from index 3 to 4, VOTER 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:38.034382  1561 tablet_service.cc:1558] Processing DeleteTablet for tablet ecf79110f7ff4e8b8bf2e0e4ea3c6def with delete_type TABLET_DATA_TOMBSTONED (TS 89ac9d5e2fbc4536b03a1ff1dd3eb226 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36626
I20260709 12:58:38.036017  2588 tablet_replica.cc:333] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 89ac9d5e2fbc4536b03a1ff1dd3eb226: stopping tablet replica
I20260709 12:58:38.036837  2588 raft_consensus.cc:2243] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:38.037503  2588 raft_consensus.cc:2272] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:38.040298  2588 ts_tablet_manager.cc:1916] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:38.057431  2588 ts_tablet_manager.cc:1929] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 89ac9d5e2fbc4536b03a1ff1dd3eb226: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:38.057796  2588 log.cc:1199] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Deleting WAL directory at /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601869227091-431-0/minicluster-data/ts-0-root/wals/ecf79110f7ff4e8b8bf2e0e4ea3c6def
I20260709 12:58:38.059150  1459 catalog_manager.cc:5028] TS 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): tablet ecf79110f7ff4e8b8bf2e0e4ea3c6def (table test-workload [id=2e230675e851429db50863dfed56dde5]) successfully deleted
I20260709 12:58:39.110590  1645 consensus_queue.cc:237] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:39.116482  1719 raft_consensus.cc:1275] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:58:39.117905  1615 consensus_peers.cc:597] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423): Couldn't send request to peer 05476b84d8f84d76a9a1f51b620a3c66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d5eec36d47dc40c5a83cc72207d9c310. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:39.117879  2518 consensus_queue.cc:1048] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:39.118448  1574 raft_consensus.cc:1275] T d5eec36d47dc40c5a83cc72207d9c310 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:39.120270  2576 consensus_queue.cc:1048] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:39.129629  2591 raft_consensus.cc:2955] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:39.133384  1719 raft_consensus.cc:2955] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:39.145207  1716 consensus_queue.cc:237] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:39.158924  1474 catalog_manager.cc:5697] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:39.163560  1574 raft_consensus.cc:2955] T d5eec36d47dc40c5a83cc72207d9c310 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:39.176968  1573 raft_consensus.cc:1275] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:39.178952  1648 raft_consensus.cc:1275] T 608abea191d946228bed666c5560fd0a P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:58:39.179131  1689 consensus_peers.cc:597] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 -> Peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423): Couldn't send request to peer 05476b84d8f84d76a9a1f51b620a3c66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 608abea191d946228bed666c5560fd0a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:39.180573  2556 consensus_queue.cc:1048] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:39.182404  2556 consensus_queue.cc:1048] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:39.191943  2556 raft_consensus.cc:2955] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:39.199643  1648 raft_consensus.cc:2955] T 608abea191d946228bed666c5560fd0a P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:39.208089  1574 raft_consensus.cc:2955] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:39.237366  1474 catalog_manager.cc:5697] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:39.267239  1574 consensus_queue.cc:237] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:39.274169  1716 raft_consensus.cc:1275] T 1aa00507899e41f9b595f503add14c8c P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:39.276197  1648 raft_consensus.cc:1275] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:39.276425  2550 consensus_queue.cc:1048] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:39.279145  2550 consensus_queue.cc:1048] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:39.285822  2550 raft_consensus.cc:2955] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:39.287189  1716 raft_consensus.cc:2955] T 1aa00507899e41f9b595f503add14c8c P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:39.291226  1648 raft_consensus.cc:2955] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
W20260709 12:58:39.293747  1540 consensus_peers.cc:597] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 -> Peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423): Couldn't send request to peer 05476b84d8f84d76a9a1f51b620a3c66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1aa00507899e41f9b595f503add14c8c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:39.305110  1645 consensus_queue.cc:237] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:39.312628  1471 catalog_manager.cc:5697] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:39.315651  1716 raft_consensus.cc:1275] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:39.316817  1573 raft_consensus.cc:1275] T a5bf40aa94d24ad9b858ebb61a527c4e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:39.317014  2518 consensus_queue.cc:1048] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:58:39.317896  1615 consensus_peers.cc:597] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e -> Peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423): Couldn't send request to peer 05476b84d8f84d76a9a1f51b620a3c66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a5bf40aa94d24ad9b858ebb61a527c4e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:39.319458  2518 consensus_queue.cc:1048] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:39.338165  2595 raft_consensus.cc:2955] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:39.339872  1573 raft_consensus.cc:2955] T a5bf40aa94d24ad9b858ebb61a527c4e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:39.341768  1719 raft_consensus.cc:2955] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:39.358793  1474 catalog_manager.cc:5697] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:39.603698  2614 ts_tablet_manager.cc:933] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66: Initiating tablet copy from peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:39.605654  2614 tablet_copy_client.cc:323] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:37391
I20260709 12:58:39.607152  1661 tablet_copy_service.cc:140] P 4dbe7d47a2374afca075d3a98583b49e: Received BeginTabletCopySession request for tablet d5eec36d47dc40c5a83cc72207d9c310 from peer 05476b84d8f84d76a9a1f51b620a3c66 ({username='slave'} at 127.0.0.1:57912)
I20260709 12:58:39.607589  1661 tablet_copy_service.cc:161] P 4dbe7d47a2374afca075d3a98583b49e: Beginning new tablet copy session on tablet d5eec36d47dc40c5a83cc72207d9c310 from peer 05476b84d8f84d76a9a1f51b620a3c66 at {username='slave'} at 127.0.0.1:57912: session id = 05476b84d8f84d76a9a1f51b620a3c66-d5eec36d47dc40c5a83cc72207d9c310
I20260709 12:58:39.613384  1661 tablet_copy_source_session.cc:215] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:39.616442  2614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5eec36d47dc40c5a83cc72207d9c310. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:39.632454  2614 tablet_copy_client.cc:806] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:39.633109  2614 tablet_copy_client.cc:670] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:39.645946  2614 tablet_copy_client.cc:538] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:39.655148  2614 tablet_bootstrap.cc:492] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap starting.
I20260709 12:58:39.675823  2614 tablet_bootstrap.cc:492] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:39.676900  2614 tablet_bootstrap.cc:492] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap complete.
I20260709 12:58:39.677703  2614 ts_tablet_manager.cc:1403] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent bootstrapping tablet: real 0.023s	user 0.019s	sys 0.004s
I20260709 12:58:39.680619  2614 raft_consensus.cc:359] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:39.681494  2614 raft_consensus.cc:740] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Initialized, Role: LEARNER
I20260709 12:58:39.682126  2614 consensus_queue.cc:260] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:39.685318  2614 ts_tablet_manager.cc:1434] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:58:39.690850  1661 tablet_copy_service.cc:342] P 4dbe7d47a2374afca075d3a98583b49e: Request end of tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-d5eec36d47dc40c5a83cc72207d9c310 received from {username='slave'} at 127.0.0.1:57912
I20260709 12:58:39.691303  1661 tablet_copy_service.cc:434] P 4dbe7d47a2374afca075d3a98583b49e: ending tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-d5eec36d47dc40c5a83cc72207d9c310 on tablet d5eec36d47dc40c5a83cc72207d9c310 with peer 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:58:39.746286  2614 ts_tablet_manager.cc:933] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66: Initiating tablet copy from peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:39.748296  2614 tablet_copy_client.cc:323] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:45473
I20260709 12:58:39.749773  1734 tablet_copy_service.cc:140] P 0c7751452c4b46afa95251b9df7169d4: Received BeginTabletCopySession request for tablet 608abea191d946228bed666c5560fd0a from peer 05476b84d8f84d76a9a1f51b620a3c66 ({username='slave'} at 127.0.0.1:58782)
I20260709 12:58:39.750341  1734 tablet_copy_service.cc:161] P 0c7751452c4b46afa95251b9df7169d4: Beginning new tablet copy session on tablet 608abea191d946228bed666c5560fd0a from peer 05476b84d8f84d76a9a1f51b620a3c66 at {username='slave'} at 127.0.0.1:58782: session id = 05476b84d8f84d76a9a1f51b620a3c66-608abea191d946228bed666c5560fd0a
I20260709 12:58:39.758968  1734 tablet_copy_source_session.cc:215] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:39.761920  2614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 608abea191d946228bed666c5560fd0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:39.775967  2614 tablet_copy_client.cc:806] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:39.776705  2614 tablet_copy_client.cc:670] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:39.781888  2614 tablet_copy_client.cc:538] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:39.792899  2614 tablet_bootstrap.cc:492] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap starting.
I20260709 12:58:39.807451  2620 ts_tablet_manager.cc:933] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66: Initiating tablet copy from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373)
I20260709 12:58:39.812742  2620 tablet_copy_client.cc:323] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:34373
I20260709 12:58:39.817710  2614 tablet_bootstrap.cc:492] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:39.819010  2614 tablet_bootstrap.cc:492] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap complete.
I20260709 12:58:39.819973  2614 ts_tablet_manager.cc:1403] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.008s
I20260709 12:58:39.824312  2614 raft_consensus.cc:359] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:39.825407  2614 raft_consensus.cc:740] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Initialized, Role: LEARNER
I20260709 12:58:39.826076  2614 consensus_queue.cc:260] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:39.828444  2614 ts_tablet_manager.cc:1434] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:58:39.831949  1734 tablet_copy_service.cc:342] P 0c7751452c4b46afa95251b9df7169d4: Request end of tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-608abea191d946228bed666c5560fd0a received from {username='slave'} at 127.0.0.1:58782
I20260709 12:58:39.832448  1734 tablet_copy_service.cc:434] P 0c7751452c4b46afa95251b9df7169d4: ending tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-608abea191d946228bed666c5560fd0a on tablet 608abea191d946228bed666c5560fd0a with peer 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:58:39.835770  2623 ts_tablet_manager.cc:933] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66: Initiating tablet copy from peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:39.854266  2623 tablet_copy_client.cc:323] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:37391
I20260709 12:58:39.857786  1661 tablet_copy_service.cc:140] P 4dbe7d47a2374afca075d3a98583b49e: Received BeginTabletCopySession request for tablet a5bf40aa94d24ad9b858ebb61a527c4e from peer 05476b84d8f84d76a9a1f51b620a3c66 ({username='slave'} at 127.0.0.1:57912)
I20260709 12:58:39.858393  1661 tablet_copy_service.cc:161] P 4dbe7d47a2374afca075d3a98583b49e: Beginning new tablet copy session on tablet a5bf40aa94d24ad9b858ebb61a527c4e from peer 05476b84d8f84d76a9a1f51b620a3c66 at {username='slave'} at 127.0.0.1:57912: session id = 05476b84d8f84d76a9a1f51b620a3c66-a5bf40aa94d24ad9b858ebb61a527c4e
I20260709 12:58:39.864065  1586 tablet_copy_service.cc:140] P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Received BeginTabletCopySession request for tablet 1aa00507899e41f9b595f503add14c8c from peer 05476b84d8f84d76a9a1f51b620a3c66 ({username='slave'} at 127.0.0.1:37682)
I20260709 12:58:39.864796  1586 tablet_copy_service.cc:161] P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Beginning new tablet copy session on tablet 1aa00507899e41f9b595f503add14c8c from peer 05476b84d8f84d76a9a1f51b620a3c66 at {username='slave'} at 127.0.0.1:37682: session id = 05476b84d8f84d76a9a1f51b620a3c66-1aa00507899e41f9b595f503add14c8c
I20260709 12:58:39.877064  1661 tablet_copy_source_session.cc:215] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:39.877585  1586 tablet_copy_source_session.cc:215] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:39.880754  2623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a5bf40aa94d24ad9b858ebb61a527c4e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:39.881860  2620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1aa00507899e41f9b595f503add14c8c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:39.896919  2623 tablet_copy_client.cc:806] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:39.897603  2623 tablet_copy_client.cc:670] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:39.897755  2620 tablet_copy_client.cc:806] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:39.899847  2620 tablet_copy_client.cc:670] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:39.915164  2623 tablet_copy_client.cc:538] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:39.915803  2620 tablet_copy_client.cc:538] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:39.932782  2620 tablet_bootstrap.cc:492] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap starting.
I20260709 12:58:39.932706  2623 tablet_bootstrap.cc:492] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap starting.
I20260709 12:58:39.963819  2620 tablet_bootstrap.cc:492] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:39.964174  2623 tablet_bootstrap.cc:492] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:39.964782  2620 tablet_bootstrap.cc:492] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap complete.
I20260709 12:58:39.965147  2623 tablet_bootstrap.cc:492] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap complete.
I20260709 12:58:39.965559  2620 ts_tablet_manager.cc:1403] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66: Time spent bootstrapping tablet: real 0.033s	user 0.016s	sys 0.011s
I20260709 12:58:39.966427  2623 ts_tablet_manager.cc:1403] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66: Time spent bootstrapping tablet: real 0.034s	user 0.020s	sys 0.005s
I20260709 12:58:39.969308  2623 raft_consensus.cc:359] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:39.970224  2623 raft_consensus.cc:740] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Initialized, Role: LEARNER
I20260709 12:58:39.970925  2623 consensus_queue.cc:260] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:39.971637  2620 raft_consensus.cc:359] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:39.972620  2620 raft_consensus.cc:740] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Initialized, Role: LEARNER
I20260709 12:58:39.973071  2623 ts_tablet_manager.cc:1434] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:58:39.973330  2620 consensus_queue.cc:260] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:39.974987  1661 tablet_copy_service.cc:342] P 4dbe7d47a2374afca075d3a98583b49e: Request end of tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-a5bf40aa94d24ad9b858ebb61a527c4e received from {username='slave'} at 127.0.0.1:57912
I20260709 12:58:39.975415  1661 tablet_copy_service.cc:434] P 4dbe7d47a2374afca075d3a98583b49e: ending tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-a5bf40aa94d24ad9b858ebb61a527c4e on tablet a5bf40aa94d24ad9b858ebb61a527c4e with peer 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:58:39.976016  2620 ts_tablet_manager.cc:1434] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 12:58:39.980408  1586 tablet_copy_service.cc:342] P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Request end of tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-1aa00507899e41f9b595f503add14c8c received from {username='slave'} at 127.0.0.1:37682
I20260709 12:58:39.980878  1586 tablet_copy_service.cc:434] P 89ac9d5e2fbc4536b03a1ff1dd3eb226: ending tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-1aa00507899e41f9b595f503add14c8c on tablet 1aa00507899e41f9b595f503add14c8c with peer 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:58:40.220578  2331 raft_consensus.cc:1217] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:40.243350  2332 raft_consensus.cc:1217] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:40.358175  2332 raft_consensus.cc:1217] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:40.382936  2332 raft_consensus.cc:1217] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:40.686868  2637 raft_consensus.cc:1064] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e: attempting to promote NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 to VOTER
I20260709 12:58:40.689632  2637 consensus_queue.cc:237] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:40.693832  2594 raft_consensus.cc:1064] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e: attempting to promote NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 to VOTER
I20260709 12:58:40.697743  2594 consensus_queue.cc:237] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:40.699362  1720 raft_consensus.cc:1275] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:40.700616  2332 raft_consensus.cc:1275] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:40.702142  1573 raft_consensus.cc:1275] T d5eec36d47dc40c5a83cc72207d9c310 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:40.702874  2636 consensus_queue.cc:1048] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:40.708990  2637 consensus_queue.cc:1048] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:40.710000  2591 consensus_queue.cc:1048] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:40.723718  2634 raft_consensus.cc:2955] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:40.730672  1573 raft_consensus.cc:2955] T d5eec36d47dc40c5a83cc72207d9c310 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:40.738467  1720 raft_consensus.cc:2955] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:40.743417  1716 raft_consensus.cc:1275] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:40.745703  2331 raft_consensus.cc:1275] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:40.747483  1574 raft_consensus.cc:1275] T a5bf40aa94d24ad9b858ebb61a527c4e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:40.747717  2591 consensus_queue.cc:1048] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:40.749964  2591 consensus_queue.cc:1048] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:40.750924  2637 consensus_queue.cc:1048] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:40.790143  2610 raft_consensus.cc:1064] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226: attempting to promote NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 to VOTER
I20260709 12:58:40.794298  2610 consensus_queue.cc:237] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:40.800103  2332 raft_consensus.cc:2955] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:40.771325  1474 catalog_manager.cc:5697] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:40.921487  2591 raft_consensus.cc:2955] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:40.923125  2331 raft_consensus.cc:2955] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:40.935531  1574 raft_consensus.cc:2955] T a5bf40aa94d24ad9b858ebb61a527c4e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
W20260709 12:58:40.956267  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 130925us
I20260709 12:58:40.978757  1716 raft_consensus.cc:1275] T 1aa00507899e41f9b595f503add14c8c P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:40.981564  2331 raft_consensus.cc:1275] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:40.981948  1645 raft_consensus.cc:1275] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:40.983889  2550 consensus_queue.cc:1048] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:40.992233  2550 consensus_queue.cc:1048] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:40.993875  2610 consensus_queue.cc:1048] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:41.005316  2651 raft_consensus.cc:1064] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4: attempting to promote NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 to VOTER
I20260709 12:58:41.004343  2652 raft_consensus.cc:2955] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:41.006733  1720 raft_consensus.cc:2955] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:41.008086  2651 consensus_queue.cc:237] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:41.013175  1651 raft_consensus.cc:2955] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:41.018956  2331 raft_consensus.cc:2955] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:41.041895  1716 raft_consensus.cc:2955] T 1aa00507899e41f9b595f503add14c8c P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:41.045513  1573 raft_consensus.cc:1275] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:41.045519  1651 raft_consensus.cc:1275] T 608abea191d946228bed666c5560fd0a P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:41.047921  2589 consensus_queue.cc:1048] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:41.050974  2589 consensus_queue.cc:1048] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:58:41.068466  1470 catalog_manager.cc:5697] T a5bf40aa94d24ad9b858ebb61a527c4e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:41.072018  2331 raft_consensus.cc:1275] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:41.078962  1648 consensus_queue.cc:237] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:41.087793  2651 consensus_queue.cc:1048] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:41.090790  2331 raft_consensus.cc:1275] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:41.092932  2591 consensus_queue.cc:1048] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:41.110371  2636 raft_consensus.cc:2955] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:41.117473  1470 catalog_manager.cc:5697] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:41.127135  1720 raft_consensus.cc:1275] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:41.131819  2638 raft_consensus.cc:2955] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:41.137710  2637 consensus_queue.cc:1048] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:41.142737  1651 consensus_queue.cc:237] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:41.146051  1645 raft_consensus.cc:2955] T 608abea191d946228bed666c5560fd0a P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:41.150897  2331 raft_consensus.cc:2955] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:41.159375  1458 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d5eec36d47dc40c5a83cc72207d9c310 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:41.157274  1572 consensus_queue.cc:237] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:41.171851  2329 raft_consensus.cc:1275] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:41.171396  1716 raft_consensus.cc:2955] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:41.174763  1721 raft_consensus.cc:1275] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:41.188221  2331 raft_consensus.cc:1275] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:41.192502  2646 consensus_queue.cc:1048] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:58:41.189534  1567 raft_consensus.cc:2955] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:41.197542  2636 consensus_queue.cc:1048] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:41.199604  1651 raft_consensus.cc:1275] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:41.199980  2610 raft_consensus.cc:2955] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:41.202248  2587 consensus_queue.cc:1048] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:41.233214  1648 raft_consensus.cc:2955] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:41.224700  2594 consensus_queue.cc:1048] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 12:58:41.250379  2329 raft_consensus.cc:2955] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
W20260709 12:58:41.285754  2662 log.cc:927] Time spent T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:58:41.295764  2332 raft_consensus.cc:2955] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:41.282527  1471 catalog_manager.cc:5697] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: config changed from index 3 to 4, VOTER 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:41.309448  1459 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1aa00507899e41f9b595f503add14c8c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:58:41.315397  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 52061.4us
I20260709 12:58:41.316748  1474 catalog_manager.cc:5697] T 608abea191d946228bed666c5560fd0a P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:41.339435  2667 raft_consensus.cc:2955] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:41.342105  2332 raft_consensus.cc:2955] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:41.356765  1561 tablet_service.cc:1558] Processing DeleteTablet for tablet d5eec36d47dc40c5a83cc72207d9c310 with delete_type TABLET_DATA_TOMBSTONED (TS 89ac9d5e2fbc4536b03a1ff1dd3eb226 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36626
I20260709 12:58:41.362265  1474 catalog_manager.cc:5697] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: config changed from index 3 to 4, VOTER 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:41.371379  2669 tablet_replica.cc:333] T d5eec36d47dc40c5a83cc72207d9c310 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: stopping tablet replica
I20260709 12:58:41.378602  2669 raft_consensus.cc:2243] T d5eec36d47dc40c5a83cc72207d9c310 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:41.378710  1458 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a5bf40aa94d24ad9b858ebb61a527c4e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:41.390879  1474 catalog_manager.cc:5697] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: config changed from index 3 to 4, VOTER 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:41.391644  1716 raft_consensus.cc:2955] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:41.393443  1706 tablet_service.cc:1558] Processing DeleteTablet for tablet 1aa00507899e41f9b595f503add14c8c with delete_type TABLET_DATA_TOMBSTONED (TS 0c7751452c4b46afa95251b9df7169d4 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49982
I20260709 12:58:41.404287  2669 raft_consensus.cc:2272] T d5eec36d47dc40c5a83cc72207d9c310 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:41.404937  1561 tablet_service.cc:1558] Processing DeleteTablet for tablet a5bf40aa94d24ad9b858ebb61a527c4e with delete_type TABLET_DATA_TOMBSTONED (TS 89ac9d5e2fbc4536b03a1ff1dd3eb226 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36626
I20260709 12:58:41.419294  1721 consensus_queue.cc:237] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:41.427870  2669 ts_tablet_manager.cc:1916] T d5eec36d47dc40c5a83cc72207d9c310 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:41.433554  2332 raft_consensus.cc:1275] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:41.434289  1567 raft_consensus.cc:1275] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:41.435588  2665 consensus_queue.cc:1048] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:41.439606  2665 consensus_queue.cc:1048] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:41.440876  2670 tablet_replica.cc:333] T 1aa00507899e41f9b595f503add14c8c P 0c7751452c4b46afa95251b9df7169d4: stopping tablet replica
I20260709 12:58:41.449736  2670 raft_consensus.cc:2243] T 1aa00507899e41f9b595f503add14c8c P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:41.450591  2670 raft_consensus.cc:2272] T 1aa00507899e41f9b595f503add14c8c P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:41.453258  2332 raft_consensus.cc:2955] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:41.455907  1567 raft_consensus.cc:2955] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:41.456986  2668 raft_consensus.cc:2955] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:41.454433  2670 ts_tablet_manager.cc:1916] T 1aa00507899e41f9b595f503add14c8c P 0c7751452c4b46afa95251b9df7169d4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:41.469317  1461 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 608abea191d946228bed666c5560fd0a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:41.518277  2669 ts_tablet_manager.cc:1929] T d5eec36d47dc40c5a83cc72207d9c310 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:41.523378  2669 log.cc:1199] T d5eec36d47dc40c5a83cc72207d9c310 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Deleting WAL directory at /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601869227091-431-0/minicluster-data/ts-0-root/wals/d5eec36d47dc40c5a83cc72207d9c310
I20260709 12:58:41.529210  1471 catalog_manager.cc:5697] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: config changed from index 3 to 4, VOTER 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:41.540472  2669 tablet_replica.cc:333] T a5bf40aa94d24ad9b858ebb61a527c4e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: stopping tablet replica
I20260709 12:58:41.540747  1459 catalog_manager.cc:5028] TS 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): tablet d5eec36d47dc40c5a83cc72207d9c310 (table test-workload [id=2e230675e851429db50863dfed56dde5]) successfully deleted
I20260709 12:58:41.549810  2669 raft_consensus.cc:2243] T a5bf40aa94d24ad9b858ebb61a527c4e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:41.550518  1634 tablet_service.cc:1558] Processing DeleteTablet for tablet 608abea191d946228bed666c5560fd0a with delete_type TABLET_DATA_TOMBSTONED (TS 4dbe7d47a2374afca075d3a98583b49e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45134
I20260709 12:58:41.550609  2669 raft_consensus.cc:2272] T a5bf40aa94d24ad9b858ebb61a527c4e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:41.553292  2670 ts_tablet_manager.cc:1929] T 1aa00507899e41f9b595f503add14c8c P 0c7751452c4b46afa95251b9df7169d4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:41.556200  2671 tablet_replica.cc:333] T 608abea191d946228bed666c5560fd0a P 4dbe7d47a2374afca075d3a98583b49e: stopping tablet replica
I20260709 12:58:41.559049  2670 log.cc:1199] T 1aa00507899e41f9b595f503add14c8c P 0c7751452c4b46afa95251b9df7169d4: Deleting WAL directory at /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601869227091-431-0/minicluster-data/ts-2-root/wals/1aa00507899e41f9b595f503add14c8c
I20260709 12:58:41.558578  2669 ts_tablet_manager.cc:1916] T a5bf40aa94d24ad9b858ebb61a527c4e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:41.560019  2671 raft_consensus.cc:2243] T 608abea191d946228bed666c5560fd0a P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:41.561240  2671 raft_consensus.cc:2272] T 608abea191d946228bed666c5560fd0a P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:41.569217  1461 catalog_manager.cc:5028] TS 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): tablet 1aa00507899e41f9b595f503add14c8c (table test-workload [id=2e230675e851429db50863dfed56dde5]) successfully deleted
I20260709 12:58:41.565505  2671 ts_tablet_manager.cc:1916] T 608abea191d946228bed666c5560fd0a P 4dbe7d47a2374afca075d3a98583b49e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:41.578408  2669 ts_tablet_manager.cc:1929] T a5bf40aa94d24ad9b858ebb61a527c4e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:41.578838  2669 log.cc:1199] T a5bf40aa94d24ad9b858ebb61a527c4e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Deleting WAL directory at /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601869227091-431-0/minicluster-data/ts-0-root/wals/a5bf40aa94d24ad9b858ebb61a527c4e
I20260709 12:58:41.580209  1459 catalog_manager.cc:5028] TS 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): tablet a5bf40aa94d24ad9b858ebb61a527c4e (table test-workload [id=2e230675e851429db50863dfed56dde5]) successfully deleted
I20260709 12:58:41.584828  2671 ts_tablet_manager.cc:1929] T 608abea191d946228bed666c5560fd0a P 4dbe7d47a2374afca075d3a98583b49e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:41.585256  2671 log.cc:1199] T 608abea191d946228bed666c5560fd0a P 4dbe7d47a2374afca075d3a98583b49e: Deleting WAL directory at /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601869227091-431-0/minicluster-data/ts-1-root/wals/608abea191d946228bed666c5560fd0a
I20260709 12:58:41.587097  1458 catalog_manager.cc:5028] TS 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): tablet 608abea191d946228bed666c5560fd0a (table test-workload [id=2e230675e851429db50863dfed56dde5]) successfully deleted
I20260709 12:58:42.624492  1567 consensus_queue.cc:237] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:42.631212  1716 raft_consensus.cc:1275] T a0203dcfbe4440c790f2bf709bd16179 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:58:42.631448  1540 consensus_peers.cc:597] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 -> Peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423): Couldn't send request to peer 05476b84d8f84d76a9a1f51b620a3c66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a0203dcfbe4440c790f2bf709bd16179. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:42.632375  1651 raft_consensus.cc:1275] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:42.632658  2652 consensus_queue.cc:1048] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:42.633783  2610 consensus_queue.cc:1048] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:42.644322  2673 raft_consensus.cc:2955] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:42.648093  1648 raft_consensus.cc:2955] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:42.656368  1716 raft_consensus.cc:2955] T a0203dcfbe4440c790f2bf709bd16179 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:42.658315  1720 consensus_queue.cc:237] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
W20260709 12:58:42.671058  1689 consensus_peers.cc:597] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423): Couldn't send request to peer 05476b84d8f84d76a9a1f51b620a3c66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9ec2114c988b4a38a63b42293dcf1757. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:42.674993  1573 raft_consensus.cc:1275] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:42.675105  1648 raft_consensus.cc:1275] T 9ec2114c988b4a38a63b42293dcf1757 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:42.676725  2668 consensus_queue.cc:1048] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:42.677623  2665 consensus_queue.cc:1048] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:42.678092  1470 catalog_manager.cc:5697] T a0203dcfbe4440c790f2bf709bd16179 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:42.697111  2668 raft_consensus.cc:2955] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:42.698709  1648 raft_consensus.cc:2955] T 9ec2114c988b4a38a63b42293dcf1757 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:42.717661  1573 raft_consensus.cc:2955] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:42.727708  1648 consensus_queue.cc:237] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:42.743929  1474 catalog_manager.cc:5697] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:42.762243  1567 raft_consensus.cc:1275] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:58:42.763209  1615 consensus_peers.cc:597] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423): Couldn't send request to peer 05476b84d8f84d76a9a1f51b620a3c66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 725a29842f534310a9c0bb9d5c7892a2. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:42.764195  2667 consensus_queue.cc:1048] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:42.770749  1716 raft_consensus.cc:1275] T 725a29842f534310a9c0bb9d5c7892a2 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:42.773844  2667 consensus_queue.cc:1048] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:42.776026  2634 raft_consensus.cc:2955] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:42.777799  1567 raft_consensus.cc:2955] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:42.784406  1720 raft_consensus.cc:2955] T 725a29842f534310a9c0bb9d5c7892a2 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:42.790659  1716 consensus_queue.cc:237] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:42.799319  1474 catalog_manager.cc:5697] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:58:42.810933  1689 consensus_peers.cc:597] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 -> Peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423): Couldn't send request to peer 05476b84d8f84d76a9a1f51b620a3c66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: df63a7a2acf448379066cf6e352a511e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:42.813194  1648 raft_consensus.cc:1275] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:42.814787  1567 raft_consensus.cc:1275] T df63a7a2acf448379066cf6e352a511e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:42.816330  2663 consensus_queue.cc:1048] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:42.817386  2665 consensus_queue.cc:1048] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:42.832840  2681 raft_consensus.cc:2955] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:42.834636  1567 raft_consensus.cc:2955] T df63a7a2acf448379066cf6e352a511e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:42.834671  1648 raft_consensus.cc:2955] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:42.852159  1470 catalog_manager.cc:5697] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:43.145862  2690 ts_tablet_manager.cc:933] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66: Initiating tablet copy from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373)
I20260709 12:58:43.148440  2690 tablet_copy_client.cc:323] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:34373
I20260709 12:58:43.150606  1586 tablet_copy_service.cc:140] P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Received BeginTabletCopySession request for tablet a0203dcfbe4440c790f2bf709bd16179 from peer 05476b84d8f84d76a9a1f51b620a3c66 ({username='slave'} at 127.0.0.1:37682)
I20260709 12:58:43.151259  1586 tablet_copy_service.cc:161] P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Beginning new tablet copy session on tablet a0203dcfbe4440c790f2bf709bd16179 from peer 05476b84d8f84d76a9a1f51b620a3c66 at {username='slave'} at 127.0.0.1:37682: session id = 05476b84d8f84d76a9a1f51b620a3c66-a0203dcfbe4440c790f2bf709bd16179
I20260709 12:58:43.158221  1586 tablet_copy_source_session.cc:215] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:43.161487  2690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0203dcfbe4440c790f2bf709bd16179. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:43.167224  2692 ts_tablet_manager.cc:933] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66: Initiating tablet copy from peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:43.170418  2692 tablet_copy_client.cc:323] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:45473
I20260709 12:58:43.172238  1734 tablet_copy_service.cc:140] P 0c7751452c4b46afa95251b9df7169d4: Received BeginTabletCopySession request for tablet 9ec2114c988b4a38a63b42293dcf1757 from peer 05476b84d8f84d76a9a1f51b620a3c66 ({username='slave'} at 127.0.0.1:58782)
I20260709 12:58:43.172857  1734 tablet_copy_service.cc:161] P 0c7751452c4b46afa95251b9df7169d4: Beginning new tablet copy session on tablet 9ec2114c988b4a38a63b42293dcf1757 from peer 05476b84d8f84d76a9a1f51b620a3c66 at {username='slave'} at 127.0.0.1:58782: session id = 05476b84d8f84d76a9a1f51b620a3c66-9ec2114c988b4a38a63b42293dcf1757
I20260709 12:58:43.179030  2690 tablet_copy_client.cc:806] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:43.179762  2690 tablet_copy_client.cc:670] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:43.183017  1734 tablet_copy_source_session.cc:215] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:43.186183  2690 tablet_copy_client.cc:538] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:43.191919  2692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ec2114c988b4a38a63b42293dcf1757. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:43.198776  2690 tablet_bootstrap.cc:492] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap starting.
I20260709 12:58:43.203902  2694 ts_tablet_manager.cc:933] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66: Initiating tablet copy from peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:43.218935  2694 tablet_copy_client.cc:323] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:45473
I20260709 12:58:43.222353  2692 tablet_copy_client.cc:806] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:43.223064  2692 tablet_copy_client.cc:670] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:43.227851  2692 tablet_copy_client.cc:538] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:43.228204  2690 tablet_bootstrap.cc:492] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:43.228364  1734 tablet_copy_service.cc:140] P 0c7751452c4b46afa95251b9df7169d4: Received BeginTabletCopySession request for tablet df63a7a2acf448379066cf6e352a511e from peer 05476b84d8f84d76a9a1f51b620a3c66 ({username='slave'} at 127.0.0.1:58782)
I20260709 12:58:43.229120  1734 tablet_copy_service.cc:161] P 0c7751452c4b46afa95251b9df7169d4: Beginning new tablet copy session on tablet df63a7a2acf448379066cf6e352a511e from peer 05476b84d8f84d76a9a1f51b620a3c66 at {username='slave'} at 127.0.0.1:58782: session id = 05476b84d8f84d76a9a1f51b620a3c66-df63a7a2acf448379066cf6e352a511e
I20260709 12:58:43.230342  2690 tablet_bootstrap.cc:492] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap complete.
I20260709 12:58:43.231423  2690 ts_tablet_manager.cc:1403] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent bootstrapping tablet: real 0.033s	user 0.023s	sys 0.009s
I20260709 12:58:43.237490  1734 tablet_copy_source_session.cc:215] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:43.239187  2692 tablet_bootstrap.cc:492] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap starting.
I20260709 12:58:43.234988  2690 raft_consensus.cc:359] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:43.239923  2690 raft_consensus.cc:740] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Initialized, Role: LEARNER
I20260709 12:58:43.240869  2694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df63a7a2acf448379066cf6e352a511e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:43.240706  2690 consensus_queue.cc:260] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:43.255004  2690 ts_tablet_manager.cc:1434] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent starting tablet: real 0.023s	user 0.010s	sys 0.007s
I20260709 12:58:43.257457  1586 tablet_copy_service.cc:342] P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Request end of tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-a0203dcfbe4440c790f2bf709bd16179 received from {username='slave'} at 127.0.0.1:37682
I20260709 12:58:43.257968  1586 tablet_copy_service.cc:434] P 89ac9d5e2fbc4536b03a1ff1dd3eb226: ending tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-a0203dcfbe4440c790f2bf709bd16179 on tablet a0203dcfbe4440c790f2bf709bd16179 with peer 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:58:43.261847  2690 ts_tablet_manager.cc:933] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66: Initiating tablet copy from peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:43.277493  2690 tablet_copy_client.cc:323] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:37391
I20260709 12:58:43.279706  1661 tablet_copy_service.cc:140] P 4dbe7d47a2374afca075d3a98583b49e: Received BeginTabletCopySession request for tablet 725a29842f534310a9c0bb9d5c7892a2 from peer 05476b84d8f84d76a9a1f51b620a3c66 ({username='slave'} at 127.0.0.1:57912)
I20260709 12:58:43.280308  1661 tablet_copy_service.cc:161] P 4dbe7d47a2374afca075d3a98583b49e: Beginning new tablet copy session on tablet 725a29842f534310a9c0bb9d5c7892a2 from peer 05476b84d8f84d76a9a1f51b620a3c66 at {username='slave'} at 127.0.0.1:57912: session id = 05476b84d8f84d76a9a1f51b620a3c66-725a29842f534310a9c0bb9d5c7892a2
I20260709 12:58:43.293211  2692 tablet_bootstrap.cc:492] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:43.297508  2692 tablet_bootstrap.cc:492] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap complete.
I20260709 12:58:43.295583  1661 tablet_copy_source_session.cc:215] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:43.299594  2692 ts_tablet_manager.cc:1403] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent bootstrapping tablet: real 0.061s	user 0.026s	sys 0.005s
I20260709 12:58:43.302708  2692 raft_consensus.cc:359] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:43.303658  2692 raft_consensus.cc:740] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Initialized, Role: LEARNER
I20260709 12:58:43.304383  2692 consensus_queue.cc:260] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:43.305723  2690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 725a29842f534310a9c0bb9d5c7892a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:43.307337  2692 ts_tablet_manager.cc:1434] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:58:43.314303  1734 tablet_copy_service.cc:342] P 0c7751452c4b46afa95251b9df7169d4: Request end of tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-9ec2114c988b4a38a63b42293dcf1757 received from {username='slave'} at 127.0.0.1:58782
I20260709 12:58:43.314728  1734 tablet_copy_service.cc:434] P 0c7751452c4b46afa95251b9df7169d4: ending tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-9ec2114c988b4a38a63b42293dcf1757 on tablet 9ec2114c988b4a38a63b42293dcf1757 with peer 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:58:43.303284  2694 tablet_copy_client.cc:806] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:43.318562  2694 tablet_copy_client.cc:670] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:43.322752  2694 tablet_copy_client.cc:538] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:43.331904  2694 tablet_bootstrap.cc:492] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap starting.
I20260709 12:58:43.356637  2690 tablet_copy_client.cc:806] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:43.357290  2690 tablet_copy_client.cc:670] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:43.361759  2690 tablet_copy_client.cc:538] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:43.379264  2694 tablet_bootstrap.cc:492] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:43.380443  2694 tablet_bootstrap.cc:492] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap complete.
I20260709 12:58:43.381170  2694 ts_tablet_manager.cc:1403] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66: Time spent bootstrapping tablet: real 0.049s	user 0.028s	sys 0.012s
I20260709 12:58:43.382408  2690 tablet_bootstrap.cc:492] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap starting.
I20260709 12:58:43.383601  2694 raft_consensus.cc:359] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:43.384243  2694 raft_consensus.cc:740] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Initialized, Role: LEARNER
I20260709 12:58:43.384815  2694 consensus_queue.cc:260] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:43.387264  2694 ts_tablet_manager.cc:1434] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.004s
I20260709 12:58:43.389003  1734 tablet_copy_service.cc:342] P 0c7751452c4b46afa95251b9df7169d4: Request end of tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-df63a7a2acf448379066cf6e352a511e received from {username='slave'} at 127.0.0.1:58782
I20260709 12:58:43.389451  1734 tablet_copy_service.cc:434] P 0c7751452c4b46afa95251b9df7169d4: ending tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-df63a7a2acf448379066cf6e352a511e on tablet df63a7a2acf448379066cf6e352a511e with peer 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:58:43.424053  2690 tablet_bootstrap.cc:492] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:43.424899  2690 tablet_bootstrap.cc:492] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap complete.
I20260709 12:58:43.425504  2690 ts_tablet_manager.cc:1403] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent bootstrapping tablet: real 0.043s	user 0.018s	sys 0.013s
I20260709 12:58:43.427896  2690 raft_consensus.cc:359] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:43.428627  2690 raft_consensus.cc:740] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Initialized, Role: LEARNER
I20260709 12:58:43.429256  2690 consensus_queue.cc:260] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:43.432178  2690 ts_tablet_manager.cc:1434] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:58:43.434540  1661 tablet_copy_service.cc:342] P 4dbe7d47a2374afca075d3a98583b49e: Request end of tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-725a29842f534310a9c0bb9d5c7892a2 received from {username='slave'} at 127.0.0.1:57912
I20260709 12:58:43.434998  1661 tablet_copy_service.cc:434] P 4dbe7d47a2374afca075d3a98583b49e: ending tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-725a29842f534310a9c0bb9d5c7892a2 on tablet 725a29842f534310a9c0bb9d5c7892a2 with peer 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:58:43.586563  2332 raft_consensus.cc:1217] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:43.741878  2332 raft_consensus.cc:1217] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:43.758517  2332 raft_consensus.cc:1217] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:43.775841  2332 raft_consensus.cc:1217] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:44.015363  2652 raft_consensus.cc:1064] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: attempting to promote NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 to VOTER
I20260709 12:58:44.018047  2652 consensus_queue.cc:237] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:44.026676  2332 raft_consensus.cc:1275] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:44.028317  1721 raft_consensus.cc:1275] T a0203dcfbe4440c790f2bf709bd16179 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:44.028988  1648 raft_consensus.cc:1275] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:44.029148  2610 consensus_queue.cc:1048] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:44.030265  2652 consensus_queue.cc:1048] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:44.031236  2705 consensus_queue.cc:1048] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:44.058595  2652 raft_consensus.cc:2955] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:44.062834  1648 raft_consensus.cc:2955] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:44.063983  2332 raft_consensus.cc:2955] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:44.070452  1721 raft_consensus.cc:2955] T a0203dcfbe4440c790f2bf709bd16179 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:44.085124  1471 catalog_manager.cc:5697] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:44.117573  1567 consensus_queue.cc:237] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:44.122047  2332 raft_consensus.cc:1275] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:44.123878  2705 consensus_queue.cc:1048] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:44.130457  2610 raft_consensus.cc:2955] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:44.132004  2332 raft_consensus.cc:2955] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:44.141065  1651 raft_consensus.cc:1275] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:44.143494  2652 consensus_queue.cc:1048] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:44.152974  1648 raft_consensus.cc:2955] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:44.150542  1473 catalog_manager.cc:5697] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: config changed from index 3 to 4, VOTER 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:44.161943  1459 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a0203dcfbe4440c790f2bf709bd16179 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:44.184919  2702 raft_consensus.cc:1064] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4: attempting to promote NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 to VOTER
I20260709 12:58:44.187148  1706 tablet_service.cc:1558] Processing DeleteTablet for tablet a0203dcfbe4440c790f2bf709bd16179 with delete_type TABLET_DATA_TOMBSTONED (TS 0c7751452c4b46afa95251b9df7169d4 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49982
I20260709 12:58:44.188190  2702 consensus_queue.cc:237] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:44.205799  2715 tablet_replica.cc:333] T a0203dcfbe4440c790f2bf709bd16179 P 0c7751452c4b46afa95251b9df7169d4: stopping tablet replica
I20260709 12:58:44.210183  2715 raft_consensus.cc:2243] T a0203dcfbe4440c790f2bf709bd16179 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:44.211344  2715 raft_consensus.cc:2272] T a0203dcfbe4440c790f2bf709bd16179 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:44.218058  1573 raft_consensus.cc:1275] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:44.220307  2668 consensus_queue.cc:1048] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:44.222697  2332 raft_consensus.cc:1275] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:44.225606  2667 raft_consensus.cc:1064] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e: attempting to promote NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 to VOTER
I20260709 12:58:44.230196  1648 raft_consensus.cc:1275] T 9ec2114c988b4a38a63b42293dcf1757 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:44.228412  2667 consensus_queue.cc:237] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:44.233682  2701 consensus_queue.cc:1048] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:58:44.244273  2714 consensus_queue.cc:1048] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:44.218583  2715 ts_tablet_manager.cc:1916] T a0203dcfbe4440c790f2bf709bd16179 P 0c7751452c4b46afa95251b9df7169d4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:44.266858  2329 raft_consensus.cc:1275] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:44.268635  1567 raft_consensus.cc:1275] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:44.269445  2667 consensus_queue.cc:1048] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:44.272693  1720 raft_consensus.cc:1275] T 725a29842f534310a9c0bb9d5c7892a2 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:44.274158  2667 consensus_queue.cc:1048] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:44.276770  2634 consensus_queue.cc:1048] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:44.296983  2720 raft_consensus.cc:1064] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4: attempting to promote NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 to VOTER
I20260709 12:58:44.300079  2720 consensus_queue.cc:237] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:44.304388  2714 raft_consensus.cc:2955] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:44.311007  2327 raft_consensus.cc:2955] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:44.340317  1473 catalog_manager.cc:5697] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:44.368003  1651 raft_consensus.cc:2955] T 9ec2114c988b4a38a63b42293dcf1757 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:44.370500  2715 ts_tablet_manager.cc:1929] T a0203dcfbe4440c790f2bf709bd16179 P 0c7751452c4b46afa95251b9df7169d4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:44.371438  2715 log.cc:1199] T a0203dcfbe4440c790f2bf709bd16179 P 0c7751452c4b46afa95251b9df7169d4: Deleting WAL directory at /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601869227091-431-0/minicluster-data/ts-2-root/wals/a0203dcfbe4440c790f2bf709bd16179
I20260709 12:58:44.381583  1461 catalog_manager.cc:5028] TS 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): tablet a0203dcfbe4440c790f2bf709bd16179 (table test-workload [id=2e230675e851429db50863dfed56dde5]) successfully deleted
W20260709 12:58:44.406105  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 131177us
W20260709 12:58:44.438822  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 45842.6us
I20260709 12:58:44.450078  2634 raft_consensus.cc:2955] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:44.471875  2329 raft_consensus.cc:1275] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:44.474056  1645 raft_consensus.cc:1275] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:44.473385  1573 raft_consensus.cc:2955] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:44.464661  1572 raft_consensus.cc:2955] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:44.487346  1569 raft_consensus.cc:1275] T df63a7a2acf448379066cf6e352a511e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:44.489401  2702 consensus_queue.cc:1048] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:44.493499  2717 consensus_queue.cc:1048] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:44.497264  2714 consensus_queue.cc:1048] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:44.497284  1719 consensus_queue.cc:237] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:44.510192  2327 raft_consensus.cc:1275] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:44.511924  2717 consensus_queue.cc:1048] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:44.518731  2730 raft_consensus.cc:2955] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:44.525285  2329 raft_consensus.cc:2955] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:44.529706  1461 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9ec2114c988b4a38a63b42293dcf1757 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:44.535115  1567 raft_consensus.cc:1275] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:44.543360  2327 raft_consensus.cc:2955] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:44.549203  2717 consensus_queue.cc:1048] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:44.549372  2720 raft_consensus.cc:2955] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:44.562254  1719 raft_consensus.cc:2955] T 725a29842f534310a9c0bb9d5c7892a2 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:44.566152  1473 catalog_manager.cc:5697] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: config changed from index 3 to 4, VOTER 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:44.581090  1634 tablet_service.cc:1558] Processing DeleteTablet for tablet 9ec2114c988b4a38a63b42293dcf1757 with delete_type TABLET_DATA_TOMBSTONED (TS 4dbe7d47a2374afca075d3a98583b49e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45134
I20260709 12:58:44.589316  1471 catalog_manager.cc:5697] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:44.577497  2329 raft_consensus.cc:2955] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:44.601835  1569 raft_consensus.cc:2955] T df63a7a2acf448379066cf6e352a511e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:44.602504  1567 raft_consensus.cc:2955] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:44.613941  1645 raft_consensus.cc:2955] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:44.630509  2735 tablet_replica.cc:333] T 9ec2114c988b4a38a63b42293dcf1757 P 4dbe7d47a2374afca075d3a98583b49e: stopping tablet replica
I20260709 12:58:44.629890  1473 catalog_manager.cc:5697] T df63a7a2acf448379066cf6e352a511e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:44.631636  2735 raft_consensus.cc:2243] T 9ec2114c988b4a38a63b42293dcf1757 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:44.632447  2735 raft_consensus.cc:2272] T 9ec2114c988b4a38a63b42293dcf1757 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:44.648321  2735 ts_tablet_manager.cc:1916] T 9ec2114c988b4a38a63b42293dcf1757 P 4dbe7d47a2374afca075d3a98583b49e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:44.669533  1645 consensus_queue.cc:237] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:44.673542  2735 ts_tablet_manager.cc:1929] T 9ec2114c988b4a38a63b42293dcf1757 P 4dbe7d47a2374afca075d3a98583b49e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:44.674124  2735 log.cc:1199] T 9ec2114c988b4a38a63b42293dcf1757 P 4dbe7d47a2374afca075d3a98583b49e: Deleting WAL directory at /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601869227091-431-0/minicluster-data/ts-1-root/wals/9ec2114c988b4a38a63b42293dcf1757
I20260709 12:58:44.675931  1458 catalog_manager.cc:5028] TS 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): tablet 9ec2114c988b4a38a63b42293dcf1757 (table test-workload [id=2e230675e851429db50863dfed56dde5]) successfully deleted
I20260709 12:58:44.682472  2329 raft_consensus.cc:1275] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:44.684136  2634 consensus_queue.cc:1048] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:44.689272  1716 consensus_queue.cc:237] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:44.695405  2329 raft_consensus.cc:1275] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:44.698212  1651 raft_consensus.cc:1275] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:44.699373  2717 consensus_queue.cc:1048] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:44.702457  2664 raft_consensus.cc:2955] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:44.704178  1572 raft_consensus.cc:1275] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:44.705466  2702 consensus_queue.cc:1048] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:44.711059  2725 consensus_queue.cc:1048] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:44.716023  2327 raft_consensus.cc:2955] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:44.719419  2730 raft_consensus.cc:2955] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:44.723778  1458 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 725a29842f534310a9c0bb9d5c7892a2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:44.727229  1645 raft_consensus.cc:2955] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:44.717518  1572 raft_consensus.cc:2955] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:44.745759  1470 catalog_manager.cc:5697] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: config changed from index 3 to 4, VOTER 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:44.763224  1461 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet df63a7a2acf448379066cf6e352a511e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:44.765352  1706 tablet_service.cc:1558] Processing DeleteTablet for tablet 725a29842f534310a9c0bb9d5c7892a2 with delete_type TABLET_DATA_TOMBSTONED (TS 0c7751452c4b46afa95251b9df7169d4 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49982
I20260709 12:58:44.773315  2715 tablet_replica.cc:333] T 725a29842f534310a9c0bb9d5c7892a2 P 0c7751452c4b46afa95251b9df7169d4: stopping tablet replica
I20260709 12:58:44.772298  2329 raft_consensus.cc:2955] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:44.783989  2715 raft_consensus.cc:2243] T 725a29842f534310a9c0bb9d5c7892a2 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:44.784915  2715 raft_consensus.cc:2272] T 725a29842f534310a9c0bb9d5c7892a2 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:44.788724  2715 ts_tablet_manager.cc:1916] T 725a29842f534310a9c0bb9d5c7892a2 P 0c7751452c4b46afa95251b9df7169d4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:44.790333  1473 catalog_manager.cc:5697] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: config changed from index 3 to 4, VOTER 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:44.806056  1561 tablet_service.cc:1558] Processing DeleteTablet for tablet df63a7a2acf448379066cf6e352a511e with delete_type TABLET_DATA_TOMBSTONED (TS 89ac9d5e2fbc4536b03a1ff1dd3eb226 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36626
I20260709 12:58:44.817685  2738 tablet_replica.cc:333] T df63a7a2acf448379066cf6e352a511e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: stopping tablet replica
I20260709 12:58:44.819787  2738 raft_consensus.cc:2243] T df63a7a2acf448379066cf6e352a511e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:44.823239  2738 raft_consensus.cc:2272] T df63a7a2acf448379066cf6e352a511e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:44.824918  2715 ts_tablet_manager.cc:1929] T 725a29842f534310a9c0bb9d5c7892a2 P 0c7751452c4b46afa95251b9df7169d4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:44.830376  2738 ts_tablet_manager.cc:1916] T df63a7a2acf448379066cf6e352a511e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:44.831921  2715 log.cc:1199] T 725a29842f534310a9c0bb9d5c7892a2 P 0c7751452c4b46afa95251b9df7169d4: Deleting WAL directory at /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601869227091-431-0/minicluster-data/ts-2-root/wals/725a29842f534310a9c0bb9d5c7892a2
I20260709 12:58:44.834810  1461 catalog_manager.cc:5028] TS 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): tablet 725a29842f534310a9c0bb9d5c7892a2 (table test-workload [id=2e230675e851429db50863dfed56dde5]) successfully deleted
I20260709 12:58:44.843473  2738 ts_tablet_manager.cc:1929] T df63a7a2acf448379066cf6e352a511e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:44.844054  2738 log.cc:1199] T df63a7a2acf448379066cf6e352a511e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Deleting WAL directory at /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601869227091-431-0/minicluster-data/ts-0-root/wals/df63a7a2acf448379066cf6e352a511e
I20260709 12:58:44.845801  1459 catalog_manager.cc:5028] TS 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): tablet df63a7a2acf448379066cf6e352a511e (table test-workload [id=2e230675e851429db50863dfed56dde5]) successfully deleted
I20260709 12:58:45.877354  1716 consensus_queue.cc:237] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:45.885190  1651 raft_consensus.cc:1275] T 091ce8e86e49437b8fffb903bd5ce2fb P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:58:45.885274  1689 consensus_peers.cc:597] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 -> Peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423): Couldn't send request to peer 05476b84d8f84d76a9a1f51b620a3c66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 091ce8e86e49437b8fffb903bd5ce2fb. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:45.886245  1567 raft_consensus.cc:1275] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:45.886814  2721 consensus_queue.cc:1048] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:45.888252  2730 consensus_queue.cc:1048] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:45.899609  2730 raft_consensus.cc:2955] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:45.902979  1567 raft_consensus.cc:2955] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:45.907528  1651 raft_consensus.cc:2955] T 091ce8e86e49437b8fffb903bd5ce2fb P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:45.928908  1470 catalog_manager.cc:5697] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:45.935195  1645 consensus_queue.cc:237] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
W20260709 12:58:45.944325  1615 consensus_peers.cc:597] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423): Couldn't send request to peer 05476b84d8f84d76a9a1f51b620a3c66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 65524f4fe7be481b9f069829076b7dc3. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:45.944669  1567 raft_consensus.cc:1275] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:45.945443  1716 raft_consensus.cc:1275] T 65524f4fe7be481b9f069829076b7dc3 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:45.946457  2725 consensus_queue.cc:1048] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:45.947477  2736 consensus_queue.cc:1048] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:45.982748  2725 raft_consensus.cc:2955] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:45.985960  1716 raft_consensus.cc:2955] T 65524f4fe7be481b9f069829076b7dc3 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:45.986061  1567 raft_consensus.cc:2955] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:46.003934  1473 catalog_manager.cc:5697] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:46.010459  1716 consensus_queue.cc:237] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:46.019501  1645 raft_consensus.cc:1275] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:46.020999  2721 consensus_queue.cc:1048] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:58:46.024303  1689 consensus_peers.cc:597] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 -> Peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423): Couldn't send request to peer 05476b84d8f84d76a9a1f51b620a3c66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a7bcbc7b936b4bdca8a41d00f9ecdd5f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:46.026548  1567 raft_consensus.cc:1275] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:46.028316  2730 consensus_queue.cc:1048] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:46.031226  2721 raft_consensus.cc:2955] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:46.034638  1645 raft_consensus.cc:2955] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:46.043568  1572 raft_consensus.cc:2955] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:46.051051  1471 catalog_manager.cc:5697] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:46.062129  1645 consensus_queue.cc:237] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:46.082762  1719 raft_consensus.cc:1275] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:58:46.082835  1615 consensus_peers.cc:597] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423): Couldn't send request to peer 05476b84d8f84d76a9a1f51b620a3c66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 475f4ce2905344b0803209ce7b2e9386. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:46.082762  1567 raft_consensus.cc:1275] T 475f4ce2905344b0803209ce7b2e9386 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:46.084367  2753 consensus_queue.cc:1048] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:46.086187  2736 consensus_queue.cc:1048] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:46.106400  2725 raft_consensus.cc:2955] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:46.108031  1572 raft_consensus.cc:2955] T 475f4ce2905344b0803209ce7b2e9386 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:46.127708  1716 raft_consensus.cc:2955] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:46.132751  1471 catalog_manager.cc:5697] T 475f4ce2905344b0803209ce7b2e9386 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:46.266218  2760 ts_tablet_manager.cc:933] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66: Initiating tablet copy from peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:46.268116  2760 tablet_copy_client.cc:323] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:45473
I20260709 12:58:46.269694  1734 tablet_copy_service.cc:140] P 0c7751452c4b46afa95251b9df7169d4: Received BeginTabletCopySession request for tablet 091ce8e86e49437b8fffb903bd5ce2fb from peer 05476b84d8f84d76a9a1f51b620a3c66 ({username='slave'} at 127.0.0.1:58782)
I20260709 12:58:46.270313  1734 tablet_copy_service.cc:161] P 0c7751452c4b46afa95251b9df7169d4: Beginning new tablet copy session on tablet 091ce8e86e49437b8fffb903bd5ce2fb from peer 05476b84d8f84d76a9a1f51b620a3c66 at {username='slave'} at 127.0.0.1:58782: session id = 05476b84d8f84d76a9a1f51b620a3c66-091ce8e86e49437b8fffb903bd5ce2fb
I20260709 12:58:46.281798  1734 tablet_copy_source_session.cc:215] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:46.284858  2760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 091ce8e86e49437b8fffb903bd5ce2fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.296813  2760 tablet_copy_client.cc:806] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:46.297369  2760 tablet_copy_client.cc:670] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:46.300645  2760 tablet_copy_client.cc:538] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:46.306555  2760 tablet_bootstrap.cc:492] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap starting.
I20260709 12:58:46.327374  2760 tablet_bootstrap.cc:492] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:46.328344  2760 tablet_bootstrap.cc:492] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap complete.
I20260709 12:58:46.329056  2760 ts_tablet_manager.cc:1403] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66: Time spent bootstrapping tablet: real 0.023s	user 0.019s	sys 0.004s
I20260709 12:58:46.333595  2760 raft_consensus.cc:359] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:46.334529  2760 raft_consensus.cc:740] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Initialized, Role: LEARNER
I20260709 12:58:46.335227  2760 consensus_queue.cc:260] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:46.339805  2760 ts_tablet_manager.cc:1434] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:58:46.341624  1734 tablet_copy_service.cc:342] P 0c7751452c4b46afa95251b9df7169d4: Request end of tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-091ce8e86e49437b8fffb903bd5ce2fb received from {username='slave'} at 127.0.0.1:58782
I20260709 12:58:46.342057  1734 tablet_copy_service.cc:434] P 0c7751452c4b46afa95251b9df7169d4: ending tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-091ce8e86e49437b8fffb903bd5ce2fb on tablet 091ce8e86e49437b8fffb903bd5ce2fb with peer 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:58:46.396876  2760 ts_tablet_manager.cc:933] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66: Initiating tablet copy from peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:46.398583  2760 tablet_copy_client.cc:323] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:45473
I20260709 12:58:46.400168  1734 tablet_copy_service.cc:140] P 0c7751452c4b46afa95251b9df7169d4: Received BeginTabletCopySession request for tablet a7bcbc7b936b4bdca8a41d00f9ecdd5f from peer 05476b84d8f84d76a9a1f51b620a3c66 ({username='slave'} at 127.0.0.1:58782)
I20260709 12:58:46.400705  1734 tablet_copy_service.cc:161] P 0c7751452c4b46afa95251b9df7169d4: Beginning new tablet copy session on tablet a7bcbc7b936b4bdca8a41d00f9ecdd5f from peer 05476b84d8f84d76a9a1f51b620a3c66 at {username='slave'} at 127.0.0.1:58782: session id = 05476b84d8f84d76a9a1f51b620a3c66-a7bcbc7b936b4bdca8a41d00f9ecdd5f
I20260709 12:58:46.408272  1734 tablet_copy_source_session.cc:215] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:46.411972  2760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7bcbc7b936b4bdca8a41d00f9ecdd5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.426476  2760 tablet_copy_client.cc:806] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:46.427071  2760 tablet_copy_client.cc:670] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:46.430706  2760 tablet_copy_client.cc:538] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:46.443650  2760 tablet_bootstrap.cc:492] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap starting.
I20260709 12:58:46.449460  2765 ts_tablet_manager.cc:933] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66: Initiating tablet copy from peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:46.451803  2765 tablet_copy_client.cc:323] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:37391
I20260709 12:58:46.453485  1661 tablet_copy_service.cc:140] P 4dbe7d47a2374afca075d3a98583b49e: Received BeginTabletCopySession request for tablet 65524f4fe7be481b9f069829076b7dc3 from peer 05476b84d8f84d76a9a1f51b620a3c66 ({username='slave'} at 127.0.0.1:57912)
I20260709 12:58:46.453996  1661 tablet_copy_service.cc:161] P 4dbe7d47a2374afca075d3a98583b49e: Beginning new tablet copy session on tablet 65524f4fe7be481b9f069829076b7dc3 from peer 05476b84d8f84d76a9a1f51b620a3c66 at {username='slave'} at 127.0.0.1:57912: session id = 05476b84d8f84d76a9a1f51b620a3c66-65524f4fe7be481b9f069829076b7dc3
I20260709 12:58:46.462728  1661 tablet_copy_source_session.cc:215] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:46.466094  2765 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65524f4fe7be481b9f069829076b7dc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.483075  2760 tablet_bootstrap.cc:492] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:46.484561  2760 tablet_bootstrap.cc:492] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap complete.
I20260709 12:58:46.485253  2760 ts_tablet_manager.cc:1403] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66: Time spent bootstrapping tablet: real 0.042s	user 0.019s	sys 0.005s
I20260709 12:58:46.488010  2765 tablet_copy_client.cc:806] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:46.488689  2765 tablet_copy_client.cc:670] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:46.494071  2765 tablet_copy_client.cc:538] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:46.502676  2760 raft_consensus.cc:359] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:46.503572  2760 raft_consensus.cc:740] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Initialized, Role: LEARNER
I20260709 12:58:46.504204  2760 consensus_queue.cc:260] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:46.506556  2760 ts_tablet_manager.cc:1434] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:58:46.509521  1734 tablet_copy_service.cc:342] P 0c7751452c4b46afa95251b9df7169d4: Request end of tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-a7bcbc7b936b4bdca8a41d00f9ecdd5f received from {username='slave'} at 127.0.0.1:58782
I20260709 12:58:46.509929  1734 tablet_copy_service.cc:434] P 0c7751452c4b46afa95251b9df7169d4: ending tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-a7bcbc7b936b4bdca8a41d00f9ecdd5f on tablet a7bcbc7b936b4bdca8a41d00f9ecdd5f with peer 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:58:46.513954  2760 ts_tablet_manager.cc:933] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66: Initiating tablet copy from peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:46.521129  2760 tablet_copy_client.cc:323] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:37391
I20260709 12:58:46.522526  1661 tablet_copy_service.cc:140] P 4dbe7d47a2374afca075d3a98583b49e: Received BeginTabletCopySession request for tablet 475f4ce2905344b0803209ce7b2e9386 from peer 05476b84d8f84d76a9a1f51b620a3c66 ({username='slave'} at 127.0.0.1:57912)
I20260709 12:58:46.523023  1661 tablet_copy_service.cc:161] P 4dbe7d47a2374afca075d3a98583b49e: Beginning new tablet copy session on tablet 475f4ce2905344b0803209ce7b2e9386 from peer 05476b84d8f84d76a9a1f51b620a3c66 at {username='slave'} at 127.0.0.1:57912: session id = 05476b84d8f84d76a9a1f51b620a3c66-475f4ce2905344b0803209ce7b2e9386
I20260709 12:58:46.524245  2765 tablet_bootstrap.cc:492] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap starting.
I20260709 12:58:46.533402  1661 tablet_copy_source_session.cc:215] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:46.537266  2760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 475f4ce2905344b0803209ce7b2e9386. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:46.559618  2765 tablet_bootstrap.cc:492] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:46.560113  2760 tablet_copy_client.cc:806] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:46.561915  2765 tablet_bootstrap.cc:492] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap complete.
I20260709 12:58:46.561941  2760 tablet_copy_client.cc:670] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:46.562831  2765 ts_tablet_manager.cc:1403] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent bootstrapping tablet: real 0.039s	user 0.018s	sys 0.017s
I20260709 12:58:46.567504  2760 tablet_copy_client.cc:538] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:46.567086  2765 raft_consensus.cc:359] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:46.567912  2765 raft_consensus.cc:740] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Initialized, Role: LEARNER
I20260709 12:58:46.568578  2765 consensus_queue.cc:260] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:46.578922  2765 ts_tablet_manager.cc:1434] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:58:46.579891  2760 tablet_bootstrap.cc:492] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap starting.
I20260709 12:58:46.591877  1661 tablet_copy_service.cc:342] P 4dbe7d47a2374afca075d3a98583b49e: Request end of tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-65524f4fe7be481b9f069829076b7dc3 received from {username='slave'} at 127.0.0.1:57912
I20260709 12:58:46.592317  1661 tablet_copy_service.cc:434] P 4dbe7d47a2374afca075d3a98583b49e: ending tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-65524f4fe7be481b9f069829076b7dc3 on tablet 65524f4fe7be481b9f069829076b7dc3 with peer 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:58:46.601413  2760 tablet_bootstrap.cc:492] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:46.602130  2760 tablet_bootstrap.cc:492] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap complete.
I20260709 12:58:46.602679  2760 ts_tablet_manager.cc:1403] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.004s
I20260709 12:58:46.604714  2760 raft_consensus.cc:359] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:46.605281  2760 raft_consensus.cc:740] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Initialized, Role: LEARNER
I20260709 12:58:46.605759  2760 consensus_queue.cc:260] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:46.607535  2760 ts_tablet_manager.cc:1434] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:58:46.609628  1661 tablet_copy_service.cc:342] P 4dbe7d47a2374afca075d3a98583b49e: Request end of tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-475f4ce2905344b0803209ce7b2e9386 received from {username='slave'} at 127.0.0.1:57912
I20260709 12:58:46.610059  1661 tablet_copy_service.cc:434] P 4dbe7d47a2374afca075d3a98583b49e: ending tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-475f4ce2905344b0803209ce7b2e9386 on tablet 475f4ce2905344b0803209ce7b2e9386 with peer 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:58:46.728606  2329 raft_consensus.cc:1217] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:46.843811  2329 raft_consensus.cc:1217] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:47.036928  2329 raft_consensus.cc:1217] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:47.038476  2327 raft_consensus.cc:1217] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:47.247061  2721 raft_consensus.cc:1064] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4: attempting to promote NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 to VOTER
I20260709 12:58:47.249084  2721 consensus_queue.cc:237] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:47.257158  2327 raft_consensus.cc:1275] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:47.258844  1648 raft_consensus.cc:1275] T 091ce8e86e49437b8fffb903bd5ce2fb P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:47.259922  1567 raft_consensus.cc:1275] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:47.261178  2730 consensus_queue.cc:1048] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:47.262409  2773 consensus_queue.cc:1048] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:47.263499  2730 consensus_queue.cc:1048] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:47.449682   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:47.725507  2721 raft_consensus.cc:2955] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:48.254233  2791 raft_consensus.cc:493] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:58:48.254820  2791 raft_consensus.cc:515] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:48.257071  2791 leader_election.cc:290] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:48.264312  2777 raft_consensus.cc:493] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:58:48.264983  2777 raft_consensus.cc:515] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:48.267648  2777 leader_election.cc:290] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:48.273947  2777 raft_consensus.cc:493] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:58:48.274471  2777 raft_consensus.cc:515] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:48.287302  2786 raft_consensus.cc:493] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:58:48.287897  2786 raft_consensus.cc:515] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:48.294016  2786 leader_election.cc:290] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:48.298156  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:48.301972  2777 leader_election.cc:290] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:48.305740  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:48.316190  2793 raft_consensus.cc:493] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:58:48.316934  2793 raft_consensus.cc:515] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:48.321434  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:48.325637  2793 leader_election.cc:290] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:48.327421  2787 raft_consensus.cc:493] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:58:48.328131  2787 raft_consensus.cc:515] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:48.330219  2787 leader_election.cc:290] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:48.330367  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:48.332741  2782 raft_consensus.cc:1064] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e: attempting to promote NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 to VOTER
I20260709 12:58:48.332751  1646 raft_consensus.cc:2955] T 091ce8e86e49437b8fffb903bd5ce2fb P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:48.340049  2730 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:58:48.340602  2730 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:48.342221  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:48.342820  2730 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:48.343693  2777 raft_consensus.cc:493] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:58:48.344177  2777 raft_consensus.cc:515] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:48.346036  2777 leader_election.cc:290] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:48.347664  2782 consensus_queue.cc:237] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:48.349400  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:48.364774  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:48.350095  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:48.351078  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:48.361855  2784 raft_consensus.cc:1064] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e: attempting to promote NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 to VOTER
I20260709 12:58:48.369602  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:48.369936  2784 consensus_queue.cc:237] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:48.382354  2777 raft_consensus.cc:1064] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4: attempting to promote NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 to VOTER
I20260709 12:58:48.385377  2777 consensus_queue.cc:237] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:48.394618  2793 raft_consensus.cc:493] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:58:48.395259  2793 raft_consensus.cc:515] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:48.397836  2793 leader_election.cc:290] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:48.401986  2330 raft_consensus.cc:1275] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:48.404328  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:48.406949  2792 consensus_queue.cc:1048] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:48.413899  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:48.421545  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:48.420214  1571 raft_consensus.cc:1275] T 475f4ce2905344b0803209ce7b2e9386 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:48.425222  2330 raft_consensus.cc:1275] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:48.426285  1574 raft_consensus.cc:1275] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:48.428912  2784 consensus_queue.cc:1048] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:48.432183  2781 consensus_queue.cc:1048] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:48.434278  2781 consensus_queue.cc:1048] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:48.441696  1470 catalog_manager.cc:5697] T 091ce8e86e49437b8fffb903bd5ce2fb P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:48.441769  1574 raft_consensus.cc:2955] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:48.445519  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:48.446266  1542 leader_election.cc:304] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:58:48.447074  2793 raft_consensus.cc:2749] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:48.453435  1646 raft_consensus.cc:1275] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:48.455083  2730 consensus_queue.cc:1048] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:48.455061  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:58:48.462607  1617 leader_election.cc:304] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:48.465188  2782 raft_consensus.cc:2749] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:48.467561  2328 raft_consensus.cc:2955] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:48.477417  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:48.477988  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:48.478726  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:48.479053  2332 raft_consensus.cc:1275] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:48.483080  1716 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e"
dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
mode: GRACEFUL
new_leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:50592
I20260709 12:58:48.483718  1721 raft_consensus.cc:1275] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:48.484354  1719 raft_consensus.cc:1275] T 65524f4fe7be481b9f069829076b7dc3 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:48.483740  1716 raft_consensus.cc:606] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Received request to transfer leadership to TS 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:48.485781  2791 raft_consensus.cc:2955] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:48.489193  1571 raft_consensus.cc:1275] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:48.492231  1689 leader_election.cc:304] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:48.495815  2730 raft_consensus.cc:2749] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:48.496299  1689 leader_election.cc:304] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:48.497176  2730 raft_consensus.cc:2749] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:48.498440  1689 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:48.494966  2783 raft_consensus.cc:2955] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:48.499425  2730 raft_consensus.cc:2749] T 4fa306a802914bb9b8d54b7bfe53009c P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:48.500785  1689 leader_election.cc:304] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:48.501561  2730 raft_consensus.cc:2749] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:48.503804  2776 consensus_queue.cc:1048] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:48.497480  2330 raft_consensus.cc:2955] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:48.509330  2776 consensus_queue.cc:1048] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:48.516813  1542 leader_election.cc:304] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:58:48.518056  2793 raft_consensus.cc:2749] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:48.518437  1542 leader_election.cc:304] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:58:48.519338  2793 raft_consensus.cc:2749] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:48.519972  1542 leader_election.cc:304] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:58:48.521103  2787 raft_consensus.cc:2749] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:48.526634  1719 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6"
dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
mode: GRACEFUL
new_leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:50592
I20260709 12:58:48.527185  1719 raft_consensus.cc:606] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Received request to transfer leadership to TS 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:48.511747  1571 raft_consensus.cc:2955] T 475f4ce2905344b0803209ce7b2e9386 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:48.528915  2781 consensus_queue.cc:1048] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:48.530819  1719 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0"
dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
mode: GRACEFUL
new_leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:50592
I20260709 12:58:48.531786  1719 raft_consensus.cc:606] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Received request to transfer leadership to TS 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:48.534425  1716 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819"
dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
mode: GRACEFUL
new_leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:50592
I20260709 12:58:48.534853  1716 raft_consensus.cc:606] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Received request to transfer leadership to TS 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:48.536015  1574 raft_consensus.cc:2955] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:48.538380  1716 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91"
dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
mode: GRACEFUL
new_leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:50592
I20260709 12:58:48.538826  1716 raft_consensus.cc:606] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 2 LEADER]: Received request to transfer leadership to TS 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:48.547851  2808 consensus_queue.cc:1048] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:48.554653  1719 raft_consensus.cc:2955] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:48.578778  2324 raft_consensus.cc:2955] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:48.593271  2332 raft_consensus.cc:2955] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:48.589946  2776 raft_consensus.cc:2955] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:48.619189  1716 raft_consensus.cc:2955] T 65524f4fe7be481b9f069829076b7dc3 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:48.840062  2790 raft_consensus.cc:493] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:58:48.852564  2790 raft_consensus.cc:515] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:48.893141  2790 leader_election.cc:290] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:48.948154  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:48.974634  1646 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f964296f18474862b1eee102af9116f4"
dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
mode: GRACEFUL
new_leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
 from {username='slave'} at 127.0.0.1:35470
I20260709 12:58:48.975955  1646 raft_consensus.cc:606] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Received request to transfer leadership to TS 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:58:48.977121  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:48.984376   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:58:48.986120   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 12:58:48.996292  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 185650us
I20260709 12:58:49.004500  1642 raft_consensus.cc:2955] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:49.026064  1542 leader_election.cc:304] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:58:49.021831  1474 catalog_manager.cc:5697] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:49.028873  2828 raft_consensus.cc:993] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e: : Instructing follower 05476b84d8f84d76a9a1f51b620a3c66 to start an election
I20260709 12:58:49.029542  2832 raft_consensus.cc:1081] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Signalling peer 05476b84d8f84d76a9a1f51b620a3c66 to start an election
I20260709 12:58:49.029027  1474 catalog_manager.cc:5697] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:49.030488  1474 catalog_manager.cc:5697] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:49.032729  2787 raft_consensus.cc:2749] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:49.036831  1721 consensus_queue.cc:237] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:49.043612  2326 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f964296f18474862b1eee102af9116f4"
dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
 from {username='slave'} at 127.0.0.1:53290
I20260709 12:58:49.044466  2326 raft_consensus.cc:493] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:49.044957  2326 raft_consensus.cc:3060] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:49.061319  2721 raft_consensus.cc:993] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4: : Instructing follower 89ac9d5e2fbc4536b03a1ff1dd3eb226 to start an election
I20260709 12:58:49.062448  2776 raft_consensus.cc:1081] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Signalling peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 to start an election
I20260709 12:58:49.064370  2825 raft_consensus.cc:993] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4: : Instructing follower 89ac9d5e2fbc4536b03a1ff1dd3eb226 to start an election
I20260709 12:58:49.065644  2825 raft_consensus.cc:1081] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Signalling peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 to start an election
I20260709 12:58:49.072373  2829 raft_consensus.cc:993] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4: : Instructing follower 89ac9d5e2fbc4536b03a1ff1dd3eb226 to start an election
I20260709 12:58:49.073552  2829 raft_consensus.cc:1081] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Signalling peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 to start an election
I20260709 12:58:49.074870  2825 raft_consensus.cc:993] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4: : Instructing follower 89ac9d5e2fbc4536b03a1ff1dd3eb226 to start an election
I20260709 12:58:49.078099  2721 raft_consensus.cc:1081] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 2 LEADER]: Signalling peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 to start an election
I20260709 12:58:49.072479  2326 raft_consensus.cc:515] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:49.093928  1573 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6"
dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:36642
I20260709 12:58:49.094485  1573 raft_consensus.cc:493] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:49.094826  1573 raft_consensus.cc:3060] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:49.093945  1571 raft_consensus.cc:2955] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:49.097287  1576 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0"
dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:36642
I20260709 12:58:49.097847  1576 raft_consensus.cc:493] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:49.098176  1576 raft_consensus.cc:3060] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:49.099534  1646 consensus_queue.cc:237] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:49.103649  1574 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819"
dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:36642
I20260709 12:58:49.104198  1574 raft_consensus.cc:493] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:49.104611  1574 raft_consensus.cc:3060] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:49.107596  1573 raft_consensus.cc:515] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:49.112018  2325 raft_consensus.cc:1275] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:49.112428  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:49.112995  1645 raft_consensus.cc:3060] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:49.114447  1568 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91"
dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:36642
I20260709 12:58:49.114948  1568 raft_consensus.cc:493] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:49.115255  1568 raft_consensus.cc:3060] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:49.118834  1573 leader_election.cc:290] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:49.119624  1645 raft_consensus.cc:2468] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 2.
I20260709 12:58:49.122148  1567 raft_consensus.cc:1275] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:49.124358  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:58:49.124907  1721 raft_consensus.cc:3055] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:49.125190  1721 raft_consensus.cc:740] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:58:49.126742  1574 raft_consensus.cc:515] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:49.118181  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
W20260709 12:58:49.127835  2353 debug-util.cc:398] Leaking SignalData structure 0x7b0800300060 after lost signal to thread 434
I20260709 12:58:49.128188  1642 raft_consensus.cc:3055] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:49.128508  1642 raft_consensus.cc:740] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:58:49.134879  1567 raft_consensus.cc:1275] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:49.138814  1539 leader_election.cc:304] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:58:49.107980  1576 raft_consensus.cc:515] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:49.142392  2818 raft_consensus.cc:2804] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:49.142328  2721 consensus_queue.cc:1048] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:49.143000  2777 raft_consensus.cc:993] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4: : Instructing follower 89ac9d5e2fbc4536b03a1ff1dd3eb226 to start an election
I20260709 12:58:49.143078  2818 raft_consensus.cc:697] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:58:49.143621  2777 raft_consensus.cc:1081] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Signalling peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 to start an election
W20260709 12:58:49.133982  2353 debug-util.cc:398] Leaking SignalData structure 0x7b0800300740 after lost signal to thread 1508
W20260709 12:58:49.145857  2353 debug-util.cc:398] Leaking SignalData structure 0x7b080033afc0 after lost signal to thread 1600
I20260709 12:58:49.149896  1567 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e"
dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:36642
I20260709 12:58:49.150452  1567 raft_consensus.cc:493] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:49.150817  1567 raft_consensus.cc:3060] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:49.153878  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:49.154403  1645 raft_consensus.cc:3060] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:49.156095  1574 leader_election.cc:290] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:49.140049  1721 consensus_queue.cc:260] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:49.158361  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:49.147905  2325 raft_consensus.cc:1275] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:49.158980  1646 raft_consensus.cc:3060] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:58:49.163272  2353 debug-util.cc:398] Leaking SignalData structure 0x7b0800330fa0 after lost signal to thread 2356
I20260709 12:58:49.163059  2823 consensus_queue.cc:1048] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.007s
I20260709 12:58:49.153244  2830 consensus_queue.cc:1048] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 12:58:49.168143  1642 consensus_queue.cc:260] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:49.164558  1721 raft_consensus.cc:3060] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:49.173768  1642 raft_consensus.cc:3060] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:49.174436  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:58:49.175045  1724 raft_consensus.cc:3055] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:49.175369  1724 raft_consensus.cc:740] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:58:49.178738  1576 leader_election.cc:290] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:49.144182  2818 consensus_queue.cc:237] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:49.177042  1568 raft_consensus.cc:515] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:49.181232  1721 raft_consensus.cc:2468] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 2.
I20260709 12:58:49.179421  2821 consensus_queue.cc:1048] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:58:49.180248  1724 consensus_queue.cc:260] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:49.187819  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:49.188400  1648 raft_consensus.cc:3060] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:49.189117  2326 leader_election.cc:290] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:49.190882  1724 raft_consensus.cc:3060] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:49.217502  1645 raft_consensus.cc:2468] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 2.
I20260709 12:58:49.220324  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:58:49.221014  1720 raft_consensus.cc:3060] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:49.223008  1567 raft_consensus.cc:515] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:49.227591  1648 raft_consensus.cc:2468] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 3.
I20260709 12:58:49.228145  1720 raft_consensus.cc:2468] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 2.
I20260709 12:58:49.228295  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:58:49.231259  1725 raft_consensus.cc:3055] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:49.231577  1725 raft_consensus.cc:740] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:58:49.232431  1539 leader_election.cc:304] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:58:49.238366  1568 leader_election.cc:290] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:49.235622  1725 consensus_queue.cc:260] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:49.239573  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:58:49.239914  1725 raft_consensus.cc:3060] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:49.240140  1716 raft_consensus.cc:3055] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:49.240450  1716 raft_consensus.cc:740] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:58:49.242190  1716 consensus_queue.cc:260] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:49.243127  1716 raft_consensus.cc:3060] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:49.245751  1646 raft_consensus.cc:2468] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 2.
W20260709 12:58:49.232610  2834 log.cc:927] Time spent T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 12:58:49.247128  1539 leader_election.cc:304] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:58:49.261092  2297 leader_election.cc:304] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 12:58:49.263998  2812 raft_consensus.cc:2804] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:49.253728  2793 raft_consensus.cc:2804] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:49.263897  2782 raft_consensus.cc:2955] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:49.267959  2819 raft_consensus.cc:2804] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:49.266767  1725 raft_consensus.cc:2468] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 2.
I20260709 12:58:49.269809  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:49.271078  1646 raft_consensus.cc:3060] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:49.272497  1539 leader_election.cc:304] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:58:49.275967  2793 raft_consensus.cc:697] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:58:49.314819  2777 raft_consensus.cc:2955] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
W20260709 12:58:49.334735  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 62322.3us
I20260709 12:58:49.328213  1724 raft_consensus.cc:2468] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 2.
I20260709 12:58:49.341516  1646 raft_consensus.cc:2468] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 2.
I20260709 12:58:49.344491  1716 raft_consensus.cc:2468] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 3.
I20260709 12:58:49.348335  1651 consensus_queue.cc:237] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:49.349270  1642 raft_consensus.cc:2468] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 2.
I20260709 12:58:49.334092  2819 raft_consensus.cc:697] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:58:49.364435  1716 raft_consensus.cc:1275] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:49.370364  1567 leader_election.cc:290] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:49.356926  2819 consensus_queue.cc:237] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:49.357203  2822 raft_consensus.cc:2804] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:49.408015  1458 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 65524f4fe7be481b9f069829076b7dc3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:49.376032  2812 raft_consensus.cc:697] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:58:49.419152  2326 raft_consensus.cc:1275] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:49.419247  1575 raft_consensus.cc:2955] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:49.401012  2832 consensus_queue.cc:1048] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:58:49.417668  2793 consensus_queue.cc:237] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:49.417523  2822 raft_consensus.cc:697] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:58:49.473125  1539 leader_election.cc:304] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:58:49.474269  2818 raft_consensus.cc:2804] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:49.474794  2818 raft_consensus.cc:697] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:58:49.475561  2818 consensus_queue.cc:237] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:58:49.482682  2835 log.cc:927] Time spent T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 12:58:49.484833  2822 consensus_queue.cc:237] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:49.489065  2812 consensus_queue.cc:237] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:58:49.534756  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 130381us
I20260709 12:58:49.545636  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:58:49.546279  1716 raft_consensus.cc:3055] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:49.546629  1716 raft_consensus.cc:740] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
W20260709 12:58:49.548923  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 148830us
I20260709 12:58:49.554010  1567 raft_consensus.cc:2955] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:49.576027  1716 consensus_queue.cc:260] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:49.593091  2324 raft_consensus.cc:2955] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:49.597177  1716 raft_consensus.cc:3060] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:49.596304  1470 catalog_manager.cc:5697] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 1 to 2, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:49.615031  1716 raft_consensus.cc:2468] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 2.
W20260709 12:58:49.615727  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 56885.2us
I20260709 12:58:49.630625  1461 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 091ce8e86e49437b8fffb903bd5ce2fb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:49.630525  1473 catalog_manager.cc:5697] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: config changed from index 3 to 4, VOTER 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:49.639171  2832 consensus_queue.cc:1048] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:58:49.664127  2805 log.cc:927] Time spent T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.075s	user 0.003s	sys 0.000s
I20260709 12:58:49.671649  2828 raft_consensus.cc:2955] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
W20260709 12:58:49.678581  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:49.684852  2330 raft_consensus.cc:2955] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
W20260709 12:58:49.694782  2843 log.cc:927] Time spent T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.057s	user 0.003s	sys 0.000s
I20260709 12:58:49.712950  1474 catalog_manager.cc:5697] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 1 to 2, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:49.716326  1717 consensus_queue.cc:237] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:58:49.721735  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 64614.3us
I20260709 12:58:49.734802  1471 catalog_manager.cc:5697] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: config changed from index 3 to 4, VOTER 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:49.736893  2325 raft_consensus.cc:2955] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:49.744097  2332 raft_consensus.cc:1275] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:49.744891  1571 raft_consensus.cc:1275] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:49.765326  2825 consensus_queue.cc:1048] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:58:49.773460  1646 raft_consensus.cc:1275] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:49.774852  2818 consensus_queue.cc:1048] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:49.780917  2776 consensus_queue.cc:1048] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:58:49.785104  1719 raft_consensus.cc:1275] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:49.790007  1458 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 475f4ce2905344b0803209ce7b2e9386 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:49.793834  2837 consensus_queue.cc:1048] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:58:49.797405  2777 raft_consensus.cc:2955] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:49.804061  1719 raft_consensus.cc:2955] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:49.807394  2325 raft_consensus.cc:2955] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:49.814167  1575 raft_consensus.cc:2955] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:49.839668  1646 raft_consensus.cc:1275] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:49.842002  2837 consensus_queue.cc:1048] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:49.852358  1643 raft_consensus.cc:1275] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:49.862763  2837 consensus_queue.cc:1048] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:49.881366  1461 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a7bcbc7b936b4bdca8a41d00f9ecdd5f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:49.886590  1643 raft_consensus.cc:1275] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:49.888015  2837 consensus_queue.cc:1048] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:49.919847  1706 tablet_service.cc:1558] Processing DeleteTablet for tablet 65524f4fe7be481b9f069829076b7dc3 with delete_type TABLET_DATA_TOMBSTONED (TS 0c7751452c4b46afa95251b9df7169d4 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49982
I20260709 12:58:49.982138  1716 raft_consensus.cc:1275] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:58:49.983862  1719 raft_consensus.cc:1275] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:49.992313   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:50.005825  2857 tablet_replica.cc:333] T 65524f4fe7be481b9f069829076b7dc3 P 0c7751452c4b46afa95251b9df7169d4: stopping tablet replica
I20260709 12:58:50.010212  1724 raft_consensus.cc:1275] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:50.011348  2857 raft_consensus.cc:2243] T 65524f4fe7be481b9f069829076b7dc3 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:50.012656  2857 raft_consensus.cc:2272] T 65524f4fe7be481b9f069829076b7dc3 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:50.041178  2857 ts_tablet_manager.cc:1916] T 65524f4fe7be481b9f069829076b7dc3 P 0c7751452c4b46afa95251b9df7169d4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:50.046798  1634 tablet_service.cc:1558] Processing DeleteTablet for tablet 091ce8e86e49437b8fffb903bd5ce2fb with delete_type TABLET_DATA_TOMBSTONED (TS 4dbe7d47a2374afca075d3a98583b49e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45134
I20260709 12:58:50.048645  2785 consensus_queue.cc:1048] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:50.050045  2785 consensus_queue.cc:1048] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:50.054143  2817 consensus_queue.cc:1048] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:58:50.065892  1725 raft_consensus.cc:1275] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:50.069758  2817 consensus_queue.cc:1048] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:50.085868  2862 tablet_replica.cc:333] T 091ce8e86e49437b8fffb903bd5ce2fb P 4dbe7d47a2374afca075d3a98583b49e: stopping tablet replica
I20260709 12:58:50.092235  1648 raft_consensus.cc:1275] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:58:50.097775  2812 consensus_queue.cc:1048] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:50.101651  1474 catalog_manager.cc:5697] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: config changed from index 3 to 4, VOTER 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:50.108385  1474 catalog_manager.cc:5697] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: config changed from index 3 to 4, VOTER 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:50.131057  2857 ts_tablet_manager.cc:1929] T 65524f4fe7be481b9f069829076b7dc3 P 0c7751452c4b46afa95251b9df7169d4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:50.132025  2857 log.cc:1199] T 65524f4fe7be481b9f069829076b7dc3 P 0c7751452c4b46afa95251b9df7169d4: Deleting WAL directory at /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601869227091-431-0/minicluster-data/ts-2-root/wals/65524f4fe7be481b9f069829076b7dc3
I20260709 12:58:50.136185  1461 catalog_manager.cc:5028] TS 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): tablet 65524f4fe7be481b9f069829076b7dc3 (table test-workload [id=2e230675e851429db50863dfed56dde5]) successfully deleted
I20260709 12:58:50.241217  2862 raft_consensus.cc:2243] T 091ce8e86e49437b8fffb903bd5ce2fb P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:50.262252  2862 raft_consensus.cc:2272] T 091ce8e86e49437b8fffb903bd5ce2fb P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:50.265847  2862 ts_tablet_manager.cc:1916] T 091ce8e86e49437b8fffb903bd5ce2fb P 4dbe7d47a2374afca075d3a98583b49e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:58:50.312860  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 122630us
I20260709 12:58:50.390197  1473 catalog_manager.cc:5697] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 1 to 2, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:50.395896  1473 catalog_manager.cc:5697] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 2 to 3, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
W20260709 12:58:50.491400  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 86504.3us
I20260709 12:58:50.498270  1473 catalog_manager.cc:5697] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 1 to 2, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:50.518656  1473 catalog_manager.cc:5697] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 1 to 2, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
W20260709 12:58:50.556398  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 162478us
I20260709 12:58:50.563566  1651 raft_consensus.cc:1275] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:50.565063  2862 ts_tablet_manager.cc:1929] T 091ce8e86e49437b8fffb903bd5ce2fb P 4dbe7d47a2374afca075d3a98583b49e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:50.573748  2862 log.cc:1199] T 091ce8e86e49437b8fffb903bd5ce2fb P 4dbe7d47a2374afca075d3a98583b49e: Deleting WAL directory at /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601869227091-431-0/minicluster-data/ts-1-root/wals/091ce8e86e49437b8fffb903bd5ce2fb
W20260709 12:58:50.571921  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 159948us
I20260709 12:58:50.590237  1458 catalog_manager.cc:5028] TS 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): tablet 091ce8e86e49437b8fffb903bd5ce2fb (table test-workload [id=2e230675e851429db50863dfed56dde5]) successfully deleted
I20260709 12:58:50.601053  1561 tablet_service.cc:1558] Processing DeleteTablet for tablet 475f4ce2905344b0803209ce7b2e9386 with delete_type TABLET_DATA_TOMBSTONED (TS 89ac9d5e2fbc4536b03a1ff1dd3eb226 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36626
I20260709 12:58:50.600358  2785 raft_consensus.cc:493] T 475f4ce2905344b0803209ce7b2e9386 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:58:50.604015  2785 raft_consensus.cc:515] T 475f4ce2905344b0803209ce7b2e9386 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:50.606643   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:50.609184  1634 tablet_service.cc:1558] Processing DeleteTablet for tablet a7bcbc7b936b4bdca8a41d00f9ecdd5f with delete_type TABLET_DATA_TOMBSTONED (TS 4dbe7d47a2374afca075d3a98583b49e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45134
I20260709 12:58:50.627568  2862 tablet_replica.cc:333] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 4dbe7d47a2374afca075d3a98583b49e: stopping tablet replica
I20260709 12:58:50.633754  1716 raft_consensus.cc:1275] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:58:50.647919  2785 leader_election.cc:290] T 475f4ce2905344b0803209ce7b2e9386 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:58:50.650058  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:58:50.668296  2812 consensus_queue.cc:1048] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:50.669809  2818 consensus_queue.cc:1048] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:50.671018  2862 raft_consensus.cc:2243] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:50.673056  2862 raft_consensus.cc:2272] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:50.682871  2862 ts_tablet_manager.cc:1916] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 4dbe7d47a2374afca075d3a98583b49e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:50.686372  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:58:50.723016  1542 leader_election.cc:304] T 475f4ce2905344b0803209ce7b2e9386 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:58:50.726261  2837 raft_consensus.cc:2749] T 475f4ce2905344b0803209ce7b2e9386 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:58:50.734699  2886 tablet_replica.cc:333] T 475f4ce2905344b0803209ce7b2e9386 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: stopping tablet replica
I20260709 12:58:50.753099  2886 raft_consensus.cc:2243] T 475f4ce2905344b0803209ce7b2e9386 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:50.754347  2886 raft_consensus.cc:2272] T 475f4ce2905344b0803209ce7b2e9386 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:50.757269  2862 ts_tablet_manager.cc:1929] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 4dbe7d47a2374afca075d3a98583b49e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:50.757755  2862 log.cc:1199] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 4dbe7d47a2374afca075d3a98583b49e: Deleting WAL directory at /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601869227091-431-0/minicluster-data/ts-1-root/wals/a7bcbc7b936b4bdca8a41d00f9ecdd5f
I20260709 12:58:50.758527  2886 ts_tablet_manager.cc:1916] T 475f4ce2905344b0803209ce7b2e9386 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:50.759152  1458 catalog_manager.cc:5028] TS 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): tablet a7bcbc7b936b4bdca8a41d00f9ecdd5f (table test-workload [id=2e230675e851429db50863dfed56dde5]) successfully deleted
I20260709 12:58:50.787534  2886 ts_tablet_manager.cc:1929] T 475f4ce2905344b0803209ce7b2e9386 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:50.792197  2886 log.cc:1199] T 475f4ce2905344b0803209ce7b2e9386 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Deleting WAL directory at /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601869227091-431-0/minicluster-data/ts-0-root/wals/475f4ce2905344b0803209ce7b2e9386
I20260709 12:58:50.794543  1459 catalog_manager.cc:5028] TS 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): tablet 475f4ce2905344b0803209ce7b2e9386 (table test-workload [id=2e230675e851429db50863dfed56dde5]) successfully deleted
I20260709 12:58:50.807066  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:58:50.824687  1571 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e"
dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
mode: GRACEFUL
new_leader_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:60346
I20260709 12:58:50.825531  1571 raft_consensus.cc:606] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 LEADER]: Received request to transfer leadership to TS 0c7751452c4b46afa95251b9df7169d4
I20260709 12:58:50.842267  1724 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd"
dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
mode: GRACEFUL
new_leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:50592
I20260709 12:58:50.842839  1724 raft_consensus.cc:606] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Received request to transfer leadership to TS 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:50.849362  1646 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b"
dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
mode: GRACEFUL
new_leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
 from {username='slave'} at 127.0.0.1:35470
I20260709 12:58:50.849957  1646 raft_consensus.cc:606] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Received request to transfer leadership to TS 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:58:50.853399  1724 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d"
dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
mode: GRACEFUL
new_leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:50592
I20260709 12:58:50.853972  1724 raft_consensus.cc:606] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Received request to transfer leadership to TS 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:50.856498  1724 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f"
dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
mode: GRACEFUL
new_leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
 from {username='slave'} at 127.0.0.1:50592
I20260709 12:58:50.857093  1724 raft_consensus.cc:606] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Received request to transfer leadership to TS 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:58:50.865293  1724 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad"
dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
mode: GRACEFUL
new_leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
 from {username='slave'} at 127.0.0.1:50592
I20260709 12:58:50.868554  1724 raft_consensus.cc:606] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Received request to transfer leadership to TS 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:58:50.880666  1724 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e"
dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
mode: GRACEFUL
new_leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
 from {username='slave'} at 127.0.0.1:50592
I20260709 12:58:50.881265  1724 raft_consensus.cc:606] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Received request to transfer leadership to TS 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:58:50.883432   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 12:58:50.885660   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:58:50.989771  2874 raft_consensus.cc:993] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4: : Instructing follower 05476b84d8f84d76a9a1f51b620a3c66 to start an election
I20260709 12:58:50.990743  2874 raft_consensus.cc:1081] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Signalling peer 05476b84d8f84d76a9a1f51b620a3c66 to start an election
I20260709 12:58:50.992508  2330 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f"
dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
 from {username='slave'} at 127.0.0.1:53306
I20260709 12:58:50.993206  2330 raft_consensus.cc:493] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:50.993570  2330 raft_consensus.cc:3060] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:51.001641  2330 raft_consensus.cc:515] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:51.005576  2330 leader_election.cc:290] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:51.006769  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:51.007395  1568 raft_consensus.cc:3060] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:51.009732  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:58:51.010278  1724 raft_consensus.cc:3055] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:51.010583  1724 raft_consensus.cc:740] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:58:51.011330  1724 consensus_queue.cc:260] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:51.012343  1724 raft_consensus.cc:3060] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:51.032025  1568 raft_consensus.cc:2468] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 2.
I20260709 12:58:51.033708  2295 leader_election.cc:304] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:58:51.034813  2812 raft_consensus.cc:2804] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:51.042850  2730 raft_consensus.cc:993] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4: : Instructing follower 05476b84d8f84d76a9a1f51b620a3c66 to start an election
I20260709 12:58:51.043550  2879 raft_consensus.cc:1081] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Signalling peer 05476b84d8f84d76a9a1f51b620a3c66 to start an election
I20260709 12:58:51.054488  2812 raft_consensus.cc:697] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:58:51.055641  2812 consensus_queue.cc:237] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:51.057657  1724 raft_consensus.cc:2468] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 2.
I20260709 12:58:51.057749  2330 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad"
dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
 from {username='slave'} at 127.0.0.1:53306
I20260709 12:58:51.058612  2330 raft_consensus.cc:493] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:51.059016  2330 raft_consensus.cc:3060] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:51.079937  1473 catalog_manager.cc:5697] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 1 to 2, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:51.082903  2330 raft_consensus.cc:515] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:51.088795  2785 raft_consensus.cc:993] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: : Instructing follower 0c7751452c4b46afa95251b9df7169d4 to start an election
I20260709 12:58:51.089426  2785 raft_consensus.cc:1081] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 LEADER]: Signalling peer 0c7751452c4b46afa95251b9df7169d4 to start an election
I20260709 12:58:51.096163  1724 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e"
dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:49996
I20260709 12:58:51.097481  1724 raft_consensus.cc:493] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:51.097862  1724 raft_consensus.cc:3060] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:51.104343  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:51.105067  1568 raft_consensus.cc:3060] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:51.105681  1724 raft_consensus.cc:515] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:51.108212  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:58:51.109017  1725 raft_consensus.cc:3055] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:51.109143  1724 leader_election.cc:290] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:51.109409  1725 raft_consensus.cc:740] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:58:51.110625  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:51.110435  1725 consensus_queue.cc:260] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:51.111126  1646 raft_consensus.cc:3060] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:51.111716  1725 raft_consensus.cc:3060] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:51.115511  1568 raft_consensus.cc:2468] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 2.
I20260709 12:58:51.117120  2295 leader_election.cc:304] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:58:51.118101  2812 raft_consensus.cc:2804] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:51.118559  2812 raft_consensus.cc:697] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:58:51.119414  2812 consensus_queue.cc:237] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:51.119992  1646 raft_consensus.cc:2468] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 3.
I20260709 12:58:51.121801  1688 leader_election.cc:304] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:58:51.122633  2874 raft_consensus.cc:2804] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:51.122903  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:51.123100  2874 raft_consensus.cc:697] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 3 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:58:51.123443  1568 raft_consensus.cc:3055] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:51.123744  1568 raft_consensus.cc:740] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:58:51.123931  2874 consensus_queue.cc:237] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:51.124644  1568 consensus_queue.cc:260] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:51.127141  1568 raft_consensus.cc:3060] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:51.134213  1725 raft_consensus.cc:2468] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 2.
I20260709 12:58:51.135166  2330 leader_election.cc:290] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:51.140117  1568 raft_consensus.cc:2468] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 3.
I20260709 12:58:51.143394  2885 raft_consensus.cc:993] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e: : Instructing follower 05476b84d8f84d76a9a1f51b620a3c66 to start an election
I20260709 12:58:51.144161  2885 raft_consensus.cc:1081] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Signalling peer 05476b84d8f84d76a9a1f51b620a3c66 to start an election
I20260709 12:58:51.147302  2874 raft_consensus.cc:993] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4: : Instructing follower 89ac9d5e2fbc4536b03a1ff1dd3eb226 to start an election
I20260709 12:58:51.147779  2874 raft_consensus.cc:1081] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Signalling peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 to start an election
I20260709 12:58:51.148427  1473 catalog_manager.cc:5697] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 1 to 2, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:51.150030  1568 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d"
dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:36642
I20260709 12:58:51.150502  1568 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:51.150801  1568 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:51.159194  1568 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:51.161834  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:58:51.162508  1724 raft_consensus.cc:3055] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:51.162868  1724 raft_consensus.cc:740] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:58:51.163578  1724 consensus_queue.cc:260] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:51.164414  1724 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:51.165035  1568 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:51.166175  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:51.166810  1646 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:51.173995  1724 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 2.
I20260709 12:58:51.175439  1542 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:58:51.176429  2837 raft_consensus.cc:2804] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:51.177433  2837 raft_consensus.cc:697] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:58:51.178639  2837 consensus_queue.cc:237] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:51.181017  2325 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b"
dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
 from {username='slave'} at 127.0.0.1:53290
I20260709 12:58:51.181751  2325 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:51.182192  2325 raft_consensus.cc:3060] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:51.184401  1646 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 2.
I20260709 12:58:51.216917  2882 raft_consensus.cc:993] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4: : Instructing follower 05476b84d8f84d76a9a1f51b620a3c66 to start an election
I20260709 12:58:51.217684  2882 raft_consensus.cc:1081] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Signalling peer 05476b84d8f84d76a9a1f51b620a3c66 to start an election
I20260709 12:58:51.217463  2325 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:51.231086  2330 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e"
dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
 from {username='slave'} at 127.0.0.1:53306
I20260709 12:58:51.231760  2330 raft_consensus.cc:493] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:51.236614  2330 raft_consensus.cc:3060] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:51.235555  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:51.238418  1568 raft_consensus.cc:3060] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:51.238794  2825 raft_consensus.cc:993] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4: : Instructing follower 89ac9d5e2fbc4536b03a1ff1dd3eb226 to start an election
I20260709 12:58:51.239609  2730 raft_consensus.cc:1081] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Signalling peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 to start an election
I20260709 12:58:51.247880  2330 raft_consensus.cc:515] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:51.248644  1570 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd"
dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:36642
I20260709 12:58:51.249392  1570 raft_consensus.cc:493] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:51.249866  1570 raft_consensus.cc:3060] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:51.250833  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:58:51.251447  1725 raft_consensus.cc:3055] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:51.250833  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:51.251734  1725 raft_consensus.cc:740] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:58:51.252002  1646 raft_consensus.cc:3060] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:51.252473  1725 consensus_queue.cc:260] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:51.253731  1725 raft_consensus.cc:3060] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:51.259521  1570 raft_consensus.cc:515] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:51.260614  1725 raft_consensus.cc:2468] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 2.
I20260709 12:58:51.212678  1473 catalog_manager.cc:5697] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 2 to 3, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:51.261790  2297 leader_election.cc:304] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 12:58:51.263803  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:51.264739  2325 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:51.265220  1651 raft_consensus.cc:3055] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:51.265583  1651 raft_consensus.cc:740] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:58:51.266322  1651 consensus_queue.cc:260] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:51.267541  1651 raft_consensus.cc:3060] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:51.268895  2812 raft_consensus.cc:2804] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:51.269354  2812 raft_consensus.cc:697] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:58:51.269850  1646 raft_consensus.cc:2468] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 2.
I20260709 12:58:51.270206  2812 consensus_queue.cc:237] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:51.246551  1568 raft_consensus.cc:2468] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 2.
I20260709 12:58:51.284518  1570 leader_election.cc:290] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:51.287544  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:51.289417  2295 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:58:51.294848  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:58:51.295430  1725 raft_consensus.cc:3055] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:51.295734  1725 raft_consensus.cc:740] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:58:51.295892  1646 raft_consensus.cc:3060] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:51.298149  2892 raft_consensus.cc:2804] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:51.304853  2892 raft_consensus.cc:697] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:58:51.305866  2892 consensus_queue.cc:237] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:51.305552  1473 catalog_manager.cc:5697] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 1 to 2, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:51.306053  1470 catalog_manager.cc:5697] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 1 to 2, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:51.290706  1651 raft_consensus.cc:2468] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 2.
I20260709 12:58:51.299149  1725 consensus_queue.cc:260] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:51.310506  1725 raft_consensus.cc:3060] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:51.319218  2330 leader_election.cc:290] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:51.324795  1646 raft_consensus.cc:2468] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 2.
I20260709 12:58:51.321954  1725 raft_consensus.cc:2468] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 2.
I20260709 12:58:51.326072  1539 leader_election.cc:304] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:58:51.326939  2837 raft_consensus.cc:2804] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:51.327549  2837 raft_consensus.cc:697] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:58:51.328423  2837 consensus_queue.cc:237] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:51.334837  1470 catalog_manager.cc:5697] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 1 to 2, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:51.346882  1473 catalog_manager.cc:5697] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 1 to 2, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:51.456301  1568 raft_consensus.cc:1275] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:58:51.457985  2892 consensus_queue.cc:1048] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:51.463975  1724 raft_consensus.cc:1275] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:58:51.465615  2892 consensus_queue.cc:1048] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:51.626605  1646 raft_consensus.cc:1275] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:51.628301  2882 consensus_queue.cc:1048] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:51.658946  1568 raft_consensus.cc:1275] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:58:51.660606  2812 consensus_queue.cc:1048] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:51.680048  1570 raft_consensus.cc:1275] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:51.709300  2882 consensus_queue.cc:1048] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:51.744429  1724 raft_consensus.cc:1275] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:58:51.746285  2892 consensus_queue.cc:1048] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:51.794039  1646 raft_consensus.cc:1275] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:51.798238  1716 raft_consensus.cc:1275] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:58:51.800128  2892 consensus_queue.cc:1048] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:51.806447  2837 consensus_queue.cc:1048] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:51.818199  1646 consensus_queue.cc:237] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:51.824318  1643 raft_consensus.cc:1275] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:58:51.828198  2812 consensus_queue.cc:1048] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:51.835959  1648 raft_consensus.cc:1275] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:58:51.839085  2892 consensus_queue.cc:1048] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:51.849396  1725 raft_consensus.cc:1275] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:51.865473  1571 raft_consensus.cc:1275] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:58:51.874742  1615 consensus_peers.cc:597] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e -> Peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423): Couldn't send request to peer 05476b84d8f84d76a9a1f51b620a3c66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4fa306a802914bb9b8d54b7bfe53009c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:51.884193  1571 raft_consensus.cc:1275] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:58:51.886830   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:51.890064  2892 consensus_queue.cc:1048] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:51.903059  1725 raft_consensus.cc:1275] T 4fa306a802914bb9b8d54b7bfe53009c P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:51.909758  2885 consensus_queue.cc:1048] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:51.913645  2885 consensus_queue.cc:1048] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:58:51.929087  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 51043.7us
I20260709 12:58:51.946421  2905 raft_consensus.cc:2955] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:51.961093  1568 raft_consensus.cc:2955] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:51.974103  2915 consensus_queue.cc:1048] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:52.002617  1719 consensus_queue.cc:237] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:52.011124  1724 raft_consensus.cc:2955] T 4fa306a802914bb9b8d54b7bfe53009c P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:52.030839  1471 catalog_manager.cc:5697] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:58:52.033385  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 61367.4us
I20260709 12:58:52.045521  1648 raft_consensus.cc:1275] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:52.050276  1725 raft_consensus.cc:1275] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:52.053313   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:58:52.062470  1689 consensus_peers.cc:597] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423): Couldn't send request to peer 05476b84d8f84d76a9a1f51b620a3c66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 477960faa15b4001a5a6361558d69294. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:52.063105  1648 raft_consensus.cc:1275] T 477960faa15b4001a5a6361558d69294 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:52.064677  2882 consensus_queue.cc:1048] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:52.078226  2920 consensus_queue.cc:1048] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:52.082752  1571 raft_consensus.cc:1275] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:52.119418  2785 consensus_queue.cc:1048] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:52.121117  2874 consensus_queue.cc:1048] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:52.124719  2730 raft_consensus.cc:2955] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:52.153115  1651 raft_consensus.cc:2955] T 477960faa15b4001a5a6361558d69294 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:52.202955  1646 consensus_queue.cc:237] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:52.207297  1571 raft_consensus.cc:2955] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:52.225543  1719 raft_consensus.cc:1275] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:52.228866  1470 catalog_manager.cc:5697] T 477960faa15b4001a5a6361558d69294 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:52.230607  1568 raft_consensus.cc:1275] T 62c04bf03d764babb1a5e3b102527e5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:52.233986  2885 consensus_queue.cc:1048] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:52.236099  2823 consensus_queue.cc:1048] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:52.240254  1719 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb"
dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
mode: GRACEFUL
new_leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
 from {username='slave'} at 127.0.0.1:50592
I20260709 12:58:52.240811  1719 raft_consensus.cc:606] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Received request to transfer leadership to TS 05476b84d8f84d76a9a1f51b620a3c66
W20260709 12:58:52.242240  1615 consensus_peers.cc:597] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e -> Peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423): Couldn't send request to peer 05476b84d8f84d76a9a1f51b620a3c66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 62c04bf03d764babb1a5e3b102527e5f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:52.245915  1568 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0"
dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
mode: GRACEFUL
new_leader_uuid: "4dbe7d47a2374afca075d3a98583b49e"
 from {username='slave'} at 127.0.0.1:60346
I20260709 12:58:52.248381  1568 raft_consensus.cc:606] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 LEADER]: Received request to transfer leadership to TS 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:58:52.251899  1646 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d"
dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
mode: GRACEFUL
new_leader_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:35470
I20260709 12:58:52.252408  1646 raft_consensus.cc:606] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Received request to transfer leadership to TS 0c7751452c4b46afa95251b9df7169d4
I20260709 12:58:52.254978  1646 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2"
dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
mode: GRACEFUL
new_leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
 from {username='slave'} at 127.0.0.1:35470
I20260709 12:58:52.255463  1646 raft_consensus.cc:606] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Received request to transfer leadership to TS 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:58:52.258904  1646 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0"
dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
mode: GRACEFUL
new_leader_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:35470
I20260709 12:58:52.259394  1646 raft_consensus.cc:606] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Received request to transfer leadership to TS 0c7751452c4b46afa95251b9df7169d4
I20260709 12:58:52.261953  1646 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035"
dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
mode: GRACEFUL
new_leader_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:35470
I20260709 12:58:52.262425  1646 raft_consensus.cc:606] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Received request to transfer leadership to TS 0c7751452c4b46afa95251b9df7169d4
I20260709 12:58:52.263485   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:58:52.265337   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:58:52.269418  2905 raft_consensus.cc:2955] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:52.271812  1724 raft_consensus.cc:2955] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:52.273398  1571 raft_consensus.cc:2955] T 62c04bf03d764babb1a5e3b102527e5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:52.284142  1719 consensus_queue.cc:237] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:52.291199  1473 catalog_manager.cc:5697] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:52.314072  1646 raft_consensus.cc:1275] T 2f8dd5957a2647058190fd52f31ec088 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:52.314881  1571 raft_consensus.cc:1275] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:58:52.316493  1689 consensus_peers.cc:597] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423): Couldn't send request to peer 05476b84d8f84d76a9a1f51b620a3c66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2f8dd5957a2647058190fd52f31ec088. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:52.328426  2929 consensus_queue.cc:1048] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:52.334929  2929 consensus_queue.cc:1048] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:52.348016  2825 raft_consensus.cc:2955] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:52.350282  1651 raft_consensus.cc:2955] T 2f8dd5957a2647058190fd52f31ec088 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:52.387534  2938 ts_tablet_manager.cc:933] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66: Initiating tablet copy from peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:52.396499  1473 catalog_manager.cc:5697] T 2f8dd5957a2647058190fd52f31ec088 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:52.408951  2823 raft_consensus.cc:993] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e: : Instructing follower 0c7751452c4b46afa95251b9df7169d4 to start an election
I20260709 12:58:52.409451  2823 raft_consensus.cc:1081] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Signalling peer 0c7751452c4b46afa95251b9df7169d4 to start an election
I20260709 12:58:52.416019  1719 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035"
dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:50010
I20260709 12:58:52.419243  1719 raft_consensus.cc:493] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:52.419746  1719 raft_consensus.cc:3060] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:52.416282  2938 tablet_copy_client.cc:323] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:37391
I20260709 12:58:52.429214  1661 tablet_copy_service.cc:140] P 4dbe7d47a2374afca075d3a98583b49e: Received BeginTabletCopySession request for tablet 4fa306a802914bb9b8d54b7bfe53009c from peer 05476b84d8f84d76a9a1f51b620a3c66 ({username='slave'} at 127.0.0.1:57912)
I20260709 12:58:52.429955  1661 tablet_copy_service.cc:161] P 4dbe7d47a2374afca075d3a98583b49e: Beginning new tablet copy session on tablet 4fa306a802914bb9b8d54b7bfe53009c from peer 05476b84d8f84d76a9a1f51b620a3c66 at {username='slave'} at 127.0.0.1:57912: session id = 05476b84d8f84d76a9a1f51b620a3c66-4fa306a802914bb9b8d54b7bfe53009c
I20260709 12:58:52.447630  1661 tablet_copy_source_session.cc:215] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:52.457383  1571 raft_consensus.cc:2955] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:52.461757  2938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fa306a802914bb9b8d54b7bfe53009c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:52.471194  2920 raft_consensus.cc:993] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: : Instructing follower 4dbe7d47a2374afca075d3a98583b49e to start an election
I20260709 12:58:52.471732  2920 raft_consensus.cc:1081] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 LEADER]: Signalling peer 4dbe7d47a2374afca075d3a98583b49e to start an election
I20260709 12:58:52.473553  1646 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0"
dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
 from {username='slave'} at 127.0.0.1:45142
I20260709 12:58:52.474092  1646 raft_consensus.cc:493] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:52.474495  1646 raft_consensus.cc:3060] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:52.458367  1719 raft_consensus.cc:515] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:52.486294  1719 leader_election.cc:290] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:52.487521  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:52.488125  1651 raft_consensus.cc:3055] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:52.488392  1651 raft_consensus.cc:740] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:58:52.489128  1651 consensus_queue.cc:260] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:52.489331  1646 raft_consensus.cc:515] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:52.490127  2938 tablet_copy_client.cc:806] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:52.490795  2938 tablet_copy_client.cc:670] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:52.490218  1651 raft_consensus.cc:3060] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:52.492357  1646 leader_election.cc:290] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:52.493435  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:58:52.493964  1719 raft_consensus.cc:3060] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:52.496712  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:52.497249  1568 raft_consensus.cc:3055] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:52.497542  1568 raft_consensus.cc:740] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:58:52.498206  1568 consensus_queue.cc:260] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:52.499140  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:52.499315  1568 raft_consensus.cc:3060] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:52.502110  2938 tablet_copy_client.cc:538] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:52.502241  1571 raft_consensus.cc:3060] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:52.509829  1568 raft_consensus.cc:2468] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 3.
I20260709 12:58:52.511003  1615 leader_election.cc:304] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:58:52.501288  1719 raft_consensus.cc:2468] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 3.
I20260709 12:58:52.511772  2878 raft_consensus.cc:2804] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:52.512218  2878 raft_consensus.cc:697] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 3 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:58:52.513110  2878 consensus_queue.cc:237] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:52.514997  1571 raft_consensus.cc:2468] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 2.
I20260709 12:58:52.517998  2938 tablet_bootstrap.cc:492] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap starting.
I20260709 12:58:52.519840  1689 leader_election.cc:304] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:58:52.525861  2929 raft_consensus.cc:2804] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:52.528237  2929 raft_consensus.cc:697] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 2 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:58:52.529152  2929 consensus_queue.cc:237] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:52.501667  1651 raft_consensus.cc:2468] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 2.
I20260709 12:58:52.545118  2823 raft_consensus.cc:993] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e: : Instructing follower 0c7751452c4b46afa95251b9df7169d4 to start an election
I20260709 12:58:52.545598  2823 raft_consensus.cc:1081] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Signalling peer 0c7751452c4b46afa95251b9df7169d4 to start an election
I20260709 12:58:52.550503  1724 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d"
dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:50010
I20260709 12:58:52.551100  1724 raft_consensus.cc:493] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:52.551478  1724 raft_consensus.cc:3060] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:52.551724  2938 tablet_bootstrap.cc:492] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:52.551859  2874 raft_consensus.cc:993] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4: : Instructing follower 05476b84d8f84d76a9a1f51b620a3c66 to start an election
I20260709 12:58:52.552416  2874 raft_consensus.cc:1081] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Signalling peer 05476b84d8f84d76a9a1f51b620a3c66 to start an election
I20260709 12:58:52.552722  2938 tablet_bootstrap.cc:492] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap complete.
I20260709 12:58:52.553990  2938 ts_tablet_manager.cc:1403] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66: Time spent bootstrapping tablet: real 0.036s	user 0.031s	sys 0.004s
I20260709 12:58:52.559401  2330 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb"
dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
 from {username='slave'} at 127.0.0.1:53306
I20260709 12:58:52.559988  2330 raft_consensus.cc:493] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:52.560333  2330 raft_consensus.cc:3060] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:52.562697  1724 raft_consensus.cc:515] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 12:58:52.565203  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:52.565719  1646 raft_consensus.cc:3055] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:52.566010  1646 raft_consensus.cc:740] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:58:52.566725  1646 consensus_queue.cc:260] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 12:58:52.567735  1646 raft_consensus.cc:3060] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:52.567585  1470 catalog_manager.cc:5697] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 2 to 3, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 3 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:52.570544  2330 raft_consensus.cc:515] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:52.574066  1646 raft_consensus.cc:2468] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 2.
I20260709 12:58:52.574386  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:52.574960  1568 raft_consensus.cc:3060] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:52.575249  1688 leader_election.cc:304] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:58:52.577301  2825 raft_consensus.cc:2804] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:52.577739  2825 raft_consensus.cc:697] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 2 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:58:52.581605  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:58:52.582231  1716 raft_consensus.cc:3055] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:52.582502  1716 raft_consensus.cc:740] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:58:52.583410  1568 raft_consensus.cc:2468] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 2.
I20260709 12:58:52.583196  1716 consensus_queue.cc:260] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:52.584260  1716 raft_consensus.cc:3060] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:52.584448  2295 leader_election.cc:304] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:58:52.585438  2895 raft_consensus.cc:2804] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:52.585976  2895 raft_consensus.cc:697] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:58:52.585177  2825 consensus_queue.cc:237] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 12:58:52.580101  2330 leader_election.cc:290] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:52.586896  1724 leader_election.cc:290] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373)
I20260709 12:58:52.587800  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:52.588320  1571 raft_consensus.cc:3060] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:52.590685  2895 consensus_queue.cc:237] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:52.598906  1571 raft_consensus.cc:2468] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 2.
I20260709 12:58:52.578303  2938 raft_consensus.cc:359] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:52.604928  2938 raft_consensus.cc:740] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Initialized, Role: LEARNER
I20260709 12:58:52.605661  2938 consensus_queue.cc:260] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:52.605392  1716 raft_consensus.cc:2468] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 2.
I20260709 12:58:52.620661  1473 catalog_manager.cc:5697] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 1 to 2, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:52.629020  2944 ts_tablet_manager.cc:933] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66: Initiating tablet copy from peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:52.630419  2938 ts_tablet_manager.cc:1434] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66: Time spent starting tablet: real 0.076s	user 0.006s	sys 0.003s
I20260709 12:58:52.633001  1661 tablet_copy_service.cc:342] P 4dbe7d47a2374afca075d3a98583b49e: Request end of tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-4fa306a802914bb9b8d54b7bfe53009c received from {username='slave'} at 127.0.0.1:57912
I20260709 12:58:52.633462  1661 tablet_copy_service.cc:434] P 4dbe7d47a2374afca075d3a98583b49e: ending tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-4fa306a802914bb9b8d54b7bfe53009c on tablet 4fa306a802914bb9b8d54b7bfe53009c with peer 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:58:52.651525  2905 raft_consensus.cc:993] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e: : Instructing follower 05476b84d8f84d76a9a1f51b620a3c66 to start an election
I20260709 12:58:52.652016  2905 raft_consensus.cc:1081] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Signalling peer 05476b84d8f84d76a9a1f51b620a3c66 to start an election
I20260709 12:58:52.653858  2332 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2"
dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
 from {username='slave'} at 127.0.0.1:53290
I20260709 12:58:52.654387  2332 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:52.654728  2332 raft_consensus.cc:3060] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:52.626892  1470 catalog_manager.cc:5697] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 1 to 2, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:52.664047  2332 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:52.666916  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:52.667236  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:52.667493  1568 raft_consensus.cc:3060] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:52.667855  1646 raft_consensus.cc:3055] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:52.668224  1646 raft_consensus.cc:740] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:58:52.669133  1646 consensus_queue.cc:260] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:52.670138  1646 raft_consensus.cc:3060] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:52.680982  2878 raft_consensus.cc:993] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e: : Instructing follower 0c7751452c4b46afa95251b9df7169d4 to start an election
I20260709 12:58:52.681486  2878 raft_consensus.cc:1081] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Signalling peer 0c7751452c4b46afa95251b9df7169d4 to start an election
I20260709 12:58:52.683652  1568 raft_consensus.cc:2468] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 2.
I20260709 12:58:52.686929  2295 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:58:52.688166  2895 raft_consensus.cc:2804] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:52.683890  2332 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:52.689343  1716 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0"
dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:50010
I20260709 12:58:52.690124  1716 raft_consensus.cc:493] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:52.690490  1716 raft_consensus.cc:3060] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:52.688660  2895 raft_consensus.cc:697] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:58:52.694278  2895 consensus_queue.cc:237] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:52.698640  1716 raft_consensus.cc:515] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:52.701514  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:52.702061  1651 raft_consensus.cc:3055] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:52.702346  1651 raft_consensus.cc:740] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:58:52.703060  1651 consensus_queue.cc:260] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:52.704129  1651 raft_consensus.cc:3060] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:52.719705  1651 raft_consensus.cc:2468] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 2.
I20260709 12:58:52.720831  1688 leader_election.cc:304] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:58:52.722851  1716 leader_election.cc:290] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:52.722892  2929 raft_consensus.cc:2804] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:52.723459  2929 raft_consensus.cc:697] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 2 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:58:52.724318  2929 consensus_queue.cc:237] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:52.733055  2332 raft_consensus.cc:1217] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:52.736294  1473 catalog_manager.cc:5697] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 1 to 2, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:52.743175  2938 ts_tablet_manager.cc:933] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66: Initiating tablet copy from peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:52.751113  2938 tablet_copy_client.cc:323] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:37391
I20260709 12:58:52.752832  1661 tablet_copy_service.cc:140] P 4dbe7d47a2374afca075d3a98583b49e: Received BeginTabletCopySession request for tablet 62c04bf03d764babb1a5e3b102527e5f from peer 05476b84d8f84d76a9a1f51b620a3c66 ({username='slave'} at 127.0.0.1:57912)
I20260709 12:58:52.753399  1661 tablet_copy_service.cc:161] P 4dbe7d47a2374afca075d3a98583b49e: Beginning new tablet copy session on tablet 62c04bf03d764babb1a5e3b102527e5f from peer 05476b84d8f84d76a9a1f51b620a3c66 at {username='slave'} at 127.0.0.1:57912: session id = 05476b84d8f84d76a9a1f51b620a3c66-62c04bf03d764babb1a5e3b102527e5f
I20260709 12:58:52.753278  1474 catalog_manager.cc:5697] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 1 to 2, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:52.756006  1646 raft_consensus.cc:2468] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 2.
I20260709 12:58:52.765363  1661 tablet_copy_source_session.cc:215] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:52.768606  2944 tablet_copy_client.cc:323] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:45473
I20260709 12:58:52.771588  2938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62c04bf03d764babb1a5e3b102527e5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:52.780684  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:52.781306  1568 raft_consensus.cc:3060] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:52.787701  1568 raft_consensus.cc:2468] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 2.
I20260709 12:58:52.791028  1734 tablet_copy_service.cc:140] P 0c7751452c4b46afa95251b9df7169d4: Received BeginTabletCopySession request for tablet 477960faa15b4001a5a6361558d69294 from peer 05476b84d8f84d76a9a1f51b620a3c66 ({username='slave'} at 127.0.0.1:58782)
I20260709 12:58:52.791661  1734 tablet_copy_service.cc:161] P 0c7751452c4b46afa95251b9df7169d4: Beginning new tablet copy session on tablet 477960faa15b4001a5a6361558d69294 from peer 05476b84d8f84d76a9a1f51b620a3c66 at {username='slave'} at 127.0.0.1:58782: session id = 05476b84d8f84d76a9a1f51b620a3c66-477960faa15b4001a5a6361558d69294
I20260709 12:58:52.816825  1734 tablet_copy_source_session.cc:215] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:52.820587  2944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 477960faa15b4001a5a6361558d69294. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:52.829052  2951 ts_tablet_manager.cc:933] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66: Initiating tablet copy from peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:52.839263  1474 catalog_manager.cc:5697] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 1 to 2, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:52.845157  2938 tablet_copy_client.cc:806] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:52.846613  2938 tablet_copy_client.cc:670] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:52.852612  2938 tablet_copy_client.cc:538] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:52.860380  2938 tablet_bootstrap.cc:492] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap starting.
I20260709 12:58:52.853693  2951 tablet_copy_client.cc:323] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:45473
I20260709 12:58:52.866144  2944 tablet_copy_client.cc:806] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:52.870482  1734 tablet_copy_service.cc:140] P 0c7751452c4b46afa95251b9df7169d4: Received BeginTabletCopySession request for tablet 2f8dd5957a2647058190fd52f31ec088 from peer 05476b84d8f84d76a9a1f51b620a3c66 ({username='slave'} at 127.0.0.1:58782)
I20260709 12:58:52.870900  2944 tablet_copy_client.cc:670] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:52.871068  1734 tablet_copy_service.cc:161] P 0c7751452c4b46afa95251b9df7169d4: Beginning new tablet copy session on tablet 2f8dd5957a2647058190fd52f31ec088 from peer 05476b84d8f84d76a9a1f51b620a3c66 at {username='slave'} at 127.0.0.1:58782: session id = 05476b84d8f84d76a9a1f51b620a3c66-2f8dd5957a2647058190fd52f31ec088
I20260709 12:58:52.884791  1734 tablet_copy_source_session.cc:215] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:52.886252  2944 tablet_copy_client.cc:538] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:52.888424  2951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f8dd5957a2647058190fd52f31ec088. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:52.895644  2944 tablet_bootstrap.cc:492] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap starting.
I20260709 12:58:52.950703  1568 raft_consensus.cc:1275] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:52.960716  1716 raft_consensus.cc:1275] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:52.971956  2944 tablet_bootstrap.cc:492] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:52.973033  2944 tablet_bootstrap.cc:492] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap complete.
I20260709 12:58:52.973738  2944 ts_tablet_manager.cc:1403] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent bootstrapping tablet: real 0.078s	user 0.022s	sys 0.008s
I20260709 12:58:52.977036  2944 raft_consensus.cc:359] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:52.977900  2944 raft_consensus.cc:740] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Initialized, Role: LEARNER
I20260709 12:58:52.978577  2944 consensus_queue.cc:260] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:53.007061  2944 ts_tablet_manager.cc:1434] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.002s
I20260709 12:58:53.010542  2878 consensus_queue.cc:1048] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:53.014163  1734 tablet_copy_service.cc:342] P 0c7751452c4b46afa95251b9df7169d4: Request end of tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-477960faa15b4001a5a6361558d69294 received from {username='slave'} at 127.0.0.1:58782
I20260709 12:58:53.014662  1734 tablet_copy_service.cc:434] P 0c7751452c4b46afa95251b9df7169d4: ending tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-477960faa15b4001a5a6361558d69294 on tablet 477960faa15b4001a5a6361558d69294 with peer 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:58:53.027632  2330 raft_consensus.cc:1217] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:53.058385  1568 raft_consensus.cc:1275] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:53.059917  2878 consensus_queue.cc:1048] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:53.066514  2730 consensus_queue.cc:1048] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:53.083643  1716 raft_consensus.cc:1275] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:58:53.086707  2812 consensus_queue.cc:1048] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:53.111590  1570 raft_consensus.cc:1275] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:58:53.113407  2812 consensus_queue.cc:1048] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:53.134364  1651 raft_consensus.cc:1275] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:58:53.140547  2812 consensus_queue.cc:1048] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:53.157253  1570 raft_consensus.cc:1275] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:53.159787  1651 raft_consensus.cc:1275] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:53.153388  2951 tablet_copy_client.cc:806] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:53.188832  2730 consensus_queue.cc:1048] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:53.193396  2730 consensus_queue.cc:1048] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:53.216610  2951 tablet_copy_client.cc:670] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 1 WAL segments...
W20260709 12:58:53.243345  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 51728.1us
W20260709 12:58:53.266805  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 106107us
W20260709 12:58:53.292140  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 47090.6us
I20260709 12:58:53.315371  2938 tablet_bootstrap.cc:492] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:58:53.329371  2963 log.cc:927] Time spent T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:58:53.337013  1574 raft_consensus.cc:1275] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:58:53.338696  2964 consensus_queue.cc:1048] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:53.412038   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:53.404428  2938 tablet_bootstrap.cc:492] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap complete.
W20260709 12:58:53.385766  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 73582us
I20260709 12:58:53.463793  2938 ts_tablet_manager.cc:1403] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66: Time spent bootstrapping tablet: real 0.604s	user 0.045s	sys 0.035s
W20260709 12:58:53.466687  2972 log.cc:927] Time spent T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 12:58:53.481861  1646 raft_consensus.cc:1275] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:53.481642  1645 raft_consensus.cc:1275] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:58:53.491102  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 87251.6us
W20260709 12:58:53.494184  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 95941.2us
I20260709 12:58:53.518267  2951 tablet_copy_client.cc:538] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:58:53.528779  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 156049us
I20260709 12:58:53.533237  2973 consensus_queue.cc:1048] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:53.537879  2966 consensus_queue.cc:1048] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:53.546972  2938 raft_consensus.cc:359] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:53.548022  2938 raft_consensus.cc:740] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Initialized, Role: LEARNER
I20260709 12:58:53.552572  2938 consensus_queue.cc:260] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:53.560134  1568 raft_consensus.cc:1275] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:53.560755   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:53.582825  2951 tablet_bootstrap.cc:492] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap starting.
W20260709 12:58:53.702785  2983 log.cc:927] Time spent T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
W20260709 12:58:53.717937  2956 log.cc:927] Time spent T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
W20260709 12:58:53.731062  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 128405us
I20260709 12:58:53.797529  2938 ts_tablet_manager.cc:1434] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66: Time spent starting tablet: real 0.324s	user 0.007s	sys 0.002s
I20260709 12:58:53.842383  1661 tablet_copy_service.cc:342] P 4dbe7d47a2374afca075d3a98583b49e: Request end of tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-62c04bf03d764babb1a5e3b102527e5f received from {username='slave'} at 127.0.0.1:57912
I20260709 12:58:53.842823  1661 tablet_copy_service.cc:434] P 4dbe7d47a2374afca075d3a98583b49e: ending tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-62c04bf03d764babb1a5e3b102527e5f on tablet 62c04bf03d764babb1a5e3b102527e5f with peer 05476b84d8f84d76a9a1f51b620a3c66
W20260709 12:58:53.856745  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 107855us
W20260709 12:58:53.865445  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 135977us
I20260709 12:58:53.886336  2984 raft_consensus.cc:1064] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e: attempting to promote NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 to VOTER
W20260709 12:58:53.907642  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 230524us
I20260709 12:58:53.919127  2929 consensus_queue.cc:1048] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
W20260709 12:58:53.945050  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 77910.7us
I20260709 12:58:53.982597  3006 raft_consensus.cc:1064] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4: attempting to promote NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 to VOTER
I20260709 12:58:53.997336  1648 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67"
dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
mode: GRACEFUL
new_leader_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:35470
I20260709 12:58:54.002898  1648 raft_consensus.cc:606] T 3ba8e707693e4af2b8347a4bad4dfd67 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Received request to transfer leadership to TS 0c7751452c4b46afa95251b9df7169d4
I20260709 12:58:54.002413  2984 consensus_queue.cc:237] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:54.001427  3006 consensus_queue.cc:237] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:54.013820  2324 raft_consensus.cc:1217] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:54.017320  1571 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d"
dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
mode: GRACEFUL
new_leader_uuid: "4dbe7d47a2374afca075d3a98583b49e"
 from {username='slave'} at 127.0.0.1:60346
I20260709 12:58:54.019011  1571 raft_consensus.cc:606] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 LEADER]: Received request to transfer leadership to TS 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:58:54.034641  1719 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "650a39124682440d83bb93bb83f15979"
dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
mode: GRACEFUL
new_leader_uuid: "4dbe7d47a2374afca075d3a98583b49e"
 from {username='slave'} at 127.0.0.1:50592
I20260709 12:58:54.035185  1719 raft_consensus.cc:606] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Received request to transfer leadership to TS 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:58:54.048110  1642 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3"
dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
mode: GRACEFUL
new_leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
 from {username='slave'} at 127.0.0.1:35470
I20260709 12:58:54.048789  1642 raft_consensus.cc:606] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Received request to transfer leadership to TS 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:58:54.053833  1716 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757"
dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
mode: GRACEFUL
new_leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
 from {username='slave'} at 127.0.0.1:50592
I20260709 12:58:54.054407  1716 raft_consensus.cc:606] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Received request to transfer leadership to TS 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:58:54.055512   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:58:54.083209  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:54.097352   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:58:54.116406  2951 tablet_bootstrap.cc:492] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:54.143906  2951 tablet_bootstrap.cc:492] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap complete.
I20260709 12:58:54.144644  2951 ts_tablet_manager.cc:1403] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent bootstrapping tablet: real 0.562s	user 0.034s	sys 0.007s
I20260709 12:58:54.154212  2878 raft_consensus.cc:1027] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: attempt to promote peer 05476b84d8f84d76a9a1f51b620a3c66: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 12:58:54.165750  3011 raft_consensus.cc:993] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226: : Instructing follower 4dbe7d47a2374afca075d3a98583b49e to start an election
I20260709 12:58:54.200651  1724 raft_consensus.cc:1275] T 4fa306a802914bb9b8d54b7bfe53009c P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:54.205487  2988 raft_consensus.cc:993] T 3ba8e707693e4af2b8347a4bad4dfd67 P 4dbe7d47a2374afca075d3a98583b49e: : Instructing follower 0c7751452c4b46afa95251b9df7169d4 to start an election
I20260709 12:58:54.206050  2988 raft_consensus.cc:1081] T 3ba8e707693e4af2b8347a4bad4dfd67 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Signalling peer 0c7751452c4b46afa95251b9df7169d4 to start an election
I20260709 12:58:54.206578  3015 raft_consensus.cc:993] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4: : Instructing follower 4dbe7d47a2374afca075d3a98583b49e to start an election
I20260709 12:58:54.216882  1724 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67"
dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:50010
I20260709 12:58:54.208039  3015 raft_consensus.cc:1081] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Signalling peer 4dbe7d47a2374afca075d3a98583b49e to start an election
I20260709 12:58:54.206969  3011 raft_consensus.cc:1081] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 LEADER]: Signalling peer 4dbe7d47a2374afca075d3a98583b49e to start an election
I20260709 12:58:54.237027  2951 raft_consensus.cc:359] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:54.241181  2951 raft_consensus.cc:740] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Initialized, Role: LEARNER
I20260709 12:58:54.245978  1724 raft_consensus.cc:493] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:54.246483  1724 raft_consensus.cc:3060] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:54.247833  1645 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "650a39124682440d83bb93bb83f15979"
dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
 from {username='slave'} at 127.0.0.1:45148
I20260709 12:58:54.250988  1645 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:54.251392  1645 raft_consensus.cc:3060] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:54.254732  1647 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d"
dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
 from {username='slave'} at 127.0.0.1:45142
I20260709 12:58:54.255401  1647 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:54.255805  1647 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:54.258203  2328 raft_consensus.cc:1275] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:54.260835  2998 consensus_queue.cc:1048] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:54.273306  1645 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:54.281414  2984 raft_consensus.cc:993] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e: : Instructing follower 05476b84d8f84d76a9a1f51b620a3c66 to start an election
I20260709 12:58:54.282001  2984 raft_consensus.cc:1081] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Signalling peer 05476b84d8f84d76a9a1f51b620a3c66 to start an election
I20260709 12:58:54.289460  2977 consensus_queue.cc:1048] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:54.293541  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:54.294222  1570 raft_consensus.cc:3060] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:54.294345  1645 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:54.300920  2324 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3"
dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
 from {username='slave'} at 127.0.0.1:53290
I20260709 12:58:54.301854  2324 raft_consensus.cc:493] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:54.302379  2324 raft_consensus.cc:3060] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:54.310279  1568 raft_consensus.cc:1275] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:54.310703  3007 raft_consensus.cc:993] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4: : Instructing follower 05476b84d8f84d76a9a1f51b620a3c66 to start an election
I20260709 12:58:54.311646  2991 raft_consensus.cc:1081] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Signalling peer 05476b84d8f84d76a9a1f51b620a3c66 to start an election
I20260709 12:58:54.314667  1570 raft_consensus.cc:2468] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 2.
I20260709 12:58:54.318245  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:58:54.318858  1721 raft_consensus.cc:3055] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:54.322372  1721 raft_consensus.cc:740] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:58:54.329243  1615 leader_election.cc:304] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:58:54.241897  2951 consensus_queue.cc:260] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:54.337203  2326 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757"
dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
 from {username='slave'} at 127.0.0.1:53306
I20260709 12:58:54.345541  2326 raft_consensus.cc:493] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:54.345463  2996 consensus_queue.cc:1048] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:58:54.346036  2326 raft_consensus.cc:3060] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:54.349041  2951 ts_tablet_manager.cc:1434] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent starting tablet: real 0.204s	user 0.010s	sys 0.000s
I20260709 12:58:54.354084  1734 tablet_copy_service.cc:342] P 0c7751452c4b46afa95251b9df7169d4: Request end of tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-2f8dd5957a2647058190fd52f31ec088 received from {username='slave'} at 127.0.0.1:58782
I20260709 12:58:54.354506  1734 tablet_copy_service.cc:434] P 0c7751452c4b46afa95251b9df7169d4: ending tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-2f8dd5957a2647058190fd52f31ec088 on tablet 2f8dd5957a2647058190fd52f31ec088 with peer 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:58:54.355867  2324 raft_consensus.cc:515] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:54.362237  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:54.362903  1570 raft_consensus.cc:3060] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:54.336772  1724 raft_consensus.cc:515] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:54.341173  2988 raft_consensus.cc:2804] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:54.366431  2988 raft_consensus.cc:697] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 2 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:58:54.367326  2988 consensus_queue.cc:237] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:54.342464  1646 raft_consensus.cc:1275] T 477960faa15b4001a5a6361558d69294 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:54.302594  1647 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:54.343102  1721 consensus_queue.cc:260] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:54.371369  1721 raft_consensus.cc:3060] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:54.372671  1647 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:54.377805  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:58:54.378561  1718 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:54.378919  1724 leader_election.cc:290] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:54.386094  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:54.386744  1646 raft_consensus.cc:3055] T 3ba8e707693e4af2b8347a4bad4dfd67 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:54.387013  1646 raft_consensus.cc:740] T 3ba8e707693e4af2b8347a4bad4dfd67 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:58:54.391361  1646 consensus_queue.cc:260] T 3ba8e707693e4af2b8347a4bad4dfd67 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:54.397568  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:54.398226  1571 raft_consensus.cc:3055] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:54.398523  1571 raft_consensus.cc:740] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:58:54.399296  1571 consensus_queue.cc:260] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:54.400386  1571 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:54.403854  1570 raft_consensus.cc:2468] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 2.
I20260709 12:58:54.395200  1721 raft_consensus.cc:2468] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 2.
I20260709 12:58:54.405916  2295 leader_election.cc:304] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:58:54.407568  1574 raft_consensus.cc:1240] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:54.408486  1646 raft_consensus.cc:3060] T 3ba8e707693e4af2b8347a4bad4dfd67 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:54.423610  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:54.424291  1645 raft_consensus.cc:3055] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:54.426783  1645 raft_consensus.cc:740] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:58:54.434974  1645 consensus_queue.cc:260] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:54.436056  1645 raft_consensus.cc:3060] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:54.437557  1570 raft_consensus.cc:1275] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:54.441017  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:54.441629  1575 raft_consensus.cc:3060] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:54.449347  2332 raft_consensus.cc:1275] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:54.408080  2324 leader_election.cc:290] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:54.418213  2979 raft_consensus.cc:2804] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:54.465865  1575 raft_consensus.cc:2468] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 2.
I20260709 12:58:54.408174  3007 consensus_queue.cc:1048] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 12:58:54.476212  1571 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 3.
W20260709 12:58:54.504731  1617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:54.515379  1645 raft_consensus.cc:2468] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 2.
W20260709 12:58:54.528635  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 55348.5us
I20260709 12:58:54.480836  2979 raft_consensus.cc:697] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:58:54.464763  2326 raft_consensus.cc:515] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:54.519546  1646 raft_consensus.cc:2468] T 3ba8e707693e4af2b8347a4bad4dfd67 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 2.
I20260709 12:58:54.560344  1615 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:58:54.560163  1689 leader_election.cc:304] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:58:54.550900  2991 consensus_queue.cc:1048] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:58:54.581897  2874 consensus_queue.cc:1048] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:54.585209  2979 consensus_queue.cc:237] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:54.586645  2326 leader_election.cc:290] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:54.588768  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:54.569303  2984 raft_consensus.cc:2804] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:54.604812  1567 raft_consensus.cc:3060] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:54.608642  2984 raft_consensus.cc:697] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 3 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:58:54.609730  2984 consensus_queue.cc:237] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:54.615944  1718 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 3.
I20260709 12:58:54.579141  3015 raft_consensus.cc:2804] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:54.617529  3015 raft_consensus.cc:697] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 2 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:58:54.618566  3015 consensus_queue.cc:237] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:54.620874  1471 catalog_manager.cc:5697] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 1 to 2, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 2 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:54.632561  1567 raft_consensus.cc:2468] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 2.
W20260709 12:58:54.640265  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 150229us
W20260709 12:58:54.652441  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 80126.3us
I20260709 12:58:54.649029  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:58:54.688444  1718 raft_consensus.cc:3055] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:54.688827  1718 raft_consensus.cc:740] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
W20260709 12:58:54.693225  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 49143.7us
I20260709 12:58:54.724256  2996 raft_consensus.cc:1064] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e: attempting to promote NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 to VOTER
I20260709 12:58:54.728757  1570 raft_consensus.cc:1240] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:54.689606  1718 consensus_queue.cc:260] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:54.782771  2295 leader_election.cc:304] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:58:54.778576  1718 raft_consensus.cc:3060] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:54.776763  2326 raft_consensus.cc:1217] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:54.800879  2996 consensus_queue.cc:237] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:54.811326  1567 raft_consensus.cc:2955] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
W20260709 12:58:54.822438  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 49081.5us
I20260709 12:58:54.825546  2982 raft_consensus.cc:2804] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:54.826058  2982 raft_consensus.cc:697] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:58:54.826952  2982 consensus_queue.cc:237] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:54.843506  2332 raft_consensus.cc:2955] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:54.819442  2985 raft_consensus.cc:2955] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
W20260709 12:58:54.912086  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 50872.1us
I20260709 12:58:54.938038  1470 catalog_manager.cc:5697] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:54.945780  1718 raft_consensus.cc:2468] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 2.
I20260709 12:58:54.974972  1567 raft_consensus.cc:1275] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:58:54.985522  3039 log.cc:927] Time spent T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.052s	user 0.003s	sys 0.000s
W20260709 12:58:54.964061  3040 log.cc:927] Time spent T 00000000000000000000000000000000 P fcfaa17e55ae48e194c5d95ca24a659f: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
W20260709 12:58:55.004837  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 58007.4us
I20260709 12:58:55.024948  1575 raft_consensus.cc:1275] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:55.035482  2878 consensus_queue.cc:1048] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:55.038400  1716 raft_consensus.cc:2955] T 4fa306a802914bb9b8d54b7bfe53009c P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:55.050631  1722 raft_consensus.cc:1275] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:55.051903  1720 raft_consensus.cc:1275] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:55.059971  2825 raft_consensus.cc:2955] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:55.071777  2970 consensus_queue.cc:1048] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:55.076150  2977 consensus_queue.cc:1048] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:55.077646  2977 consensus_queue.cc:1048] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:55.089798  1473 catalog_manager.cc:5697] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 1 to 2, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:55.099092   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:55.103681  1647 raft_consensus.cc:1275] T 3ba8e707693e4af2b8347a4bad4dfd67 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:55.105014  1646 raft_consensus.cc:2955] T 477960faa15b4001a5a6361558d69294 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:55.105389  1474 catalog_manager.cc:5697] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 1 to 2, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:55.107203  1474 catalog_manager.cc:5697] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 1 to 2, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:55.109125  3028 consensus_queue.cc:1048] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:55.115293  2324 raft_consensus.cc:1275] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:55.134781  1571 raft_consensus.cc:1275] T 62c04bf03d764babb1a5e3b102527e5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:55.146224  2324 raft_consensus.cc:2955] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:55.151306  1567 raft_consensus.cc:2955] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:55.155284  1646 raft_consensus.cc:1275] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:58:55.155356  1571 raft_consensus.cc:1275] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:58:55.158435  3035 consensus_queue.cc:1048] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:58:55.164633  2812 consensus_queue.cc:1048] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:55.164978  2996 consensus_queue.cc:1048] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:55.166340  1725 raft_consensus.cc:1275] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:55.187515  2970 consensus_queue.cc:1048] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:55.225468  1473 catalog_manager.cc:5697] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 2 to 3, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 3 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } }
I20260709 12:58:55.226029  1474 catalog_manager.cc:5697] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:55.237206  1571 raft_consensus.cc:1275] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:55.238739  2825 raft_consensus.cc:1064] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4: attempting to promote NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 to VOTER
I20260709 12:58:55.245398  2825 consensus_queue.cc:237] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:55.254979  2878 consensus_queue.cc:1048] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:58:55.312983  2730 consensus_queue.cc:1048] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:55.354704   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:58:55.375015  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 117912us
W20260709 12:58:55.458719  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 55009.2us
W20260709 12:58:55.452230  3055 log.cc:927] Time spent T 62c04bf03d764babb1a5e3b102527e5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 12:58:55.465121  2332 raft_consensus.cc:1275] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:55.581123  1648 raft_consensus.cc:1275] T 2f8dd5957a2647058190fd52f31ec088 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:55.665911  2730 consensus_queue.cc:1048] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:58:55.669322  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 49034.8us
W20260709 12:58:55.663858  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 199330us
I20260709 12:58:55.702942  1718 raft_consensus.cc:1275] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:58:55.706867  3027 consensus_queue.cc:1048] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:58:55.742787  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 240683us
I20260709 12:58:55.744814  1575 raft_consensus.cc:1275] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:58:55.744196  1718 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088"
dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
mode: GRACEFUL
new_leader_uuid: "4dbe7d47a2374afca075d3a98583b49e"
 from {username='slave'} at 127.0.0.1:50592
I20260709 12:58:55.780620  1718 raft_consensus.cc:606] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Received request to transfer leadership to TS 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:58:55.806090  1720 consensus_queue.cc:237] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:55.806443  1648 consensus_queue.cc:237] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:55.820673  1575 raft_consensus.cc:1275] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:58:55.831465  2332 raft_consensus.cc:1275] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:55.838199  2996 consensus_queue.cc:1048] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 12:58:55.857383  3072 consensus_queue.cc:1048] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:58:55.834255  3061 consensus_queue.cc:1048] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 12:58:55.872514  2968 raft_consensus.cc:2955] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:55.882737  1571 raft_consensus.cc:1275] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:55.891005  2996 consensus_queue.cc:1048] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:58:55.897388  3028 consensus_queue.cc:1048] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:55.907948  2332 raft_consensus.cc:1275] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:55.914194  2328 raft_consensus.cc:2955] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:55.917922  3061 raft_consensus.cc:993] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4: : Instructing follower 4dbe7d47a2374afca075d3a98583b49e to start an election
I20260709 12:58:55.918448  3061 raft_consensus.cc:1081] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Signalling peer 4dbe7d47a2374afca075d3a98583b49e to start an election
I20260709 12:58:55.918462  1576 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7"
dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
mode: GRACEFUL
new_leader_uuid: "4dbe7d47a2374afca075d3a98583b49e"
 from {username='slave'} at 127.0.0.1:60346
I20260709 12:58:55.919692  1576 raft_consensus.cc:606] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 LEADER]: Received request to transfer leadership to TS 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:58:55.927583  2929 consensus_queue.cc:1048] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 12:58:55.943408  3057 raft_consensus.cc:2955] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:55.927583  1647 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088"
dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
 from {username='slave'} at 127.0.0.1:45148
I20260709 12:58:55.952548  1647 raft_consensus.cc:493] T 2f8dd5957a2647058190fd52f31ec088 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:55.952950  1647 raft_consensus.cc:3060] T 2f8dd5957a2647058190fd52f31ec088 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:55.953028  1642 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c"
dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
mode: GRACEFUL
new_leader_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:35470
I20260709 12:58:55.953622  1642 raft_consensus.cc:606] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Received request to transfer leadership to TS 0c7751452c4b46afa95251b9df7169d4
I20260709 12:58:55.955698   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:58:55.957634   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:58:55.958714  2325 raft_consensus.cc:2955] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:55.961686  3038 raft_consensus.cc:993] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: : Instructing follower 4dbe7d47a2374afca075d3a98583b49e to start an election
I20260709 12:58:55.962639  2969 raft_consensus.cc:1081] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 LEADER]: Signalling peer 4dbe7d47a2374afca075d3a98583b49e to start an election
I20260709 12:58:55.965656  1571 raft_consensus.cc:1275] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:55.980886  1458 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4fa306a802914bb9b8d54b7bfe53009c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:55.987450  1642 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7"
dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
 from {username='slave'} at 127.0.0.1:45142
I20260709 12:58:55.988061  1642 raft_consensus.cc:493] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:55.988420  1642 raft_consensus.cc:3060] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:56.037581  1567 raft_consensus.cc:2955] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:56.040066  3070 consensus_queue.cc:1048] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:56.040438  1575 raft_consensus.cc:2955] T 62c04bf03d764babb1a5e3b102527e5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:56.049554  2929 raft_consensus.cc:2955] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:56.055756  2326 raft_consensus.cc:2955] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:56.063992  1642 raft_consensus.cc:515] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:56.067713  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:56.068331  1571 raft_consensus.cc:3055] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:56.068706  1571 raft_consensus.cc:740] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:58:56.069480  1571 consensus_queue.cc:260] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:56.070580  1571 raft_consensus.cc:3060] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:56.071734  1470 catalog_manager.cc:5697] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: config changed from index 3 to 4, VOTER 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:56.077281  3057 raft_consensus.cc:993] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e: : Instructing follower 0c7751452c4b46afa95251b9df7169d4 to start an election
I20260709 12:58:56.077100  1718 raft_consensus.cc:2955] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:56.080416  3058 raft_consensus.cc:1081] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Signalling peer 0c7751452c4b46afa95251b9df7169d4 to start an election
I20260709 12:58:56.088588  1571 raft_consensus.cc:2468] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 2.
I20260709 12:58:56.090044  1615 leader_election.cc:304] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:58:56.081588  1642 leader_election.cc:290] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:56.105886  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:58:56.106621  3058 raft_consensus.cc:2804] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:56.128969  1717 raft_consensus.cc:3060] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:56.132687  3058 raft_consensus.cc:697] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 2 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:58:56.135106  1719 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c"
dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:50010
I20260709 12:58:56.135919  1719 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:56.136374  1719 raft_consensus.cc:3060] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:56.133993  3058 consensus_queue.cc:237] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:56.141629  1647 raft_consensus.cc:515] T 2f8dd5957a2647058190fd52f31ec088 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:56.098237  3028 raft_consensus.cc:2955] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
W20260709 12:58:56.358358  1542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:58:56.659369  1575 consensus_meta.cc:287] T 62c04bf03d764babb1a5e3b102527e5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.617s	user 0.091s	sys 0.072s
I20260709 12:58:56.733158  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:56.737792  1576 raft_consensus.cc:3060] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:58:56.739626  1717 consensus_meta.cc:287] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.606s	user 0.010s	sys 0.000s
I20260709 12:58:56.751721  1719 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:56.746182  1642 raft_consensus.cc:1240] T 2f8dd5957a2647058190fd52f31ec088 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:56.759752  1719 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:56.748375  1647 leader_election.cc:290] T 2f8dd5957a2647058190fd52f31ec088 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:58:56.449878  2324 raft_consensus.cc:2955] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:56.752156  1717 raft_consensus.cc:2468] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 2.
W20260709 12:58:56.770656  1718 consensus_meta.cc:287] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.689s	user 0.005s	sys 0.006s
W20260709 12:58:56.781354  2929 consensus_meta.cc:287] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.730s	user 0.006s	sys 0.006s
I20260709 12:58:56.804111  2929 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:49982 (request call id 76) took 1096 ms. Trace:
I20260709 12:58:56.808807  1576 raft_consensus.cc:2468] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 2.
W20260709 12:58:56.867061  3087 log.cc:927] Time spent T 62c04bf03d764babb1a5e3b102527e5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:58:56.804611  2929 rpcz_store.cc:276] 0709 12:58:55.707256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:55.707458 (+   202us) service_pool.cc:224] Handling call
0709 12:58:55.765773 (+ 58315us) spinlock_profiling.cc:243] Waited 43.8 ms on lock 0x7b180021f600. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23f673d 00007fa9f23c1f3f 00007fa9f23c16b3 00007fa9f23b99fa 00007fa9f73814c9 00007fa9f08fdc54 00007fa9f08fdbe2 00007fa9f08fdb11 00007fa9f08fda8c 00007fa9f08fcd42
0709 12:58:55.805383 (+ 39610us) spinlock_profiling.cc:243] Waited 8.6 ms on lock 0x7b58003101d0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23170aa 00007fa9f2399447 00007fa9f23b670a 00007fa9f23b776a 00007fa9f23b691b 00007fa9f23c203c 00007fa9f23c16b3 00007fa9f23b99fa 00007fa9f73814c9 00007fa9f08fdc54
0709 12:58:55.818822 (+ 13439us) log.cc:844] Serialized 501 byte log entry
0709 12:58:55.841255 (+ 22433us) spinlock_profiling.cc:243] Waited 6.39 ms on lock 0x7b54000dc620. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f2334142 00007fa9f2314eaa 00007fa9f231bd53 00007fa9f231bcd9 00007fa9f231bc69 00007fa9f231bc31 00007fa9f231adfd 000000000038f354 000000000038f199 00007fa9ef2ce475
0709 12:58:55.872258 (+ 31003us) spinlock_profiling.cc:243] Waited 2.21 ms on lock 0x7b18001a1a60. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef29c2a6 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f0687a20 00007fa9f0698a29 00007fa9f069913f 00007fa9f065d2ab
0709 12:58:55.872897 (+   639us) spinlock_profiling.cc:243] Waited 3.62 ms on lock 0x7b4c00215c00. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f0687a20 00007fa9f0698a29 00007fa9f069913f 00007fa9f065d2ab 00007fa9f068af3c 00007fa9f068b3fe 00007fa9f091850b 00007fa9f2317381 00007fa9f231526b 00007fa9f231bd53 00007fa9f231bcd9
0709 12:58:56.804022 (+931125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13760,"raft.queue_time_us":625,"raft.run_cpu_time_us":4659,"raft.run_wall_time_us":77503,"spinlock_wait_cycles":148557312}
I20260709 12:58:56.931701  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:56.932345  1642 raft_consensus.cc:3055] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:56.932705  1642 raft_consensus.cc:740] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:58:56.933544  1642 consensus_queue.cc:260] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:56.934607  1642 raft_consensus.cc:3060] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:56.941370  1642 raft_consensus.cc:2468] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 2.
I20260709 12:58:56.954540  1461 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 477960faa15b4001a5a6361558d69294 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:56.960974  3103 consensus_queue.cc:1059] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:56.962003  3028 raft_consensus.cc:3055] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:56.962370  3028 raft_consensus.cc:740] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:58:56.963361  1688 leader_election.cc:304] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:58:56.963265  3028 consensus_queue.cc:260] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:56.965224  3028 raft_consensus.cc:3060] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:56.963279  1720 raft_consensus.cc:1240] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:56.974821  3103 raft_consensus.cc:2804] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:56.975063  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:58:56.975358  3103 raft_consensus.cc:697] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 2 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:58:56.976270  3103 consensus_queue.cc:237] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:58:57.004690  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:58:57.004755  1721 raft_consensus.cc:2468] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 2.
W20260709 12:58:57.017719  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 76137us
I20260709 12:58:57.027288  1615 leader_election.cc:304] T 2f8dd5957a2647058190fd52f31ec088 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:58:57.028141  3107 raft_consensus.cc:2804] T 2f8dd5957a2647058190fd52f31ec088 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:57.028765  3107 raft_consensus.cc:697] T 2f8dd5957a2647058190fd52f31ec088 P 4dbe7d47a2374afca075d3a98583b49e [term 2 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:58:57.030084  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:57.029922  3107 consensus_queue.cc:237] T 2f8dd5957a2647058190fd52f31ec088 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:57.032624  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:58:57.033245  2328 raft_consensus.cc:3060] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:57.043977  2328 raft_consensus.cc:2468] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 2.
I20260709 12:58:57.030671  1571 raft_consensus.cc:3060] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:57.062319  1571 raft_consensus.cc:2468] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 2.
I20260709 12:58:57.102838   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:57.108292  1470 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55620 (request call id 233) took 1121 ms. Trace:
I20260709 12:58:57.108824  1571 raft_consensus.cc:1240] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 1. Current term is 2. Ops: []
I20260709 12:58:57.109254  1706 tablet_service.cc:1558] Processing DeleteTablet for tablet 4fa306a802914bb9b8d54b7bfe53009c with delete_type TABLET_DATA_TOMBSTONED (TS 0c7751452c4b46afa95251b9df7169d4 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49982
I20260709 12:58:57.113349  1474 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48478 (request call id 142) took 1048 ms. Trace:
I20260709 12:58:57.113749  1474 rpcz_store.cc:276] 0709 12:58:56.065015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:56.065141 (+   126us) service_pool.cc:224] Handling call
0709 12:58:57.113289 (+1048148us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1}
I20260709 12:58:57.127036  1473 catalog_manager.cc:5697] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:57.128968  1473 catalog_manager.cc:5697] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:57.130625  1473 catalog_manager.cc:5697] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: config changed from index 3 to 4, VOTER 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:58:57.134590  1570 raft_consensus.cc:2955] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:57.108702  1470 rpcz_store.cc:276] 0709 12:58:55.987168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:58:56.010911 (+ 23743us) service_pool.cc:224] Handling call
0709 12:58:57.108199 (+1097288us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:58:56.748640 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:58:56.796788 (+ 48148us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:58:56.798247 (+  1459us) write_op.cc:435] Acquired schema lock
0709 12:58:56.799891 (+  1644us) tablet.cc:662] Decoding operations
0709 12:58:56.807293 (+  7402us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:58:56.807377 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 12:58:56.807412 (+    35us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:58:56.807591 (+   179us) tablet.cc:701] Row locks acquired
0709 12:58:56.807606 (+    15us) write_op.cc:260] PREPARE: finished
0709 12:58:56.807741 (+   135us) write_op.cc:270] Start()
0709 12:58:56.807857 (+   116us) write_op.cc:276] Timestamp: P: 1783601936807699 usec, L: 0
0709 12:58:56.807883 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:58:56.856413 (+ 48530us) log.cc:844] Serialized 536 byte log entry
0709 12:58:56.897331 (+ 40918us) spinlock_profiling.cc:243] Waited 4.85 ms on lock 0x7b4400022b4c. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef1f4c85 00007fa9ef1f56a2 00007fa9f1f671db 00007fa9f1f62aaf 00007fa9ef2b10ac 00007fa9f810bab9 00007fa9ef2cd69b 00007fa9ef2cb93f 00007fa9ef2cdc02 00007fa9f1f5520b
0709 12:58:57.068942 (+171611us) op_driver.cc:464] REPLICATION: finished
0709 12:58:57.098559 (+ 29617us) write_op.cc:301] APPLY: starting
0709 12:58:57.098637 (+    78us) tablet.cc:1367] starting BulkCheckPresence
0709 12:58:57.098732 (+    95us) tablet.cc:1370] finished BulkCheckPresence
0709 12:58:57.098763 (+    31us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:58:57.098969 (+   206us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:58:57.099115 (+   146us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:58:57.099160 (+    45us) write_op.cc:312] APPLY: finished
0709 12:58:57.104775 (+  5615us) log.cc:844] Serialized 23 byte log entry
0709 12:58:57.105496 (+   721us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:58:57.105583 (+    87us) write_op.cc:454] Released schema lock
0709 12:58:57.105623 (+    40us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":6883,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":29392,"num_ops":1,"prepare.queue_time_us":648500,"prepare.run_cpu_time_us":14095,"prepare.run_wall_time_us":331048,"raft.queue_time_us":787,"raft.run_cpu_time_us":24576,"raft.run_wall_time_us":28770,"replication_time_us":260926,"spinlock_wait_cycles":11152256,"thread_start_us":309038,"threads_started":4,"wal-append.queue_time_us":210260}]]}
I20260709 12:58:57.162153  3115 tablet_replica.cc:333] T 4fa306a802914bb9b8d54b7bfe53009c P 0c7751452c4b46afa95251b9df7169d4: stopping tablet replica
I20260709 12:58:57.163450  3115 raft_consensus.cc:2243] T 4fa306a802914bb9b8d54b7bfe53009c P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:57.166208  3115 raft_consensus.cc:2272] T 4fa306a802914bb9b8d54b7bfe53009c P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:57.180112  1634 tablet_service.cc:1558] Processing DeleteTablet for tablet 477960faa15b4001a5a6361558d69294 with delete_type TABLET_DATA_TOMBSTONED (TS 4dbe7d47a2374afca075d3a98583b49e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45134
I20260709 12:58:57.189317  3115 ts_tablet_manager.cc:1916] T 4fa306a802914bb9b8d54b7bfe53009c P 0c7751452c4b46afa95251b9df7169d4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:57.195216  1470 catalog_manager.cc:5697] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 1 to 2, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 2 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:57.211725  1470 catalog_manager.cc:5697] T 2f8dd5957a2647058190fd52f31ec088 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: config changed from index 3 to 2, term changed from 1 to 2, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from VOTER to NON_VOTER, now has a pending config: VOTER 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193), VOTER 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194), VOTER 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195), VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:57.218465  3115 ts_tablet_manager.cc:1929] T 4fa306a802914bb9b8d54b7bfe53009c P 0c7751452c4b46afa95251b9df7169d4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:57.225387  3115 log.cc:1199] T 4fa306a802914bb9b8d54b7bfe53009c P 0c7751452c4b46afa95251b9df7169d4: Deleting WAL directory at /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601869227091-431-0/minicluster-data/ts-2-root/wals/4fa306a802914bb9b8d54b7bfe53009c
I20260709 12:58:57.227444  1461 catalog_manager.cc:5028] TS 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): tablet 4fa306a802914bb9b8d54b7bfe53009c (table test-workload [id=2e230675e851429db50863dfed56dde5]) successfully deleted
I20260709 12:58:57.226148  1472 catalog_manager.cc:5697] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193), VOTER 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194), VOTER 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195), VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:57.228147  3116 tablet_replica.cc:333] T 477960faa15b4001a5a6361558d69294 P 4dbe7d47a2374afca075d3a98583b49e: stopping tablet replica
I20260709 12:58:57.229218  3116 raft_consensus.cc:2243] T 477960faa15b4001a5a6361558d69294 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:57.229058  1472 catalog_manager.cc:5697] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 1 to 2, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:57.229980  3116 raft_consensus.cc:2272] T 477960faa15b4001a5a6361558d69294 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:57.235678  3116 ts_tablet_manager.cc:1916] T 477960faa15b4001a5a6361558d69294 P 4dbe7d47a2374afca075d3a98583b49e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:57.238423  1642 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088"
dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:45134
I20260709 12:58:57.239069  1642 raft_consensus.cc:606] T 2f8dd5957a2647058190fd52f31ec088 P 4dbe7d47a2374afca075d3a98583b49e [term 2 LEADER]: Received request to transfer leadership
I20260709 12:58:57.243894  1642 consensus_queue.cc:237] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:57.249737  1647 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088"
dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:45134
I20260709 12:58:57.250412  1647 raft_consensus.cc:606] T 2f8dd5957a2647058190fd52f31ec088 P 4dbe7d47a2374afca075d3a98583b49e [term 2 LEADER]: Received request to transfer leadership
W20260709 12:58:57.252454  1458 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 2f8dd5957a2647058190fd52f31ec088 already in progress [suppressed 3 similar messages]
I20260709 12:58:57.274124  1647 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088"
dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:45134
I20260709 12:58:57.274773  1647 raft_consensus.cc:606] T 2f8dd5957a2647058190fd52f31ec088 P 4dbe7d47a2374afca075d3a98583b49e [term 2 LEADER]: Received request to transfer leadership
I20260709 12:58:57.277684  2328 raft_consensus.cc:1275] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:57.279579  3107 consensus_queue.cc:1048] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:58:57.281991  1521 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:58:57.282430  1521 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 2f8dd5957a2647058190fd52f31ec088 already in progress
I20260709 12:58:57.282539  3116 ts_tablet_manager.cc:1929] T 477960faa15b4001a5a6361558d69294 P 4dbe7d47a2374afca075d3a98583b49e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
W20260709 12:58:57.282758  1521 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 2f8dd5957a2647058190fd52f31ec088 already in progress
I20260709 12:58:57.283636  3116 log.cc:1199] T 477960faa15b4001a5a6361558d69294 P 4dbe7d47a2374afca075d3a98583b49e: Deleting WAL directory at /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601869227091-431-0/minicluster-data/ts-1-root/wals/477960faa15b4001a5a6361558d69294
I20260709 12:58:57.287554   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:57.293605  1458 catalog_manager.cc:5028] TS 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): tablet 477960faa15b4001a5a6361558d69294 (table test-workload [id=2e230675e851429db50863dfed56dde5]) successfully deleted
I20260709 12:58:57.303905  1570 raft_consensus.cc:1275] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:57.307472  3059 consensus_queue.cc:1048] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:57.308852  3111 raft_consensus.cc:2955] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:57.315539  1718 raft_consensus.cc:1275] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:58:57.314786  2324 raft_consensus.cc:2955] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:57.324998  3107 consensus_queue.cc:1048] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:57.335912  1718 raft_consensus.cc:2955] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:57.378378  1470 catalog_manager.cc:5697] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: config changed from index 3 to 4, VOTER 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:57.382021  1458 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 62c04bf03d764babb1a5e3b102527e5f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:57.392313  1570 raft_consensus.cc:1275] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:57.403548  3095 consensus_queue.cc:1048] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:58:57.409992  1717 raft_consensus.cc:1275] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:57.403782  1561 tablet_service.cc:1558] Processing DeleteTablet for tablet 62c04bf03d764babb1a5e3b102527e5f with delete_type TABLET_DATA_TOMBSTONED (TS 89ac9d5e2fbc4536b03a1ff1dd3eb226 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36626
I20260709 12:58:57.421962  3099 consensus_queue.cc:1048] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:58:57.426761  1719 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc"
dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
mode: GRACEFUL
new_leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:50592
I20260709 12:58:57.427371  1719 raft_consensus.cc:606] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Received request to transfer leadership to TS 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:57.438336  1642 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2"
dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
mode: GRACEFUL
new_leader_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:35470
I20260709 12:58:57.440760  1642 raft_consensus.cc:606] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Received request to transfer leadership to TS 0c7751452c4b46afa95251b9df7169d4
I20260709 12:58:57.443395  1642 raft_consensus.cc:1275] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:57.444618  3121 tablet_replica.cc:333] T 62c04bf03d764babb1a5e3b102527e5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226: stopping tablet replica
I20260709 12:58:57.445178  3094 consensus_queue.cc:1048] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:57.446372  1642 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7"
dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
mode: GRACEFUL
new_leader_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:35470
I20260709 12:58:57.455811  3121 raft_consensus.cc:2243] T 62c04bf03d764babb1a5e3b102527e5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:57.478125  3121 raft_consensus.cc:2272] T 62c04bf03d764babb1a5e3b102527e5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:57.481873  3070 raft_consensus.cc:993] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4: : Instructing follower 89ac9d5e2fbc4536b03a1ff1dd3eb226 to start an election
I20260709 12:58:57.482465  3095 raft_consensus.cc:1081] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Signalling peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 to start an election
I20260709 12:58:57.486625  1642 raft_consensus.cc:606] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 2 LEADER]: Received request to transfer leadership to TS 0c7751452c4b46afa95251b9df7169d4
I20260709 12:58:57.490593  1571 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc"
dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:36642
I20260709 12:58:57.492146  1571 raft_consensus.cc:493] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:57.492635  1571 raft_consensus.cc:3060] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:57.495160  1718 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c"
dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
mode: GRACEFUL
new_leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:50592
I20260709 12:58:57.499432  1717 raft_consensus.cc:1275] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:58:57.503250  3099 consensus_queue.cc:1048] T 2f8dd5957a2647058190fd52f31ec088 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:57.503590  1571 raft_consensus.cc:515] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:57.508731  1571 leader_election.cc:290] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:57.511798  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:57.545208  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:58:57.512734  1642 raft_consensus.cc:3060] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:57.551808  1718 raft_consensus.cc:606] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 2 LEADER]: Received request to transfer leadership to TS 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:58:57.555294   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:58:57.553119  1723 raft_consensus.cc:3055] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:57.556710  1723 raft_consensus.cc:740] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:58:57.558795   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:58:57.488948  3121 ts_tablet_manager.cc:1916] T 62c04bf03d764babb1a5e3b102527e5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:57.573429  3111 raft_consensus.cc:993] T 2f8dd5957a2647058190fd52f31ec088 P 4dbe7d47a2374afca075d3a98583b49e: : Instructing follower 0c7751452c4b46afa95251b9df7169d4 to start an election
I20260709 12:58:57.573985  3111 raft_consensus.cc:1081] T 2f8dd5957a2647058190fd52f31ec088 P 4dbe7d47a2374afca075d3a98583b49e [term 2 LEADER]: Signalling peer 0c7751452c4b46afa95251b9df7169d4 to start an election
I20260709 12:58:57.576112  3058 raft_consensus.cc:993] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e: : Instructing follower 0c7751452c4b46afa95251b9df7169d4 to start an election
I20260709 12:58:57.576210  1717 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088"
dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:50010
I20260709 12:58:57.576689  3058 raft_consensus.cc:1081] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 2 LEADER]: Signalling peer 0c7751452c4b46afa95251b9df7169d4 to start an election
I20260709 12:58:57.576924  1717 raft_consensus.cc:493] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:57.577386  1717 raft_consensus.cc:3060] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:57.578395  1718 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7"
dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:50010
I20260709 12:58:57.578986  1718 raft_consensus.cc:493] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:57.579398  1718 raft_consensus.cc:3060] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:57.586691  1718 raft_consensus.cc:515] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:57.595739  1718 leader_election.cc:290] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:57.557765  1723 consensus_queue.cc:260] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:57.596799  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:57.609359  1647 raft_consensus.cc:3055] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:57.609787  1647 raft_consensus.cc:740] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:58:57.610651  1647 consensus_queue.cc:260] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:57.611155  2328 raft_consensus.cc:1275] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:58:57.612104  1647 raft_consensus.cc:3060] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:57.598203  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:57.598889  1717 raft_consensus.cc:515] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:57.612852  1571 raft_consensus.cc:3060] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:57.619428  1647 raft_consensus.cc:2468] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 3.
I20260709 12:58:57.619817  1571 raft_consensus.cc:2468] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 3.
I20260709 12:58:57.621057  1723 raft_consensus.cc:3060] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:57.621181  1688 leader_election.cc:304] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:58:57.621563  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:57.622315  1647 raft_consensus.cc:3055] T 2f8dd5957a2647058190fd52f31ec088 P 4dbe7d47a2374afca075d3a98583b49e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:57.622759  1647 raft_consensus.cc:740] T 2f8dd5957a2647058190fd52f31ec088 P 4dbe7d47a2374afca075d3a98583b49e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:58:57.622792  3028 raft_consensus.cc:2804] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:57.624370  3028 raft_consensus.cc:697] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 3 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:58:57.624019  1647 consensus_queue.cc:260] T 2f8dd5957a2647058190fd52f31ec088 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:57.625646  1647 raft_consensus.cc:3060] T 2f8dd5957a2647058190fd52f31ec088 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:57.625523  3028 consensus_queue.cc:237] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:57.628299  1717 leader_election.cc:290] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:58:57.629298  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:57.629908  1571 raft_consensus.cc:3060] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:57.632010  3121 ts_tablet_manager.cc:1929] T 62c04bf03d764babb1a5e3b102527e5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:58:57.632587  3121 log.cc:1199] T 62c04bf03d764babb1a5e3b102527e5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Deleting WAL directory at /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601869227091-431-0/minicluster-data/ts-0-root/wals/62c04bf03d764babb1a5e3b102527e5f
I20260709 12:58:57.634683  1459 catalog_manager.cc:5028] TS 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): tablet 62c04bf03d764babb1a5e3b102527e5f (table test-workload [id=2e230675e851429db50863dfed56dde5]) successfully deleted
I20260709 12:58:57.635329  1647 raft_consensus.cc:2468] T 2f8dd5957a2647058190fd52f31ec088 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 3.
I20260709 12:58:57.638589  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:58:57.639271  2328 raft_consensus.cc:3060] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:57.640698  1642 raft_consensus.cc:2468] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 2.
I20260709 12:58:57.641939  1539 leader_election.cc:304] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:58:57.642856  3097 raft_consensus.cc:2804] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:57.643397  3097 raft_consensus.cc:697] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:58:57.644326  3097 consensus_queue.cc:237] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:57.656333  2328 raft_consensus.cc:2468] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 3.
I20260709 12:58:57.670248  1723 raft_consensus.cc:2468] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 2.
I20260709 12:58:57.680106  1571 raft_consensus.cc:2468] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 3.
I20260709 12:58:57.681720  1470 catalog_manager.cc:5697] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 1 to 2, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:57.683732  1471 catalog_manager.cc:5697] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 2 to 3, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:57.691726  1689 leader_election.cc:304] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:58:57.695245  3070 raft_consensus.cc:2804] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:57.695737  3070 raft_consensus.cc:697] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 3 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:58:57.696640  3070 consensus_queue.cc:237] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:57.717850  1471 catalog_manager.cc:5697] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 2 to 3, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:57.914206  3107 raft_consensus.cc:993] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e: : Instructing follower 0c7751452c4b46afa95251b9df7169d4 to start an election
I20260709 12:58:57.914800  3058 raft_consensus.cc:1081] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Signalling peer 0c7751452c4b46afa95251b9df7169d4 to start an election
I20260709 12:58:57.916445  1717 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2"
dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:50010
I20260709 12:58:57.916991  1717 raft_consensus.cc:493] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:57.917354  1717 raft_consensus.cc:3060] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:57.923666  1717 raft_consensus.cc:515] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:57.927868  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:57.928288  1717 leader_election.cc:290] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:57.929664  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:57.930226  1647 raft_consensus.cc:3055] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:57.930519  1647 raft_consensus.cc:740] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:58:57.931350  1647 consensus_queue.cc:260] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:57.928424  1571 raft_consensus.cc:3060] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:57.932381  1647 raft_consensus.cc:3060] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:57.943639  1647 raft_consensus.cc:2468] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 2.
I20260709 12:58:57.945875  1571 raft_consensus.cc:2468] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 2.
I20260709 12:58:57.952584  1689 leader_election.cc:304] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:58:57.953532  3028 raft_consensus.cc:2804] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:57.954110  3028 raft_consensus.cc:697] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 2 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:58:57.955139  3028 consensus_queue.cc:237] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:57.984923  1471 catalog_manager.cc:5697] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 1 to 2, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:58.000149  3070 raft_consensus.cc:993] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4: : Instructing follower 89ac9d5e2fbc4536b03a1ff1dd3eb226 to start an election
I20260709 12:58:58.000699  3028 raft_consensus.cc:1081] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 2 LEADER]: Signalling peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 to start an election
I20260709 12:58:58.002089  1571 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c"
dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:36642
I20260709 12:58:58.002688  1571 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:58.003062  1571 raft_consensus.cc:3060] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:58.010056  1571 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:58.012367  1571 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:58.012940  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:58.013495  1647 raft_consensus.cc:3060] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:58.018255  1647 raft_consensus.cc:2468] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 3.
I20260709 12:58:58.018417  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:58:58.018994  1723 raft_consensus.cc:3055] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:58.019307  1723 raft_consensus.cc:740] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:58:58.019447  1539 leader_election.cc:304] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:58:58.020025  1723 consensus_queue.cc:260] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:58.020228  3097 raft_consensus.cc:2804] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:58.020896  3097 raft_consensus.cc:697] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:58:58.021123  1723 raft_consensus.cc:3060] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:58.021972  3097 consensus_queue.cc:237] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:58.030881  1723 raft_consensus.cc:2468] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 3.
I20260709 12:58:58.035944  1471 catalog_manager.cc:5697] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 2 to 3, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:58.033346  1647 raft_consensus.cc:1275] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:58.039479  3028 consensus_queue.cc:1048] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:58.071015  1567 raft_consensus.cc:1275] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:58.075502  3028 consensus_queue.cc:1048] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:58.142076  2328 raft_consensus.cc:1275] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:58:58.143846  3028 consensus_queue.cc:1048] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:58:58.167127  1644 raft_consensus.cc:1275] T 2f8dd5957a2647058190fd52f31ec088 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:58:58.168294  3028 consensus_queue.cc:1048] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:58.171324  1644 raft_consensus.cc:2955] T 2f8dd5957a2647058190fd52f31ec088 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:58.189240  1570 raft_consensus.cc:1275] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:58:58.192132  3094 consensus_queue.cc:1048] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:58.196180  1570 raft_consensus.cc:2955] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:58.232043  1723 raft_consensus.cc:1275] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:58.233444  3097 consensus_queue.cc:1048] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:58.250427  1644 raft_consensus.cc:1275] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:58.252000  3106 consensus_queue.cc:1048] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:58.392139  1644 raft_consensus.cc:1275] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:58.394699  2929 consensus_queue.cc:1048] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:58.409706  1571 raft_consensus.cc:1275] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:58.420452  3094 consensus_queue.cc:1048] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:58.456641  1644 raft_consensus.cc:1275] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:58.468004  3097 consensus_queue.cc:1048] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:58.481470  1723 raft_consensus.cc:1275] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:58:58.482811  3097 consensus_queue.cc:1048] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:58:58.559931   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:58.575803  1570 consensus_queue.cc:237] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:58.582963  1721 raft_consensus.cc:1275] T 93e6c991440c40c8a8c8050982e85eeb P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:58:58.586124  1540 consensus_peers.cc:597] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 -> Peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423): Couldn't send request to peer 05476b84d8f84d76a9a1f51b620a3c66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 93e6c991440c40c8a8c8050982e85eeb. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:58.586285  1644 raft_consensus.cc:1275] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:58.587955  3139 consensus_queue.cc:1048] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:58.593152  3106 consensus_queue.cc:1048] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:58.596570  1717 consensus_queue.cc:237] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:58:58.604308  1567 raft_consensus.cc:1275] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:58:58.604308  2328 raft_consensus.cc:1275] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:58:58.606287  3070 consensus_queue.cc:1048] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:58.608353  3094 consensus_queue.cc:1048] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:58:58.617172  3070 raft_consensus.cc:2955] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 3 to 6, VOTER 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:58.622103  2325 raft_consensus.cc:2955] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 3 to 6, VOTER 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:58.627727  1570 raft_consensus.cc:2955] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 3 to 6, VOTER 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:58.641121  3139 raft_consensus.cc:2955] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:58.644758  1461 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2f8dd5957a2647058190fd52f31ec088 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:58:58.650488  1473 catalog_manager.cc:5697] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: config changed from index 3 to 6, VOTER 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) evicted. New cstate: current_term: 3 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:58:58.657754  1721 raft_consensus.cc:2955] T 93e6c991440c40c8a8c8050982e85eeb P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:58.674085   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:58:58.678434  1644 raft_consensus.cc:2955] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:58.679103  1721 consensus_queue.cc:237] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:58.720969  1651 raft_consensus.cc:1275] T f8c04e2c99384254b275d20e6d27467b P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:58.722559  3028 consensus_queue.cc:1048] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:58:58.723997  1689 consensus_peers.cc:597] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 -> Peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423): Couldn't send request to peer 05476b84d8f84d76a9a1f51b620a3c66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f8c04e2c99384254b275d20e6d27467b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:58.722718  1570 raft_consensus.cc:1275] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:58.730051  3028 consensus_queue.cc:1048] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:58.732772  1471 catalog_manager.cc:5697] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:58.737111  1634 tablet_service.cc:1558] Processing DeleteTablet for tablet 2f8dd5957a2647058190fd52f31ec088 with delete_type TABLET_DATA_TOMBSTONED (TS 4dbe7d47a2374afca075d3a98583b49e not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:45134
I20260709 12:58:58.747332  3070 raft_consensus.cc:2955] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:58.749294  1646 raft_consensus.cc:2955] T f8c04e2c99384254b275d20e6d27467b P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:58.754482  3151 tablet_replica.cc:333] T 2f8dd5957a2647058190fd52f31ec088 P 4dbe7d47a2374afca075d3a98583b49e: stopping tablet replica
I20260709 12:58:58.755671  3151 raft_consensus.cc:2243] T 2f8dd5957a2647058190fd52f31ec088 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:58:58.756657  3151 raft_consensus.cc:2272] T 2f8dd5957a2647058190fd52f31ec088 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:58:58.760476  3151 ts_tablet_manager.cc:1916] T 2f8dd5957a2647058190fd52f31ec088 P 4dbe7d47a2374afca075d3a98583b49e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:58:58.772562  1471 catalog_manager.cc:5697] T f8c04e2c99384254b275d20e6d27467b P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:58.783902  1567 raft_consensus.cc:2955] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:58.790822  3151 ts_tablet_manager.cc:1929] T 2f8dd5957a2647058190fd52f31ec088 P 4dbe7d47a2374afca075d3a98583b49e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 12:58:58.791404  3151 log.cc:1199] T 2f8dd5957a2647058190fd52f31ec088 P 4dbe7d47a2374afca075d3a98583b49e: Deleting WAL directory at /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601869227091-431-0/minicluster-data/ts-1-root/wals/2f8dd5957a2647058190fd52f31ec088
I20260709 12:58:58.793097  1458 catalog_manager.cc:5028] TS 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): tablet 2f8dd5957a2647058190fd52f31ec088 (table test-workload [id=2e230675e851429db50863dfed56dde5]) successfully deleted
I20260709 12:58:58.777630  1644 consensus_queue.cc:237] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
W20260709 12:58:58.881394  1615 consensus_peers.cc:597] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423): Couldn't send request to peer 05476b84d8f84d76a9a1f51b620a3c66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6eb51aa4d3bf4882a502ada4948b2cc2. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:58.882268  1570 raft_consensus.cc:1275] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:58.882609  1717 raft_consensus.cc:1275] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:58:58.883896  3099 consensus_queue.cc:1048] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:58.884959  3111 consensus_queue.cc:1048] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:58.937347  3111 raft_consensus.cc:2955] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:58.947026  1721 raft_consensus.cc:2955] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:58.946177  1570 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413"
dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
mode: GRACEFUL
new_leader_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:60346
I20260709 12:58:58.949169  1570 raft_consensus.cc:606] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 LEADER]: Received request to transfer leadership to TS 0c7751452c4b46afa95251b9df7169d4
I20260709 12:58:58.956518  1717 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2"
dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
mode: GRACEFUL
new_leader_uuid: "4dbe7d47a2374afca075d3a98583b49e"
 from {username='slave'} at 127.0.0.1:50592
I20260709 12:58:58.957518  1717 raft_consensus.cc:606] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 2 LEADER]: Received request to transfer leadership to TS 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:58:58.951647  1570 raft_consensus.cc:2955] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:58.964766  1471 catalog_manager.cc:5697] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:58.966144  1717 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8"
dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
mode: GRACEFUL
new_leader_uuid: "4dbe7d47a2374afca075d3a98583b49e"
 from {username='slave'} at 127.0.0.1:50592
I20260709 12:58:58.966886  1717 raft_consensus.cc:606] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Received request to transfer leadership to TS 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:58:58.972875   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:58:58.971707  1721 consensus_queue.cc:237] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:58.999565   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:58:59.007658  1644 raft_consensus.cc:1275] T 3ba8e707693e4af2b8347a4bad4dfd67 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:58:59.010722  1570 raft_consensus.cc:1275] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:58:59.010687  3070 consensus_queue.cc:1048] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:58:59.012362  2929 raft_consensus.cc:993] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4: : Instructing follower 4dbe7d47a2374afca075d3a98583b49e to start an election
I20260709 12:58:59.012866  3070 raft_consensus.cc:1081] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Signalling peer 4dbe7d47a2374afca075d3a98583b49e to start an election
I20260709 12:58:59.012702  3028 consensus_queue.cc:1048] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:58:59.018203  1689 consensus_peers.cc:597] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423): Couldn't send request to peer 05476b84d8f84d76a9a1f51b620a3c66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3ba8e707693e4af2b8347a4bad4dfd67. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:58:59.020875  1644 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8"
dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
 from {username='slave'} at 127.0.0.1:45148
I20260709 12:58:59.021505  1644 raft_consensus.cc:493] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:59.021934  1644 raft_consensus.cc:3060] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:59.035672  1644 raft_consensus.cc:515] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:59.038796  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:59.039593  1567 raft_consensus.cc:3060] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:59.052093  1644 leader_election.cc:290] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:59.052438  3094 raft_consensus.cc:2955] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:59.055922  1567 raft_consensus.cc:2468] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 2.
I20260709 12:58:59.056919  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:58:59.057674  1721 raft_consensus.cc:3055] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:59.058059  1721 raft_consensus.cc:740] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:58:59.059206  1721 consensus_queue.cc:260] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:59.060835  1721 raft_consensus.cc:3060] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:59.065292  1570 raft_consensus.cc:2955] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:59.066062  1615 leader_election.cc:304] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:58:59.067250  3156 raft_consensus.cc:2804] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:59.067811  3156 raft_consensus.cc:697] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 2 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:58:59.068691  3156 consensus_queue.cc:237] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:59.071928  1721 raft_consensus.cc:2468] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 2.
I20260709 12:58:59.084292  1646 raft_consensus.cc:2955] T 3ba8e707693e4af2b8347a4bad4dfd67 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:58:59.107642  1470 catalog_manager.cc:5697] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: config changed from index -1 to 3, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New cstate: current_term: 2 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:59.094769  3158 ts_tablet_manager.cc:933] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66: Initiating tablet copy from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373)
I20260709 12:58:59.130535  3158 tablet_copy_client.cc:323] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:34373
I20260709 12:58:59.132997  1586 tablet_copy_service.cc:140] P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Received BeginTabletCopySession request for tablet 93e6c991440c40c8a8c8050982e85eeb from peer 05476b84d8f84d76a9a1f51b620a3c66 ({username='slave'} at 127.0.0.1:37682)
I20260709 12:58:59.133585  1586 tablet_copy_service.cc:161] P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Beginning new tablet copy session on tablet 93e6c991440c40c8a8c8050982e85eeb from peer 05476b84d8f84d76a9a1f51b620a3c66 at {username='slave'} at 127.0.0.1:37682: session id = 05476b84d8f84d76a9a1f51b620a3c66-93e6c991440c40c8a8c8050982e85eeb
I20260709 12:58:59.140977  1471 catalog_manager.cc:5697] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 1 to 2, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 2 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:59.142608  1586 tablet_copy_source_session.cc:215] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:59.163856  3158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93e6c991440c40c8a8c8050982e85eeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:59.198581  3158 tablet_copy_client.cc:806] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:59.199326  3158 tablet_copy_client.cc:670] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:59.204396  3158 tablet_copy_client.cc:538] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:59.211767  3158 tablet_bootstrap.cc:492] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap starting.
I20260709 12:58:59.237131  3163 ts_tablet_manager.cc:933] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66: Initiating tablet copy from peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:59.249080  3158 tablet_bootstrap.cc:492] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:59.250552  3158 tablet_bootstrap.cc:492] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap complete.
I20260709 12:58:59.250742  3163 tablet_copy_client.cc:323] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:45473
I20260709 12:58:59.251375  3158 ts_tablet_manager.cc:1403] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66: Time spent bootstrapping tablet: real 0.040s	user 0.026s	sys 0.008s
I20260709 12:58:59.252486  1734 tablet_copy_service.cc:140] P 0c7751452c4b46afa95251b9df7169d4: Received BeginTabletCopySession request for tablet f8c04e2c99384254b275d20e6d27467b from peer 05476b84d8f84d76a9a1f51b620a3c66 ({username='slave'} at 127.0.0.1:58782)
I20260709 12:58:59.253082  1734 tablet_copy_service.cc:161] P 0c7751452c4b46afa95251b9df7169d4: Beginning new tablet copy session on tablet f8c04e2c99384254b275d20e6d27467b from peer 05476b84d8f84d76a9a1f51b620a3c66 at {username='slave'} at 127.0.0.1:58782: session id = 05476b84d8f84d76a9a1f51b620a3c66-f8c04e2c99384254b275d20e6d27467b
I20260709 12:58:59.254153  3158 raft_consensus.cc:359] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:59.254798  3158 raft_consensus.cc:740] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Initialized, Role: LEARNER
I20260709 12:58:59.255363  3158 consensus_queue.cc:260] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:59.260669  1734 tablet_copy_source_session.cc:215] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:59.264016  3163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8c04e2c99384254b275d20e6d27467b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:59.268551  3158 ts_tablet_manager.cc:1434] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 12:58:59.276068  3097 raft_consensus.cc:993] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: : Instructing follower 0c7751452c4b46afa95251b9df7169d4 to start an election
I20260709 12:58:59.276651  3139 raft_consensus.cc:1081] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 LEADER]: Signalling peer 0c7751452c4b46afa95251b9df7169d4 to start an election
I20260709 12:58:59.278568  1721 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413"
dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:49996
I20260709 12:58:59.279060  1721 raft_consensus.cc:493] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:59.279367  1721 raft_consensus.cc:3060] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:59.281677  1586 tablet_copy_service.cc:342] P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Request end of tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-93e6c991440c40c8a8c8050982e85eeb received from {username='slave'} at 127.0.0.1:37682
I20260709 12:58:59.282130  1586 tablet_copy_service.cc:434] P 89ac9d5e2fbc4536b03a1ff1dd3eb226: ending tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-93e6c991440c40c8a8c8050982e85eeb on tablet 93e6c991440c40c8a8c8050982e85eeb with peer 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:58:59.289091  1721 raft_consensus.cc:515] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:59.292337  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:58:59.292949  1646 raft_consensus.cc:3060] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:59.296283  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:59.296945  1570 raft_consensus.cc:3055] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:58:59.297262  1570 raft_consensus.cc:740] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:58:59.297973  1570 consensus_queue.cc:260] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:59.299022  1570 raft_consensus.cc:3060] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:58:59.299851  1646 raft_consensus.cc:2468] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 2.
I20260709 12:58:59.306244  3163 tablet_copy_client.cc:806] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:59.306485  1688 leader_election.cc:304] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:58:59.306933  3163 tablet_copy_client.cc:670] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:59.307502  3070 raft_consensus.cc:2804] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:58:59.308043  3070 raft_consensus.cc:697] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 2 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:58:59.309000  3070 consensus_queue.cc:237] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:59.311913  3163 tablet_copy_client.cc:538] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:59.314133  1721 leader_election.cc:290] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:59.316071  1570 raft_consensus.cc:2468] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 2.
I20260709 12:58:59.326550  3163 tablet_bootstrap.cc:492] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap starting.
I20260709 12:58:59.331576  3158 ts_tablet_manager.cc:933] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66: Initiating tablet copy from peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:58:59.338580  1470 catalog_manager.cc:5697] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 1 to 2, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 12:58:59.414088  3158 tablet_copy_client.cc:323] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:37391
I20260709 12:58:59.421092  1661 tablet_copy_service.cc:140] P 4dbe7d47a2374afca075d3a98583b49e: Received BeginTabletCopySession request for tablet 6eb51aa4d3bf4882a502ada4948b2cc2 from peer 05476b84d8f84d76a9a1f51b620a3c66 ({username='slave'} at 127.0.0.1:57912)
I20260709 12:58:59.421684  1661 tablet_copy_service.cc:161] P 4dbe7d47a2374afca075d3a98583b49e: Beginning new tablet copy session on tablet 6eb51aa4d3bf4882a502ada4948b2cc2 from peer 05476b84d8f84d76a9a1f51b620a3c66 at {username='slave'} at 127.0.0.1:57912: session id = 05476b84d8f84d76a9a1f51b620a3c66-6eb51aa4d3bf4882a502ada4948b2cc2
I20260709 12:58:59.427949  1661 tablet_copy_source_session.cc:215] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:59.477666  3169 ts_tablet_manager.cc:933] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66: Initiating tablet copy from peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:59.486598  3094 raft_consensus.cc:993] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4: : Instructing follower 4dbe7d47a2374afca075d3a98583b49e to start an election
I20260709 12:58:59.487157  3094 raft_consensus.cc:1081] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 2 LEADER]: Signalling peer 4dbe7d47a2374afca075d3a98583b49e to start an election
I20260709 12:58:59.490290  1646 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2"
dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
 from {username='slave'} at 127.0.0.1:45148
I20260709 12:58:59.491032  1646 raft_consensus.cc:493] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:58:59.491905  1646 raft_consensus.cc:3060] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:59.496935  3169 tablet_copy_client.cc:323] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:45473
I20260709 12:58:59.500546  1734 tablet_copy_service.cc:140] P 0c7751452c4b46afa95251b9df7169d4: Received BeginTabletCopySession request for tablet 3ba8e707693e4af2b8347a4bad4dfd67 from peer 05476b84d8f84d76a9a1f51b620a3c66 ({username='slave'} at 127.0.0.1:58782)
I20260709 12:58:59.501060  1734 tablet_copy_service.cc:161] P 0c7751452c4b46afa95251b9df7169d4: Beginning new tablet copy session on tablet 3ba8e707693e4af2b8347a4bad4dfd67 from peer 05476b84d8f84d76a9a1f51b620a3c66 at {username='slave'} at 127.0.0.1:58782: session id = 05476b84d8f84d76a9a1f51b620a3c66-3ba8e707693e4af2b8347a4bad4dfd67
I20260709 12:58:59.508889  1734 tablet_copy_source_session.cc:215] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:58:59.515519  3169 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3ba8e707693e4af2b8347a4bad4dfd67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:59.544435  3169 tablet_copy_client.cc:806] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:59.545118  3169 tablet_copy_client.cc:670] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:59.562460  3158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6eb51aa4d3bf4882a502ada4948b2cc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:58:59.569207  1721 raft_consensus.cc:1275] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:59.564379  3169 tablet_copy_client.cc:538] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:59.604840  3111 consensus_queue.cc:1048] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:59.614812  2328 raft_consensus.cc:1217] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:58:59.652947  1646 raft_consensus.cc:515] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:59.687615  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:58:59.688462  1717 raft_consensus.cc:3055] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:58:59.688941  1717 raft_consensus.cc:740] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:58:59.689988  1717 consensus_queue.cc:260] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:58:59.691324  1717 raft_consensus.cc:3060] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:59.703658  1570 raft_consensus.cc:1275] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:59.705643  1717 raft_consensus.cc:2468] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 3.
I20260709 12:58:59.656282  1646 leader_election.cc:290] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:58:59.706938  1617 leader_election.cc:304] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:58:59.729120  1571 raft_consensus.cc:1275] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:58:59.731386  3070 consensus_queue.cc:1048] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:59.734745  3163 tablet_bootstrap.cc:492] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:59.735845  3163 tablet_bootstrap.cc:492] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap complete.
I20260709 12:58:59.736725  3163 ts_tablet_manager.cc:1403] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66: Time spent bootstrapping tablet: real 0.410s	user 0.070s	sys 0.094s
I20260709 12:58:59.740021  3163 raft_consensus.cc:359] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:59.720649  3111 consensus_queue.cc:1048] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:58:59.716812  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:58:59.742365  1570 raft_consensus.cc:3060] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:58:59.721112  3169 tablet_bootstrap.cc:492] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap starting.
I20260709 12:58:59.749495  3156 raft_consensus.cc:2804] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:58:59.750098  3156 raft_consensus.cc:697] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 3 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:58:59.751144  3156 consensus_queue.cc:237] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:58:59.754761  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 47902.9us
I20260709 12:58:59.780822  3163 raft_consensus.cc:740] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Initialized, Role: LEARNER
I20260709 12:58:59.781924  3163 consensus_queue.cc:260] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:59.741705  3158 tablet_copy_client.cc:806] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 0 data blocks...
I20260709 12:58:59.797744  3158 tablet_copy_client.cc:670] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 1 WAL segments...
I20260709 12:58:59.815393  1570 raft_consensus.cc:2468] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 3.
I20260709 12:58:59.818881  1646 raft_consensus.cc:1275] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:58:59.821725  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 97291.2us
I20260709 12:58:59.825590  2929 consensus_queue.cc:1048] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:58:59.826432  3158 tablet_copy_client.cc:538] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:58:59.825820  3163 ts_tablet_manager.cc:1434] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66: Time spent starting tablet: real 0.089s	user 0.007s	sys 0.000s
I20260709 12:58:59.868036  1734 tablet_copy_service.cc:342] P 0c7751452c4b46afa95251b9df7169d4: Request end of tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-f8c04e2c99384254b275d20e6d27467b received from {username='slave'} at 127.0.0.1:58782
I20260709 12:58:59.868628  1734 tablet_copy_service.cc:434] P 0c7751452c4b46afa95251b9df7169d4: ending tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-f8c04e2c99384254b275d20e6d27467b on tablet f8c04e2c99384254b275d20e6d27467b with peer 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:58:59.902930  3158 tablet_bootstrap.cc:492] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap starting.
I20260709 12:58:59.896633  1471 catalog_manager.cc:5697] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 2 to 3, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 3 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:58:59.962709  3169 tablet_bootstrap.cc:492] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:58:59.965438  3169 tablet_bootstrap.cc:492] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap complete.
I20260709 12:58:59.968510  3169 ts_tablet_manager.cc:1403] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent bootstrapping tablet: real 0.248s	user 0.023s	sys 0.011s
I20260709 12:58:59.977550  3169 raft_consensus.cc:359] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:58:59.978617  3169 raft_consensus.cc:740] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Initialized, Role: LEARNER
I20260709 12:58:59.979403  3169 consensus_queue.cc:260] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:59:00.013170  3169 ts_tablet_manager.cc:1434] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent starting tablet: real 0.039s	user 0.014s	sys 0.001s
I20260709 12:59:00.024330  1734 tablet_copy_service.cc:342] P 0c7751452c4b46afa95251b9df7169d4: Request end of tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-3ba8e707693e4af2b8347a4bad4dfd67 received from {username='slave'} at 127.0.0.1:58782
I20260709 12:59:00.024801  1734 tablet_copy_service.cc:434] P 0c7751452c4b46afa95251b9df7169d4: ending tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-3ba8e707693e4af2b8347a4bad4dfd67 on tablet 3ba8e707693e4af2b8347a4bad4dfd67 with peer 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:59:00.037461   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:00.089035  3158 tablet_bootstrap.cc:492] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:59:00.090446  3158 tablet_bootstrap.cc:492] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap complete.
I20260709 12:59:00.091127  3158 ts_tablet_manager.cc:1403] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent bootstrapping tablet: real 0.188s	user 0.017s	sys 0.030s
I20260709 12:59:00.095187  3158 raft_consensus.cc:359] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:59:00.096107  3158 raft_consensus.cc:740] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Initialized, Role: LEARNER
I20260709 12:59:00.096840  3158 consensus_queue.cc:260] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:59:00.105193  3158 ts_tablet_manager.cc:1434] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.003s
I20260709 12:59:00.108444  1661 tablet_copy_service.cc:342] P 4dbe7d47a2374afca075d3a98583b49e: Request end of tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-6eb51aa4d3bf4882a502ada4948b2cc2 received from {username='slave'} at 127.0.0.1:57912
I20260709 12:59:00.108858  1661 tablet_copy_service.cc:434] P 4dbe7d47a2374afca075d3a98583b49e: ending tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-6eb51aa4d3bf4882a502ada4948b2cc2 on tablet 6eb51aa4d3bf4882a502ada4948b2cc2 with peer 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:59:00.124285  3187 raft_consensus.cc:1064] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226: attempting to promote NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 to VOTER
I20260709 12:59:00.127223  3187 consensus_queue.cc:237] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:00.146728  1718 raft_consensus.cc:1275] T 93e6c991440c40c8a8c8050982e85eeb P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:00.148536  3145 consensus_queue.cc:1048] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:00.152036  1646 raft_consensus.cc:1275] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:00.154508  2325 raft_consensus.cc:1275] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:00.157356  3187 consensus_queue.cc:1048] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:00.165520  3097 consensus_queue.cc:1048] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:00.189347  3145 raft_consensus.cc:2955] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:59:00.197398   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:00.192025  1651 raft_consensus.cc:2955] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:59:00.220682  1718 raft_consensus.cc:2955] T 93e6c991440c40c8a8c8050982e85eeb P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:59:00.238392  2325 raft_consensus.cc:2955] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:59:00.241015  1471 catalog_manager.cc:5697] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:59:00.253310  1723 raft_consensus.cc:1275] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:00.255438  3111 consensus_queue.cc:1048] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:00.288074  1567 consensus_queue.cc:237] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:00.298589  1570 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad"
dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
mode: GRACEFUL
new_leader_uuid: "4dbe7d47a2374afca075d3a98583b49e"
 from {username='slave'} at 127.0.0.1:60346
I20260709 12:59:00.300365  1570 raft_consensus.cc:606] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 LEADER]: Received request to transfer leadership to TS 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:00.306316  1646 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f"
dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
mode: GRACEFUL
new_leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
 from {username='slave'} at 127.0.0.1:35470
I20260709 12:59:00.307053  1646 raft_consensus.cc:606] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Received request to transfer leadership to TS 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:59:00.321244  1570 raft_consensus.cc:1275] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:00.324839  1723 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0"
dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
mode: GRACEFUL
new_leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:50592
I20260709 12:59:00.325461  1723 raft_consensus.cc:606] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 2 LEADER]: Received request to transfer leadership to TS 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:00.329921  1646 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e"
dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
mode: GRACEFUL
new_leader_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:35470
I20260709 12:59:00.330507  1646 raft_consensus.cc:606] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Received request to transfer leadership to TS 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:00.332508   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:59:00.334061   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:00.335623  1646 raft_consensus.cc:1275] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:00.337918  3187 consensus_queue.cc:1048] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:00.339783  3156 consensus_queue.cc:1048] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:00.347733  3097 raft_consensus.cc:2955] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:59:00.358873  2328 raft_consensus.cc:1217] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:00.364895  1646 raft_consensus.cc:2955] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:59:00.368904  2324 raft_consensus.cc:1217] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:59:00.346781  2325 raft_consensus.cc:1275] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:00.388417  3187 consensus_queue.cc:1048] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:00.400460  2325 raft_consensus.cc:1217] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:59:00.411691  1459 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 93e6c991440c40c8a8c8050982e85eeb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:00.411478  2324 raft_consensus.cc:2955] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:59:00.494473  1468 catalog_manager.cc:5697] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: config changed from index 3 to 4, VOTER 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) evicted. New cstate: current_term: 1 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:00.506026  3094 raft_consensus.cc:993] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4: : Instructing follower 89ac9d5e2fbc4536b03a1ff1dd3eb226 to start an election
I20260709 12:59:00.506976  3094 raft_consensus.cc:1081] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 2 LEADER]: Signalling peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 to start an election
I20260709 12:59:00.597214  1706 tablet_service.cc:1558] Processing DeleteTablet for tablet 93e6c991440c40c8a8c8050982e85eeb with delete_type TABLET_DATA_TOMBSTONED (TS 0c7751452c4b46afa95251b9df7169d4 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49982
W20260709 12:59:00.655439  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 51513.1us
W20260709 12:59:00.673475  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 76748.1us
I20260709 12:59:00.673635  1567 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0"
dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:36642
I20260709 12:59:00.674671  1567 raft_consensus.cc:493] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:00.675513  1567 raft_consensus.cc:3060] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:00.679725  3204 tablet_replica.cc:333] T 93e6c991440c40c8a8c8050982e85eeb P 0c7751452c4b46afa95251b9df7169d4: stopping tablet replica
I20260709 12:59:00.710456  3111 raft_consensus.cc:993] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e: : Instructing follower 0c7751452c4b46afa95251b9df7169d4 to start an election
I20260709 12:59:00.711615  3175 raft_consensus.cc:1081] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Signalling peer 0c7751452c4b46afa95251b9df7169d4 to start an election
I20260709 12:59:00.714046  1717 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e"
dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:50010
I20260709 12:59:00.714790  1717 raft_consensus.cc:493] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:00.715179  1717 raft_consensus.cc:3060] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:00.696182  1567 raft_consensus.cc:515] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:00.732025  1567 leader_election.cc:290] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:00.748984  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:00.749903  1723 raft_consensus.cc:3055] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:00.750286  1723 raft_consensus.cc:740] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:00.750093  3111 raft_consensus.cc:993] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e: : Instructing follower 05476b84d8f84d76a9a1f51b620a3c66 to start an election
I20260709 12:59:00.751641  1723 consensus_queue.cc:260] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:00.753686  3175 raft_consensus.cc:1081] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Signalling peer 05476b84d8f84d76a9a1f51b620a3c66 to start an election
I20260709 12:59:00.755092  1723 raft_consensus.cc:3060] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:00.762590  2324 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f"
dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
 from {username='slave'} at 127.0.0.1:53290
I20260709 12:59:00.763299  2324 raft_consensus.cc:493] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:00.763610  3204 raft_consensus.cc:2243] T 93e6c991440c40c8a8c8050982e85eeb P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:00.764928  3204 raft_consensus.cc:2272] T 93e6c991440c40c8a8c8050982e85eeb P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:00.765676  2324 raft_consensus.cc:3060] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:59:00.769744  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 56793.5us
I20260709 12:59:00.769780  3204 ts_tablet_manager.cc:1916] T 93e6c991440c40c8a8c8050982e85eeb P 0c7751452c4b46afa95251b9df7169d4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:00.772928  1717 raft_consensus.cc:515] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:00.776608  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:00.777230  1647 raft_consensus.cc:3055] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:00.777521  1647 raft_consensus.cc:740] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:00.778481  1647 consensus_queue.cc:260] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:00.779672  1647 raft_consensus.cc:3060] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:00.780910  1723 raft_consensus.cc:2468] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 3.
I20260709 12:59:00.782132  1717 leader_election.cc:290] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:00.782807  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:00.783390  2328 raft_consensus.cc:3060] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:00.787786  1542 leader_election.cc:304] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:00.788849  3199 raft_consensus.cc:2804] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:00.789274  2328 raft_consensus.cc:2468] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 2.
I20260709 12:59:00.789363  3199 raft_consensus.cc:697] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:00.790488  3199 consensus_queue.cc:237] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:00.796955  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:00.797622  1651 raft_consensus.cc:3060] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:00.804510  1689 leader_election.cc:304] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 12:59:00.804993  1651 raft_consensus.cc:2468] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 3.
I20260709 12:59:00.806684  3094 raft_consensus.cc:2804] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:00.807487  3094 raft_consensus.cc:697] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 2 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:00.808754  3094 consensus_queue.cc:237] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:00.816268  3204 ts_tablet_manager.cc:1929] T 93e6c991440c40c8a8c8050982e85eeb P 0c7751452c4b46afa95251b9df7169d4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:00.806782  1647 raft_consensus.cc:2468] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 2.
I20260709 12:59:00.816927  3204 log.cc:1199] T 93e6c991440c40c8a8c8050982e85eeb P 0c7751452c4b46afa95251b9df7169d4: Deleting WAL directory at /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601869227091-431-0/minicluster-data/ts-2-root/wals/93e6c991440c40c8a8c8050982e85eeb
I20260709 12:59:00.823318  1461 catalog_manager.cc:5028] TS 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): tablet 93e6c991440c40c8a8c8050982e85eeb (table test-workload [id=2e230675e851429db50863dfed56dde5]) successfully deleted
I20260709 12:59:00.829715  2324 raft_consensus.cc:515] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:00.835353  1474 catalog_manager.cc:5697] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 2 to 3, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:00.838855  2324 leader_election.cc:290] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:00.842298  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:00.843371  1646 raft_consensus.cc:3055] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:00.843685  1646 raft_consensus.cc:740] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:00.844559  1646 consensus_queue.cc:260] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:00.845512  1646 raft_consensus.cc:3060] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:00.845430  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:00.846143  1717 raft_consensus.cc:3060] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:00.858982  3156 raft_consensus.cc:1064] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e: attempting to promote NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 to VOTER
I20260709 12:59:00.862350  3156 consensus_queue.cc:237] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:00.872308  3201 raft_consensus.cc:993] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226: : Instructing follower 4dbe7d47a2374afca075d3a98583b49e to start an election
I20260709 12:59:00.872901  3199 raft_consensus.cc:1081] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 LEADER]: Signalling peer 4dbe7d47a2374afca075d3a98583b49e to start an election
I20260709 12:59:00.874697  1647 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad"
dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
 from {username='slave'} at 127.0.0.1:45142
I20260709 12:59:00.875276  1647 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:00.875633  1647 raft_consensus.cc:3060] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:00.887218  1474 catalog_manager.cc:5697] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 1 to 2, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:00.889616  3028 raft_consensus.cc:1064] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4: attempting to promote NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 to VOTER
I20260709 12:59:00.901187  1646 raft_consensus.cc:2468] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 2.
I20260709 12:59:00.898166  3028 consensus_queue.cc:237] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:00.902823  1647 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:00.908577  1717 raft_consensus.cc:2468] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 2.
I20260709 12:59:00.911216  2294 leader_election.cc:304] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:00.913009  3171 raft_consensus.cc:2804] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:00.913511  3171 raft_consensus.cc:697] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:00.914464  3171 consensus_queue.cc:237] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:00.909554  1723 raft_consensus.cc:1240] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:00.921749  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:00.922384  1567 raft_consensus.cc:3055] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:00.922670  1567 raft_consensus.cc:740] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:00.923571  1567 consensus_queue.cc:260] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:00.927085  1567 raft_consensus.cc:3060] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:00.929260  1647 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:00.936197  3197 raft_consensus.cc:1064] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4: attempting to promote NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 to VOTER
I20260709 12:59:00.940119  3197 consensus_queue.cc:237] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:00.949580  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:00.950192  1723 raft_consensus.cc:3060] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:00.960142  1723 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 3.
I20260709 12:59:00.963716  1647 raft_consensus.cc:1275] T 3ba8e707693e4af2b8347a4bad4dfd67 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:59:00.965639  3210 consensus_queue.cc:1048] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:00.969405  1567 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 3.
I20260709 12:59:01.015002  1647 raft_consensus.cc:1275] T f8c04e2c99384254b275d20e6d27467b P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:01.016556  3028 consensus_queue.cc:1048] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:01.036190  1575 raft_consensus.cc:1275] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:01.036938  2324 raft_consensus.cc:1275] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:01.037853  3197 consensus_queue.cc:1048] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:01.040766  3028 consensus_queue.cc:1048] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:00.973536  1617 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:00.971185  1570 raft_consensus.cc:1275] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:00.985879  1721 raft_consensus.cc:1275] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:01.043159  3111 raft_consensus.cc:2804] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:01.043617  3111 raft_consensus.cc:697] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 3 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:01.000074  1474 catalog_manager.cc:5697] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 1 to 2, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:00.981564  1571 raft_consensus.cc:1275] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:59:01.044543  3111 consensus_queue.cc:237] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:00.969754  2328 raft_consensus.cc:1275] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:59:01.046406  3203 consensus_queue.cc:1048] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:59:01.049052  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 75685.6us
I20260709 12:59:01.050439  3178 consensus_queue.cc:1048] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:00.974148  2325 raft_consensus.cc:1275] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 LEARNER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:59:01.058743  3203 consensus_queue.cc:1048] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:01.058786  3210 consensus_queue.cc:1048] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:59:01.061858  3197 consensus_queue.cc:1048] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:01.138892  3028 raft_consensus.cc:2955] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:59:01.144279  2328 raft_consensus.cc:2955] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:59:01.164428  3203 raft_consensus.cc:2955] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:59:01.171495  1571 raft_consensus.cc:2955] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:59:01.162129  1468 catalog_manager.cc:5697] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 2 to 3, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 3 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:01.190112  1647 raft_consensus.cc:2955] T f8c04e2c99384254b275d20e6d27467b P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:59:01.194631  1474 catalog_manager.cc:5697] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:59:01.199584  1718 raft_consensus.cc:1275] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:01.202966  3187 consensus_queue.cc:1048] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:01.217695  2324 raft_consensus.cc:2955] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:59:01.216157  3210 raft_consensus.cc:2955] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:59:01.235196  1718 consensus_queue.cc:237] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:01.215473  1721 raft_consensus.cc:2955] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:59:01.216070  1575 raft_consensus.cc:2955] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:59:01.243803  2328 raft_consensus.cc:1275] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:01.246048  1571 raft_consensus.cc:1275] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:01.250607  3197 consensus_queue.cc:1048] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:01.260278  3028 consensus_queue.cc:1048] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:01.259792  1647 raft_consensus.cc:2955] T 3ba8e707693e4af2b8347a4bad4dfd67 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:59:01.244549  1570 raft_consensus.cc:2955] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:59:01.277894  3070 raft_consensus.cc:2955] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:59:01.279143  2328 raft_consensus.cc:2955] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:59:01.292802  1571 raft_consensus.cc:2955] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:59:01.297247  1461 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f8c04e2c99384254b275d20e6d27467b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:01.299124  1647 raft_consensus.cc:1275] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:01.300836  3201 consensus_queue.cc:1048] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:01.303133  1644 raft_consensus.cc:1275] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:01.311072  2326 raft_consensus.cc:2955] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:59:01.312968  2325 raft_consensus.cc:1275] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:01.314858  3071 consensus_queue.cc:1048] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:01.315603  1647 raft_consensus.cc:1275] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:01.317809  3197 consensus_queue.cc:1048] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:01.324983  3070 consensus_queue.cc:1048] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:01.367660   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:01.293687  1469 catalog_manager.cc:5697] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: config changed from index 2 to 3, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:01.485783  1717 raft_consensus.cc:1275] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:01.489813  3071 consensus_queue.cc:1048] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:01.497648  1473 catalog_manager.cc:5697] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: config changed from index 3 to 4, VOTER 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) evicted. New cstate: current_term: 1 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:01.469445  1469 catalog_manager.cc:5697] T 3ba8e707693e4af2b8347a4bad4dfd67 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: config changed from index 3 to 4, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } attrs { replace: true } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:59:01.521041  1721 raft_consensus.cc:1275] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:59:01.525061  3178 consensus_queue.cc:1048] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
W20260709 12:59:01.534775  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 67225.9us
I20260709 12:59:01.587704  1567 raft_consensus.cc:1275] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:59:01.596343  1634 tablet_service.cc:1558] Processing DeleteTablet for tablet f8c04e2c99384254b275d20e6d27467b with delete_type TABLET_DATA_TOMBSTONED (TS 4dbe7d47a2374afca075d3a98583b49e not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45134
I20260709 12:59:01.598634  3178 consensus_queue.cc:1048] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:01.613642  3244 tablet_replica.cc:333] T f8c04e2c99384254b275d20e6d27467b P 4dbe7d47a2374afca075d3a98583b49e: stopping tablet replica
I20260709 12:59:01.615252  3244 raft_consensus.cc:2243] T f8c04e2c99384254b275d20e6d27467b P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:01.616236  3244 raft_consensus.cc:2272] T f8c04e2c99384254b275d20e6d27467b P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:01.620486  3244 ts_tablet_manager.cc:1916] T f8c04e2c99384254b275d20e6d27467b P 4dbe7d47a2374afca075d3a98583b49e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:01.629349  1646 consensus_queue.cc:237] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:01.641251  3244 ts_tablet_manager.cc:1929] T f8c04e2c99384254b275d20e6d27467b P 4dbe7d47a2374afca075d3a98583b49e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:01.641876  3244 log.cc:1199] T f8c04e2c99384254b275d20e6d27467b P 4dbe7d47a2374afca075d3a98583b49e: Deleting WAL directory at /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601869227091-431-0/minicluster-data/ts-1-root/wals/f8c04e2c99384254b275d20e6d27467b
I20260709 12:59:01.643993  1458 catalog_manager.cc:5028] TS 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): tablet f8c04e2c99384254b275d20e6d27467b (table test-workload [id=2e230675e851429db50863dfed56dde5]) successfully deleted
I20260709 12:59:01.661978  2326 raft_consensus.cc:1275] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:01.663949  1721 raft_consensus.cc:1275] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:59:01.667150  3175 consensus_queue.cc:1048] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:01.679162  3203 consensus_queue.cc:1048] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:01.715921  3178 raft_consensus.cc:2955] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:59:01.738418  2326 raft_consensus.cc:2955] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:59:01.747195  1721 raft_consensus.cc:2955] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:59:01.764699  1458 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6eb51aa4d3bf4882a502ada4948b2cc2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:01.786485  1723 consensus_queue.cc:237] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:01.803908  1469 catalog_manager.cc:5697] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: config changed from index 3 to 4, VOTER 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) evicted. New cstate: current_term: 1 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:59:01.824156  1570 raft_consensus.cc:1275] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:01.826671  2328 raft_consensus.cc:1275] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:01.830202  1561 tablet_service.cc:1558] Processing DeleteTablet for tablet 6eb51aa4d3bf4882a502ada4948b2cc2 with delete_type TABLET_DATA_TOMBSTONED (TS 89ac9d5e2fbc4536b03a1ff1dd3eb226 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36626
W20260709 12:59:01.835031  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 269602us
I20260709 12:59:01.865682  3246 tablet_replica.cc:333] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: stopping tablet replica
I20260709 12:59:01.867084  3246 raft_consensus.cc:2243] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:01.873142  3246 raft_consensus.cc:2272] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:01.879264  3246 ts_tablet_manager.cc:1916] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:01.881156  3197 consensus_queue.cc:1048] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:01.953202  3246 ts_tablet_manager.cc:1929] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:59:01.960789  3246 log.cc:1199] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Deleting WAL directory at /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601869227091-431-0/minicluster-data/ts-0-root/wals/6eb51aa4d3bf4882a502ada4948b2cc2
I20260709 12:59:01.963071  1459 catalog_manager.cc:5028] TS 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): tablet 6eb51aa4d3bf4882a502ada4948b2cc2 (table test-workload [id=2e230675e851429db50863dfed56dde5]) successfully deleted
I20260709 12:59:01.978770  2929 consensus_queue.cc:1048] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:02.016820  2929 raft_consensus.cc:2955] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:59:02.029420  1461 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3ba8e707693e4af2b8347a4bad4dfd67 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:59:02.040886  2328 raft_consensus.cc:2955] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:59:02.062685  1575 raft_consensus.cc:2955] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:59:02.069893  1472 catalog_manager.cc:5697] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: config changed from index 4 to 5, VOTER 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) evicted. New cstate: current_term: 2 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:59:02.069900   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:02.128407  1634 tablet_service.cc:1558] Processing DeleteTablet for tablet 3ba8e707693e4af2b8347a4bad4dfd67 with delete_type TABLET_DATA_TOMBSTONED (TS 4dbe7d47a2374afca075d3a98583b49e not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:45134
I20260709 12:59:02.129567  3244 tablet_replica.cc:333] T 3ba8e707693e4af2b8347a4bad4dfd67 P 4dbe7d47a2374afca075d3a98583b49e: stopping tablet replica
I20260709 12:59:02.141248  3244 raft_consensus.cc:2243] T 3ba8e707693e4af2b8347a4bad4dfd67 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:59:02.142329  3244 raft_consensus.cc:2272] T 3ba8e707693e4af2b8347a4bad4dfd67 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:59:02.146552  3244 ts_tablet_manager.cc:1916] T 3ba8e707693e4af2b8347a4bad4dfd67 P 4dbe7d47a2374afca075d3a98583b49e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:59:02.168313  3244 ts_tablet_manager.cc:1929] T 3ba8e707693e4af2b8347a4bad4dfd67 P 4dbe7d47a2374afca075d3a98583b49e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:59:02.168911  3244 log.cc:1199] T 3ba8e707693e4af2b8347a4bad4dfd67 P 4dbe7d47a2374afca075d3a98583b49e: Deleting WAL directory at /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601869227091-431-0/minicluster-data/ts-1-root/wals/3ba8e707693e4af2b8347a4bad4dfd67
I20260709 12:59:02.170722  1458 catalog_manager.cc:5028] TS 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): tablet 3ba8e707693e4af2b8347a4bad4dfd67 (table test-workload [id=2e230675e851429db50863dfed56dde5]) successfully deleted
I20260709 12:59:02.210850  1721 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "477960faa15b4001a5a6361558d69294"
dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
mode: GRACEFUL
new_leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:50592
I20260709 12:59:02.211449  1721 raft_consensus.cc:606] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Received request to transfer leadership to TS 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:02.214959  1575 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8"
dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
mode: GRACEFUL
new_leader_uuid: "4dbe7d47a2374afca075d3a98583b49e"
 from {username='slave'} at 127.0.0.1:60346
I20260709 12:59:02.215617  1575 raft_consensus.cc:606] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 LEADER]: Received request to transfer leadership to TS 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:02.222087  1651 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a"
dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
mode: GRACEFUL
new_leader_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:35470
I20260709 12:59:02.222832  1651 raft_consensus.cc:606] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Received request to transfer leadership to TS 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:02.232353  3210 raft_consensus.cc:993] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4: : Instructing follower 89ac9d5e2fbc4536b03a1ff1dd3eb226 to start an election
I20260709 12:59:02.232880  2929 raft_consensus.cc:1081] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Signalling peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 to start an election
I20260709 12:59:02.233093  1721 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b"
dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
mode: GRACEFUL
new_leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
 from {username='slave'} at 127.0.0.1:50592
I20260709 12:59:02.233731  1721 raft_consensus.cc:606] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Received request to transfer leadership to TS 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:59:02.234654  1575 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "477960faa15b4001a5a6361558d69294"
dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:36642
I20260709 12:59:02.235301  1575 raft_consensus.cc:493] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:02.235675  1575 raft_consensus.cc:3060] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:02.243552  1575 raft_consensus.cc:515] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:02.244567   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:59:02.246371  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:02.247042  1721 raft_consensus.cc:3055] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:02.247371  1721 raft_consensus.cc:740] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:02.247429  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:02.248126  2328 raft_consensus.cc:3060] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:02.248447  1721 consensus_queue.cc:260] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:02.250034  1721 raft_consensus.cc:3060] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:02.266458  1575 leader_election.cc:290] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:02.265875  2328 raft_consensus.cc:2468] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 2.
I20260709 12:59:02.268882  1540 leader_election.cc:304] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:02.270097  3199 raft_consensus.cc:2804] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:02.271570  3199 raft_consensus.cc:697] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:02.274724  3199 consensus_queue.cc:237] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:02.287187   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:02.289757  1721 raft_consensus.cc:2468] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 2.
I20260709 12:59:02.310177  1469 catalog_manager.cc:5697] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 1 to 2, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:02.373669  3210 raft_consensus.cc:993] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4: : Instructing follower 05476b84d8f84d76a9a1f51b620a3c66 to start an election
I20260709 12:59:02.374162  2929 raft_consensus.cc:1081] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Signalling peer 05476b84d8f84d76a9a1f51b620a3c66 to start an election
I20260709 12:59:02.375641  2328 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b"
dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
 from {username='slave'} at 127.0.0.1:53306
I20260709 12:59:02.376096  2328 raft_consensus.cc:493] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:02.376386  2328 raft_consensus.cc:3060] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:02.382866  2328 raft_consensus.cc:515] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:02.385234  2328 leader_election.cc:290] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:02.385715  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:02.386287  1570 raft_consensus.cc:3060] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:02.387610  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:02.388190  1719 raft_consensus.cc:3055] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:02.388502  1719 raft_consensus.cc:740] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:02.389259  1719 consensus_queue.cc:260] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:02.390367  1719 raft_consensus.cc:3060] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:02.396586  1570 raft_consensus.cc:2468] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 2.
I20260709 12:59:02.397846  2295 leader_election.cc:304] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:02.398650  3236 raft_consensus.cc:2804] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:02.399793  3236 raft_consensus.cc:697] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:02.400679  3236 consensus_queue.cc:237] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:02.404122  3243 raft_consensus.cc:993] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: : Instructing follower 4dbe7d47a2374afca075d3a98583b49e to start an election
I20260709 12:59:02.404860  3243 raft_consensus.cc:1081] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 LEADER]: Signalling peer 4dbe7d47a2374afca075d3a98583b49e to start an election
I20260709 12:59:02.406656  1651 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8"
dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
 from {username='slave'} at 127.0.0.1:45142
I20260709 12:59:02.407392  1651 raft_consensus.cc:493] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:02.407795  1651 raft_consensus.cc:3060] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:02.412724  1719 raft_consensus.cc:2468] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 2.
I20260709 12:59:02.418365  1651 raft_consensus.cc:515] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:02.421723  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:02.422051  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:02.422364  1719 raft_consensus.cc:3060] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:02.422598  1570 raft_consensus.cc:3055] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:02.422937  1570 raft_consensus.cc:740] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:02.423664  1570 consensus_queue.cc:260] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:02.424727  1570 raft_consensus.cc:3060] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:02.425433  1469 catalog_manager.cc:5697] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 1 to 2, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:02.436810  1570 raft_consensus.cc:2468] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 2.
I20260709 12:59:02.438330  1615 leader_election.cc:304] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:02.439374  3175 raft_consensus.cc:2804] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:02.439934  3175 raft_consensus.cc:697] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 2 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:02.440984  3175 consensus_queue.cc:237] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:02.443889  1719 raft_consensus.cc:2468] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 2.
I20260709 12:59:02.421321  1651 leader_election.cc:290] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:02.470660  1469 catalog_manager.cc:5697] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 1 to 2, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 2 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:04.118259  3253 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:04.120770  3254 raft_consensus.cc:493] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:04.141165  3254 raft_consensus.cc:515] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:04.143373  3254 leader_election.cc:290] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:04.124330  3252 raft_consensus.cc:493] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:04.144802  3252 raft_consensus.cc:515] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:04.146944  3252 leader_election.cc:290] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:04.147410  3252 raft_consensus.cc:493] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:04.147848  3252 raft_consensus.cc:515] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:04.150588  3254 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:04.151572  3254 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:04.155506  3252 leader_election.cc:290] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:04.160593  3254 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:04.188938  3252 raft_consensus.cc:493] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:04.189646  3252 raft_consensus.cc:515] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:04.191689  3252 leader_election.cc:290] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:04.192473  3253 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:04.192123  3252 raft_consensus.cc:493] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:04.221060  3260 raft_consensus.cc:493] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:04.221892  3260 raft_consensus.cc:515] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:04.224836  3262 raft_consensus.cc:493] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:04.225057  3260 leader_election.cc:290] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:04.218753  3252 raft_consensus.cc:515] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:04.254593  3256 raft_consensus.cc:493] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:04.256896  3254 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:04.265453  3265 raft_consensus.cc:493] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:04.265817  3267 raft_consensus.cc:493] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:04.262951  3253 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:04.261372  3262 raft_consensus.cc:515] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:04.299816  3264 raft_consensus.cc:493] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:04.273388  3260 raft_consensus.cc:493] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:04.304873  3259 raft_consensus.cc:493] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:04.305591  3259 raft_consensus.cc:515] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:04.303097  3268 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:04.308869  3260 raft_consensus.cc:515] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:04.273222  3265 raft_consensus.cc:515] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:04.311571  3260 leader_election.cc:290] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:04.272732  3256 raft_consensus.cc:515] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:04.314111  3262 leader_election.cc:290] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:04.315551  3256 leader_election.cc:290] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:04.317940  3252 leader_election.cc:290] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:04.273247  3267 raft_consensus.cc:515] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:04.342783  3267 leader_election.cc:290] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:04.289590  3254 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:04.343896  3264 raft_consensus.cc:515] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:04.352908  3262 raft_consensus.cc:493] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:04.353474  3262 raft_consensus.cc:515] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:04.354171  3263 raft_consensus.cc:493] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:04.355224  3266 raft_consensus.cc:493] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:04.355070  3263 raft_consensus.cc:515] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:04.355906  3266 raft_consensus.cc:515] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:04.357978  3266 leader_election.cc:290] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:04.359505  3260 raft_consensus.cc:493] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:04.308027  3268 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:04.389298  3252 raft_consensus.cc:493] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:04.390066  3252 raft_consensus.cc:515] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:04.379640  3253 raft_consensus.cc:493] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:04.393203  3253 raft_consensus.cc:515] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:04.395501  3253 leader_election.cc:290] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:04.349540  3265 leader_election.cc:290] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:04.347046  3259 leader_election.cc:290] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:04.397056  3257 raft_consensus.cc:493] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:04.364284  3264 leader_election.cc:290] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:04.396417  3267 raft_consensus.cc:493] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:04.360360  3273 raft_consensus.cc:493] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:04.404764  3257 raft_consensus.cc:515] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:04.367374  3254 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:04.369148  3262 leader_election.cc:290] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:04.359706  3263 leader_election.cc:290] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:04.405048  3267 raft_consensus.cc:515] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:04.408318  3270 raft_consensus.cc:493] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:04.408954  3257 leader_election.cc:290] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:04.408573  3273 raft_consensus.cc:515] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:04.576555  3254 raft_consensus.cc:493] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:04.577188  3254 raft_consensus.cc:515] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:04.579370  3254 leader_election.cc:290] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:04.413256  3252 leader_election.cc:290] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:04.404740  3260 raft_consensus.cc:515] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:04.536751  3253 raft_consensus.cc:493] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:04.542331  3263 raft_consensus.cc:493] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:04.553290  3266 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:04.584690  3257 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:04.581326  3270 raft_consensus.cc:515] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:04.622574  3270 leader_election.cc:290] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:04.623237  3253 raft_consensus.cc:515] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:04.615284  3263 raft_consensus.cc:515] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:04.618898  3266 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:04.623993  3275 raft_consensus.cc:493] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:04.625854  3273 leader_election.cc:290] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:04.633733  3257 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:04.645422  3257 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:04.627561  3267 leader_election.cc:290] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:04.629961  3253 leader_election.cc:290] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:04.634923  3264 raft_consensus.cc:493] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:04.647593  3264 raft_consensus.cc:515] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:04.650008  3264 leader_election.cc:290] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:04.633386  3263 leader_election.cc:290] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:04.640614  3275 raft_consensus.cc:515] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:04.654099  3275 leader_election.cc:290] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:04.624109  3268 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:04.639113  3266 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:04.636555  3260 leader_election.cc:290] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:04.661237  3278 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:04.661918  3278 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:04.665067  3278 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:04.667208  3278 raft_consensus.cc:493] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:04.667903  3278 raft_consensus.cc:515] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:04.670398  3278 leader_election.cc:290] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:04.672819  3268 raft_consensus.cc:493] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:04.673538  3268 raft_consensus.cc:515] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:04.675513  3268 leader_election.cc:290] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:04.705250  3264 raft_consensus.cc:493] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:04.706249  3264 raft_consensus.cc:515] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:04.707212  3262 raft_consensus.cc:493] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:04.707798  3262 raft_consensus.cc:515] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:04.708376  3263 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:04.709007  3263 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:04.709530  3264 leader_election.cc:290] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:04.710139  3262 leader_election.cc:290] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:04.711331  3263 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:04.712128  3266 raft_consensus.cc:493] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:04.712754  3266 raft_consensus.cc:515] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:04.714969  3266 leader_election.cc:290] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:04.721726  3253 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:04.722398  3253 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:04.724649  3267 raft_consensus.cc:493] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:04.725076  3253 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:04.725257  3267 raft_consensus.cc:515] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:04.726495  3253 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:04.727198  3253 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:04.728084  3267 leader_election.cc:290] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:04.729970  3253 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:04.731714  3265 raft_consensus.cc:493] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:04.731793  3274 raft_consensus.cc:493] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:04.732246  3277 raft_consensus.cc:493] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:04.732635  3274 raft_consensus.cc:515] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:04.732965  3277 raft_consensus.cc:515] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:04.735327  3274 leader_election.cc:290] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:04.735394  3277 leader_election.cc:290] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:04.735643  3263 raft_consensus.cc:493] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:04.736083  3274 raft_consensus.cc:493] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:04.736285  3263 raft_consensus.cc:515] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:04.736899  3265 raft_consensus.cc:515] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:04.739181  3263 leader_election.cc:290] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:04.739722  3265 leader_election.cc:290] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:04.743609  3270 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:04.743860  3278 raft_consensus.cc:493] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:04.744298  3270 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:04.745376  3268 raft_consensus.cc:493] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:04.745946  3268 raft_consensus.cc:515] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:04.747044  3270 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:04.740759  3274 raft_consensus.cc:515] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:04.748100  3268 leader_election.cc:290] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:04.748709  3254 raft_consensus.cc:493] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:04.749341  3255 raft_consensus.cc:493] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:04.749711  3257 raft_consensus.cc:493] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:04.749933  3255 raft_consensus.cc:515] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 12:59:04.750322  3257 raft_consensus.cc:515] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:04.751443  3274 leader_election.cc:290] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:04.744557  3278 raft_consensus.cc:515] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:04.749346  3254 raft_consensus.cc:515] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:04.752596  3257 leader_election.cc:290] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:04.753659  3257 raft_consensus.cc:493] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:04.754365  3278 leader_election.cc:290] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:04.754230  3257 raft_consensus.cc:515] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:04.754967  3254 leader_election.cc:290] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:04.755329  3281 raft_consensus.cc:493] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:04.755630  3254 raft_consensus.cc:493] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:04.755921  3281 raft_consensus.cc:515] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:04.752430  3255 leader_election.cc:290] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:04.756224  3254 raft_consensus.cc:515] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 12:59:04.758026  3257 leader_election.cc:290] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:04.758724  3281 leader_election.cc:290] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:04.759528  3254 leader_election.cc:290] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373)
I20260709 12:59:04.765311  3273 raft_consensus.cc:493] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:04.766089  3273 raft_consensus.cc:515] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:04.766476  3258 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:04.767123  3258 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:04.769106  3273 leader_election.cc:290] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:04.769555  3258 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:04.769901  3273 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:04.770676  3273 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:04.773401  3273 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:04.737483  3279 raft_consensus.cc:493] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:04.775735  3284 raft_consensus.cc:493] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:04.775820  3286 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:04.777523  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:04.778008  3275 raft_consensus.cc:493] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:04.778553  3275 raft_consensus.cc:515] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:04.781324  3285 raft_consensus.cc:493] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:04.783104  3275 leader_election.cc:290] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:04.783111  3272 raft_consensus.cc:493] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:04.784924  3260 raft_consensus.cc:493] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:04.784958  3275 raft_consensus.cc:493] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:04.785573  3260 raft_consensus.cc:515] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:04.785737  3275 raft_consensus.cc:515] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:04.788023  3280 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:04.740454  3265 raft_consensus.cc:493] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:04.789310  3265 raft_consensus.cc:515] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:04.789896  3271 raft_consensus.cc:493] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:04.790673  3258 raft_consensus.cc:493] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:04.819948  3259 raft_consensus.cc:493] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:04.817224  3267 raft_consensus.cc:493] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:04.790750  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:04.822415  3258 raft_consensus.cc:515] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:04.822602  3259 raft_consensus.cc:515] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:04.822777  3267 raft_consensus.cc:515] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:04.823127  1575 raft_consensus.cc:2468] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 1.
I20260709 12:59:04.819559  3256 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:04.824008  3256 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:04.824388  3265 leader_election.cc:290] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:04.795084  3261 raft_consensus.cc:493] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:04.825142  3259 leader_election.cc:290] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:04.791273  3266 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:04.825886  3267 leader_election.cc:290] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:04.826081  3256 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:04.793146  3281 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:04.819841  3276 raft_consensus.cc:493] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:04.826339  3266 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:04.819434  3257 raft_consensus.cc:493] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:04.829010  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:04.829530  3257 raft_consensus.cc:515] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:04.829809  2326 raft_consensus.cc:1275] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:04.830543  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:04.831460  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:04.821931  3283 raft_consensus.cc:493] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:04.831856  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:04.791289  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:04.832154  2326 raft_consensus.cc:2468] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 1.
I20260709 12:59:04.811365  3264 raft_consensus.cc:493] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:04.833585  3264 raft_consensus.cc:515] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:04.834053  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:04.834812  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:04.835377  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:04.835501  2326 raft_consensus.cc:2468] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 3.
I20260709 12:59:04.835789  3264 leader_election.cc:290] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:04.792413  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:04.837020  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:04.837206  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:04.837325  1568 raft_consensus.cc:2468] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 1.
I20260709 12:59:04.837646  3290 raft_consensus.cc:493] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:04.838414  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:04.812311  3273 raft_consensus.cc:493] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:04.839092  1572 raft_consensus.cc:2468] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 2.
I20260709 12:59:04.839671  3273 raft_consensus.cc:515] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:04.839867  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:04.839993  1574 raft_consensus.cc:2468] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 2.
I20260709 12:59:04.793146  3253 raft_consensus.cc:493] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:04.838757  3281 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:04.841267  3253 raft_consensus.cc:515] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:04.843413  3281 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:04.843556  3269 raft_consensus.cc:493] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:04.844348  3260 leader_election.cc:290] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:04.816072  3254 raft_consensus.cc:493] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:04.845278  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:04.845896  3254 raft_consensus.cc:515] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:04.846444  3273 leader_election.cc:290] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:04.820014  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:04.847196  1567 raft_consensus.cc:2468] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 3.
I20260709 12:59:04.848333  3254 leader_election.cc:290] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:04.848450  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:04.848668  3278 raft_consensus.cc:493] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:04.836426  3264 raft_consensus.cc:493] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:04.849285  3278 raft_consensus.cc:515] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:04.851091  3258 leader_election.cc:290] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:04.849610  3264 raft_consensus.cc:515] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:04.832170  3257 leader_election.cc:290] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:04.853384  3264 leader_election.cc:290] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:04.854223  3274 raft_consensus.cc:493] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:04.854661  3266 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:04.855053  3274 raft_consensus.cc:515] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:04.791488  3255 raft_consensus.cc:493] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:04.784485  3262 raft_consensus.cc:493] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:04.788172  3275 leader_election.cc:290] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:04.855357  3287 raft_consensus.cc:493] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:04.858685  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:04.776645  3286 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:04.858785  3278 leader_election.cc:290] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:04.859721  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:04.774447  3279 raft_consensus.cc:515] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:04.783918  3272 raft_consensus.cc:515] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:04.857210  3253 leader_election.cc:290] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:04.788628  3280 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:04.825431  3261 raft_consensus.cc:515] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:04.781935  3285 raft_consensus.cc:515] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:04.790405  3271 raft_consensus.cc:515] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:04.776599  3284 raft_consensus.cc:515] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:04.838132  3290 raft_consensus.cc:515] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:04.860515  3274 leader_election.cc:290] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:04.966970  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:04.862529  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:04.861168  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:04.969002  1651 raft_consensus.cc:2468] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 2.
I20260709 12:59:04.849179  2328 raft_consensus.cc:2468] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 2.
I20260709 12:59:04.972718  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:04.972319  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:04.973629  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:04.844177  3269 raft_consensus.cc:515] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:04.832271  3283 raft_consensus.cc:515] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:04.828711  3276 raft_consensus.cc:515] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:04.975983  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:04.860721  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:05.021520  3289 raft_consensus.cc:493] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:05.022190  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:04.976495  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:05.038337  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:05.023015  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:05.020153  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:05.040783  1575 raft_consensus.cc:2468] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 2.
I20260709 12:59:05.028334  1571 raft_consensus.cc:2468] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 1.
I20260709 12:59:05.038352  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:05.044591  3284 leader_election.cc:290] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:05.019500  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:04.942489  3288 raft_consensus.cc:493] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:05.053360  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:04.884460  3264 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:04.902930  3260 raft_consensus.cc:493] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:04.968683  3258 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:05.057209  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:05.058194  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:05.060112  1567 raft_consensus.cc:2468] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 1.
I20260709 12:59:05.060101  1568 raft_consensus.cc:2468] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 2.
I20260709 12:59:05.062523  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:05.062872   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:05.061975  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:05.063747  2324 raft_consensus.cc:2468] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 2.
I20260709 12:59:05.022166  3275 raft_consensus.cc:493] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:04.977033  3262 raft_consensus.cc:515] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:05.030524  3255 raft_consensus.cc:515] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:05.039422  3289 raft_consensus.cc:515] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:05.030939  3287 raft_consensus.cc:515] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:05.065352  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:05.236774  3294 raft_consensus.cc:493] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:05.237195  1569 raft_consensus.cc:2468] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 2.
I20260709 12:59:05.237629  3294 raft_consensus.cc:515] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:05.238406  3283 leader_election.cc:290] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:05.238936  3289 leader_election.cc:290] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:05.239317  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:05.183320  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:05.240602  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:05.240856  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:05.241220  1646 raft_consensus.cc:2468] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 3.
I20260709 12:59:05.241780  3279 leader_election.cc:290] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:05.105741  3258 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:05.088147  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:05.107327  3272 leader_election.cc:290] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:05.182792  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:05.245472  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:05.246269  1645 raft_consensus.cc:2468] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 1.
I20260709 12:59:05.161614  3266 raft_consensus.cc:493] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:05.180444  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:05.178700  3276 leader_election.cc:290] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:05.247843  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:05.248306  1648 raft_consensus.cc:2468] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 1.
I20260709 12:59:05.062387  3260 raft_consensus.cc:515] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:05.177057  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:05.178360  3271 leader_election.cc:290] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:05.251048  3260 leader_election.cc:290] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:05.251252  2332 raft_consensus.cc:2468] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 1.
I20260709 12:59:05.251314  3262 leader_election.cc:290] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:05.252787  3287 leader_election.cc:290] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:05.105223  3275 raft_consensus.cc:515] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:05.113194  3288 raft_consensus.cc:515] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:05.254002  3290 leader_election.cc:290] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:05.254281  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:05.235460  3269 leader_election.cc:290] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:05.255185  3275 leader_election.cc:290] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:05.173000  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:05.060225  3261 leader_election.cc:290] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:05.106462  3282 raft_consensus.cc:493] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:05.257133  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:05.257702  3282 raft_consensus.cc:515] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:05.130633  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:05.258756  2329 raft_consensus.cc:2468] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 1.
I20260709 12:59:05.064656  3264 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:05.177150  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:05.261348  3264 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:05.238981  3283 raft_consensus.cc:493] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:05.262368  3283 raft_consensus.cc:515] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:05.262655  3266 raft_consensus.cc:515] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:05.265245  3266 leader_election.cc:290] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:05.266875  3255 leader_election.cc:290] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:05.271510  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:05.272564  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:05.180958  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:05.277724  2323 raft_consensus.cc:2468] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 2.
I20260709 12:59:05.277858  3258 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:59:05.278352  2353 debug-util.cc:398] Leaking SignalData structure 0x7b08003310a0 after lost signal to thread 434
I20260709 12:59:05.278398  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:59:05.279501  2353 debug-util.cc:398] Leaking SignalData structure 0x7b0800349be0 after lost signal to thread 1508
I20260709 12:59:05.279552  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:05.280176  1650 raft_consensus.cc:2468] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 1.
I20260709 12:59:05.106261  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 12:59:05.280982  2353 debug-util.cc:398] Leaking SignalData structure 0x7b0800300ac0 after lost signal to thread 1600
I20260709 12:59:05.106071  3292 raft_consensus.cc:493] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
W20260709 12:59:05.282066  2353 debug-util.cc:398] Leaking SignalData structure 0x7b0800300260 after lost signal to thread 1675
I20260709 12:59:05.282035  3292 raft_consensus.cc:515] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:05.283233  2353 debug-util.cc:398] Leaking SignalData structure 0x7b0800316960 after lost signal to thread 1749
W20260709 12:59:05.284366  2353 debug-util.cc:398] Leaking SignalData structure 0x7b080037ab20 after lost signal to thread 2356
I20260709 12:59:05.084926  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:05.247334  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:05.088291  3273 raft_consensus.cc:493] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:05.289937  3273 raft_consensus.cc:515] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:05.292025  3273 leader_election.cc:290] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:05.106659  3253 raft_consensus.cc:493] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:05.292855  3253 raft_consensus.cc:515] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:05.295205  3253 leader_election.cc:290] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:05.295960  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:05.296120  3260 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:05.301635  3260 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:05.297508  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:05.297714  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:05.303378  3286 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:05.298322  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:05.303951  1719 raft_consensus.cc:2468] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 1.
I20260709 12:59:05.298933  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:05.296829  3295 raft_consensus.cc:493] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:05.299059  3269 raft_consensus.cc:493] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:05.299319  3264 raft_consensus.cc:493] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:05.327243  1718 raft_consensus.cc:2468] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 1.
I20260709 12:59:05.300645  3294 leader_election.cc:290] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:05.301891  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:05.298259  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:05.304167  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:05.106294  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:05.149602  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:05.343938  1644 raft_consensus.cc:2468] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 1.
I20260709 12:59:05.296658  3275 raft_consensus.cc:493] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:05.345340  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:05.345745  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:05.255470  3288 leader_election.cc:290] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:05.308342  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:05.346504  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:05.312644  3282 leader_election.cc:290] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:05.106482  3265 raft_consensus.cc:493] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:05.106364  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:05.349334  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:05.284441  3292 leader_election.cc:290] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:05.264335  3283 leader_election.cc:290] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:05.241490  1649 raft_consensus.cc:2468] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 1.
I20260709 12:59:05.248793  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:05.106468  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:05.341516  1615 leader_election.cc:304] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:05.355355  1642 raft_consensus.cc:2468] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 1.
I20260709 12:59:05.300282  1569 raft_consensus.cc:1275] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:05.356988  3257 raft_consensus.cc:2804] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:05.357339  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:05.357975  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:05.358623  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:05.359726  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:05.360960  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:05.347440  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:05.348701  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:05.350692  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:05.350417  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:05.366112  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:05.347544  3275 raft_consensus.cc:515] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:05.366737  1650 raft_consensus.cc:2468] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 3.
I20260709 12:59:05.368382  3275 leader_election.cc:290] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:05.369135  1720 raft_consensus.cc:1275] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:05.341120  3295 raft_consensus.cc:515] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:05.346616  3264 raft_consensus.cc:515] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:05.363835  1724 raft_consensus.cc:2468] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 1.
I20260709 12:59:05.352722  3260 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:05.375211  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:05.376344  3264 leader_election.cc:290] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:05.357375  3257 raft_consensus.cc:493] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:05.376974  3257 raft_consensus.cc:3060] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:05.351058  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:05.347103  3269 raft_consensus.cc:515] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:05.378818  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:05.379889  3269 leader_election.cc:290] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:05.380807  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:05.381806  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:05.374454  3295 leader_election.cc:290] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:05.381892  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:05.383234  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:05.383903  3280 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:05.384547  3265 raft_consensus.cc:515] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:05.385923  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:05.386591  3265 leader_election.cc:290] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:05.373313  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:05.380228  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:05.391762  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:05.394639  2295 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:05.395752  2295 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:05.395897  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:05.397353  3287 raft_consensus.cc:2804] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:05.397850  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:05.398347  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:05.399016  2295 leader_election.cc:304] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:05.389514  1567 raft_consensus.cc:2468] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 1.
I20260709 12:59:05.389653  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:05.400158  1576 raft_consensus.cc:1275] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:05.400830  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:05.401468  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:05.398051  3278 raft_consensus.cc:2804] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:05.403968  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:05.392086  3285 leader_election.cc:290] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:05.404194  3274 raft_consensus.cc:2804] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:05.404623  1642 raft_consensus.cc:2468] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 2.
I20260709 12:59:05.397864  3287 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:05.404989  3274 raft_consensus.cc:493] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:05.404156  3278 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:05.405553  3274 raft_consensus.cc:3060] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:05.405821  3278 raft_consensus.cc:3060] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:05.405373  3287 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:05.410983  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:05.410293  1573 consensus_queue.cc:237] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:59:05.416043  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:05.416882  1724 raft_consensus.cc:2468] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 2.
I20260709 12:59:05.417035  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:05.419085  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:05.419848  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:05.419801  1642 raft_consensus.cc:2468] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 2.
I20260709 12:59:05.421227  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:05.421887  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:05.422120  1718 raft_consensus.cc:1275] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:05.421624  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:05.423149  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:05.423410  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:05.423851  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:05.424811  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:05.424424  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:05.425302  1718 raft_consensus.cc:2468] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 2.
I20260709 12:59:05.426241  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:05.426035  1720 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 3.
W20260709 12:59:05.428901  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 73256.3us
I20260709 12:59:05.429504  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:05.430670  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:05.431800  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:05.430611  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:05.433009  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:05.433911  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:05.434098  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:05.434185  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:05.434502  1650 raft_consensus.cc:2468] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 2.
I20260709 12:59:05.434655  1642 raft_consensus.cc:2468] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 1.
I20260709 12:59:05.435472  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:05.435552  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:05.435897  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:05.432590  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:05.438061  1646 raft_consensus.cc:2468] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 2.
I20260709 12:59:05.441672  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:05.442517  1647 raft_consensus.cc:2468] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 1.
I20260709 12:59:05.430328  1540 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:05.435565  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:05.443800  1540 leader_election.cc:304] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:05.444514  3265 raft_consensus.cc:2804] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:05.445417  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:05.432614  3285 consensus_queue.cc:1048] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:59:05.451164  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:05.457407  1642 raft_consensus.cc:2468] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 3.
I20260709 12:59:05.453039  3282 raft_consensus.cc:2804] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:05.458205  3282 raft_consensus.cc:493] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:05.454348  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:05.451475  3265 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:05.455514  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:59:05.452559  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 49680.8us
I20260709 12:59:05.459723  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:05.452576  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:05.459744  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:05.462978  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:05.464661  2294 leader_election.cc:304] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:05.465826  1721 raft_consensus.cc:2468] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 3.
I20260709 12:59:05.458755  3282 raft_consensus.cc:3060] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:05.464114  1722 raft_consensus.cc:2468] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 1.
I20260709 12:59:05.467172  1718 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 3.
I20260709 12:59:05.468668  1540 leader_election.cc:304] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:05.469920  3266 raft_consensus.cc:2804] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:05.470469  3266 raft_consensus.cc:493] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:05.470992  3266 raft_consensus.cc:3060] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:05.465431  3265 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:05.481896  1540 leader_election.cc:304] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:05.484241  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:05.484463  1688 leader_election.cc:304] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:05.484792  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:05.485569  1688 leader_election.cc:304] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:05.486299  3291 raft_consensus.cc:2804] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:05.486699  3291 raft_consensus.cc:493] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:05.487076  3291 raft_consensus.cc:3060] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:05.487365  3266 raft_consensus.cc:515] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:05.488605  3285 raft_consensus.cc:2804] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:05.489018  3285 raft_consensus.cc:493] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:05.492089  3295 raft_consensus.cc:2804] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:05.492560  3295 raft_consensus.cc:493] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:05.492913  3295 raft_consensus.cc:3060] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:05.495080  3257 raft_consensus.cc:515] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:05.495884  2297 leader_election.cc:304] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 12:59:05.489408  3285 raft_consensus.cc:3060] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:05.496930  2297 leader_election.cc:304] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:05.499153  3257 leader_election.cc:290] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:05.499619  2297 leader_election.cc:304] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 12:59:05.502061  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:05.502678  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:05.503275  1720 raft_consensus.cc:2468] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 2.
I20260709 12:59:05.504135  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:05.505153  1688 leader_election.cc:304] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:05.505213  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:05.506028  3269 raft_consensus.cc:2804] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:05.506453  3269 raft_consensus.cc:493] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:05.506827  3269 raft_consensus.cc:3060] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:05.507184  3266 leader_election.cc:290] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:05.506048  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:05.508456  1718 raft_consensus.cc:2468] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 2.
I20260709 12:59:05.513507  3287 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:05.514791  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:05.515390  1718 raft_consensus.cc:2468] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 3.
I20260709 12:59:05.517334  1688 leader_election.cc:304] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:05.495468  3274 raft_consensus.cc:515] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:05.519672  3274 leader_election.cc:290] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:05.520239  3280 raft_consensus.cc:2804] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:05.521677  3278 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:05.523783  3278 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:05.523999  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:05.524288  3278 raft_consensus.cc:2804] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:05.524637  1720 raft_consensus.cc:2468] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 2.
I20260709 12:59:05.525280  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:05.525821  1717 raft_consensus.cc:1275] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:05.527935  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:05.524957  3278 raft_consensus.cc:493] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:05.525997  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:05.524497  3291 raft_consensus.cc:515] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:05.527578  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:05.527480  3295 raft_consensus.cc:515] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:05.531834  3295 leader_election.cc:290] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:05.524835  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:05.531899  3291 leader_election.cc:290] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:05.525597  3300 raft_consensus.cc:2804] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:05.524947  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:05.532696  3300 raft_consensus.cc:493] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:05.533154  3300 raft_consensus.cc:3060] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:05.525869  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:05.521085  1688 leader_election.cc:304] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:05.535478  1688 leader_election.cc:304] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:05.521657  3280 raft_consensus.cc:493] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:05.537711  1688 leader_election.cc:304] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:05.538460  3264 raft_consensus.cc:2804] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:05.538856  3264 raft_consensus.cc:493] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:05.537756  1615 leader_election.cc:304] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:05.539280  3264 raft_consensus.cc:3060] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:05.538923  3285 raft_consensus.cc:515] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:05.539712  3257 raft_consensus.cc:2804] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:05.540072  3257 raft_consensus.cc:493] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:05.540462  3257 raft_consensus.cc:3060] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:05.541568  1615 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:59:05.541245  3295 raft_consensus.cc:2804] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:05.542985  3295 raft_consensus.cc:493] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:05.541450  3280 raft_consensus.cc:3060] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:05.544178  3287 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:05.543341  3296 raft_consensus.cc:2804] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:59:05.542411  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 77822.4us
I20260709 12:59:05.541522  3274 raft_consensus.cc:2804] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:05.545846  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:05.557231  3274 raft_consensus.cc:493] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:05.546101  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:05.557680  3274 raft_consensus.cc:3060] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:05.546875  1615 leader_election.cc:304] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 12:59:05.547384  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 47829.3us
I20260709 12:59:05.547125  3282 raft_consensus.cc:515] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:05.536190  3278 raft_consensus.cc:3060] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:05.516215  3269 raft_consensus.cc:515] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:05.549928  3296 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:05.563457  3296 raft_consensus.cc:3060] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:05.526439  3265 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:05.552223  3257 raft_consensus.cc:515] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:05.553928  3285 leader_election.cc:290] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:05.554314  3300 raft_consensus.cc:515] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:05.581017  3261 consensus_queue.cc:1048] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:05.543385  3295 raft_consensus.cc:3060] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:05.556761  3291 raft_consensus.cc:2804] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:05.558934  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:05.583865  3291 raft_consensus.cc:493] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:05.560156  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:05.561695  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:05.584358  3291 raft_consensus.cc:3060] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:05.560299  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:05.559983  1719 raft_consensus.cc:1275] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:05.560379  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:05.562889  3276 raft_consensus.cc:2749] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:59:05.565402  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 100068us
I20260709 12:59:05.586745  2295 leader_election.cc:304] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:05.587970  2295 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:05.566146  3282 leader_election.cc:290] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:05.571601  3265 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:05.574594  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:05.589901  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:05.579291  3257 leader_election.cc:290] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:05.587711  3296 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:05.558620  1688 leader_election.cc:304] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:05.591727  3260 raft_consensus.cc:2804] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:05.592239  3260 raft_consensus.cc:493] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:05.592790  3260 raft_consensus.cc:3060] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:05.595192  1688 leader_election.cc:304] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:05.596799  3275 raft_consensus.cc:2804] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:05.597177  3275 raft_consensus.cc:493] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:05.597545  3275 raft_consensus.cc:3060] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:05.598111  1688 leader_election.cc:304] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:05.599186  3292 raft_consensus.cc:2804] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:05.599665  3292 raft_consensus.cc:493] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:05.600107  3292 raft_consensus.cc:3060] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:05.608505  3275 raft_consensus.cc:515] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:05.608989  1688 leader_election.cc:304] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:05.610312  3283 raft_consensus.cc:2804] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:05.612839  1615 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:05.614079  1615 leader_election.cc:304] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:05.614828  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:05.610711  1688 leader_election.cc:304] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
W20260709 12:59:05.623762  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 62714.7us
I20260709 12:59:05.561347  3301 raft_consensus.cc:2804] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:05.568040  3264 raft_consensus.cc:515] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:05.624702  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:05.627347   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:05.625782  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:05.632324  2294 leader_election.cc:304] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:05.578088  3287 consensus_queue.cc:1048] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:59:05.614770  3283 raft_consensus.cc:493] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:05.621551  3261 raft_consensus.cc:2749] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:59:05.655040  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 67118.2us
I20260709 12:59:05.638288  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:05.624464  3257 raft_consensus.cc:2749] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:05.634485  3301 raft_consensus.cc:493] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:05.639398  3288 raft_consensus.cc:2804] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:05.640833  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:05.641224  3299 raft_consensus.cc:2804] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:05.641774  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:05.641873  3275 leader_election.cc:290] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:05.642979  3292 raft_consensus.cc:515] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:05.645076  3302 raft_consensus.cc:2804] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:05.666791  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:05.666898  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:05.666932  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:05.666914  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:05.646392  3300 leader_election.cc:290] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:05.646766  3283 raft_consensus.cc:3060] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:05.647770  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:05.669922  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:05.649799  3297 raft_consensus.cc:2804] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:05.650235  1651 raft_consensus.cc:1240] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:05.650972  3291 raft_consensus.cc:515] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:05.656389  2295 leader_election.cc:304] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:05.656751  1642 raft_consensus.cc:3060] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:05.662233  1643 raft_consensus.cc:3060] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:05.658341  3288 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:05.664136  3264 leader_election.cc:290] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:05.664779  3292 leader_election.cc:290] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:05.664880  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:05.689524  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:05.665421  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:05.689932  2295 leader_election.cc:304] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:05.666170  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:05.666290  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:05.667822  1647 raft_consensus.cc:3060] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:05.667062  3302 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:05.670250  1646 raft_consensus.cc:3060] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:05.670553  1648 raft_consensus.cc:3060] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:05.671029  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 93604.3us
I20260709 12:59:05.658216  3301 raft_consensus.cc:3060] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:05.674055  3296 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:05.665606  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:05.661935  3299 raft_consensus.cc:493] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:05.677551  3294 consensus_queue.cc:1059] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:05.694476  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:59:05.696125  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 63868.3us
I20260709 12:59:05.706200  2294 leader_election.cc:304] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:05.706359  3303 consensus_queue.cc:1048] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 12:59:05.690442  3269 leader_election.cc:290] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:05.708588  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:05.708612  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:05.671655  3297 raft_consensus.cc:493] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:05.712301  2297 leader_election.cc:304] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:05.697340  3300 raft_consensus.cc:2804] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:05.692366  3288 raft_consensus.cc:3060] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:05.714181  2297 leader_election.cc:304] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:05.712383  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:05.698833  3304 raft_consensus.cc:2804] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:05.699328  3302 raft_consensus.cc:3060] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:05.709625  3299 raft_consensus.cc:3060] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:05.671805  3260 raft_consensus.cc:515] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:05.721544  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:05.723270  3269 raft_consensus.cc:3055] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:05.723634  3304 raft_consensus.cc:493] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:05.732076  1647 raft_consensus.cc:2468] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 3.
I20260709 12:59:05.732417  2294 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:05.714570  3297 raft_consensus.cc:3060] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:05.737748  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:05.743918  1648 raft_consensus.cc:2468] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 3.
I20260709 12:59:05.744781  1651 raft_consensus.cc:3060] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:05.744737  1688 leader_election.cc:304] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:05.741997  1643 raft_consensus.cc:2468] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 4.
I20260709 12:59:05.754163  1688 leader_election.cc:304] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:05.715451  3300 raft_consensus.cc:493] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:05.737676  3303 raft_consensus.cc:2804] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:05.761837  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:05.762425  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:05.765255  1572 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc"
dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
mode: GRACEFUL
new_leader_uuid: "4dbe7d47a2374afca075d3a98583b49e"
 from {username='slave'} at 127.0.0.1:60346
I20260709 12:59:05.763104  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:05.767810  1572 raft_consensus.cc:606] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 LEADER]: Received request to transfer leadership to TS 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:05.763379  1688 leader_election.cc:304] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:05.744455  3304 raft_consensus.cc:3060] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:05.770709  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:05.772101  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:05.772639  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:05.773607  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:05.773886  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:05.743155  3269 raft_consensus.cc:740] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:05.775153  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:05.775511  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:05.780834  1575 raft_consensus.cc:2468] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 2.
I20260709 12:59:05.776368  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:05.776422  3294 raft_consensus.cc:2804] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:05.759095  3286 raft_consensus.cc:2804] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:05.777213  1567 raft_consensus.cc:1240] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:05.783646  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:05.785645  1642 raft_consensus.cc:2468] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 2.
I20260709 12:59:05.786831  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:05.788394  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:05.789600  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:05.794988  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:05.799144  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:05.799297  1688 leader_election.cc:304] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:05.749724  3307 raft_consensus.cc:2804] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:05.768921  3300 raft_consensus.cc:3060] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:05.770143  3275 raft_consensus.cc:2804] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:05.765460  3303 raft_consensus.cc:493] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:05.798942  1617 leader_election.cc:304] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:05.803086  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 12:59:05.803295  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 189272us
I20260709 12:59:05.804399  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:05.807170  1646 raft_consensus.cc:2468] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 2.
I20260709 12:59:05.751068  3280 raft_consensus.cc:515] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:05.809788  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:05.810067  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:05.796115  3287 raft_consensus.cc:2749] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:05.817798  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:05.824723  1651 raft_consensus.cc:2468] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 2.
I20260709 12:59:05.808733  3307 raft_consensus.cc:493] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:05.808259  3303 raft_consensus.cc:3060] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:05.830509  1542 leader_election.cc:304] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
W20260709 12:59:05.834481  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 120366us
I20260709 12:59:05.835284  2297 leader_election.cc:304] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:05.836228  2297 leader_election.cc:304] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 12:59:05.838901  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:05.817607  3261 raft_consensus.cc:2749] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:05.803617  3295 raft_consensus.cc:515] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:05.856720  1542 leader_election.cc:304] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:59:05.858003  1651 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0"
dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
mode: GRACEFUL
new_leader_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:35470
I20260709 12:59:05.858618  1651 raft_consensus.cc:606] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 3 LEADER]: Received request to transfer leadership to TS 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:05.873104  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 12:59:05.875207  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 142960us
I20260709 12:59:05.879606  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:05.884716  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:05.884131  3286 raft_consensus.cc:697] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 3 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:05.888175  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:05.889225  3286 consensus_queue.cc:237] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:05.889575  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 72476.3us
I20260709 12:59:05.840626  3307 raft_consensus.cc:3060] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:05.893033  1617 leader_election.cc:304] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:05.849092  3273 raft_consensus.cc:2749] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:05.899384  3261 raft_consensus.cc:2749] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:05.899814  1617 leader_election.cc:304] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:05.859242  3291 leader_election.cc:290] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:05.897029  3306 raft_consensus.cc:2749] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:05.906597  1617 leader_election.cc:304] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
W20260709 12:59:05.906948  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 50336.6us
I20260709 12:59:05.908938  1617 leader_election.cc:304] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:05.908697  1542 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:05.910621  1617 leader_election.cc:304] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:05.912209  3305 raft_consensus.cc:2804] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:05.834033  3269 consensus_queue.cc:260] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:05.857868  3278 raft_consensus.cc:515] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:05.873986  3253 consensus_queue.cc:1048] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:59:05.898994  3275 raft_consensus.cc:697] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 3 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:05.903517  3261 raft_consensus.cc:2749] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:05.913928  1542 leader_election.cc:304] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 12:59:05.914052  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 71531.3us
I20260709 12:59:05.913874  1617 leader_election.cc:304] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:05.904808  3310 raft_consensus.cc:2804] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:05.916813  3311 raft_consensus.cc:2749] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:05.912654  3305 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:05.911262  3257 raft_consensus.cc:2749] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:05.912925  3276 raft_consensus.cc:2749] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:05.912947  3265 raft_consensus.cc:2804] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:05.934754  1617 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:05.909376  3274 raft_consensus.cc:515] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:05.935423  3305 raft_consensus.cc:3060] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:05.935843  3311 raft_consensus.cc:2749] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:05.933023  1542 leader_election.cc:304] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:05.913564  3291 raft_consensus.cc:2804] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:05.916343  3260 leader_election.cc:290] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:05.926371  3273 raft_consensus.cc:2804] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:05.946846  1542 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:05.926002  3310 raft_consensus.cc:493] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:05.949678  1542 leader_election.cc:304] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:05.939771  3269 raft_consensus.cc:3060] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:05.946431  1617 leader_election.cc:304] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:05.938097  3265 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:05.953505  3266 raft_consensus.cc:2749] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:05.953351  1542 leader_election.cc:304] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:05.958250  3295 leader_election.cc:290] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:05.958827  3278 leader_election.cc:290] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:05.941090  3314 consensus_queue.cc:1048] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:59:05.942113  3296 raft_consensus.cc:2749] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:05.948664  3273 raft_consensus.cc:493] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:05.940411  3294 raft_consensus.cc:697] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 4 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:05.960813  3265 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:05.961688  3291 raft_consensus.cc:697] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 2 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:05.971786  1617 leader_election.cc:304] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 12:59:05.983583  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 184330us
I20260709 12:59:05.961572  3253 raft_consensus.cc:2804] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:05.988011  3253 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:05.988466  3253 raft_consensus.cc:3060] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:05.988392  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:05.952500  3285 raft_consensus.cc:2804] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:05.949429  3319 raft_consensus.cc:2749] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:05.980795  1689 leader_election.cc:304] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:05.975454  3307 raft_consensus.cc:515] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:05.969339  3273 raft_consensus.cc:3060] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:06.007746  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:06.008545  1648 raft_consensus.cc:3060] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:05.985085  1617 leader_election.cc:304] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:05.987243  1646 raft_consensus.cc:1240] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:05.989322  1651 raft_consensus.cc:3060] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:06.011013  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:05.991142  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:05.961462  1542 leader_election.cc:304] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:06.012813  2294 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:06.014077  1617 leader_election.cc:304] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:06.016292  1617 leader_election.cc:304] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:05.997033  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:06.017920  1647 raft_consensus.cc:3060] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:05.960988  3280 leader_election.cc:290] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:06.001263  1688 leader_election.cc:304] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:06.005235  1689 leader_election.cc:304] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:05.952185  3310 raft_consensus.cc:3060] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:05.979386  3257 raft_consensus.cc:2749] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:06.029906  1617 leader_election.cc:304] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
W20260709 12:59:06.030057  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 68681.9us
I20260709 12:59:06.021415  1689 leader_election.cc:304] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 12:59:06.034749  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 217441us
I20260709 12:59:06.032565  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:06.001073  3311 raft_consensus.cc:2749] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:06.037539  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:06.000088  3285 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:06.043213  1650 raft_consensus.cc:1240] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:06.039431  1647 raft_consensus.cc:2468] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 2.
I20260709 12:59:06.044651  2325 raft_consensus.cc:1240] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:59:06.036679  2294 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:06.021968  3264 raft_consensus.cc:2804] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:06.045972  3264 raft_consensus.cc:493] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:06.046115  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:06.046417  3264 raft_consensus.cc:3060] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:06.047050  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:06.037770  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:06.049573  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:06.047066  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
W20260709 12:59:06.050513  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 49364.2us
I20260709 12:59:06.051180  1688 leader_election.cc:304] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:06.036765  1615 leader_election.cc:304] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:06.052047  1689 leader_election.cc:304] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:06.052356  1615 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:06.029075  3261 raft_consensus.cc:2749] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:06.055006  2297 leader_election.cc:304] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:06.037478  3314 raft_consensus.cc:2749] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:06.035517  3258 raft_consensus.cc:2749] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:06.078298  3323 raft_consensus.cc:2749] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:06.069698  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:06.072269  3299 raft_consensus.cc:515] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:06.083606  1650 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d"
dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
mode: GRACEFUL
new_leader_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:35470
I20260709 12:59:06.084321  1642 raft_consensus.cc:3060] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:06.048202  3274 leader_election.cc:290] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:59:06.092268  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:06.094013  1650 raft_consensus.cc:606] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 3 LEADER]: Received request to transfer leadership to TS 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:06.048959  3285 raft_consensus.cc:3060] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:06.037077  3312 raft_consensus.cc:2749] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:06.103739  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:06.053874  3257 raft_consensus.cc:2749] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:59:06.104169  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 49212.6us
W20260709 12:59:06.109161  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 56851.8us
W20260709 12:59:06.105654  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 69045.4us
I20260709 12:59:06.095234  3296 raft_consensus.cc:2749] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:06.071384  3295 raft_consensus.cc:2804] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:06.109979  1615 leader_election.cc:304] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:06.110616  2294 leader_election.cc:304] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:06.000000  3275 consensus_queue.cc:237] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:06.085166  3286 raft_consensus.cc:2804] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:06.112990  1651 raft_consensus.cc:2468] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 3.
I20260709 12:59:06.036332  3321 raft_consensus.cc:2804] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:59:06.115222  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 81880.4us
I20260709 12:59:06.086864  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:06.117103  3322 raft_consensus.cc:2749] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:06.117180  3325 raft_consensus.cc:2749] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:06.125344  1642 raft_consensus.cc:2468] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 3.
I20260709 12:59:06.093855  3323 raft_consensus.cc:2749] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:06.073173  3282 raft_consensus.cc:2804] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:06.102908  3284 raft_consensus.cc:2749] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:06.134368  1648 raft_consensus.cc:2468] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 4.
I20260709 12:59:06.135103  1542 leader_election.cc:304] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:06.136498  1542 leader_election.cc:304] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:06.170325  1542 leader_election.cc:304] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:06.172971  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:06.119479  3276 raft_consensus.cc:2749] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:06.124310  3278 raft_consensus.cc:2749] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:06.183344  1542 leader_election.cc:304] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
W20260709 12:59:06.138902  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 86937.9us
I20260709 12:59:06.119256  3314 raft_consensus.cc:2749] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:06.123759  3295 raft_consensus.cc:697] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 2 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:06.190297  1542 leader_election.cc:304] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:06.193367   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:59:06.099711  3291 consensus_queue.cc:237] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:06.119997  3321 raft_consensus.cc:493] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:06.087785  3294 consensus_queue.cc:237] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:06.196353   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 12:59:06.190900  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 71091.9us
I20260709 12:59:06.172390  3266 raft_consensus.cc:2804] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:06.136044  3286 raft_consensus.cc:697] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 2 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:06.177805  3258 raft_consensus.cc:2804] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:06.177232  3255 raft_consensus.cc:2804] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:06.134872  3297 raft_consensus.cc:515] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:06.212666  1650 raft_consensus.cc:1240] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:06.210744  3288 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:06.217173  1651 raft_consensus.cc:1240] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:06.204645  3321 raft_consensus.cc:3060] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:06.207285  3258 raft_consensus.cc:493] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:06.208184  3266 raft_consensus.cc:493] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:06.209091  3319 raft_consensus.cc:2749] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:06.222225  1688 leader_election.cc:304] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:06.224815  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:59:06.225064  3320 log.cc:927] Time spent T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260709 12:59:06.210848  3255 raft_consensus.cc:493] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:06.226779  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:06.236017  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:06.236413  1724 raft_consensus.cc:3060] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:06.236593  1646 raft_consensus.cc:1240] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:06.228816  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:06.230520  1688 leader_election.cc:304] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:06.231634  2327 raft_consensus.cc:1240] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:06.231694  3295 consensus_queue.cc:237] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:06.232479  3307 leader_election.cc:290] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:06.234001  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:06.219422  3288 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:06.248409  1688 leader_election.cc:304] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:06.216872  3316 consensus_queue.cc:1059] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.130s
I20260709 12:59:06.223191  3258 raft_consensus.cc:3060] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:06.252233  3286 consensus_queue.cc:237] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:06.252278  3299 leader_election.cc:290] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:06.225492  3266 raft_consensus.cc:3060] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:06.255610  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 12:59:06.260394  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 230547us
I20260709 12:59:06.246542  3255 raft_consensus.cc:3060] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:06.264590  1617 leader_election.cc:304] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:06.255934  3292 raft_consensus.cc:2804] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:59:06.266399  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 59197.9us
I20260709 12:59:06.268355  1617 leader_election.cc:304] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:06.268620  3327 raft_consensus.cc:2749] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:06.227371  3253 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:06.270869  1617 leader_election.cc:304] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 12:59:06.312182  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 193102us
I20260709 12:59:06.313298  1617 leader_election.cc:304] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:06.313841  2294 leader_election.cc:304] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:06.314698  1617 leader_election.cc:304] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:06.316150  1617 leader_election.cc:304] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:06.318463  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:06.325686  3311 raft_consensus.cc:2749] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:06.327428  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 12:59:06.335173  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 65271.4us
I20260709 12:59:06.336220  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:06.338157  1689 leader_election.cc:304] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:06.347568  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:06.343662  2328 raft_consensus.cc:1240] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:06.343350  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:06.350368  1689 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:06.325760  3314 raft_consensus.cc:2749] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:06.329038  3261 raft_consensus.cc:2749] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:06.345857  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:06.342985  2326 raft_consensus.cc:1240] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:06.360178  3328 raft_consensus.cc:2749] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:06.361251  3316 raft_consensus.cc:2804] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:06.361755  3317 raft_consensus.cc:2749] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:06.350072  3292 raft_consensus.cc:697] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 3 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:06.365187  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:06.321300  3337 raft_consensus.cc:2749] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:06.368800  2324 raft_consensus.cc:1240] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:06.390234  3333 raft_consensus.cc:2749] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:06.331984  3307 consensus_queue.cc:1059] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:59:06.393031  3255 raft_consensus.cc:515] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:06.394827  3253 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:59:06.385635  3283 consensus_meta.cc:287] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.716s	user 0.006s	sys 0.006s
I20260709 12:59:06.396608  3315 raft_consensus.cc:2804] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:06.364400  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:06.406752  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:06.362206  3338 raft_consensus.cc:2749] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:06.410908  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:59:06.387388  3302 consensus_meta.cc:287] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.643s	user 0.009s	sys 0.003s
I20260709 12:59:06.413282  1724 raft_consensus.cc:2468] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 3.
I20260709 12:59:06.388464  3316 raft_consensus.cc:493] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:06.417433  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:06.417414  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:06.418324  3282 raft_consensus.cc:493] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:06.331208  3331 consensus_queue.cc:1048] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.214s
I20260709 12:59:06.398665  3324 raft_consensus.cc:2804] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:06.426268  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:06.358269  3265 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:06.398839  3327 raft_consensus.cc:493] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:06.428805  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:06.429893  2297 leader_election.cc:304] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 12:59:06.431263  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:59:06.431353  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 241102us
I20260709 12:59:06.425915  3316 raft_consensus.cc:3060] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:06.438361  1645 raft_consensus.cc:1240] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 2. Current term is 3. Ops: []
W20260709 12:59:06.429728  3301 consensus_meta.cc:287] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.721s	user 0.011s	sys 0.000s
I20260709 12:59:06.428287  3282 raft_consensus.cc:3060] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:06.442059  3255 leader_election.cc:290] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:06.445355  1570 raft_consensus.cc:1240] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:06.414520  3283 raft_consensus.cc:515] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:06.431234  3315 raft_consensus.cc:697] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 4 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:06.426090  3302 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:06.449681  3292 consensus_queue.cc:237] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:06.452764  3302 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:06.452775  3283 leader_election.cc:290] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:06.436946  3307 raft_consensus.cc:2804] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:06.454566  1645 raft_consensus.cc:1240] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 1. Current term is 2. Ops: []
W20260709 12:59:06.457614  3304 consensus_meta.cc:287] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.659s	user 0.008s	sys 0.002s
I20260709 12:59:06.425034  3310 raft_consensus.cc:515] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:06.438598  3324 raft_consensus.cc:697] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 2 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
W20260709 12:59:06.450855  3305 consensus_meta.cc:287] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.507s	user 0.005s	sys 0.005s
W20260709 12:59:06.481020  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 130717us
I20260709 12:59:06.480697  3304 raft_consensus.cc:515] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:06.486478  1689 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:06.491645  1689 leader_election.cc:304] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:06.494207  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:06.496366  3295 consensus_queue.cc:1059] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:06.497004  1689 leader_election.cc:304] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:06.498445  3295 raft_consensus.cc:2749] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:06.499316  1689 leader_election.cc:304] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:06.449029  3301 raft_consensus.cc:515] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:06.486253  3307 raft_consensus.cc:697] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:06.504374  1645 raft_consensus.cc:1240] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:06.491472  3283 raft_consensus.cc:2749] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:06.513136  1689 leader_election.cc:304] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:06.436085  3327 raft_consensus.cc:515] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:06.503314  3346 raft_consensus.cc:2749] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:06.519874  2329 raft_consensus.cc:1240] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:06.520246  1645 raft_consensus.cc:1240] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:06.487849  3305 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:06.509003  1649 raft_consensus.cc:1240] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:06.506735  3295 raft_consensus.cc:2749] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:06.525415  3341 raft_consensus.cc:3055] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:06.519448  3269 raft_consensus.cc:2749] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:06.527282  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:06.527271  1689 leader_election.cc:304] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:06.537490  3265 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:06.540271  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:59:06.528185  3300 consensus_meta.cc:287] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.717s	user 0.007s	sys 0.004s
I20260709 12:59:06.542763  1689 leader_election.cc:304] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:06.545022  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:06.550004  1689 leader_election.cc:304] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:06.539281  3341 raft_consensus.cc:740] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:06.553027  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:06.554147  3275 raft_consensus.cc:2749] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:59:06.556908  3303 consensus_meta.cc:287] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.707s	user 0.011s	sys 0.000s
I20260709 12:59:06.534252  3264 raft_consensus.cc:515] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:06.526301  3315 consensus_queue.cc:237] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:06.559659  1720 raft_consensus.cc:1240] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:06.558763  3301 leader_election.cc:290] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:06.547807  3295 raft_consensus.cc:2749] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:06.562832  1689 leader_election.cc:304] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:06.561758  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:06.565356  1689 leader_election.cc:304] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:06.565778  3264 leader_election.cc:290] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:06.566504  3323 raft_consensus.cc:2749] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:06.566972  3264 raft_consensus.cc:2764] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:59:06.567339  1648 raft_consensus.cc:1240] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:06.567335  1689 leader_election.cc:304] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:06.568655  1689 leader_election.cc:304] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:06.543883  3266 raft_consensus.cc:515] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:06.569307  3292 raft_consensus.cc:2804] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:06.569516  3327 leader_election.cc:290] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:06.569681  3292 raft_consensus.cc:493] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:06.570116  3292 raft_consensus.cc:3060] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:06.570644  3266 leader_election.cc:290] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:06.571271  1567 raft_consensus.cc:1240] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:06.552775  3307 consensus_queue.cc:237] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:06.571718  3288 raft_consensus.cc:3055] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:06.572129  3288 raft_consensus.cc:740] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:06.580103  1689 leader_election.cc:304] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:06.567814  3258 raft_consensus.cc:515] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:06.574744  3291 raft_consensus.cc:2749] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:06.557052  3286 raft_consensus.cc:2749] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:06.542255  3324 consensus_queue.cc:237] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:06.592711  3310 leader_election.cc:290] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:06.593123  3305 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:06.585531  3292 raft_consensus.cc:515] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:06.586673  1689 leader_election.cc:304] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:06.548586  3300 raft_consensus.cc:515] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:06.589174  3304 leader_election.cc:290] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:06.591737  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:06.556351  3285 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:06.558992  3303 raft_consensus.cc:515] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:06.594511  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:06.597445  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:59:06.588438  3273 consensus_meta.cc:287] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.553s	user 0.008s	sys 0.001s
I20260709 12:59:06.600883  1689 leader_election.cc:304] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:06.601544  1575 raft_consensus.cc:1240] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:59:06.590692  3264 raft_consensus.cc:2749] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:06.581863  3341 consensus_queue.cc:260] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:06.648406  2330 raft_consensus.cc:1240] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:06.602101  3275 raft_consensus.cc:2749] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:59:06.650596  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 49823.1us
I20260709 12:59:06.604050  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:06.655562  1572 raft_consensus.cc:1240] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:06.655445  1689 leader_election.cc:304] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:06.657044  3350 raft_consensus.cc:2749] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:06.657193  3264 raft_consensus.cc:2749] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:06.658444  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:06.658694  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:06.660091  1718 raft_consensus.cc:1240] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:06.660197  1724 raft_consensus.cc:1240] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 4 LEADER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 3. Current term is 4. Ops: []
W20260709 12:59:06.665481  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:06.654109  3283 consensus_queue.cc:1175] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "05476b84d8f84d76a9a1f51b620a3c66" responder_term: 2 status { last_received { term: 2 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 2 index: 5 } }
W20260709 12:59:06.669363  1539 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:37391 timed out after 1.517s (SENT)
I20260709 12:59:06.671288  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:06.671706  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:06.672561  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:06.672719  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:06.673285  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:06.675168  1647 raft_consensus.cc:1240] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:06.675621  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:06.676749  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:06.679029  1574 raft_consensus.cc:2393] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 3: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:06.653612  3341 raft_consensus.cc:3060] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:06.682397  1725 raft_consensus.cc:1240] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 3 LEADER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:06.685475  1719 raft_consensus.cc:1240] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:59:06.683158  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:06.687088  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:06.688234  1718 raft_consensus.cc:1240] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 3 LEADER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:06.690066  3292 leader_election.cc:290] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:06.689867  3321 raft_consensus.cc:515] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:06.691491  1717 raft_consensus.cc:1240] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 2 LEADER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:06.691519  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:06.692432  1722 raft_consensus.cc:1240] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:06.617051  3273 raft_consensus.cc:515] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:06.669608  3288 consensus_queue.cc:260] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:06.701654  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:06.702831  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:06.701697  1719 raft_consensus.cc:1240] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 2 LEADER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:06.705168  1723 raft_consensus.cc:1240] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 4 LEADER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:06.708513  1718 raft_consensus.cc:1240] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:06.709940  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:06.692929  3303 leader_election.cc:290] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:06.708920  3300 leader_election.cc:290] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:06.688654  3282 raft_consensus.cc:515] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:06.717820  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:06.730098  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:06.730453  1568 raft_consensus.cc:1240] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:06.738022  3282 leader_election.cc:290] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:06.717208  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:06.719596  3288 raft_consensus.cc:3060] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:06.742249  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:06.726843  3258 leader_election.cc:290] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:06.748581  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:06.749538  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:06.753497  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 12:59:06.749725  1540 consensus_peers.cc:597] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 -> Peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423): Couldn't send request to peer 05476b84d8f84d76a9a1f51b620a3c66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dfdb9ea6c3bf4001aeecb5c37e0d6baf. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:06.754179  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 430920us
I20260709 12:59:06.754635  3327 consensus_queue.cc:1059] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:06.755152  1540 leader_election.cc:304] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:06.755462  3327 consensus_queue.cc:1059] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:06.756250  3327 raft_consensus.cc:3055] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:06.756608  3327 raft_consensus.cc:740] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:06.756708  3255 raft_consensus.cc:2749] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:06.753466  3331 consensus_queue.cc:1059] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:59:06.757447  3327 consensus_queue.cc:260] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:06.758455  3331 consensus_queue.cc:1243] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer 0c7751452c4b46afa95251b9df7169d4 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:59:06.759073  3331 raft_consensus.cc:3055] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:06.759522  3331 raft_consensus.cc:740] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:06.759697  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:06.762427  3321 leader_election.cc:290] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:06.760929  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:06.762277  3327 raft_consensus.cc:3060] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:06.763490  3265 consensus_queue.cc:1059] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:06.764657  3265 consensus_queue.cc:1243] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer 0c7751452c4b46afa95251b9df7169d4 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:59:06.749372  3266 consensus_queue.cc:1059] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:59:06.765159  3316 raft_consensus.cc:515] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:06.765828  3266 raft_consensus.cc:3055] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:06.766260  3266 raft_consensus.cc:740] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:06.767575  3316 leader_election.cc:290] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:06.767194  3266 consensus_queue.cc:260] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:06.766434  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:06.768442  1721 raft_consensus.cc:1240] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:06.765162  3265 raft_consensus.cc:3055] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:06.768926  1725 raft_consensus.cc:3060] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:06.769857  1540 leader_election.cc:304] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:06.770990  1540 leader_election.cc:304] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:06.769166  3265 raft_consensus.cc:740] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:06.772538  3265 consensus_queue.cc:260] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:06.773783  3265 raft_consensus.cc:3060] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:06.777258  3258 raft_consensus.cc:2749] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:06.750777  3282 consensus_queue.cc:1059] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:59:06.777140  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:06.778519  3282 consensus_queue.cc:1243] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer 0c7751452c4b46afa95251b9df7169d4 log is divergent from this leader: its last log entry 4.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:59:06.779023  3282 raft_consensus.cc:3055] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:06.779366  3282 raft_consensus.cc:740] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:06.779407  3273 leader_election.cc:290] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:06.760381  3331 consensus_queue.cc:260] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:06.782222  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:06.782588  3331 raft_consensus.cc:3060] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:06.783383  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:06.780042  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:06.785460  1689 leader_election.cc:304] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:06.789973  1724 raft_consensus.cc:1240] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 2 LEADER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 1. Current term is 2. Ops: [1.2-1.2]
I20260709 12:59:06.794615  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:06.795809  3258 consensus_queue.cc:1059] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:59:06.798081  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:06.798435  3347 raft_consensus.cc:3055] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:06.798699  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:06.798787  3347 raft_consensus.cc:740] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
W20260709 12:59:06.799141  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:06.791028  3275 raft_consensus.cc:2749] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:06.800212  1716 raft_consensus.cc:1240] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 3 LEADER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:06.797505  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:06.801267  1540 leader_election.cc:304] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:06.803285  1716 raft_consensus.cc:1240] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:06.771544  3266 raft_consensus.cc:3060] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:06.805410  3253 raft_consensus.cc:2749] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:06.808200  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:06.790216  3327 raft_consensus.cc:2749] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:06.813453  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:06.799865  3347 consensus_queue.cc:260] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:06.814671  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:06.815442  1650 raft_consensus.cc:1240] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:06.817675  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:06.818773  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:06.819005  2295 leader_election.cc:304] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:06.822219  3304 raft_consensus.cc:2749] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:59:06.823415  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:06.824710  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:06.825834  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:06.827711  1688 leader_election.cc:304] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:06.828750  3285 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:06.829455  3260 raft_consensus.cc:2749] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:06.830858  1567 raft_consensus.cc:1240] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:06.835377  2297 leader_election.cc:304] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:06.836484  2297 leader_election.cc:304] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:06.837112  3340 raft_consensus.cc:2749] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:06.837234  3297 leader_election.cc:290] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:06.828831  1688 leader_election.cc:304] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:06.838128  1720 raft_consensus.cc:1240] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 2 LEADER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:06.838357  1721 raft_consensus.cc:1240] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:06.838989  3260 raft_consensus.cc:2804] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:06.839536  3260 raft_consensus.cc:697] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 3 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:06.840426  3260 consensus_queue.cc:237] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:06.842574  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:06.842981  1642 raft_consensus.cc:1240] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:06.843142  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:06.844738  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:06.846575  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:06.849126  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:06.889326  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:06.869596  1642 raft_consensus.cc:1275] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:06.844640  3313 consensus_queue.cc:1059] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:06.837190  3303 raft_consensus.cc:2749] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:06.890235  2294 leader_election.cc:304] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:06.800568  3273 consensus_queue.cc:1059] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.090s
I20260709 12:59:06.891361  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:06.780287  3282 consensus_queue.cc:260] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:06.906908  1568 raft_consensus.cc:1240] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:06.907960  1567 raft_consensus.cc:1240] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:06.907821  1615 leader_election.cc:304] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:06.908754  1572 raft_consensus.cc:1240] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:06.890017  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:06.896559  3297 consensus_queue.cc:1059] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:59:06.891310  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:06.909171  2294 leader_election.cc:304] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:06.908811  1725 raft_consensus.cc:2468] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 3.
I20260709 12:59:06.910084  1568 raft_consensus.cc:1240] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:06.918335  1716 raft_consensus.cc:1240] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:59:06.918890  2294 leader_election.cc:304] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:06.910182  1615 leader_election.cc:304] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:06.893546  1688 leader_election.cc:304] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:06.910941  3338 raft_consensus.cc:2749] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:06.905148  3304 consensus_queue.cc:1059] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:59:06.911285  3303 raft_consensus.cc:2749] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:06.911927  3299 raft_consensus.cc:3055] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:06.920104  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:06.921291  1688 leader_election.cc:304] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:06.925246  2294 leader_election.cc:304] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:06.931941  3299 raft_consensus.cc:740] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:06.932642  3323 raft_consensus.cc:2749] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:06.932943  3299 consensus_queue.cc:260] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:06.934316  3299 raft_consensus.cc:3060] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:06.934497  3283 consensus_queue.cc:1048] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:06.923985  3276 consensus_queue.cc:1059] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:59:06.937789  3276 raft_consensus.cc:3055] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:06.938277  3276 raft_consensus.cc:740] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:06.943710  1569 raft_consensus.cc:2468] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 3.
I20260709 12:59:06.922413  3313 raft_consensus.cc:2749] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:06.922310  3284 raft_consensus.cc:2749] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:06.922642  3324 raft_consensus.cc:2749] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:06.942176  3302 raft_consensus.cc:2749] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:06.954247  2294 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:06.959903  2294 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:06.960930  2294 leader_election.cc:304] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:06.942492  3311 consensus_queue.cc:1059] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:59:06.939383  3276 consensus_queue.cc:260] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:06.941941  3332 consensus_queue.cc:1059] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:59:06.943152  3273 consensus_queue.cc:1059] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 12:59:06.955405  3310 raft_consensus.cc:2749] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:06.962937  3313 raft_consensus.cc:2749] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:59:07.014921  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 94259.2us
I20260709 12:59:06.965301  3326 raft_consensus.cc:2749] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:07.023054  1650 raft_consensus.cc:1275] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:07.023996  2329 raft_consensus.cc:1240] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 1. Current term is 2. Ops: []
W20260709 12:59:07.022653  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 75737.3us
I20260709 12:59:06.958935  3284 consensus_queue.cc:1059] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 12:59:07.026279  2323 raft_consensus.cc:1240] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:07.029168  1650 raft_consensus.cc:1275] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:07.023718  1539 leader_election.cc:304] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:07.033003  3324 consensus_queue.cc:1048] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:07.012315  3307 raft_consensus.cc:2749] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:07.037032  3260 consensus_queue.cc:1048] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:59:07.055630  1539 leader_election.cc:304] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:07.057235  1539 leader_election.cc:304] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:07.058451  1539 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:07.039774  3364 consensus_queue.cc:1059] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:59:07.064431  3327 raft_consensus.cc:2749] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:07.084069  2326 raft_consensus.cc:1240] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:07.059932  3273 raft_consensus.cc:2749] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:07.077991  1571 raft_consensus.cc:2468] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 3.
I20260709 12:59:07.079668  3265 consensus_queue.cc:1059] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:59:07.083122  3327 consensus_queue.cc:1059] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
W20260709 12:59:07.089355  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 49601.9us
I20260709 12:59:07.095088  3265 raft_consensus.cc:3055] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:07.095492  3265 raft_consensus.cc:740] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:07.096051  1615 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:07.096392  3265 consensus_queue.cc:260] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:07.079484  3285 raft_consensus.cc:2749] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:07.068889  3361 raft_consensus.cc:2749] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:59:07.096355  3360 log.cc:927] Time spent T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.069s	user 0.003s	sys 0.000s
I20260709 12:59:07.088088  3338 consensus_queue.cc:1059] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:59:07.104435  3331 consensus_queue.cc:1059] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:07.104265  3367 raft_consensus.cc:3055] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:07.105599  3367 raft_consensus.cc:740] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:07.106721  3367 consensus_queue.cc:260] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:07.107748  3332 consensus_queue.cc:1059] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:07.108218  3367 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:07.118851  1542 leader_election.cc:304] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:07.119622  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:07.119939  2325 raft_consensus.cc:1240] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:07.113056  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:07.108917  3332 consensus_queue.cc:1059] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:07.124199  1539 leader_election.cc:304] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:07.125406  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:07.119618  3284 raft_consensus.cc:2749] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:07.127663  3361 consensus_queue.cc:1059] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:59:07.131848  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:07.132571  3366 raft_consensus.cc:3055] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:07.131907  3324 consensus_queue.cc:1059] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:07.133010  3366 raft_consensus.cc:740] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:07.133559  3253 raft_consensus.cc:3055] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:07.133580  3324 raft_consensus.cc:3055] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:07.134210  3324 raft_consensus.cc:740] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:07.133862  3366 consensus_queue.cc:260] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:07.135195  3366 raft_consensus.cc:3060] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:07.135042  3324 consensus_queue.cc:260] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:07.136305  3324 raft_consensus.cc:3060] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:07.124423  3285 consensus_queue.cc:1059] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 12:59:07.136768  3266 raft_consensus.cc:3055] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:07.137771  3266 raft_consensus.cc:740] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:07.138474  3365 raft_consensus.cc:3055] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:07.138895  3365 raft_consensus.cc:740] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:07.138578  3266 consensus_queue.cc:260] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:07.139724  3266 raft_consensus.cc:3060] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:07.139658  3365 consensus_queue.cc:260] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:07.140913  3365 raft_consensus.cc:3060] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:07.139829  3265 raft_consensus.cc:3060] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:07.141528  3276 raft_consensus.cc:3060] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:07.122785  3331 raft_consensus.cc:2749] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:07.152518  1576 raft_consensus.cc:1275] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:59:07.152918  1576 pending_rounds.cc:85] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting all ops after (but not including) 4
I20260709 12:59:07.120136  3339 consensus_queue.cc:1059] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:59:07.153146  1576 pending_rounds.cc:107] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:59:07.153468  1576 raft_consensus.cc:2889] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:07.132324  3361 consensus_queue.cc:1243] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer 0c7751452c4b46afa95251b9df7169d4 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
W20260709 12:59:07.156641  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 60697.1us
I20260709 12:59:07.162303  1615 leader_election.cc:304] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:07.159246  3285 consensus_queue.cc:1243] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer 0c7751452c4b46afa95251b9df7169d4 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:59:07.123267  3258 consensus_queue.cc:1059] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:59:07.154461  3253 raft_consensus.cc:740] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:07.167029  3253 consensus_queue.cc:260] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:07.168751  2330 raft_consensus.cc:1240] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 1. Current term is 2. Ops: []
W20260709 12:59:07.169814  3362 log.cc:927] Time spent T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
W20260709 12:59:07.170568  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:07.153477  3339 consensus_queue.cc:1243] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer 0c7751452c4b46afa95251b9df7169d4 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
W20260709 12:59:07.184597  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 63469.1us
I20260709 12:59:07.160287  3299 consensus_queue.cc:1048] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:59:07.161762  3361 consensus_queue.cc:1059] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:59:07.179111  3253 raft_consensus.cc:3060] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:59:07.198486  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 74353.1us
I20260709 12:59:07.199608  1539 leader_election.cc:304] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:07.205096   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:07.181903  3285 raft_consensus.cc:3055] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:07.214160  3368 ts_tablet_manager.cc:933] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 05476b84d8f84d76a9a1f51b620a3c66: Initiating tablet copy from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373)
I20260709 12:59:07.183656  3331 consensus_queue.cc:1059] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:59:07.182178  3302 consensus_queue.cc:1059] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:59:07.181651  3370 raft_consensus.cc:2749] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:07.233155  1643 raft_consensus.cc:1275] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:07.238068  3376 consensus_queue.cc:1059] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:07.213303  3285 raft_consensus.cc:740] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
W20260709 12:59:07.249737  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 86140.9us
I20260709 12:59:07.223201  3258 raft_consensus.cc:3055] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:07.258814  1718 raft_consensus.cc:1275] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:07.260151  3285 consensus_queue.cc:260] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:59:07.261582  3285 raft_consensus.cc:3060] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:07.269155  3347 raft_consensus.cc:3060] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:07.263799  1472 catalog_manager.cc:5697] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 3 to 4, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:07.271965  1472 catalog_manager.cc:5697] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 2 to 3, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
W20260709 12:59:07.274214  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 74960us
I20260709 12:59:07.273851  1472 catalog_manager.cc:5697] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 1 to 2, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:07.276441  1472 catalog_manager.cc:5697] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 1 to 2, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:07.277622  1472 catalog_manager.cc:5697] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 1 to 2, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:07.279440  1472 catalog_manager.cc:5697] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 2 to 3, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:07.282850  3276 raft_consensus.cc:3055] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:07.215564  3372 consensus_queue.cc:1059] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 12:59:07.282969  1472 catalog_manager.cc:5697] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 3 to 4, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:07.255230  3258 raft_consensus.cc:740] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:07.284196  1718 raft_consensus.cc:1240] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:07.290128  1472 catalog_manager.cc:5697] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 2 to 3, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:07.292454  1472 catalog_manager.cc:5697] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 1 to 2, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:07.283368  3276 raft_consensus.cc:740] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:07.276959  3374 raft_consensus.cc:2749] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:07.297991  3255 raft_consensus.cc:2749] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:07.278117  3332 consensus_queue.cc:1059] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
W20260709 12:59:07.309034  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 109538us
I20260709 12:59:07.309931  1539 leader_election.cc:304] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:07.323483  1539 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:07.276427  3304 consensus_queue.cc:1048] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:59:07.330605  1539 leader_election.cc:304] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:07.327095  3255 raft_consensus.cc:2749] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:07.273649  3375 consensus_queue.cc:1059] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 12:59:07.330451  3253 raft_consensus.cc:2749] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:07.332401  3375 raft_consensus.cc:3055] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:07.332964  3375 raft_consensus.cc:740] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:07.335076  1539 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:07.305357  3374 consensus_queue.cc:1059] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:07.297786  3276 consensus_queue.cc:260] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:07.338725  1539 leader_election.cc:304] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:07.340323  1539 leader_election.cc:304] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:07.320206  3297 consensus_queue.cc:1059] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:59:07.342041  3253 raft_consensus.cc:2749] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:07.340164  3255 raft_consensus.cc:2749] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:59:07.354640  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:07.338193  3265 raft_consensus.cc:2749] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:07.359489  1643 raft_consensus.cc:1275] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:07.343492  1539 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:07.364084  1642 raft_consensus.cc:1275] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:59:07.364447  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 239288us
I20260709 12:59:07.366374  1539 leader_election.cc:304] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:07.351589  3340 raft_consensus.cc:3055] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:07.368877  1648 raft_consensus.cc:1275] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:07.345347  3276 raft_consensus.cc:3060] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:07.342839  3381 consensus_queue.cc:1059] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
W20260709 12:59:07.387805  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:07.377336  1542 leader_election.cc:304] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:07.393678  1648 raft_consensus.cc:1275] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:07.363461  3366 raft_consensus.cc:3055] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:07.364938  3374 raft_consensus.cc:3055] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:07.396773  3374 raft_consensus.cc:740] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:07.397598  3374 consensus_queue.cc:260] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:07.398295  1575 raft_consensus.cc:3055] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:07.336103  3258 consensus_queue.cc:260] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:07.377012  3265 raft_consensus.cc:2749] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:07.362844  3275 consensus_queue.cc:1048] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:59:07.394804  3341 consensus_queue.cc:1048] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:59:07.355779  3385 raft_consensus.cc:2749] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:07.364662  3253 raft_consensus.cc:2749] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:07.398738  1575 raft_consensus.cc:740] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:07.377624  3375 consensus_queue.cc:260] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:07.398738  3374 raft_consensus.cc:3060] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:07.369422  3340 raft_consensus.cc:740] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:07.407485  3387 consensus_queue.cc:1048] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:59:07.411190  1573 raft_consensus.cc:3055] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:07.414016  1573 raft_consensus.cc:740] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:07.399399  3366 raft_consensus.cc:740] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:07.370385  3285 consensus_queue.cc:1059] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 12:59:07.420413  1576 raft_consensus.cc:1275] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:07.416592  3266 raft_consensus.cc:2804] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:07.415750  3375 raft_consensus.cc:3060] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:07.439111  3347 consensus_queue.cc:1059] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:07.435487  3266 raft_consensus.cc:697] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:07.416908  3332 consensus_queue.cc:1059] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:59:07.442720  3347 consensus_queue.cc:1243] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer 0c7751452c4b46afa95251b9df7169d4 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:59:07.441064  3266 consensus_queue.cc:237] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:07.437912  3366 consensus_queue.cc:260] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:07.464695  3282 raft_consensus.cc:3060] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:07.504460  3372 raft_consensus.cc:3055] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:07.504899  3301 raft_consensus.cc:3055] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:07.504957  3372 raft_consensus.cc:740] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:07.505458  3301 raft_consensus.cc:740] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:07.506026  3372 consensus_queue.cc:260] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:07.506323  3301 consensus_queue.cc:260] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:07.507951  3301 raft_consensus.cc:3060] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:07.526196  1575 consensus_queue.cc:260] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:07.541293  1575 raft_consensus.cc:3060] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:07.543143  3368 tablet_copy_client.cc:323] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.193:34373
W20260709 12:59:07.559912  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 280668us
I20260709 12:59:07.561014  1539 leader_election.cc:304] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:07.562084  3255 raft_consensus.cc:2749] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:07.562680  3310 raft_consensus.cc:3055] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:07.563067  3310 raft_consensus.cc:740] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:07.562114  1642 raft_consensus.cc:1275] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:07.565100  1539 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:07.568187  1576 raft_consensus.cc:1240] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:07.564232  1573 consensus_queue.cc:260] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:07.569835  1568 raft_consensus.cc:1275] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:07.570844  1573 raft_consensus.cc:3060] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:07.571516  3386 log.cc:927] Time spent T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.123s	user 0.002s	sys 0.000s
I20260709 12:59:07.577188  1569 raft_consensus.cc:1240] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:07.585284  3380 raft_consensus.cc:3055] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:07.585687  3380 raft_consensus.cc:740] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:07.587958  1575 raft_consensus.cc:1275] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:07.584394  1719 raft_consensus.cc:1240] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:07.584365  2329 raft_consensus.cc:1240] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:07.591861  1573 raft_consensus.cc:1275] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:07.579416  3361 raft_consensus.cc:2749] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:07.593611  3287 consensus_queue.cc:1059] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.002s
W20260709 12:59:07.594168  3273 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 12:59:07.598616  3370 raft_consensus.cc:3055] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:07.599016  3370 raft_consensus.cc:740] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
W20260709 12:59:07.608911  3339 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
W20260709 12:59:07.580883  3311 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.001s	sys 0.019s
I20260709 12:59:07.564476  3310 consensus_queue.cc:260] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:07.656944  3311 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.001s	sys 0.019s
I20260709 12:59:07.599901  3370 consensus_queue.cc:260] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:07.676546  3383 raft_consensus.cc:493] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:07.687904  1569 raft_consensus.cc:1275] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:07.689091  1574 raft_consensus.cc:3055] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:07.689297  1567 raft_consensus.cc:1275] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:07.690599  1575 raft_consensus.cc:1275] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 2. (term mismatch)
I20260709 12:59:07.691079  1575 pending_rounds.cc:85] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting all ops after (but not including) 1
I20260709 12:59:07.691363  1575 pending_rounds.cc:107] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.2
I20260709 12:59:07.691691  1575 raft_consensus.cc:2917] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Aborting config change with OpId 1.2: Aborted: Op aborted by new leader
I20260709 12:59:07.692126  1575 raft_consensus.cc:2889] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:07.689481  1574 raft_consensus.cc:740] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:07.706255  1573 raft_consensus.cc:1240] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:07.710930  1575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:40744 (request call id 3) took 2311 ms. Trace:
I20260709 12:59:07.586467  3380 consensus_queue.cc:260] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:07.714416  3374 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:07.714596  3380 raft_consensus.cc:3060] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:07.714809  1586 tablet_copy_service.cc:140] P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Received BeginTabletCopySession request for tablet dfdb9ea6c3bf4001aeecb5c37e0d6baf from peer 05476b84d8f84d76a9a1f51b620a3c66 ({username='slave'} at 127.0.0.1:37682)
I20260709 12:59:07.714937  1567 raft_consensus.cc:1275] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:07.675554  3310 raft_consensus.cc:3060] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:07.714958  3374 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:07.705123  1574 consensus_queue.cc:260] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:07.721846  1723 raft_consensus.cc:1240] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 2 LEADER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:07.722354  1719 raft_consensus.cc:1240] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 3 LEADER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:07.717760  1586 tablet_copy_service.cc:161] P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Beginning new tablet copy session on tablet dfdb9ea6c3bf4001aeecb5c37e0d6baf from peer 05476b84d8f84d76a9a1f51b620a3c66 at {username='slave'} at 127.0.0.1:37682: session id = 05476b84d8f84d76a9a1f51b620a3c66-dfdb9ea6c3bf4001aeecb5c37e0d6baf
I20260709 12:59:07.727946  1574 raft_consensus.cc:3060] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:07.677284  3383 raft_consensus.cc:515] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:07.733810  1571 raft_consensus.cc:1275] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:07.745594  1648 raft_consensus.cc:1275] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:07.744686  3370 raft_consensus.cc:3060] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:07.742373  3311 raft_consensus.cc:493] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:07.776568  1572 raft_consensus.cc:1240] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:07.711365  1575 rpcz_store.cc:276] 0709 12:59:05.393760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:05.399111 (+  5351us) service_pool.cc:224] Handling call
0709 12:59:05.418226 (+ 19115us) log.cc:844] Serialized 506 byte log entry
0709 12:59:05.471537 (+ 53311us) spinlock_profiling.cc:243] Waited 2.44 ms on lock 0x7b540039baa0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f2334142 00007fa9f2314eaa 00007fa9f231bd53 00007fa9f231bcd9 00007fa9f231bc69 00007fa9f231bc31 00007fa9f231adfd 000000000038f354 000000000038f199 00007fa9ef2ce475
0709 12:59:05.473829 (+  2292us) spinlock_profiling.cc:243] Waited 3.85 ms on lock 0x7b540039baa0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f233bb26 00007fa9f233549a 00007fa9f2334714 00007fa9f2314eaa 00007fa9f231bd53 00007fa9f231bcd9 00007fa9f231bc69 00007fa9f231bc31 00007fa9f231adfd 000000000038f354
0709 12:59:05.487596 (+ 13767us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b18002dd6e0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23f7d01 00007fa9f2334691 00007fa9f2314eaa 00007fa9f231bd53 00007fa9f231bcd9 00007fa9f231bc69 00007fa9f231bc31 00007fa9f231adfd 000000000038f354 000000000038f199
0709 12:59:05.521315 (+ 33719us) spinlock_profiling.cc:243] Waited 5.52 ms on lock 0x7b1800123160. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef2ce3f3 00007fa9ef2d07c1 00007fa9ef2d0779 00007fa9ef2d0709 00007fa9ef2d06d1 00007fa9ef2cf9cd 000000000038f354 000000000038f199 00007fa9ef2b183a
0709 12:59:07.692508 (+2171193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5818,"raft.queue_time_us":12575,"raft.run_cpu_time_us":6291,"raft.run_wall_time_us":34405,"spinlock_wait_cycles":53672064,"thread_start_us":40545,"threads_started":1,"wal-append.queue_time_us":65789,"wal-append.run_cpu_time_us":1503,"wal-append.run_wall_time_us":1002459}
I20260709 12:59:07.768294  3323 consensus_queue.cc:1048] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:59:07.747218  3302 consensus_queue.cc:1059] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:59:07.772505  3311 raft_consensus.cc:515] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:07.787109  1574 raft_consensus.cc:1275] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:07.764670  3315 consensus_queue.cc:1048] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:59:07.783635  3288 consensus_queue.cc:1048] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:59:07.804917  1689 leader_election.cc:304] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:07.788506  3399 raft_consensus.cc:493] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
W20260709 12:59:07.788966  3394 log.cc:927] Time spent T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 12:59:07.809916  3288 raft_consensus.cc:2749] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:07.811208  3323 consensus_queue.cc:1059] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:07.812312  3288 raft_consensus.cc:3055] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:07.812700  3288 raft_consensus.cc:740] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:07.813450  3288 consensus_queue.cc:260] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:07.787824  3260 consensus_queue.cc:1048] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:07.789806  3383 leader_election.cc:290] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:07.771870  3313 raft_consensus.cc:493] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:07.827659  3313 raft_consensus.cc:515] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:07.791632  1521 auto_rebalancer.cc:629] Failed to schedule move for tablet dfdb9ea6c3bf4001aeecb5c37e0d6baf: Aborted: Op aborted by new leader
I20260709 12:59:07.791718  3374 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:07.764189  3341 consensus_queue.cc:1048] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 12:59:07.815718  3340 consensus_queue.cc:260] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:07.793787  1586 tablet_copy_source_session.cc:215] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:07.764400  3291 consensus_queue.cc:1048] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:59:07.830224  3340 raft_consensus.cc:3060] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:07.797842  1615 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:07.798508  3397 raft_consensus.cc:493] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:07.798858  3371 raft_consensus.cc:3055] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:07.801659  3337 raft_consensus.cc:3055] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:07.802839  3286 consensus_queue.cc:1048] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:07.803947  3387 consensus_queue.cc:1048] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:07.806073  3334 consensus_queue.cc:1059] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:59:07.808197  3379 consensus_queue.cc:1048] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:07.819044  3366 raft_consensus.cc:3060] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:59:07.820331  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:07.856855  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:07.821102  3288 raft_consensus.cc:3060] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:07.857601  2330 raft_consensus.cc:2393] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 2: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 12:59:07.821938  1689 leader_election.cc:304] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 12:59:07.823750  3327 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:59:07.823741  3258 raft_consensus.cc:3060] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:07.826951  3363 raft_consensus.cc:3055] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:07.786137  3311 leader_election.cc:290] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:07.904093  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 44493.9us
W20260709 12:59:07.904426  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 46759.4us
I20260709 12:59:07.839972  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:07.840330  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:59:07.860162  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:07.842026  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:07.844767  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:07.906322  1568 raft_consensus.cc:2468] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 2.
I20260709 12:59:07.859959  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:07.845265  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:07.907454  1576 raft_consensus.cc:2468] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 3.
I20260709 12:59:07.907619  1615 leader_election.cc:304] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
W20260709 12:59:07.838157  3364 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.010s	sys 0.028s
I20260709 12:59:07.807518  3283 consensus_queue.cc:1048] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 12:59:07.838981  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:07.905309  1642 raft_consensus.cc:2468] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 2.
I20260709 12:59:07.840858  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:07.845952  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:07.908844  3308 consensus_queue.cc:1059] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 12:59:07.859541  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:07.841297  3371 raft_consensus.cc:740] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:07.848076  3337 raft_consensus.cc:740] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:07.915088  1649 raft_consensus.cc:2393] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 3: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
W20260709 12:59:07.911274  3364 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.846s	user 0.010s	sys 0.028s
I20260709 12:59:07.903579  3275 raft_consensus.cc:2749] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:07.926117  3388 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:07.922030  2323 raft_consensus.cc:1240] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:07.852444  3260 consensus_queue.cc:1048] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.064s
W20260709 12:59:07.930791  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:07.931756  1615 leader_election.cc:304] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:07.855343  3376 consensus_queue.cc:1059] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 12:59:07.970876  1539 leader_election.cc:304] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:07.856567  3264 consensus_queue.cc:1048] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.067s
W20260709 12:59:07.997876  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 66168.8us
I20260709 12:59:07.915529  3363 raft_consensus.cc:740] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:07.856591  3276 consensus_queue.cc:1059] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.072s
I20260709 12:59:08.004097  3327 raft_consensus.cc:2749] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:59:08.005889  3409 log.cc:927] Time spent T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.147s	user 0.000s	sys 0.002s
I20260709 12:59:07.971634  3367 raft_consensus.cc:2804] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:07.977295  3372 raft_consensus.cc:3060] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:07.999701  3377 raft_consensus.cc:493] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.001489  3368 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfdb9ea6c3bf4001aeecb5c37e0d6baf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:08.002215  1539 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:07.976938  3337 consensus_queue.cc:260] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:07.932860  3297 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.010398  1574 raft_consensus.cc:2468] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 4.
I20260709 12:59:08.013929  1539 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:08.017212  1539 leader_election.cc:304] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:07.983418  3382 consensus_queue.cc:1048] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.089s
W20260709 12:59:08.023175  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:08.009829  3367 raft_consensus.cc:493] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:08.015190  3308 raft_consensus.cc:3055] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:08.016397  3364 raft_consensus.cc:2804] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:07.993438  3388 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:08.024986  3327 raft_consensus.cc:2749] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:08.047801  1642 raft_consensus.cc:1275] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:59:08.048174  1642 pending_rounds.cc:85] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e: Aborting all ops after (but not including) 1
I20260709 12:59:08.048411  1642 pending_rounds.cc:107] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:59:08.048676  1642 raft_consensus.cc:2889] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:08.024832  3370 raft_consensus.cc:3060] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:08.050642  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:07.856665  3397 raft_consensus.cc:515] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:08.070636  1576 raft_consensus.cc:2468] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 2.
I20260709 12:59:08.016510  3258 raft_consensus.cc:2749] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:08.040598  3367 raft_consensus.cc:3060] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:08.044396  3364 raft_consensus.cc:493] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:08.083467  1615 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:08.018457  3297 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:08.039558  3377 raft_consensus.cc:515] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:08.049271  3388 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:08.098857  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:08.068841  3273 consensus_queue.cc:1048] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:59:08.086508  3364 raft_consensus.cc:3060] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:08.039345  3308 raft_consensus.cc:740] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:07.842309  3399 raft_consensus.cc:515] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:08.090662  3276 raft_consensus.cc:2804] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:08.094060  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:08.110241  3377 leader_election.cc:290] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:08.141532  3273 raft_consensus.cc:493] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
W20260709 12:59:08.173982  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 315140us
I20260709 12:59:08.181057  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:08.187671  1572 raft_consensus.cc:2468] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 4.
I20260709 12:59:08.158558  3374 raft_consensus.cc:493] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:08.179087  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 274235us
I20260709 12:59:08.189837  2330 raft_consensus.cc:1240] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:08.193270  2323 raft_consensus.cc:2393] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 2: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 12:59:08.196072  1572 raft_consensus.cc:1240] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:08.197930  3338 raft_consensus.cc:3055] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:08.200649  3374 raft_consensus.cc:515] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:08.201205  3313 leader_election.cc:290] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:08.178799  3369 raft_consensus.cc:493] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.202459  3397 leader_election.cc:290] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:08.204923  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:08.205142  3399 leader_election.cc:290] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:08.206151  3297 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:08.208909  3363 consensus_queue.cc:260] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:08.213881  3337 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:08.215611  1569 raft_consensus.cc:1240] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:08.215845  3367 raft_consensus.cc:515] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:08.283218  3414 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.291064  3367 leader_election.cc:290] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:08.290951  3414 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:08.291872  3287 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.292354  3287 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:08.293118  3414 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:08.218128  3370 raft_consensus.cc:2749] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:08.178510  3316 raft_consensus.cc:493] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.195277  3273 raft_consensus.cc:515] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:08.176293  3276 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:08.225786  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:08.212054  1615 leader_election.cc:304] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:08.298482  1576 raft_consensus.cc:2468] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 2.
W20260709 12:59:08.298595  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 86610.3us
I20260709 12:59:08.226948  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 12:59:08.238996  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 51673.4us
I20260709 12:59:08.238360  3334 raft_consensus.cc:493] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.242614  3417 raft_consensus.cc:493] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.238408  3338 raft_consensus.cc:740] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:08.243355  3374 leader_election.cc:290] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:08.244819  3380 raft_consensus.cc:493] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:08.247748  1723 raft_consensus.cc:2468] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 4.
I20260709 12:59:08.251235  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:08.253768  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:08.255640  1720 raft_consensus.cc:1275] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:59:08.255842  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:08.262722  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:08.318127  1651 raft_consensus.cc:2468] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 2.
I20260709 12:59:08.259553  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:08.212030  3308 consensus_queue.cc:260] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:08.246538  3387 consensus_queue.cc:1048] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:59:08.296296  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:08.296281  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:08.300513  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:08.324999  1647 raft_consensus.cc:2468] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 2.
I20260709 12:59:08.325449  2330 raft_consensus.cc:2393] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 2: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 12:59:08.306627  2295 leader_election.cc:304] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:08.308660  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:08.320925  1719 raft_consensus.cc:2393] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 4: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:59:08.285456  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:08.326928  1574 raft_consensus.cc:2468] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 2.
I20260709 12:59:08.303395  3276 raft_consensus.cc:3060] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:08.330857  2295 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:08.331244  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:08.332026  1615 leader_election.cc:304] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:08.336138  1648 raft_consensus.cc:2468] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 3.
I20260709 12:59:08.335279  2294 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:08.307003  3367 raft_consensus.cc:2804] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:08.337996  1615 leader_election.cc:304] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:08.338948  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:08.339389  1574 raft_consensus.cc:2468] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 3.
I20260709 12:59:08.340126  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:08.340495  1574 raft_consensus.cc:2468] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 2.
I20260709 12:59:08.340518  1615 leader_election.cc:304] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:08.333910  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:08.341675  2295 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:08.343761  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 12:59:08.344852  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:08.303629  3288 consensus_queue.cc:1059] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:59:08.304582  3316 raft_consensus.cc:515] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:08.334749  3313 raft_consensus.cc:2804] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:08.333750  3287 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:08.294651  3369 raft_consensus.cc:515] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:08.342973  3388 raft_consensus.cc:2749] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:08.347355  3397 raft_consensus.cc:2804] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:08.324605  3376 consensus_queue.cc:1059] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 12:59:08.363330  2323 raft_consensus.cc:2393] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 2: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 12:59:08.346287  3332 raft_consensus.cc:2804] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:08.344318  3367 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:08.337790  3374 consensus_queue.cc:1059] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:59:08.312754  3334 raft_consensus.cc:515] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:08.349761  3304 raft_consensus.cc:2804] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:08.324509  3380 raft_consensus.cc:515] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:08.367769  3273 leader_election.cc:290] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:08.353991  3326 raft_consensus.cc:2804] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:08.347744  3297 raft_consensus.cc:2804] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:08.349524  3347 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
W20260709 12:59:08.380213  1615 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:08.354838  3323 raft_consensus.cc:493] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:08.360415  3313 raft_consensus.cc:493] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:08.393743  3367 raft_consensus.cc:3060] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:08.393183  3332 raft_consensus.cc:493] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:08.410046  1643 raft_consensus.cc:2468] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 4.
I20260709 12:59:08.412500  1567 raft_consensus.cc:2468] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 2.
I20260709 12:59:08.316484  3417 raft_consensus.cc:515] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:08.377710  3397 raft_consensus.cc:493] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:08.428596  1568 raft_consensus.cc:1240] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:08.355891  3421 consensus_queue.cc:1048] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 12:59:08.405699  3304 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:08.408921  3431 raft_consensus.cc:493] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:08.431401  3297 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:08.427000  3326 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:08.440831  1615 leader_election.cc:304] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:59:08.360358  3338 consensus_queue.cc:260] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:08.436091  3414 raft_consensus.cc:493] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.441548  3332 raft_consensus.cc:3060] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:08.439970  3313 raft_consensus.cc:3060] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:08.447002  3397 raft_consensus.cc:3060] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:08.449110  3304 raft_consensus.cc:3060] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:08.455444  3297 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:08.454000  3291 raft_consensus.cc:493] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.457050  3326 raft_consensus.cc:3060] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:08.438603  3347 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:08.465176  3372 raft_consensus.cc:2804] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:59:08.500975  3419 log.cc:927] Time spent T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
I20260709 12:59:08.501284  3363 raft_consensus.cc:3060] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:08.501929  3425 log.cc:927] Time spent T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:59:08.442126  3323 raft_consensus.cc:515] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:08.455302  3431 raft_consensus.cc:515] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:08.467077  3414 raft_consensus.cc:515] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:08.521308  3372 raft_consensus.cc:697] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 2 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:08.498270  3291 raft_consensus.cc:515] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:08.541553  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:08.528518  3287 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.542200  1573 raft_consensus.cc:2468] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 2.
I20260709 12:59:08.548617  3287 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:08.549440  3292 raft_consensus.cc:3055] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:08.549906  3292 raft_consensus.cc:740] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:08.550906  3287 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:08.550813  3292 consensus_queue.cc:260] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:08.552917  3380 leader_election.cc:290] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:08.552982  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:08.553478  3431 leader_election.cc:290] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:08.553771  1572 raft_consensus.cc:2468] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 2.
I20260709 12:59:08.554885  2295 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:08.558310  3414 leader_election.cc:290] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:08.560982  3334 leader_election.cc:290] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:08.523892  3364 raft_consensus.cc:515] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:08.565351  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:08.566694  1539 leader_election.cc:304] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:08.565984  1643 raft_consensus.cc:2468] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 2.
I20260709 12:59:08.568344  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:08.573323  1650 raft_consensus.cc:2393] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 3: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:08.554978  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:08.569784  2294 leader_election.cc:304] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:08.584205  3397 raft_consensus.cc:515] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:08.587160  3397 leader_election.cc:290] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:08.546082  3316 leader_election.cc:290] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:08.589522  3421 raft_consensus.cc:2804] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:59:08.594336  3434 log.cc:927] Time spent T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.130s	user 0.003s	sys 0.000s
I20260709 12:59:08.596786  3372 consensus_queue.cc:237] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:08.599548  1645 raft_consensus.cc:1240] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:59:08.589008  3287 raft_consensus.cc:2804] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:08.592357  3414 raft_consensus.cc:2804] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:08.600011  3421 raft_consensus.cc:493] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:08.592131  3302 raft_consensus.cc:493] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:08.618997  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 269916us
I20260709 12:59:08.599081  3332 raft_consensus.cc:515] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:08.611481  3323 leader_election.cc:290] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:08.610291  3433 log.cc:927] Time spent T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.210s	user 0.003s	sys 0.004s
I20260709 12:59:08.605227  3287 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:08.625536  3417 leader_election.cc:290] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:08.634670  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:08.634438  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:08.632272  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:08.637209  1651 raft_consensus.cc:2468] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 2.
I20260709 12:59:08.637676  1643 raft_consensus.cc:2468] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 3.
I20260709 12:59:08.633487  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:08.641031  1646 raft_consensus.cc:2368] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 3. Current term is 4.
I20260709 12:59:08.636207  3287 raft_consensus.cc:3060] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:08.636758  1648 raft_consensus.cc:2468] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 3.
I20260709 12:59:08.614946  3414 raft_consensus.cc:493] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:08.649484  1688 leader_election.cc:304] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:08.618952  3421 raft_consensus.cc:3060] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:08.652591  3417 raft_consensus.cc:2804] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:08.652725  1688 leader_election.cc:304] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:08.653034  3417 raft_consensus.cc:493] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:08.653416  3417 raft_consensus.cc:3060] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:08.653781  1688 leader_election.cc:400] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391) with higher term. Message: Invalid argument: T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 3. Current term is 4.
I20260709 12:59:08.654103  1688 leader_election.cc:403] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:08.654649  3323 raft_consensus.cc:2804] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:08.654743  1688 leader_election.cc:304] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:08.655090  3323 raft_consensus.cc:493] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:08.655486  3323 raft_consensus.cc:3060] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:08.655802  3283 raft_consensus.cc:3060] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:59:08.655905  3431 raft_consensus.cc:2804] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:08.656333  3431 raft_consensus.cc:493] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:08.656770  3431 raft_consensus.cc:3060] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:08.625383  3340 raft_consensus.cc:493] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.629228  3332 leader_election.cc:290] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:08.630992  3364 leader_election.cc:290] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:08.673498  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:08.677947  1642 raft_consensus.cc:2468] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 1.
I20260709 12:59:08.640791  3411 raft_consensus.cc:493] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
W20260709 12:59:08.676471  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 360281us
I20260709 12:59:08.659780  3414 raft_consensus.cc:3060] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:08.679538  1688 leader_election.cc:304] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
W20260709 12:59:08.736845  1691 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:08.661593  3258 raft_consensus.cc:493] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.623482  3302 raft_consensus.cc:515] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:08.741947  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 62511.4us
I20260709 12:59:08.674827  3299 raft_consensus.cc:493] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.677441  3370 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:08.744638  3411 raft_consensus.cc:515] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:08.675923  3291 leader_election.cc:290] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:08.743117  3258 raft_consensus.cc:515] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:08.748062  3369 leader_election.cc:290] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:08.748718  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:08.754431  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:08.673158  3276 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:08.751359  3408 log.cc:927] Time spent T 00000000000000000000000000000000 P fcfaa17e55ae48e194c5d95ca24a659f: Append to log took a long time: real 0.077s	user 0.004s	sys 0.004s
I20260709 12:59:08.750532  3437 raft_consensus.cc:2804] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:08.678453  3340 raft_consensus.cc:515] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:08.742323  3439 raft_consensus.cc:493] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.775549  2323 raft_consensus.cc:2393] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 2: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 12:59:08.751721  3370 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:08.776895  3308 raft_consensus.cc:3060] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:08.679399  3371 consensus_queue.cc:260] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:08.788903  3370 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:08.778883  1649 raft_consensus.cc:2468] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 2.
I20260709 12:59:08.792163  3417 raft_consensus.cc:515] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:08.798036  1718 raft_consensus.cc:2468] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 2.
I20260709 12:59:08.753796  3299 raft_consensus.cc:515] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:08.810835  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:08.811703  1647 raft_consensus.cc:2468] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 3.
I20260709 12:59:08.813426  2294 leader_election.cc:304] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:08.808013  3439 raft_consensus.cc:515] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:08.765406  3437 raft_consensus.cc:493] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:08.815733  3291 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.833118  3437 raft_consensus.cc:3060] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:08.850939  3347 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:08.851511  3313 raft_consensus.cc:515] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:08.853530  3299 leader_election.cc:290] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:08.855233  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:08.865746  3264 raft_consensus.cc:3055] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:59:08.879606  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:08.870904  3340 leader_election.cc:290] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:08.839838  3302 leader_election.cc:290] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:08.829593  3367 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:08.873406  3443 log.cc:927] Time spent T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.212s	user 0.000s	sys 0.002s
I20260709 12:59:08.878276  3276 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:08.873806  3301 raft_consensus.cc:2804] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:08.874104  3410 raft_consensus.cc:493] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.847348  3291 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:08.897142  1615 leader_election.cc:304] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:08.900766  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:08.901958  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:08.903219  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:08.911764  1570 raft_consensus.cc:3060] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:08.903502  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:08.904642  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:08.905524  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:08.872435  3326 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:08.846566  3382 consensus_queue.cc:1059] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 12:59:08.872275  3304 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:08.878718  3264 raft_consensus.cc:740] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:08.917088  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:08.925329  1572 raft_consensus.cc:2468] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 3.
I20260709 12:59:08.926153  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:08.927138  3439 leader_election.cc:290] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:08.927161  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:08.926754  1572 raft_consensus.cc:2468] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 2.
I20260709 12:59:08.934325  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:08.935106  1573 raft_consensus.cc:2468] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 3.
W20260709 12:59:08.936975  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 187565us
I20260709 12:59:08.898991  3301 raft_consensus.cc:493] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:08.915748  3321 raft_consensus.cc:493] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.938257  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:08.918502  3442 raft_consensus.cc:493] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.949398  1645 raft_consensus.cc:2468] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 2.
I20260709 12:59:08.918776  3372 raft_consensus.cc:2804] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:08.891974  3421 raft_consensus.cc:515] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:08.953192  1539 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:08.963729  3439 raft_consensus.cc:2804] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:08.960659  3264 consensus_queue.cc:260] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:08.964165  3439 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:08.964634  3439 raft_consensus.cc:3060] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:08.941175  3379 raft_consensus.cc:3055] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:59:08.968832  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:08.947197  3301 raft_consensus.cc:3060] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:08.918927  3410 raft_consensus.cc:515] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:08.978336  3388 raft_consensus.cc:493] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:08.979372  3388 raft_consensus.cc:515] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:08.982945  3388 leader_election.cc:290] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:08.965045  3264 raft_consensus.cc:3060] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:08.990252  1570 raft_consensus.cc:2468] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 4.
I20260709 12:59:08.984906  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:08.996183  1573 raft_consensus.cc:2468] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 4.
I20260709 12:59:08.952566  3382 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:08.996767  1575 raft_consensus.cc:2393] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 5: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:08.956326  3316 raft_consensus.cc:493] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:08.953478  3372 raft_consensus.cc:493] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:08.969401  3379 raft_consensus.cc:740] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:08.954309  3321 raft_consensus.cc:515] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:08.962816  3442 raft_consensus.cc:515] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:09.007784  3372 raft_consensus.cc:3060] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:09.010425  3258 leader_election.cc:290] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:09.018781  3299 raft_consensus.cc:493] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.034322  3299 raft_consensus.cc:515] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:09.008021  3316 raft_consensus.cc:515] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:09.037760  3316 leader_election.cc:290] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:09.039593  3323 raft_consensus.cc:515] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:09.023409  3415 raft_consensus.cc:493] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:09.044008  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:09.046520  1569 raft_consensus.cc:3060] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:09.036072  1720 consensus_queue.cc:237] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
W20260709 12:59:09.025157  3368 consensus_meta.cc:287] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.614s	user 0.005s	sys 0.006s
I20260709 12:59:09.006999  3382 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:09.020990  3302 raft_consensus.cc:493] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:09.048380  3416 raft_consensus.cc:493] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.077855  1615 leader_election.cc:304] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:09.049521  3276 raft_consensus.cc:493] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.079826  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:09.056705  1647 raft_consensus.cc:2468] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 2.
I20260709 12:59:09.062083  3382 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 12:59:09.063412  3446 log.cc:927] Time spent T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
W20260709 12:59:09.064311  3363 consensus_meta.cc:287] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.563s	user 0.010s	sys 0.000s
I20260709 12:59:09.065949  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:59:09.068958  3444 log.cc:927] Time spent T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 12:59:09.086589  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:09.094695  1719 raft_consensus.cc:2393] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 4: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:59:09.069188  3286 raft_consensus.cc:493] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.069913  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:09.070248  3321 leader_election.cc:290] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:09.070803  3367 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:09.072190  3442 leader_election.cc:290] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:09.073133  1569 raft_consensus.cc:2468] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 5.
I20260709 12:59:09.073477  3323 leader_election.cc:290] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:09.074800  3304 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:09.075985  3417 leader_election.cc:290] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:09.049489  1568 raft_consensus.cc:2468] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 2.
I20260709 12:59:09.078707  1615 leader_election.cc:304] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:09.079783  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:09.054378  3316 raft_consensus.cc:493] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:09.051959  3410 leader_election.cc:290] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:09.083144  2330 raft_consensus.cc:2368] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 3. Current term is 4.
I20260709 12:59:09.096156  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:09.084161  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:09.120122  1716 raft_consensus.cc:2468] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 3.
I20260709 12:59:09.068081  3414 raft_consensus.cc:515] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:09.096913  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:09.100843  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:09.104004  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:09.058828  3449 raft_consensus.cc:493] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.124348  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:09.125149  1721 raft_consensus.cc:3060] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:09.108353  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:09.114459  1574 raft_consensus.cc:1275] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:09.076794  3313 leader_election.cc:290] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:09.129289  3371 raft_consensus.cc:3060] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:09.103984  3447 raft_consensus.cc:493] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.130435  3447 raft_consensus.cc:515] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:09.058372  3415 raft_consensus.cc:515] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:09.092728  3276 raft_consensus.cc:515] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:09.118661  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:09.079597  3302 raft_consensus.cc:515] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:09.081565  3388 raft_consensus.cc:2804] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:59:09.123096  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 44451.1us
I20260709 12:59:09.124312  2329 raft_consensus.cc:2368] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 2. Current term is 3.
W20260709 12:59:09.152208  1615 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:09.131916  3450 log.cc:927] Time spent T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:59:09.124709  3291 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:09.148324  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:09.133819  3381 raft_consensus.cc:2804] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:09.153746  1573 raft_consensus.cc:2468] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 4.
I20260709 12:59:09.153643  1615 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 12:59:09.229841  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 76259us
W20260709 12:59:09.155486  1689 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:09.125171  3304 raft_consensus.cc:493] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.146528  1721 raft_consensus.cc:2468] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 5.
I20260709 12:59:09.148904  2325 raft_consensus.cc:2368] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 2. Current term is 3.
I20260709 12:59:09.140056  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:09.234529  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:09.235481  1721 raft_consensus.cc:2393] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 4: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:59:09.231828  1646 raft_consensus.cc:2468] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 2.
I20260709 12:59:09.132236  3451 raft_consensus.cc:493] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.081617  3416 raft_consensus.cc:515] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:09.079212  3379 consensus_queue.cc:260] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:09.233130  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:09.232756  3258 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.234434  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:09.236886  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:09.151844  3388 raft_consensus.cc:493] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:09.237793  1615 leader_election.cc:304] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:09.250733  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:09.124832  3316 raft_consensus.cc:515] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:09.240445  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:09.246054  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:09.254263  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:09.237839  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:09.149834  3411 leader_election.cc:290] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:09.154536  3367 raft_consensus.cc:493] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.106443  3286 raft_consensus.cc:515] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:09.132134  3449 raft_consensus.cc:515] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:09.261804  1572 raft_consensus.cc:1240] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:59:09.225471  3273 raft_consensus.cc:493] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:09.283565  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:09.237071  3370 raft_consensus.cc:493] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:09.284621  1649 raft_consensus.cc:2468] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 2.
W20260709 12:59:09.271759  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 171800us
I20260709 12:59:09.250152  2323 raft_consensus.cc:2393] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 2: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 12:59:09.229022  3327 raft_consensus.cc:493] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:09.274921  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:09.256274  3388 raft_consensus.cc:3060] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:09.143687  3287 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:09.287043  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:09.288736  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:09.289651  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:09.244382  3381 raft_consensus.cc:697] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 4 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:09.292263  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:09.293802  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:09.294653  1688 leader_election.cc:304] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:09.295610  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:09.295744  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:09.298872  1650 raft_consensus.cc:3060] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:09.246307  3364 raft_consensus.cc:2804] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:09.249892  3368 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:32870 (request call id 137) took 2210 ms. Trace:
I20260709 12:59:09.305644  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:09.256433  3421 leader_election.cc:290] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:09.305672  1721 raft_consensus.cc:2468] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 3.
I20260709 12:59:09.306735  2294 leader_election.cc:304] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:09.309013  3338 raft_consensus.cc:3060] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:09.253767  3369 consensus_queue.cc:1048] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:59:09.263664  3258 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:09.334714  3258 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:09.308776  3313 raft_consensus.cc:493] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.335413  3313 raft_consensus.cc:515] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:09.337824  3313 leader_election.cc:290] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:09.246176  2326 raft_consensus.cc:2468] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 1.
I20260709 12:59:09.271449  3410 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.339345  3410 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:09.280738  3397 raft_consensus.cc:2804] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:09.322366  1570 raft_consensus.cc:2393] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 2: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:09.322613  1573 raft_consensus.cc:3060] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:59:09.342736  1540 leader_election.cc:400] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423) with higher term. Message: Invalid argument: T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 3. Current term is 4.
I20260709 12:59:09.343070  1540 leader_election.cc:403] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:09.322969  1649 raft_consensus.cc:3060] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:09.345841  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 57354.1us
W20260709 12:59:09.345001  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 107184us
I20260709 12:59:09.346644  2295 leader_election.cc:304] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:09.243664  3304 raft_consensus.cc:515] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:09.324641  1576 raft_consensus.cc:2468] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 2.
I20260709 12:59:09.300964  3363 raft_consensus.cc:493] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:09.358721  1540 leader_election.cc:400] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423) with higher term. Message: Invalid argument: T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 2. Current term is 3.
I20260709 12:59:09.358496  1615 leader_election.cc:304] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:59:09.332427  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:09.360903  1648 raft_consensus.cc:2468] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 2.
I20260709 12:59:09.326960  1719 raft_consensus.cc:2468] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 3.
I20260709 12:59:09.362771  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:09.359771  1540 leader_election.cc:304] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:09.349311  2329 raft_consensus.cc:1275] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:09.348459  1650 raft_consensus.cc:2468] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 4.
I20260709 12:59:09.311651  3337 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:09.285771  3367 raft_consensus.cc:515] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:09.365660  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 130098us
I20260709 12:59:09.350183  1645 raft_consensus.cc:2468] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 3.
I20260709 12:59:09.368681  1573 raft_consensus.cc:2468] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 4.
I20260709 12:59:09.307215  3370 raft_consensus.cc:515] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:09.380175  2331 raft_consensus.cc:2368] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 2. Current term is 3.
I20260709 12:59:09.289453  3273 raft_consensus.cc:515] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:09.351614  3442 raft_consensus.cc:2804] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:09.351756  3447 leader_election.cc:290] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:09.241858  3451 raft_consensus.cc:515] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:09.360116  3397 raft_consensus.cc:697] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 4 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:09.350349  3304 leader_election.cc:290] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:09.351166  3364 raft_consensus.cc:697] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 2 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:09.311409  3327 raft_consensus.cc:515] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:09.390992  3347 raft_consensus.cc:2804] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:09.389218  3421 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:09.397068  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 69726.9us
I20260709 12:59:09.394693  3411 raft_consensus.cc:2804] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:09.393501  3258 raft_consensus.cc:2749] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423) with higher term. Message: Invalid argument: T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 3. Current term is 4.
I20260709 12:59:09.365136  3363 raft_consensus.cc:515] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:09.424229  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 12:59:09.425742  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 78104.6us
I20260709 12:59:09.427825  1649 raft_consensus.cc:2468] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 3.
W20260709 12:59:09.430016  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 67900.7us
I20260709 12:59:09.433208  2328 raft_consensus.cc:2468] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 3.
I20260709 12:59:09.431236  3442 raft_consensus.cc:697] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 2 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:09.442932  3287 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:09.443066  3442 consensus_queue.cc:237] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:09.435436  2294 leader_election.cc:304] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:09.391757  3337 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:09.412925  3410 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 12:59:09.446581  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:09.411931  3447 raft_consensus.cc:2804] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:09.448001  3287 raft_consensus.cc:2804] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:09.449729  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:09.328900  3437 raft_consensus.cc:515] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:09.450598  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:09.444478  3367 leader_election.cc:290] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:09.415376  3347 raft_consensus.cc:493] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:09.451196  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:09.437637  3458 raft_consensus.cc:493] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.431321  3411 raft_consensus.cc:493] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:09.422490  3467 raft_consensus.cc:493] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
W20260709 12:59:09.493012  3457 log.cc:927] Time spent T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 12:59:09.547770  1651 raft_consensus.cc:3060] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:09.503723  3415 leader_election.cc:290] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:09.555138  3347 raft_consensus.cc:3060] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:09.504518  3338 raft_consensus.cc:2804] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:09.519929  3447 raft_consensus.cc:697] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:09.559021  3338 raft_consensus.cc:697] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 2 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
W20260709 12:59:09.523429  3264 consensus_meta.cc:287] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.527s	user 0.006s	sys 0.003s
I20260709 12:59:09.559953  1723 raft_consensus.cc:2468] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 2.
I20260709 12:59:09.501434  3286 leader_election.cc:290] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:09.449746  3451 leader_election.cc:290] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:09.495103  3301 raft_consensus.cc:515] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:09.432509  3421 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:09.558487  1716 raft_consensus.cc:2368] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 2. Current term is 3.
W20260709 12:59:09.493767  3431 consensus_meta.cc:287] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.837s	user 0.011s	sys 0.001s
W20260709 12:59:09.489732  3308 consensus_meta.cc:287] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.712s	user 0.008s	sys 0.004s
I20260709 12:59:09.563951  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:09.416293  3381 consensus_queue.cc:237] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:09.436254  3414 leader_election.cc:290] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:59:09.520489  3297 consensus_meta.cc:287] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 1.022s	user 0.012s	sys 0.000s
I20260709 12:59:09.571376  3431 raft_consensus.cc:515] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:09.567065  1643 raft_consensus.cc:1275] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:09.580438  3431 leader_election.cc:290] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:09.581254  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:59:09.522805  3283 consensus_meta.cc:287] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.866s	user 0.003s	sys 0.008s
I20260709 12:59:09.439536  3276 leader_election.cc:290] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:09.570645  2324 raft_consensus.cc:2393] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 4: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 12:59:09.490007  3327 leader_election.cc:290] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:09.486613  3449 leader_election.cc:290] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:09.561986  3411 raft_consensus.cc:3060] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:09.573743  3421 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:09.500871  3273 leader_election.cc:290] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:09.520728  3370 leader_election.cc:290] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:09.578363  3297 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:09.495626  3316 leader_election.cc:290] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:09.577488  1648 raft_consensus.cc:2468] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 2.
I20260709 12:59:09.500882  3363 leader_election.cc:290] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:09.580772  3447 consensus_queue.cc:237] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:09.560103  3338 consensus_queue.cc:237] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:09.602830  1651 raft_consensus.cc:2468] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 3.
I20260709 12:59:09.591410  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:09.609642  2297 leader_election.cc:304] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:09.613009  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:09.613631  3415 raft_consensus.cc:493] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:09.614172  3459 raft_consensus.cc:493] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:09.615825  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:09.665616  1720 raft_consensus.cc:2468] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 3.
W20260709 12:59:09.641093  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:09.666735  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:09.558615  3287 raft_consensus.cc:493] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:09.442942  3416 leader_election.cc:290] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:09.661700  1643 raft_consensus.cc:3060] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:09.490500  3364 consensus_queue.cc:237] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:09.545284  3397 consensus_queue.cc:237] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:09.667621  1540 leader_election.cc:304] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:09.667999  3437 leader_election.cc:290] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:09.564040  3458 raft_consensus.cc:515] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:09.576736  3377 raft_consensus.cc:493] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:09.669935  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 311549us
W20260709 12:59:09.670651  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 61139.4us
I20260709 12:59:09.673969  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:09.610448  3327 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.595229  3337 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:09.326514  3368 rpcz_store.cc:276] 0709 12:59:07.037571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:07.037776 (+   205us) service_pool.cc:224] Handling call
0709 12:59:07.234144 (+196368us) ts_tablet_manager.cc:934] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 05476b84d8f84d76a9a1f51b620a3c66: Initiating tablet copy from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373)
0709 12:59:07.841633 (+607489us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:59:08.376927 (+535294us) tablet_metadata.cc:665] Metadata flushed
0709 12:59:08.377066 (+   139us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:59:09.057449 (+680383us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:59:09.121164 (+ 63715us) tablet_replica.cc:206] Creating consensus instance
0709 12:59:09.230578 (+109414us) ts_tablet_manager.cc:989] Replica registered.
0709 12:59:09.235130 (+  4552us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":1595,"tablet-copy.queue_time_us":109019,"thread_start_us":315003,"threads_started":2}
I20260709 12:59:09.684949  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:09.676044  3363 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.697197  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:09.696951  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:09.697535  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:09.676489  3287 raft_consensus.cc:3060] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:09.657956  3283 raft_consensus.cc:2749] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391) with higher term. Message: Invalid argument: T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 3. Current term is 4.
I20260709 12:59:09.712201  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:09.725946  1649 raft_consensus.cc:2393] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 4: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:59:09.718294  2329 raft_consensus.cc:2468] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 2.
I20260709 12:59:09.695258  2297 leader_election.cc:304] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 12:59:09.675428  3415 raft_consensus.cc:515] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:09.722929  1615 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:09.727795  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:09.725158  1643 raft_consensus.cc:2468] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 4.
W20260709 12:59:09.713675  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 310322us
I20260709 12:59:09.564055  3467 raft_consensus.cc:515] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:09.692289  3370 raft_consensus.cc:2804] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:09.725431  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:09.731995  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:09.732873  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:09.733669  3301 leader_election.cc:290] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:09.734169  3379 raft_consensus.cc:3060] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:09.699349  3332 raft_consensus.cc:493] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:09.734781  3299 leader_election.cc:290] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:09.712577  3469 raft_consensus.cc:2804] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:09.740087  2328 raft_consensus.cc:2468] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 3.
I20260709 12:59:09.692093  3273 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:09.726200  3368 tablet_copy_client.cc:806] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:09.710773  3377 raft_consensus.cc:515] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:09.739145  3414 raft_consensus.cc:2804] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:09.714423  3276 consensus_queue.cc:1048] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:59:09.771677  3469 raft_consensus.cc:493] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:09.779191  3469 raft_consensus.cc:3060] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:09.769644  3439 consensus_meta.cc:287] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.803s	user 0.009s	sys 0.002s
I20260709 12:59:09.770174  3273 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:09.724906  3363 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:09.721105  3327 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:09.775131  2323 raft_consensus.cc:2393] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 2: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 12:59:09.765913  3332 raft_consensus.cc:515] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:09.738111  3370 raft_consensus.cc:493] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:09.675791  3459 raft_consensus.cc:515] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:09.772385  3372 consensus_meta.cc:287] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.721s	user 0.012s	sys 0.003s
I20260709 12:59:09.774430  3414 raft_consensus.cc:493] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:09.740489  3477 raft_consensus.cc:493] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:09.747078  2327 raft_consensus.cc:2468] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 2.
I20260709 12:59:09.787570  1689 leader_election.cc:304] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:09.770742  3474 raft_consensus.cc:493] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:09.780128  3368 tablet_copy_client.cc:670] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:09.795475  1725 raft_consensus.cc:2468] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 4.
I20260709 12:59:09.782120  3439 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:09.803974  3439 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:09.804577  1567 raft_consensus.cc:3060] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:09.805085  3297 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:09.805315  3442 consensus_queue.cc:1059] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:09.791662  3370 raft_consensus.cc:3060] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:09.814471  1615 leader_election.cc:304] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:09.797887  3414 raft_consensus.cc:3060] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:09.817247  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:09.817937  1615 leader_election.cc:304] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:09.819718  1649 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:09.826745  1567 raft_consensus.cc:2468] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 3.
W20260709 12:59:09.815310  3371 consensus_meta.cc:287] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.686s	user 0.007s	sys 0.004s
I20260709 12:59:09.829432  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:09.829548  1649 raft_consensus.cc:2468] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 3.
I20260709 12:59:09.808208  3264 raft_consensus.cc:2804] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:09.833881  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:09.833158  3467 leader_election.cc:290] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:09.812458  3258 raft_consensus.cc:493] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:09.798579  3372 raft_consensus.cc:515] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:09.824707  3308 raft_consensus.cc:2804] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:09.827472  3337 raft_consensus.cc:2804] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:09.823434  3439 raft_consensus.cc:493] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:09.830981  3273 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:09.835768  3264 raft_consensus.cc:493] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:09.801972  3477 raft_consensus.cc:515] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:09.850854  2323 raft_consensus.cc:2368] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 2. Current term is 3.
I20260709 12:59:09.851055  3264 raft_consensus.cc:3060] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:09.848800  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:09.837082  3470 raft_consensus.cc:493] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.827680  3388 raft_consensus.cc:515] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:09.857450  1651 raft_consensus.cc:3060] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:09.845917  3308 raft_consensus.cc:493] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:09.848766  3337 raft_consensus.cc:493] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:09.847234  3421 raft_consensus.cc:493] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:09.808638  3474 raft_consensus.cc:515] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:09.868289  1646 raft_consensus.cc:2368] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 4. Current term is 5.
W20260709 12:59:09.867302  3480 log.cc:927] Time spent T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:59:09.847481  3258 raft_consensus.cc:515] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:09.863452  2327 raft_consensus.cc:2393] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 2: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 12:59:09.862279  3337 raft_consensus.cc:3060] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:09.865340  3421 raft_consensus.cc:515] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:09.860873  3308 raft_consensus.cc:3060] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:09.870347  1651 raft_consensus.cc:2468] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 3.
I20260709 12:59:09.865098  3415 leader_election.cc:290] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:09.878840  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:09.890311  1573 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 4.
I20260709 12:59:09.853024  3439 raft_consensus.cc:515] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:09.887251  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:09.894228  1648 raft_consensus.cc:3060] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:09.849172  3287 raft_consensus.cc:515] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:09.892344  1615 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:09.896270  3459 leader_election.cc:290] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:09.896257  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:09.884431  3326 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:09.887180  3273 raft_consensus.cc:493] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:09.906675  1648 raft_consensus.cc:2468] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 4.
I20260709 12:59:09.900517  2332 raft_consensus.cc:2468] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 3.
I20260709 12:59:09.893661  3377 leader_election.cc:290] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:09.923949  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:09.925336  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:09.926204  1648 raft_consensus.cc:2468] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 2.
I20260709 12:59:09.929800  3421 leader_election.cc:290] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:09.930011  3258 leader_election.cc:290] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:09.930419  3421 raft_consensus.cc:493] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:09.930976  3421 raft_consensus.cc:515] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:09.908931  3458 leader_election.cc:290] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:09.933063  3477 leader_election.cc:290] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:09.907893  3276 raft_consensus.cc:2804] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:09.933715  3388 leader_election.cc:290] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:09.933920  3276 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:09.934361  3276 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:09.936240  3372 leader_election.cc:290] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:09.919039  3415 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:09.937614  3415 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:09.939635  3415 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:09.891954  3347 raft_consensus.cc:515] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:09.908514  3397 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:09.864467  3470 raft_consensus.cc:515] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:09.946285  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:09.953966  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:09.954443  1572 raft_consensus.cc:3060] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:09.948655  1540 leader_election.cc:304] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:09.957043  3258 raft_consensus.cc:2804] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:09.919447  3459 raft_consensus.cc:493] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:09.957970  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:09.958328  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:09.959314  1720 raft_consensus.cc:2393] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 4: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:59:09.947844  1573 raft_consensus.cc:2468] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 2.
I20260709 12:59:09.950956  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:09.960014  1723 raft_consensus.cc:2468] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 2.
I20260709 12:59:09.960178  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:09.960851  1719 raft_consensus.cc:2468] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 2.
I20260709 12:59:09.957476  1540 leader_election.cc:400] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 election: Vote denied by peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423) with higher term. Message: Invalid argument: T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 2. Current term is 3.
I20260709 12:59:09.961730  1540 leader_election.cc:403] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:59:09.964687  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:09.964020  1615 leader_election.cc:304] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:09.957971  3302 leader_election.cc:290] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:59:09.967003  3481 log.cc:927] Time spent T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:59:09.967859  3347 leader_election.cc:290] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:09.964901  3459 raft_consensus.cc:515] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:09.968501  3347 raft_consensus.cc:2749] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423) with higher term. Message: Invalid argument: T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 2. Current term is 3.
I20260709 12:59:09.968683  3388 raft_consensus.cc:2764] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 12:59:09.970453  3459 leader_election.cc:290] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:09.919132  3327 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:09.914126  3363 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:09.922068  3377 raft_consensus.cc:493] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:09.957516  3258 raft_consensus.cc:493] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:09.974224  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:09.941524  3477 raft_consensus.cc:493] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:09.974951  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:09.980715  2332 raft_consensus.cc:3060] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:59:09.980979  1719 raft_consensus.cc:2468] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 3.
I20260709 12:59:09.972813  1572 raft_consensus.cc:2468] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 5.
I20260709 12:59:09.913642  3273 raft_consensus.cc:515] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:09.978466  2297 leader_election.cc:304] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 12:59:09.983155  3258 raft_consensus.cc:3060] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:09.992272  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:09.982426  3377 raft_consensus.cc:515] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:10.011305  3287 leader_election.cc:290] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:09.953357  3397 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:10.018805  3411 raft_consensus.cc:515] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:10.031037  3377 leader_election.cc:290] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:10.032300  3483 log.cc:927] Time spent T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 12:59:10.032829  3411 leader_election.cc:290] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:10.019805  3264 raft_consensus.cc:515] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:10.033995  3415 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:10.034881  3264 leader_election.cc:290] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:10.037191  1718 raft_consensus.cc:2393] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 4: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:59:10.019984  2332 raft_consensus.cc:2468] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 3.
I20260709 12:59:09.986896  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:10.038818  1649 raft_consensus.cc:2468] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 4.
W20260709 12:59:10.023407  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 45054.9us
W20260709 12:59:10.039680  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 600478us
I20260709 12:59:10.040506  2297 leader_election.cc:304] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 12:59:10.041356  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:10.034550  3415 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:09.983693  1615 leader_election.cc:304] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 12:59:10.043972  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 60406.1us
I20260709 12:59:10.049388  3365 raft_consensus.cc:2804] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:10.049682  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:10.050585  2328 raft_consensus.cc:2468] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 2.
I20260709 12:59:10.031051  3397 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:10.007028  3477 raft_consensus.cc:515] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:10.053004  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:10.054497  3477 leader_election.cc:290] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:10.056700  3415 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:10.056866  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:10.021373  3337 raft_consensus.cc:515] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:10.059623  3337 leader_election.cc:290] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:10.060505  1689 leader_election.cc:400] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423) with higher term. Message: Invalid argument: T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 2. Current term is 3.
I20260709 12:59:10.061280  3273 leader_election.cc:290] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:10.062119  1689 leader_election.cc:304] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 12:59:10.062441  3439 leader_election.cc:290] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:10.062698  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:10.062923  3415 raft_consensus.cc:2804] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:10.063412  3415 raft_consensus.cc:493] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:10.024350  3327 raft_consensus.cc:493] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:10.063831  3415 raft_consensus.cc:3060] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:10.064296  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:10.064128  3327 raft_consensus.cc:515] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:10.065076  2323 raft_consensus.cc:2368] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 2. Current term is 3.
I20260709 12:59:10.064563  3370 raft_consensus.cc:515] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:10.015245  3474 leader_election.cc:290] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:10.066707  1617 leader_election.cc:304] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:10.067338  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:10.069154  1572 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 4.
I20260709 12:59:10.041206  3421 leader_election.cc:290] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:10.069769  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:10.070387  1721 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 3.
I20260709 12:59:10.070415  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:10.071291  3414 raft_consensus.cc:515] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:10.072559  3327 leader_election.cc:290] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:10.073499  3414 leader_election.cc:290] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:10.076881  3276 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:10.077941  3370 leader_election.cc:290] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:10.077978  3415 raft_consensus.cc:515] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:10.079769  3332 leader_election.cc:290] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:10.080360  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:10.081126  1725 raft_consensus.cc:2393] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 3: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:59:10.080965  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:10.081313  3411 raft_consensus.cc:2804] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:10.081638  1721 raft_consensus.cc:2393] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 3: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:59:10.081952  3411 raft_consensus.cc:493] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:10.082535  3411 raft_consensus.cc:3060] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:10.027315  3313 raft_consensus.cc:2804] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:10.084815  3313 raft_consensus.cc:493] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:10.085336  3313 raft_consensus.cc:3060] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:10.078667  3365 raft_consensus.cc:697] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 5 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:10.069787  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:10.089972  2328 raft_consensus.cc:2368] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 2. Current term is 3.
I20260709 12:59:10.090500  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:10.090735  1615 leader_election.cc:400] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 election: Vote denied by peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423) with higher term. Message: Invalid argument: T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 2. Current term is 3.
I20260709 12:59:10.091120  1719 raft_consensus.cc:2468] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 3.
I20260709 12:59:10.067709  2297 leader_election.cc:304] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 12:59:10.086694  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:10.092676  2325 raft_consensus.cc:1240] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:10.092878  2332 raft_consensus.cc:3060] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:10.092865  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:10.093657  1723 raft_consensus.cc:2468] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 1.
I20260709 12:59:10.088999  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:10.088027  1651 raft_consensus.cc:2368] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 4. Current term is 5.
I20260709 12:59:10.095527  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:10.096645  1720 raft_consensus.cc:2393] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 3: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:59:10.097479  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:10.101094  1724 raft_consensus.cc:2410] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:59:10.102241  1540 leader_election.cc:304] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:10.106751  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:10.107883  2330 raft_consensus.cc:2393] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 4: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 12:59:10.109279  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:10.110903  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:10.111707  1716 raft_consensus.cc:3060] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:59:10.114002  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:10.114830  2331 raft_consensus.cc:3060] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:10.106002  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:10.117563  2332 raft_consensus.cc:2468] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 4.
I20260709 12:59:10.120553  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:10.117398  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:10.115945  1615 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:10.122488  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:10.110474  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:10.125250  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:10.125967  1721 raft_consensus.cc:2468] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 2.
I20260709 12:59:10.126379  1617 leader_election.cc:400] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 pre-election: Vote denied by peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473) with higher term. Message: Invalid argument: T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 2. Current term is 3.
I20260709 12:59:10.132382  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:10.134689  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:10.135152  1542 leader_election.cc:304] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:59:10.135492  1650 raft_consensus.cc:3060] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:10.136809  1542 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:10.136858  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:10.137857  1719 raft_consensus.cc:3060] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:10.139673  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:10.139971  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:10.140033  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:10.140357  1576 raft_consensus.cc:2468] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 4.
I20260709 12:59:10.140839  1570 raft_consensus.cc:2393] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 3: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:10.140887  1721 raft_consensus.cc:3060] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:59:10.142019  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:10.142649  1570 raft_consensus.cc:2468] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 2.
I20260709 12:59:10.097126  3397 raft_consensus.cc:3060] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:10.144990  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:10.146409  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:10.146914  1717 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 3.
I20260709 12:59:10.148113  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:10.148667  1720 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 3.
I20260709 12:59:10.143678  3370 raft_consensus.cc:2804] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:10.151952  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:10.152865  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:10.149849  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:10.153518  1572 raft_consensus.cc:2468] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 4.
I20260709 12:59:10.119369  3414 raft_consensus.cc:2804] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:10.150147  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:10.149853  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:10.153810  1718 raft_consensus.cc:2368] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 2. Current term is 3.
I20260709 12:59:10.154621  1717 raft_consensus.cc:2393] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 3: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:59:10.157584  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:10.158535  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
W20260709 12:59:10.158977  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 118508us
I20260709 12:59:10.159372  1648 raft_consensus.cc:2393] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 3: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:10.159788  2295 leader_election.cc:304] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:10.160053  3489 raft_consensus.cc:2804] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:10.160614  3489 raft_consensus.cc:697] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:10.160698  3340 raft_consensus.cc:2749] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:10.161638  3489 consensus_queue.cc:237] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:10.162364  1615 leader_election.cc:304] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:10.163563  2295 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:10.164409  1721 raft_consensus.cc:2468] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 5.
I20260709 12:59:10.166649  2295 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:10.155361  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:10.168897  1570 raft_consensus.cc:2368] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 4. Current term is 5.
I20260709 12:59:10.171484  1650 raft_consensus.cc:2468] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 3.
I20260709 12:59:10.129756  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 12:59:10.179291  1689 consensus_peers.cc:597] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 -> Peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423): Couldn't send request to peer 05476b84d8f84d76a9a1f51b620a3c66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8e94ee9035214526808abfaab11799fe. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:10.179726  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:10.180095  1689 leader_election.cc:400] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423) with higher term. Message: Invalid argument: T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 2. Current term is 3.
I20260709 12:59:10.180661  1689 leader_election.cc:403] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:10.180706  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:10.175746  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:10.181690  1576 raft_consensus.cc:2468] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 1.
I20260709 12:59:10.176807  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:10.182108  1689 leader_election.cc:400] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 election: Vote denied by peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423) with higher term. Message: Invalid argument: T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 2. Current term is 3.
I20260709 12:59:10.176597  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:10.178144  3310 raft_consensus.cc:2804] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:10.131685  3372 raft_consensus.cc:2804] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:10.129988  3470 leader_election.cc:290] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:10.180934  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:10.181818  1573 raft_consensus.cc:2468] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 1.
I20260709 12:59:10.188403  1649 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 4.
I20260709 12:59:10.188607  1571 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:10.182466  1569 raft_consensus.cc:2468] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 3.
I20260709 12:59:10.189814  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:10.177430  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:10.174278  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:10.182924  1575 raft_consensus.cc:3060] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:10.191354  1570 raft_consensus.cc:2393] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 4: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:10.191354  2295 leader_election.cc:304] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:10.183108  1689 leader_election.cc:304] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 12:59:10.184506  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:10.193457  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:10.193938  1576 raft_consensus.cc:3060] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:10.183483  1720 raft_consensus.cc:2468] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 3.
I20260709 12:59:10.143738  3421 raft_consensus.cc:2804] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:10.164662  3415 leader_election.cc:290] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:10.197079  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:10.203639  1573 raft_consensus.cc:2393] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 4: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:10.202127  1576 raft_consensus.cc:2468] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 3.
I20260709 12:59:10.153651  3370 raft_consensus.cc:493] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:10.166561  3414 raft_consensus.cc:493] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:10.190661  1574 raft_consensus.cc:2468] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 1.
I20260709 12:59:10.217705  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:10.218562  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:10.218562  1642 raft_consensus.cc:2393] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 3: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:10.204655  2295 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:10.209012  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:10.183561  3458 raft_consensus.cc:2804] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:10.245581  1571 raft_consensus.cc:2468] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 3.
I20260709 12:59:10.236040  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:10.244477  1719 raft_consensus.cc:2468] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 4.
I20260709 12:59:10.265888  1575 raft_consensus.cc:2468] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 3.
I20260709 12:59:10.266141  1644 raft_consensus.cc:2368] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 2. Current term is 3.
I20260709 12:59:10.235626  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:10.235065  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:10.266927  1643 raft_consensus.cc:2468] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 3.
I20260709 12:59:10.192128  3372 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:10.267760  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:10.269474  1573 raft_consensus.cc:1275] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:59:10.269667  1643 raft_consensus.cc:2393] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 4: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:10.199103  3456 raft_consensus.cc:2804] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:10.200692  3421 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:10.272462  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:10.193842  3310 raft_consensus.cc:697] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:10.272310  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:10.271490  3297 raft_consensus.cc:2804] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:10.199930  3365 consensus_queue.cc:237] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:10.189142  3341 consensus_queue.cc:1059] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.088s
I20260709 12:59:10.306697  3310 consensus_queue.cc:237] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:10.268329  2323 raft_consensus.cc:2393] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 2: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 12:59:10.301442  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:10.228701  3299 raft_consensus.cc:2804] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:10.302992  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:10.303480  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:10.265161  3332 raft_consensus.cc:2804] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:10.305151  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:10.307387  3341 raft_consensus.cc:3055] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:10.309026  1573 raft_consensus.cc:3060] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:10.225587  3414 raft_consensus.cc:3060] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:10.301859  2331 raft_consensus.cc:2468] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 3.
I20260709 12:59:10.310985  1688 leader_election.cc:304] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:59:10.312819  2294 leader_election.cc:304] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:10.306348  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:10.321130  1716 raft_consensus.cc:2468] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 3.
I20260709 12:59:10.225386  3370 raft_consensus.cc:3060] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:59:10.303695  3469 consensus_meta.cc:287] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.524s	user 0.010s	sys 0.000s
I20260709 12:59:10.306206  3297 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:10.332969  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:10.271680  3372 raft_consensus.cc:3060] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:10.374393  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:10.318967  3299 raft_consensus.cc:493] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:10.305603  3421 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:10.274606  3415 raft_consensus.cc:493] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:10.379870  1572 raft_consensus.cc:3060] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:10.377571  1647 raft_consensus.cc:2468] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 2.
I20260709 12:59:10.376601  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:59:10.377255  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 66338.3us
W20260709 12:59:10.383822  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 71101us
I20260709 12:59:10.279230  3458 raft_consensus.cc:697] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:10.301949  3417 raft_consensus.cc:493] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:10.337568  3332 raft_consensus.cc:493] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:10.417912  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:10.331439  3456 raft_consensus.cc:697] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 4 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:10.336948  3276 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:10.374122  3448 raft_consensus.cc:493] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:10.416867  2294 leader_election.cc:304] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:10.384982  3299 raft_consensus.cc:3060] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:10.375869  3334 raft_consensus.cc:2749] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423) with higher term. Message: Invalid argument: T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 2. Current term is 3.
I20260709 12:59:10.385016  3323 raft_consensus.cc:2804] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:10.375398  3341 raft_consensus.cc:740] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:10.416667  3327 raft_consensus.cc:493] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:10.428382  3459 consensus_queue.cc:1048] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:59:10.377161  3488 raft_consensus.cc:493] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:10.431094  2294 leader_election.cc:304] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:10.389185  3326 raft_consensus.cc:2804] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:10.437906  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:10.441833  1539 leader_election.cc:304] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:10.443547  1573 raft_consensus.cc:2468] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 4.
I20260709 12:59:10.381721  3297 raft_consensus.cc:3060] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:10.467059  1539 leader_election.cc:400] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 election: Vote denied by peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391) with higher term. Message: Invalid argument: T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 2. Current term is 3.
I20260709 12:59:10.421109  3332 raft_consensus.cc:3060] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:10.454039  3477 raft_consensus.cc:493] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:10.375052  3308 raft_consensus.cc:515] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:10.386215  3469 raft_consensus.cc:515] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:10.418916  3415 raft_consensus.cc:515] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:10.469869  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:10.477488  1573 raft_consensus.cc:2393] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 4: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:10.478499  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:10.479677  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:10.470481  1539 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:59:10.483395  3273 raft_consensus.cc:2804] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:10.483893  3273 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:10.484387  3273 raft_consensus.cc:3060] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:10.469063  3477 raft_consensus.cc:515] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:10.486651  3477 leader_election.cc:290] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:10.488461  3308 leader_election.cc:290] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:10.488809  1645 raft_consensus.cc:2368] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 2. Current term is 3.
I20260709 12:59:10.469986  3488 raft_consensus.cc:515] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:10.491662  3488 leader_election.cc:290] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:10.471940  3439 raft_consensus.cc:2804] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:10.465708  3326 raft_consensus.cc:493] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:10.493276  3326 raft_consensus.cc:3060] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:10.494554  3469 leader_election.cc:290] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:10.494789  3460 raft_consensus.cc:3055] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:10.495332  3460 raft_consensus.cc:740] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:10.496802  2329 raft_consensus.cc:2368] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 3. Current term is 4.
I20260709 12:59:10.423877  3417 raft_consensus.cc:515] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:10.492887  3439 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:10.476451  2324 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53306 (request call id 465) took 1377 ms (client timeout 1574 ms). Trace:
I20260709 12:59:10.431085  3448 raft_consensus.cc:515] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:10.454262  3474 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:10.480489  1573 raft_consensus.cc:2393] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 4: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
W20260709 12:59:10.499433  2324 rpcz_store.cc:269] 0709 12:59:09.093337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:09.093455 (+   118us) service_pool.cc:224] Handling call
0709 12:59:10.470554 (+1377099us) spinlock_profiling.cc:243] Waited 449 ms on lock 0x7b54005aaad4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:10.470715 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1033141120}
I20260709 12:59:10.511438  3417 leader_election.cc:290] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:10.511617  3490 log.cc:927] Time spent T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.198s	user 0.002s	sys 0.000s
I20260709 12:59:10.513600  3292 raft_consensus.cc:3060] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:10.515353  3332 raft_consensus.cc:515] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:10.500778  3454 raft_consensus.cc:2804] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:10.496290  3460 consensus_queue.cc:260] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:10.517098  3474 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:10.517678  3460 raft_consensus.cc:3060] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:10.519207  3474 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:10.522121  3297 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:10.523655  1643 raft_consensus.cc:2393] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 5: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:10.460049  3327 raft_consensus.cc:515] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:10.476913  3258 raft_consensus.cc:515] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:10.504817  3469 raft_consensus.cc:2749] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:10.524823  3454 raft_consensus.cc:697] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:10.531348  3297 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:10.532680  1567 raft_consensus.cc:1240] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:10.556915  1542 leader_election.cc:304] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:10.559015  1572 raft_consensus.cc:2468] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 3.
I20260709 12:59:10.499790  3439 raft_consensus.cc:3060] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:10.536165  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 331587us
I20260709 12:59:10.561549  2295 leader_election.cc:304] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:10.564005  1617 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:10.567435  1542 leader_election.cc:304] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:10.569298  3273 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:10.570472  3411 raft_consensus.cc:515] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:10.571581  3273 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:10.573005  1722 raft_consensus.cc:2468] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 2.
I20260709 12:59:10.573220  3454 consensus_queue.cc:237] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:10.573834  3273 raft_consensus.cc:493] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:10.574136  3258 leader_election.cc:290] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:10.574321  3273 raft_consensus.cc:515] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:10.574801  1569 raft_consensus.cc:2468] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 3.
I20260709 12:59:10.575315  3466 raft_consensus.cc:493] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:10.575795  3466 raft_consensus.cc:515] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:10.506723  3458 consensus_queue.cc:237] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:10.577421  3467 raft_consensus.cc:2749] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:10.577562  3273 leader_election.cc:290] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:10.580859  3415 leader_election.cc:290] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:10.499778  3341 consensus_queue.cc:260] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:10.581657  3448 leader_election.cc:290] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:10.581992  3341 raft_consensus.cc:3060] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:10.501004  3456 consensus_queue.cc:237] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:10.590062  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45148 (request call id 1788) took 1030 ms. Trace:
I20260709 12:59:10.591922  2295 leader_election.cc:304] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:10.595033  2295 leader_election.cc:304] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:10.509344  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:10.597584  1573 raft_consensus.cc:3060] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:10.599601  1542 leader_election.cc:304] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:59:10.604449  1617 leader_election.cc:304] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 12:59:10.606527  1689 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:10.622864  1646 rpcz_store.cc:276] 0709 12:59:09.559744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:09.563685 (+  3941us) service_pool.cc:224] Handling call
0709 12:59:10.559609 (+995924us) spinlock_profiling.cc:243] Waited 296 ms on lock 0x7b5400174dd4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:10.589979 (+ 30370us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":680340864}
I20260709 12:59:10.625653  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:10.626736  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:10.627504  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:10.627697  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:10.628803  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:10.629524  1721 raft_consensus.cc:2393] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 4: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 12:59:10.484133  3313 raft_consensus.cc:515] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:10.635289  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:10.635907  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:10.630149  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:10.645406  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:10.645468  1723 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 3.
I20260709 12:59:10.646063  1716 raft_consensus.cc:2468] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 3.
I20260709 12:59:10.634541  1573 raft_consensus.cc:2468] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 4.
I20260709 12:59:10.645637  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:10.648115  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 12:59:10.650449  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 215513us
I20260709 12:59:10.650606  1573 raft_consensus.cc:3060] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:59:10.633635  1617 leader_election.cc:304] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:10.655380  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:10.657339  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:10.657788  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:10.593492  3488 raft_consensus.cc:2749] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:10.624061  3474 raft_consensus.cc:2804] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:59:10.661047  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 230612us
I20260709 12:59:10.635604  3297 raft_consensus.cc:2764] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:59:10.634654  3448 raft_consensus.cc:2804] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:10.629606  3301 raft_consensus.cc:2749] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:10.663615  1688 leader_election.cc:304] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:10.634999  3447 raft_consensus.cc:2804] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:10.664836  1573 raft_consensus.cc:2468] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 4.
I20260709 12:59:10.666069  2294 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:10.636461  3467 raft_consensus.cc:2749] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:10.634497  3273 raft_consensus.cc:493] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:10.674978  1617 leader_election.cc:400] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 election: Vote denied by peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473) with higher term. Message: Invalid argument: T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 2. Current term is 3.
I20260709 12:59:10.665107  3411 leader_election.cc:290] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:10.682276  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:10.683249  1688 leader_election.cc:304] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:10.687412  1576 raft_consensus.cc:1240] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 LEADER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 1. Current term is 3. Ops: []
I20260709 12:59:10.678530  3365 raft_consensus.cc:2749] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:10.688688  2327 raft_consensus.cc:2393] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 3: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
W20260709 12:59:10.688947  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:10.689287  3291 raft_consensus.cc:2804] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:10.691586  3326 raft_consensus.cc:515] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:10.693490  3421 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:10.697701  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:10.698392  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:10.665745  3474 raft_consensus.cc:493] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:10.713735  3474 raft_consensus.cc:3060] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:10.713815  3447 raft_consensus.cc:697] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:10.714778  3447 consensus_queue.cc:237] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:10.662529  3323 raft_consensus.cc:697] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 4 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:10.701701  1688 leader_election.cc:304] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:10.702275  2294 leader_election.cc:304] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:10.675601  3448 raft_consensus.cc:493] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:10.710918  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:59:10.721519  1691 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:10.711741  1721 raft_consensus.cc:3060] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:10.711889  1723 raft_consensus.cc:3060] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:10.708072  3412 raft_consensus.cc:2804] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:10.719005  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:10.720770  1724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1705) took 1480 ms. Trace:
I20260709 12:59:10.728099  1724 rpcz_store.cc:276] 0709 12:59:09.231864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:09.234203 (+  2339us) service_pool.cc:224] Handling call
0709 12:59:10.711929 (+1477726us) spinlock_profiling.cc:243] Waited 853 ms on lock 0x7b54000e29d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:10.712066 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1961214336}
I20260709 12:59:10.717228  3291 raft_consensus.cc:697] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 4 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:10.747812  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:10.733906  3321 raft_consensus.cc:2804] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:10.748714  3372 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:10.751611  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:10.751917  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:10.752414  2325 raft_consensus.cc:2368] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 2. Current term is 3.
I20260709 12:59:10.737115  3332 leader_election.cc:290] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:10.719964  3499 raft_consensus.cc:2804] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:10.743465  3414 raft_consensus.cc:515] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:10.727820  3448 raft_consensus.cc:3060] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:10.744714  3327 leader_election.cc:290] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:10.745865  3493 raft_consensus.cc:2804] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:59:10.746323  3397 consensus_meta.cc:287] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.593s	user 0.010s	sys 0.000s
I20260709 12:59:10.746970  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:10.747608  3370 raft_consensus.cc:515] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:10.749349  3321 raft_consensus.cc:697] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 3 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:10.748860  3291 consensus_queue.cc:237] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:10.740886  3323 consensus_queue.cc:237] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:10.767534  3397 raft_consensus.cc:2749] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:10.772995  3493 raft_consensus.cc:697] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:10.774674  3493 consensus_queue.cc:237] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:10.775328  2332 raft_consensus.cc:2368] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 3. Current term is 4.
I20260709 12:59:10.766379  3499 raft_consensus.cc:697] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:10.774178  3321 consensus_queue.cc:237] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:10.777364  3499 consensus_queue.cc:237] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:10.727368  3412 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:10.707211  3273 raft_consensus.cc:515] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:10.785414  3299 raft_consensus.cc:515] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:10.786126  3273 leader_election.cc:290] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:10.744047  3326 leader_election.cc:290] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:10.786460  3421 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:10.784336  3412 raft_consensus.cc:3060] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:10.787530  3299 leader_election.cc:290] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:10.780227  3466 leader_election.cc:290] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:10.772090  3414 leader_election.cc:290] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:10.796514  3448 raft_consensus.cc:515] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:10.796988  3370 leader_election.cc:290] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:10.796712  3474 raft_consensus.cc:515] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:10.800227  3474 leader_election.cc:290] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:08.919888   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:10.841756  1469 catalog_manager.cc:5697] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 2 to 3, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:10.850901  1573 raft_consensus.cc:3060] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:10.706820  1617 leader_election.cc:304] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:10.895399  1542 leader_election.cc:304] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
W20260709 12:59:10.898437  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 191517us
I20260709 12:59:10.861946  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 12:59:10.900449  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:10.901391  1575 raft_consensus.cc:2393] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 5: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:10.902771  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:10.903900  1575 raft_consensus.cc:3060] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:10.853480  1574 raft_consensus.cc:2393] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 5: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:10.757308  1723 raft_consensus.cc:2468] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 3.
I20260709 12:59:10.729363  1688 leader_election.cc:304] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:10.777637  2329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32870 (request call id 143) took 1050 ms. Trace:
I20260709 12:59:10.939976  2329 rpcz_store.cc:276] 0709 12:59:09.727302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:09.727443 (+   141us) service_pool.cc:224] Handling call
0709 12:59:10.777458 (+1050015us) spinlock_profiling.cc:243] Waited 768 ms on lock 0x7b5400599554. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:10.777585 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1766667648}
I20260709 12:59:10.760280  2324 raft_consensus.cc:2393] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 3: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:10.941963  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:10.751871  2297 leader_election.cc:304] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:10.943481  1716 raft_consensus.cc:2368] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 2. Current term is 3.
I20260709 12:59:10.945041  1722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1115) took 1709 ms. Trace:
W20260709 12:59:10.945712  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 193790us
I20260709 12:59:10.947227  3327 raft_consensus.cc:2749] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:10.847821  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:10.948787  3332 raft_consensus.cc:493] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:10.949347  1568 raft_consensus.cc:2468] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 2.
I20260709 12:59:10.873481  2325 raft_consensus.cc:1240] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:10.949935  3332 raft_consensus.cc:515] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:10.873817  2326 raft_consensus.cc:1240] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:10.773588  3313 leader_election.cc:290] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:10.879109  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:10.953866  1615 leader_election.cc:304] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:10.879349  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:10.955399  3313 raft_consensus.cc:2804] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:10.955749  2328 raft_consensus.cc:2393] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 3: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 12:59:10.956796  3338 raft_consensus.cc:2804] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:10.957484  3338 raft_consensus.cc:697] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 3 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:10.957645  2330 raft_consensus.cc:1240] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 LEADER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:10.956235  3313 raft_consensus.cc:697] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
W20260709 12:59:10.958431  3517 log.cc:927] Time spent T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.150s	user 0.002s	sys 0.000s
I20260709 12:59:10.958917  3338 consensus_queue.cc:237] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:10.883256  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:10.883603  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:10.886128  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:10.888767  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:10.889576  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:10.891448  1472 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55626 (request call id 255) took 3759 ms. Trace:
I20260709 12:59:10.893059  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:10.870954  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:10.900130  1542 leader_election.cc:304] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:10.881042  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:10.904458  1721 raft_consensus.cc:2468] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 4.
I20260709 12:59:10.945562  1722 rpcz_store.cc:276] 0709 12:59:09.235334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:09.248233 (+ 12899us) service_pool.cc:224] Handling call
0709 12:59:10.935790 (+1687557us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b5400101654. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:10.944785 (+  8995us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3038823808}
I20260709 12:59:10.914310  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:10.898437  3273 raft_consensus.cc:493] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
W20260709 12:59:10.976856  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 76608.7us
W20260709 12:59:10.977499  3519 log.cc:927] Time spent T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 12:59:10.977819  3273 raft_consensus.cc:515] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:10.980822  3397 raft_consensus.cc:2749] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:10.983850  2295 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:10.801153  3372 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:10.975142  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:10.996495  1717 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:59:10.996912  1569 raft_consensus.cc:3060] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:10.997853  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:10.996069  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:10.996306  1651 raft_consensus.cc:2393] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 3: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:11.003213  1719 raft_consensus.cc:2393] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 3: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:59:11.004559  3369 raft_consensus.cc:493] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:11.006189  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:11.007022  1568 raft_consensus.cc:3060] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:11.009236  3464 raft_consensus.cc:2804] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:11.010303  2295 leader_election.cc:304] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:11.010712  3489 raft_consensus.cc:2749] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:59:11.012288  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 282813us
I20260709 12:59:11.014305  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:11.015512  1719 raft_consensus.cc:3060] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:59:11.015952  3368 tablet_copy_client.cc:538] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:10.996240  1643 raft_consensus.cc:3060] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:10.960474  3313 consensus_queue.cc:237] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:11.005404  3369 raft_consensus.cc:515] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:10.961120  1472 rpcz_store.cc:276] 0709 12:59:07.132135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:07.133021 (+   886us) service_pool.cc:224] Handling call
0709 12:59:10.891105 (+3758084us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:07.673423 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:07.710939 (+ 37516us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:07.710969 (+    30us) write_op.cc:435] Acquired schema lock
0709 12:59:07.710988 (+    19us) tablet.cc:662] Decoding operations
0709 12:59:07.751518 (+ 40530us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:07.764779 (+ 13261us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:07.766502 (+  1723us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:59:07.781423 (+ 14921us) tablet.cc:701] Row locks acquired
0709 12:59:07.781445 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:59:07.781578 (+   133us) write_op.cc:270] Start()
0709 12:59:07.781693 (+   115us) write_op.cc:276] Timestamp: P: 1783601947781534 usec, L: 0
0709 12:59:07.781712 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:59:07.782312 (+   600us) log.cc:844] Serialized 3642 byte log entry
0709 12:59:08.376720 (+594408us) op_driver.cc:464] REPLICATION: finished
0709 12:59:08.613163 (+236443us) write_op.cc:301] APPLY: starting
0709 12:59:08.613259 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:08.613541 (+   282us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:08.613680 (+   139us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:08.665899 (+ 52219us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:08.666201 (+   302us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 12:59:08.666277 (+    76us) write_op.cc:312] APPLY: finished
0709 12:59:08.666591 (+   314us) log.cc:844] Serialized 71 byte log entry
0709 12:59:08.666795 (+   204us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:08.669952 (+  3157us) write_op.cc:454] Released schema lock
0709 12:59:08.670029 (+    77us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:08.670476 (+   447us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:08.670519 (+    43us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":236150,"apply.run_cpu_time_us":3801,"apply.run_wall_time_us":57290,"num_ops":9,"prepare.queue_time_us":292183,"prepare.run_cpu_time_us":25401,"prepare.run_wall_time_us":180293,"raft.queue_time_us":222592,"raft.run_cpu_time_us":28176,"raft.run_wall_time_us":170838,"replication_time_us":594793,"thread_start_us":576516,"threads_started":4,"wal-append.queue_time_us":255517,"wal-append.run_cpu_time_us":55468,"wal-append.run_wall_time_us":1744388}]]}
I20260709 12:59:11.016462  1688 leader_election.cc:400] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391) with higher term. Message: Invalid argument: T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 4. Current term is 5.
W20260709 12:59:11.017674  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 117777us
I20260709 12:59:11.017298  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:11.029450  1571 raft_consensus.cc:3060] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:11.034647  1688 leader_election.cc:403] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:11.021028  1723 raft_consensus.cc:3060] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:59:11.033317  1720 raft_consensus.cc:1275] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:59:11.042848  1725 raft_consensus.cc:3060] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:11.015529  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:11.022364  3499 raft_consensus.cc:2804] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:11.048687  1574 raft_consensus.cc:3060] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:11.017284  3332 leader_election.cc:290] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:11.053234  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 85077.1us
I20260709 12:59:11.022493  3464 raft_consensus.cc:697] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:11.026798  3273 leader_election.cc:290] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:11.060700  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:11.062633  1573 raft_consensus.cc:2468] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 3.
I20260709 12:59:11.027062  3369 leader_election.cc:290] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:11.027813  3421 raft_consensus.cc:493] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:11.069582  1542 leader_election.cc:304] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:11.070065  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:11.071491  3412 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:11.077673  1717 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
I20260709 12:59:11.083173  1574 raft_consensus.cc:2468] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 3.
I20260709 12:59:11.084244  3323 raft_consensus.cc:2749] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391) with higher term. Message: Invalid argument: T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 4. Current term is 5.
I20260709 12:59:11.084313  1716 raft_consensus.cc:3060] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:11.065934  3499 raft_consensus.cc:697] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
W20260709 12:59:11.088883  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 55178.1us
I20260709 12:59:11.089617  3421 raft_consensus.cc:515] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 12:59:11.090685  2295 leader_election.cc:304] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:11.092036  3421 leader_election.cc:290] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:11.093075  3414 raft_consensus.cc:2804] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:11.093600  3414 raft_consensus.cc:697] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:11.094468  1688 leader_election.cc:400] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391) with higher term. Message: Invalid argument: T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 4. Current term is 5.
I20260709 12:59:11.094966  1688 leader_election.cc:403] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:11.094605  3414 consensus_queue.cc:237] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:11.096072  1688 leader_election.cc:400] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391) with higher term. Message: Invalid argument: T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 2. Current term is 3.
I20260709 12:59:11.096410  1688 leader_election.cc:403] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:11.097409  1688 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:11.098285  3291 raft_consensus.cc:2749] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391) with higher term. Message: Invalid argument: T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 4. Current term is 5.
I20260709 12:59:11.099524  1575 raft_consensus.cc:2468] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 4.
I20260709 12:59:11.099754  1643 raft_consensus.cc:2468] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 3.
I20260709 12:59:11.106665  3337 consensus_queue.cc:1059] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:11.107901  3388 raft_consensus.cc:493] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:11.108839  3366 raft_consensus.cc:3055] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:11.108560  3388 raft_consensus.cc:515] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:11.109229  3366 raft_consensus.cc:740] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:11.110332  3366 consensus_queue.cc:260] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:11.110872  3388 leader_election.cc:290] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:11.111496  3474 raft_consensus.cc:2749] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:11.111898  3467 raft_consensus.cc:493] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:11.112545  3467 raft_consensus.cc:515] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:11.105717  1569 raft_consensus.cc:2468] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 3.
I20260709 12:59:11.114655  3467 leader_election.cc:290] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:11.068719  3464 consensus_queue.cc:237] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:11.121284  3292 raft_consensus.cc:493] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:11.121973  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:11.121706  3499 consensus_queue.cc:237] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:11.122769  2324 raft_consensus.cc:2393] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 3: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:11.122097  3292 raft_consensus.cc:515] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:11.125818  3341 raft_consensus.cc:493] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:11.126192  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 78320.8us
I20260709 12:59:11.127143  1542 leader_election.cc:304] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:11.127864  3397 raft_consensus.cc:493] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:11.128552  3397 raft_consensus.cc:515] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:11.126633  3341 raft_consensus.cc:515] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:11.130750  3397 leader_election.cc:290] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:11.132709  1569 raft_consensus.cc:1240] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:59:11.136449  3341 leader_election.cc:290] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:11.136852  2294 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:11.138538  3447 raft_consensus.cc:2804] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:11.139235  3447 raft_consensus.cc:697] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:11.140900  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:11.141021  3447 consensus_queue.cc:237] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:11.141795  2297 leader_election.cc:304] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 12:59:11.143003  2325 raft_consensus.cc:1275] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:11.142023  2328 raft_consensus.cc:2368] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 2. Current term is 3.
I20260709 12:59:11.143668  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:11.136633  1568 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 5.
I20260709 12:59:11.086544  3273 raft_consensus.cc:493] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:11.145153  2295 leader_election.cc:304] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:11.152966  1725 raft_consensus.cc:2468] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 4.
W20260709 12:59:11.159929  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 62632.6us
W20260709 12:59:11.170907  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 43923.5us
I20260709 12:59:11.158979  1540 leader_election.cc:400] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 election: Vote denied by peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423) with higher term. Message: Invalid argument: T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 2. Current term is 3.
I20260709 12:59:11.172195  1540 leader_election.cc:403] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:59:11.176606  3493 raft_consensus.cc:2804] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:11.149399  3388 raft_consensus.cc:493] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:11.177673  3292 leader_election.cc:290] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:11.148518  3327 raft_consensus.cc:2749] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:11.178041  3388 raft_consensus.cc:515] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:11.181329  3523 log.cc:927] Time spent T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:59:11.183003  3455 raft_consensus.cc:493] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:11.183739  3455 raft_consensus.cc:515] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:11.184747  3341 raft_consensus.cc:2804] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:11.185215  3341 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:11.185648  3341 raft_consensus.cc:3060] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:11.188958  1574 raft_consensus.cc:1275] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:11.189738  3397 raft_consensus.cc:493] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
W20260709 12:59:11.190896  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 87269.1us
I20260709 12:59:11.197299  1571 raft_consensus.cc:2468] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 2.
W20260709 12:59:11.202844  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 147307us
I20260709 12:59:11.207293  1723 raft_consensus.cc:2468] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
I20260709 12:59:11.213402  1716 raft_consensus.cc:2468] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 3.
W20260709 12:59:11.217475  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 67297us
W20260709 12:59:11.184800  3439 consensus_meta.cc:287] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.550s	user 0.012s	sys 0.006s
W20260709 12:59:11.224720  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 177123us
I20260709 12:59:11.190505  3397 raft_consensus.cc:515] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:11.215881  3338 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:11.190738  3273 raft_consensus.cc:515] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:11.234804  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:11.235342  1651 raft_consensus.cc:2468] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 1.
I20260709 12:59:11.232825  1719 raft_consensus.cc:2468] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 3.
I20260709 12:59:11.228473  1617 leader_election.cc:304] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:11.237810  1542 leader_election.cc:304] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:11.239676  3466 raft_consensus.cc:2764] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:59:11.240032  3493 raft_consensus.cc:697] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:11.241496  1642 raft_consensus.cc:1275] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:11.241843  3493 consensus_queue.cc:237] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:11.243804  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:11.243423  3338 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:11.244414  1567 raft_consensus.cc:1240] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 2. Current term is 3. Ops: []
W20260709 12:59:11.244237  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 55003.5us
W20260709 12:59:11.245806  3522 log.cc:927] Time spent T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:59:11.246111  3303 consensus_queue.cc:1048] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:11.246562  3501 raft_consensus.cc:2804] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:11.246917  1569 raft_consensus.cc:1275] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:11.247166  2297 leader_election.cc:304] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:11.247972  3368 tablet_bootstrap.cc:492] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap starting.
I20260709 12:59:11.248493  3382 raft_consensus.cc:2749] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391) with higher term. Message: Invalid argument: T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 2. Current term is 3.
I20260709 12:59:11.226608  3327 raft_consensus.cc:2749] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423) with higher term. Message: Invalid argument: T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 2. Current term is 3.
I20260709 12:59:11.263726  3421 raft_consensus.cc:3060] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:11.265215  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:11.266273  1649 raft_consensus.cc:2368] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 2. Current term is 3.
I20260709 12:59:11.230958  3388 leader_election.cc:290] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:11.267846  3448 leader_election.cc:290] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:11.269080  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 51826.4us
I20260709 12:59:11.269954  1542 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:11.271644  1542 leader_election.cc:304] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
W20260709 12:59:11.272070  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 65290.2us
I20260709 12:59:11.272751  3448 raft_consensus.cc:2764] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:59:11.273352  1576 raft_consensus.cc:1275] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:59:11.272814  3474 raft_consensus.cc:2804] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:11.273949  3474 raft_consensus.cc:493] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:11.274427  3474 raft_consensus.cc:3060] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:11.274536  3532 raft_consensus.cc:2749] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:11.275525  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:11.276358  1650 raft_consensus.cc:2468] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 3.
I20260709 12:59:11.276973  3501 raft_consensus.cc:697] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:11.275689  3458 raft_consensus.cc:2804] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:11.277532  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:11.278124  3458 raft_consensus.cc:697] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:11.278172  3501 consensus_queue.cc:237] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:11.279284  3458 consensus_queue.cc:237] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:11.279805  1716 raft_consensus.cc:1275] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:59:11.280496  1716 pending_rounds.cc:85] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4: Aborting all ops after (but not including) 4
I20260709 12:59:11.280787  1716 pending_rounds.cc:107] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:59:11.281056  1716 raft_consensus.cc:2889] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:11.281255  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:11.228147  3439 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:11.286972  1647 raft_consensus.cc:1275] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:11.287501  1570 raft_consensus.cc:1240] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:11.293044  1643 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 1.
I20260709 12:59:11.296825  3529 ts_tablet_manager.cc:933] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66: Initiating tablet copy from peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:11.295430  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:11.298808  1647 raft_consensus.cc:2468] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 3.
I20260709 12:59:11.301957  1540 leader_election.cc:400] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 election: Vote denied by peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423) with higher term. Message: Invalid argument: T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 3. Current term is 4.
I20260709 12:59:11.302423  1540 leader_election.cc:403] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:59:11.303195  1648 raft_consensus.cc:1275] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:59:11.306734  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:11.307365  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:11.306833  3439 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:59:11.308602  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 46272.9us
I20260709 12:59:11.306820  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:11.310637  1689 leader_election.cc:304] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:11.310567  3323 consensus_queue.cc:1059] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:11.311606  3292 raft_consensus.cc:2749] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:11.312362  3292 raft_consensus.cc:3055] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:11.312740  3292 raft_consensus.cc:740] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:11.313761  3292 consensus_queue.cc:260] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:11.315157  3292 raft_consensus.cc:3060] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:11.317298  3338 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:11.317374  3273 leader_election.cc:290] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:11.319168  1542 leader_election.cc:304] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:11.320606  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:11.323000  3439 raft_consensus.cc:2749] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423) with higher term. Message: Invalid argument: T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 3. Current term is 4.
I20260709 12:59:11.322894  1643 raft_consensus.cc:2468] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 3.
I20260709 12:59:11.330140  1689 leader_election.cc:304] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:11.330616  1540 leader_election.cc:400] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423) with higher term. Message: Invalid argument: T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 3. Current term is 4.
I20260709 12:59:11.331094  1540 leader_election.cc:403] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:11.344682  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:11.350899  2295 leader_election.cc:304] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:11.342499  3273 raft_consensus.cc:493] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:11.362073  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 66686.6us
I20260709 12:59:11.346565  3397 leader_election.cc:290] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:11.369277  3264 raft_consensus.cc:2804] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:11.370100  3264 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:11.370692  3264 raft_consensus.cc:3060] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:11.371201  1647 raft_consensus.cc:2393] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 5: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:11.372843  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:11.373703  1643 raft_consensus.cc:2393] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 5: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:11.345687  3439 raft_consensus.cc:2749] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:59:11.378099  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:11.380919  1542 leader_election.cc:304] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:11.354764  3448 raft_consensus.cc:2749] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423) with higher term. Message: Invalid argument: T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 3. Current term is 4.
I20260709 12:59:11.371203  3455 leader_election.cc:290] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:11.372714  3366 raft_consensus.cc:3060] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:11.387311  3411 consensus_queue.cc:1048] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.084s
I20260709 12:59:11.390635  3529 tablet_copy_client.cc:323] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.195:45473
I20260709 12:59:11.391115  1572 raft_consensus.cc:1275] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:11.377137  3273 raft_consensus.cc:515] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:11.396339  1571 raft_consensus.cc:1275] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:59:11.396734  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 66337.9us
I20260709 12:59:11.378021  3421 raft_consensus.cc:2749] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:11.398126  1540 leader_election.cc:400] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 election: Vote denied by peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423) with higher term. Message: Invalid argument: T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 2. Current term is 3.
I20260709 12:59:11.398451  1540 leader_election.cc:403] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:59:11.399186  3489 consensus_queue.cc:1048] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:11.400664  3489 raft_consensus.cc:2749] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423) with higher term. Message: Invalid argument: T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 2. Current term is 3.
I20260709 12:59:11.400871  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:11.401674  1650 raft_consensus.cc:2468] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 2.
I20260709 12:59:11.385684  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:11.405201  1571 raft_consensus.cc:1275] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:11.406809  3412 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:11.366254  3414 raft_consensus.cc:2804] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:11.355341  3464 consensus_queue.cc:1048] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:59:11.382627  3327 raft_consensus.cc:2749] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:59:11.412703  1691 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:11.415316  3273 leader_election.cc:290] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:11.418783  3449 consensus_queue.cc:1048] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:11.419863  3297 consensus_queue.cc:1048] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:11.422655  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:11.424279  1649 raft_consensus.cc:1240] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:11.427273  3338 raft_consensus.cc:493] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:11.428682  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:11.429519  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:11.430305  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:11.388753  3341 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:11.435333  3303 consensus_queue.cc:1048] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:59:11.435803  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 58958.3us
W20260709 12:59:11.438014  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 125460us
I20260709 12:59:11.461612  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:11.449132  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:11.445537  1643 raft_consensus.cc:1275] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:11.469019  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:11.456869  3414 raft_consensus.cc:697] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:11.474269  1573 raft_consensus.cc:1275] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:11.476568  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:11.479416  1542 leader_election.cc:304] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
W20260709 12:59:11.480387  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:11.475430  1647 raft_consensus.cc:3060] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:11.482275  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:11.483330  3341 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:11.483265  3493 consensus_queue.cc:1048] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:11.487242  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:11.488174  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:11.488699  1539 leader_election.cc:400] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 election: Vote denied by peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391) with higher term. Message: Invalid argument: T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 2. Current term is 3.
I20260709 12:59:11.488816  1574 raft_consensus.cc:2468] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 3.
I20260709 12:59:11.489938  3341 raft_consensus.cc:493] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:11.490001  1539 leader_election.cc:304] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:11.490983  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:11.490792  3341 raft_consensus.cc:515] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:11.491226  1539 leader_election.cc:304] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:11.491994  3414 consensus_queue.cc:237] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:11.493235  1567 raft_consensus.cc:1275] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:11.494462  3341 leader_election.cc:290] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:11.496163  1539 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:11.504683  3499 consensus_queue.cc:1048] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:11.510492  3337 raft_consensus.cc:493] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:11.511257  3337 raft_consensus.cc:515] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:11.512161  3439 raft_consensus.cc:2804] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:11.512770  3439 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:11.513271  3439 raft_consensus.cc:3060] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:11.514839  1734 tablet_copy_service.cc:140] P 0c7751452c4b46afa95251b9df7169d4: Received BeginTabletCopySession request for tablet 8e94ee9035214526808abfaab11799fe from peer 05476b84d8f84d76a9a1f51b620a3c66 ({username='slave'} at 127.0.0.1:58782)
I20260709 12:59:11.515738  1734 tablet_copy_service.cc:161] P 0c7751452c4b46afa95251b9df7169d4: Beginning new tablet copy session on tablet 8e94ee9035214526808abfaab11799fe from peer 05476b84d8f84d76a9a1f51b620a3c66 at {username='slave'} at 127.0.0.1:58782: session id = 05476b84d8f84d76a9a1f51b620a3c66-8e94ee9035214526808abfaab11799fe
I20260709 12:59:11.502408  3327 raft_consensus.cc:2804] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:11.517305  3327 raft_consensus.cc:493] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:11.517642  1542 leader_election.cc:304] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:11.519243  1542 leader_election.cc:304] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:11.513433  3337 leader_election.cc:290] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:11.520503  3489 raft_consensus.cc:2749] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:11.521278  3489 raft_consensus.cc:2749] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:11.523663  3467 raft_consensus.cc:493] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:11.524279  3467 raft_consensus.cc:515] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:11.525444  3337 raft_consensus.cc:493] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:11.525254  3474 raft_consensus.cc:515] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:11.526302  3337 raft_consensus.cc:515] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:11.527886  3474 leader_election.cc:290] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:11.528682  1568 raft_consensus.cc:1240] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:11.515807  3496 consensus_queue.cc:1048] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 12:59:11.517786  3327 raft_consensus.cc:3060] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:11.502928  1571 raft_consensus.cc:2468] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 2.
I20260709 12:59:11.500445  3273 raft_consensus.cc:2804] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:11.543061  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:11.544493  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:11.547828  1716 raft_consensus.cc:1275] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:11.553118  1539 leader_election.cc:304] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 12:59:11.565842  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 90957.7us
I20260709 12:59:11.568006  3370 raft_consensus.cc:2749] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:11.550737  3297 consensus_queue.cc:1059] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:59:11.556753  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:11.569718  3297 raft_consensus.cc:3055] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:11.570315  3297 raft_consensus.cc:740] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:11.574448  3337 leader_election.cc:290] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:11.576440  1650 raft_consensus.cc:1275] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:59:11.577036  1650 pending_rounds.cc:85] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e: Aborting all ops after (but not including) 4
I20260709 12:59:11.577422  1650 pending_rounds.cc:107] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:59:11.577792  1650 raft_consensus.cc:2889] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:11.580922  1539 leader_election.cc:304] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:11.548823  3273 raft_consensus.cc:493] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:11.586445  1569 raft_consensus.cc:1275] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:11.546289  3338 raft_consensus.cc:515] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:11.589485  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 70392.1us
I20260709 12:59:11.590322  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:11.587869  3448 raft_consensus.cc:2804] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:11.592778  1615 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:11.593860  1571 raft_consensus.cc:1275] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:11.592216  3448 raft_consensus.cc:493] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:11.596794  3469 consensus_queue.cc:1048] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:59:11.597182  1569 raft_consensus.cc:1275] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:11.598671  3338 leader_election.cc:290] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:11.584257  3421 raft_consensus.cc:2804] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:11.587096  3273 raft_consensus.cc:3060] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:11.558398  3397 consensus_queue.cc:1059] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:59:11.612767  3338 consensus_queue.cc:1048] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:11.609736  3421 raft_consensus.cc:493] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:11.613801  1615 leader_election.cc:304] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:11.614199  3421 raft_consensus.cc:3060] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:11.614677  3338 consensus_queue.cc:1048] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:11.614823  3364 consensus_queue.cc:1048] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:11.615809  1615 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:59:11.616387  3364 raft_consensus.cc:2749] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:11.616782  3365 raft_consensus.cc:2804] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:11.617172  3365 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:11.617517  3365 raft_consensus.cc:3060] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:11.617444  3388 consensus_queue.cc:1059] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:11.604893  3303 consensus_queue.cc:1048] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:11.609941  1689 leader_election.cc:304] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
W20260709 12:59:11.648790  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 46506us
I20260709 12:59:11.602517  3448 raft_consensus.cc:3060] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:11.611836  3366 raft_consensus.cc:2804] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:11.571954  3297 consensus_queue.cc:260] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:11.592849  1734 tablet_copy_source_session.cc:215] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:11.644091  1716 raft_consensus.cc:1275] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:11.645443  3467 leader_election.cc:290] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:11.659543  1539 leader_election.cc:304] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:11.658640  3469 consensus_queue.cc:1048] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 12:59:11.664121  3365 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:11.665410  3370 raft_consensus.cc:2804] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:11.586724  3447 consensus_queue.cc:1048] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:59:11.648695  3338 raft_consensus.cc:3055] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:59:11.661162  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 45397.3us
I20260709 12:59:11.603873  3414 consensus_queue.cc:1048] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 12:59:11.680986  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:11.682626  1615 leader_election.cc:304] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:11.670454  3412 raft_consensus.cc:2764] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:59:11.671907  3366 raft_consensus.cc:697] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 5 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
W20260709 12:59:11.686689  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 93196.1us
I20260709 12:59:11.684473  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:11.688198  3365 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:11.676209  3370 raft_consensus.cc:493] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:11.678735  3338 raft_consensus.cc:740] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:11.697593  2325 raft_consensus.cc:1275] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:11.697876  1689 leader_election.cc:304] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:11.674685  3469 consensus_queue.cc:1048] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:59:11.697647  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:11.694516  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:11.689381  3337 raft_consensus.cc:2804] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:11.701795  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:11.700291  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:11.707744  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:11.711643  3264 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:11.712864  3542 log.cc:927] Time spent T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260709 12:59:11.712018  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:11.715199  1469 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48478 (request call id 172) took 4642 ms. Trace:
I20260709 12:59:11.696784  3370 raft_consensus.cc:3060] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:11.722067  1647 raft_consensus.cc:2468] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 4.
I20260709 12:59:11.715574  3365 consensus_queue.cc:1048] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:59:11.725572  1473 catalog_manager.cc:5697] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 2 to 3, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:11.732982  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:11.736332  1688 leader_election.cc:304] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:11.738232  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:11.748713  1646 raft_consensus.cc:2468] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 4.
I20260709 12:59:11.749768  3366 consensus_queue.cc:237] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:11.750778  3449 consensus_queue.cc:1048] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:11.750893  3338 consensus_queue.cc:260] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:11.715893  1469 rpcz_store.cc:276] 0709 12:59:07.073007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:07.073317 (+   310us) service_pool.cc:224] Handling call
0709 12:59:11.715109 (+4641792us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:11.131516 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:11.179631 (+ 48115us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:11.179703 (+    72us) write_op.cc:435] Acquired schema lock
0709 12:59:11.179729 (+    26us) tablet.cc:662] Decoding operations
0709 12:59:11.180317 (+   588us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:11.180443 (+   126us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:11.180494 (+    51us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:59:11.180924 (+   430us) tablet.cc:701] Row locks acquired
0709 12:59:11.180978 (+    54us) write_op.cc:260] PREPARE: finished
0709 12:59:11.181197 (+   219us) write_op.cc:270] Start()
0709 12:59:11.181363 (+   166us) write_op.cc:276] Timestamp: P: 1783601951181117 usec, L: 0
0709 12:59:11.181406 (+    43us) op_driver.cc:348] REPLICATION: starting
0709 12:59:11.182202 (+   796us) log.cc:844] Serialized 536 byte log entry
0709 12:59:11.485937 (+303735us) op_driver.cc:464] REPLICATION: finished
0709 12:59:11.576869 (+ 90932us) write_op.cc:301] APPLY: starting
0709 12:59:11.576948 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:11.577060 (+   112us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:11.577192 (+   132us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:11.577506 (+   314us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:11.577755 (+   249us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:59:11.577820 (+    65us) write_op.cc:312] APPLY: finished
0709 12:59:11.592290 (+ 14470us) log.cc:844] Serialized 23 byte log entry
0709 12:59:11.600977 (+  8687us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:11.604275 (+  3298us) write_op.cc:454] Released schema lock
0709 12:59:11.609185 (+  4910us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:11.646940 (+ 37755us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:11.646980 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1966131,"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":90614,"apply.run_cpu_time_us":2657,"apply.run_wall_time_us":70054,"num_ops":1,"prepare.queue_time_us":227231,"prepare.run_cpu_time_us":40386,"prepare.run_wall_time_us":157714,"raft.queue_time_us":114937,"raft.run_cpu_time_us":30286,"raft.run_wall_time_us":69822,"replication_time_us":304348,"thread_start_us":378258,"threads_started":4,"wal-append.queue_time_us":160787}]]}
I20260709 12:59:11.706344  3337 raft_consensus.cc:493] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:11.759002  1649 raft_consensus.cc:1275] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:11.761593  1645 raft_consensus.cc:1275] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:11.759815  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:11.721184  3264 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:11.763477  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:11.738881  3412 raft_consensus.cc:2749] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:11.769713  1651 raft_consensus.cc:1240] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:59:11.770850  3338 raft_consensus.cc:3060] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:11.765272  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 67489.7us
I20260709 12:59:11.781368  1644 raft_consensus.cc:1275] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:59:11.712423  3327 raft_consensus.cc:515] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:11.763468  3337 raft_consensus.cc:3060] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:11.764932  3382 raft_consensus.cc:2749] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:11.788062  3448 raft_consensus.cc:515] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:11.793697  3439 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:11.795447  1615 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:11.798043  1573 raft_consensus.cc:1275] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:11.812386  3467 raft_consensus.cc:2749] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:59:11.819247  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 129326us
I20260709 12:59:11.766883  3421 raft_consensus.cc:515] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:11.782688  3493 consensus_queue.cc:1048] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:59:11.846935  1539 leader_election.cc:304] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 12:59:11.853637  1691 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:11.804461  3499 consensus_queue.cc:1048] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:59:11.805032  3303 consensus_queue.cc:1048] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:59:11.808379  3501 consensus_queue.cc:1059] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
W20260709 12:59:11.871107  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 48133.9us
I20260709 12:59:11.842106  3447 consensus_queue.cc:1048] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:59:11.879439  1689 leader_election.cc:304] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:11.907626  3556 raft_consensus.cc:2804] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:11.908294  1688 leader_election.cc:304] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
W20260709 12:59:11.886042  3555 log.cc:927] Time spent T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:59:11.913177  1689 leader_election.cc:400] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373) with higher term. Message: Invalid argument: T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 4. Current term is 5.
W20260709 12:59:11.909575  3560 log.cc:927] Time spent T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 12:59:11.908361  3556 raft_consensus.cc:697] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:11.924805  1689 leader_election.cc:304] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:11.928606  3323 raft_consensus.cc:2749] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:11.923867  3556 consensus_queue.cc:237] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:11.934231  1575 raft_consensus.cc:1275] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:11.935779  1689 leader_election.cc:304] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:59:11.937031  3439 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:11.938143  3291 raft_consensus.cc:2764] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:59:11.939254  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:11.910873  3466 raft_consensus.cc:2749] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:11.900069  3397 raft_consensus.cc:493] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:11.919495  3455 raft_consensus.cc:2804] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:11.920348  3412 consensus_queue.cc:1048] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 12:59:11.958666  3455 raft_consensus.cc:493] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:11.977059  3563 log.cc:927] Time spent T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.165s	user 0.002s	sys 0.000s
I20260709 12:59:11.968823  3264 consensus_queue.cc:1048] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:59:11.974869  3327 leader_election.cc:290] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:59:11.981501  1542 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.689s (SENT) [suppressed 6 similar messages]
I20260709 12:59:11.980592  3455 raft_consensus.cc:3060] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:11.966979  3397 raft_consensus.cc:515] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:12.006253  3337 raft_consensus.cc:515] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:12.020807  1720 raft_consensus.cc:1275] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:12.020602  1576 raft_consensus.cc:1275] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:59:12.032938  2295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:12.018376  3464 consensus_queue.cc:1048] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:59:12.078860  1648 raft_consensus.cc:1275] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
W20260709 12:59:12.380606  3572 log.cc:927] Time spent T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.301s	user 0.000s	sys 0.001s
I20260709 12:59:12.437812  1648 pending_rounds.cc:85] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e: Aborting all ops after (but not including) 4
I20260709 12:59:12.438246  1648 pending_rounds.cc:107] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:59:12.438586  1648 raft_consensus.cc:2889] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:59:12.394507  3573 log.cc:927] Time spent T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
W20260709 12:59:12.091706  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:12.410279  3370 consensus_meta.cc:287] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.691s	user 0.013s	sys 0.000s
I20260709 12:59:12.440912  3370 raft_consensus.cc:515] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:12.443807  3370 leader_election.cc:290] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:12.437276  3397 leader_election.cc:290] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:59:12.318411  3569 log.cc:927] Time spent T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.283s	user 0.001s	sys 0.000s
I20260709 12:59:12.283649  3337 leader_election.cc:290] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:59:12.450978  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 113837us
I20260709 12:59:12.453433  1689 leader_election.cc:304] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:12.455262  3576 raft_consensus.cc:2749] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:12.457518  1689 leader_election.cc:304] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:12.034866  1719 raft_consensus.cc:1275] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:59:12.208741  3273 consensus_meta.cc:287] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.588s	user 0.009s	sys 0.002s
I20260709 12:59:12.494383  3368 tablet_bootstrap.cc:492] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:59:12.495471  1721 raft_consensus.cc:1275] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:12.503401  3368 tablet_bootstrap.cc:492] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap complete.
I20260709 12:59:12.251080  3365 raft_consensus.cc:493] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:12.430894  3455 raft_consensus.cc:515] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:12.533110  3365 raft_consensus.cc:515] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:12.528407  3368 ts_tablet_manager.cc:1403] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 05476b84d8f84d76a9a1f51b620a3c66: Time spent bootstrapping tablet: real 1.281s	user 0.031s	sys 0.066s
I20260709 12:59:12.566437  3455 leader_election.cc:290] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:12.569242  3292 raft_consensus.cc:3060] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:12.265494  3323 raft_consensus.cc:2955] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
W20260709 12:59:12.582217  3554 log.cc:927] Time spent T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.756s	user 0.006s	sys 0.016s
I20260709 12:59:12.583909  1574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 269) took 1090 ms. Trace:
I20260709 12:59:12.584417  1574 rpcz_store.cc:276] 0709 12:59:11.493602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:11.493738 (+   136us) service_pool.cc:224] Handling call
0709 12:59:11.494033 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:11.509712 (+ 15679us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:11.509731 (+    19us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:11.552486 (+ 42755us) log.cc:844] Serialized 26 byte log entry
0709 12:59:11.675557 (+123071us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:11.676447 (+   890us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:11.676595 (+   148us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:12.519665 (+843070us) spinlock_profiling.cc:243] Waited 3.95 ms on lock 0x7b4400022b4c. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef1f4c85 00007fa9ef1f56a2 00007fa9f1f671db 00007fa9f1f62aaf 00007fa9f1f5686e 00007fa9f1f55bb6 00007fa9f1f557d8 00007fa9f1f5f221 00007fa9f1f5f1d9 00007fa9f1f5f169
0709 12:59:12.583540 (+ 63875us) raft_consensus.cc:1685] finished
0709 12:59:12.583570 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:12.583816 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4383,"raft.queue_time_us":15744,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":124,"spinlock_wait_cycles":9081728,"thread_start_us":91951,"threads_started":1,"wal-append.queue_time_us":138284}
I20260709 12:59:12.588835  3292 raft_consensus.cc:2749] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:12.589272  3556 raft_consensus.cc:493] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:12.590029  3556 raft_consensus.cc:515] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:12.592726  1650 raft_consensus.cc:1240] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:12.594220  3297 raft_consensus.cc:3060] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:12.594786  3556 leader_election.cc:290] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:12.594863  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:12.497571  3273 raft_consensus.cc:515] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:12.595674  1651 raft_consensus.cc:3060] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:12.598183  3273 leader_election.cc:290] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:12.563848  3368 raft_consensus.cc:359] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:12.599758  3411 raft_consensus.cc:3055] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:12.600206  3411 raft_consensus.cc:740] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:12.600332  3368 raft_consensus.cc:740] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Initialized, Role: LEARNER
I20260709 12:59:12.601238  3411 consensus_queue.cc:260] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:12.602535  3411 raft_consensus.cc:3060] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:12.601419  3368 consensus_queue.cc:260] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:59:12.602795  1643 raft_consensus.cc:2955] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:59:12.604668  3368 ts_tablet_manager.cc:1434] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 05476b84d8f84d76a9a1f51b620a3c66: Time spent starting tablet: real 0.070s	user 0.010s	sys 0.000s
I20260709 12:59:12.607772  3365 leader_election.cc:290] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:12.611716  1651 raft_consensus.cc:2468] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 5.
I20260709 12:59:12.623003  3421 leader_election.cc:290] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:59:12.635756  3550 log.cc:927] Time spent T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.842s	user 0.005s	sys 0.014s
W20260709 12:59:12.635883  3570 log.cc:927] Time spent T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.675s	user 0.010s	sys 0.010s
W20260709 12:59:12.647552  1647 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.017s	sys 0.027s
W20260709 12:59:12.648978  1647 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.017s	sys 0.028s
W20260709 12:59:12.658815  1724 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.000s	sys 0.016s
W20260709 12:59:12.659313  1724 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.000s	sys 0.016s
W20260709 12:59:12.660054  1542 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.002s	sys 0.013s
W20260709 12:59:12.661219  1617 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.002s	sys 0.013s
W20260709 12:59:12.665478  1617 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.002s	sys 0.013s
W20260709 12:59:12.660447  1542 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.002s	sys 0.013s
W20260709 12:59:12.666757  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 685216us
W20260709 12:59:12.661127  1616 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.009s	sys 0.007s
W20260709 12:59:12.683096  1616 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.009s	sys 0.007s
W20260709 12:59:12.665819  2294 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.003s	sys 0.013s
W20260709 12:59:12.684104  2294 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.003s	sys 0.013s
W20260709 12:59:12.684512  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 658039us
W20260709 12:59:12.686072  1716 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.010s	sys 0.006s
W20260709 12:59:12.686498  1716 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.010s	sys 0.006s
W20260709 12:59:12.693648  2297 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.000s	sys 0.016s
W20260709 12:59:12.658740  2296 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.001s	sys 0.014s
W20260709 12:59:12.697623  2297 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.000s	sys 0.017s
I20260709 12:59:12.649914  3365 raft_consensus.cc:493] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:12.701570  1723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 277) took 1180 ms. Trace:
I20260709 12:59:12.702160  1723 rpcz_store.cc:276] 0709 12:59:11.514075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:11.528433 (+ 14358us) service_pool.cc:224] Handling call
0709 12:59:11.528834 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:11.529261 (+   427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:11.529291 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:11.529802 (+   511us) log.cc:844] Serialized 26 byte log entry
0709 12:59:11.680601 (+150799us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:11.680637 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:11.680698 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:12.596914 (+916216us) spinlock_profiling.cc:243] Waited 8.59 ms on lock 0x7b4400022b4c. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef1f4c85 00007fa9ef1f56a2 00007fa9f1f671db 00007fa9f1f62aaf 00007fa9f1f5686e 00007fa9f1f55bb6 00007fa9f1f557d8 00007fa9f1f5f221 00007fa9f1f5f1d9 00007fa9f1f5f169
0709 12:59:12.686543 (+ 89629us) raft_consensus.cc:1685] finished
0709 12:59:12.686569 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:12.694200 (+  7631us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":126,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":106,"spinlock_wait_cycles":19750272,"thread_start_us":150448,"threads_started":1,"wal-append.queue_time_us":246793}
W20260709 12:59:12.700075  2296 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.002s	sys 0.015s
W20260709 12:59:12.692924  3332 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.007s	sys 0.011s
I20260709 12:59:12.709836  3365 raft_consensus.cc:515] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:12.766479  1570 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.007s	sys 0.015s
W20260709 12:59:12.778631  1570 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.007s	sys 0.015s
W20260709 12:59:12.778591  1575 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.013s	sys 0.102s
W20260709 12:59:12.786502  1575 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.014s	sys 0.102s
W20260709 12:59:12.773756  3332 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.008s	sys 0.011s
W20260709 12:59:12.797024  1645 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.736s	user 0.014s	sys 0.026s
W20260709 12:59:12.797713  2295 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.761s	user 0.012s	sys 0.033s
W20260709 12:59:12.797780  1645 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.014s	sys 0.026s
W20260709 12:59:12.798266  2295 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.012s	sys 0.033s
I20260709 12:59:12.774183  3292 raft_consensus.cc:493] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:12.803895  3292 raft_consensus.cc:515] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:12.799345  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:12.766868  1643 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05713611987147e49a96fdf32bb28649"
dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
mode: GRACEFUL
new_leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:35470
I20260709 12:59:12.812390  1643 raft_consensus.cc:606] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Received request to transfer leadership to TS 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:12.798194  3576 raft_consensus.cc:493] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:12.815218  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 357774us
W20260709 12:59:12.818806  3501 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.777s	user 0.021s	sys 0.023s
I20260709 12:59:12.818499  3529 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e94ee9035214526808abfaab11799fe. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:59:12.925441  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 83557.1us
I20260709 12:59:12.825814  3581 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:12.928684  1723 raft_consensus.cc:1240] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:12.835397  3421 raft_consensus.cc:493] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:12.927639  3273 raft_consensus.cc:493] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:12.900619  3501 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.862s	user 0.022s	sys 0.023s
I20260709 12:59:12.958257  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:12.959388  1723 raft_consensus.cc:2393] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 5: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:12.961647  3447 consensus_queue.cc:1048] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
W20260709 12:59:12.980052  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 173547us
W20260709 12:59:12.986167  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 219153us
I20260709 12:59:12.908484  3576 raft_consensus.cc:515] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:12.939184  3303 consensus_queue.cc:1048] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
W20260709 12:59:12.989029  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 170766us
I20260709 12:59:12.967729  3397 raft_consensus.cc:493] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:12.964378  3556 raft_consensus.cc:493] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
W20260709 12:59:12.980398  3558 log.cc:927] Time spent T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 1.186s	user 0.005s	sys 0.014s
I20260709 12:59:12.992337  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:12.995945  1719 raft_consensus.cc:2393] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 3: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 12:59:12.996833  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:12.997833  1723 raft_consensus.cc:2393] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 5: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:12.962095  3273 raft_consensus.cc:515] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:12.969727  3421 raft_consensus.cc:515] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:13.006096  1721 raft_consensus.cc:1275] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:13.009130  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:13.009775  1717 raft_consensus.cc:3060] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:12.956254  3581 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:13.001622  3595 raft_consensus.cc:493] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:13.001803  3489 raft_consensus.cc:493] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:13.023790  1722 raft_consensus.cc:1275] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:13.014165  3337 raft_consensus.cc:493] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:13.040153  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:13.040642  3579 raft_consensus.cc:493] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:13.041342  3579 raft_consensus.cc:515] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:13.043881  3579 leader_election.cc:290] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:13.024761  3292 leader_election.cc:290] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:13.044653  3365 leader_election.cc:290] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:59:13.046566  3582 log.cc:927] Time spent T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:59:13.046743  3273 leader_election.cc:290] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:13.047343  3273 raft_consensus.cc:493] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:13.047062  3337 raft_consensus.cc:515] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:13.002717  3397 raft_consensus.cc:515] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:13.048915  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:13.049532  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 286) took 1039 ms. Trace:
I20260709 12:59:13.073662  1571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 278) took 1412 ms. Trace:
I20260709 12:59:13.079988  1717 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 5.
I20260709 12:59:13.074275  1571 rpcz_store.cc:276] 0709 12:59:11.660796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:11.661956 (+  1160us) service_pool.cc:224] Handling call
0709 12:59:11.662300 (+   344us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:11.674238 (+ 11938us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:11.674282 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:11.688270 (+ 13988us) log.cc:844] Serialized 26 byte log entry
0709 12:59:11.753657 (+ 65387us) spinlock_profiling.cc:243] Waited 1.44 ms on lock 0x7b48000beed8. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f72e4aa1 00007fa9f72dbb37 00007fa9f72db9ca 00007fa9f73d326f 00007fa9f73d2f37 00007fa9f73e755c 00007fa9f73e7508 00007fa9f73e7488 00007fa9f73e7443 00007fa9f73e66ec 00007fa9f6310a96
0709 12:59:11.785884 (+ 32227us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:11.785934 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:11.786011 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:12.796206 (+1010195us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b4400022b4c. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef1f4c85 00007fa9ef1f56a2 00007fa9f1f671db 00007fa9f1f62aaf 00007fa9f1f5686e 00007fa9f1f55bb6 00007fa9f1f557d8 00007fa9f1f5f221 00007fa9f1f5f1d9 00007fa9f1f5f169
0709 12:59:13.073383 (+277177us) raft_consensus.cc:1685] finished
0709 12:59:13.073413 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:13.073586 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8435,"raft.run_cpu_time_us":1764,"raft.run_wall_time_us":76563,"spinlock_wait_cycles":27002624,"thread_start_us":97185,"threads_started":1,"wal-append.queue_time_us":95074}
I20260709 12:59:13.085376  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:59:13.086905  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 99500.4us
I20260709 12:59:13.082608  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:13.047899  3273 raft_consensus.cc:515] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:13.019507  3556 raft_consensus.cc:515] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:13.037932  3323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:58774 (request call id 13) took 4696 ms. Trace:
I20260709 12:59:13.064703  1570 rpcz_store.cc:276] 0709 12:59:12.010557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:12.010677 (+   120us) service_pool.cc:224] Handling call
0709 12:59:12.013578 (+  2901us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:12.024590 (+ 11012us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:12.024638 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:12.036415 (+ 11777us) log.cc:844] Serialized 26 byte log entry
0709 12:59:12.785622 (+749207us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:12.785685 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:12.785787 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:13.049335 (+263548us) raft_consensus.cc:1685] finished
0709 12:59:13.049355 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:13.049479 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6932,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":10581,"thread_start_us":723668,"threads_started":1,"wal-append.queue_time_us":887057}
I20260709 12:59:13.052637  3365 raft_consensus.cc:493] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:13.092175  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:59:13.094118  3585 log.cc:927] Time spent T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
W20260709 12:59:13.098721  3599 log.cc:927] Time spent T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:59:13.102711  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:13.102906  1586 tablet_copy_service.cc:342] P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Request end of tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-dfdb9ea6c3bf4001aeecb5c37e0d6baf received from {username='slave'} at 127.0.0.1:37682
I20260709 12:59:13.103646  1586 tablet_copy_service.cc:434] P 89ac9d5e2fbc4536b03a1ff1dd3eb226: ending tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-dfdb9ea6c3bf4001aeecb5c37e0d6baf on tablet dfdb9ea6c3bf4001aeecb5c37e0d6baf with peer 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:59:13.104105  3591 consensus_queue.cc:1048] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:59:13.105150  3600 log.cc:927] Time spent T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
W20260709 12:59:13.106036  3592 log.cc:927] Time spent T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
W20260709 12:59:13.106243  3604 log.cc:927] Time spent T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:59:13.107178  1716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 285) took 1098 ms. Trace:
I20260709 12:59:13.100837  3365 raft_consensus.cc:515] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:13.109300  3365 leader_election.cc:290] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:13.107700  1716 rpcz_store.cc:276] 0709 12:59:12.009215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:12.009448 (+   233us) service_pool.cc:224] Handling call
0709 12:59:12.009774 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:12.030085 (+ 20311us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:12.030113 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:12.045064 (+ 14951us) log.cc:844] Serialized 26 byte log entry
0709 12:59:12.686928 (+641864us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:12.686971 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:12.687045 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:13.106913 (+419868us) raft_consensus.cc:1685] finished
0709 12:59:13.106941 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:13.107111 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13082,"raft.queue_time_us":16635,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":11560,"thread_start_us":639524,"threads_started":1,"wal-append.queue_time_us":767224}
I20260709 12:59:13.110790  3576 leader_election.cc:290] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:13.114228  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:59:13.117959  3580 log.cc:927] Time spent T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.256s	user 0.000s	sys 0.001s
W20260709 12:59:13.119232  3557 log.cc:927] Time spent T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 1.333s	user 0.013s	sys 0.005s
I20260709 12:59:13.120311  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 277) took 1461 ms. Trace:
I20260709 12:59:13.114346  3397 leader_election.cc:290] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:13.105773  3591 consensus_queue.cc:1048] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:13.120684  1569 rpcz_store.cc:276] 0709 12:59:11.658544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:11.663915 (+  5371us) service_pool.cc:224] Handling call
0709 12:59:11.664234 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:11.664599 (+   365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:11.664624 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:11.665109 (+   485us) log.cc:844] Serialized 26 byte log entry
0709 12:59:11.760852 (+ 95743us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:11.760888 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:11.760960 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:13.023591 (+1262631us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x7b4400022b4c. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef1f4c85 00007fa9ef1f56a2 00007fa9f1f671db 00007fa9f1f62aaf 00007fa9f1f5686e 00007fa9f1f55bb6 00007fa9f1f557d8 00007fa9f1f5f221 00007fa9f1f5f1d9 00007fa9f1f5f169
0709 12:59:13.120011 (+ 96420us) raft_consensus.cc:1685] finished
0709 12:59:13.120042 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:13.120256 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2807,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":8881,"spinlock_wait_cycles":35413376,"thread_start_us":95390,"threads_started":1,"wal-append.queue_time_us":120944}
I20260709 12:59:13.124822  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 267) took 1237 ms. Trace:
I20260709 12:59:13.125357  1647 rpcz_store.cc:276] 0709 12:59:11.887164 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:11.887316 (+   152us) service_pool.cc:224] Handling call
0709 12:59:11.910429 (+ 23113us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:11.918367 (+  7938us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:11.918416 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:11.939144 (+ 20728us) log.cc:844] Serialized 26 byte log entry
0709 12:59:12.649583 (+710439us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:12.649634 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:12.649714 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:13.117283 (+467569us) spinlock_profiling.cc:243] Waited 4.23 ms on lock 0x7b4400022b4c. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef1f4c85 00007fa9ef1f56a2 00007fa9f1f671db 00007fa9f1f62aaf 00007fa9f1f5686e 00007fa9f1f55bb6 00007fa9f1f557d8 00007fa9f1f5f221 00007fa9f1f5f1d9 00007fa9f1f5f169
0709 12:59:13.120350 (+  3067us) raft_consensus.cc:1685] finished
0709 12:59:13.120373 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:13.124725 (+  4352us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1604,"raft.queue_time_us":7512,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":24794,"spinlock_wait_cycles":9722624,"thread_start_us":686143,"threads_started":1,"wal-append.queue_time_us":847881}
I20260709 12:59:13.127985  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 258) took 1371 ms. Trace:
I20260709 12:59:13.143505  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:13.131058  1645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45148 (request call id 1831) took 1089 ms. Trace:
I20260709 12:59:13.143169  1724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 288) took 1126 ms. Trace:
I20260709 12:59:13.146366  1645 rpcz_store.cc:276] 0709 12:59:12.031096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:12.031452 (+   356us) service_pool.cc:224] Handling call
0709 12:59:12.041751 (+ 10299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:12.809022 (+767271us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:12.809949 (+   927us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:12.816596 (+  6647us) log.cc:844] Serialized 26 byte log entry
0709 12:59:13.011618 (+195022us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:59:13.011653 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:13.011730 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:13.120717 (+108987us) raft_consensus.cc:1685] finished
0709 12:59:13.120738 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:13.120875 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":33571,"raft.run_cpu_time_us":306,"raft.run_wall_time_us":136193,"thread_start_us":822891,"threads_started":2,"wal-append.queue_time_us":250412}
I20260709 12:59:13.077404  3489 raft_consensus.cc:515] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:13.051752  3595 raft_consensus.cc:515] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:13.128504  1646 rpcz_store.cc:276] 0709 12:59:11.756656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:11.756769 (+   113us) service_pool.cc:224] Handling call
0709 12:59:11.765989 (+  9220us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:11.782042 (+ 16053us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:11.782072 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:11.794585 (+ 12513us) log.cc:844] Serialized 26 byte log entry
0709 12:59:12.495087 (+700502us) spinlock_profiling.cc:243] Waited 1.04 ms on lock 0x7b180026c4a0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef2b0e07 00007fa9f810bab9 00007fa9ef2cd69b 00007fa9ef2cb93f 00007fa9ef2cdc02 00007fa9f1f5520b 00007fa9f1f5ad23 00007fa9f1f5b0d1 00007fa9f2376a0f
0709 12:59:12.816313 (+321226us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:12.816371 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:12.816478 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:13.124022 (+307544us) raft_consensus.cc:1685] finished
0709 12:59:13.124047 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:13.127909 (+  3862us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17939,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":8802,"spinlock_wait_cycles":2387840,"thread_start_us":321014,"threads_started":1,"wal-append.queue_time_us":1196781}
I20260709 12:59:13.234241  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:13.195451  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:13.208858  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:59:13.222844  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 129156us
I20260709 12:59:13.178522  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:13.242038  1575 raft_consensus.cc:3060] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:13.196668  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:13.157023  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:13.231642  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:13.196249  1572 raft_consensus.cc:1275] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:59:13.246889  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:13.247511  1569 raft_consensus.cc:2468] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 4.
I20260709 12:59:13.258740  1568 raft_consensus.cc:2393] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 4: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:13.259194  1716 raft_consensus.cc:1275] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:13.240882  1576 raft_consensus.cc:2468] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 5.
W20260709 12:59:13.145344  3411 consensus_meta.cc:287] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.539s	user 0.012s	sys 0.001s
I20260709 12:59:13.280893  1574 raft_consensus.cc:2468] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 4.
I20260709 12:59:13.281087  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:13.285100  3612 raft_consensus.cc:493] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:13.285723  3612 raft_consensus.cc:515] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:13.286499  1718 raft_consensus.cc:1275] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:13.287436  3332 raft_consensus.cc:493] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:13.288062  3332 raft_consensus.cc:515] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:13.290081  3297 consensus_meta.cc:287] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.695s	user 0.012s	sys 0.000s
I20260709 12:59:13.290386  3332 leader_election.cc:290] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:13.285243  1725 raft_consensus.cc:1275] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:59:13.159013  3603 log.cc:927] Time spent T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:59:13.149255  1724 rpcz_store.cc:276] 0709 12:59:12.016772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:12.016924 (+   152us) service_pool.cc:224] Handling call
0709 12:59:12.026193 (+  9269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:12.045155 (+ 18962us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:12.045196 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:12.076164 (+ 30968us) log.cc:844] Serialized 26 byte log entry
0709 12:59:12.578214 (+502050us) spinlock_profiling.cc:243] Waited 4.33 ms on lock 0x7b4800240258. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f72e4aa1 00007fa9f72dbb37 00007fa9f72db9ca 00007fa9f73d326f 00007fa9f73d2f37 00007fa9f73e755c 00007fa9f73e7508 00007fa9f73e7488 00007fa9f73e7443 00007fa9f73e66ec 00007fa9f6310a96
0709 12:59:12.659769 (+ 81555us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:12.659843 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:12.659941 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:13.099153 (+439212us) raft_consensus.cc:1685] finished
0709 12:59:13.099172 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:13.143067 (+ 43895us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4327,"raft.queue_time_us":11000,"raft.run_cpu_time_us":19355,"raft.run_wall_time_us":537391,"spinlock_wait_cycles":9960192,"thread_start_us":546025,"threads_started":1,"wal-append.queue_time_us":695191}
I20260709 12:59:13.285637  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:59:13.294735  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 60127.8us
I20260709 12:59:13.292511  2324 raft_consensus.cc:2468] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 4.
I20260709 12:59:13.291851  1725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 290) took 1249 ms. Trace:
I20260709 12:59:13.193043  3421 leader_election.cc:290] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:13.177929  3608 raft_consensus.cc:493] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:13.296197  1725 rpcz_store.cc:276] 0709 12:59:12.042427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:12.042558 (+   131us) service_pool.cc:224] Handling call
0709 12:59:13.284698 (+1242140us) spinlock_profiling.cc:243] Waited 4.4 ms on lock 0x7b5800196e98. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef296b71 00007fa9ef296a22 00007fa9f81afc09 00007fa9f7309ee0 00007fa9f73d30ab 00007fa9f73d3131 00007fa9f7394fc0 00007fa9f737f929 00007fa9f737f3d2 00007fa9f08f6bd4
0709 12:59:13.284887 (+   189us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:13.291609 (+  6722us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:13.291796 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10109824}
I20260709 12:59:13.174540  3466 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:13.301882  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:13.157898  3556 leader_election.cc:290] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:13.288333  3612 leader_election.cc:290] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:13.177408  3581 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:13.299113  1615 leader_election.cc:304] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:13.176446  3273 leader_election.cc:290] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:13.174819  3547 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:13.308768  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:13.297657  3365 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
W20260709 12:59:13.350495  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 51496.9us
I20260709 12:59:13.311465  3466 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:13.308736  3608 raft_consensus.cc:515] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:13.601382  1575 raft_consensus.cc:2468] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 3.
I20260709 12:59:13.488440  3366 raft_consensus.cc:493] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:13.695936  3366 raft_consensus.cc:515] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:13.643757  3364 raft_consensus.cc:493] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:13.697474  3466 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:13.662276  3583 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:13.698148  3466 raft_consensus.cc:493] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:13.698596  3583 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:13.474440  1473 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55606 (request call id 268) took 5191 ms. Trace:
I20260709 12:59:13.355675  3547 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:13.700062  1473 rpcz_store.cc:276] 0709 12:59:08.283368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:08.283539 (+   171us) service_pool.cc:224] Handling call
0709 12:59:13.474351 (+5190812us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:11.752731 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:11.753237 (+   506us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:11.753271 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:59:11.753284 (+    13us) tablet.cc:662] Decoding operations
0709 12:59:11.753618 (+   334us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:11.753675 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:11.753708 (+    33us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:59:11.753883 (+   175us) tablet.cc:701] Row locks acquired
0709 12:59:11.753894 (+    11us) write_op.cc:260] PREPARE: finished
0709 12:59:11.754031 (+   137us) write_op.cc:270] Start()
0709 12:59:11.754131 (+   100us) write_op.cc:276] Timestamp: P: 1783601951753987 usec, L: 0
0709 12:59:11.754145 (+    14us) op_driver.cc:348] REPLICATION: starting
0709 12:59:11.754727 (+   582us) log.cc:844] Serialized 541 byte log entry
0709 12:59:11.768895 (+ 14168us) op_driver.cc:464] REPLICATION: finished
0709 12:59:11.769459 (+   564us) write_op.cc:301] APPLY: starting
0709 12:59:11.769539 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:11.769645 (+   106us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:11.769748 (+   103us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:11.770065 (+   317us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:11.770217 (+   152us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:59:11.770299 (+    82us) write_op.cc:312] APPLY: finished
0709 12:59:11.770463 (+   164us) log.cc:844] Serialized 23 byte log entry
0709 12:59:11.770615 (+   152us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:11.770697 (+    82us) write_op.cc:454] Released schema lock
0709 12:59:11.770730 (+    33us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:11.771065 (+   335us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:11.771098 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":7683,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":342,"apply.run_cpu_time_us":1551,"apply.run_wall_time_us":1552,"num_ops":1,"prepare.queue_time_us":15547,"prepare.run_cpu_time_us":2256,"prepare.run_wall_time_us":2256,"replication_time_us":9388}]]}
I20260709 12:59:13.635397  3581 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:13.397861  3332 raft_consensus.cc:493] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:13.419596  3397 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:13.708105  3397 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:13.707635  3332 raft_consensus.cc:515] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:13.354255  3467 raft_consensus.cc:2804] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:13.711053  3467 raft_consensus.cc:493] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
W20260709 12:59:13.356786  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 223455us
I20260709 12:59:13.712180  3467 raft_consensus.cc:3060] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:13.361387  3622 consensus_queue.cc:1048] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.334s
I20260709 12:59:13.595611  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:13.531216  3579 raft_consensus.cc:493] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:13.633026  3382 raft_consensus.cc:493] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:13.716421  3579 raft_consensus.cc:515] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:13.697844  3364 raft_consensus.cc:515] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:13.717312  3382 raft_consensus.cc:515] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:13.719547  3364 leader_election.cc:290] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:13.706099  3581 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:13.731956  3547 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:13.734509  3581 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:13.700968  3583 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:13.741686  3332 leader_election.cc:290] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:13.698715  3366 leader_election.cc:290] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:13.711140  3397 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:13.736213  3382 leader_election.cc:290] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:13.749540  3382 raft_consensus.cc:493] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:13.380497  3365 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:13.755754  3365 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:13.754299  3382 raft_consensus.cc:515] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:13.762264  1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:35470 (request call id 16) took 1061 ms. Trace:
I20260709 12:59:13.765196  3454 raft_consensus.cc:493] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:13.771479  3337 leader_election.cc:290] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:13.780709  3421 raft_consensus.cc:493] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:13.784731  3547 raft_consensus.cc:493] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:13.785590  3273 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:13.786561  3556 raft_consensus.cc:493] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:13.786898  3612 raft_consensus.cc:493] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:13.789742  3370 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:13.790931  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:13.792719  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:13.092955  3323 rpcz_store.cc:276] 0709 12:59:08.324674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:08.325062 (+   388us) service_pool.cc:224] Handling call
0709 12:59:08.627055 (+301993us) spinlock_profiling.cc:243] Waited 1.31 ms on lock 0x7b5400156920. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f2338520 00007fa9f23c1b42 00007fa9f23c0800 00007fa9f7381d29 00007fa9f09001d4 00007fa9f0900162 00007fa9f0900091 00007fa9f090000c 00007fa9f08ff2c2 00007fa9f06f648c
0709 12:59:09.035294 (+408239us) spinlock_profiling.cc:243] Waited 233 ms on lock 0x7b5800169ad0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23170aa 00007fa9f2399447 00007fa9f23b670a 00007fa9f23b776a 00007fa9f23b691b 00007fa9f23c203c 00007fa9f23c16b3 00007fa9f7381d29 00007fa9f09001d4 00007fa9f0900162
0709 12:59:09.071124 (+ 35830us) log.cc:844] Serialized 506 byte log entry
0709 12:59:10.164296 (+1093172us) spinlock_profiling.cc:243] Waited 8.76 ms on lock 0x7b4c00215c00. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f0687a20 00007fa9f0698a29 00007fa9f069913f 00007fa9f065d2ab 00007fa9f068af3c 00007fa9f068b3fe 00007fa9f091850b 00007fa9f2317381 00007fa9f231526b 00007fa9f231bd53 00007fa9f231bcd9
0709 12:59:13.016180 (+2851884us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25409,"raft.queue_time_us":173203,"raft.run_cpu_time_us":5391,"raft.run_wall_time_us":980076,"spinlock_wait_cycles":558121344,"thread_start_us":543665,"threads_started":3,"wal-append.queue_time_us":247533,"wal-append.run_cpu_time_us":5677,"wal-append.run_wall_time_us":1244861}
I20260709 12:59:13.842651  1646 raft_consensus.cc:2468] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 3.
I20260709 12:59:13.805051  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:13.698717  3466 raft_consensus.cc:515] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:13.807235  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:13.808117  1724 raft_consensus.cc:1275] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:59:13.808398  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:13.808743  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:13.881518  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:13.806916  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:13.808957  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:13.718818  3579 leader_election.cc:290] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:13.800798  3571 raft_consensus.cc:493] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:13.811442  3621 log.cc:927] Time spent T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.414s	user 0.000s	sys 0.000s
I20260709 12:59:13.801736  1718 raft_consensus.cc:1275] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:13.833110  3547 raft_consensus.cc:515] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:13.485633  3369 raft_consensus.cc:493] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:13.827787  1643 rpcz_store.cc:276] 0709 12:59:12.707003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:12.709872 (+  2869us) service_pool.cc:224] Handling call
0709 12:59:13.453715 (+743843us) spinlock_profiling.cc:243] Waited 29.5 ms on lock 0x7b5400110420. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f2338520 00007fa9f23b5652 00007fa9f738360a 00007fa9f09097d4 00007fa9f0909762 00007fa9f0909691 00007fa9f090960c 00007fa9f09088c2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:13.762160 (+308445us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67920256}
I20260709 12:59:13.841696  1649 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 5.
W20260709 12:59:13.863127  2294 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.000s	sys 0.039s
W20260709 12:59:13.901086  2294 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.000s	sys 0.039s
W20260709 12:59:13.901461  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 597437us
I20260709 12:59:13.840435  3612 raft_consensus.cc:515] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:13.913928  1716 raft_consensus.cc:2468] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 5.
I20260709 12:59:13.916314  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:13.917124  1719 raft_consensus.cc:2376] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 5. Re-sending same reply.
I20260709 12:59:13.839658  3273 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:13.922379  3273 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:13.838775  3421 raft_consensus.cc:515] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:13.931788  3466 leader_election.cc:290] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:13.837659  3454 raft_consensus.cc:515] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:13.934448  3454 leader_election.cc:290] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:13.934775  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:13.935536  1648 raft_consensus.cc:2468] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 4.
I20260709 12:59:13.941530  1643 raft_consensus.cc:1275] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:13.941749  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 12:59:13.936347  2326 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.007s	sys 0.026s
I20260709 12:59:13.880460  3556 raft_consensus.cc:515] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:13.943575  2326 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.007s	sys 0.026s
I20260709 12:59:13.945916  1719 raft_consensus.cc:2393] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 5: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:13.899374  3370 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:13.952841  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:13.954114  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:13.955041  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:13.926209  3337 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:13.960598  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:13.904440  3369 raft_consensus.cc:515] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:13.902757  3571 raft_consensus.cc:515] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:13.938553  3595 leader_election.cc:290] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:13.965719  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:13.967546  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:13.972983  1568 raft_consensus.cc:2410] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:59:13.980243  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:13.980137  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:13.983439  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 12:59:13.984158  1722 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.018s	sys 0.009s
W20260709 12:59:13.984565  1722 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.018s	sys 0.009s
I20260709 12:59:13.984400  1716 raft_consensus.cc:2393] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 5: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:13.986573  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:13.987129  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:13.986621  1719 raft_consensus.cc:2393] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 3: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 12:59:13.987888  1576 raft_consensus.cc:2468] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 4.
W20260709 12:59:13.989737  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 549162us
W20260709 12:59:13.991204  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 267816us
I20260709 12:59:13.993873  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 12:59:13.983985  3411 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.012s	sys 0.015s
I20260709 12:59:13.997419  1615 leader_election.cc:304] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:14.013623  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:13.981514  3365 raft_consensus.cc:493] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:14.015674  1576 raft_consensus.cc:2468] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 3.
I20260709 12:59:13.988768  3532 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:14.020790  1572 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.730s	user 0.001s	sys 0.013s
W20260709 12:59:14.014611  3411 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.012s	sys 0.016s
I20260709 12:59:14.025347  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:59:14.025278  1572 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.002s	sys 0.013s
W20260709 12:59:13.990411  3601 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.015s	sys 0.025s
W20260709 12:59:14.029827  3601 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.015s	sys 0.025s
W20260709 12:59:13.991621  2296 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.004s	sys 0.007s
I20260709 12:59:14.033321  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:14.037578  1615 leader_election.cc:304] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:13.974984  3337 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:14.056118  1615 leader_election.cc:304] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:14.058826  1615 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:14.015966  3624 raft_consensus.cc:493] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:14.058976  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:14.188468  3571 leader_election.cc:290] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:14.157517  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:59:14.190172  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 131485us
I20260709 12:59:14.067958  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:14.090775  1573 raft_consensus.cc:1275] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:14.060020  1575 raft_consensus.cc:1275] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:14.030411  3364 raft_consensus.cc:2804] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:59:14.189643  3627 log.cc:927] Time spent T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.199s	user 0.000s	sys 0.000s
I20260709 12:59:14.195606  1615 leader_election.cc:304] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:14.040457  3532 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:14.205729  3630 raft_consensus.cc:2804] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:14.206492  3630 raft_consensus.cc:697] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 3 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:14.207647  3532 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:14.091899  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 99442.8us
I20260709 12:59:14.054456  3332 raft_consensus.cc:2804] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:14.159206  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:14.212435  1574 raft_consensus.cc:2468] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 4.
I20260709 12:59:14.192850  3596 raft_consensus.cc:2749] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:14.187685  3547 leader_election.cc:290] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:14.214871  1615 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:14.158545  3421 leader_election.cc:290] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:14.091323  3366 raft_consensus.cc:2804] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:14.040077  3365 raft_consensus.cc:515] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:14.199456  3643 raft_consensus.cc:493] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:14.207527  3630 consensus_queue.cc:237] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:14.219614  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:14.219794  2326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53290 (request call id 760) took 1015 ms. Trace:
I20260709 12:59:14.202553  3364 raft_consensus.cc:493] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:14.053102  3338 consensus_queue.cc:1048] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.162s
I20260709 12:59:14.226593  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:14.228941  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:59:14.230561  3625 log.cc:927] Time spent T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.207s	user 0.000s	sys 0.000s
I20260709 12:59:14.230382  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:14.231133  3369 leader_election.cc:290] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:14.234220  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
W20260709 12:59:14.257447  3618 log.cc:927] Time spent T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.241s	user 0.001s	sys 0.000s
I20260709 12:59:14.253556  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:14.291584  1647 raft_consensus.cc:3060] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:14.222374  3370 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:14.253168  1644 raft_consensus.cc:1275] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:14.297438  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:14.298317  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:14.298503  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:14.298897  1644 raft_consensus.cc:2468] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 3.
I20260709 12:59:14.299885  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:14.253897  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:14.257305  3643 raft_consensus.cc:515] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:14.240077  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:14.300777  1642 raft_consensus.cc:3060] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:14.300954  1648 raft_consensus.cc:3060] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:14.302246  3643 leader_election.cc:290] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:14.221391  3366 raft_consensus.cc:493] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:14.305024  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:14.209412  3624 raft_consensus.cc:515] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:14.214735  3332 raft_consensus.cc:493] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:14.228212  2326 rpcz_store.cc:276] 0709 12:59:13.204168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:13.211004 (+  6836us) service_pool.cc:224] Handling call
0709 12:59:13.290978 (+ 79974us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:13.305755 (+ 14777us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:59:13.946574 (+640819us) log.cc:844] Serialized 14 byte log entry
0709 12:59:14.219428 (+272854us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:14.219479 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:14.219518 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:14.219597 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:14.219725 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41980,"prepare.queue_time_us":272580,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":4371,"thread_start_us":778360,"threads_started":3}
I20260709 12:59:14.243554  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:14.271873  1643 raft_consensus.cc:3060] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:14.232770  3612 leader_election.cc:290] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:14.274107  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:14.324960  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:14.274879  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:14.325619  1644 raft_consensus.cc:2468] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 3.
I20260709 12:59:14.325814  1725 raft_consensus.cc:2468] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 3.
I20260709 12:59:14.275550  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:14.327015  1723 raft_consensus.cc:2468] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 3.
I20260709 12:59:14.329393  1650 raft_consensus.cc:2468] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 3.
I20260709 12:59:14.329506  1647 raft_consensus.cc:2468] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 3.
I20260709 12:59:14.276963  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:14.277772  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:14.281442  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:14.282792  3337 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:14.284497  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 293) took 1132 ms. Trace:
I20260709 12:59:14.333850  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:14.333850  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:14.289069  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:14.289428  3596 raft_consensus.cc:993] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e: : Instructing follower 89ac9d5e2fbc4536b03a1ff1dd3eb226 to start an election
I20260709 12:59:14.292246  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:14.335338  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:14.232591  3583 raft_consensus.cc:2804] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:14.300096  1615 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:14.306876  1717 raft_consensus.cc:2410] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:59:14.335532  1644 raft_consensus.cc:2376] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 3. Re-sending same reply.
I20260709 12:59:14.240134  3364 raft_consensus.cc:3060] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:14.311214  1648 raft_consensus.cc:2468] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 4.
I20260709 12:59:14.308207  3366 raft_consensus.cc:3060] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:14.353120  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:14.353897  1644 raft_consensus.cc:3060] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:14.309267  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 159078us
I20260709 12:59:14.355783  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:14.356937  1648 raft_consensus.cc:2393] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 5: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
W20260709 12:59:14.357607  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 57586us
I20260709 12:59:14.267156  3382 leader_election.cc:290] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:14.330549  1721 raft_consensus.cc:2468] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 3.
I20260709 12:59:14.286636  3411 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:14.334419  1570 rpcz_store.cc:276] 0709 12:59:13.151887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:13.179590 (+ 27703us) service_pool.cc:224] Handling call
0709 12:59:13.202699 (+ 23109us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:13.203095 (+   396us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:13.203139 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:13.220663 (+ 17524us) log.cc:844] Serialized 26 byte log entry
0709 12:59:13.398294 (+177631us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:13.398361 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:13.398465 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:14.284192 (+885727us) raft_consensus.cc:1685] finished
0709 12:59:14.284224 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:14.284416 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2407,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":9393,"thread_start_us":103811,"threads_started":1,"wal-append.queue_time_us":713015}
I20260709 12:59:14.292236  3365 leader_election.cc:290] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:14.342172  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:14.344972  1576 raft_consensus.cc:2393] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 4: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:14.345701  1718 raft_consensus.cc:2468] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 2.
I20260709 12:59:14.350521  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:14.364964  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:14.313259  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:14.359130  1615 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:14.360204  1643 raft_consensus.cc:2410] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 2 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:59:14.361191  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:14.331797  3332 raft_consensus.cc:3060] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:14.292862  3467 raft_consensus.cc:515] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:14.395397  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:14.364168  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:14.361909  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:14.349345  3583 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
W20260709 12:59:14.390339  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 156704us
I20260709 12:59:14.366811  1647 raft_consensus.cc:2410] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:59:14.393791  1615 leader_election.cc:304] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:14.392643  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:14.372093  1568 raft_consensus.cc:2410] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:59:14.396391  1688 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.004s	sys 0.024s
W20260709 12:59:14.459558  1688 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.005s	sys 0.024s
W20260709 12:59:14.459993  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 665629us
I20260709 12:59:14.359303  3581 raft_consensus.cc:1081] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Signalling peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 to start an election
I20260709 12:59:14.398409  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:14.472940  1648 raft_consensus.cc:2468] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 2.
I20260709 12:59:14.456045  1642 raft_consensus.cc:2468] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 2.
I20260709 12:59:14.366986  3643 raft_consensus.cc:493] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:14.456897  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:14.482775  1643 raft_consensus.cc:2468] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 3.
I20260709 12:59:14.369597  3337 raft_consensus.cc:2749] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:14.361388  3369 raft_consensus.cc:493] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:14.486212  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:14.543320  1642 raft_consensus.cc:2468] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 2.
W20260709 12:59:14.548710  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 65709.1us
I20260709 12:59:14.460702  3583 raft_consensus.cc:3060] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:14.577056  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:59:14.460583  3614 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.828s	user 0.019s	sys 0.018s
I20260709 12:59:14.363209  3596 consensus_queue.cc:1059] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.123s
I20260709 12:59:14.395421  3532 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:14.460199  3365 raft_consensus.cc:2749] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:14.579777  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:14.572911  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:14.455869  3629 consensus_queue.cc:1048] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.123s
W20260709 12:59:14.599071  3651 log.cc:927] Time spent T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.206s	user 0.000s	sys 0.000s
I20260709 12:59:14.390895  3411 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:14.591997  2327 raft_consensus.cc:1275] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:59:14.585417  3614 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.989s	user 0.020s	sys 0.019s
W20260709 12:59:14.615621  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 158190us
W20260709 12:59:14.616643  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 222893us
I20260709 12:59:14.612671  3338 raft_consensus.cc:2749] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:14.633654  2332 raft_consensus.cc:2410] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:59:14.639303  1615 leader_election.cc:304] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:14.620779  3581 raft_consensus.cc:3055] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:14.573518  3643 raft_consensus.cc:515] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:14.585820  3369 raft_consensus.cc:515] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 12:59:14.637820  1644 raft_consensus.cc:2468] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 4.
I20260709 12:59:14.690444  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:14.690856  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:14.586606  3655 consensus_queue.cc:1048] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
W20260709 12:59:14.701128  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 61897us
I20260709 12:59:14.703890  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:14.704774  1568 raft_consensus.cc:2468] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 3.
I20260709 12:59:14.708133  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:14.708778  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:14.709522  1576 raft_consensus.cc:2393] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 3: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:14.708287  1539 leader_election.cc:304] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:14.617575  3532 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:59:14.712634  3612 consensus_queue.cc:1048] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:59:14.717948  1539 leader_election.cc:304] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:14.719450  1539 leader_election.cc:304] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:14.722149  1568 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "05713611987147e49a96fdf32bb28649"
dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:36640
I20260709 12:59:14.723062  1568 raft_consensus.cc:493] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:14.723544  1568 raft_consensus.cc:3060] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:14.724126  3556 leader_election.cc:290] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:14.724861  3556 raft_consensus.cc:2804] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:14.725055  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:14.725901  1570 raft_consensus.cc:3060] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:14.725936  3608 leader_election.cc:290] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:14.726796  3608 raft_consensus.cc:2804] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:14.727192  3608 raft_consensus.cc:493] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:14.727607  3608 raft_consensus.cc:3060] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:14.728735  3547 raft_consensus.cc:2804] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:14.629768  3633 consensus_queue.cc:1048] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 12:59:14.690510  3579 raft_consensus.cc:493] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:14.655287  3581 raft_consensus.cc:740] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:14.630085  3656 consensus_queue.cc:1048] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.081s
I20260709 12:59:14.725304  3556 raft_consensus.cc:493] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:14.711918  3337 raft_consensus.cc:2804] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:14.737015  3369 leader_election.cc:290] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373)
I20260709 12:59:14.729393  3547 raft_consensus.cc:697] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:14.691735  3382 consensus_queue.cc:1059] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
I20260709 12:59:14.748582  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:14.749902  1717 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e"
dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
mode: GRACEFUL
new_leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:50592
I20260709 12:59:14.753016  1716 raft_consensus.cc:2368] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 2. Current term is 3.
W20260709 12:59:14.735172  1542 connection.cc:256] RPC call timeout handler was delayed by -1.3526267160000316s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1847s for a response
W20260709 12:59:14.754125  1542 connection.cc:256] RPC call timeout handler was delayed by -1.3274267160000477s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1875s for a response
W20260709 12:59:14.754568  1542 connection.cc:256] RPC call timeout handler was delayed by -1.2500267160000362s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19610000000000002s for a response
I20260709 12:59:14.750522  1717 raft_consensus.cc:606] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 3 LEADER]: Received request to transfer leadership to TS 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 12:59:14.756350  1542 connection.cc:256] RPC call timeout handler was delayed by -1.1519267160000481s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.207s for a response
I20260709 12:59:14.756991  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:14.758247  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:14.755074  1539 leader_election.cc:304] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:14.747174  3556 raft_consensus.cc:3060] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:14.745394  3532 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:14.763749  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:14.762087  1718 raft_consensus.cc:1275] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:14.764943  1615 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:14.765839  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:14.766587  1575 raft_consensus.cc:2468] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 2.
I20260709 12:59:14.749374  3337 raft_consensus.cc:493] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:14.747560  3467 leader_election.cc:290] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:14.769250  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:14.751176  3624 leader_election.cc:290] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:59:14.770813  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 308777us
W20260709 12:59:14.776559  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 88936.8us
I20260709 12:59:14.786238  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:14.787516  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:14.788084  1720 raft_consensus.cc:3060] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:14.759743  3370 raft_consensus.cc:493] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:14.758181  3612 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:14.791311  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:14.792389  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:14.746107  3579 raft_consensus.cc:515] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:14.806046  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:14.793655  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:14.796056  1617 leader_election.cc:304] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:14.794448  1568 raft_consensus.cc:515] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:14.796154  1615 leader_election.cc:304] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:14.764344  3323 raft_consensus.cc:493] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:14.802606  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:14.773149  3369 raft_consensus.cc:493] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:14.809661  1617 leader_election.cc:304] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:14.773744  3337 raft_consensus.cc:3060] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:14.807662  1574 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 2.
I20260709 12:59:14.773398  3397 raft_consensus.cc:493] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
W20260709 12:59:14.814734  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 59770.2us
I20260709 12:59:14.822469  1724 raft_consensus.cc:2468] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 3.
I20260709 12:59:14.811022  3661 consensus_queue.cc:1048] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260709 12:59:14.827168  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:14.827795  1717 raft_consensus.cc:2468] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 3.
I20260709 12:59:14.802407  3448 leader_election.cc:290] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:14.809760  3467 raft_consensus.cc:2804] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:14.828464  3661 raft_consensus.cc:2804] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:14.834779  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:14.837468  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:14.838467  1574 raft_consensus.cc:2410] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:59:14.836395  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:14.811764  3421 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:14.814652  3532 raft_consensus.cc:2749] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:14.790904  3660 consensus_queue.cc:1048] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:59:14.816516  3609 raft_consensus.cc:493] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
W20260709 12:59:14.846225  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 71493.3us
I20260709 12:59:14.841868  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:14.858877  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:14.804428  3370 raft_consensus.cc:515] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:14.859514  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:14.813897  3596 consensus_queue.cc:1048] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
W20260709 12:59:14.840675  3529 consensus_meta.cc:287] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.579s	user 0.009s	sys 0.002s
I20260709 12:59:15.101897  1688 leader_election.cc:304] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
W20260709 12:59:15.009584  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 213478us
I20260709 12:59:14.949151  3643 leader_election.cc:290] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:14.857852  3411 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:14.824414  3547 consensus_queue.cc:237] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:14.840969  3656 raft_consensus.cc:493] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:15.120975  2327 raft_consensus.cc:1275] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:15.120791  3656 raft_consensus.cc:515] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:14.823366  3369 raft_consensus.cc:515] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:15.123337  3656 leader_election.cc:290] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:15.086066  3673 raft_consensus.cc:2749] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:15.086898  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:15.125720  1717 raft_consensus.cc:2410] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:59:15.126749  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:15.126690  3337 raft_consensus.cc:515] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:15.127873  1717 raft_consensus.cc:2393] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 5: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:59:14.829511  3397 raft_consensus.cc:515] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:15.129537  3669 log.cc:927] Time spent T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.268s	user 0.000s	sys 0.006s
I20260709 12:59:15.130445  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:15.130533  3397 leader_election.cc:290] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:15.031162  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:15.131667  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:15.090615  1720 raft_consensus.cc:2468] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 4.
I20260709 12:59:15.091001  3583 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:15.124022  3369 leader_election.cc:290] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:15.135711  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:15.138931  3576 raft_consensus.cc:3055] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:15.139298  3583 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:14.925063  3667 raft_consensus.cc:493] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:15.139773  3556 raft_consensus.cc:515] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:15.140619  3667 raft_consensus.cc:515] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:15.143153  3337 leader_election.cc:290] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:15.148993  3579 leader_election.cc:290] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:14.837829  3661 raft_consensus.cc:493] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:14.860225  1571 raft_consensus.cc:2468] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 4.
I20260709 12:59:14.862031  3609 raft_consensus.cc:515] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:14.858675  3421 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:15.097506  1572 raft_consensus.cc:1275] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:15.097584  3608 raft_consensus.cc:515] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:15.098510  1575 raft_consensus.cc:1275] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:59:15.099124  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 12:59:15.088302  3332 consensus_meta.cc:287] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.689s	user 0.007s	sys 0.004s
I20260709 12:59:14.835551  3467 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:14.864982  1617 leader_election.cc:304] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:14.809604  3612 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:15.086056  1573 raft_consensus.cc:1275] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:14.814407  3323 raft_consensus.cc:515] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:14.791821  3581 consensus_queue.cc:260] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:15.106052  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:15.108055  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:15.110574  3370 leader_election.cc:290] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:15.188779  1644 raft_consensus.cc:2468] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 1.
I20260709 12:59:15.153273  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:15.190174  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:15.094406  3448 raft_consensus.cc:2804] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:15.115713  3529 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:53306 (request call id 484) took 4008 ms. Trace:
I20260709 12:59:15.117774  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:15.118039  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:15.118791  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:15.150086  3661 raft_consensus.cc:3060] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:15.132328  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:15.133128  1723 raft_consensus.cc:1275] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:15.194114  1646 raft_consensus.cc:2376] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 4. Re-sending same reply.
I20260709 12:59:15.139384  3576 raft_consensus.cc:740] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:15.116916  3664 raft_consensus.cc:2804] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:59:15.116742  3366 consensus_meta.cc:287] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.721s	user 0.012s	sys 0.003s
I20260709 12:59:15.131816  1718 raft_consensus.cc:2468] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 4.
W20260709 12:59:15.203891  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 343128us
I20260709 12:59:15.143643  3667 leader_election.cc:290] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:15.144958  3650 log.cc:927] Time spent T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.882s	user 0.003s	sys 0.003s
I20260709 12:59:15.145094  3556 leader_election.cc:290] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:15.147044  3674 raft_consensus.cc:493] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:15.191025  1644 raft_consensus.cc:2376] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 2. Re-sending same reply.
I20260709 12:59:15.194422  1642 raft_consensus.cc:2410] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 2 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:59:15.150171  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:15.194833  1647 raft_consensus.cc:2468] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 2.
I20260709 12:59:15.124148  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:15.225630  1645 raft_consensus.cc:2468] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 2.
I20260709 12:59:15.195477  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:15.196624  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:15.198830  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:15.099705  1570 raft_consensus.cc:2468] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 5.
I20260709 12:59:15.229321  3674 raft_consensus.cc:515] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:15.193894  3529 rpcz_store.cc:276] 0709 12:59:11.107144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:11.107597 (+   453us) service_pool.cc:224] Handling call
0709 12:59:11.297221 (+189624us) ts_tablet_manager.cc:934] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66: Initiating tablet copy from peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
0709 12:59:12.776407 (+1479186us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:59:14.258394 (+1481987us) tablet_metadata.cc:665] Metadata flushed
0709 12:59:14.258543 (+   149us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:59:15.101392 (+842849us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:59:15.115225 (+ 13833us) tablet_replica.cc:206] Creating consensus instance
0709 12:59:15.115567 (+   342us) ts_tablet_manager.cc:989] Replica registered.
0709 12:59:15.115633 (+    66us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":12506,"tablet-copy.queue_time_us":184885,"thread_start_us":190291,"threads_started":2}
I20260709 12:59:15.231734  3529 tablet_copy_client.cc:806] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:15.220919  3337 raft_consensus.cc:2749] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:59:15.202450  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 89473.4us
I20260709 12:59:15.202932  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:15.232999  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:15.249063  1573 raft_consensus.cc:2410] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:59:15.204735  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:15.233767  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:15.250157  1574 raft_consensus.cc:2468] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 2.
I20260709 12:59:15.204784  1617 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:15.252157  1575 raft_consensus.cc:3060] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:15.192163  3467 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:15.196185  3448 raft_consensus.cc:493] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:15.168955  3670 raft_consensus.cc:493] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:15.207933  3489 leader_election.cc:290] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:15.208168  3576 consensus_queue.cc:260] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:15.209583  3323 leader_election.cc:290] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:15.209512  3664 raft_consensus.cc:697] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 5 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:15.210316  3581 raft_consensus.cc:3060] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:15.271760  3670 raft_consensus.cc:515] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:15.272771  3664 consensus_queue.cc:237] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:15.274611  3670 leader_election.cc:290] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:15.217307  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:15.217391  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:15.278983  2326 raft_consensus.cc:2468] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 4.
I20260709 12:59:15.229724  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:15.108371  1615 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:15.229344  1646 raft_consensus.cc:2393] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 5: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:15.280007  1570 raft_consensus.cc:2468] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 3.
W20260709 12:59:15.280146  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 171858us
I20260709 12:59:15.281232  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:15.281117  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:15.282578  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:15.283995  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:15.227988  1542 leader_election.cc:400] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 election: Vote denied by peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473) with higher term. Message: Invalid argument: T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 2. Current term is 3.
I20260709 12:59:15.252233  1688 leader_election.cc:304] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:15.241741  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:15.285218  1542 leader_election.cc:403] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:59:15.206167  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:15.243505  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:15.192391  3332 raft_consensus.cc:515] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:15.227324  3364 consensus_meta.cc:287] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.867s	user 0.022s	sys 0.000s
I20260709 12:59:15.294719  3673 raft_consensus.cc:2804] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:15.295286  3673 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:15.238557  3646 log.cc:927] Time spent T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.978s	user 0.002s	sys 0.010s
I20260709 12:59:15.295644  3673 raft_consensus.cc:3060] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:15.245288  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:15.296389  2331 raft_consensus.cc:2468] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 4.
I20260709 12:59:15.265699  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:15.297006  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:15.255740  3584 raft_consensus.cc:493] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:15.262243  3337 raft_consensus.cc:2749] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:15.266515  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:15.297784  1572 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 5.
I20260709 12:59:15.297849  3584 raft_consensus.cc:515] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:15.299037  1573 raft_consensus.cc:1240] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:15.299296  1572 raft_consensus.cc:1240] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:15.246721  3609 leader_election.cc:290] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:15.268791  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:15.301796  1644 raft_consensus.cc:2468] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 4.
I20260709 12:59:15.265920  1645 raft_consensus.cc:1240] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:15.242102  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:15.284672  1570 raft_consensus.cc:3060] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:15.289525  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 84804.1us
I20260709 12:59:15.232496  3529 tablet_copy_client.cc:670] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:15.295138  1615 leader_election.cc:304] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:15.294788  3364 raft_consensus.cc:515] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:15.243921  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:15.263278  3448 raft_consensus.cc:3060] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:15.297401  1574 raft_consensus.cc:2393] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 4: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:15.286988  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 1668) took 1931 ms. Trace:
I20260709 12:59:15.313935  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:15.313704  1569 rpcz_store.cc:276] 0709 12:59:13.355258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:13.355385 (+   127us) service_pool.cc:224] Handling call
0709 12:59:13.802233 (+446848us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:13.981627 (+179394us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:13.981683 (+    56us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:13.981724 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:13.981754 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:15.286675 (+1304921us) spinlock_profiling.cc:243] Waited 174 ms on lock 0x7b5400244d54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:15.286746 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:15.286908 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":399536896}
I20260709 12:59:15.315940  1648 raft_consensus.cc:2393] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 6: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:15.314193  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:15.282488  1571 raft_consensus.cc:2468] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 4.
I20260709 12:59:15.304482  1572 raft_consensus.cc:1240] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:15.304507  1617 leader_election.cc:304] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:15.302795  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:15.206152  3366 raft_consensus.cc:515] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:15.306943  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 86261us
I20260709 12:59:15.307192  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:15.320392  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
W20260709 12:59:15.306293  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 54194.9us
I20260709 12:59:15.309019  1573 raft_consensus.cc:1240] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:15.321386  1724 raft_consensus.cc:2468] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 1.
I20260709 12:59:15.323431  3661 raft_consensus.cc:515] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 12:59:15.323997  3366 leader_election.cc:290] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:15.325708  3661 leader_election.cc:290] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373)
I20260709 12:59:15.328871  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:15.330080  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:15.330425  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:15.330634  1644 raft_consensus.cc:2468] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 3.
I20260709 12:59:15.330976  1724 raft_consensus.cc:2376] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5. Re-sending same reply.
I20260709 12:59:15.331756  1644 raft_consensus.cc:1240] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:15.331830  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:15.310125  3412 raft_consensus.cc:2804] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:15.333389  3412 raft_consensus.cc:493] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:15.333542  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:15.333820  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:15.333938  3412 raft_consensus.cc:3060] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:15.334340  1717 raft_consensus.cc:2376] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5. Re-sending same reply.
I20260709 12:59:15.334610  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:15.335198  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:15.335594  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:15.339216  1724 raft_consensus.cc:2368] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 2. Current term is 3.
I20260709 12:59:15.322479  1542 leader_election.cc:304] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:15.311946  2297 leader_election.cc:304] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 12:59:15.318589  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:15.244922  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:15.304031  3670 raft_consensus.cc:2749] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473) with higher term. Message: Invalid argument: T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 2. Current term is 3.
I20260709 12:59:15.238642  3608 leader_election.cc:290] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:15.341339  1574 raft_consensus.cc:1240] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 1. Current term is 2. Ops: [1.2-1.2]
I20260709 12:59:15.311576  3596 raft_consensus.cc:2804] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:15.344825  1573 raft_consensus.cc:1240] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:15.345392  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:15.345579  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:15.346323  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:15.350991  1542 leader_election.cc:304] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:15.323937  3364 leader_election.cc:290] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:15.348203  1615 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:15.353252  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:15.351421  1646 raft_consensus.cc:2468] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 3.
I20260709 12:59:15.353648  2297 leader_election.cc:304] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 12:59:15.354722  1569 raft_consensus.cc:1240] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 3. Current term is 4. Ops: []
W20260709 12:59:15.357067  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 52639.3us
I20260709 12:59:15.360909  1617 leader_election.cc:304] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:15.357779  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:15.361456  1540 leader_election.cc:304] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:15.370971  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:15.372020  1721 raft_consensus.cc:2468] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 3.
I20260709 12:59:15.345978  3493 raft_consensus.cc:2804] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:15.358709  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:15.379740  1646 raft_consensus.cc:2468] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 2.
I20260709 12:59:15.365280  1571 raft_consensus.cc:1240] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 LEADER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:15.373327  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:15.357781  1644 raft_consensus.cc:2468] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 2.
I20260709 12:59:15.381301  1573 raft_consensus.cc:3060] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:15.380494  1540 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:15.364164  3661 raft_consensus.cc:2749] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:15.384232  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:15.378252  3608 raft_consensus.cc:2804] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:15.384455  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:15.384953  3608 raft_consensus.cc:493] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:15.385434  3608 raft_consensus.cc:3060] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:15.385490  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:15.386646  1717 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc"
dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
mode: GRACEFUL
new_leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:50592
I20260709 12:59:15.386739  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:15.386865  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:15.387179  1717 raft_consensus.cc:606] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 2 LEADER]: Received request to transfer leadership to TS 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:15.387254  2331 raft_consensus.cc:3060] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:15.388631  3529 tablet_copy_client.cc:538] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:15.390153  3421 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:15.385510  3679 log.cc:927] Time spent T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:59:15.378618  3670 raft_consensus.cc:2749] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:59:15.401585  3649 log.cc:927] Time spent T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.945s	user 0.002s	sys 0.000s
I20260709 12:59:15.403676  3653 raft_consensus.cc:2804] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:15.403859  1722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 296) took 2102 ms. Trace:
I20260709 12:59:15.404343  3653 raft_consensus.cc:493] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:15.404966  3653 raft_consensus.cc:3060] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:15.404484  1722 rpcz_store.cc:276] 0709 12:59:13.301156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:13.301447 (+   291us) service_pool.cc:224] Handling call
0709 12:59:13.317531 (+ 16084us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:13.361144 (+ 43613us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:59:13.985066 (+623922us) log.cc:844] Serialized 14 byte log entry
0709 12:59:14.209566 (+224500us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:14.215604 (+  6038us) log.cc:844] Serialized 26 byte log entry
0709 12:59:14.233903 (+ 18299us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:14.234520 (+   617us) log.cc:844] Serialized 14 byte log entry
0709 12:59:14.234769 (+   249us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:14.234839 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:15.400915 (+1166076us) spinlock_profiling.cc:243] Waited 26.1 ms on lock 0x7b4400022b4c. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef1f4c85 00007fa9ef1f56a2 00007fa9f1f671db 00007fa9f1f62aaf 00007fa9f1f5686e 00007fa9f1f55bb6 00007fa9f1f557d8 00007fa9f1f5f221 00007fa9f1f5f1d9 00007fa9f1f5f169
0709 12:59:15.403570 (+  2655us) raft_consensus.cc:1685] finished
0709 12:59:15.403595 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:15.403757 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":792955,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":80,"raft.queue_time_us":5047,"raft.run_cpu_time_us":402,"raft.run_wall_time_us":50890,"spinlock_wait_cycles":60099840,"thread_start_us":847442,"threads_started":2,"wal-append.queue_time_us":342925}
I20260709 12:59:15.363993  3583 raft_consensus.cc:2749] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:15.411331  1648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 1232) took 1143 ms. Trace:
I20260709 12:59:15.418579  2332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53290 (request call id 773) took 1121 ms. Trace:
I20260709 12:59:15.419183  2332 rpcz_store.cc:276] 0709 12:59:14.297432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:14.298026 (+   594us) service_pool.cc:224] Handling call
0709 12:59:15.418270 (+1120244us) spinlock_profiling.cc:243] Waited 334 ms on lock 0x7b54005d84d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:15.418479 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":767972096}
I20260709 12:59:15.420871  1615 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:15.421873  3661 raft_consensus.cc:2749] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:15.425356  1651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45148 (request call id 1847) took 1632 ms. Trace:
I20260709 12:59:15.425868  1651 rpcz_store.cc:276] 0709 12:59:13.793046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:13.793221 (+   175us) service_pool.cc:224] Handling call
0709 12:59:13.793601 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:13.983427 (+189826us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:13.983469 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:13.983522 (+    53us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:13.983564 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:15.425042 (+1441478us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b540030e654. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:15.425112 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:15.425267 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":436030208}
W20260709 12:59:15.430311  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 49911.3us
I20260709 12:59:15.411856  1648 rpcz_store.cc:276] 0709 12:59:14.267806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:14.487373 (+219567us) service_pool.cc:224] Handling call
0709 12:59:15.411064 (+923691us) spinlock_profiling.cc:243] Waited 738 ms on lock 0x7b5400098dd4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:15.411244 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1697018752}
W20260709 12:59:15.453377  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 92534.9us
I20260709 12:59:15.454861  1617 leader_election.cc:304] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:15.456319  1617 leader_election.cc:304] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:15.453990  1646 raft_consensus.cc:1240] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:15.458062  1575 raft_consensus.cc:2468] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 5.
I20260709 12:59:15.459316  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:15.459609  1646 raft_consensus.cc:1240] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:15.460031  1575 raft_consensus.cc:3060] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:15.461061  1646 raft_consensus.cc:1240] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:15.370271  1724 raft_consensus.cc:2468] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 2.
W20260709 12:59:15.462155  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 98970.2us
I20260709 12:59:15.462857  1542 leader_election.cc:304] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:15.463478  1569 raft_consensus.cc:1240] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:15.465572  1617 leader_election.cc:304] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:15.359066  3556 raft_consensus.cc:2749] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:15.468158  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:15.472844  2332 raft_consensus.cc:2468] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 4.
I20260709 12:59:15.469796  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:15.471027  1617 leader_election.cc:304] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:59:15.472040  1570 raft_consensus.cc:2468] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 4.
I20260709 12:59:15.365264  3596 raft_consensus.cc:697] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 5 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:15.475865  1617 leader_election.cc:304] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:15.466331  3661 raft_consensus.cc:2749] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:15.480314  1575 raft_consensus.cc:2468] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6.
I20260709 12:59:15.431918  3493 raft_consensus.cc:493] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:15.451684  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:15.487810  1542 leader_election.cc:304] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:15.462390  3583 raft_consensus.cc:2749] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:15.461902  3547 raft_consensus.cc:2749] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:15.466840  3366 raft_consensus.cc:2749] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:15.493848  1540 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:15.467796  3332 leader_election.cc:290] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:15.468173  3670 raft_consensus.cc:2749] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:15.502656  1615 leader_election.cc:304] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:15.473986  3364 raft_consensus.cc:2749] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:15.484539  3660 raft_consensus.cc:2804] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:15.509902  1615 leader_election.cc:304] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:15.492913  3493 raft_consensus.cc:3060] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:15.468096  3421 consensus_queue.cc:1048] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 12:59:15.519110  1617 leader_election.cc:304] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:15.495347  3489 raft_consensus.cc:2749] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:15.523602  1542 leader_election.cc:304] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:15.521456  1573 raft_consensus.cc:2468] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 5.
I20260709 12:59:15.526203  1615 leader_election.cc:304] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:15.511314  3556 raft_consensus.cc:2804] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:15.511082  3579 raft_consensus.cc:493] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:15.534857  1542 leader_election.cc:304] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:15.521633  1617 leader_election.cc:304] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:15.525658  1646 raft_consensus.cc:1240] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:15.519112  3675 raft_consensus.cc:2804] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:15.510959  3660 raft_consensus.cc:493] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:15.517067  3661 raft_consensus.cc:2804] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:15.529973  3547 raft_consensus.cc:3060] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:15.537496  1542 leader_election.cc:304] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:15.537592  3675 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:15.560736  3675 raft_consensus.cc:3060] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:15.563501  3547 raft_consensus.cc:2749] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:15.564281  3591 raft_consensus.cc:493] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:15.565481  3591 raft_consensus.cc:515] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:15.566859  3547 raft_consensus.cc:2804] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:15.567360  3547 raft_consensus.cc:493] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:15.567552  3591 leader_election.cc:290] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:15.567732  3547 raft_consensus.cc:3060] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:15.570122  2331 raft_consensus.cc:2468] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 5.
I20260709 12:59:15.573298  1573 raft_consensus.cc:1240] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:15.574023  3670 raft_consensus.cc:493] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:15.574537  3670 raft_consensus.cc:515] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:15.577032  3670 leader_election.cc:290] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:15.578938  3675 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:15.581722  3675 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:15.517740  3581 raft_consensus.cc:2804] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:15.619037  3581 raft_consensus.cc:697] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 6 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:15.620168  3581 consensus_queue.cc:237] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:15.603178  3547 raft_consensus.cc:515] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:15.623301  3547 leader_election.cc:290] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:15.591820  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:15.624032  1648 raft_consensus.cc:2468] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 3.
W20260709 12:59:15.551481  1521 auto_rebalancer.cc:629] Failed to schedule move for tablet 589a395c6abe4eec80fca6d6210acf0d: Illegal state: Replica 4dbe7d47a2374afca075d3a98583b49e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } }
I20260709 12:59:15.598133  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:15.625331  2331 raft_consensus.cc:3060] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:15.554945  3412 raft_consensus.cc:515] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:15.527236  3332 raft_consensus.cc:2749] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:15.628608  3412 leader_election.cc:290] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:15.629632  3639 log.cc:927] Time spent T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 1.367s	user 0.004s	sys 0.009s
I20260709 12:59:15.635710  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:15.639248  3675 raft_consensus.cc:2749] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:15.639505  3674 leader_election.cc:290] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:15.640250  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 118700us
I20260709 12:59:15.599793  3667 raft_consensus.cc:493] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:15.600241  3591 consensus_queue.cc:1048] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:15.601220  3454 consensus_queue.cc:1048] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:15.604125  2295 leader_election.cc:304] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:15.556043  1469 catalog_manager.cc:5697] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:15.545588  3448 raft_consensus.cc:515] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:15.609431  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:15.672884  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:15.673238  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:15.673991  1718 raft_consensus.cc:2468] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 3.
I20260709 12:59:15.674898  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:15.615003  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 12:59:15.616158  1719 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1753) took 1656 ms (client timeout 2147 ms). Trace:
I20260709 12:59:15.617049  1688 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:15.618278  3584 leader_election.cc:290] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:15.554569  1568 leader_election.cc:290] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:15.680706  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:15.538578  3556 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:15.617100  3612 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:15.541031  3579 raft_consensus.cc:515] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:15.696872  1574 raft_consensus.cc:1240] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:15.599295  3661 raft_consensus.cc:697] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 4 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
W20260709 12:59:15.645984  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:15.646986  1617 leader_election.cc:304] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 12:59:15.698335  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 51440.7us
I20260709 12:59:15.699077  1617 leader_election.cc:304] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:59:15.657294  1539 leader_election.cc:304] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:15.658581  1724 raft_consensus.cc:1240] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:15.635740  2331 raft_consensus.cc:2468] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 2.
W20260709 12:59:15.665604  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 72007us
I20260709 12:59:15.716243  1615 leader_election.cc:304] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:15.668255  2294 leader_election.cc:304] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:15.670593  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:15.671499  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:15.612671  3596 consensus_queue.cc:237] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:15.545724  3366 raft_consensus.cc:2804] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:15.540833  3660 raft_consensus.cc:3060] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:15.675791  1719 rpcz_store.cc:269] 0709 12:59:13.960168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:13.960303 (+   135us) service_pool.cc:224] Handling call
0709 12:59:15.615911 (+1655608us) spinlock_profiling.cc:243] Waited 25.1 ms on lock 0x7b540041fd54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:15.616086 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57791232}
I20260709 12:59:15.541195  3370 raft_consensus.cc:2749] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:15.678926  1469 catalog_manager.cc:5697] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 1 to 2, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 2 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:15.672849  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:59:15.694736  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 90680.4us
I20260709 12:59:15.666260  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:15.725112  1617 leader_election.cc:304] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 12:59:15.726001  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 109058us
I20260709 12:59:15.763234  1646 raft_consensus.cc:2393] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 4: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:15.726843  1643 raft_consensus.cc:1240] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 2. Current term is 3. Ops: []
W20260709 12:59:15.736368  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 49116us
I20260709 12:59:15.752739  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:15.545588  3467 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:15.756959  1469 catalog_manager.cc:5697] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:15.685832  3556 raft_consensus.cc:3060] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:15.758857  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 101680us
I20260709 12:59:15.693859  3466 raft_consensus.cc:493] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:15.555279  3673 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:59:15.780308  1617 leader_election.cc:304] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
W20260709 12:59:15.860518  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 80324.7us
I20260709 12:59:15.862035  1617 leader_election.cc:304] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:15.782111  1725 raft_consensus.cc:2468] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 3.
I20260709 12:59:15.783540  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:15.672356  3364 consensus_queue.cc:1059] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.079s
I20260709 12:59:15.766814  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:15.787832  1469 catalog_manager.cc:5697] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 2 to 3, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } }
I20260709 12:59:15.784682  1539 leader_election.cc:304] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:15.670898  3667 raft_consensus.cc:515] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:15.789882  1688 leader_election.cc:304] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:15.752666  3675 raft_consensus.cc:2804] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:15.753090  3369 raft_consensus.cc:2804] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:15.893534  3369 raft_consensus.cc:493] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:15.893931  3369 raft_consensus.cc:3060] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:15.838758  3466 raft_consensus.cc:515] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:15.896005  3466 leader_election.cc:290] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:15.758430  3612 raft_consensus.cc:493] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:15.896806  3612 raft_consensus.cc:515] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:15.898829  3612 leader_election.cc:290] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:15.755822  3665 raft_consensus.cc:2804] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:15.899394  3665 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:15.899771  3665 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:15.900244  3370 raft_consensus.cc:2804] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:15.900808  3370 raft_consensus.cc:697] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:15.901630  3370 consensus_queue.cc:237] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:15.903667  3493 raft_consensus.cc:515] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:15.785043  3366 raft_consensus.cc:697] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 5 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:15.784914  3547 raft_consensus.cc:2804] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:15.785262  3338 raft_consensus.cc:3060] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:15.756614  3332 raft_consensus.cc:2804] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:15.815605  3576 raft_consensus.cc:3060] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:15.817350  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:15.819562  3556 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:15.821523  3623 raft_consensus.cc:2764] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:59:15.821806  3608 raft_consensus.cc:515] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:15.822757  3613 raft_consensus.cc:493] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
W20260709 12:59:15.821457  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 153247us
W20260709 12:59:15.971272  1571 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.026s	sys 0.029s
I20260709 12:59:15.830250  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
W20260709 12:59:15.972971  1571 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.026s	sys 0.029s
I20260709 12:59:15.831328  3661 consensus_queue.cc:237] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:15.833847  3448 leader_election.cc:290] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:15.755693  3614 raft_consensus.cc:2804] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:15.997663  3614 raft_consensus.cc:493] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:15.998190  3614 raft_consensus.cc:3060] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:15.887034  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 102423us
I20260709 12:59:15.885200  1469 catalog_manager.cc:5697] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 1 to 2, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 2 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:16.001236  1539 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:16.002722  1539 leader_election.cc:304] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:16.002409  1469 catalog_manager.cc:5697] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
W20260709 12:59:15.887912  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 98115.5us
I20260709 12:59:16.004900  3670 raft_consensus.cc:2749] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:16.005457  1688 leader_election.cc:304] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:16.005841  3670 raft_consensus.cc:2804] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:16.006446  3466 consensus_queue.cc:1059] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:16.006467  3670 raft_consensus.cc:697] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:16.006960  1688 leader_election.cc:304] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:16.007682  3323 raft_consensus.cc:3055] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:15.891963  1650 raft_consensus.cc:2393] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 4: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:16.008092  3323 raft_consensus.cc:740] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:16.007715  3670 consensus_queue.cc:237] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:16.008987  3323 consensus_queue.cc:260] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:16.010087  3323 raft_consensus.cc:3060] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:16.010223  1650 raft_consensus.cc:1240] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 3 LEADER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:15.892980  3397 raft_consensus.cc:2749] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:15.911127  1645 raft_consensus.cc:1240] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 1. Current term is 3. Ops: []
I20260709 12:59:15.917786  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:15.771461  1689 leader_election.cc:304] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 12:59:15.924746  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 159548us
I20260709 12:59:15.930634  1572 raft_consensus.cc:1275] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:16.014390  1647 raft_consensus.cc:1240] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:16.004151  1539 leader_election.cc:304] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:16.015383  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:16.016041  1572 raft_consensus.cc:3060] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:15.962977  1648 raft_consensus.cc:3060] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:15.889176  3629 raft_consensus.cc:2749] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:16.016562  3664 raft_consensus.cc:2804] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:16.017006  3664 raft_consensus.cc:493] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:16.017416  3664 raft_consensus.cc:3060] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:15.991699  3369 raft_consensus.cc:515] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:16.015545  3489 raft_consensus.cc:2804] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:15.910115  3643 raft_consensus.cc:2804] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:16.020866  3489 raft_consensus.cc:493] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:16.021126  3643 raft_consensus.cc:493] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:16.021471  3489 raft_consensus.cc:3060] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:16.021623  3643 raft_consensus.cc:3060] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:16.021600  1469 catalog_manager.cc:5697] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 3 to 4, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 4 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:16.016121  1539 leader_election.cc:304] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:59:16.028918  3448 raft_consensus.cc:2804] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:16.029390  3448 raft_consensus.cc:493] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:16.029830  3448 raft_consensus.cc:3060] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:16.033540  3674 raft_consensus.cc:2749] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:59:16.034492  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 266007us
I20260709 12:59:16.035040  1539 leader_election.cc:304] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:59:16.035403  1689 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:16.020907  1688 leader_election.cc:304] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:16.037564  1648 raft_consensus.cc:2468] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 4.
I20260709 12:59:16.038635  3643 raft_consensus.cc:515] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:16.053218  1646 raft_consensus.cc:1240] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 3. Current term is 4. Ops: []
W20260709 12:59:16.053742  1723 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.000s	sys 0.014s
W20260709 12:59:16.054152  1723 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.000s	sys 0.014s
W20260709 12:59:16.054879  1569 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.011s	sys 0.003s
W20260709 12:59:16.055253  1569 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.011s	sys 0.003s
W20260709 12:59:15.971848  3337 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.063s	sys 0.059s
I20260709 12:59:16.042374  3664 raft_consensus.cc:515] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:15.962625  3332 raft_consensus.cc:493] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:16.081527  1576 raft_consensus.cc:2468] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 4.
I20260709 12:59:16.042655  3448 raft_consensus.cc:515] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:16.049525  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 58774.4us
I20260709 12:59:16.089097  2294 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:16.090596  2294 leader_election.cc:304] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 12:59:16.050136  1717 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.065s	sys 0.106s
W20260709 12:59:16.092773  1717 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.065s	sys 0.106s
I20260709 12:59:15.929602  3547 raft_consensus.cc:493] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:16.040213  1572 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 3.
I20260709 12:59:16.095414  1572 raft_consensus.cc:1240] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 4. Current term is 5. Ops: []
W20260709 12:59:16.071918  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 51083.9us
I20260709 12:59:16.072489  1689 leader_election.cc:304] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 12:59:16.085839  1573 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.011s	sys 0.007s
W20260709 12:59:16.069432  3337 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.063s	sys 0.060s
I20260709 12:59:16.056988  2297 leader_election.cc:304] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 12:59:16.100545  1573 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.011s	sys 0.007s
I20260709 12:59:16.079110  3662 raft_consensus.cc:2804] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:16.079923  3332 raft_consensus.cc:3060] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:16.091893  3529 tablet_bootstrap.cc:492] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap starting.
I20260709 12:59:16.074115  3674 raft_consensus.cc:2749] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:59:16.115590  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 58688.6us
W20260709 12:59:16.105118  1542 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.013s	sys 0.002s
I20260709 12:59:16.109483  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
W20260709 12:59:16.116344  1542 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.014s	sys 0.002s
I20260709 12:59:16.080324  3673 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:16.050033  3620 consensus_queue.cc:1048] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
W20260709 12:59:16.116954  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 530290us
I20260709 12:59:16.097831  3547 raft_consensus.cc:3060] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:16.119218  2297 leader_election.cc:304] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:16.114800  3662 raft_consensus.cc:493] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:16.142311  3496 raft_consensus.cc:2804] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:16.150295  3662 raft_consensus.cc:3060] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:16.102463  3605 raft_consensus.cc:2804] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:16.112385  3591 raft_consensus.cc:2749] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:16.150646  3496 raft_consensus.cc:493] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:16.150873  3605 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:16.151208  3496 raft_consensus.cc:3060] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:16.052057  3613 raft_consensus.cc:515] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:16.137214  3323 raft_consensus.cc:2749] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:16.163239  1725 raft_consensus.cc:1240] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:16.118175  3622 consensus_queue.cc:1059] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.037s
W20260709 12:59:16.164038  1721 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.696s	user 0.037s	sys 0.055s
I20260709 12:59:16.164765  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 12:59:16.167423  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:16.160768  1540 leader_election.cc:304] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 12:59:16.209339  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:16.210322  1572 raft_consensus.cc:3060] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:16.153580  1720 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.013s	sys 0.009s
W20260709 12:59:16.214376  1720 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.014s	sys 0.010s
W20260709 12:59:16.214885  1721 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.037s	sys 0.060s
I20260709 12:59:16.158107  3605 raft_consensus.cc:3060] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:16.138406  3412 consensus_queue.cc:1059] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.051s
W20260709 12:59:16.287781  1722 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.019s	sys 0.009s
W20260709 12:59:16.288271  1722 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.019s	sys 0.009s
I20260709 12:59:16.293304  1572 raft_consensus.cc:2468] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 5.
I20260709 12:59:16.294965  2295 leader_election.cc:304] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:16.161101  3448 leader_election.cc:290] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:16.189970  3626 raft_consensus.cc:2804] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:16.156047  3584 consensus_queue.cc:1059] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 12:59:16.190249  3369 leader_election.cc:290] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:59:16.308718  1642 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.006s	sys 0.018s
W20260709 12:59:16.309185  1642 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.006s	sys 0.018s
I20260709 12:59:16.310081  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 281) took 1042 ms. Trace:
I20260709 12:59:16.119867  3677 consensus_queue.cc:1059] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.183s
I20260709 12:59:16.269256  3466 raft_consensus.cc:2804] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:16.222851  3579 leader_election.cc:290] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:16.151988  3489 raft_consensus.cc:515] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:16.317309  3660 consensus_meta.cc:287] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.520s	user 0.009s	sys 0.001s
W20260709 12:59:16.418547  1574 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.011s	sys 0.043s
I20260709 12:59:16.112054  3623 consensus_queue.cc:1059] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.205s
I20260709 12:59:16.307287  3609 raft_consensus.cc:3055] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:16.303406  3626 raft_consensus.cc:493] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:16.155117  3366 consensus_queue.cc:237] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:16.433483  3675 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.018s	sys 0.018s
I20260709 12:59:16.367264  3622 raft_consensus.cc:2804] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:16.438171  3493 leader_election.cc:290] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:59:16.423524  1574 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.012s	sys 0.043s
W20260709 12:59:16.447991  3675 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.018s	sys 0.019s
I20260709 12:59:16.366539  3467 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:16.469913  1568 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.011s	sys 0.034s
I20260709 12:59:16.421865  3667 leader_election.cc:290] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:16.441301  3626 raft_consensus.cc:3060] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:16.440096  3609 raft_consensus.cc:740] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:16.444404  3608 leader_election.cc:290] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:16.467463  3675 raft_consensus.cc:697] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 5 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
W20260709 12:59:16.191352  3581 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.011s	sys 0.006s
I20260709 12:59:16.440286  3660 raft_consensus.cc:515] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:16.471547  1568 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.012s	sys 0.035s
I20260709 12:59:16.451903  3556 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:16.455217  3643 leader_election.cc:290] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:16.462723  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 427743us
W20260709 12:59:16.525552  3697 log.cc:927] Time spent T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
W20260709 12:59:16.498766  3581 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.875s	user 0.012s	sys 0.007s
W20260709 12:59:16.510995  3665 consensus_meta.cc:287] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.611s	user 0.008s	sys 0.002s
W20260709 12:59:16.532366  3689 log.cc:927] Time spent T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:59:16.462718  3622 raft_consensus.cc:697] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:16.468907  3623 raft_consensus.cc:3055] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:16.507606  3612 raft_consensus.cc:2804] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:16.469473  3664 leader_election.cc:290] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:16.486936  3364 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.017s	sys 0.033s
I20260709 12:59:16.534817  1539 leader_election.cc:304] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:16.537575  1649 raft_consensus.cc:2393] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 4: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:16.494062  1723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 307) took 1230 ms. Trace:
W20260709 12:59:16.564687  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 403947us
W20260709 12:59:16.545933  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 473516us
I20260709 12:59:16.544061  3670 raft_consensus.cc:2804] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:59:16.540139  1542 leader_election.cc:336] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.883s (SENT)
I20260709 12:59:16.542402  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 304) took 1383 ms. Trace:
W20260709 12:59:16.558001  3653 consensus_meta.cc:287] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 1.152s	user 0.010s	sys 0.004s
I20260709 12:59:16.461658  3614 raft_consensus.cc:515] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:16.546262  1617 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.002s	sys 0.013s
I20260709 12:59:16.544857  3623 raft_consensus.cc:740] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
W20260709 12:59:16.559083  3364 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.630s	user 0.017s	sys 0.033s
W20260709 12:59:16.540663  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 427433us
W20260709 12:59:16.573277  1542 leader_election.cc:336] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.919s (SENT)
I20260709 12:59:16.555902  1723 rpcz_store.cc:276] 0709 12:59:15.263848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:15.414102 (+150254us) service_pool.cc:224] Handling call
0709 12:59:15.444757 (+ 30655us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:15.444999 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:59:16.054607 (+609608us) log.cc:844] Serialized 14 byte log entry
0709 12:59:16.493294 (+438687us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:16.493412 (+   118us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:16.493525 (+   113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:16.493666 (+   141us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:16.493940 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22075,"prepare.queue_time_us":65831,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":146,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":17896,"thread_start_us":1007827,"threads_started":2}
W20260709 12:59:16.541203  3370 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.026s	sys 0.030s
I20260709 12:59:16.579679  1542 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
W20260709 12:59:16.575659  1617 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.002s	sys 0.013s
I20260709 12:59:16.596586  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 309) took 1332 ms. Trace:
I20260709 12:59:16.525563  3675 consensus_queue.cc:237] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:16.558667  3612 raft_consensus.cc:697] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
W20260709 12:59:16.600772  1617 leader_election.cc:336] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.147s (SENT)
I20260709 12:59:16.597123  1717 rpcz_store.cc:276] 0709 12:59:15.264395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:15.464208 (+199813us) service_pool.cc:224] Handling call
0709 12:59:15.487877 (+ 23669us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:15.488263 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:15.488301 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:15.496786 (+  8485us) log.cc:844] Serialized 26 byte log entry
0709 12:59:16.093410 (+596624us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:16.093471 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:16.093571 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:16.596240 (+502669us) raft_consensus.cc:1685] finished
0709 12:59:16.596291 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:16.596466 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":334,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":25543,"thread_start_us":568116,"threads_started":1,"wal-append.queue_time_us":873906}
W20260709 12:59:16.594326  3370 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.027s	sys 0.035s
I20260709 12:59:16.572901  1567 rpcz_store.cc:276] 0709 12:59:15.159184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:15.417304 (+258120us) service_pool.cc:224] Handling call
0709 12:59:15.417666 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:15.417897 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:59:15.725104 (+307207us) log.cc:844] Serialized 14 byte log entry
0709 12:59:16.536944 (+811840us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:16.537023 (+    79us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:16.537083 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:16.537161 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:16.542340 (+  5179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52179,"prepare.queue_time_us":721785,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":411104,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":9648,"thread_start_us":1049005,"threads_started":3,"wal-append.queue_time_us":611262}
I20260709 12:59:16.543258  3665 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:16.562917  3613 leader_election.cc:290] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:59:16.635892  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 62651.1us
W20260709 12:59:16.602392  1571 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.011s	sys 0.013s
W20260709 12:59:16.603695  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 68948.5us
I20260709 12:59:16.637766  1539 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
W20260709 12:59:16.604426  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:16.554070  3609 consensus_queue.cc:260] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:16.636709  1542 leader_election.cc:336] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.982s (SENT)
W20260709 12:59:16.641742  1542 leader_election.cc:336] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.020s (SENT)
I20260709 12:59:16.642231  1542 leader_election.cc:304] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:16.631028  1617 leader_election.cc:304] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:16.576934  3664 consensus_queue.cc:1048] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
W20260709 12:59:16.637080  1571 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.011s	sys 0.014s
I20260709 12:59:16.578461  3643 consensus_queue.cc:1048] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.058s
W20260709 12:59:16.564678  1615 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.002s	sys 0.012s
W20260709 12:59:16.653316  1615 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.004s	sys 0.013s
W20260709 12:59:16.653642  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 729096us
I20260709 12:59:16.656250  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:16.657696  1539 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:16.577160  3653 raft_consensus.cc:515] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:16.665077  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 89704.2us
W20260709 12:59:16.669234  1616 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.759s	user 0.002s	sys 0.010s
W20260709 12:59:16.640877  3694 log.cc:927] Time spent T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
W20260709 12:59:16.669806  1616 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.780s	user 0.002s	sys 0.010s
W20260709 12:59:16.669917  1573 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.003s	sys 0.010s
W20260709 12:59:16.670877  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 75842.1us
W20260709 12:59:16.672012  1542 leader_election.cc:336] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.086s (SENT)
I20260709 12:59:16.633630  3489 leader_election.cc:290] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:59:16.670006  1569 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.008s	sys 0.006s
W20260709 12:59:16.723991  1569 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.008s	sys 0.006s
W20260709 12:59:16.673134  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 72287.1us
I20260709 12:59:16.673116  1689 leader_election.cc:304] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 12:59:16.723826  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 51858.4us
I20260709 12:59:16.722568  3556 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:16.728013  1615 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:16.721005  3467 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:16.729920  3467 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:16.730671  3576 consensus_meta.cc:287] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.759s	user 0.005s	sys 0.003s
I20260709 12:59:16.731130  3323 raft_consensus.cc:493] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:16.731577  3323 raft_consensus.cc:515] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:16.725863  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:16.733356  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:16.734488  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:16.734584  1648 raft_consensus.cc:1240] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:16.630767  3710 raft_consensus.cc:2749] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:59:16.720412  1573 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.003s	sys 0.010s
I20260709 12:59:16.736447  1573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 1698) took 1269 ms. Trace:
I20260709 12:59:16.673385  1571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 303) took 1514 ms. Trace:
I20260709 12:59:16.736637  1542 leader_election.cc:304] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
W20260709 12:59:16.723794  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 66246.4us
I20260709 12:59:16.715991  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:16.736853  1572 raft_consensus.cc:1240] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:16.740378  1539 leader_election.cc:304] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:16.736865  1573 rpcz_store.cc:276] 0709 12:59:15.466718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:15.574142 (+107424us) service_pool.cc:224] Handling call
0709 12:59:15.574396 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:15.574577 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:59:16.101965 (+527388us) log.cc:844] Serialized 14 byte log entry
0709 12:59:16.736125 (+634160us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:16.736180 (+    55us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:16.736230 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:16.736295 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:16.736400 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9714,"prepare.queue_time_us":733721,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":404220,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"thread_start_us":1160804,"threads_started":2}
I20260709 12:59:16.737793  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:16.742551  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:16.743129  1648 raft_consensus.cc:2393] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 4: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
W20260709 12:59:16.746191  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 73133us
I20260709 12:59:16.747285  1689 leader_election.cc:304] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 12:59:16.772466  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:16.749819  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 306) took 1590 ms. Trace:
I20260709 12:59:16.752168  1570 raft_consensus.cc:1240] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:16.750356  1542 leader_election.cc:304] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:16.757858  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:16.792536  1569 rpcz_store.cc:276] 0709 12:59:15.159723 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:15.489841 (+330118us) service_pool.cc:224] Handling call
0709 12:59:15.490146 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:15.490364 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:59:16.055684 (+565320us) log.cc:844] Serialized 14 byte log entry
0709 12:59:16.749093 (+693409us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:16.749277 (+   184us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:16.749357 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:16.749536 (+   179us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:16.749736 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76317,"prepare.queue_time_us":720170,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":8331,"raft.queue_time_us":26668,"thread_start_us":1216714,"threads_started":2}
W20260709 12:59:16.733237  3337 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.000s	sys 0.018s
I20260709 12:59:16.721997  3609 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:16.669628  3718 raft_consensus.cc:2749] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:59:16.797832  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 47553.2us
W20260709 12:59:16.803594  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 57343.6us
I20260709 12:59:16.825246  1542 leader_election.cc:304] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:59:16.756691  2323 raft_consensus.cc:1240] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:16.675237  3677 consensus_queue.cc:1048] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.129s
I20260709 12:59:16.752435  3556 raft_consensus.cc:2749] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:16.760361  3448 raft_consensus.cc:2749] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:16.751487  3489 raft_consensus.cc:2804] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:59:16.822608  3693 log.cc:927] Time spent T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.313s	user 0.000s	sys 0.001s
I20260709 12:59:16.808405  3660 leader_election.cc:290] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:16.634541  3622 consensus_queue.cc:237] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:16.751470  3711 raft_consensus.cc:2749] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:16.820988  3699 raft_consensus.cc:2804] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:59:16.808176  3337 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.000s	sys 0.019s
I20260709 12:59:16.838673  1646 raft_consensus.cc:1240] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:16.832317  3713 consensus_queue.cc:1059] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 12:59:16.803400  3714 raft_consensus.cc:2804] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:16.827186  3728 raft_consensus.cc:2749] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:16.744372  3717 consensus_queue.cc:1059] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.136s
I20260709 12:59:16.754347  3715 consensus_queue.cc:1048] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.102s
I20260709 12:59:16.865626  3601 raft_consensus.cc:3055] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:59:16.868685  3700 log.cc:927] Time spent T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
I20260709 12:59:16.872038  3412 consensus_queue.cc:1059] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:16.872298  3721 raft_consensus.cc:2804] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:16.854271  3643 raft_consensus.cc:2749] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:16.673382  3623 consensus_queue.cc:260] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:16.849244  3612 consensus_queue.cc:237] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:16.910622  1651 raft_consensus.cc:1240] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 5 LEADER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 4. Current term is 5. Ops: []
W20260709 12:59:17.131595  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 384373us
I20260709 12:59:16.863467  3489 raft_consensus.cc:697] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
W20260709 12:59:16.870404  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 141440us
I20260709 12:59:16.872792  3467 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:16.921903  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 181570us
W20260709 12:59:16.897897  3703 log.cc:927] Time spent T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.255s	user 0.000s	sys 0.001s
W20260709 12:59:17.157858  3724 log.cc:927] Time spent T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
W20260709 12:59:17.089470  3704 log.cc:927] Time spent T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.433s	user 0.001s	sys 0.001s
W20260709 12:59:16.897539  3696 log.cc:927] Time spent T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.301s	user 0.001s	sys 0.000s
I20260709 12:59:17.185176  1689 leader_election.cc:304] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:17.013720  3660 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:16.869827  3364 raft_consensus.cc:2749] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:59:17.157464  3709 log.cc:927] Time spent T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 12:59:16.910162  3337 raft_consensus.cc:3055] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:59:16.875075  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 49937.6us
I20260709 12:59:16.919500  3711 raft_consensus.cc:493] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:16.864427  3664 consensus_queue.cc:1059] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.321s
I20260709 12:59:16.796978  3707 raft_consensus.cc:2749] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:17.033021  3675 raft_consensus.cc:493] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:17.158627  3721 raft_consensus.cc:493] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
W20260709 12:59:17.184147  3605 consensus_meta.cc:287] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.888s	user 0.011s	sys 0.000s
I20260709 12:59:16.984887  3713 raft_consensus.cc:493] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:17.133527  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:16.957562  3614 leader_election.cc:290] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:17.156970  3653 leader_election.cc:290] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:59:17.226145  3723 log.cc:927] Time spent T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
I20260709 12:59:17.209388  1689 leader_election.cc:304] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:17.211418  1646 raft_consensus.cc:1275] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:17.220146  3556 consensus_queue.cc:1059] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 12:59:16.898089  3699 raft_consensus.cc:697] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 3 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:17.230301  3721 raft_consensus.cc:3060] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:17.184778  3601 raft_consensus.cc:740] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:17.215801  1570 raft_consensus.cc:1275] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:17.188719  3728 raft_consensus.cc:493] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:16.873278  3714 raft_consensus.cc:493] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:17.217621  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:17.218897  1572 raft_consensus.cc:1275] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:17.195442  3729 raft_consensus.cc:493] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:17.213792  3467 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:17.213063  3337 raft_consensus.cc:740] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
W20260709 12:59:17.241675  3338 consensus_meta.cc:287] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 1.273s	user 0.012s	sys 0.000s
I20260709 12:59:17.241899  3323 leader_election.cc:290] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:17.224469  3466 raft_consensus.cc:493] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:17.225934  3717 raft_consensus.cc:2804] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:59:17.245045  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 412569us
I20260709 12:59:17.223901  3665 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:16.921754  1645 consensus_queue.cc:237] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:59:17.246924  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 319) took 1392 ms. Trace:
I20260709 12:59:17.215046  3370 consensus_queue.cc:1059] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:59:17.252008  1689 leader_election.cc:304] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:17.214380  1542 leader_election.cc:304] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:59:17.217036  3660 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:17.231094  3675 raft_consensus.cc:515] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:17.309713  3323 consensus_queue.cc:1059] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:17.305063  3466 raft_consensus.cc:3060] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:17.310592  3323 raft_consensus.cc:3055] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:17.311108  3323 raft_consensus.cc:740] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:17.311163  3675 leader_election.cc:290] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:17.311823  3733 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:17.230973  3711 raft_consensus.cc:515] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:17.231760  3605 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:17.281150  1567 raft_consensus.cc:2468] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 2.
I20260709 12:59:17.261824  3718 raft_consensus.cc:3055] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:17.247200  3732 raft_consensus.cc:493] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:17.260929  3707 consensus_queue.cc:1048] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:59:17.278690  3714 raft_consensus.cc:3060] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:17.300352  3338 raft_consensus.cc:2749] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:17.308427  1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 320) took 1639 ms. Trace:
I20260709 12:59:17.304597  1568 rpcz_store.cc:276] 0709 12:59:15.854282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:15.855510 (+  1228us) service_pool.cc:224] Handling call
0709 12:59:15.855940 (+   430us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:15.889369 (+ 33429us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:15.889402 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:15.893600 (+  4198us) log.cc:844] Serialized 26 byte log entry
0709 12:59:16.499503 (+605903us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:16.499558 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:16.499647 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:17.246724 (+747077us) raft_consensus.cc:1685] finished
0709 12:59:17.246742 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:17.246867 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27206,"raft.queue_time_us":28302,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":3639,"thread_start_us":605475,"threads_started":1,"wal-append.queue_time_us":701096}
I20260709 12:59:17.278740  3729 raft_consensus.cc:515] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:17.302685  3626 consensus_meta.cc:287] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.801s	user 0.001s	sys 0.010s
I20260709 12:59:17.327879  3718 raft_consensus.cc:740] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
W20260709 12:59:17.312919  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 61009.3us
W20260709 12:59:17.308851  3496 consensus_meta.cc:287] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 1.148s	user 0.004s	sys 0.008s
I20260709 12:59:17.299726  3699 consensus_queue.cc:237] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:59:17.246228  3489 consensus_queue.cc:237] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:17.331344  1648 raft_consensus.cc:1240] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:17.303602  3717 raft_consensus.cc:493] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
W20260709 12:59:17.315147  3547 consensus_meta.cc:287] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 1.139s	user 0.012s	sys 0.000s
I20260709 12:59:17.243480  3713 raft_consensus.cc:515] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:17.305546  3739 raft_consensus.cc:2749] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:17.300989  3467 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:17.345742  3740 raft_consensus.cc:2804] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:17.345911  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:17.337451  3732 raft_consensus.cc:515] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:17.340587  1718 rpcz_store.cc:276] 0709 12:59:15.669370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:15.726615 (+ 57245us) service_pool.cc:224] Handling call
0709 12:59:15.779875 (+ 53260us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:15.837180 (+ 57305us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:15.837212 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:15.892566 (+ 55354us) log.cc:844] Serialized 26 byte log entry
0709 12:59:16.448790 (+556224us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:16.469053 (+ 20263us) log.cc:844] Serialized 14 byte log entry
0709 12:59:16.469468 (+   415us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:16.469581 (+   113us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:17.308145 (+838564us) raft_consensus.cc:1685] finished
0709 12:59:17.308172 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:17.308333 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52050,"prepare.queue_time_us":49702,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":52830,"raft.run_cpu_time_us":294,"raft.run_wall_time_us":40645,"thread_start_us":459673,"threads_started":1,"wal-append.queue_time_us":630548}
I20260709 12:59:17.355309  1643 raft_consensus.cc:1240] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 5 LEADER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 4. Current term is 5. Ops: []
W20260709 12:59:17.355732  1539 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:37391 timed out after 1.633s (SENT) [suppressed 40 similar messages]
I20260709 12:59:17.277372  3728 raft_consensus.cc:515] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:17.369890  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:17.336833  3665 consensus_queue.cc:1059] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 12:59:17.312211  3323 consensus_queue.cc:260] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:59:17.343628  3626 raft_consensus.cc:515] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:17.335719  3337 consensus_queue.cc:260] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:17.387820  3718 consensus_queue.cc:260] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:17.357187  3496 raft_consensus.cc:515] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:17.353950  3726 log.cc:927] Time spent T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 12:59:17.324349  3733 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:17.360100  3717 raft_consensus.cc:3060] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:17.663146  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 448801us
I20260709 12:59:17.393232  1646 raft_consensus.cc:1275] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:17.662631  1648 raft_consensus.cc:2468] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 5.
W20260709 12:59:17.444648  3734 log.cc:927] Time spent T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
W20260709 12:59:17.457336  3332 consensus_meta.cc:287] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 1.315s	user 0.004s	sys 0.008s
W20260709 12:59:17.668174  1649 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45148 (request call id 1866) took 1789 ms (client timeout 2110 ms). Trace:
W20260709 12:59:17.664716  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 304852us
I20260709 12:59:17.703572  3714 raft_consensus.cc:515] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:17.690378  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 60462us
I20260709 12:59:17.368597  3547 raft_consensus.cc:515] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:17.569239  3743 log.cc:927] Time spent T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:59:17.536269  3746 raft_consensus.cc:493] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:17.703820  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:17.876929  1648 raft_consensus.cc:3060] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:17.392998  3467 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:17.478408  3466 raft_consensus.cc:515] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:17.880069  3637 raft_consensus.cc:493] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:17.880659  3637 raft_consensus.cc:515] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:17.881088  3466 leader_election.cc:290] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:17.563679  3605 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:17.673730  1574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 316) took 1880 ms. Trace:
I20260709 12:59:17.702575  3370 raft_consensus.cc:493] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
W20260709 12:59:17.668227  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 312508us
W20260709 12:59:17.474651  3662 consensus_meta.cc:287] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 1.324s	user 0.007s	sys 0.006s
W20260709 12:59:17.417078  3725 log.cc:927] Time spent T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:59:17.703243  3337 raft_consensus.cc:3060] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:17.420658  3736 raft_consensus.cc:2749] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:17.566110  3660 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:17.421618  3729 leader_election.cc:290] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:17.897745  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:17.386394  3740 raft_consensus.cc:493] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:17.898398  3740 raft_consensus.cc:3060] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:17.898845  2328 raft_consensus.cc:1240] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:17.898983  3547 leader_election.cc:290] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:59:17.723804  1691 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:17.873590  3718 raft_consensus.cc:3060] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:17.844906  3579 raft_consensus.cc:3055] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:17.901453  3579 raft_consensus.cc:740] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:17.901727  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:17.902365  3579 consensus_queue.cc:260] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:17.903515  3579 raft_consensus.cc:3060] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:17.903749  3496 leader_election.cc:290] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:59:17.747905  1649 rpcz_store.cc:269] 0709 12:59:15.785642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:15.829925 (+ 44283us) service_pool.cc:224] Handling call
0709 12:59:17.574819 (+1744894us) spinlock_profiling.cc:243] Waited 548 ms on lock 0x7b54002d87d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:17.574997 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1260864256}
I20260709 12:59:17.476275  3711 leader_election.cc:290] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:17.506547  3713 leader_election.cc:290] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:17.418236  3739 consensus_queue.cc:1059] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.355s
I20260709 12:59:16.310549  1642 rpcz_store.cc:276] 0709 12:59:15.267573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:15.267993 (+   420us) service_pool.cc:224] Handling call
0709 12:59:15.268240 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:15.268425 (+   185us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:59:15.695823 (+427398us) log.cc:844] Serialized 14 byte log entry
0709 12:59:16.309636 (+613813us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:16.309703 (+    67us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:16.309769 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:16.309858 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:16.310016 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2297,"prepare.queue_time_us":847032,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":2032,"raft.queue_time_us":89,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":39180,"thread_start_us":1040467,"threads_started":2}
I20260709 12:59:17.747817  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:17.749399  1688 leader_election.cc:304] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:17.851336  2331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53290 (request call id 780) took 1744 ms. Trace:
W20260709 12:59:17.837957  1542 leader_election.cc:336] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.640s (SENT)
I20260709 12:59:17.507555  3661 raft_consensus.cc:493] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:17.890666  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 12:59:17.919659  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 170338us
I20260709 12:59:17.891482  3626 leader_election.cc:290] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:17.892830  3732 leader_election.cc:290] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:17.882751  1574 rpcz_store.cc:276] 0709 12:59:15.796075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:15.811055 (+ 14980us) service_pool.cc:224] Handling call
0709 12:59:15.812806 (+  1751us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:15.813882 (+  1076us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:59:17.573026 (+1759144us) spinlock_profiling.cc:243] Waited 3.9 ms on lock 0x7b180022ef40. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9f1f634bc 00007fa9ef2b148b 00007fa9f810bab9 00007fa9ef2cd69b 00007fa9ef2cb93f 00007fa9ef2cb455 00007fa9f5db33c7 00007fa9f23c59a7 00007fa9f23d50bf
0709 12:59:17.573185 (+   159us) log.cc:844] Serialized 14 byte log entry
0709 12:59:17.673403 (+100218us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:17.673460 (+    57us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:17.673504 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:17.673571 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:17.673678 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8995,"prepare.queue_time_us":570858,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":474,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":41428,"spinlock_wait_cycles":8962304,"thread_start_us":737464,"threads_started":2,"wal-append.queue_time_us":261283}
W20260709 12:59:17.837088  3726 log.cc:927] Time spent T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
W20260709 12:59:17.850571  3690 log.cc:927] Time spent T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 1.290s	user 0.008s	sys 0.000s
W20260709 12:59:17.453428  3737 log.cc:927] Time spent T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:59:17.905140  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 290) took 1571 ms. Trace:
I20260709 12:59:17.906378  3744 raft_consensus.cc:493] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:17.761859  3332 raft_consensus.cc:515] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:17.906822  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:17.941313  1645 raft_consensus.cc:3060] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:17.800267  2323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53290 (request call id 779) took 1693 ms. Trace:
I20260709 12:59:17.894026  3662 raft_consensus.cc:515] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:17.908089  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:17.893814  3370 raft_consensus.cc:515] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:17.915714  1650 raft_consensus.cc:3060] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:17.917259  1542 leader_election.cc:304] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:17.916079  2331 rpcz_store.cc:276] 0709 12:59:16.106920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:16.107380 (+   460us) service_pool.cc:224] Handling call
0709 12:59:16.108017 (+   637us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:16.221385 (+113368us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:16.221429 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:16.221493 (+    64us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:16.221541 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:17.851002 (+1629461us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b540062e154. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:17.851071 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:17.851261 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":260146432}
I20260709 12:59:17.935420  1647 rpcz_store.cc:276] 0709 12:59:16.334117 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:16.334316 (+   199us) service_pool.cc:224] Handling call
0709 12:59:16.438465 (+104149us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:16.454298 (+ 15833us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:16.454340 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:16.477934 (+ 23594us) log.cc:844] Serialized 26 byte log entry
0709 12:59:16.864413 (+386479us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:16.864467 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:16.864573 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:17.904924 (+1040351us) raft_consensus.cc:1685] finished
0709 12:59:17.904954 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:17.905089 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8218,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":9108,"thread_start_us":333087,"threads_started":1,"wal-append.queue_time_us":734565}
I20260709 12:59:17.977020  3739 raft_consensus.cc:2804] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:18.024778  3739 raft_consensus.cc:493] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:17.992596  3717 raft_consensus.cc:515] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:17.977994  3714 leader_election.cc:290] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:18.026051  3707 raft_consensus.cc:2749] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:17.935711  3661 raft_consensus.cc:515] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:17.974505  3757 raft_consensus.cc:493] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:17.909689  3637 leader_election.cc:290] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:17.987664  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:18.038211  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:17.988823  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:17.794866  3745 consensus_queue.cc:1059] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.158s
I20260709 12:59:17.995296  1648 raft_consensus.cc:2468] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 4.
I20260709 12:59:18.000304  1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45148 (request call id 1865) took 2386 ms. Trace:
I20260709 12:59:18.039067  1646 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:18.001328  3742 log.cc:927] Time spent T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:59:16.736989  1571 rpcz_store.cc:276] 0709 12:59:15.158867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:15.382692 (+223825us) service_pool.cc:224] Handling call
0709 12:59:15.383042 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:15.383276 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:59:15.989169 (+605893us) log.cc:844] Serialized 14 byte log entry
0709 12:59:16.672324 (+683155us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:16.672736 (+   412us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:16.672894 (+   158us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:16.673084 (+   190us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:16.673297 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23387,"prepare.queue_time_us":700501,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":40138,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":1490,"thread_start_us":1161647,"threads_started":2}
I20260709 12:59:18.047232  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:18.049799  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:18.050483  1571 raft_consensus.cc:2393] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 5: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:18.046838  2327 raft_consensus.cc:2468] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 4.
W20260709 12:59:18.006211  1617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:18.006702  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 168799us
W20260709 12:59:18.056164  1617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:18.057029  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:17.905576  3547 raft_consensus.cc:493] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:18.010492  3576 raft_consensus.cc:3055] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:18.013257  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:18.013943  2330 raft_consensus.cc:1240] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:18.061214  2329 raft_consensus.cc:2393] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 5: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 12:59:18.020152  3338 raft_consensus.cc:493] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:18.021656  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:18.023250  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:18.024104  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:18.025341  3739 raft_consensus.cc:3060] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:18.027456  1651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45148 (request call id 1857) took 2699 ms. Trace:
I20260709 12:59:18.069222  1724 raft_consensus.cc:1240] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:18.068797  1651 rpcz_store.cc:276] 0709 12:59:15.328383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:15.427455 (+ 99072us) service_pool.cc:224] Handling call
0709 12:59:15.625072 (+197617us) spinlock_profiling.cc:243] Waited 21 ms on lock 0x7b5800181898. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef296b71 00007fa9ef296a22 00007fa9f81afc09 00007fa9f7309ee0 00007fa9f73d30ab 00007fa9f73d3131 00007fa9f7394fc0 00007fa9f737f929 00007fa9f737f3d2 00007fa9f08f6bd4
0709 12:59:15.727988 (+102916us) spinlock_profiling.cc:243] Waited 41 ms on lock 0x7b5800181898. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef296e9c 00007fa9ef296a5b 00007fa9f81afc09 00007fa9f7309ee0 00007fa9f73d30ab 00007fa9f73d3131 00007fa9f7394fc0 00007fa9f737f929 00007fa9f737f3d2 00007fa9f08f6bd4
0709 12:59:15.728199 (+   211us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:17.172059 (+1443860us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:18.027244 (+855185us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54002b1e54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:18.027401 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2860804096}
I20260709 12:59:18.069720  2326 raft_consensus.cc:2368] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 4. Current term is 5.
I20260709 12:59:17.978957  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:17.947791  3728 leader_election.cc:290] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:18.030697  1645 raft_consensus.cc:2468] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 5.
I20260709 12:59:17.945258  2323 rpcz_store.cc:276] 0709 12:59:16.106546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:16.113975 (+  7429us) service_pool.cc:224] Handling call
0709 12:59:16.150046 (+ 36071us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:16.854554 (+704508us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:17.799877 (+945323us) spinlock_profiling.cc:243] Waited 574 ms on lock 0x7b5400632254. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:17.800162 (+   285us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1319796480}
I20260709 12:59:18.033535  1569 raft_consensus.cc:1275] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:59:17.789165  3601 consensus_queue.cc:260] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:18.034605  1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 311) took 2769 ms. Trace:
I20260709 12:59:18.039251  1643 rpcz_store.cc:276] 0709 12:59:15.614385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:15.919188 (+304803us) service_pool.cc:224] Handling call
0709 12:59:15.919546 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:17.347989 (+1428443us) spinlock_profiling.cc:243] Waited 24.9 ms on lock 0x7b540034b0a0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f2332dc0 00007fa9f23bd1c0 00007fa9f23be231 00007fa9f23bad8f 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c
0709 12:59:17.664120 (+316131us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:18.000012 (+335892us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b5400193a54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:18.000203 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2518291200}
I20260709 12:59:18.040683  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:18.053812  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:18.055152  1722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 312) took 2790 ms. Trace:
W20260709 12:59:18.007310  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 258865us
I20260709 12:59:18.058388  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:18.078787  1717 raft_consensus.cc:2468] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 1.
I20260709 12:59:18.056701  3710 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:18.017115  3556 raft_consensus.cc:3055] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:18.062187  1723 raft_consensus.cc:1240] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 3. Current term is 4. Ops: []
W20260709 12:59:18.061434  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 140217us
I20260709 12:59:18.063864  3581 raft_consensus.cc:493] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:18.063558  1725 raft_consensus.cc:3060] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:59:18.063788  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:18.086710  1571 raft_consensus.cc:3060] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:18.052902  3448 raft_consensus.cc:493] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:18.066300  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:18.056164  3707 raft_consensus.cc:493] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:18.073711  1722 rpcz_store.cc:276] 0709 12:59:15.265188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:15.565932 (+300744us) service_pool.cc:224] Handling call
0709 12:59:15.566243 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:15.566574 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:15.566601 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:15.567067 (+   466us) log.cc:844] Serialized 26 byte log entry
0709 12:59:16.288700 (+721633us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:16.288742 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:16.288820 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:17.849770 (+1560950us) spinlock_profiling.cc:243] Waited 1.94 ms on lock 0x7b4400022b4c. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef1f4c85 00007fa9ef1f56a2 00007fa9f1f671db 00007fa9f1f62aaf 00007fa9f1f5686e 00007fa9f1f55bb6 00007fa9f1f557d8 00007fa9f1f5f221 00007fa9f1f5f1d9 00007fa9f1f5f169
0709 12:59:18.054809 (+205039us) raft_consensus.cc:1685] finished
0709 12:59:18.054840 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:18.055080 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":91,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":89,"spinlock_wait_cycles":4466432,"thread_start_us":721268,"threads_started":1,"wal-append.queue_time_us":947166}
I20260709 12:59:18.060361  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:18.062089  3733 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:18.065755  3715 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:18.062083  3576 raft_consensus.cc:740] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:18.105394  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 12:59:18.063275  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:18.047679  3757 raft_consensus.cc:515] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:18.072580  3547 raft_consensus.cc:515] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:18.074640  3595 raft_consensus.cc:493] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:18.068742  3338 raft_consensus.cc:515] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:18.063673  3364 raft_consensus.cc:493] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:17.910682  3746 raft_consensus.cc:515] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:18.072134  1720 rpcz_store.cc:276] 0709 12:59:15.264913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:15.492806 (+227893us) service_pool.cc:224] Handling call
0709 12:59:15.617185 (+124379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:15.617610 (+   425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:15.617649 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:15.618214 (+   565us) log.cc:844] Serialized 26 byte log entry
0709 12:59:16.214798 (+596584us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:16.214865 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:16.214962 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:16.869259 (+654297us) raft_consensus.cc:1685] finished
0709 12:59:16.869286 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:18.034358 (+1165072us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b540041fd50. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23ba8ad 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:18.034545 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":11600,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"spinlock_wait_cycles":246482304,"thread_start_us":596150,"threads_started":1,"wal-append.queue_time_us":829916,"wal-append.run_cpu_time_us":4228,"wal-append.run_wall_time_us":1420630}
I20260709 12:59:18.088928  1719 raft_consensus.cc:3060] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:18.093128  3581 raft_consensus.cc:515] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:18.089715  1716 raft_consensus.cc:3060] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:18.090165  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:18.077540  3584 consensus_queue.cc:1059] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:59:18.083499  3332 leader_election.cc:290] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:18.085507  3556 raft_consensus.cc:740] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:17.990453  3744 raft_consensus.cc:515] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:18.128913  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 49192.8us
W20260709 12:59:18.131651  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 53163.9us
I20260709 12:59:18.109587  3382 raft_consensus.cc:3055] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:18.123543  1721 raft_consensus.cc:3060] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:18.093465  3745 consensus_queue.cc:1059] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:59:18.123834  3713 raft_consensus.cc:493] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:18.096129  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:18.093983  3714 consensus_queue.cc:1059] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:59:18.113054  3670 raft_consensus.cc:493] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:18.096263  3448 raft_consensus.cc:515] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:18.120111  3675 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:18.124670  3595 raft_consensus.cc:515] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:18.122884  3757 leader_election.cc:290] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:18.096829  3707 raft_consensus.cc:515] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:18.148608  1725 raft_consensus.cc:1275] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:18.131572  3717 leader_election.cc:290] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:18.134337  3382 raft_consensus.cc:740] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:18.158998  1650 raft_consensus.cc:2468] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 3.
I20260709 12:59:18.161351  1650 raft_consensus.cc:1240] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 4 LEADER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:18.141501  3670 raft_consensus.cc:3060] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:18.168097  1719 raft_consensus.cc:2468] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 4.
I20260709 12:59:18.130057  3364 raft_consensus.cc:515] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:18.176873  1571 raft_consensus.cc:2468] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 5.
I20260709 12:59:18.150666  3728 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:18.124331  3715 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:18.151081  3675 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:18.141708  3713 raft_consensus.cc:515] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:18.150995  3745 consensus_queue.cc:1059] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 12:59:18.107177  3710 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:18.149358  3576 consensus_queue.cc:260] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:18.314015  1540 leader_election.cc:400] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 election: Vote denied by peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423) with higher term. Message: Invalid argument: T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 4. Current term is 5.
I20260709 12:59:18.325738  1540 leader_election.cc:403] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:59:18.327971  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 12:59:18.207976  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 72973us
I20260709 12:59:18.328354  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
W20260709 12:59:18.217114  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 56477.9us
W20260709 12:59:18.330778  1617 leader_election.cc:336] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.642s (SENT)
W20260709 12:59:18.210109  1542 leader_election.cc:336] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.535s (SENT)
I20260709 12:59:18.335274  1716 raft_consensus.cc:2468] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 2.
W20260709 12:59:18.335601  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 125554us
I20260709 12:59:18.335743  1540 leader_election.cc:304] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:18.338131  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 12:59:18.242077  3701 log.cc:927] Time spent T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 1.051s	user 0.009s	sys 0.000s
I20260709 12:59:18.340046  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:18.341020  2331 raft_consensus.cc:2393] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 5: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 12:59:18.344568  1646 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 6.
I20260709 12:59:18.345249  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45148 (request call id 1878) took 1012 ms. Trace:
I20260709 12:59:18.345577  1646 rpcz_store.cc:276] 0709 12:59:17.333335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:17.988564 (+655229us) service_pool.cc:224] Handling call
0709 12:59:18.345194 (+356630us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:18.183787  3755 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:18.309031  3595 leader_election.cc:290] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:18.242386  3661 leader_election.cc:290] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:18.326081  3744 leader_election.cc:290] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:18.350944  1646 raft_consensus.cc:1240] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:18.352586  1650 raft_consensus.cc:1240] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:18.174357  3753 consensus_queue.cc:1059] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.176s
I20260709 12:59:18.190229  3662 leader_election.cc:290] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:18.334522  3608 consensus_queue.cc:1059] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:59:18.338056  3711 raft_consensus.cc:2749] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423) with higher term. Message: Invalid argument: T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 4. Current term is 5.
I20260709 12:59:18.340590  3489 raft_consensus.cc:2749] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:18.358708  1646 raft_consensus.cc:1240] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:18.337284  3728 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:18.325724  3587 consensus_queue.cc:1059] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
W20260709 12:59:18.352428  3721 consensus_meta.cc:287] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 1.075s	user 0.009s	sys 0.003s
I20260709 12:59:18.371368  1644 raft_consensus.cc:3055] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:18.372941  1644 raft_consensus.cc:740] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:18.373140  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:18.373464  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:18.359127  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:18.178578  3556 consensus_queue.cc:260] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:18.371807  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:18.383776  1689 leader_election.cc:304] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:18.346252  3717 consensus_queue.cc:1059] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260709 12:59:18.374749  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:18.362313  3744 raft_consensus.cc:3055] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:18.375937  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:18.376813  3715 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:18.378274  3713 leader_election.cc:290] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:18.351837  3714 consensus_queue.cc:1059] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 12:59:18.354933  3755 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:18.379175  3746 leader_election.cc:290] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:18.379745  3364 leader_election.cc:290] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:18.324429  3382 consensus_queue.cc:260] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:18.365176  3338 leader_election.cc:290] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:18.399554  1725 raft_consensus.cc:2468] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
I20260709 12:59:18.360071  3745 consensus_queue.cc:1059] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:59:18.372884  3764 consensus_queue.cc:1059] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.069s
I20260709 12:59:18.382697  3721 raft_consensus.cc:515] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:18.573529  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:18.462180  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 12:59:18.412488  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:18.575114  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:18.510964  1721 raft_consensus.cc:2468] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 4.
I20260709 12:59:18.573632  1689 leader_election.cc:304] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:18.400642  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 12:59:18.539059  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:18.583865  1617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:18.584829  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:18.584996  3770 raft_consensus.cc:3055] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:18.585431  3764 raft_consensus.cc:3055] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:18.504771  3466 raft_consensus.cc:3055] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:18.585666  3770 raft_consensus.cc:740] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:18.585880  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:18.586340  3466 raft_consensus.cc:740] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:18.586638  1725 raft_consensus.cc:2468] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 4.
I20260709 12:59:18.587448  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:18.587889  3382 raft_consensus.cc:3060] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:18.587399  3466 consensus_queue.cc:260] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:18.501609  3556 raft_consensus.cc:3060] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:18.588137  1725 raft_consensus.cc:2468] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 3.
I20260709 12:59:18.543224  3753 raft_consensus.cc:2749] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:18.588572  3338 raft_consensus.cc:493] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:18.585901  3764 raft_consensus.cc:740] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:18.398767  3707 leader_election.cc:290] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:18.589124  1689 leader_election.cc:304] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:18.576169  1719 raft_consensus.cc:1240] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:59:18.576220  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:18.598356  1716 raft_consensus.cc:2468] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
I20260709 12:59:18.599280  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:18.591463  3714 raft_consensus.cc:2749] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:18.386318  1644 consensus_queue.cc:260] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:18.609090  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:18.533196  3665 raft_consensus.cc:3055] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:18.594696  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:18.387054  3448 leader_election.cc:290] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:18.597249  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:18.610723  1725 raft_consensus.cc:2468] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 3.
I20260709 12:59:18.399928  3744 raft_consensus.cc:740] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:18.398746  3717 consensus_queue.cc:1243] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:59:18.583817  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 12:59:18.600997  3337 consensus_meta.cc:287] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.699s	user 0.005s	sys 0.006s
I20260709 12:59:18.601748  1689 leader_election.cc:304] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 12:59:18.603199  3739 consensus_meta.cc:287] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.527s	user 0.008s	sys 0.000s
I20260709 12:59:18.611271  3721 leader_election.cc:290] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:18.610319  3665 raft_consensus.cc:740] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:18.626535  3739 raft_consensus.cc:515] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:18.627676  3665 consensus_queue.cc:260] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:18.628938  3739 leader_election.cc:290] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:18.629067  3665 raft_consensus.cc:3060] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:18.586992  3770 consensus_queue.cc:260] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:18.629951  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:18.630383  3770 raft_consensus.cc:3060] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:18.616588  3764 consensus_queue.cc:260] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:18.632212  3764 raft_consensus.cc:3060] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:18.611680  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:18.636790  1688 leader_election.cc:304] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:18.637096  1725 raft_consensus.cc:3060] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:18.594542  3675 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:18.639816  1646 raft_consensus.cc:1240] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:18.597009  3710 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:59:18.404714  3740 consensus_meta.cc:287] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.506s	user 0.010s	sys 0.002s
I20260709 12:59:18.615746  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:18.644313  3674 raft_consensus.cc:2749] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:18.644204  3739 consensus_queue.cc:1059] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:18.633455  3670 raft_consensus.cc:515] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:18.645100  3739 consensus_queue.cc:1243] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer 4dbe7d47a2374afca075d3a98583b49e log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:59:18.645550  3674 raft_consensus.cc:3055] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:18.645567  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:18.646050  3674 raft_consensus.cc:740] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:18.646963  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:18.647661  1717 raft_consensus.cc:2468] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
I20260709 12:59:18.647043  3674 consensus_queue.cc:260] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:18.648928  3674 raft_consensus.cc:3060] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:18.597407  3338 raft_consensus.cc:515] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:18.605521  3755 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:18.649386  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:18.650239  3740 raft_consensus.cc:515] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:18.651348  3338 leader_election.cc:290] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:18.598239  3623 raft_consensus.cc:3060] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:18.609905  3771 raft_consensus.cc:2749] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:18.617923  3744 consensus_queue.cc:260] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:18.616041  3466 raft_consensus.cc:3060] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:18.640872  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:18.661114  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:18.661756  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:18.662202  1646 raft_consensus.cc:2393] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 4: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:18.662832  1650 raft_consensus.cc:2393] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 3: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:18.663403  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:18.664260  1646 raft_consensus.cc:3060] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:18.641376  1617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:18.642060  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:18.665190  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:18.642956  3579 consensus_queue.cc:1048] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:18.643569  1689 leader_election.cc:304] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:18.643733  3768 raft_consensus.cc:2804] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:18.631134  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:18.632963  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 1708) took 1427 ms. Trace:
I20260709 12:59:18.620460  3728 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:18.647032  3670 leader_election.cc:290] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:18.669593  1569 rpcz_store.cc:276] 0709 12:59:17.205787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:17.206384 (+   597us) service_pool.cc:224] Handling call
0709 12:59:17.206770 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:18.071811 (+865041us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:18.632739 (+560928us) spinlock_profiling.cc:243] Waited 821 ms on lock 0x7b54002ebdd4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:18.632903 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1889397760}
W20260709 12:59:18.670241  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 45863.8us
I20260709 12:59:18.670322  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:18.668962  1725 raft_consensus.cc:2468] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
I20260709 12:59:18.676481  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:18.673144  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:18.675581  2295 leader_election.cc:304] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:18.677178  1725 raft_consensus.cc:2468] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
I20260709 12:59:18.677121  1689 leader_election.cc:304] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:18.681375  1722 raft_consensus.cc:3055] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:18.681695  1722 raft_consensus.cc:740] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:18.683094  1650 raft_consensus.cc:1240] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:18.666626  3744 raft_consensus.cc:3060] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:18.685725  1725 raft_consensus.cc:3055] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:18.686210  1725 raft_consensus.cc:740] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:18.671604  3745 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:18.685295  1722 consensus_queue.cc:260] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:18.693945  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:18.694794  1571 raft_consensus.cc:1275] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:18.696465  1571 raft_consensus.cc:1240] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 12:59:18.697221  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:18.697746  1575 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:18.698485  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:18.699762  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:18.700304  1571 raft_consensus.cc:3060] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:18.701851  1646 raft_consensus.cc:2468] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 6.
I20260709 12:59:18.694641  1569 raft_consensus.cc:2468] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 5.
I20260709 12:59:18.674520  3753 raft_consensus.cc:2749] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:18.679438  3587 raft_consensus.cc:2749] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:18.679242  3717 consensus_queue.cc:1048] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:59:18.679279  3768 raft_consensus.cc:697] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 4 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:18.708336  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:18.711738  3670 raft_consensus.cc:493] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:18.718832  1569 raft_consensus.cc:1240] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:18.722656  3740 leader_election.cc:290] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:18.724212  1571 raft_consensus.cc:2468] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 3.
I20260709 12:59:18.725819  1574 raft_consensus.cc:1240] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:59:18.689482  3755 raft_consensus.cc:2764] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:59:18.727236  1573 raft_consensus.cc:2393] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 4: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:18.727983  1542 leader_election.cc:304] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:18.727772  1725 consensus_queue.cc:260] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:18.734954  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:18.735806  1573 raft_consensus.cc:2410] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:59:18.736785  1542 leader_election.cc:304] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:18.738744  1542 leader_election.cc:304] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:59:18.740046  1542 leader_election.cc:304] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:18.740319  1575 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 6.
I20260709 12:59:18.737555  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:18.742214  1650 raft_consensus.cc:1240] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:18.742611  1571 raft_consensus.cc:3060] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:18.746655  3712 log.cc:927] Time spent T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 1.848s	user 0.001s	sys 0.011s
I20260709 12:59:18.749531  1542 leader_election.cc:304] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:18.758731  1542 leader_election.cc:304] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:18.759929  1542 leader_election.cc:304] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:18.767433  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:18.769126  3740 raft_consensus.cc:2804] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:18.769564  3740 raft_consensus.cc:493] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:18.769901  3740 raft_consensus.cc:3060] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:18.771088  3710 raft_consensus.cc:2749] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:18.772537  1725 raft_consensus.cc:3060] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:18.705051  3745 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:18.776234  1542 leader_election.cc:304] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:18.776981  1571 raft_consensus.cc:2468] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 6.
I20260709 12:59:18.777235  1542 leader_election.cc:304] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
W20260709 12:59:18.777925  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:18.780900  3608 raft_consensus.cc:2749] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:18.782291  1717 raft_consensus.cc:2468] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 3.
I20260709 12:59:18.779102  3710 raft_consensus.cc:2749] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:18.784488  3707 raft_consensus.cc:2804] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:18.784934  3707 raft_consensus.cc:493] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:18.785262  3707 raft_consensus.cc:3060] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:18.786550  3370 leader_election.cc:290] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:18.788484  3750 raft_consensus.cc:3055] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:18.789007  3750 raft_consensus.cc:740] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:18.790126  3750 consensus_queue.cc:260] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:18.791530  3750 raft_consensus.cc:3060] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:18.728894  3670 raft_consensus.cc:515] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:18.797533  3323 raft_consensus.cc:3060] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:59:18.798235  3670 leader_election.cc:290] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:18.798942  3768 consensus_queue.cc:237] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:18.806348  3605 raft_consensus.cc:3055] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:18.807010  3605 raft_consensus.cc:740] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:18.810851  1723 raft_consensus.cc:2468] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 3.
I20260709 12:59:18.810914  3601 raft_consensus.cc:3060] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:18.811872  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:18.741317  3556 raft_consensus.cc:2749] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:18.744094  3721 raft_consensus.cc:2804] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:18.813802  3721 raft_consensus.cc:493] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:18.814182  3721 raft_consensus.cc:3060] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:18.741811  3728 raft_consensus.cc:2749] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:18.744220  3714 raft_consensus.cc:493] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:18.817142  3714 raft_consensus.cc:515] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:18.817921  3581 leader_election.cc:290] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:18.819443  3714 leader_election.cc:290] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:18.822201  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:59:18.822599  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 132404us
I20260709 12:59:18.823829  2295 leader_election.cc:304] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:18.824599  1720 raft_consensus.cc:2468] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 4.
I20260709 12:59:18.826323  2295 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:18.827261  3591 raft_consensus.cc:2804] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:18.767452  3448 raft_consensus.cc:2804] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:18.827797  3591 raft_consensus.cc:697] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:18.828171  3448 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:18.828655  3448 raft_consensus.cc:3060] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:18.828816  3591 consensus_queue.cc:237] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:18.832244  1575 raft_consensus.cc:1240] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:18.832176  1569 raft_consensus.cc:1240] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:18.836928  1725 raft_consensus.cc:1275] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:18.839608  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:18.839385  3740 raft_consensus.cc:515] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:18.842724  3740 leader_election.cc:290] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:18.839721  1574 raft_consensus.cc:1240] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:18.832605  3449 raft_consensus.cc:2749] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:18.846830  3745 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:18.847887  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:18.848763  1650 raft_consensus.cc:2393] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 5: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:18.853704  1723 raft_consensus.cc:2468] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 5.
I20260709 12:59:18.857164  1721 raft_consensus.cc:2468] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 3.
I20260709 12:59:18.824959  3605 consensus_queue.cc:260] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:18.860862  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:59:18.862219  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 81893.4us
I20260709 12:59:18.867676  3449 consensus_queue.cc:1059] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:18.868628  3623 raft_consensus.cc:3055] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:18.868723  3449 consensus_queue.cc:1059] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:18.869177  3623 raft_consensus.cc:740] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:18.879056  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:59:18.883949  3749 log.cc:927] Time spent T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.995s	user 0.005s	sys 0.001s
I20260709 12:59:18.885046  3740 raft_consensus.cc:493] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:18.893419  3584 consensus_queue.cc:1059] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:18.886642  1649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45148 (request call id 1872) took 1556 ms. Trace:
I20260709 12:59:18.897380  3740 raft_consensus.cc:515] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:18.885372  3595 raft_consensus.cc:3055] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:18.898610  3595 raft_consensus.cc:740] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:18.899753  3740 leader_election.cc:290] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:18.899412  3595 consensus_queue.cc:260] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:18.900630  3595 raft_consensus.cc:3060] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:18.901185  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:18.902220  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:18.902896  1571 raft_consensus.cc:1240] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:18.903144  1724 raft_consensus.cc:2410] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:59:18.896832  1649 rpcz_store.cc:276] 0709 12:59:17.330600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:18.049268 (+718668us) service_pool.cc:224] Handling call
0709 12:59:18.049525 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:18.059840 (+ 10315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:18.059868 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:18.059911 (+    43us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:59:18.059956 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:18.886418 (+826462us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b54000d8ed4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:18.886460 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:18.886581 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23276800}
I20260709 12:59:18.902163  1720 raft_consensus.cc:2393] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 3: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:59:18.892470  1723 raft_consensus.cc:2393] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 3: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:59:18.907960  1574 raft_consensus.cc:1240] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:18.881247  3605 raft_consensus.cc:3060] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:18.953668  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:18.956645  1720 raft_consensus.cc:1240] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 3. Current term is 4. Ops: [3.5-3.5]
W20260709 12:59:18.951416  3496 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.016s	sys 0.052s
I20260709 12:59:18.974936  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 12:59:18.972662  3496 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.016s	sys 0.052s
I20260709 12:59:18.952418  3449 consensus_queue.cc:1059] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:59:18.978516  3449 raft_consensus.cc:3055] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:18.979036  3449 raft_consensus.cc:740] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:18.960001  3448 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:18.984084  3448 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:18.983501  3449 consensus_queue.cc:260] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:18.985776  1721 raft_consensus.cc:1240] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:59:18.986686  3449 raft_consensus.cc:3060] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:18.987241  1721 raft_consensus.cc:1275] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:18.990310  3707 raft_consensus.cc:515] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:18.991458  1573 raft_consensus.cc:1240] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:18.971549  3762 raft_consensus.cc:3055] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:18.976107  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:19.000766  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:18.895543  3623 consensus_queue.cc:260] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:18.970841  3740 consensus_queue.cc:1048] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:59:19.072891  1722 raft_consensus.cc:3060] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:59:19.059554  1617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:19.114730  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:19.097307  1644 raft_consensus.cc:3060] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:19.155943  1719 raft_consensus.cc:2393] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 3: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
W20260709 12:59:19.070587  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:19.125698  1691 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:19.114246  2297 leader_election.cc:304] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e
W20260709 12:59:19.156142  1617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:19.014626  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:19.156770  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:19.001121  2331 raft_consensus.cc:1275] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:19.075263  1615 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 12:59:19.012441  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:19.159818  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:19.160014  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:59:19.160715  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:19.168592  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 54486.6us
W20260709 12:59:19.171319  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:19.037025  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:19.161798  1724 raft_consensus.cc:2468] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 4.
W20260709 12:59:19.030135  2295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:19.190625  1644 raft_consensus.cc:2468] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 2.
W20260709 12:59:19.183527  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 108332us
I20260709 12:59:19.194725  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:19.195794  1724 raft_consensus.cc:3060] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:19.093974  3576 raft_consensus.cc:3060] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:19.196379  2297 leader_election.cc:304] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:19.069530  3733 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:19.197024  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 12:59:19.050434  3735 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 12:59:19.174542  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:19.076701  3369 raft_consensus.cc:493] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:19.211218  3369 raft_consensus.cc:515] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:19.211663  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:19.203279  3605 consensus_queue.cc:1048] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:59:19.213306  3369 leader_election.cc:290] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:19.213790  3369 consensus_queue.cc:1048] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:19.214111  1574 raft_consensus.cc:1240] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:19.217500  1724 raft_consensus.cc:2468] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 5.
I20260709 12:59:19.196960  3601 consensus_queue.cc:1059] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:59:19.218652  3605 raft_consensus.cc:3055] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:19.218340  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:19.219008  3605 raft_consensus.cc:740] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:19.219480  3591 consensus_queue.cc:1059] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:19.219924  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:19.219805  3605 consensus_queue.cc:260] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:19.220677  1724 raft_consensus.cc:2393] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 3: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
W20260709 12:59:19.221035  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:19.221469  2325 raft_consensus.cc:2468] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 4.
I20260709 12:59:19.032441  3489 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:19.222002  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:19.195722  3675 raft_consensus.cc:2804] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:19.222108  3489 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:19.222608  1724 raft_consensus.cc:2468] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 5.
I20260709 12:59:19.222782  3675 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:19.223224  3675 raft_consensus.cc:3060] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:19.223572  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:19.095110  3529 tablet_bootstrap.cc:492] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:59:19.202901  1568 raft_consensus.cc:1240] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:19.175585  1721 raft_consensus.cc:3060] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:19.204865  2297 leader_election.cc:304] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 12:59:19.090180  3707 leader_election.cc:290] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:19.004209  3448 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:19.176471  3626 raft_consensus.cc:2804] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:59:19.176326  3662 raft_consensus.cc:493] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:19.075634  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:19.159710  3338 raft_consensus.cc:493] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:19.078647  3732 consensus_queue.cc:1048] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.129s
W20260709 12:59:19.200407  1644 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 1257) took 3603 ms (client timeout 1633 ms). Trace:
I20260709 12:59:19.193403  3728 raft_consensus.cc:493] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:19.078450  3702 consensus_queue.cc:1048] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.156s
W20260709 12:59:19.255676  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:19.337453  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 74393.3us
I20260709 12:59:19.334611  1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 325) took 1303 ms. Trace:
I20260709 12:59:19.231027  1724 raft_consensus.cc:2410] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:59:19.282176  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 12:59:19.199679  3673 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:59:19.077889  3581 raft_consensus.cc:493] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:19.077680  3758 raft_consensus.cc:493] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:19.167183  3496 raft_consensus.cc:3055] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:19.000204  3762 raft_consensus.cc:740] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:19.088359  3739 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:19.176194  3744 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
W20260709 12:59:19.263257  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:19.335983  1651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45148 (request call id 1877) took 2003 ms. Trace:
I20260709 12:59:19.209240  1719 raft_consensus.cc:2393] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 3: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
W20260709 12:59:19.361953  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:19.280889  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:19.338332  1718 rpcz_store.cc:276] 0709 12:59:18.031196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:18.031325 (+   129us) service_pool.cc:224] Handling call
0709 12:59:18.053416 (+ 22091us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:18.136217 (+ 82801us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:18.136236 (+    19us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:18.136262 (+    26us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:18.136284 (+    22us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:19.334251 (+1197967us) spinlock_profiling.cc:243] Waited 82.6 ms on lock 0x7b5400353754. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:19.334311 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:19.334534 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":190078848}
I20260709 12:59:19.340251  1574 raft_consensus.cc:2393] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 6: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:19.361593  1651 rpcz_store.cc:276] 0709 12:59:17.332989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:18.085196 (+752207us) service_pool.cc:224] Handling call
0709 12:59:18.104066 (+ 18870us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:18.124190 (+ 20124us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:18.124222 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:18.124261 (+    39us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:18.124292 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:19.335681 (+1211389us) spinlock_profiling.cc:243] Waited 19.9 ms on lock 0x7b54001f8e54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:19.335743 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:19.335910 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45827328}
I20260709 12:59:19.261031  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 12:59:19.240485  1542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:19.336314  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 12:59:19.341302  1644 rpcz_store.cc:269] 0709 12:59:15.591070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:15.665074 (+ 74004us) service_pool.cc:224] Handling call
0709 12:59:18.371234 (+2706160us) spinlock_profiling.cc:243] Waited 873 ms on lock 0x7b5400110420. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f2332dc0 00007fa9f23bee18 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:19.097096 (+725862us) spinlock_profiling.cc:243] Waited 184 ms on lock 0x7b5800076ad0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23170aa 00007fa9f2399447 00007fa9f23b1fe7 00007fa9f23b37de 00007fa9f23bf27c 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c
0709 12:59:19.194564 (+ 97468us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2432822400}
I20260709 12:59:19.346628  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 12:59:19.349560  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 147309us
W20260709 12:59:19.335454  3781 log.cc:927] Time spent T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
W20260709 12:59:19.351879  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 150153us
I20260709 12:59:19.205922  3587 raft_consensus.cc:2804] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:19.264366  3620 raft_consensus.cc:3055] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:19.333702  3774 raft_consensus.cc:3055] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:19.362344  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:19.384979  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:19.385317  3587 raft_consensus.cc:697] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:19.385581  1719 raft_consensus.cc:2393] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 3: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:19.385975  1570 raft_consensus.cc:2393] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 2: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:19.336033  3489 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:19.384366  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:19.386482  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:19.386996  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:19.387454  1720 raft_consensus.cc:2376] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 5. Re-sending same reply.
I20260709 12:59:19.387795  1570 raft_consensus.cc:2393] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 3: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:19.388054  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:19.388360  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:19.389101  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:19.388958  3762 consensus_queue.cc:260] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:19.389503  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:19.389917  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:19.376130  1724 raft_consensus.cc:2393] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 4: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:59:19.376866  1572 raft_consensus.cc:2410] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:59:19.390956  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:19.338212  3448 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:19.392037  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:19.392565  1724 raft_consensus.cc:2376] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 4. Re-sending same reply.
I20260709 12:59:19.392863  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:19.393343  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:19.393651  1574 raft_consensus.cc:2393] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 3: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:19.348942  3591 consensus_queue.cc:1059] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:59:19.394331  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:19.394543  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:19.395241  1574 raft_consensus.cc:2468] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 4.
I20260709 12:59:19.386375  3587 consensus_queue.cc:237] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:19.395330  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:19.395926  1724 raft_consensus.cc:2468] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 4.
I20260709 12:59:19.396335  1716 raft_consensus.cc:2410] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:59:19.384757  3620 raft_consensus.cc:740] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:19.385198  3774 raft_consensus.cc:740] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:19.353518  3496 raft_consensus.cc:740] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:19.337327  3626 raft_consensus.cc:493] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:19.364283  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:19.391050  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 12:59:19.380916  3780 log.cc:927] Time spent T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 12:59:19.390182  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:19.453222  3323 raft_consensus.cc:493] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:19.377786  3739 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:59:19.396983  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:19.354286  3581 raft_consensus.cc:515] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:19.396986  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:19.397898  1569 raft_consensus.cc:1275] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:19.360813  3758 raft_consensus.cc:515] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:19.347790  3338 raft_consensus.cc:515] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:19.485105  1569 raft_consensus.cc:1275] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:19.396145  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:19.486155  1574 raft_consensus.cc:2393] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 4: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
W20260709 12:59:19.486676  1691 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:19.391130  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:19.403949  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:19.487265  1569 raft_consensus.cc:1240] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:19.405462  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45148 (request call id 1871) took 2075 ms. Trace:
I20260709 12:59:19.406875  3547 leader_election.cc:290] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:19.338404  3728 raft_consensus.cc:515] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:19.495224  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:19.409180  3754 raft_consensus.cc:3055] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:19.352881  2323 raft_consensus.cc:2468] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
I20260709 12:59:19.207617  3733 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:19.337942  3662 raft_consensus.cc:515] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:19.417837  1721 raft_consensus.cc:2468] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6.
I20260709 12:59:19.507275  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:19.507696  1574 raft_consensus.cc:1240] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:59:19.426409  3623 raft_consensus.cc:3060] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:19.429023  2294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:19.412297  1571 raft_consensus.cc:1240] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 LEADER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:19.468797  3369 consensus_queue.cc:1059] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
W20260709 12:59:19.460024  2325 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53290 (request call id 784) took 1575 ms (client timeout 2023 ms). Trace:
I20260709 12:59:19.504570  3584 consensus_queue.cc:1059] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:59:19.358196  3778 raft_consensus.cc:2804] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:19.210147  3721 raft_consensus.cc:515] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:19.476226  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:19.478155  3323 raft_consensus.cc:515] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:19.482136  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:19.393368  3448 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:19.401732  3529 tablet_bootstrap.cc:492] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap complete.
I20260709 12:59:19.487525  1572 raft_consensus.cc:2468] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 2.
I20260709 12:59:19.487703  1647 rpcz_store.cc:276] 0709 12:59:17.330360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:18.048087 (+717727us) service_pool.cc:224] Handling call
0709 12:59:18.048313 (+   226us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:18.134241 (+ 85928us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:18.134270 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:18.134314 (+    44us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:18.134384 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:19.405214 (+1270830us) spinlock_profiling.cc:243] Waited 85.7 ms on lock 0x7b5400157f54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:19.405282 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:19.405410 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":197187328}
I20260709 12:59:19.487685  1720 raft_consensus.cc:2393] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 4: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:59:19.390134  3762 raft_consensus.cc:3060] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:19.488655  1716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1210) took 1096 ms. Trace:
I20260709 12:59:19.550334  1716 rpcz_store.cc:276] 0709 12:59:18.382217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:18.599077 (+216860us) service_pool.cc:224] Handling call
0709 12:59:19.478850 (+879773us) spinlock_profiling.cc:243] Waited 796 ms on lock 0x7b5400329bd4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:19.478998 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1831420160}
I20260709 12:59:19.468027  3626 raft_consensus.cc:3060] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:19.497248  1725 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 3.
I20260709 12:59:19.491787  3613 consensus_queue.cc:1048] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:59:19.500432  1576 raft_consensus.cc:2393] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 6: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:19.379384  3744 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:19.595832  1716 raft_consensus.cc:1275] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:19.508386  1721 raft_consensus.cc:2410] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:59:19.510684  3733 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:19.511503  1570 raft_consensus.cc:1275] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:19.473130  3720 consensus_queue.cc:1059] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:59:19.517732  1567 raft_consensus.cc:2468] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 4.
I20260709 12:59:19.479709  3556 consensus_queue.cc:1048] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:59:19.456943  1617 leader_election.cc:304] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:19.376833  2297 leader_election.cc:304] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:19.524068  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:19.444145  1722 raft_consensus.cc:1275] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:19.606479  1722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1200) took 1227 ms. Trace:
I20260709 12:59:19.606943  1722 rpcz_store.cc:276] 0709 12:59:18.379388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:18.681100 (+301712us) service_pool.cc:224] Handling call
0709 12:59:18.681259 (+   159us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:19.072725 (+391466us) spinlock_profiling.cc:243] Waited 378 ms on lock 0x7b58001691d0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23170aa 00007fa9f2399447 00007fa9f23b1fe7 00007fa9f23b37de 00007fa9f23bdb49 00007fa9f23be416 00007fa9f23bad8f 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4
0709 12:59:19.606184 (+533459us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:19.606418 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":870466816}
I20260709 12:59:19.607474  1716 raft_consensus.cc:1275] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:59:19.607985  1716 pending_rounds.cc:85] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4: Aborting all ops after (but not including) 5
I20260709 12:59:19.608258  1716 pending_rounds.cc:107] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:59:19.608814  1722 raft_consensus.cc:1275] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:59:19.608935  1716 raft_consensus.cc:2889] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:19.609318  1722 pending_rounds.cc:85] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4: Aborting all ops after (but not including) 2
I20260709 12:59:19.609650  1722 pending_rounds.cc:107] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:59:19.609921  1722 raft_consensus.cc:2889] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:19.528925  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 12:59:19.520949  2325 rpcz_store.cc:269] 0709 12:59:17.884495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:17.886258 (+  1763us) service_pool.cc:224] Handling call
0709 12:59:19.459813 (+1573555us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54006ac7d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:19.459954 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2762008960}
I20260709 12:59:19.521425  3591 raft_consensus.cc:493] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:19.533423  1569 raft_consensus.cc:1240] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:19.534626  1719 raft_consensus.cc:2468] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 4.
I20260709 12:59:19.480139  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:19.499823  3754 raft_consensus.cc:740] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:19.538326  1689 leader_election.cc:304] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 12:59:19.622720  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 84446.4us
I20260709 12:59:19.545527  1724 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "608abea191d946228bed666c5560fd0a"
dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
mode: GRACEFUL
new_leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:50592
I20260709 12:59:19.624161  1469 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55620 (request call id 273) took 7854 ms. Trace:
I20260709 12:59:19.536481  3369 consensus_queue.cc:1048] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.085s
I20260709 12:59:19.624943  3664 consensus_queue.cc:1059] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:19.625981  3664 consensus_queue.cc:1059] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:19.626983  3664 raft_consensus.cc:3055] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:19.627321  3664 raft_consensus.cc:740] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:19.624552  1469 rpcz_store.cc:276] 0709 12:59:11.770152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:13.193308 (+1423156us) service_pool.cc:224] Handling call
0709 12:59:19.624093 (+6430785us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:16.756220 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:16.756970 (+   750us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:16.757008 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:59:16.757033 (+    25us) tablet.cc:662] Decoding operations
0709 12:59:16.758045 (+  1012us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:16.758121 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:16.758159 (+    38us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:59:16.758915 (+   756us) tablet.cc:701] Row locks acquired
0709 12:59:16.758935 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:59:16.759107 (+   172us) write_op.cc:270] Start()
0709 12:59:16.759238 (+   131us) write_op.cc:276] Timestamp: P: 1783601956759051 usec, L: 0
0709 12:59:16.759262 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:59:16.857888 (+ 98626us) log.cc:844] Serialized 2855 byte log entry
0709 12:59:17.872980 (+1015092us) op_driver.cc:464] REPLICATION: finished
0709 12:59:17.879538 (+  6558us) write_op.cc:301] APPLY: starting
0709 12:59:17.879616 (+    78us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:17.880086 (+   470us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:17.880201 (+   115us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:17.881265 (+  1064us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:17.881491 (+   226us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 12:59:17.881536 (+    45us) write_op.cc:312] APPLY: finished
0709 12:59:17.894098 (+ 12562us) log.cc:844] Serialized 59 byte log entry
0709 12:59:17.909193 (+ 15095us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:17.929294 (+ 20101us) write_op.cc:454] Released schema lock
0709 12:59:17.939368 (+ 10074us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:17.977644 (+ 38276us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:17.977674 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":253491,"reported_tablets":17,"child_traces":[["op",{"apply.queue_time_us":6315,"apply.run_cpu_time_us":3062,"apply.run_wall_time_us":98076,"num_ops":7,"prepare.queue_time_us":726548,"prepare.run_cpu_time_us":18827,"prepare.run_wall_time_us":467075,"raft.queue_time_us":533360,"raft.run_cpu_time_us":1617,"raft.run_wall_time_us":17265,"replication_time_us":1113533,"spinlock_wait_cycles":24832,"thread_start_us":834772,"threads_started":4,"wal-append.queue_time_us":390136,"wal-append.run_cpu_time_us":12627,"wal-append.run_wall_time_us":1718750}]]}
I20260709 12:59:19.628847  3735 raft_consensus.cc:3055] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:19.620682  1473 catalog_manager.cc:5697] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:19.629232  3735 raft_consensus.cc:740] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:19.624477  1724 raft_consensus.cc:606] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Received request to transfer leadership to TS 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:19.630431  1724 raft_consensus.cc:614] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:19.629941  1473 catalog_manager.cc:5697] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 1 to 3, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:19.546823  1574 raft_consensus.cc:1240] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 LEADER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 1. Current term is 2. Ops: []
W20260709 12:59:19.575176  1539 leader_election.cc:336] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Timed out: RequestConsensusVote RPC to 127.0.107.194:37391 timed out after 1.633s (SENT)
W20260709 12:59:19.631727  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 56600.6us
W20260709 12:59:19.586506  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:19.633738  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:19.603408  1575 raft_consensus.cc:1240] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:19.611435  1571 raft_consensus.cc:2410] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:59:19.611534  1716 raft_consensus.cc:1275] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:19.613097  1722 raft_consensus.cc:1240] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:19.613487  1723 raft_consensus.cc:1275] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:59:19.613973  3643 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
W20260709 12:59:19.617161  1691 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:19.643842  1718 raft_consensus.cc:2468] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 2.
I20260709 12:59:19.631461  1473 catalog_manager.cc:5697] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 1 to 3, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:19.624181  1689 leader_election.cc:304] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:19.645718  1689 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:19.645534  1473 catalog_manager.cc:5697] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:19.640952  1724 raft_consensus.cc:1240] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:19.505290  3620 consensus_queue.cc:260] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:19.642356  1720 raft_consensus.cc:1275] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:59:19.648976  1691 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:19.652221  3744 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:19.624692  3736 raft_consensus.cc:2749] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:19.596760  3448 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:19.654994  3448 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:19.656985  3581 leader_election.cc:290] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:19.657534  3448 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:19.658401  3758 leader_election.cc:290] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:19.659603  3754 consensus_queue.cc:260] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 12:59:19.660935  3754 raft_consensus.cc:3060] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:19.635171  3591 raft_consensus.cc:515] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:19.537571  3496 consensus_queue.cc:260] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:19.663479  3496 raft_consensus.cc:3060] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:19.665210  3782 log.cc:927] Time spent T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
I20260709 12:59:19.667404  3338 leader_election.cc:290] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:19.668139  3771 raft_consensus.cc:2804] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:19.522432  3774 consensus_queue.cc:260] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:19.669384  3774 raft_consensus.cc:3060] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:19.673389  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:19.679060  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 222175us
I20260709 12:59:19.679257  3449 raft_consensus.cc:2804] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:19.680023  3449 raft_consensus.cc:697] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:19.680418  1617 leader_election.cc:304] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:19.681142  3449 consensus_queue.cc:237] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:19.681835  1617 leader_election.cc:304] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:19.684151  3784 raft_consensus.cc:2804] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:19.683524  1617 leader_election.cc:304] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:19.687599  1473 catalog_manager.cc:5697] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 1 to 3, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:19.693250  3581 raft_consensus.cc:2749] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:19.694236  3581 raft_consensus.cc:2804] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:19.694691  3581 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:19.695086  3581 raft_consensus.cc:3060] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:19.695729  3779 log.cc:927] Time spent T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.341s	user 0.000s	sys 0.003s
I20260709 12:59:19.701064  1473 catalog_manager.cc:5697] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 3 to 5, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 5 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:19.670991  3529 ts_tablet_manager.cc:1403] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66: Time spent bootstrapping tablet: real 3.584s	user 0.058s	sys 0.076s
I20260709 12:59:19.603924  3702 raft_consensus.cc:3055] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:59:19.762559  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 79113.3us
I20260709 12:59:19.659626  3662 leader_election.cc:290] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:19.712656  1473 catalog_manager.cc:5697] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 1 to 2, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:59:19.740653  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:19.664356  3591 leader_election.cc:290] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 12:59:19.771453  1617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:19.704412  3736 raft_consensus.cc:2804] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:19.540917  3576 consensus_queue.cc:1048] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.223s
I20260709 12:59:19.777459  1473 catalog_manager.cc:5697] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 1 to 3, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:59:19.781675  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 402079us
I20260709 12:59:19.723719  3784 raft_consensus.cc:697] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 5 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:19.781847  1473 catalog_manager.cc:5697] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:19.769867  3758 raft_consensus.cc:3060] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:19.793486  1615 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:19.761785  3702 raft_consensus.cc:740] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
W20260709 12:59:19.807098  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 449941us
W20260709 12:59:19.811021  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 290716us
W20260709 12:59:19.811147  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:19.780442  3783 raft_consensus.cc:493] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:19.813738  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:19.815560  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:19.794302  3736 raft_consensus.cc:697] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 6 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:19.800474  1473 catalog_manager.cc:5697] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 1 to 3, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:59:19.818055  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:19.818743  1647 raft_consensus.cc:2468] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 4.
W20260709 12:59:19.820963  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:19.806039  3556 raft_consensus.cc:493] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:19.822355  1473 catalog_manager.cc:5697] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 2 to 3, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:19.832036  1688 leader_election.cc:304] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:19.833069  1473 catalog_manager.cc:5697] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 1 to 3, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:19.795470  3338 consensus_queue.cc:1059] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:59:19.816048  3771 raft_consensus.cc:697] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 3 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:19.837257  1473 catalog_manager.cc:5697] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:19.830931  3778 raft_consensus.cc:697] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:19.837349  3739 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:19.853351  1688 leader_election.cc:304] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:19.853750  3792 consensus_queue.cc:1059] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:19.854781  3792 raft_consensus.cc:3055] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:19.853089  3338 raft_consensus.cc:2804] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:19.855245  3792 raft_consensus.cc:740] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:19.855482  3338 raft_consensus.cc:697] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 4 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:19.856323  3338 consensus_queue.cc:237] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:19.856926  3662 raft_consensus.cc:2804] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:19.857594  3662 raft_consensus.cc:697] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 6 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:19.854727  3739 raft_consensus.cc:2749] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:19.833985  3556 raft_consensus.cc:515] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:19.861344  2325 raft_consensus.cc:1275] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:19.858639  3662 consensus_queue.cc:237] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:19.862561  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:19.862895  3556 leader_election.cc:290] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:19.864405  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:19.864782  3778 consensus_queue.cc:237] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:19.865355  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:19.865927  2332 raft_consensus.cc:2468] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 5.
I20260709 12:59:19.866767  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:19.867895  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:19.869379  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:19.872541  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:19.874020  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:19.875522  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:19.881186  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:19.883050  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:19.822328  3783 raft_consensus.cc:515] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:19.851940  3721 leader_election.cc:290] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:19.895777  2332 raft_consensus.cc:2468] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 3.
W20260709 12:59:19.906694  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 261034us
I20260709 12:59:19.907872  1473 catalog_manager.cc:5697] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 1 to 3, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:19.908631  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
W20260709 12:59:19.890092  3675 consensus_meta.cc:287] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.666s	user 0.013s	sys 0.000s
I20260709 12:59:19.915727  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
W20260709 12:59:19.918188  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 541442us
I20260709 12:59:19.910965  1689 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 12:59:19.898012  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 381730us
I20260709 12:59:19.919916  1473 catalog_manager.cc:5697] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 1 to 3, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:59:19.925215  2295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:19.926106  2295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:19.926558  1540 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:19.928966  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:19.926133  1473 catalog_manager.cc:5697] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 1 to 3, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:59:19.938205  1645 raft_consensus.cc:1275] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:19.938738  1716 raft_consensus.cc:1240] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:19.956980  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:19.960194  1689 leader_election.cc:304] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:19.938825  2327 raft_consensus.cc:1240] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:19.975641  2325 raft_consensus.cc:1240] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:59:19.952384  3448 raft_consensus.cc:2804] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:59:19.983777  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 184012us
I20260709 12:59:19.986960  1644 raft_consensus.cc:1275] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:59:19.882321  3784 consensus_queue.cc:237] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:19.856124  3792 consensus_queue.cc:260] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:19.989537  2297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:19.992434  2297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:19.994881  1689 leader_election.cc:304] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:19.995172  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:19.996646  1644 raft_consensus.cc:3060] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:19.996845  1646 raft_consensus.cc:1240] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:19.997213  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:19.993486  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:19.997997  1643 raft_consensus.cc:2376] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 2. Re-sending same reply.
I20260709 12:59:20.000247  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:20.002415  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:59:20.002782  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 147095us
I20260709 12:59:20.004618  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:20.005964  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:20.007264  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:20.007982  1643 raft_consensus.cc:2393] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 5: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:20.005398  1723 raft_consensus.cc:2468] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 3.
I20260709 12:59:20.009604  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:20.010102  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:20.010258  1651 raft_consensus.cc:2468] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 4.
I20260709 12:59:20.010987  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:20.011242  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:20.000874  1650 raft_consensus.cc:2468] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 2.
I20260709 12:59:19.998953  3744 raft_consensus.cc:493] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:20.013152  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:20.012950  3744 raft_consensus.cc:515] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:20.013823  1720 raft_consensus.cc:2393] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 4: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:59:20.014549  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:20.015355  3744 leader_election.cc:290] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:20.015549  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:20.012311  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:20.017354  3662 raft_consensus.cc:2749] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:20.018273  3662 raft_consensus.cc:2749] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:20.018425  3323 leader_election.cc:290] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:20.018443  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:20.019675  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:20.019873  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:20.020398  1720 raft_consensus.cc:2376] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5. Re-sending same reply.
W20260709 12:59:20.020968  3788 log.cc:927] Time spent T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.182s	user 0.000s	sys 0.000s
I20260709 12:59:20.021317  3620 raft_consensus.cc:3060] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:20.022294  3772 raft_consensus.cc:3055] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:20.022722  3772 raft_consensus.cc:740] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:20.023988  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:20.023626  3772 consensus_queue.cc:260] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:19.949786  3556 consensus_queue.cc:1048] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:59:19.953151  3787 consensus_queue.cc:1059] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:59:20.024559  1650 raft_consensus.cc:3060] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:20.026218  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:20.016335  1644 raft_consensus.cc:2468] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 2.
I20260709 12:59:20.039748  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:20.021338  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:20.040925  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:20.039747  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:20.032950  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:20.022322  1646 raft_consensus.cc:1275] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:20.020659  1723 raft_consensus.cc:3060] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:20.049364  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:20.006290  1688 leader_election.cc:304] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:20.035171  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:59:20.037103  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 70497.2us
I20260709 12:59:19.948597  3675 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:20.041796  1649 raft_consensus.cc:2468] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 4.
I20260709 12:59:20.050535  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:59:20.051156  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 44963.7us
I20260709 12:59:20.051213  1646 raft_consensus.cc:2468] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 4.
I20260709 12:59:20.051400  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:20.052124  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:20.052273  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:20.045109  1722 raft_consensus.cc:1275] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:19.983937  3797 raft_consensus.cc:2749] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:19.987574  3448 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:20.052440  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:20.028612  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:20.058928  1649 raft_consensus.cc:2468] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 4.
I20260709 12:59:20.053350  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:20.059703  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:20.059975  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:20.053470  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:20.054267  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:20.061215  1721 raft_consensus.cc:2410] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:59:19.952113  3736 consensus_queue.cc:237] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:20.060247  1649 raft_consensus.cc:2376] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 3. Re-sending same reply.
I20260709 12:59:20.065292  1649 raft_consensus.cc:1275] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:59:20.066008  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:20.066777  1617 leader_election.cc:304] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:20.067451  1688 leader_election.cc:304] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:20.070858  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:20.072328  1617 leader_election.cc:304] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:20.074115  2325 raft_consensus.cc:1240] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 LEADER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:20.084108  1542 leader_election.cc:304] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:20.085122  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:20.085772  1649 raft_consensus.cc:2376] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 2. Re-sending same reply.
I20260709 12:59:20.078500  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:20.088020  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:20.088594  1575 raft_consensus.cc:2468] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 4.
I20260709 12:59:20.089344  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:20.089851  1575 raft_consensus.cc:2468] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 5.
I20260709 12:59:20.090363  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:20.091238  1575 raft_consensus.cc:1240] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:59:20.091943  1575 raft_consensus.cc:1240] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:20.093297  1643 raft_consensus.cc:2393] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 3: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:20.071389  1720 raft_consensus.cc:2376] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 3. Re-sending same reply.
I20260709 12:59:20.099134  1650 raft_consensus.cc:2468] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 4.
W20260709 12:59:20.100947  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:20.100966  1723 raft_consensus.cc:2468] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6.
I20260709 12:59:20.101728  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:20.105787  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:20.055488  3744 raft_consensus.cc:493] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:20.109344  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:20.110018  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:20.106482  1716 raft_consensus.cc:2376] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 3. Re-sending same reply.
I20260709 12:59:20.064416  3772 raft_consensus.cc:3060] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:20.119519  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:20.122599  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:20.063900  3448 raft_consensus.cc:3060] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:20.112061  1574 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 3.
I20260709 12:59:19.970456  3771 consensus_queue.cc:237] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:20.121639  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:20.114499  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:20.132341  1567 raft_consensus.cc:2393] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 4: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:20.142657  1689 leader_election.cc:304] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:20.111979  3787 raft_consensus.cc:2749] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:59:20.126029  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 75313.1us
I20260709 12:59:20.123421  1720 raft_consensus.cc:2468] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
W20260709 12:59:20.148001  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 62164.1us
W20260709 12:59:20.147117  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 63095.8us
W20260709 12:59:20.150839  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 83614.5us
I20260709 12:59:20.110482  3643 raft_consensus.cc:2804] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:20.150053  2295 leader_election.cc:304] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:20.152652  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:20.153316  1689 leader_election.cc:304] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
W20260709 12:59:20.142001  3762 consensus_meta.cc:287] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.547s	user 0.007s	sys 0.003s
I20260709 12:59:20.155548  1689 leader_election.cc:304] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:20.098358  3721 consensus_queue.cc:1048] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
W20260709 12:59:20.159330  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:20.162600  1542 leader_election.cc:304] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:20.128686  3800 raft_consensus.cc:2749] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:20.150616  3797 raft_consensus.cc:493] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:20.120970  3744 raft_consensus.cc:515] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:20.153331  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:20.155452  1539 leader_election.cc:304] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:20.152557  3796 raft_consensus.cc:493] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:20.157660  3662 raft_consensus.cc:2804] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:20.158927  3591 raft_consensus.cc:2749] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:20.159303  3758 raft_consensus.cc:2749] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:20.153153  3581 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:20.162863  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:20.157536  3799 raft_consensus.cc:2749] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:59:20.189657  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 93390.8us
I20260709 12:59:20.191820  3529 raft_consensus.cc:359] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:20.193737  2297 leader_election.cc:304] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:20.194726  3815 raft_consensus.cc:2804] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:20.195446  3744 leader_election.cc:290] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:59:20.195874  3496 consensus_meta.cc:287] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.532s	user 0.011s	sys 0.000s
I20260709 12:59:20.174228  3762 raft_consensus.cc:3060] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:20.157440  3323 raft_consensus.cc:2749] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:59:20.232138  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 43652us
I20260709 12:59:20.172678  3795 consensus_queue.cc:1059] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:59:20.177867  3810 consensus_queue.cc:1059] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
W20260709 12:59:20.243201  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 87770.2us
W20260709 12:59:20.247452  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 92112.1us
I20260709 12:59:20.247785  1648 raft_consensus.cc:2393] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 6: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
W20260709 12:59:20.247825  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 175533us
W20260709 12:59:20.215458  3754 consensus_meta.cc:287] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.554s	user 0.011s	sys 0.000s
I20260709 12:59:20.278203  1617 leader_election.cc:304] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:20.281700  1617 leader_election.cc:304] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:20.282244  1717 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d"
dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
mode: GRACEFUL
new_leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:50592
I20260709 12:59:20.248956  1615 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 12:59:20.246359  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 52722us
I20260709 12:59:20.250221  3774 raft_consensus.cc:2749] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:20.197160  3783 leader_election.cc:290] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:20.257959  2326 raft_consensus.cc:2468] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 3.
W20260709 12:59:20.259068  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 96554.9us
I20260709 12:59:20.267302  2332 raft_consensus.cc:2468] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 4.
I20260709 12:59:20.233196  3733 raft_consensus.cc:2804] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:20.276059  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:20.276901  1539 leader_election.cc:304] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:20.278964  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:20.300762  1716 raft_consensus.cc:2468] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 5.
I20260709 12:59:20.283906  1717 raft_consensus.cc:606] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Received request to transfer leadership to TS 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:20.302875  1717 raft_consensus.cc:614] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:20.182806  3814 consensus_queue.cc:1048] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.081s
I20260709 12:59:20.292892  1689 leader_election.cc:304] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:20.293296  1542 leader_election.cc:304] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:20.252992  3744 raft_consensus.cc:2749] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:20.297297  1573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 340) took 1099 ms. Trace:
I20260709 12:59:20.256901  3828 raft_consensus.cc:493] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:20.305536  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:20.310845  1573 rpcz_store.cc:276] 0709 12:59:19.198404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:19.199352 (+   948us) service_pool.cc:224] Handling call
0709 12:59:19.199637 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:19.635448 (+435811us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:19.635488 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:19.635542 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:19.635588 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:20.297050 (+661462us) spinlock_profiling.cc:243] Waited 436 ms on lock 0x7b54003660d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:20.297101 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:20.297239 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1001736960}
I20260709 12:59:20.298107  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:20.180049  3797 raft_consensus.cc:515] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:20.283386  3815 raft_consensus.cc:697] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:20.285439  3787 raft_consensus.cc:2804] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:20.187264  3796 raft_consensus.cc:515] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:20.286494  3323 raft_consensus.cc:493] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:20.380942  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 94720.6us
I20260709 12:59:20.311650  3783 raft_consensus.cc:2749] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:59:20.368431  2294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:20.354786  3662 raft_consensus.cc:697] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 3 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:20.302222  3804 raft_consensus.cc:493] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:20.367251  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 74444.3us
I20260709 12:59:20.391996  1573 raft_consensus.cc:1275] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:59:20.405007  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 128219us
I20260709 12:59:20.407403  1539 leader_election.cc:304] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:20.379427  3787 raft_consensus.cc:493] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:20.410887  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:20.382740  3810 raft_consensus.cc:2804] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:20.377765  3397 raft_consensus.cc:2804] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:20.313282  3778 consensus_queue.cc:1059] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 12:59:20.387264  3529 raft_consensus.cc:740] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Initialized, Role: LEARNER
I20260709 12:59:20.419780  1539 leader_election.cc:304] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:20.398345  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:20.448109  2324 raft_consensus.cc:2468] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 3.
W20260709 12:59:20.445636  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 152432us
I20260709 12:59:20.412084  3675 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:20.417097  3787 raft_consensus.cc:3060] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:20.421020  3397 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:20.453315  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 12:59:20.463292  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 43771us
I20260709 12:59:20.390343  3323 raft_consensus.cc:515] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:20.450891  1542 leader_election.cc:304] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:20.464432  1539 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
W20260709 12:59:20.454600  3626 consensus_meta.cc:287] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.849s	user 0.010s	sys 0.002s
I20260709 12:59:20.466454  3397 raft_consensus.cc:3060] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:20.416321  3783 consensus_queue.cc:1048] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:59:20.470672  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:20.481506  1649 raft_consensus.cc:1275] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:59:20.482968  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:20.471163  1539 leader_election.cc:304] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:20.382385  3828 raft_consensus.cc:515] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:20.486341  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:20.397354  3804 raft_consensus.cc:515] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:20.467015  3744 raft_consensus.cc:2804] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:59:20.476727  3829 log.cc:927] Time spent T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 12:59:20.504865  1542 leader_election.cc:304] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:20.514452  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:20.472909  3581 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:20.485026  3810 raft_consensus.cc:697] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 3 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:20.520263  1649 raft_consensus.cc:3055] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:59:20.499615  3808 log.cc:927] Time spent T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.260s	user 0.000s	sys 0.001s
I20260709 12:59:20.474777  3728 leader_election.cc:290] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:20.523065  1720 raft_consensus.cc:2468] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 4.
W20260709 12:59:20.515875  3803 log.cc:927] Time spent T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.256s	user 0.001s	sys 0.000s
I20260709 12:59:20.521545  1649 raft_consensus.cc:740] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:20.527792  1539 leader_election.cc:304] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:20.527055  2326 raft_consensus.cc:2468] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 4.
I20260709 12:59:20.532442  3796 leader_election.cc:290] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:20.473917  3815 consensus_queue.cc:237] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:20.533811  3323 leader_election.cc:290] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:20.534312  1649 consensus_queue.cc:260] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:20.535353  1649 raft_consensus.cc:3060] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:59:20.537725  3623 consensus_meta.cc:287] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 1.015s	user 0.008s	sys 0.003s
I20260709 12:59:20.465464  3827 consensus_queue.cc:1048] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 12:59:20.487352  3529 consensus_queue.cc:260] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:59:20.541623  3529 ts_tablet_manager.cc:1434] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66: Time spent starting tablet: real 0.781s	user 0.012s	sys 0.001s
W20260709 12:59:20.541976  3529 ts_tablet_manager.cc:1467] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66: Tablet startup took 825ms
I20260709 12:59:20.472975  3626 raft_consensus.cc:515] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:20.493494  3824 raft_consensus.cc:2804] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:20.466342  3825 raft_consensus.cc:2749] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:59:20.544349  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:20.485405  3836 raft_consensus.cc:2749] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:20.510519  3744 raft_consensus.cc:493] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:20.496076  3814 consensus_queue.cc:1048] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 12:59:20.523164  3832 raft_consensus.cc:2749] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:59:20.549197  3813 log.cc:927] Time spent T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.259s	user 0.001s	sys 0.001s
W20260709 12:59:20.570605  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 188839us
I20260709 12:59:20.497067  3662 consensus_queue.cc:237] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:20.542882  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:20.727020  2327 raft_consensus.cc:2468] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 4.
W20260709 12:59:20.667100  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 139375us
I20260709 12:59:20.729628  1539 leader_election.cc:304] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:20.553580  3323 raft_consensus.cc:493] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:20.548619  3824 raft_consensus.cc:493] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:20.543826  3835 raft_consensus.cc:2749] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:59:20.751102  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 447493us
I20260709 12:59:20.557333  3744 raft_consensus.cc:3060] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:20.762130  1719 raft_consensus.cc:1275] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:59:20.590807  3802 log.cc:927] Time spent T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260709 12:59:20.578491  3754 raft_consensus.cc:493] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:20.579761  3819 raft_consensus.cc:2804] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:20.585296  3830 raft_consensus.cc:493] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
W20260709 12:59:20.721035  3576 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.734s	user 0.004s	sys 0.007s
W20260709 12:59:20.771401  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:20.556056  3831 consensus_queue.cc:1048] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.225s
W20260709 12:59:20.653364  3838 log.cc:927] Time spent T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:59:20.560779  3728 consensus_queue.cc:1048] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.202s
W20260709 12:59:20.790665  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 53105.8us
W20260709 12:59:20.771688  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 522751us
I20260709 12:59:20.586941  3832 raft_consensus.cc:2749] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:59:20.811851  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 49744.3us
W20260709 12:59:20.822124  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 317329us
I20260709 12:59:20.838508  1617 leader_election.cc:304] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:20.768514  2323 raft_consensus.cc:2468] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 4.
W20260709 12:59:20.771147  3736 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.006s	sys 0.026s
I20260709 12:59:20.586061  3836 raft_consensus.cc:2804] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:20.838702  1542 leader_election.cc:304] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
W20260709 12:59:20.841177  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:20.805495  3823 raft_consensus.cc:493] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:20.769081  3784 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:20.585273  3810 consensus_queue.cc:237] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:20.764456  3824 raft_consensus.cc:3060] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:20.748428  3825 raft_consensus.cc:2804] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:20.864277  3825 raft_consensus.cc:493] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:20.865092  3825 raft_consensus.cc:3060] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:20.813146  3576 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.827s	user 0.005s	sys 0.007s
I20260709 12:59:20.865934  3735 consensus_queue.cc:260] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:20.816867  3762 consensus_meta.cc:287] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.539s	user 0.011s	sys 0.001s
I20260709 12:59:20.808599  3819 raft_consensus.cc:493] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:20.867560  3762 raft_consensus.cc:2749] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:20.846673  3837 raft_consensus.cc:2804] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:20.868227  3837 raft_consensus.cc:493] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:20.868677  3837 raft_consensus.cc:3060] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:20.868563  3783 consensus_queue.cc:1048] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:20.870500  1645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45148 (request call id 1893) took 1058 ms. Trace:
I20260709 12:59:20.870926  1645 rpcz_store.cc:276] 0709 12:59:19.812488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:19.813383 (+   895us) service_pool.cc:224] Handling call
0709 12:59:19.813744 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:19.938580 (+124836us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:20.870245 (+931665us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b540030d754. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:20.870438 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":285512576}
I20260709 12:59:20.871827  3643 raft_consensus.cc:493] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:20.839358  3626 leader_election.cc:290] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:20.842003  3839 consensus_queue.cc:1048] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
I20260709 12:59:20.874678  3733 raft_consensus.cc:493] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:20.844305  3784 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:20.875193  3733 raft_consensus.cc:3060] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:20.876855  1647 raft_consensus.cc:1240] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:20.877075  3784 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:20.844050  3823 raft_consensus.cc:515] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:20.879257  3823 leader_election.cc:290] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:20.855618  1617 leader_election.cc:304] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 12:59:20.856993  1725 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1774) took 2120 ms (client timeout 1998 ms). Trace:
I20260709 12:59:20.879989  3605 raft_consensus.cc:3060] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:20.879940  1725 rpcz_store.cc:269] 0709 12:59:18.737211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:18.839394 (+102183us) service_pool.cc:224] Handling call
0709 12:59:20.856808 (+2017414us) spinlock_profiling.cc:243] Waited 657 ms on lock 0x7b54000cdad4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:20.856918 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1510537600}
I20260709 12:59:20.857412  1724 raft_consensus.cc:1275] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:20.880806  1617 leader_election.cc:304] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:20.881630  3839 raft_consensus.cc:2804] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:20.882014  3839 raft_consensus.cc:493] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:20.882050  1724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1824) took 1520 ms. Trace:
I20260709 12:59:20.882566  3839 raft_consensus.cc:3060] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:20.882613  1724 rpcz_store.cc:276] 0709 12:59:19.361857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:19.647602 (+285745us) service_pool.cc:224] Handling call
0709 12:59:20.857059 (+1209457us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:20.881198 (+ 24139us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:20.881864 (+   666us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54000cdad0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23ba8ad 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:20.881998 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2780536576}
I20260709 12:59:20.763170  3323 raft_consensus.cc:515] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:20.884884  1617 leader_election.cc:304] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:20.885246  3323 leader_election.cc:290] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 12:59:20.848311  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 113062us
I20260709 12:59:20.859836  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:20.885699  3827 raft_consensus.cc:2804] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:20.886188  3827 raft_consensus.cc:493] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:20.886587  3827 raft_consensus.cc:3060] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:20.791842  3754 raft_consensus.cc:515] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:20.887979  2295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:20.856191  3758 consensus_queue.cc:1048] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.002s
W20260709 12:59:20.862141  3833 log.cc:927] Time spent T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:59:20.863590  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:20.867606  3819 raft_consensus.cc:3060] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:20.589823  3817 log.cc:927] Time spent T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
I20260709 12:59:20.857738  3795 consensus_queue.cc:1048] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
W20260709 12:59:20.840341  3821 log.cc:927] Time spent T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.391s	user 0.000s	sys 0.001s
I20260709 12:59:20.853027  1615 leader_election.cc:304] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:20.850621  2330 raft_consensus.cc:2468] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 3.
I20260709 12:59:20.886672  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:20.848814  1542 leader_election.cc:304] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:20.901403  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:20.891180  1575 raft_consensus.cc:1240] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:20.872288  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:20.867201  3735 raft_consensus.cc:3060] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:20.913429  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 12:59:20.977999  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 125042us
I20260709 12:59:20.921813  1725 raft_consensus.cc:1275] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:20.924815  1649 raft_consensus.cc:1275] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:20.916229  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:20.910666  1716 raft_consensus.cc:1240] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:59:20.977792  1724 raft_consensus.cc:3060] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:20.985673  1719 raft_consensus.cc:2393] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 6: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:20.989286  1645 raft_consensus.cc:1240] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 1. Current term is 2. Ops: []
W20260709 12:59:20.991153  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 146603us
I20260709 12:59:20.989682  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:20.991935  1542 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:20.992904  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:20.993664  1649 raft_consensus.cc:2468] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 2.
I20260709 12:59:20.994690  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:59:20.843322  3736 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.010s	sys 0.034s
I20260709 12:59:21.003705  3839 raft_consensus.cc:515] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:20.889858  3448 consensus_meta.cc:287] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.746s	user 0.010s	sys 0.000s
I20260709 12:59:20.909929  3323 raft_consensus.cc:493] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:20.989735  3811 consensus_queue.cc:1048] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:59:20.998550  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:21.000211  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:21.000599  3790 consensus_queue.cc:1048] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:20.989228  3581 raft_consensus.cc:2804] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:21.000782  3733 raft_consensus.cc:515] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:20.817209  3830 raft_consensus.cc:515] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:21.002710  3761 raft_consensus.cc:3055] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:59:21.024808  3787 consensus_meta.cc:287] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.554s	user 0.009s	sys 0.000s
I20260709 12:59:21.002980  1615 leader_election.cc:304] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:20.902071  3758 raft_consensus.cc:493] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:20.993042  3771 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.005s	sys 0.004s
I20260709 12:59:20.888581  3369 consensus_queue.cc:1048] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.153s
I20260709 12:59:20.923007  3849 consensus_queue.cc:1048] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.081s
I20260709 12:59:21.004479  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:20.888497  3397 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:20.982314  3837 raft_consensus.cc:515] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:20.893007  3675 consensus_queue.cc:1048] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.116s
I20260709 12:59:20.872329  3643 raft_consensus.cc:3060] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:20.542356  3529 ts_tablet_manager.cc:1469] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66: Trace:
0709 12:59:11.107144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:11.107597 (+   453us) service_pool.cc:224] Handling call
0709 12:59:11.297221 (+189624us) ts_tablet_manager.cc:934] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66: Initiating tablet copy from peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
0709 12:59:12.776407 (+1479186us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:59:14.258394 (+1481987us) tablet_metadata.cc:665] Metadata flushed
0709 12:59:14.258543 (+   149us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:59:15.101392 (+842849us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:59:15.115225 (+ 13833us) tablet_replica.cc:206] Creating consensus instance
0709 12:59:15.115567 (+   342us) ts_tablet_manager.cc:989] Replica registered.
0709 12:59:15.115633 (+    66us) inbound_call.cc:177] Queueing success response
0709 12:59:16.050895 (+935262us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:59:19.761110 (+3710215us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:59:19.779282 (+ 18172us) tablet_replica.cc:261] Starting instrumentation
0709 12:59:19.878377 (+ 99095us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":12506,"mutex_wait_us":10220,"raft.queue_time_us":356,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":100,"tablet-copy.queue_time_us":184885,"tablet-download-pool.queue_time_us":5727,"tablet-download-pool.run_cpu_time_us":1137,"tablet-download-pool.run_wall_time_us":71395,"thread_start_us":190291,"threads_started":2}
I20260709 12:59:21.011971  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:20.995352  1649 raft_consensus.cc:2468] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 2.
I20260709 12:59:21.016507  2329 raft_consensus.cc:2468] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 4.
I20260709 12:59:20.888734  3784 raft_consensus.cc:2804] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:21.024544  1724 raft_consensus.cc:2468] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 2.
I20260709 12:59:20.908675  3842 raft_consensus.cc:493] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:21.025672  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:21.311152  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:20.893023  3754 leader_election.cc:290] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:20.853560  3836 raft_consensus.cc:697] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:21.027874  1646 raft_consensus.cc:2468] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 3.
I20260709 12:59:21.027747  3852 raft_consensus.cc:2804] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:59:21.122478  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:21.031401  3581 raft_consensus.cc:493] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
W20260709 12:59:21.244828  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 241870us
I20260709 12:59:20.997277  3783 consensus_queue.cc:1059] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:59:21.329133  3397 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:21.331993  3842 raft_consensus.cc:515] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:21.333626  3848 consensus_queue.cc:1059] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:21.334242  3842 leader_election.cc:290] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:21.334800  3842 raft_consensus.cc:2804] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:21.335194  3842 raft_consensus.cc:697] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
W20260709 12:59:21.336304  3744 consensus_meta.cc:287] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.545s	user 0.008s	sys 0.000s
I20260709 12:59:21.336817  3744 raft_consensus.cc:515] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:21.337270  3847 log.cc:927] Time spent T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
I20260709 12:59:21.338356  1720 raft_consensus.cc:1240] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:21.338804  3744 leader_election.cc:290] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:59:21.341375  3798 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:59:21.199146  3662 raft_consensus.cc:493] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.030753  3323 raft_consensus.cc:515] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:21.202370  2323 raft_consensus.cc:2468] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 5.
I20260709 12:59:21.197230  3591 raft_consensus.cc:493] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.351101  1688 leader_election.cc:304] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:59:21.328516  3852 raft_consensus.cc:697] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:21.329062  3581 raft_consensus.cc:3060] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:21.027668  3448 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:21.203886  3823 raft_consensus.cc:493] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:21.348923  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:21.207250  3758 raft_consensus.cc:515] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:21.288725  3784 raft_consensus.cc:493] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:21.173811  3761 raft_consensus.cc:740] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:21.353031  3810 raft_consensus.cc:493] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:21.357021  3800 raft_consensus.cc:2749] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:21.400581  3810 raft_consensus.cc:515] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:21.207912  3771 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.006s	sys 0.004s
I20260709 12:59:21.336067  3842 consensus_queue.cc:237] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:21.401117  3860 log.cc:927] Time spent T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:59:21.204566  3787 raft_consensus.cc:515] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:21.378105  3831 raft_consensus.cc:2804] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:21.414465  3774 raft_consensus.cc:3055] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:21.415102  3584 raft_consensus.cc:3055] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:21.440274  3774 raft_consensus.cc:740] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:21.440347  3584 raft_consensus.cc:740] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:21.441219  3584 consensus_queue.cc:260] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:21.416041  3793 raft_consensus.cc:493] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.418735  3761 consensus_queue.cc:260] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:21.442539  3836 consensus_queue.cc:237] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:21.442553  3793 raft_consensus.cc:515] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:21.361821  3851 consensus_queue.cc:1048] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.090s
I20260709 12:59:21.445453  3793 leader_election.cc:290] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:21.441219  3774 consensus_queue.cc:260] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:21.447125  3774 raft_consensus.cc:3060] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:21.447983  3733 leader_election.cc:290] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:21.419628  3810 leader_election.cc:290] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:21.401310  3852 consensus_queue.cc:237] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:21.421219  3828 leader_election.cc:290] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:21.370230  3675 raft_consensus.cc:493] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.431342  3831 raft_consensus.cc:493] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:21.467612  3831 raft_consensus.cc:3060] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:21.353595  3662 raft_consensus.cc:515] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 12:59:21.470388  3662 leader_election.cc:290] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373)
I20260709 12:59:21.357335  3736 consensus_queue.cc:1048] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.114s
I20260709 12:59:21.467608  3675 raft_consensus.cc:515] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:21.473526  3837 leader_election.cc:290] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:21.475134  3675 leader_election.cc:290] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:21.475899  3825 consensus_meta.cc:287] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.610s	user 0.006s	sys 0.003s
I20260709 12:59:21.476398  3825 raft_consensus.cc:515] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:21.477573  3819 raft_consensus.cc:515] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:21.478878  3825 leader_election.cc:290] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:21.369277  3754 consensus_queue.cc:1059] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.111s
I20260709 12:59:21.442052  3830 leader_election.cc:290] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 12:59:21.406795  3827 consensus_meta.cc:287] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.517s	user 0.006s	sys 0.004s
I20260709 12:59:21.369242  3790 raft_consensus.cc:493] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.427765  3823 raft_consensus.cc:515] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:21.369212  3855 raft_consensus.cc:493] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:21.465204  3856 log.cc:927] Time spent T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:59:21.466490  3839 leader_election.cc:290] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:21.480572  3827 raft_consensus.cc:515] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:21.542775  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:21.357160  1688 leader_election.cc:304] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:21.387418  1720 raft_consensus.cc:1275] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:21.552233  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 12:59:21.416679  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:21.417943  3323 leader_election.cc:290] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:21.436785  3581 raft_consensus.cc:515] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:21.355525  3591 raft_consensus.cc:515] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:21.622311  3581 leader_election.cc:290] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:21.355306  3744 raft_consensus.cc:2749] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:21.402693  3784 raft_consensus.cc:3060] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:21.633108  1644 raft_consensus.cc:1240] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 2. Current term is 3. Ops: []
W20260709 12:59:21.634438  3735 consensus_meta.cc:287] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.651s	user 0.008s	sys 0.002s
I20260709 12:59:21.439322  3787 leader_election.cc:290] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:21.487247  3790 raft_consensus.cc:515] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:21.480954  3819 leader_election.cc:290] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:21.578166  2323 raft_consensus.cc:1240] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:59:21.580600  3823 leader_election.cc:290] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:21.703619  3790 leader_election.cc:290] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:21.582981  3448 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:21.502609  3824 consensus_meta.cc:287] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.517s	user 0.008s	sys 0.004s
I20260709 12:59:21.503005  3855 raft_consensus.cc:515] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:21.592870  1540 connection.cc:256] RPC call timeout handler was delayed by -1.3027957080000192s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21130000000000002s for a response
I20260709 12:59:21.593328  3675 raft_consensus.cc:493] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.707736  3675 raft_consensus.cc:515] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:21.708316  3855 leader_election.cc:290] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:21.584659  3758 leader_election.cc:290] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:21.619037  3662 raft_consensus.cc:493] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.594789  3827 leader_election.cc:290] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:21.624161  3591 leader_election.cc:290] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 12:59:21.647737  1643 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 1297) took 1615 ms (client timeout 1829 ms). Trace:
I20260709 12:59:21.651047  1645 raft_consensus.cc:1240] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:21.594448  3831 raft_consensus.cc:515] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:21.651018  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:21.681382  3774 raft_consensus.cc:493] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.684741  1723 raft_consensus.cc:3060] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:21.729207  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 371922us
W20260709 12:59:21.715521  1643 rpcz_store.cc:269] 0709 12:59:20.031786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:20.051906 (+ 20120us) service_pool.cc:224] Handling call
0709 12:59:21.647066 (+1595160us) spinlock_profiling.cc:243] Waited 40.2 ms on lock 0x7b54002b1954. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:21.647416 (+   350us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":92386560}
I20260709 12:59:21.730499  1688 leader_election.cc:304] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:21.686185  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:21.732700  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:21.733117  1720 raft_consensus.cc:3060] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:21.733299  3855 raft_consensus.cc:2804] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:21.733857  3855 raft_consensus.cc:493] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:21.695716  3736 raft_consensus.cc:2804] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:21.746963  3736 raft_consensus.cc:493] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:21.747539  3736 raft_consensus.cc:3060] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:21.750358  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:21.751957  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:21.752753  3831 leader_election.cc:290] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:21.754395  3784 raft_consensus.cc:515] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:21.705595  3824 raft_consensus.cc:515] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:21.715288  3662 raft_consensus.cc:515] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:21.714138  3675 leader_election.cc:290] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:21.736071  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:21.734222  3855 raft_consensus.cc:3060] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:21.739080  2330 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53306 (request call id 506) took 1856 ms (client timeout 1526 ms). Trace:
I20260709 12:59:21.741353  3643 raft_consensus.cc:515] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:21.743813  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:21.744899  3823 raft_consensus.cc:493] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:21.745880  3774 raft_consensus.cc:515] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:21.706202  1540 leader_election.cc:304] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:21.765832  1718 raft_consensus.cc:3060] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:21.767047  2332 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53306 (request call id 507) took 1855 ms (client timeout 2090 ms). Trace:
W20260709 12:59:21.772630  2332 rpcz_store.cc:269] 0709 12:59:19.899971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:19.908278 (+  8307us) service_pool.cc:224] Handling call
0709 12:59:21.740074 (+1831796us) spinlock_profiling.cc:243] Waited 346 ms on lock 0x7b5400561154. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:21.740321 (+   247us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":795860864}
W20260709 12:59:21.768683  2330 rpcz_store.cc:269] 0709 12:59:19.882607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:19.882796 (+   189us) service_pool.cc:224] Handling call
0709 12:59:21.738544 (+1855748us) spinlock_profiling.cc:243] Waited 657 ms on lock 0x7b54004bfd54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:21.738770 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1511930240}
W20260709 12:59:21.786803  2295 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.024s	sys 0.036s
W20260709 12:59:21.787379  2295 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.024s	sys 0.036s
W20260709 12:59:21.787793  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 761644us
I20260709 12:59:21.789549  3784 leader_election.cc:290] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:59:21.790544  1716 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.045s	sys 0.086s
W20260709 12:59:21.791069  1716 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.045s	sys 0.086s
W20260709 12:59:21.796841  2295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:21.797027  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:21.799775  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:21.800928  1569 raft_consensus.cc:2468] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 6.
I20260709 12:59:21.804926  3587 raft_consensus.cc:493] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.805852  3587 raft_consensus.cc:515] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:21.843636  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 128903us
I20260709 12:59:21.845592  1643 raft_consensus.cc:2393] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 4: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:21.843662  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:21.848791  1575 raft_consensus.cc:2468] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 4.
I20260709 12:59:21.859295  2295 leader_election.cc:304] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 12:59:21.858626  1542 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.808s	user 0.001s	sys 0.017s
W20260709 12:59:21.861446  2297 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.000s	sys 0.021s
W20260709 12:59:21.861953  2297 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.000s	sys 0.021s
I20260709 12:59:21.862413  3797 leader_election.cc:290] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:21.862958  2297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:21.864688  1649 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.012s	sys 0.011s
I20260709 12:59:21.865083  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:21.865929  1646 raft_consensus.cc:2468] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 3.
W20260709 12:59:21.868656  1542 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.842s	user 0.001s	sys 0.017s
W20260709 12:59:21.870301  1615 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.005s	sys 0.014s
W20260709 12:59:21.870836  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 556892us
I20260709 12:59:21.871276  3643 leader_election.cc:290] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 12:59:21.873235  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:21.876704  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 170800us
I20260709 12:59:21.878189  1540 leader_election.cc:304] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:21.879912  1540 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:21.859308  3587 leader_election.cc:290] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:59:21.882185  2294 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.001s	sys 0.016s
W20260709 12:59:21.884017  2294 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.002s	sys 0.017s
I20260709 12:59:21.885409  3869 raft_consensus.cc:2804] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:59:21.885653  1725 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.002s	sys 0.048s
I20260709 12:59:21.886080  3869 raft_consensus.cc:493] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:21.886317  1725 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.003s	sys 0.048s
I20260709 12:59:21.886662  3869 raft_consensus.cc:3060] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:21.887269  1690 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.044s	sys 0.083s
W20260709 12:59:21.887760  1690 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.045s	sys 0.084s
I20260709 12:59:21.857792  3823 raft_consensus.cc:515] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:21.890151  2295 leader_election.cc:304] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:21.890641  3823 leader_election.cc:290] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:21.891672  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 899728us
I20260709 12:59:21.891227  3823 raft_consensus.cc:493] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:21.892664  3823 raft_consensus.cc:515] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:21.892889  3842 raft_consensus.cc:2804] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:21.893033  1542 leader_election.cc:304] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:21.893528  3873 raft_consensus.cc:2804] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:21.894034  3873 raft_consensus.cc:493] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:21.894222  3824 leader_election.cc:290] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:21.895545  3797 raft_consensus.cc:493] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.894402  3873 raft_consensus.cc:3060] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:21.894264  1688 leader_election.cc:304] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:21.871922  1615 leader_election.cc:304] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:21.896241  3797 raft_consensus.cc:515] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:21.895447  3868 log.cc:927] Time spent T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.109s	user 0.005s	sys 0.000s
I20260709 12:59:21.908712  1720 raft_consensus.cc:2468] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6.
I20260709 12:59:21.911985  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:21.912302  3877 raft_consensus.cc:2749] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:21.914319  3662 leader_election.cc:290] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:21.916123  1723 raft_consensus.cc:2468] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 5.
I20260709 12:59:21.891747  3867 raft_consensus.cc:493] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:21.928731  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:21.930475  1723 raft_consensus.cc:3060] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:21.921577  3842 raft_consensus.cc:697] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:21.925124  1643 raft_consensus.cc:2468] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 2.
I20260709 12:59:21.932144  1718 raft_consensus.cc:2468] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 3.
I20260709 12:59:21.936614  3878 raft_consensus.cc:3060] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:21.938741  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:21.940572  1720 raft_consensus.cc:1275] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:21.943403  3852 raft_consensus.cc:493] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.943985  3852 raft_consensus.cc:515] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:21.946547  1723 raft_consensus.cc:2468] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 5.
I20260709 12:59:21.945307  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:50592 (request call id 24) took 1663 ms. Trace:
I20260709 12:59:21.947314  1717 rpcz_store.cc:276] 0709 12:59:20.281975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:20.282101 (+   126us) service_pool.cc:224] Handling call
0709 12:59:21.944829 (+1662728us) spinlock_profiling.cc:243] Waited 942 us on lock 0x7b5400353254. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23b5853 00007fa9f738360a 00007fa9f09097d4 00007fa9f0909762 00007fa9f0909691 00007fa9f090960c 00007fa9f09088c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:21.945013 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2167168}
I20260709 12:59:21.947911  3852 leader_election.cc:290] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:21.948809  3643 raft_consensus.cc:2804] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:21.949272  3643 raft_consensus.cc:493] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:21.950248  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 12:59:21.950994  2327 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32870 (request call id 191) took 1887 ms (client timeout 1553 ms). Trace:
I20260709 12:59:21.951856  2323 raft_consensus.cc:1275] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:21.951996  2332 raft_consensus.cc:1275] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:21.949608  3643 raft_consensus.cc:3060] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:21.952760  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:21.953636  3870 raft_consensus.cc:493] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:21.951509  2327 rpcz_store.cc:269] 0709 12:59:20.063184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:20.070539 (+  7355us) service_pool.cc:224] Handling call
0709 12:59:21.950518 (+1879979us) spinlock_profiling.cc:243] Waited 355 ms on lock 0x7b5400846a54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:21.950794 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":815430400}
I20260709 12:59:21.954351  3870 raft_consensus.cc:515] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:21.955205  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:21.953719  2330 raft_consensus.cc:2393] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 3: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:21.953528  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:21.923558  3774 leader_election.cc:290] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:59:21.960989  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 81232.6us
I20260709 12:59:21.964015  3832 raft_consensus.cc:2804] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:21.964100  1734 tablet_copy_service.cc:342] P 0c7751452c4b46afa95251b9df7169d4: Request end of tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-8e94ee9035214526808abfaab11799fe received from {username='slave'} at 127.0.0.1:58782
I20260709 12:59:21.964421  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:21.964705  3832 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:21.965008  1734 tablet_copy_service.cc:434] P 0c7751452c4b46afa95251b9df7169d4: ending tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-8e94ee9035214526808abfaab11799fe on tablet 8e94ee9035214526808abfaab11799fe with peer 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:59:21.965212  3832 raft_consensus.cc:3060] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:21.965914  3830 raft_consensus.cc:493] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.966601  3830 raft_consensus.cc:515] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:21.925617  3824 raft_consensus.cc:493] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.963387  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:21.974434  1688 leader_election.cc:304] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:21.976619  3828 raft_consensus.cc:2804] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:21.977285  3828 raft_consensus.cc:493] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:21.977819  3828 raft_consensus.cc:3060] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:21.982228  1540 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:21.983232  3840 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:21.976799  3855 raft_consensus.cc:515] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:21.984587  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:21.984009  3840 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:21.985569  1643 raft_consensus.cc:2468] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 2.
I20260709 12:59:21.986714  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:21.987418  3840 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:21.987998  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:21.988909  3843 raft_consensus.cc:2804] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:21.989413  3843 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:21.989787  3843 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:21.991071  3643 raft_consensus.cc:515] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 12:59:21.991593  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:21.992466  1569 raft_consensus.cc:2468] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 5.
I20260709 12:59:21.993094  3814 raft_consensus.cc:2749] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:21.996055  1689 leader_election.cc:304] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:21.997290  3771 raft_consensus.cc:2804] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:21.997749  3771 raft_consensus.cc:493] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:21.998224  3771 raft_consensus.cc:3060] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:21.945459  3842 consensus_queue.cc:237] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:22.015677  3871 raft_consensus.cc:493] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:22.019330  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 126527us
I20260709 12:59:22.021391  2294 leader_election.cc:304] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:21.973352  3797 leader_election.cc:290] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:22.025552  1718 raft_consensus.cc:3060] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:22.038468  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:22.036586  3797 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:22.029793  3871 raft_consensus.cc:515] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:21.998493  3702 consensus_queue.cc:260] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:22.040933  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:22.040704  3784 raft_consensus.cc:493] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:22.047225  3784 raft_consensus.cc:515] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:22.041563  3792 raft_consensus.cc:3060] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:22.050478  1648 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 1276) took 2057 ms (client timeout 2451 ms). Trace:
W20260709 12:59:22.050956  1648 rpcz_store.cc:269] 0709 12:59:19.993189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:19.996265 (+  3076us) service_pool.cc:224] Handling call
0709 12:59:22.050021 (+2053756us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b54001739d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:22.050300 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":454602624}
I20260709 12:59:22.054248  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:22.054931  1651 raft_consensus.cc:2468] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 3.
I20260709 12:59:22.055887  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:22.041836  3795 raft_consensus.cc:2804] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:22.056727  3795 raft_consensus.cc:493] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:22.057112  3795 raft_consensus.cc:3060] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:22.040943  1719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1836) took 1133 ms. Trace:
I20260709 12:59:22.040323  1643 raft_consensus.cc:3060] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:22.052330  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:22.060134  1651 raft_consensus.cc:2393] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 5: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:22.059407  1725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1835) took 1152 ms. Trace:
I20260709 12:59:22.065694  2294 leader_election.cc:304] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:21.931135  3867 raft_consensus.cc:515] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:22.059558  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:22.069316  1717 raft_consensus.cc:2468] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 5.
I20260709 12:59:22.068497  3772 consensus_queue.cc:1048] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:59:22.074646  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 78908.7us
I20260709 12:59:22.037561  3824 raft_consensus.cc:515] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:22.040072  3830 leader_election.cc:290] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:22.075258  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 203581us
I20260709 12:59:22.041021  3797 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:22.080559  3702 raft_consensus.cc:3060] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:22.074105  3878 raft_consensus.cc:2749] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:22.087795  1648 raft_consensus.cc:2468] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 4.
I20260709 12:59:22.090469  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:22.091128  1689 leader_election.cc:304] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:22.100140  1651 raft_consensus.cc:3060] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:22.100653  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:22.101756  1648 raft_consensus.cc:2393] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 6: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:22.102588  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:22.102764  3804 leader_election.cc:290] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:22.103127  1648 raft_consensus.cc:3060] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:22.103327  3804 raft_consensus.cc:2749] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:22.103952  1617 leader_election.cc:304] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:22.104642  3844 raft_consensus.cc:2804] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:22.105050  3739 consensus_queue.cc:1048] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:22.106123  3844 raft_consensus.cc:493] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:22.078776  3831 raft_consensus.cc:493] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:22.096513  3584 raft_consensus.cc:3060] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:22.107352  3831 raft_consensus.cc:515] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:22.061582  1725 rpcz_store.cc:276] 0709 12:59:20.906736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:21.011940 (+105204us) service_pool.cc:224] Handling call
0709 12:59:21.030458 (+ 18518us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:21.104904 (+ 74446us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:21.104949 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:21.107360 (+  2411us) log.cc:844] Serialized 26 byte log entry
0709 12:59:21.886975 (+779615us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:21.887055 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:21.887184 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:21.894428 (+  7244us) spinlock_profiling.cc:243] Waited 85.7 ms on lock 0x7b4400022b4c. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef1f4c85 00007fa9ef1f56a2 00007fa9f1f671db 00007fa9f1f62aaf 00007fa9f1f5686e 00007fa9f1f55bb6 00007fa9f1f557d8 00007fa9f1f5f221 00007fa9f1f5f1d9 00007fa9f1f5f169
0709 12:59:22.059052 (+164624us) raft_consensus.cc:1685] finished
0709 12:59:22.059077 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:22.059334 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":126484,"raft.queue_time_us":75530,"raft.run_cpu_time_us":246,"raft.run_wall_time_us":28708,"spinlock_wait_cycles":197036288,"thread_start_us":641492,"threads_started":1,"wal-append.queue_time_us":587799}
I20260709 12:59:22.105988  3662 consensus_queue.cc:1048] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:22.057850  1719 rpcz_store.cc:276] 0709 12:59:20.906908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:21.021268 (+114360us) service_pool.cc:224] Handling call
0709 12:59:21.021621 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:21.022001 (+   380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:21.022030 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:21.349680 (+327650us) spinlock_profiling.cc:243] Waited 4.74 ms on lock 0x7b2c0001ccc8. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f0cb4a11 00007fa9f0cc4372 00007fa9f23f6a01 00007fa9f23bb43a 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2
0709 12:59:21.350044 (+   364us) log.cc:844] Serialized 26 byte log entry
0709 12:59:21.866800 (+516756us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:21.866888 (+    88us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:21.873023 (+  6135us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:22.034315 (+161292us) raft_consensus.cc:1685] finished
0709 12:59:22.034329 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:22.040321 (+  5992us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3047,"raft.queue_time_us":3523,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":52048,"spinlock_wait_cycles":10892672,"thread_start_us":308450,"threads_started":1,"wal-append.queue_time_us":540536}
I20260709 12:59:22.098600  2297 leader_election.cc:304] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:22.096115  3797 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:22.106642  3844 raft_consensus.cc:3060] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:22.091981  1645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 315) took 1101 ms. Trace:
I20260709 12:59:22.111867  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:22.115275  3870 leader_election.cc:290] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:22.117280  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:59:22.118463  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:22.116484  1617 leader_election.cc:304] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:22.114473  1645 rpcz_store.cc:276] 0709 12:59:20.990943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:20.991151 (+   208us) service_pool.cc:224] Handling call
0709 12:59:21.650408 (+659257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:21.767530 (+117122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:22.091709 (+324179us) spinlock_profiling.cc:243] Waited 659 ms on lock 0x7b54002b1950. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23ba8ad 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:22.091881 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1515213184}
I20260709 12:59:22.124791  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:22.127068  1723 raft_consensus.cc:2468] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 4.
I20260709 12:59:22.127974  3837 raft_consensus.cc:2804] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:22.130983  1651 raft_consensus.cc:2468] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 3.
I20260709 12:59:22.128582  3837 raft_consensus.cc:697] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 6 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:22.133384  3837 consensus_queue.cc:237] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:22.129153  3736 raft_consensus.cc:515] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:22.126601  3876 log.cc:927] Time spent T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.297s	user 0.001s	sys 0.002s
I20260709 12:59:22.136363  2294 leader_election.cc:304] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:22.115792  3869 raft_consensus.cc:515] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:22.146283  1725 raft_consensus.cc:1240] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:59:22.147898  1717 raft_consensus.cc:2468] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 4.
I20260709 12:59:22.148100  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45148 (request call id 1904) took 1156 ms. Trace:
I20260709 12:59:22.148430  1647 rpcz_store.cc:276] 0709 12:59:20.991181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:21.270589 (+279408us) service_pool.cc:224] Handling call
0709 12:59:21.270971 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:21.548639 (+277668us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:21.548698 (+    59us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:21.550218 (+  1520us) log.cc:844] Serialized 26 byte log entry
0709 12:59:21.792761 (+242543us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:21.792812 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:22.145694 (+352882us) spinlock_profiling.cc:243] Waited 262 ms on lock 0x7b540030e154. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:22.145750 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:22.145801 (+    51us) raft_consensus.cc:1685] finished
0709 12:59:22.145817 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:22.147916 (+  2099us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":45657,"raft.run_cpu_time_us":313,"raft.run_wall_time_us":315,"spinlock_wait_cycles":602751872,"thread_start_us":241985,"threads_started":1,"wal-append.queue_time_us":308406}
I20260709 12:59:22.149592  3620 raft_consensus.cc:2804] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:59:22.150229  3620 raft_consensus.cc:697] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:22.150403  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:22.151360  1647 raft_consensus.cc:2393] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 5: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:22.152249  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:22.153752  1647 raft_consensus.cc:1275] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:22.155084  1647 raft_consensus.cc:1275] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:22.155162  2328 raft_consensus.cc:1275] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:59:22.151388  2329 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53306 (request call id 503) took 2279 ms (client timeout 2067 ms). Trace:
W20260709 12:59:22.163060  2329 rpcz_store.cc:269] 0709 12:59:19.871728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:19.872226 (+   498us) service_pool.cc:224] Handling call
0709 12:59:22.150996 (+2278770us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54008476d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:22.151172 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2567710976}
I20260709 12:59:22.169251  1617 leader_election.cc:304] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
W20260709 12:59:22.171669  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 60039.3us
I20260709 12:59:22.173586  3867 leader_election.cc:290] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:22.173764  3870 raft_consensus.cc:2804] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:22.174206  3870 raft_consensus.cc:493] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:22.174651  3870 raft_consensus.cc:3060] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:22.151443  3620 consensus_queue.cc:237] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:22.271116  2295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:22.543632  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:22.407627  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:22.180757  1647 raft_consensus.cc:1240] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:59:22.371487  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 12:59:22.747505  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 667941us
W20260709 12:59:22.242270  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 95274.1us
I20260709 12:59:22.751185  1615 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:22.752308  3702 raft_consensus.cc:2749] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:59:22.675359  1643 consensus_meta.cc:287] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.604s	user 0.009s	sys 0.000s
I20260709 12:59:22.768777  1643 raft_consensus.cc:2468] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 5.
I20260709 12:59:22.567972  1642 raft_consensus.cc:1275] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:22.770227  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:22.271545  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:22.560271  3869 leader_election.cc:290] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:59:22.774766  1649 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.008s	sys 0.031s
W20260709 12:59:22.775265  1649 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.008s	sys 0.031s
I20260709 12:59:22.754959  3871 leader_election.cc:290] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:22.757179  1576 raft_consensus.cc:1240] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:22.758000  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:22.758198  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:22.759016  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:22.777787  2324 raft_consensus.cc:2468] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6.
I20260709 12:59:22.604974  3844 raft_consensus.cc:515] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:22.352460  3834 raft_consensus.cc:493] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:22.352628  3758 consensus_queue.cc:1048] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.410s
I20260709 12:59:22.312320  3771 raft_consensus.cc:515] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:22.144858  3878 raft_consensus.cc:2804] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:22.248515  1718 raft_consensus.cc:2468] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 5.
I20260709 12:59:22.562644  1648 raft_consensus.cc:2468] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 4.
I20260709 12:59:22.255853  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:59:22.575294  3843 consensus_meta.cc:287] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.585s	user 0.005s	sys 0.003s
I20260709 12:59:22.771101  1569 raft_consensus.cc:2468] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 5.
W20260709 12:59:22.788909  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:22.628211  3792 consensus_meta.cc:287] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.579s	user 0.006s	sys 0.003s
W20260709 12:59:22.622150  3873 consensus_meta.cc:287] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.725s	user 0.000s	sys 0.010s
W20260709 12:59:22.629130  3832 consensus_meta.cc:287] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.663s	user 0.004s	sys 0.008s
W20260709 12:59:22.312223  3886 log.cc:927] Time spent T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
W20260709 12:59:22.295250  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 124745us
I20260709 12:59:22.813695  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:22.294199  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 12:59:22.567255  3795 consensus_meta.cc:287] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.510s	user 0.006s	sys 0.005s
I20260709 12:59:22.812842  1617 leader_election.cc:304] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:22.549891  3623 raft_consensus.cc:493] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:22.801785  1725 raft_consensus.cc:2393] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 5: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
W20260709 12:59:22.801848  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:22.804311  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:22.804350  2332 raft_consensus.cc:1240] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:59:22.806027  1723 raft_consensus.cc:2468] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 3.
I20260709 12:59:22.362293  3605 raft_consensus.cc:493] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:22.271135  3784 leader_election.cc:290] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:22.211278  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:22.342229  3643 leader_election.cc:290] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373)
I20260709 12:59:22.175130  3673 raft_consensus.cc:2804] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:22.367287  3866 consensus_queue.cc:1048] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.502s
I20260709 12:59:22.808900  1568 raft_consensus.cc:2368] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 4. Current term is 5.
W20260709 12:59:22.557267  1539 leader_election.cc:336] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Timed out: RequestConsensusVote RPC to 127.0.107.194:37391 timed out after 1.611s (SENT)
I20260709 12:59:22.809383  1574 raft_consensus.cc:2393] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 5: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:22.351255  3867 raft_consensus.cc:493] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:22.802408  3828 consensus_meta.cc:287] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.824s	user 0.012s	sys 0.000s
W20260709 12:59:22.805263  1689 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:34373 timed out after 2.046s (SENT) [suppressed 51 similar messages]
I20260709 12:59:22.812934  3824 leader_election.cc:290] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:22.808940  3875 log.cc:927] Time spent T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.983s	user 0.010s	sys 0.024s
I20260709 12:59:22.818212  2327 raft_consensus.cc:2368] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 6. Current term is 7.
I20260709 12:59:22.815546  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:22.290736  3662 raft_consensus.cc:493] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:22.818856  3869 raft_consensus.cc:493] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:22.827299  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:22.811671  3878 raft_consensus.cc:697] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 5 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:22.828972  1539 leader_election.cc:304] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:22.837018  3601 raft_consensus.cc:493] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:22.837690  3601 raft_consensus.cc:515] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:22.837965  3878 consensus_queue.cc:237] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:22.844974  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:22.846347  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:22.846632  3733 raft_consensus.cc:2749] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:22.847079  1569 raft_consensus.cc:2468] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 5.
I20260709 12:59:22.848074  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:22.850241  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
W20260709 12:59:22.851028  2326 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32870 (request call id 195) took 2672 ms (client timeout 3228 ms). Trace:
W20260709 12:59:22.846627  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 289503us
I20260709 12:59:22.852895  1647 raft_consensus.cc:1240] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:22.852919  3733 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:22.853562  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:22.854367  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:22.803592  3834 raft_consensus.cc:515] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:22.853871  3733 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:22.855161  1568 raft_consensus.cc:2393] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 4: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:22.856000  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:22.857226  3733 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:22.811877  3873 raft_consensus.cc:515] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:22.853940  3869 raft_consensus.cc:515] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:22.840201  3601 leader_election.cc:290] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:22.862416  1568 raft_consensus.cc:2468] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 2.
W20260709 12:59:22.851370  2326 rpcz_store.cc:269] 0709 12:59:20.178434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:20.528814 (+350380us) service_pool.cc:224] Handling call
0709 12:59:22.849967 (+2321153us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b58000e6a98. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef296b71 00007fa9ef296a22 00007fa9f81afc09 00007fa9f7309ee0 00007fa9f73d30ab 00007fa9f73d3131 00007fa9f73810a0 00007fa9f7380984 00007fa9f08fb6d4 00007fa9f08fb662
0709 12:59:22.850980 (+  1013us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32500096}
I20260709 12:59:22.831842  3702 raft_consensus.cc:2804] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:22.813859  3832 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:22.830729  3736 leader_election.cc:290] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 12:59:22.880940  1615 consensus_peers.cc:597] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e -> Peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423): Couldn't send request to peer 05476b84d8f84d76a9a1f51b620a3c66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 216561bf1aef403280c36c1e716ca3ad. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:59:22.881393  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 69315.6us
I20260709 12:59:22.882779  1615 leader_election.cc:304] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:22.884006  1615 leader_election.cc:304] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:22.884824  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:22.884684  3867 raft_consensus.cc:515] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:22.885928  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:22.886598  1576 raft_consensus.cc:2393] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 5: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:22.886821  3867 leader_election.cc:290] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:22.887295  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:22.887850  1576 raft_consensus.cc:3060] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:22.888830  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:22.889523  1647 raft_consensus.cc:3060] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:59:22.829753  2323 raft_consensus.cc:2468] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 5.
I20260709 12:59:22.892789  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:22.893376  1568 raft_consensus.cc:2468] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 5.
I20260709 12:59:22.894207  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:22.894871  1568 raft_consensus.cc:2393] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 6: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:22.895524  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:22.896112  1568 raft_consensus.cc:2393] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 6: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:22.856412  3834 leader_election.cc:290] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:22.897954  3771 leader_election.cc:290] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:22.832899  3828 raft_consensus.cc:515] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:22.833619  3605 raft_consensus.cc:515] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:22.861619  3673 raft_consensus.cc:697] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 3 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:22.902110  3823 leader_election.cc:290] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:22.902112  3828 leader_election.cc:290] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:22.903013  3673 consensus_queue.cc:237] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:22.904389  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:22.905534  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:22.905714  3869 leader_election.cc:290] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:22.906623  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:22.906783  3844 leader_election.cc:290] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:22.907697  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:22.822615  3623 raft_consensus.cc:515] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:22.902284  3605 leader_election.cc:290] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:22.878422  1572 raft_consensus.cc:2468] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 5.
I20260709 12:59:22.818560  3795 raft_consensus.cc:515] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:22.917900  3584 consensus_queue.cc:1048] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:59:22.921772  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:22.922392  1646 raft_consensus.cc:2468] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 3.
I20260709 12:59:22.920136  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:22.923514  1568 raft_consensus.cc:3060] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:59:22.806485  3843 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:22.918448  3758 raft_consensus.cc:2749] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:22.933192  1574 raft_consensus.cc:2393] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 6: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:22.942270  2331 raft_consensus.cc:2468] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 3.
I20260709 12:59:22.943328  3871 raft_consensus.cc:2749] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:22.887349  3867 raft_consensus.cc:493] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:22.955631  1722 raft_consensus.cc:1240] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:59:22.957407  3626 raft_consensus.cc:493] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:22.958153  3626 raft_consensus.cc:515] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:22.969517  1576 raft_consensus.cc:2468] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 5.
I20260709 12:59:22.981053  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:22.981979  1720 raft_consensus.cc:2468] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 3.
I20260709 12:59:22.987883  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:22.988896  1725 raft_consensus.cc:3060] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:59:22.990036  1569 raft_consensus.cc:1275] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:59:22.940725  3873 leader_election.cc:290] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:59:22.991925  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 108018us
I20260709 12:59:23.002564  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:23.003306  1723 raft_consensus.cc:2468] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 4.
I20260709 12:59:23.007256  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:23.028086  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:23.008487  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:23.029737  1722 raft_consensus.cc:2410] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:59:23.013180  1572 raft_consensus.cc:1275] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:59:22.950126  3662 raft_consensus.cc:515] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:23.051654  3662 leader_election.cc:290] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:23.057610  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:23.058372  1719 raft_consensus.cc:3060] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:23.053479  1650 raft_consensus.cc:1275] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:23.012362  3623 leader_election.cc:290] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:22.991533  3867 raft_consensus.cc:515] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:23.066828  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 261560us
I20260709 12:59:23.084832  1689 leader_election.cc:304] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:23.089154  1647 raft_consensus.cc:2468] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 4.
W20260709 12:59:23.092826  2297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:23.095989  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 243079us
I20260709 12:59:23.097226  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:23.100334  1572 raft_consensus.cc:3060] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:23.088830  3584 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:23.092407  3873 raft_consensus.cc:493] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:23.104449  1539 leader_election.cc:336] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Timed out: RequestConsensusVote RPC to 127.0.107.194:37391 timed out after 1.906s (SENT)
I20260709 12:59:23.113638  1539 leader_election.cc:304] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:23.113173  3702 raft_consensus.cc:697] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 5 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:23.123929  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:23.112887  3824 raft_consensus.cc:493] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:23.112464  3832 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:23.129099  2323 raft_consensus.cc:1240] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:59:23.130548  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:23.131253  3626 leader_election.cc:290] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:23.133751  3843 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:23.134701  3824 raft_consensus.cc:515] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:23.115880  3795 leader_election.cc:290] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:23.136340  1725 raft_consensus.cc:2468] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 7.
W20260709 12:59:23.137153  1615 consensus_peers.cc:597] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e -> Peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423): Couldn't send request to peer 05476b84d8f84d76a9a1f51b620a3c66. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:59:23.138593  3824 leader_election.cc:290] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:23.139144  3824 raft_consensus.cc:493] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
W20260709 12:59:23.139732  3885 log.cc:927] Time spent T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 1.308s	user 0.007s	sys 0.008s
I20260709 12:59:23.139664  3824 raft_consensus.cc:515] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:23.136767  1645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45148 (request call id 1920) took 1112 ms. Trace:
I20260709 12:59:23.104902  1722 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf"
dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
mode: GRACEFUL
new_leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:50592
I20260709 12:59:23.142050  1645 rpcz_store.cc:276] 0709 12:59:22.024561 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:22.332060 (+307499us) service_pool.cc:224] Handling call
0709 12:59:22.332480 (+   420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:22.549090 (+216610us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:22.549126 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:22.549663 (+   537us) log.cc:844] Serialized 26 byte log entry
0709 12:59:22.922892 (+373229us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:22.922942 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:22.923133 (+   191us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:23.136565 (+213432us) raft_consensus.cc:1685] finished
0709 12:59:23.136586 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:23.136712 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":372692,"threads_started":1,"wal-append.queue_time_us":543647}
I20260709 12:59:23.115222  3584 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:23.153437  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 12:59:23.153637  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 62329us
I20260709 12:59:23.112430  3873 raft_consensus.cc:515] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:23.155265  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:59:23.141233  3894 log.cc:927] Time spent T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:59:23.160072  1722 raft_consensus.cc:606] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Received request to transfer leadership to TS 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:23.160832  1722 raft_consensus.cc:614] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:59:23.169224  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 64816.8us
I20260709 12:59:23.180998  1568 raft_consensus.cc:2468] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 4.
I20260709 12:59:23.184885  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:23.144302  3842 raft_consensus.cc:2749] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:59:23.188724  2326 raft_consensus.cc:2368] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 4. Current term is 5.
I20260709 12:59:23.189527  3702 consensus_queue.cc:237] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:23.190784  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:23.191360  1648 raft_consensus.cc:3060] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:59:23.190083  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:23.193181  3867 leader_election.cc:290] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:23.193740  1724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1837) took 2247 ms. Trace:
I20260709 12:59:23.194034  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:23.194608  3733 raft_consensus.cc:493] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:23.194800  1646 raft_consensus.cc:2376] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 4. Re-sending same reply.
I20260709 12:59:23.195281  3733 raft_consensus.cc:515] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:23.195848  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:23.197055  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:23.197605  1646 raft_consensus.cc:3060] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:23.193967  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:23.201159  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:23.203397  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:23.193260  3584 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 12:59:23.200997  3891 log.cc:927] Time spent T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260709 12:59:23.211566  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:23.212175  1650 raft_consensus.cc:1240] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:59:23.197775  1724 rpcz_store.cc:276] 0709 12:59:20.907064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:21.289283 (+382219us) service_pool.cc:224] Handling call
0709 12:59:21.553602 (+264319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:21.554392 (+   790us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:59:21.824805 (+270413us) log.cc:844] Serialized 14 byte log entry
0709 12:59:21.831319 (+  6514us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:21.897856 (+ 66537us) log.cc:844] Serialized 506 byte log entry
0709 12:59:21.898032 (+   176us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:21.898069 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:21.898135 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:23.139200 (+1241065us) spinlock_profiling.cc:243] Waited 44.3 ms on lock 0x7b4400022b4c. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef1f4c85 00007fa9ef1f56a2 00007fa9f1f671db 00007fa9f1f62aaf 00007fa9f1f5686e 00007fa9f1f55bb6 00007fa9f1f557d8 00007fa9f1f5f221 00007fa9f1f5f1d9 00007fa9f1f5f169
0709 12:59:23.141464 (+  2264us) raft_consensus.cc:1685] finished
0709 12:59:23.154267 (+ 12803us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:23.154369 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":270345,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":126,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":252,"spinlock_wait_cycles":101919872,"thread_start_us":275268,"threads_started":2,"wal-append.queue_time_us":5907}
I20260709 12:59:23.212172  2329 raft_consensus.cc:2468] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
I20260709 12:59:23.202677  3828 raft_consensus.cc:2749] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:23.234067  3870 raft_consensus.cc:515] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:23.236793  3824 leader_election.cc:290] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:23.236933  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:23.210718  3843 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:23.303817  1646 raft_consensus.cc:2468] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
I20260709 12:59:23.347098  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:23.342006  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:23.249169  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 359) took 1229 ms. Trace:
I20260709 12:59:23.342221  1572 raft_consensus.cc:2468] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 7.
I20260709 12:59:23.385375  1647 raft_consensus.cc:2368] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 5. Current term is 6.
I20260709 12:59:23.343876  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:23.291594  2325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53306 (request call id 530) took 1038 ms. Trace:
W20260709 12:59:23.389004  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:23.288914  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 100169us
I20260709 12:59:23.325502  2326 raft_consensus.cc:1275] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:23.330155  1648 raft_consensus.cc:2468] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 4.
I20260709 12:59:23.312949  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:23.291786  1719 raft_consensus.cc:2468] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 5.
I20260709 12:59:23.404456  2329 raft_consensus.cc:2368] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 6. Current term is 7.
I20260709 12:59:23.385151  1717 rpcz_store.cc:276] 0709 12:59:22.019761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:22.148693 (+128932us) service_pool.cc:224] Handling call
0709 12:59:22.149067 (+   374us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:22.149566 (+   499us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:22.149598 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:22.150229 (+   631us) log.cc:844] Serialized 52 byte log entry
0709 12:59:22.775980 (+625751us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:23.101016 (+325036us) log.cc:844] Serialized 14 byte log entry
0709 12:59:23.101236 (+   220us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:23.101306 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:23.242152 (+140846us) raft_consensus.cc:1685] finished
0709 12:59:23.242179 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:23.249086 (+  6907us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":398958,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":8762,"raft.queue_time_us":4985,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":2619,"thread_start_us":440713,"threads_started":2,"wal-append.queue_time_us":832959}
I20260709 12:59:23.399202  2325 rpcz_store.cc:276] 0709 12:59:22.253626 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:22.253788 (+   162us) service_pool.cc:224] Handling call
0709 12:59:22.291052 (+ 37264us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:22.291277 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:22.291307 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:22.291825 (+   518us) log.cc:844] Serialized 26 byte log entry
0709 12:59:22.712268 (+420443us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:22.712331 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:22.712432 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:23.291302 (+578870us) raft_consensus.cc:1685] finished
0709 12:59:23.291324 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:23.291472 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":420008,"threads_started":1,"wal-append.queue_time_us":708633}
I20260709 12:59:23.360625  2297 leader_election.cc:304] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
W20260709 12:59:23.408556  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 50442us
W20260709 12:59:23.409201  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 49179.8us
I20260709 12:59:23.410925  2297 leader_election.cc:304] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 12:59:23.292172  3870 leader_election.cc:290] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:23.247969  3855 leader_election.cc:290] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:23.346128  3842 raft_consensus.cc:493] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:23.369387  3795 consensus_queue.cc:1059] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:59:23.413085  3605 raft_consensus.cc:2804] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:23.346783  3824 raft_consensus.cc:493] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:23.420557  3605 raft_consensus.cc:493] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:23.420680  3720 raft_consensus.cc:2804] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:23.421057  3605 raft_consensus.cc:3060] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:23.415390  3843 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:23.421365  3720 raft_consensus.cc:493] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:23.421868  3720 raft_consensus.cc:3060] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:23.422645  3867 consensus_queue.cc:1059] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:59:23.423430  3843 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:23.420750  3824 raft_consensus.cc:515] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:23.420727  3909 log.cc:927] Time spent T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.221s	user 0.000s	sys 0.002s
I20260709 12:59:23.427625  3824 leader_election.cc:290] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:23.418771  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:23.430174  3605 raft_consensus.cc:515] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:23.414780  3900 log.cc:927] Time spent T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.228s	user 0.001s	sys 0.001s
I20260709 12:59:23.289113  3733 leader_election.cc:290] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:23.432425  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 12:59:23.433270  3910 log.cc:927] Time spent T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:59:23.433514  2325 raft_consensus.cc:2468] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 4.
I20260709 12:59:23.437901  3605 leader_election.cc:290] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:23.419529  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:23.441480  1540 leader_election.cc:304] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:23.442049  2326 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:23.447010  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 310) took 3299 ms. Trace:
I20260709 12:59:23.447781  3843 consensus_queue.cc:1059] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:23.420225  3842 raft_consensus.cc:515] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:23.447892  1642 rpcz_store.cc:276] 0709 12:59:20.144598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:20.144744 (+   146us) service_pool.cc:224] Handling call
0709 12:59:20.158276 (+ 13532us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:22.769876 (+2611600us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:23.439629 (+669753us) spinlock_profiling.cc:243] Waited 2.41 s on lock 0x7b5400097ed4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:23.444211 (+  4582us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5540201216}
I20260709 12:59:23.443260  2323 raft_consensus.cc:2468] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
I20260709 12:59:23.446048  3916 raft_consensus.cc:493] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:23.453742  3842 leader_election.cc:290] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:23.458429  3843 raft_consensus.cc:3055] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:23.455221  3855 raft_consensus.cc:493] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:23.463443  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:23.463512  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:23.464207  1650 raft_consensus.cc:2393] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 3: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:23.464725  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:23.456707  3824 raft_consensus.cc:2749] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:23.466486  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:23.468327  1646 raft_consensus.cc:3060] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:23.462299  3843 raft_consensus.cc:740] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:23.473150  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:59:23.474918  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 61423.9us
I20260709 12:59:23.480981  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:23.461199  3733 consensus_queue.cc:1048] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 12:59:23.489223  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:23.491364  1646 raft_consensus.cc:2468] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 5.
I20260709 12:59:23.492619  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:23.494009  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:23.495024  1646 raft_consensus.cc:2410] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:59:23.471016  3855 raft_consensus.cc:515] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:23.467317  3916 raft_consensus.cc:515] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:23.498898  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:23.501530  3843 consensus_queue.cc:260] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:23.501772  3664 consensus_queue.cc:260] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:23.503434  3664 raft_consensus.cc:3060] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:59:23.507380  3874 log.cc:927] Time spent T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 1.713s	user 0.006s	sys 0.008s
W20260709 12:59:23.505064  3865 log.cc:927] Time spent T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 1.677s	user 0.004s	sys 0.010s
I20260709 12:59:23.498247  1645 raft_consensus.cc:2393] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 6: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
W20260709 12:59:23.509312  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 46048.8us
I20260709 12:59:23.511291  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:23.512272  1646 raft_consensus.cc:2393] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 5: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:59:23.512864  2326 raft_consensus.cc:2468] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
I20260709 12:59:23.512892  1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 324) took 1161 ms. Trace:
I20260709 12:59:23.515048  1643 rpcz_store.cc:276] 0709 12:59:22.351812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:22.786014 (+434202us) service_pool.cc:224] Handling call
0709 12:59:22.786298 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:22.830213 (+ 43915us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:22.830242 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:22.830278 (+    36us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:22.830312 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:23.512667 (+682355us) spinlock_profiling.cc:243] Waited 18.3 ms on lock 0x7b54001752d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:23.512712 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:23.512830 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":42102016}
I20260709 12:59:23.515123  1688 leader_election.cc:304] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66
W20260709 12:59:23.520594  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:23.520663  1645 raft_consensus.cc:1275] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:59:23.500350  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:23.522258  1643 raft_consensus.cc:1240] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:23.522384  1689 leader_election.cc:304] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:23.523036  1651 raft_consensus.cc:1240] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 3 LEADER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:59:23.521364  1540 leader_election.cc:400] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 election: Vote denied by peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423) with higher term. Message: Invalid argument: T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 4. Current term is 5.
I20260709 12:59:23.524263  1540 leader_election.cc:403] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:59:23.524576  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:23.525764  1650 raft_consensus.cc:1240] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 5 LEADER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:59:23.526762  1646 raft_consensus.cc:1240] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:23.527583  3613 consensus_queue.cc:1059] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:59:23.528821  3613 raft_consensus.cc:3055] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:23.529201  3613 raft_consensus.cc:740] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:23.530088  3613 consensus_queue.cc:260] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:23.531510  3613 raft_consensus.cc:3060] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:23.532864  1716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1834) took 2626 ms. Trace:
I20260709 12:59:23.533221  1716 rpcz_store.cc:276] 0709 12:59:20.906574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:20.983587 (+ 77013us) service_pool.cc:224] Handling call
0709 12:59:21.025807 (+ 42220us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:21.175802 (+149995us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:21.175842 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:21.176402 (+   560us) log.cc:844] Serialized 26 byte log entry
0709 12:59:21.791796 (+615394us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:59:21.791890 (+    94us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:21.792021 (+   131us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:23.504287 (+1712266us) spinlock_profiling.cc:243] Waited 47.4 ms on lock 0x7b4400022b4c. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef1f4c85 00007fa9ef1f56a2 00007fa9f1f671db 00007fa9f1f62aaf 00007fa9f1f5686e 00007fa9f1f55bb6 00007fa9f1f557d8 00007fa9f1f5f221 00007fa9f1f5f1d9 00007fa9f1f5f169
0709 12:59:23.532588 (+ 28301us) raft_consensus.cc:1685] finished
0709 12:59:23.532607 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:23.532795 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":213483,"raft.queue_time_us":171315,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":13696,"spinlock_wait_cycles":108968320,"thread_start_us":614732,"threads_started":1,"wal-append.queue_time_us":651065}
I20260709 12:59:23.535506  1645 raft_consensus.cc:1240] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 6 LEADER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:23.539731  3720 raft_consensus.cc:515] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:23.542042  3720 leader_election.cc:290] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:23.542603  2332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53306 (request call id 531) took 1249 ms. Trace:
I20260709 12:59:23.543654  2332 rpcz_store.cc:276] 0709 12:59:22.293446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:22.293670 (+   224us) service_pool.cc:224] Handling call
0709 12:59:22.311995 (+ 18325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:22.820149 (+508154us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:23.542322 (+722173us) spinlock_profiling.cc:243] Waited 492 ms on lock 0x7b54003886d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:23.542516 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1131473152}
I20260709 12:59:23.544974  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:23.545682  2332 raft_consensus.cc:2368] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 4. Current term is 5.
I20260709 12:59:23.546471  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:23.547058  2332 raft_consensus.cc:3060] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:23.549028  3916 leader_election.cc:290] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:23.543129  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:23.551388  2297 leader_election.cc:304] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 12:59:23.552222  2297 leader_election.cc:304] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 12:59:23.559689  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 1735) took 3470 ms. Trace:
I20260709 12:59:23.560075  1570 rpcz_store.cc:276] 0709 12:59:20.079848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:20.080026 (+   178us) service_pool.cc:224] Handling call
0709 12:59:20.080341 (+   315us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:20.198076 (+117735us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:20.198112 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:20.198686 (+   574us) log.cc:844] Serialized 52 byte log entry
0709 12:59:20.452350 (+253664us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:20.471298 (+ 18948us) log.cc:844] Serialized 14 byte log entry
0709 12:59:20.769739 (+298441us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:23.550288 (+2780549us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b54002ebdd4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:23.550350 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:23.550400 (+    50us) raft_consensus.cc:1685] finished
0709 12:59:23.550477 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:23.550654 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":18657,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":222000,"raft.run_cpu_time_us":334,"raft.run_wall_time_us":26452,"spinlock_wait_cycles":269782784,"thread_start_us":471046,"threads_started":2,"wal-append.queue_time_us":440171,"wal-append.run_cpu_time_us":3213,"wal-append.run_wall_time_us":1209221}
I20260709 12:59:23.563408  2332 raft_consensus.cc:2468] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6.
I20260709 12:59:23.564683  2332 raft_consensus.cc:1240] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:23.565971  2332 raft_consensus.cc:1240] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 LEADER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:23.557689  3613 raft_consensus.cc:2804] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:23.574167  2294 leader_election.cc:304] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:23.577121  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:23.578610  3620 raft_consensus.cc:2804] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:23.579305  3620 raft_consensus.cc:493] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:23.579846  3620 raft_consensus.cc:3060] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:23.558501  3795 raft_consensus.cc:2804] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:23.578765  3323 raft_consensus.cc:493] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:23.557873  3916 raft_consensus.cc:3060] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:23.597003  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 87857.3us
I20260709 12:59:23.598007  1540 leader_election.cc:304] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 12:59:23.600843  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 60824us
I20260709 12:59:23.577971  3613 raft_consensus.cc:697] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:23.605619  1540 leader_election.cc:400] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: Vote denied by peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423) with higher term. Message: Invalid argument: T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 6. Current term is 7.
I20260709 12:59:23.553632  3920 consensus_queue.cc:1059] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:59:23.582870  3662 raft_consensus.cc:2749] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:23.581729  3867 raft_consensus.cc:2804] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:23.611775  1540 leader_election.cc:403] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:59:23.614339  3825 raft_consensus.cc:2804] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:23.614781  3825 raft_consensus.cc:493] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:23.614650  2323 raft_consensus.cc:2468] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 3.
I20260709 12:59:23.615355  3825 raft_consensus.cc:3060] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:23.615471  3884 log.cc:927] Time spent T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 1.800s	user 0.005s	sys 0.009s
I20260709 12:59:23.619458  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:23.591267  3664 raft_consensus.cc:493] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:23.626526  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:23.626959  2326 raft_consensus.cc:1240] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 LEADER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:23.606287  3831 leader_election.cc:290] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 12:59:23.630419  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 108793us
I20260709 12:59:23.588886  3605 consensus_queue.cc:1048] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:59:23.588558  3626 consensus_queue.cc:1059] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:59:23.631348  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:23.647533  1717 raft_consensus.cc:3060] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:23.648105  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:23.648726  1722 raft_consensus.cc:3060] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:59:23.590670  3323 raft_consensus.cc:515] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:23.618795  3867 raft_consensus.cc:697] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 3 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:23.652251  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:23.658947  1716 raft_consensus.cc:1275] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:23.658833  1720 raft_consensus.cc:2468] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 2.
I20260709 12:59:23.658291  1571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 364) took 1825 ms. Trace:
I20260709 12:59:23.621084  3921 consensus_queue.cc:1048] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:59:23.661162  1539 leader_election.cc:304] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
W20260709 12:59:23.661947  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 56456.4us
I20260709 12:59:23.663583  1689 leader_election.cc:400] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373) with higher term. Message: Invalid argument: T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 4. Current term is 5.
I20260709 12:59:23.663959  1689 leader_election.cc:403] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:23.666494  2297 leader_election.cc:304] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
W20260709 12:59:23.669519  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 63120us
I20260709 12:59:23.670855  1540 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:23.671593  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:23.672173  1724 raft_consensus.cc:3060] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:23.648036  3662 consensus_queue.cc:1048] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:59:23.660871  1571 rpcz_store.cc:276] 0709 12:59:21.795024 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:21.811486 (+ 16462us) service_pool.cc:224] Handling call
0709 12:59:21.812069 (+   583us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:21.812747 (+   678us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:21.812780 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:21.813422 (+   642us) log.cc:844] Serialized 26 byte log entry
0709 12:59:21.832698 (+ 19276us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:21.832745 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:21.832812 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:23.614688 (+1781876us) spinlock_profiling.cc:243] Waited 59.8 ms on lock 0x7b4400022b4c. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef1f4c85 00007fa9ef1f56a2 00007fa9f1f671db 00007fa9f1f62aaf 00007fa9f1f5686e 00007fa9f1f55bb6 00007fa9f1f557d8 00007fa9f1f5f221 00007fa9f1f5f1d9 00007fa9f1f5f169
0709 12:59:23.617195 (+  2507us) raft_consensus.cc:1685] finished
0709 12:59:23.617217 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:23.620768 (+  3551us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":153,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":215,"spinlock_wait_cycles":137440000,"thread_start_us":18773,"threads_started":1,"wal-append.queue_time_us":1243}
I20260709 12:59:23.654724  3584 consensus_queue.cc:1048] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:59:23.663811  3855 leader_election.cc:290] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:23.678272  1688 leader_election.cc:304] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:23.669070  3702 raft_consensus.cc:493] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:23.673171  3556 raft_consensus.cc:2749] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423) with higher term. Message: Invalid argument: T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 6. Current term is 7.
I20260709 12:59:23.698581  3556 raft_consensus.cc:2804] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:23.699092  3556 raft_consensus.cc:697] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:23.698779  3702 raft_consensus.cc:515] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:23.701115  3702 leader_election.cc:290] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:23.700027  3556 consensus_queue.cc:237] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:23.704982  3871 raft_consensus.cc:493] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:23.663403  3664 raft_consensus.cc:515] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:23.707829  1722 raft_consensus.cc:2468] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 5.
I20260709 12:59:23.709775  1724 raft_consensus.cc:2468] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 5.
I20260709 12:59:23.671034  3795 raft_consensus.cc:697] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
W20260709 12:59:23.717265  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 132232us
W20260709 12:59:23.718710  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 47384.2us
I20260709 12:59:23.719038  1689 leader_election.cc:304] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:23.675668  3919 raft_consensus.cc:2804] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:23.719585  1688 leader_election.cc:304] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:23.723047  2297 leader_election.cc:304] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 12:59:23.726006  1717 raft_consensus.cc:2468] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 5.
W20260709 12:59:23.727352  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 56566.6us
I20260709 12:59:23.729482  1723 raft_consensus.cc:2468] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 3.
I20260709 12:59:23.728376  1540 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:23.682533  3824 consensus_queue.cc:1048] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:59:23.734455  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:23.741710  2326 raft_consensus.cc:2393] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 3: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 12:59:23.742061  1689 leader_election.cc:304] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:23.748361  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:23.724421  3855 raft_consensus.cc:2804] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:23.720348  3926 raft_consensus.cc:3060] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:59:23.682322  3613 consensus_queue.cc:237] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:23.752020  1689 leader_election.cc:304] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:23.753605  3720 consensus_queue.cc:1048] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:23.733345  3933 raft_consensus.cc:2804] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:23.751065  2297 leader_election.cc:304] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 12:59:23.755131  3938 consensus_queue.cc:1059] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:23.756042  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:23.773821  2326 raft_consensus.cc:2393] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 4: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 12:59:23.759498  1539 leader_election.cc:400] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 election: Vote denied by peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391) with higher term. Message: Invalid argument: T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 5. Current term is 6.
I20260709 12:59:23.718741  3871 raft_consensus.cc:515] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:23.756453  3930 raft_consensus.cc:2804] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:59:23.762003  3892 log.cc:927] Time spent T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.901s	user 0.000s	sys 0.016s
I20260709 12:59:23.762337  3924 raft_consensus.cc:2749] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:23.793270  2297 leader_election.cc:304] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 12:59:23.768038  3733 raft_consensus.cc:2804] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:23.799167  3733 raft_consensus.cc:697] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
W20260709 12:59:23.800587  2295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:23.800271  3733 consensus_queue.cc:237] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:23.783867  3871 leader_election.cc:290] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:23.802470  3605 raft_consensus.cc:2804] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:23.803086  3930 raft_consensus.cc:697] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:23.768865  3664 leader_election.cc:290] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:23.771606  1688 leader_election.cc:304] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:23.756778  3921 raft_consensus.cc:2749] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:23.804114  3930 consensus_queue.cc:237] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:23.761376  3855 raft_consensus.cc:697] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 5 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:23.775230  2330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53306 (request call id 529) took 1522 ms. Trace:
I20260709 12:59:23.772583  3906 raft_consensus.cc:2804] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:23.756613  3662 raft_consensus.cc:2804] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:23.779330  1689 leader_election.cc:304] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:23.796952  2332 raft_consensus.cc:3060] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 1 LEARNER]: Advancing to term 3
I20260709 12:59:23.797258  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:23.798087  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:59:23.779440  3925 log.cc:927] Time spent T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:59:23.798389  3935 raft_consensus.cc:2804] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:23.784816  3795 consensus_queue.cc:237] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:23.803223  3605 raft_consensus.cc:697] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:23.802551  2297 leader_election.cc:304] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 12:59:23.772684  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45148 (request call id 1903) took 2783 ms. Trace:
I20260709 12:59:23.804993  3921 raft_consensus.cc:2804] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:23.807056  1539 leader_election.cc:304] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:23.842475  2328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53306 (request call id 511) took 3748 ms. Trace:
I20260709 12:59:23.807739  1615 leader_election.cc:304] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:23.772362  3933 raft_consensus.cc:493] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:23.809267  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:23.807583  1688 leader_election.cc:304] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:23.728379  3867 consensus_queue.cc:237] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:23.779670  3923 log.cc:927] Time spent T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
W20260709 12:59:23.783406  3929 log.cc:927] Time spent T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260709 12:59:23.812047  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 83739.8us
I20260709 12:59:23.782233  3938 raft_consensus.cc:3055] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:23.811062  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 12:59:23.818718  2324 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32870 (request call id 199) took 3626 ms (client timeout 1852 ms). Trace:
I20260709 12:59:23.816135  2295 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
W20260709 12:59:23.858210  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 71446.6us
I20260709 12:59:23.859529  1539 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
W20260709 12:59:23.843103  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 63852.2us
I20260709 12:59:23.842325  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:23.860674  1651 raft_consensus.cc:3060] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:23.860847  1689 leader_election.cc:304] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:23.808642  2330 rpcz_store.cc:276] 0709 12:59:22.253114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:22.270634 (+ 17520us) service_pool.cc:224] Handling call
0709 12:59:22.312875 (+ 42241us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:22.856970 (+544095us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:22.857002 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:22.857524 (+   522us) log.cc:844] Serialized 26 byte log entry
0709 12:59:23.101133 (+243609us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:23.101245 (+   112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:23.769843 (+668598us) spinlock_profiling.cc:243] Waited 544 ms on lock 0x7b5400690354. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:23.769914 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:23.769959 (+    45us) raft_consensus.cc:1685] finished
0709 12:59:23.769971 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:23.775174 (+  5203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22962,"raft.queue_time_us":2493,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":4999,"spinlock_wait_cycles":1250315136,"thread_start_us":243210,"threads_started":1,"wal-append.queue_time_us":266557}
W20260709 12:59:23.847100  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 44619.7us
I20260709 12:59:23.845574  1644 rpcz_store.cc:276] 0709 12:59:20.990612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:20.990723 (+   111us) service_pool.cc:224] Handling call
0709 12:59:20.990981 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:21.633808 (+642827us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:23.770488 (+2136680us) spinlock_profiling.cc:243] Waited 636 ms on lock 0x7b5400157f54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:23.772617 (+  2129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1463551232}
I20260709 12:59:23.850857  3941 raft_consensus.cc:493] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:23.846467  3933 raft_consensus.cc:3060] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:23.851541  3936 raft_consensus.cc:2804] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:23.852121  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:23.843186  2328 rpcz_store.cc:276] 0709 12:59:20.069596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:20.069712 (+   116us) service_pool.cc:224] Handling call
0709 12:59:22.154583 (+2084871us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:22.155540 (+   957us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:23.818218 (+1662678us) spinlock_profiling.cc:243] Waited 2.05 s on lock 0x7b54008476d0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23ba8ad 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:23.818332 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4712625024}
I20260709 12:59:23.814934  3664 raft_consensus.cc:2749] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:23.821738  3919 raft_consensus.cc:697] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
W20260709 12:59:23.857993  2324 rpcz_store.cc:269] 0709 12:59:20.192341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:20.525761 (+333420us) service_pool.cc:224] Handling call
0709 12:59:21.732286 (+1206525us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b58000e6a98. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef296b71 00007fa9ef296a22 00007fa9f81afc09 00007fa9f7309ee0 00007fa9f73d30ab 00007fa9f73d3131 00007fa9f73810a0 00007fa9f7380984 00007fa9f08fb6d4 00007fa9f08fb662
0709 12:59:23.818568 (+2086282us) spinlock_profiling.cc:243] Waited 848 ms on lock 0x7b54006e1c54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:23.818658 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1989202944}
I20260709 12:59:23.813354  3906 raft_consensus.cc:493] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:23.873695  1643 raft_consensus.cc:3060] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:59:23.869164  1688 leader_election.cc:304] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:23.823318  3662 raft_consensus.cc:697] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 4 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:23.857178  3924 raft_consensus.cc:2804] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:59:23.881209  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 73539.3us
I20260709 12:59:23.855899  3921 raft_consensus.cc:697] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 4 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:23.857694  3935 raft_consensus.cc:697] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:23.882261  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:23.867722  3702 raft_consensus.cc:2804] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:23.857534  3938 raft_consensus.cc:740] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:23.882167  1689 leader_election.cc:304] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:23.886559  1689 leader_election.cc:304] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:23.887054  1615 leader_election.cc:304] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:23.889276  3938 consensus_queue.cc:260] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:23.890650  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:23.891842  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:23.892835  3920 raft_consensus.cc:2749] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:23.893338  3939 raft_consensus.cc:2764] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:59:23.895053  3605 consensus_queue.cc:237] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:23.873392  3936 raft_consensus.cc:493] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:23.876809  3824 raft_consensus.cc:2804] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:23.915409  1649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45148 (request call id 1912) took 2171 ms. Trace:
W20260709 12:59:23.914561  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 55433.2us
I20260709 12:59:23.917325  2295 leader_election.cc:304] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:23.883100  3828 raft_consensus.cc:2804] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:23.885574  3906 raft_consensus.cc:3060] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:23.921237  3931 raft_consensus.cc:2804] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:23.881337  3942 raft_consensus.cc:3060] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:23.918850  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:23.919766  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:23.929705  3828 raft_consensus.cc:697] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 5 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:23.929989  3733 consensus_queue.cc:1059] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:23.887681  3702 raft_consensus.cc:493] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
W20260709 12:59:23.932195  2297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:23.934363  2324 raft_consensus.cc:1240] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:59:23.912842  3936 raft_consensus.cc:3060] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:23.915850  1649 rpcz_store.cc:276] 0709 12:59:21.743916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:22.152656 (+408740us) service_pool.cc:224] Handling call
0709 12:59:22.153052 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:22.153495 (+   443us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:22.153533 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:22.154090 (+   557us) log.cc:844] Serialized 26 byte log entry
0709 12:59:22.783940 (+629850us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:22.783983 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:22.784041 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:23.599133 (+815092us) spinlock_profiling.cc:243] Waited 8.49 ms on lock 0x7b4400022b4c. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef1f4c85 00007fa9ef1f56a2 00007fa9f1f671db 00007fa9f1f62aaf 00007fa9f1f5686e 00007fa9f1f55bb6 00007fa9f1f557d8 00007fa9f1f5f221 00007fa9f1f5f1d9 00007fa9f1f5f169
0709 12:59:23.901875 (+302742us) raft_consensus.cc:1685] finished
0709 12:59:23.901895 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:23.915328 (+ 13433us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2443,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":89,"spinlock_wait_cycles":19538304,"thread_start_us":621243,"threads_started":1,"wal-append.queue_time_us":626843}
I20260709 12:59:23.951334  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:23.952104  1644 raft_consensus.cc:3060] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:23.921036  2332 raft_consensus.cc:2955] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 LEARNER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
W20260709 12:59:23.949154  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 65479.8us
I20260709 12:59:23.915007  3673 raft_consensus.cc:2749] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:23.896919  3924 raft_consensus.cc:697] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 4 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:23.919339  3664 raft_consensus.cc:493] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:23.954758  1651 raft_consensus.cc:2468] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 3.
I20260709 12:59:23.878124  3941 raft_consensus.cc:515] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:23.962621  1615 leader_election.cc:400] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 election: Vote denied by peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423) with higher term. Message: Invalid argument: T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 4. Current term is 5.
I20260709 12:59:23.971725  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:23.968868  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:23.972426  1568 raft_consensus.cc:2468] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 2.
I20260709 12:59:23.970005  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:23.972836  1651 raft_consensus.cc:3060] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:23.970147  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:23.971913  1615 leader_election.cc:403] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:59:23.975270  1615 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:23.926698  3931 raft_consensus.cc:493] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:23.976503  3931 raft_consensus.cc:3060] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:23.976620  3664 raft_consensus.cc:515] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:23.977133  3935 consensus_queue.cc:237] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:23.979686  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:23.980608  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:23.980876  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:23.981748  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:23.981979  1568 raft_consensus.cc:1240] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:23.982403  1647 raft_consensus.cc:2393] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 5: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:23.983111  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:23.983074  3940 consensus_queue.cc:1048] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.068s
I20260709 12:59:23.983945  1576 raft_consensus.cc:3060] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:23.980288  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:23.983130  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:23.951467  3702 raft_consensus.cc:3060] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:23.937148  3922 raft_consensus.cc:3060] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:23.986354  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:23.936878  3824 raft_consensus.cc:697] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:23.999891  1647 raft_consensus.cc:2468] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 3.
W20260709 12:59:23.999840  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 113351us
I20260709 12:59:24.004173  1689 leader_election.cc:304] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:24.013160  1643 raft_consensus.cc:2468] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 5.
I20260709 12:59:24.008687  3733 consensus_queue.cc:1059] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 12:59:24.024187  3733 consensus_queue.cc:1243] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer 4dbe7d47a2374afca075d3a98583b49e log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:59:24.024251  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:24.024762  3733 raft_consensus.cc:3055] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:24.025116  3733 raft_consensus.cc:740] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:24.028164  1576 raft_consensus.cc:2468] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 5.
I20260709 12:59:24.042011  1651 raft_consensus.cc:2468] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 5.
I20260709 12:59:24.045255  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:23.958098  3832 consensus_queue.cc:1059] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.053s
I20260709 12:59:23.936537  3842 consensus_queue.cc:1059] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.074s
I20260709 12:59:24.050488  2295 leader_election.cc:304] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:24.012594  3861 raft_consensus.cc:3055] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:23.958770  3556 consensus_queue.cc:1059] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 12:59:23.921950  3855 consensus_queue.cc:237] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:24.059934  2331 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53290 (request call id 789) took 4201 ms (client timeout 1808 ms). Trace:
I20260709 12:59:23.936645  3932 consensus_queue.cc:1059] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.103s
I20260709 12:59:24.049381  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 12:59:24.063447  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:24.053704  1567 raft_consensus.cc:2393] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 2: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
W20260709 12:59:24.076973  2331 rpcz_store.cc:269] 0709 12:59:19.858663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:19.864190 (+  5527us) service_pool.cc:224] Handling call
0709 12:59:24.049119 (+4184929us) spinlock_profiling.cc:243] Waited 2.95 s on lock 0x7b54006c66d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:24.059836 (+ 10717us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6781055872}
I20260709 12:59:24.027710  3673 raft_consensus.cc:2804] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:24.047394  3871 raft_consensus.cc:2749] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423) with higher term. Message: Invalid argument: T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 4. Current term is 5.
I20260709 12:59:24.055511  3920 raft_consensus.cc:3060] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:24.088860  1576 raft_consensus.cc:1240] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:24.091785  3930 raft_consensus.cc:2804] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:24.045392  3733 consensus_queue.cc:260] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:23.988179  3828 consensus_queue.cc:237] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:24.065754  3861 raft_consensus.cc:740] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:24.071132  3919 consensus_queue.cc:237] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:24.027735  3662 consensus_queue.cc:237] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 12:59:24.053804  3921 consensus_queue.cc:237] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:24.236989  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 232885us
W20260709 12:59:24.223524  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:24.220920  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 12:59:24.236101  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 185687us
I20260709 12:59:24.180539  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:24.120064  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 12:59:24.210726  3825 consensus_meta.cc:287] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.595s	user 0.004s	sys 0.005s
W20260709 12:59:24.149037  3946 log.cc:927] Time spent T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 12:59:24.210799  3922 raft_consensus.cc:2749] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:59:24.211490  3947 log.cc:927] Time spent T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
W20260709 12:59:24.184052  3916 consensus_meta.cc:287] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.593s	user 0.010s	sys 0.000s
I20260709 12:59:24.269650  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:24.299965  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:24.301322  1576 raft_consensus.cc:2410] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:59:24.117379  3842 consensus_queue.cc:1243] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer 4dbe7d47a2374afca075d3a98583b49e log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:59:24.258071  1573 raft_consensus.cc:2376] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 5. Re-sending same reply.
I20260709 12:59:24.270852  1689 leader_election.cc:304] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:24.119932  3811 raft_consensus.cc:2804] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:24.120260  3945 ts_tablet_manager.cc:933] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66: Initiating tablet copy from peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:24.311089  1575 raft_consensus.cc:1240] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 LEADER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:24.311079  1689 leader_election.cc:304] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:24.119463  3673 raft_consensus.cc:697] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 6 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:24.126201  3832 consensus_queue.cc:1243] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer 4dbe7d47a2374afca075d3a98583b49e log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 12:59:24.124158  3930 raft_consensus.cc:493] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:24.119684  3323 leader_election.cc:290] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:24.304773  3941 leader_election.cc:290] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:24.273747  3733 raft_consensus.cc:3060] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:24.303810  3620 consensus_meta.cc:287] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.723s	user 0.009s	sys 0.003s
I20260709 12:59:24.335755  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:24.269950  3955 raft_consensus.cc:493] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:24.311717  3811 raft_consensus.cc:493] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:24.123322  3931 raft_consensus.cc:515] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:24.339231  1617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:24.268769  3825 raft_consensus.cc:515] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:24.343065  3927 raft_consensus.cc:3055] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:24.343765  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:24.344753  3323 raft_consensus.cc:2804] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:24.334533  3956 raft_consensus.cc:2749] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:24.186585  3824 consensus_queue.cc:237] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:24.411755  3955 raft_consensus.cc:515] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:24.349303  3951 log.cc:927] Time spent T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.144s	user 0.003s	sys 0.000s
I20260709 12:59:24.351586  2325 raft_consensus.cc:1240] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 LEADER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:24.355454  3938 raft_consensus.cc:3060] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:24.196542  3924 consensus_queue.cc:237] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:24.565488  2325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53290 (request call id 797) took 1129 ms. Trace:
I20260709 12:59:24.366196  2294 leader_election.cc:304] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:24.303228  3916 raft_consensus.cc:2749] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423) with higher term. Message: Invalid argument: T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 4. Current term is 5.
I20260709 12:59:24.341434  1644 raft_consensus.cc:2468] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 4.
I20260709 12:59:24.595371  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:24.566041  2325 rpcz_store.cc:276] 0709 12:59:23.435728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:23.435877 (+   149us) service_pool.cc:224] Handling call
0709 12:59:23.436332 (+   455us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:24.351441 (+915109us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b5400632a20. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f2332dc0 00007fa9f23bd1c0 00007fa9f23be231 00007fa9f23bad8f 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c
0709 12:59:24.565155 (+213714us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:24.565416 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26656128}
I20260709 12:59:24.596117  1644 raft_consensus.cc:2468] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 4.
W20260709 12:59:24.397172  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 86155us
W20260709 12:59:24.412937  2295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:24.597396  1649 raft_consensus.cc:1240] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:59:24.414574  3811 raft_consensus.cc:3060] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:24.312458  3556 raft_consensus.cc:493] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:24.335832  3930 raft_consensus.cc:3060] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:24.459363  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:24.380898  3620 raft_consensus.cc:515] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:24.498660  3673 consensus_queue.cc:237] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:24.560184  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:24.628890  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:24.461191  3323 raft_consensus.cc:493] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:24.412360  3932 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:24.594444  3601 raft_consensus.cc:3055] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:59:24.708400  3962 log.cc:927] Time spent T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 12:59:24.708287  3601 raft_consensus.cc:740] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:24.709736  3601 consensus_queue.cc:260] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:24.711162  3601 raft_consensus.cc:3060] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:24.711550  3933 consensus_meta.cc:287] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.833s	user 0.009s	sys 0.000s
I20260709 12:59:24.496769  3927 raft_consensus.cc:740] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
W20260709 12:59:24.608345  3906 consensus_meta.cc:287] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.648s	user 0.009s	sys 0.000s
I20260709 12:59:24.599617  3831 raft_consensus.cc:493] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.701505  3323 raft_consensus.cc:3060] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:24.771184  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:24.771862  1575 raft_consensus.cc:2468] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6.
W20260709 12:59:24.772796  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 174892us
I20260709 12:59:24.773638  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:24.331581  3861 consensus_queue.cc:260] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:24.711975  3933 raft_consensus.cc:515] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:24.789819  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 423732us
I20260709 12:59:24.801805  2294 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:24.802524  1689 leader_election.cc:304] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:24.707326  3556 raft_consensus.cc:515] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:24.811308  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:24.830227  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:24.834139  2324 raft_consensus.cc:1240] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
W20260709 12:59:24.834410  1646 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45148 (request call id 1933) took 1232 ms (client timeout 1576 ms). Trace:
I20260709 12:59:24.844177  1575 raft_consensus.cc:2393] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 3: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:24.785879  3955 leader_election.cc:290] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:24.833799  2294 leader_election.cc:304] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
W20260709 12:59:24.835011  1646 rpcz_store.cc:269] 0709 12:59:23.602284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:24.791415 (+1189131us) service_pool.cc:224] Handling call
0709 12:59:24.834331 (+ 42916us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:24.849085  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 46639.5us
I20260709 12:59:24.850854  1572 raft_consensus.cc:2468] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 5.
I20260709 12:59:24.811455  3758 raft_consensus.cc:493] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:24.872507  3605 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.026s	sys 0.033s
W20260709 12:59:24.856647  1569 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.003s	sys 0.022s
I20260709 12:59:24.873533  3939 raft_consensus.cc:493] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:24.871340  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:24.851781  3958 raft_consensus.cc:493] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:24.874624  3931 leader_election.cc:290] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:24.875980  3702 consensus_meta.cc:287] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.855s	user 0.000s	sys 0.009s
I20260709 12:59:24.877825  3941 raft_consensus.cc:2804] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:24.807548  3956 consensus_queue.cc:1048] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.087s
I20260709 12:59:24.753733  3906 raft_consensus.cc:515] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:24.731081  3932 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:59:24.773416  3831 raft_consensus.cc:515] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:24.805794  3662 consensus_queue.cc:1048] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 12:59:25.250473  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57912 (request call id 330) took 1463 ms. Trace:
W20260709 12:59:25.261427  2295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:25.066241  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:24.906131  1719 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.846s	user 0.007s	sys 0.023s
W20260709 12:59:25.263875  1719 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.204s	user 0.011s	sys 0.050s
W20260709 12:59:25.264912  1569 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.918s	user 0.012s	sys 0.030s
I20260709 12:59:25.262398  1647 rpcz_store.cc:276] 0709 12:59:23.786886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:23.982919 (+196033us) service_pool.cc:224] Handling call
0709 12:59:25.250225 (+1267306us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b54002d8cd4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:25.250392 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24799104}
W20260709 12:59:25.260718  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 390148us
I20260709 12:59:25.263044  1642 raft_consensus.cc:2468] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 2.
W20260709 12:59:25.266924  1642 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 1322) took 1849 ms (client timeout 1576 ms). Trace:
W20260709 12:59:25.267213  1642 rpcz_store.cc:269] 0709 12:59:23.417761 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:23.450352 (+ 32591us) service_pool.cc:224] Handling call
0709 12:59:24.871190 (+1420838us) spinlock_profiling.cc:243] Waited 1.37 ms on lock 0x7b5800181898. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef296e9c 00007fa9ef296a5b 00007fa9f81afc09 00007fa9f7309ee0 00007fa9f73d30ab 00007fa9f73d3131 00007fa9f73810a0 00007fa9f7380984 00007fa9f08fb6d4 00007fa9f08fb662
0709 12:59:25.266862 (+395672us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3153792}
W20260709 12:59:24.898258  3936 consensus_meta.cc:287] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.931s	user 0.009s	sys 0.000s
W20260709 12:59:25.258008  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:25.262264  2295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:25.283782  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:59:25.292754  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 458977us
W20260709 12:59:25.299149  1648 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 1317) took 1931 ms (client timeout 2093 ms). Trace:
W20260709 12:59:25.301971  1648 rpcz_store.cc:269] 0709 12:59:23.367759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:23.402026 (+ 34267us) service_pool.cc:224] Handling call
0709 12:59:25.283630 (+1881604us) spinlock_profiling.cc:243] Waited 1.47 ms on lock 0x7b5800181898. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef296b71 00007fa9ef296eee 0000000000375939 00007fa9f730a1e0 00007fa9f73d30c4 00007fa9f73d3131 00007fa9f73810a0 00007fa9f7380984 00007fa9f08fb6d4 00007fa9f08fb662
0709 12:59:25.299095 (+ 15465us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3420288}
W20260709 12:59:25.054643  1615 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.078s	user 0.020s	sys 0.030s
W20260709 12:59:25.305984  1615 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.330s	user 0.020s	sys 0.047s
W20260709 12:59:25.306474  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 1.33123e+06us
W20260709 12:59:25.348011  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 543207us
W20260709 12:59:25.349359  1617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:25.374775  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 12:59:25.263687  3605 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.001s	user 0.040s	sys 0.038s
W20260709 12:59:24.881937  3926 consensus_meta.cc:287] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 1.109s	user 0.011s	sys 0.000s
W20260709 12:59:25.376456  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 75411.3us
W20260709 12:59:25.221215  3930 consensus_meta.cc:287] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.509s	user 0.007s	sys 0.002s
I20260709 12:59:24.861722  3870 raft_consensus.cc:2749] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:59:25.116688  3855 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.662s	user 0.019s	sys 0.028s
W20260709 12:59:24.894598  3942 consensus_meta.cc:287] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.934s	user 0.008s	sys 0.000s
I20260709 12:59:25.250088  3945 tablet_copy_client.cc:323] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Beginning tablet copy session from remote peer at address 127.0.107.194:37391
W20260709 12:59:25.380755  3733 consensus_meta.cc:287] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.998s	user 0.011s	sys 0.000s
I20260709 12:59:25.381002  2294 leader_election.cc:304] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4
W20260709 12:59:25.129510  3824 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.009s	sys 0.008s
I20260709 12:59:24.862552  3867 raft_consensus.cc:3060] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:24.880332  3556 leader_election.cc:290] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:24.892124  3920 consensus_meta.cc:287] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.770s	user 0.006s	sys 0.001s
I20260709 12:59:24.881108  3825 leader_election.cc:290] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:25.081764  3934 raft_consensus.cc:2749] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:25.390908  1575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36640 (request call id 1760) took 1036 ms. Trace:
I20260709 12:59:24.861884  3961 raft_consensus.cc:493] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:25.395802  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:25.396420  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:25.456840  1650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 1329) took 1704 ms. Trace:
I20260709 12:59:25.262976  3933 leader_election.cc:290] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:25.287322  3758 raft_consensus.cc:515] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:25.380151  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 72790.5us
I20260709 12:59:25.301462  3673 raft_consensus.cc:493] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:25.433450  3824 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.926s	user 0.009s	sys 0.011s
I20260709 12:59:25.299114  3958 raft_consensus.cc:515] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:25.469183  1719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 381) took 1510 ms. Trace:
I20260709 12:59:25.372161  3941 raft_consensus.cc:697] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:25.470994  3941 consensus_queue.cc:237] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:25.416761  2294 leader_election.cc:304] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:25.421559  1568 raft_consensus.cc:2410] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 12:59:25.395463  3855 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.046s	user 0.019s	sys 0.041s
I20260709 12:59:24.900642  3323 raft_consensus.cc:515] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:25.236166  3811 raft_consensus.cc:515] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:25.393348  3926 raft_consensus.cc:2749] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373) with higher term. Message: Invalid argument: T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 4. Current term is 5.
I20260709 12:59:25.393642  3922 raft_consensus.cc:493] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
W20260709 12:59:25.433017  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 170978us
I20260709 12:59:25.299237  3702 raft_consensus.cc:515] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:25.433542  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 392) took 1154 ms. Trace:
I20260709 12:59:25.461131  3920 raft_consensus.cc:2749] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:25.279537  3861 raft_consensus.cc:3060] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:25.415030  3942 raft_consensus.cc:2749] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:25.421452  1573 raft_consensus.cc:2955] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:59:25.469734  1719 rpcz_store.cc:276] 0709 12:59:23.958644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:23.958793 (+   149us) service_pool.cc:224] Handling call
0709 12:59:23.984783 (+ 25990us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:24.025684 (+ 40901us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:24.025730 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:24.048822 (+ 23092us) log.cc:844] Serialized 26 byte log entry
0709 12:59:25.264570 (+1215748us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:25.264609 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:25.264716 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:25.468920 (+204204us) raft_consensus.cc:1685] finished
0709 12:59:25.468948 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:25.469112 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":188,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":13607,"thread_start_us":1204644,"threads_started":1,"wal-append.queue_time_us":1402671}
I20260709 12:59:25.380987  2323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53290 (request call id 811) took 1598 ms. Trace:
I20260709 12:59:25.391269  3955 consensus_queue.cc:1059] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:59:25.317319  3936 raft_consensus.cc:515] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:25.279789  3939 raft_consensus.cc:515] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:25.477420  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 60774.6us
I20260709 12:59:25.423892  3605 raft_consensus.cc:2804] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:25.517009  3936 leader_election.cc:290] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:25.517447  3605 raft_consensus.cc:697] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:25.517732  3871 consensus_queue.cc:1059] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:25.518569  3871 consensus_queue.cc:1243] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer 05476b84d8f84d76a9a1f51b620a3c66 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:59:25.518375  3605 consensus_queue.cc:237] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:25.397229  3930 raft_consensus.cc:515] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:25.457170  1650 rpcz_store.cc:276] 0709 12:59:23.752590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:25.374843 (+1622253us) service_pool.cc:224] Handling call
0709 12:59:25.456784 (+ 81941us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:24.888983  3927 consensus_queue.cc:260] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:25.434418  3873 leader_election.cc:290] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:25.531587  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:25.464058  3961 raft_consensus.cc:515] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:25.490517  3970 log.cc:927] Time spent T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.230s	user 0.001s	sys 0.000s
I20260709 12:59:25.478262  3673 raft_consensus.cc:515] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:25.492200  1642 raft_consensus.cc:1240] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:59:25.455169  1575 rpcz_store.cc:276] 0709 12:59:24.343698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:24.861242 (+517544us) service_pool.cc:224] Handling call
0709 12:59:25.379587 (+518345us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:25.491258  3922 raft_consensus.cc:515] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:25.537693  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:25.498178  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:25.492555  1569 rpcz_store.cc:276] 0709 12:59:24.270746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:24.270909 (+   163us) service_pool.cc:224] Handling call
0709 12:59:24.312283 (+ 41374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:24.312486 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:59:25.265388 (+952902us) log.cc:844] Serialized 14 byte log entry
0709 12:59:25.425016 (+159628us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:25.425101 (+    85us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:25.425167 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:25.425250 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:25.425382 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42,"prepare.queue_time_us":1090548,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":46,"raft.queue_time_us":226,"raft.run_wall_time_us":19309,"spinlock_wait_cycles":35585408,"thread_start_us":1077237,"threads_started":2,"wal-append.queue_time_us":223598}
W20260709 12:59:25.506922  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:25.480804  3591 raft_consensus.cc:2804] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:25.513753  3905 raft_consensus.cc:3055] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:25.514675   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:59:25.531335  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:25.489777  3831 leader_election.cc:290] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 12:59:25.552884  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:25.550411  1567 raft_consensus.cc:2393] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 5: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
W20260709 12:59:25.537243  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 103511us
I20260709 12:59:25.502261  3824 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:25.548753  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:25.556008  2331 raft_consensus.cc:2393] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 4: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 12:59:25.553452  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36640 (request call id 1759) took 1210 ms. Trace:
I20260709 12:59:25.554785  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:25.556540  1567 rpcz_store.cc:276] 0709 12:59:24.343419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:25.480566 (+1137147us) service_pool.cc:224] Handling call
0709 12:59:25.553398 (+ 72832us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:25.517030  3939 leader_election.cc:290] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:25.533344  3919 raft_consensus.cc:493] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:25.533911  3556 raft_consensus.cc:493] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:25.552639  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:25.538539  3982 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:25.550738  3591 raft_consensus.cc:493] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:25.576635  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:25.639526  2326 raft_consensus.cc:2393] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 6: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
W20260709 12:59:25.640122  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 450992us
I20260709 12:59:25.552806  3905 raft_consensus.cc:740] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:25.752277  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 12:59:25.675757  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 183055us
W20260709 12:59:25.668417  1689 connection.cc:256] RPC call timeout handler was delayed by -1.4469232659999989s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1906s for a response
W20260709 12:59:25.669523  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:25.763849  1689 connection.cc:256] RPC call timeout handler was delayed by -1.1962658790000091s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2056s for a response
W20260709 12:59:25.763909  2295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:25.765662  1575 raft_consensus.cc:2393] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 5: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:25.766108  1575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36640 (request call id 1764) took 1306 ms. Trace:
I20260709 12:59:25.766417  1575 rpcz_store.cc:276] 0709 12:59:24.460023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:25.536516 (+1076493us) service_pool.cc:224] Handling call
0709 12:59:25.766056 (+229540us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":51456}
W20260709 12:59:25.766741  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 271270us
I20260709 12:59:25.560292  3958 leader_election.cc:290] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:25.772131  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45148 (request call id 1936) took 1869 ms. Trace:
I20260709 12:59:25.772514  1644 rpcz_store.cc:276] 0709 12:59:23.903213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:24.596909 (+693696us) service_pool.cc:224] Handling call
0709 12:59:24.597283 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:24.695157 (+ 97874us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:24.695206 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:24.721503 (+ 26297us) log.cc:844] Serialized 26 byte log entry
0709 12:59:25.479401 (+757898us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:25.479446 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:25.479511 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:25.770499 (+290988us) raft_consensus.cc:1685] finished
0709 12:59:25.770513 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:25.772084 (+  1571us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":406,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":40878,"thread_start_us":218829,"threads_started":1,"wal-append.queue_time_us":731187}
W20260709 12:59:25.766587  3969 log.cc:927] Time spent T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.486s	user 0.001s	sys 0.000s
I20260709 12:59:25.775061  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:25.760645  3921 raft_consensus.cc:493] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:25.776678  1615 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:25.717001  3831 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:25.758463  3927 raft_consensus.cc:3060] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:25.665387  3591 raft_consensus.cc:3060] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:25.752996  3811 leader_election.cc:290] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:25.757474  3993 raft_consensus.cc:3055] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:59:25.563221  3824 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:25.714103  3920 raft_consensus.cc:493] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:25.665488  3919 raft_consensus.cc:515] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:25.782147  3921 raft_consensus.cc:515] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:25.791939  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:25.788290  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:25.781459  3992 raft_consensus.cc:3055] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:25.782788  3906 leader_election.cc:290] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:25.665445  3556 raft_consensus.cc:515] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:25.781620  3993 raft_consensus.cc:740] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:25.789700  3921 leader_election.cc:290] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:25.802711  1724 raft_consensus.cc:1240] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:25.801368  1721 raft_consensus.cc:2468] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 5.
I20260709 12:59:25.806825  3993 consensus_queue.cc:260] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:25.807677  2297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:25.808142  3993 raft_consensus.cc:3060] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:59:25.802453  3965 raft_consensus.cc:493] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:25.802829  3992 raft_consensus.cc:740] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:25.793161  3930 leader_election.cc:290] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:25.812636  3961 leader_election.cc:290] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:25.813140  3702 leader_election.cc:290] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:25.813809  3975 log.cc:927] Time spent T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.336s	user 0.000s	sys 0.001s
I20260709 12:59:25.855603  1724 raft_consensus.cc:1275] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:59:25.814998  3922 leader_election.cc:290] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:25.815160  2295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:25.801121  3932 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:25.795789  3831 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:25.817318  3761 raft_consensus.cc:3060] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:25.819694  1649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45148 (request call id 1935) took 1933 ms. Trace:
I20260709 12:59:25.861850  1649 rpcz_store.cc:276] 0709 12:59:23.886693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:24.336200 (+449507us) service_pool.cc:224] Handling call
0709 12:59:24.596920 (+260720us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:24.602139 (+  5219us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:25.819455 (+1217316us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b54002d91d0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23ba8ad 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:25.819622 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":411496192}
W20260709 12:59:25.823729  3963 log.cc:927] Time spent T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 1.490s	user 0.004s	sys 0.017s
W20260709 12:59:25.806401  3968 log.cc:927] Time spent T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.324s	user 0.001s	sys 0.000s
W20260709 12:59:25.808490  2297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:25.830536  1573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 1757) took 1487 ms. Trace:
I20260709 12:59:25.798079  3673 leader_election.cc:290] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:25.831362  1571 raft_consensus.cc:2468] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 3.
I20260709 12:59:25.668824  3982 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:25.833489  1721 raft_consensus.cc:1240] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 5. Current term is 6. Ops: []
W20260709 12:59:25.814388  3979 log.cc:927] Time spent T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.294s	user 0.000s	sys 0.000s
W20260709 12:59:25.846140  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 281514us
I20260709 12:59:25.787449  3920 raft_consensus.cc:515] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:25.833237  3965 raft_consensus.cc:515] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:25.864017  1573 rpcz_store.cc:276] 0709 12:59:24.342800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:24.414935 (+ 72135us) service_pool.cc:224] Handling call
0709 12:59:24.806104 (+391169us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:24.844849 (+ 38745us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:24.844886 (+    37us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:25.080715 (+235829us) log.cc:844] Serialized 532 byte log entry
0709 12:59:25.421335 (+340620us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:25.830101 (+408766us) log.cc:844] Serialized 14 byte log entry
0709 12:59:25.830323 (+   222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:25.830369 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:25.830398 (+    29us) raft_consensus.cc:1685] finished
0709 12:59:25.830405 (+     7us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:25.830492 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":26212,"raft.run_cpu_time_us":299,"raft.run_wall_time_us":19543,"thread_start_us":196372,"threads_started":1,"wal-append.queue_time_us":319029}
W20260709 12:59:25.878819  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 102184us
I20260709 12:59:25.881865  3982 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:25.504954  2323 rpcz_store.cc:276] 0709 12:59:23.779964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:23.794002 (+ 14038us) service_pool.cc:224] Handling call
0709 12:59:23.842023 (+ 48021us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:23.853067 (+ 11044us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:23.853114 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:23.853808 (+   694us) log.cc:844] Serialized 26 byte log entry
0709 12:59:23.972481 (+118673us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:23.972549 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:23.972625 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:24.348609 (+375984us) spinlock_profiling.cc:243] Waited 9.36 ms on lock 0x7b4400022b4c. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef1f4c85 00007fa9ef1f56a2 00007fa9f1f671db 00007fa9f1f62aaf 00007fa9f1f5686e 00007fa9f1f55bb6 00007fa9f1f557d8 00007fa9f1f5f221 00007fa9f1f5f1d9 00007fa9f1f5f169
0709 12:59:25.262704 (+914095us) raft_consensus.cc:1685] finished
0709 12:59:25.278798 (+ 16094us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:25.378291 (+ 99493us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1556,"raft.queue_time_us":1790,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":15736,"spinlock_wait_cycles":21527936,"thread_start_us":118217,"threads_started":1,"wal-append.queue_time_us":240780}
I20260709 12:59:25.884790  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
W20260709 12:59:25.885092  1691 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:25.885269  3932 raft_consensus.cc:493] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:25.885586  2326 raft_consensus.cc:2393] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 6: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 12:59:25.885805  3932 raft_consensus.cc:515] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:25.886476  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:25.887634  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:25.879558  1615 leader_election.cc:304] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:25.887790  3932 leader_election.cc:290] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:25.924947  2324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32870 (request call id 216) took 1989 ms. Trace:
I20260709 12:59:25.926084  2324 rpcz_store.cc:276] 0709 12:59:23.948461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:23.957789 (+  9328us) service_pool.cc:224] Handling call
0709 12:59:23.986956 (+ 29167us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:24.834704 (+847748us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:25.924647 (+1089943us) spinlock_profiling.cc:243] Waited 847 ms on lock 0x7b540058a7d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:25.924879 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1947547904}
I20260709 12:59:25.878225  3673 raft_consensus.cc:2804] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:25.889294  3922 raft_consensus.cc:493] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:25.834201  3992 consensus_queue.cc:260] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:25.898926  3961 raft_consensus.cc:493] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:25.958842  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 1743) took 2048 ms. Trace:
I20260709 12:59:25.982079  1570 rpcz_store.cc:276] 0709 12:59:23.910995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:23.911136 (+   141us) service_pool.cc:224] Handling call
0709 12:59:23.924434 (+ 13298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:23.936927 (+ 12493us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:23.936965 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:23.988491 (+ 51526us) log.cc:844] Serialized 26 byte log entry
0709 12:59:24.185648 (+197157us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:24.185698 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:24.185788 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:25.823094 (+1637306us) spinlock_profiling.cc:243] Waited 2.33 ms on lock 0x7b4400022b4c. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef1f4c85 00007fa9ef1f56a2 00007fa9f1f671db 00007fa9f1f62aaf 00007fa9f1f5686e 00007fa9f1f55bb6 00007fa9f1f557d8 00007fa9f1f5f221 00007fa9f1f5f1d9 00007fa9f1f5f169
0709 12:59:25.944948 (+121854us) raft_consensus.cc:1685] finished
0709 12:59:25.944976 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:25.958759 (+ 13783us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5352320,"thread_start_us":136491,"threads_started":1,"wal-append.queue_time_us":255956}
I20260709 12:59:25.910171  4002 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:25.981317  3961 raft_consensus.cc:515] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:25.981756  3995 log.cc:927] Time spent T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 12:59:25.944103  3867 raft_consensus.cc:2749] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:26.020896  3993 raft_consensus.cc:2749] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:26.047624  1719 raft_consensus.cc:1240] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 5. Current term is 6. Ops: [4.3-5.4]
I20260709 12:59:25.960160  3922 raft_consensus.cc:515] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:26.060184  3940 raft_consensus.cc:3055] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:26.060838  3940 raft_consensus.cc:740] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:26.108017  1573 raft_consensus.cc:3055] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:26.108513  1573 raft_consensus.cc:740] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:26.022886  4002 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:26.056146  3824 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:26.097219  3620 leader_election.cc:290] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:26.061873  3940 consensus_queue.cc:260] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:26.136047  3938 consensus_meta.cc:287] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 1.535s	user 0.007s	sys 0.004s
I20260709 12:59:26.136804  3831 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:26.122805  3556 leader_election.cc:290] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:26.137951  1576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 1755) took 1795 ms. Trace:
W20260709 12:59:26.138001  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 258510us
I20260709 12:59:26.138348  1576 rpcz_store.cc:276] 0709 12:59:24.342126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:24.349881 (+  7755us) service_pool.cc:224] Handling call
0709 12:59:24.350413 (+   532us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:24.350838 (+   425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:24.350863 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:24.351949 (+  1086us) log.cc:844] Serialized 506 byte log entry
0709 12:59:24.805011 (+453062us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:24.805049 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:24.805111 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:26.137746 (+1332635us) raft_consensus.cc:1685] finished
0709 12:59:26.137768 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:26.137898 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":452695,"threads_started":1,"wal-append.queue_time_us":1044390}
I20260709 12:59:26.120929  1573 consensus_queue.cc:260] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:26.106323  3919 leader_election.cc:290] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:59:26.129113  3949 log.cc:927] Time spent T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 2.215s	user 0.009s	sys 0.029s
I20260709 12:59:26.133853  3961 leader_election.cc:290] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:26.135161  3953 raft_consensus.cc:493] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.149000  1720 raft_consensus.cc:1275] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:26.139982  3940 raft_consensus.cc:3060] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:26.170296  1573 raft_consensus.cc:3060] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:26.177834  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:26.161291  3831 raft_consensus.cc:493] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.178351  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:26.183882  1724 raft_consensus.cc:2468] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 6.
I20260709 12:59:26.185240  2297 leader_election.cc:304] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 12:59:26.166976  3720 raft_consensus.cc:493] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:26.189518  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:26.191787  1573 raft_consensus.cc:1275] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 12:59:26.172981  3982 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.192881  1573 pending_rounds.cc:85] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting all ops after (but not including) 3
I20260709 12:59:26.194804  1724 raft_consensus.cc:2393] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 6: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:59:26.179750  3920 leader_election.cc:290] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:26.183625  3919 raft_consensus.cc:493] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.182727  3664 leader_election.cc:290] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:26.165551  3953 raft_consensus.cc:515] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:26.186480  3556 raft_consensus.cc:493] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.208679  2329 raft_consensus.cc:2468] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 3.
I20260709 12:59:26.209164  3556 raft_consensus.cc:515] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:26.209991  4002 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:26.210960  3922 leader_election.cc:290] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:26.214877  1721 raft_consensus.cc:1275] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:26.196798  3982 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:26.195712  3720 raft_consensus.cc:515] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:26.219267  3982 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 12:59:26.219376  3967 log.cc:927] Time spent T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 1.517s	user 0.002s	sys 0.014s
I20260709 12:59:26.219694  3720 leader_election.cc:290] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:26.201031  3919 raft_consensus.cc:515] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:26.222144  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 1766) took 1413 ms. Trace:
I20260709 12:59:26.222683  1567 rpcz_store.cc:276] 0709 12:59:24.824551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:25.667712 (+843161us) service_pool.cc:224] Handling call
0709 12:59:25.752343 (+ 84631us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:25.806539 (+ 54196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:25.806581 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:25.806621 (+    40us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:25.806649 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:26.221904 (+415255us) spinlock_profiling.cc:243] Waited 54 ms on lock 0x7b5400313654. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:26.221958 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:26.222082 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":124245248}
I20260709 12:59:26.202183  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:26.182062  3952 consensus_queue.cc:1048] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:59:26.224972  1722 raft_consensus.cc:3060] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:26.193696  3928 raft_consensus.cc:2804] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:26.205355  3965 leader_election.cc:290] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:26.192507  3831 raft_consensus.cc:515] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:26.225939  3928 raft_consensus.cc:493] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:26.226433  3928 raft_consensus.cc:3060] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:26.209764  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:26.227406  1723 raft_consensus.cc:2468] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 3.
I20260709 12:59:26.222236  1720 raft_consensus.cc:1275] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:26.194615  1573 pending_rounds.cc:107] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:59:26.201917  3591 raft_consensus.cc:515] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:26.228142  1573 raft_consensus.cc:2889] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:26.228968  1721 raft_consensus.cc:1240] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:26.234601  1724 raft_consensus.cc:1275] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:26.248099  1722 raft_consensus.cc:2468] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 4.
I20260709 12:59:26.248258  1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 335) took 2431 ms. Trace:
I20260709 12:59:26.248394  1723 raft_consensus.cc:1240] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:26.212205  3556 leader_election.cc:290] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:26.250634  1573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 1768) took 1386 ms. Trace:
I20260709 12:59:26.251150  1573 rpcz_store.cc:276] 0709 12:59:24.860948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:25.889378 (+1028430us) service_pool.cc:224] Handling call
0709 12:59:26.096962 (+207584us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:26.246773 (+149811us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:26.246939 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:26.252636  2297 leader_election.cc:304] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 12:59:26.222334  3919 leader_election.cc:290] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:26.283455  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:26.249081  1643 rpcz_store.cc:276] 0709 12:59:23.816764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:24.028731 (+211967us) service_pool.cc:224] Handling call
0709 12:59:24.029071 (+   340us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:24.061438 (+ 32367us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:24.061481 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:24.070901 (+  9420us) log.cc:844] Serialized 52 byte log entry
0709 12:59:24.270349 (+199448us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:24.312249 (+ 41900us) log.cc:844] Serialized 14 byte log entry
0709 12:59:25.805301 (+1493052us) spinlock_profiling.cc:243] Waited 4.02 ms on lock 0x7b18003a2ee0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef248c0a 00007fa9f8988219 00007fa9ef2d0a40 00007fa9ef2cb4e4 00007fa9ef2cb455 00007fa9f5db33c7 00007fa9f23c59a7 00007fa9f23d50bf 00007fa9f23d5038
0709 12:59:25.815367 (+ 10066us) log.cc:844] Serialized 14 byte log entry
0709 12:59:25.977712 (+162345us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b18003a2ee0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef2ce3f3 00007fa9ef2d07c1 00007fa9ef2d0779 00007fa9ef2d0709 00007fa9ef2d06d1 00007fa9ef2cf9cd 000000000038f354 000000000038f199 00007fa9ef2b183a
0709 12:59:26.247555 (+269843us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:26.248033 (+   478us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:26.248081 (+    48us) raft_consensus.cc:1685] finished
0709 12:59:26.248093 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:26.248207 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1465287,"prepare.queue_time_us":1544445,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":71,"raft.queue_time_us":15039,"raft.run_cpu_time_us":311,"raft.run_wall_time_us":13947,"spinlock_wait_cycles":43904128,"thread_start_us":461377,"threads_started":3,"wal-append.queue_time_us":745774,"wal-append.run_cpu_time_us":2337,"wal-append.run_wall_time_us":1181466}
W20260709 12:59:26.335085  2295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:26.281180  3720 raft_consensus.cc:2804] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:26.254098  3605 consensus_queue.cc:1048] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.104s
I20260709 12:59:26.329945  3953 leader_election.cc:290] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:26.360781  3919 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:26.385033  1721 raft_consensus.cc:1275] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:59:26.387126  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:59:26.390126  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:26.372439  3720 raft_consensus.cc:697] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:26.396117  1721 raft_consensus.cc:1275] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:26.389057  3591 leader_election.cc:290] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:26.408605  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:26.409461  1720 raft_consensus.cc:2376] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 5. Re-sending same reply.
I20260709 12:59:26.413048  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:26.414602  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:26.417372  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:26.416484  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 1770) took 1361 ms. Trace:
I20260709 12:59:26.417913  1720 raft_consensus.cc:2468] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 5.
I20260709 12:59:26.387120  3919 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:59:26.419095  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:26.418081  1570 rpcz_store.cc:276] 0709 12:59:25.055175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:25.983894 (+928719us) service_pool.cc:224] Handling call
0709 12:59:26.118758 (+134864us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:26.123620 (+  4862us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:59:26.254252 (+130632us) log.cc:844] Serialized 14 byte log entry
0709 12:59:26.415969 (+161717us) log.cc:844] Serialized 14 byte log entry
0709 12:59:26.416155 (+   186us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:26.416200 (+    45us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:26.416245 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:26.416304 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:26.416432 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3249,"prepare.queue_time_us":291928,"raft.queue_time_us":94,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":2162,"thread_start_us":174028,"threads_started":2}
I20260709 12:59:26.421332  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:26.421861  1723 raft_consensus.cc:2468] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 3.
I20260709 12:59:26.422312  3919 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:26.423740  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:26.423348  3720 consensus_queue.cc:237] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:26.424803  1722 raft_consensus.cc:1240] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 5 LEADER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:59:26.425788  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:26.426848  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:26.427567  1722 raft_consensus.cc:2393] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 6: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:59:26.430634  1689 leader_election.cc:400] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423) with higher term. Message: Invalid argument: T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 6. Current term is 7.
I20260709 12:59:26.430989  1689 leader_election.cc:403] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:26.428301  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:26.434096  3922 raft_consensus.cc:2749] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423) with higher term. Message: Invalid argument: T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 6. Current term is 7.
I20260709 12:59:26.443758  1722 raft_consensus.cc:2468] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
I20260709 12:59:26.445186  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:26.449162  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:26.449283  1689 leader_election.cc:304] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:26.453328  1689 leader_election.cc:304] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:26.454087  3927 raft_consensus.cc:2749] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:26.453387  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:26.456355  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:26.456997  3920 raft_consensus.cc:2749] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:26.457010  1722 raft_consensus.cc:2468] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 4.
I20260709 12:59:26.457758  3843 raft_consensus.cc:3060] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:26.458113  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:26.458866  1722 raft_consensus.cc:2393] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 5: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:26.459616  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:26.460397  1722 raft_consensus.cc:2410] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:59:26.463052  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:26.463939  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:26.464444  3919 consensus_queue.cc:1059] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:59:26.466683  3919 raft_consensus.cc:3055] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:26.467000  3919 raft_consensus.cc:740] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:26.467118  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:26.467859  1722 raft_consensus.cc:2393] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 6: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:59:26.467808  3919 consensus_queue.cc:260] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:26.451905  3922 consensus_queue.cc:1048] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:59:26.469512  3919 raft_consensus.cc:3060] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:26.470468  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:26.471568  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:26.474771  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:26.475659  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:26.476253  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 338) took 2118 ms. Trace:
I20260709 12:59:26.476652  1642 rpcz_store.cc:276] 0709 12:59:24.357652 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:25.267828 (+910176us) service_pool.cc:224] Handling call
0709 12:59:25.268092 (+   264us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:25.537814 (+269722us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:26.476020 (+938206us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b540030eb54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:26.476197 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":500182912}
I20260709 12:59:26.476263  1722 raft_consensus.cc:2393] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 5: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:26.478921  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:26.446619  3867 consensus_queue.cc:1059] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
W20260709 12:59:26.480132  1572 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37682 (request call id 384) took 2500 ms (client timeout 2144 ms). Trace:
I20260709 12:59:26.480242  3867 raft_consensus.cc:3055] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:26.480647  3867 raft_consensus.cc:740] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:26.480831  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:26.481896  1723 raft_consensus.cc:2393] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 5: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:26.481601  3867 consensus_queue.cc:260] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:26.480242  1722 raft_consensus.cc:1240] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:59:26.482844  3867 raft_consensus.cc:3060] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:26.483572  1722 raft_consensus.cc:1240] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:59:26.483659  3928 raft_consensus.cc:515] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:26.484730  1722 raft_consensus.cc:1240] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 4 LEADER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:26.486186  3928 leader_election.cc:290] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:26.487906  1645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45148 (request call id 1939) took 2583 ms. Trace:
I20260709 12:59:26.489564  1721 raft_consensus.cc:2468] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 3.
I20260709 12:59:26.489605  1722 raft_consensus.cc:1275] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:59:26.490842  1721 raft_consensus.cc:1240] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 4 LEADER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:26.491561  1722 raft_consensus.cc:1240] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 3. Current term is 4. Ops: []
W20260709 12:59:26.491796  1542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:26.482954  1723 raft_consensus.cc:1240] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 5. Current term is 6. Ops: []
W20260709 12:59:26.480593  1572 rpcz_store.cc:269] 0709 12:59:23.979289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:23.979420 (+   131us) service_pool.cc:224] Handling call
0709 12:59:26.479955 (+2500535us) spinlock_profiling.cc:243] Waited 670 ms on lock 0x7b5400312c54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:26.480054 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1541229824}
W20260709 12:59:26.501989  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:26.506551  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:26.507887  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 12:59:26.508083  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 349669us
W20260709 12:59:26.508282  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:26.511818  1691 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:26.488301  1645 rpcz_store.cc:276] 0709 12:59:23.904242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:25.259126 (+1354884us) service_pool.cc:224] Handling call
0709 12:59:25.375050 (+115924us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:25.375261 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:59:25.890136 (+514875us) log.cc:844] Serialized 14 byte log entry
0709 12:59:26.487393 (+597257us) spinlock_profiling.cc:243] Waited 21.1 ms on lock 0x7b18003a2ca0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef248c0a 00007fa9f8988219 00007fa9ef2d0a40 00007fa9ef2cb4e4 00007fa9ef2cb455 00007fa9f23b3060 00007fa9f23c5716 00007fa9f23d6287 00007fa9f23d6208
0709 12:59:26.487569 (+   176us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:26.487620 (+    51us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:26.487667 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:26.487732 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:26.487853 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":497043,"prepare.queue_time_us":568005,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"spinlock_wait_cycles":48500608,"thread_start_us":126284,"threads_started":2,"wal-append.queue_time_us":237260}
I20260709 12:59:26.501752  3673 raft_consensus.cc:697] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 3 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:26.514114  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:26.514688  1723 raft_consensus.cc:3060] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:26.514575  3673 consensus_queue.cc:237] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:26.502384  3784 raft_consensus.cc:493] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.516696  3784 raft_consensus.cc:515] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 12:59:26.517916  1574 raft_consensus.cc:2410] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:59:26.518541  3843 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:26.518759  3784 leader_election.cc:290] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373)
I20260709 12:59:26.519079  3843 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:26.523036  3758 leader_election.cc:290] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:26.524442  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:26.524930  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:26.525699  3965 raft_consensus.cc:493] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:26.526216  3965 raft_consensus.cc:515] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:26.527812  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:26.528064  3965 leader_election.cc:290] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:26.528698  1576 raft_consensus.cc:2410] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:59:26.529079  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45148 (request call id 1937) took 2625 ms. Trace:
I20260709 12:59:26.529422  1646 rpcz_store.cc:276] 0709 12:59:23.903650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:25.044168 (+1140518us) service_pool.cc:224] Handling call
0709 12:59:25.138384 (+ 94216us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:25.138652 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:59:25.941895 (+803243us) log.cc:844] Serialized 14 byte log entry
0709 12:59:26.528766 (+586871us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:26.528821 (+    55us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:26.528870 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:26.528929 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:26.529020 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":885829,"prepare.queue_time_us":738167,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"spinlock_wait_cycles":196992,"thread_start_us":495660,"threads_started":2,"wal-append.queue_time_us":445802}
W20260709 12:59:26.546376  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:26.588663  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 12:59:26.593212  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 78801.8us
I20260709 12:59:26.533358  3843 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:26.482867  3905 consensus_queue.cc:260] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:26.609612  2328 raft_consensus.cc:1240] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 5. Current term is 6. Ops: []
W20260709 12:59:26.660609  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:26.672004  3601 raft_consensus.cc:493] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.884123  3601 raft_consensus.cc:515] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:26.886727  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 433464us
I20260709 12:59:26.887526  1689 leader_election.cc:304] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 12:59:26.726431  3943 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 12:59:26.738215  4002 raft_consensus.cc:493] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:26.621138  2297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:26.890673  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:26.892120  1723 raft_consensus.cc:2468] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 7.
W20260709 12:59:26.752166  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 248407us
W20260709 12:59:26.893796  1542 connection.cc:256] RPC call timeout handler was delayed by -2.3114860809999414s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1535s for a response
I20260709 12:59:26.874831  1661 tablet_copy_service.cc:140] P 4dbe7d47a2374afca075d3a98583b49e: Received BeginTabletCopySession request for tablet 216561bf1aef403280c36c1e716ca3ad from peer 05476b84d8f84d76a9a1f51b620a3c66 ({username='slave'} at 127.0.0.1:57912)
I20260709 12:59:26.532856  3965 raft_consensus.cc:493] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.896795  1646 raft_consensus.cc:1275] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:59:26.897356  1689 leader_election.cc:304] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:26.896940  1661 tablet_copy_service.cc:161] P 4dbe7d47a2374afca075d3a98583b49e: Beginning new tablet copy session on tablet 216561bf1aef403280c36c1e716ca3ad from peer 05476b84d8f84d76a9a1f51b620a3c66 at {username='slave'} at 127.0.0.1:57912: session id = 05476b84d8f84d76a9a1f51b620a3c66-216561bf1aef403280c36c1e716ca3ad
W20260709 12:59:26.900239  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:26.900224  1689 leader_election.cc:304] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:26.908615  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:26.909322  2328 raft_consensus.cc:3060] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:26.909549  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:26.715498  4001 raft_consensus.cc:493] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.910900  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:26.914921  2332 raft_consensus.cc:2410] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:59:26.915259  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:26.915830  1646 raft_consensus.cc:3060] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:26.911684  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 12:59:26.912261  1542 connection.cc:256] RPC call timeout handler was delayed by -2.06488888399997s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2627s for a response
I20260709 12:59:26.917064  1573 raft_consensus.cc:2468] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 3.
W20260709 12:59:26.918526  1615 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:26.919046  1615 connection.cc:256] RPC call timeout handler was delayed by -1.78460750499994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1533s for a response
W20260709 12:59:26.919410  1615 connection.cc:256] RPC call timeout handler was delayed by -1.7351075049999736s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15880000000000002s for a response
W20260709 12:59:26.919720  1615 connection.cc:256] RPC call timeout handler was delayed by -1.669407504999981s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16610000000000003s for a response
W20260709 12:59:26.920073  1615 connection.cc:256] RPC call timeout handler was delayed by -1.6091075049999404s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1728s for a response
W20260709 12:59:26.920585  1615 connection.cc:256] RPC call timeout handler was delayed by -1.5650075049999259s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1777s for a response
W20260709 12:59:26.920895  1615 connection.cc:256] RPC call timeout handler was delayed by -1.5443075049999493s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18000000000000002s for a response
I20260709 12:59:26.921142  2327 raft_consensus.cc:1240] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 2. Current term is 3. Ops: []
W20260709 12:59:26.921183  1615 connection.cc:256] RPC call timeout handler was delayed by -1.5083075049999479s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18400000000000002s for a response
W20260709 12:59:26.921823  1615 connection.cc:256] RPC call timeout handler was delayed by -1.4489075049999656s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1906s for a response
W20260709 12:59:26.922120  1615 connection.cc:256] RPC call timeout handler was delayed by -1.3913075049999293s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.197s for a response
W20260709 12:59:26.922410  1615 connection.cc:256] RPC call timeout handler was delayed by -1.3886075049999818s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19730000000000003s for a response
W20260709 12:59:26.922705  1615 connection.cc:256] RPC call timeout handler was delayed by -1.1762075049999794s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2209s for a response
W20260709 12:59:26.923053  1615 connection.cc:256] RPC call timeout handler was delayed by -1.1555075049999459s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22320000000000004s for a response
I20260709 12:59:26.923218  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 12:59:26.923377  1615 connection.cc:256] RPC call timeout handler was delayed by -1.1231075049999504s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2268s for a response
W20260709 12:59:26.923804  1615 connection.cc:256] RPC call timeout handler was delayed by -1.100070197999969s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1945s for a response
W20260709 12:59:26.924114  1615 connection.cc:256] RPC call timeout handler was delayed by -1.0052075049999303s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2399s for a response
I20260709 12:59:26.925423  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:26.926285  1649 raft_consensus.cc:2393] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 5: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:26.897517  3919 raft_consensus.cc:493] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:26.904956  3989 raft_consensus.cc:3060] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:26.905990  3922 raft_consensus.cc:2749] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:26.896261  3920 raft_consensus.cc:493] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:26.890630  4002 raft_consensus.cc:515] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:26.930959  1650 raft_consensus.cc:1240] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 6 LEADER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:26.911054  3905 raft_consensus.cc:3060] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:26.913168  3733 raft_consensus.cc:493] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.937539  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:26.938474  1573 raft_consensus.cc:2468] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 6.
I20260709 12:59:26.939441  1615 leader_election.cc:304] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:26.941558  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:26.895710  3843 consensus_queue.cc:1059] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:59:26.922875  3784 raft_consensus.cc:493] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:26.922501  3973 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:26.926038  3940 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:26.960287  1646 raft_consensus.cc:2468] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 4.
I20260709 12:59:26.948031  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
W20260709 12:59:26.949643  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:26.956506  1721 raft_consensus.cc:1275] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:26.949108  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:26.962961  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:26.931679  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:26.965066  1716 raft_consensus.cc:1275] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:59:26.906896  3965 raft_consensus.cc:515] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:26.965567  1716 pending_rounds.cc:85] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4: Aborting all ops after (but not including) 5
I20260709 12:59:26.965894  1716 pending_rounds.cc:107] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:59:26.966223  1716 raft_consensus.cc:2889] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:26.967247  2324 raft_consensus.cc:1240] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:26.942423  3927 raft_consensus.cc:2749] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:59:26.970715  1542 connection.cc:256] RPC call timeout handler was delayed by -1.7597888839999882s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.29660000000000003s for a response
W20260709 12:59:26.971097  1542 connection.cc:256] RPC call timeout handler was delayed by -1.65538888399999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30820000000000003s for a response
W20260709 12:59:26.971442  1542 connection.cc:256] RPC call timeout handler was delayed by -1.62028888399999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31210000000000004s for a response
W20260709 12:59:26.971773  1542 connection.cc:256] RPC call timeout handler was delayed by -1.4975248370000145s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2093s for a response
W20260709 12:59:26.972095  1542 connection.cc:256] RPC call timeout handler was delayed by -1.4524905719999879s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17880000000000001s for a response
W20260709 12:59:26.972273  1542 connection.cc:256] RPC call timeout handler was delayed by -1.4198775780000119s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1557s for a response
W20260709 12:59:26.972426  1542 connection.cc:256] RPC call timeout handler was delayed by -1.3770069679999892s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2187s for a response
W20260709 12:59:26.972697  1542 connection.cc:256] RPC call timeout handler was delayed by -1.3245277880000117s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15960000000000002s for a response
I20260709 12:59:26.972852  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 12:59:26.972937  1542 connection.cc:256] RPC call timeout handler was delayed by -1.3161319329999515s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18130000000000002s for a response
W20260709 12:59:26.973310  1542 connection.cc:256] RPC call timeout handler was delayed by -1.2474372730000027s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2143s for a response
I20260709 12:59:26.973409  1573 raft_consensus.cc:2468] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 3.
I20260709 12:59:26.944433  3943 raft_consensus.cc:493] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:26.918030  4001 raft_consensus.cc:515] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:26.980034  1572 raft_consensus.cc:1275] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:26.934183  3919 raft_consensus.cc:515] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:26.981029  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 52868.8us
I20260709 12:59:26.981923  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:26.946169  3733 raft_consensus.cc:515] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 12:59:26.974646  3843 raft_consensus.cc:3055] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:26.988296  1615 leader_election.cc:304] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:26.960278  3784 raft_consensus.cc:515] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:27.009730  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:27.028578  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:26.964798  3973 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:27.069324  1651 raft_consensus.cc:1275] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:26.944875  3920 raft_consensus.cc:515] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:27.077049  4029 log.cc:927] Time spent T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 12:59:27.078601  2328 raft_consensus.cc:2468] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 5.
I20260709 12:59:27.079430  2324 raft_consensus.cc:1240] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 12:59:27.079715  4032 log.cc:927] Time spent T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:59:27.080804  4037 raft_consensus.cc:493] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.081339  4037 raft_consensus.cc:515] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:27.083608  4037 leader_election.cc:290] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:27.084810  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:27.085129  1650 raft_consensus.cc:1275] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:27.085956  3784 leader_election.cc:290] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:27.087884  3920 leader_election.cc:290] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:26.966943  3940 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:27.089454  1644 raft_consensus.cc:1275] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:27.091909  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:26.994131  3843 raft_consensus.cc:740] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:27.097106  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:59:27.096730  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.097460  1661 tablet_copy_source_session.cc:215] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:59:27.098559  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:27.101389  1573 raft_consensus.cc:2468] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 6.
I20260709 12:59:27.102337  1650 raft_consensus.cc:2468] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 2.
I20260709 12:59:27.104188  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:27.105298  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:27.094249  3871 raft_consensus.cc:2749] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:27.108670  1649 raft_consensus.cc:1275] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:59:27.109762  3733 leader_election.cc:290] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:27.109905  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:27.110989  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:27.111603  1723 raft_consensus.cc:2368] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 6. Current term is 7.
I20260709 12:59:27.113052  4002 leader_election.cc:290] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:26.988791  3943 raft_consensus.cc:515] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:27.114022  3871 raft_consensus.cc:493] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.114533  3871 raft_consensus.cc:515] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:27.113247  3965 leader_election.cc:290] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:27.115948  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:27.116513  1721 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 3.
I20260709 12:59:27.116782  4024 raft_consensus.cc:493] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.116875  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:27.117343  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:27.117509  1648 raft_consensus.cc:2468] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 2.
I20260709 12:59:27.117753  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:27.117866  1721 raft_consensus.cc:2376] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 3. Re-sending same reply.
I20260709 12:59:27.118818  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:27.118884  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:27.097343  3601 leader_election.cc:290] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:27.119817  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:27.128063  1647 raft_consensus.cc:2468] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 4.
I20260709 12:59:27.129150  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:27.112404  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:27.130479  1723 raft_consensus.cc:2376] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5. Re-sending same reply.
I20260709 12:59:27.122056  1646 raft_consensus.cc:1240] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:27.098027  4030 raft_consensus.cc:493] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:27.133366  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:27.133710  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
W20260709 12:59:27.120954  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 139151us
I20260709 12:59:27.135147  1615 leader_election.cc:304] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:27.134234  1650 raft_consensus.cc:3060] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:27.137607  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:27.111285  3973 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:27.112383  4001 leader_election.cc:290] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:27.137056  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:27.116432  3871 leader_election.cc:290] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:27.132572  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:27.136804  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:27.143689  1716 raft_consensus.cc:2468] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 2.
I20260709 12:59:27.137219  1646 raft_consensus.cc:1275] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:27.114984  3943 leader_election.cc:290] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:27.139885  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:27.145028  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:27.127249  2323 raft_consensus.cc:1275] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:27.136804  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:27.148613  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:27.152767  1716 raft_consensus.cc:2468] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6.
I20260709 12:59:27.153761  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:27.154597  1647 raft_consensus.cc:2468] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 3.
I20260709 12:59:27.117359  4024 raft_consensus.cc:515] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:27.157470  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:27.158106  1721 raft_consensus.cc:2468] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
I20260709 12:59:27.153715  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:27.160913  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:27.140966  3758 raft_consensus.cc:2749] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:27.166831  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:27.167011  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:27.169335  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:27.171201  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:27.171582  4038 raft_consensus.cc:493] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.172106  4038 raft_consensus.cc:515] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:27.174145  4038 leader_election.cc:290] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:27.175876  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:27.176330  1716 raft_consensus.cc:2955] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:59:27.177281  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:27.178043  1569 raft_consensus.cc:2468] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 5.
I20260709 12:59:27.185259  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 12:59:27.189476  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 70687.1us
I20260709 12:59:27.190485  1542 leader_election.cc:304] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:27.193642  1721 raft_consensus.cc:2393] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 6: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:59:27.156958  3973 raft_consensus.cc:2749] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:59:27.167970  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:27.185917  1569 raft_consensus.cc:2376] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 5. Re-sending same reply.
I20260709 12:59:27.198231  1646 raft_consensus.cc:1275] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:27.199592  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:27.200682  1569 raft_consensus.cc:2410] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:59:27.136062  3843 consensus_queue.cc:260] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:27.167604  1723 raft_consensus.cc:2393] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 6: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
W20260709 12:59:27.196761  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 61731.8us
I20260709 12:59:27.197203  2294 leader_election.cc:304] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:27.198006  1688 leader_election.cc:304] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:27.196558  3943 raft_consensus.cc:493] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:27.201833  3982 consensus_queue.cc:1048] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:27.201990  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:27.212915  2331 raft_consensus.cc:2393] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 3: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 12:59:27.213200  1688 leader_election.cc:304] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:27.208189  1542 leader_election.cc:304] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:27.195606  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:27.214237  1647 raft_consensus.cc:2468] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 5.
I20260709 12:59:27.214521  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:27.215384  1569 raft_consensus.cc:2468] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 5.
I20260709 12:59:27.216408  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:27.218245  1723 raft_consensus.cc:1275] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:59:27.217695  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:27.140918  4030 raft_consensus.cc:515] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:27.220384  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:27.211719  3831 leader_election.cc:290] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:27.222384  3601 raft_consensus.cc:2804] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:27.222827  3843 raft_consensus.cc:3060] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:27.223737  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:27.211952  3733 raft_consensus.cc:2749] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:27.225205  3733 raft_consensus.cc:2749] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:27.226056  1615 leader_election.cc:304] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:27.189193  3919 leader_election.cc:290] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:27.229190  1688 leader_election.cc:304] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:27.194933  3323 leader_election.cc:290] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:27.232421  1721 raft_consensus.cc:1275] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:59:27.233654  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:27.236047  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:27.203267  3940 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:27.242129  1571 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36640 (request call id 1742) took 3344 ms (client timeout 1973 ms). Trace:
W20260709 12:59:27.244046  1571 rpcz_store.cc:269] 0709 12:59:23.897979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:23.898084 (+   105us) service_pool.cc:224] Handling call
0709 12:59:27.241969 (+3343885us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b54002710d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:27.242063 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3702849280}
I20260709 12:59:27.244789  1573 raft_consensus.cc:2410] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:59:27.242362  1574 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37682 (request call id 386) took 3262 ms (client timeout 1540 ms). Trace:
I20260709 12:59:27.219213  4038 raft_consensus.cc:2804] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:27.220829  3920 raft_consensus.cc:2804] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:27.257970  1688 leader_election.cc:304] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:27.243414  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 12:59:27.246590  1574 rpcz_store.cc:269] 0709 12:59:23.979930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:23.980051 (+   121us) service_pool.cc:224] Handling call
0709 12:59:27.235374 (+3255323us) spinlock_profiling.cc:243] Waited 2.53 s on lock 0x7b540017e154. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:27.242270 (+  6896us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5822027008}
I20260709 12:59:27.250536  3831 raft_consensus.cc:2804] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:27.259147  3831 raft_consensus.cc:493] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:27.259442  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 12:59:27.259516  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 48596.1us
I20260709 12:59:27.260259  1574 raft_consensus.cc:2410] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:59:27.260990  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:27.261729  1574 raft_consensus.cc:2410] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:59:27.230914  3943 raft_consensus.cc:515] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:27.262408  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:27.263093  1574 raft_consensus.cc:2393] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 6: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:27.263773  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:27.264039  3943 leader_election.cc:290] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:27.212095  4037 consensus_queue.cc:1048] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:59:27.265202  3867 consensus_queue.cc:1048] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:27.265765  4024 leader_election.cc:290] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:27.253430  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:27.267503  1571 raft_consensus.cc:2468] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 3.
I20260709 12:59:27.267686  4030 leader_election.cc:290] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:27.268365  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:27.268934  1571 raft_consensus.cc:2468] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 4.
I20260709 12:59:27.269683  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:27.270556  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:27.270488  3795 consensus_queue.cc:1048] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:27.271263  1571 raft_consensus.cc:3060] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:27.257320  3973 raft_consensus.cc:2749] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:27.272951  3323 raft_consensus.cc:2804] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:27.273042  3989 raft_consensus.cc:2749] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:27.273411  3323 raft_consensus.cc:493] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:27.221243  3927 consensus_queue.cc:1059] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:59:27.264310  1574 raft_consensus.cc:2468] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 2.
I20260709 12:59:27.274499  3927 raft_consensus.cc:3055] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:27.274830  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:27.274961  3927 raft_consensus.cc:740] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:27.275463  1574 raft_consensus.cc:2468] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 4.
I20260709 12:59:27.276285  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:27.276823  1574 raft_consensus.cc:2468] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 5.
I20260709 12:59:27.277688  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:27.278184  1574 raft_consensus.cc:2468] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 5.
I20260709 12:59:27.278703   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:27.278915  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:27.279377  1717 raft_consensus.cc:1240] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 3 LEADER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:59:27.279994  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 385) took 1393 ms. Trace:
I20260709 12:59:27.230020  3828 consensus_queue.cc:1048] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 12:59:27.259588  3831 raft_consensus.cc:3060] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:27.280340  1717 rpcz_store.cc:276] 0709 12:59:25.886186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:25.900647 (+ 14461us) service_pool.cc:224] Handling call
0709 12:59:27.278931 (+1378284us) spinlock_profiling.cc:243] Waited 3.2 ms on lock 0x7b5800196e98. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef296b71 00007fa9ef296a22 00007fa9f81afc09 00007fa9f7309ee0 00007fa9f73d30ab 00007fa9f73d3131 00007fa9f7394fc0 00007fa9f737f929 00007fa9f737f3d2 00007fa9f08f6bd4
0709 12:59:27.279109 (+   178us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:27.279761 (+   652us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:27.279940 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7349120}
I20260709 12:59:27.256901  4038 raft_consensus.cc:493] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:27.282441  4038 raft_consensus.cc:3060] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:27.273936  3323 raft_consensus.cc:3060] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:27.288661  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 69339.9us
I20260709 12:59:27.293494  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:27.293730  2294 leader_election.cc:304] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:27.294279  1650 raft_consensus.cc:2468] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 5.
I20260709 12:59:27.279979  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:27.290185  1569 raft_consensus.cc:2468] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 5.
I20260709 12:59:27.297827  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:27.301764  1725 raft_consensus.cc:2468] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 4.
I20260709 12:59:27.307024  1567 raft_consensus.cc:2393] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 4: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:27.307138  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:27.307744  1574 raft_consensus.cc:3060] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:27.256843  3920 raft_consensus.cc:493] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:27.309291  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:27.314776  1571 raft_consensus.cc:2468] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 6.
I20260709 12:59:27.316387  1567 raft_consensus.cc:2393] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 6: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
W20260709 12:59:27.324539  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:27.328801  2297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:27.372359  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 83419.1us
I20260709 12:59:27.373288  1615 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:27.276034  3927 consensus_queue.cc:260] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:27.382185  1570 raft_consensus.cc:2410] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:59:27.386919  4038 raft_consensus.cc:515] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:27.387574  1574 raft_consensus.cc:2468] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 7.
I20260709 12:59:27.388845  4041 raft_consensus.cc:2804] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:27.389293  4041 raft_consensus.cc:493] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:27.389649  4041 raft_consensus.cc:3060] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:27.317809  3920 raft_consensus.cc:3060] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:27.394237  3323 raft_consensus.cc:515] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:27.305226  3601 raft_consensus.cc:697] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
W20260709 12:59:27.398104  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 189991us
I20260709 12:59:27.399114  1542 leader_election.cc:304] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:27.399281  1615 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:27.308316  3943 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:27.304700  3955 consensus_queue.cc:1059] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.093s
I20260709 12:59:27.375257  1567 raft_consensus.cc:1275] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:27.396478  3323 leader_election.cc:290] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:27.406248  1542 leader_election.cc:304] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:27.438145  1542 leader_election.cc:304] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:59:27.440313  1542 leader_election.cc:304] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:27.441843  1542 leader_election.cc:304] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:27.443251  1542 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:27.402338  3973 raft_consensus.cc:2749] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:27.444730  1542 leader_election.cc:304] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:27.446530  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:27.447197  1542 leader_election.cc:304] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:27.444573  3919 raft_consensus.cc:2749] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:27.453146  1571 raft_consensus.cc:1275] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:27.403280  4024 raft_consensus.cc:2749] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:27.459687  1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58782 (request call id 390) took 1328 ms. Trace:
I20260709 12:59:27.403682  3843 raft_consensus.cc:2749] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:59:27.462246  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:27.461548  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 174014us
I20260709 12:59:27.464279  1571 raft_consensus.cc:1240] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:27.406210  3927 raft_consensus.cc:3060] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:27.466478  1615 leader_election.cc:304] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:27.460230  1718 rpcz_store.cc:276] 0709 12:59:26.119438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:26.119585 (+   147us) service_pool.cc:224] Handling call
0709 12:59:27.446380 (+1326795us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b5800196e98. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef296b71 00007fa9ef296a22 00007fa9f81afc09 00007fa9f7309ee0 00007fa9f73d30ab 00007fa9f73d3131 00007fa9f73810a0 00007fa9f7380984 00007fa9f08fb6d4 00007fa9f08fb662
0709 12:59:27.447269 (+   889us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":25188608}
I20260709 12:59:27.467255  1571 raft_consensus.cc:1240] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 1. Current term is 2. Ops: []
I20260709 12:59:27.469802  1542 leader_election.cc:304] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:27.470082  3955 raft_consensus.cc:2804] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:27.470649  3955 raft_consensus.cc:493] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:27.471133  3955 raft_consensus.cc:3060] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:27.461608  3733 raft_consensus.cc:2749] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:27.469817  1615 leader_election.cc:304] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:27.472343  2295 leader_election.cc:304] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:27.454608  3940 raft_consensus.cc:2804] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:27.447976  3905 raft_consensus.cc:2749] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:27.448081  4037 raft_consensus.cc:2749] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:27.445900  4014 raft_consensus.cc:3055] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:59:27.479117  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 190446us
I20260709 12:59:27.479486  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:27.405887  3864 consensus_queue.cc:1059] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.063s
W20260709 12:59:27.480927  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 187272us
I20260709 12:59:27.480922  1615 leader_election.cc:304] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:27.406304  3943 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:59:27.477006  3919 raft_consensus.cc:2749] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:27.480275  3733 raft_consensus.cc:2749] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:27.479449  3940 raft_consensus.cc:493] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:27.486299  4024 raft_consensus.cc:2749] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:27.486598  4014 raft_consensus.cc:740] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:27.493705  4033 raft_consensus.cc:2749] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:59:27.507875  2329 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32870 (request call id 213) took 4151 ms (client timeout 1576 ms). Trace:
W20260709 12:59:27.510905  2329 rpcz_store.cc:269] 0709 12:59:23.356693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:23.418474 (+ 61781us) service_pool.cc:224] Handling call
0709 12:59:27.507736 (+4089262us) spinlock_profiling.cc:243] Waited 2.78 s on lock 0x7b5400494b54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:27.507810 (+    74us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6393960192}
I20260709 12:59:27.496024  3965 raft_consensus.cc:2749] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:27.497815  3864 consensus_queue.cc:1243] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:59:27.462126  3601 consensus_queue.cc:237] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:27.513415  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 43712.7us
I20260709 12:59:27.499776  3940 raft_consensus.cc:3060] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:27.521451  3945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 216561bf1aef403280c36c1e716ca3ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:59:27.511219  1615 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:27.522567  1615 leader_election.cc:304] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:27.527316  3940 raft_consensus.cc:515] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:27.529822  3940 leader_election.cc:290] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:27.510063  4038 leader_election.cc:290] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:27.539495  1615 leader_election.cc:304] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:27.541227  1615 leader_election.cc:304] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:27.517688  2294 leader_election.cc:304] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
W20260709 12:59:27.548245  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 72155.3us
I20260709 12:59:27.549461  2295 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:27.549633  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:27.511945  4015 consensus_queue.cc:1048] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:59:27.550721  4014 consensus_queue.cc:260] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:27.551839  4014 raft_consensus.cc:3060] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:27.552014  3864 raft_consensus.cc:2804] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:27.552467  3864 raft_consensus.cc:493] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:27.552891  3864 raft_consensus.cc:3060] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:27.552724  3784 consensus_queue.cc:1048] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:27.554986  4002 raft_consensus.cc:2804] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:27.555408  4002 raft_consensus.cc:493] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:27.555732  4002 raft_consensus.cc:3060] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:27.529852  4043 log.cc:927] Time spent T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:59:27.557027  3871 consensus_queue.cc:1059] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 12:59:27.566116  3871 raft_consensus.cc:3055] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:27.566464  3871 raft_consensus.cc:740] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:27.567327  1542 leader_election.cc:304] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:27.567262  3871 consensus_queue.cc:260] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:27.568578  4061 raft_consensus.cc:2804] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:27.569435  4061 raft_consensus.cc:697] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:27.570420  4061 consensus_queue.cc:237] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:27.570817  3920 raft_consensus.cc:515] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:27.568454  3871 raft_consensus.cc:3060] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:27.572968  3920 leader_election.cc:290] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:27.573599  1721 raft_consensus.cc:1240] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:27.557319  4033 raft_consensus.cc:2804] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:27.574119  4033 raft_consensus.cc:493] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:27.574445  4033 raft_consensus.cc:3060] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:27.576918  4031 log.cc:927] Time spent T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.599s	user 0.003s	sys 0.000s
W20260709 12:59:27.579879  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.538705  3702 raft_consensus.cc:2804] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:27.582983  3940 consensus_queue.cc:1048] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:59:27.585366  3778 raft_consensus.cc:2749] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:59:27.590941  1568 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36640 (request call id 1762) took 3246 ms (client timeout 1800 ms). Trace:
W20260709 12:59:27.591325  1568 rpcz_store.cc:269] 0709 12:59:24.344227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:24.443160 (+ 98933us) service_pool.cc:224] Handling call
0709 12:59:27.590723 (+3147563us) spinlock_profiling.cc:243] Waited 647 ms on lock 0x7b54003f61d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:27.590856 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1488133376}
I20260709 12:59:27.592453  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:27.593051  1568 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6.
I20260709 12:59:27.593832  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:27.561040  4056 raft_consensus.cc:2804] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:27.586768  1542 leader_election.cc:400] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: Vote denied by peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473) with higher term. Message: Invalid argument: T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 6. Current term is 7.
I20260709 12:59:27.568148  3831 raft_consensus.cc:515] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:27.596995  3905 raft_consensus.cc:2749] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:27.589067  3943 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:27.586119  3702 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:27.597836  1542 leader_election.cc:403] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:59:27.570825  4041 raft_consensus.cc:515] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:27.617554  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:27.618767  1568 raft_consensus.cc:2410] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:59:27.625429  1568 raft_consensus.cc:1240] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:27.562978  4047 consensus_queue.cc:1048] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 12:59:27.626998  1542 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:27.629118  1542 leader_election.cc:304] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:27.615803  3702 raft_consensus.cc:3060] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:27.632973  3919 raft_consensus.cc:2749] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473) with higher term. Message: Invalid argument: T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 6. Current term is 7.
I20260709 12:59:27.633641  3905 raft_consensus.cc:2804] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:27.634055  3905 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:27.634387  3905 raft_consensus.cc:3060] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:27.641601  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 92251.6us
W20260709 12:59:27.646834  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:27.647603  1539 connection.cc:256] RPC call timeout handler was delayed by -1.9565145870000151s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2481s for a response
W20260709 12:59:27.647969  1539 connection.cc:256] RPC call timeout handler was delayed by -1.4627469640000186s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20270000000000002s for a response
I20260709 12:59:27.651057  2295 leader_election.cc:304] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 12:59:27.654458  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 94704.9us
I20260709 12:59:27.653169  1539 leader_election.cc:304] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:27.637925  3831 leader_election.cc:290] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:27.657938  1542 leader_election.cc:304] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:27.653448  2295 leader_election.cc:304] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:27.659358  3843 raft_consensus.cc:2749] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:27.664067  3843 raft_consensus.cc:2749] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:27.656394  4062 raft_consensus.cc:2749] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:59:27.669559  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 54413.7us
I20260709 12:59:27.646699  4041 leader_election.cc:290] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 12:59:27.673228  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 155603us
I20260709 12:59:27.676455  4002 raft_consensus.cc:515] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 12:59:27.678850  4002 leader_election.cc:290] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373)
I20260709 12:59:27.680105  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:27.681299  1718 raft_consensus.cc:1275] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:27.682507  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:27.682816  1575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 1767) took 2841 ms. Trace:
I20260709 12:59:27.683164  3955 raft_consensus.cc:515] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:27.670271  4063 raft_consensus.cc:2804] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:27.684726  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:27.685354  4063 raft_consensus.cc:697] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:27.686223  4063 consensus_queue.cc:237] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:27.687207  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:27.661537  3943 raft_consensus.cc:2804] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:27.688467  3943 raft_consensus.cc:697] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:27.688565  3955 leader_election.cc:290] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:27.689419  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:27.689484  3943 consensus_queue.cc:237] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:27.691967  2328 raft_consensus.cc:1275] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:59:27.692301  2328 pending_rounds.cc:85] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66: Aborting all ops after (but not including) 4
I20260709 12:59:27.692587  2328 pending_rounds.cc:107] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66: Aborting uncommitted NO_OP operation due to leader change: 2.5
W20260709 12:59:27.692742  1689 leader_election.cc:336] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Timed out: RequestConsensusVote RPC to 127.0.107.193:34373 timed out after 2.046s (SENT)
I20260709 12:59:27.692814  2328 raft_consensus.cc:2889] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:27.693279  1689 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:27.683212  1575 rpcz_store.cc:276] 0709 12:59:24.841312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:25.780732 (+939420us) service_pool.cc:224] Handling call
0709 12:59:27.594496 (+1813764us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:27.602666 (+  8170us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:59:27.602710 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:27.602773 (+    63us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:27.602835 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:27.602921 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:27.682663 (+ 79742us) spinlock_profiling.cc:243] Waited 1.81 s on lock 0x7b54003f61d0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23ba8ad 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:27.682761 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7765,"raft.queue_time_us":8391,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":2170,"spinlock_wait_cycles":4157209984}
W20260709 12:59:27.713882  4065 log.cc:927] Time spent T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:59:27.714504  1575 raft_consensus.cc:1275] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 12:59:27.720733  1575 pending_rounds.cc:85] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting all ops after (but not including) 3
I20260709 12:59:27.721428  1575 pending_rounds.cc:107] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:59:27.722182  1575 raft_consensus.cc:2889] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:27.717448  4033 raft_consensus.cc:515] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:27.725617  3831 raft_consensus.cc:2749] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:27.725914  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:27.726681  1642 raft_consensus.cc:2468] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 2.
I20260709 12:59:27.693156  3702 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:27.748471  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 55745.9us
I20260709 12:59:27.760541  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:27.761018  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:27.761240  1650 raft_consensus.cc:2468] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
I20260709 12:59:27.763679  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:27.764391  1650 raft_consensus.cc:2468] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 2.
I20260709 12:59:27.767292  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 12:59:27.775152  2297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.778149  1575 raft_consensus.cc:1275] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:27.784922  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:27.687181  3905 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:59:27.815060  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:27.853729  1569 raft_consensus.cc:1275] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:59:27.853969  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
W20260709 12:59:27.854619  1689 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:34373 timed out after 2.151s (SENT) [suppressed 34 similar messages]
I20260709 12:59:27.854624  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:27.855144  1648 raft_consensus.cc:1240] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 3 LEADER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:59:27.759217  3864 raft_consensus.cc:515] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:27.857954  1575 raft_consensus.cc:1275] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:59:27.858790  3864 leader_election.cc:290] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:27.864102  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37682 (request call id 410) took 1319 ms. Trace:
I20260709 12:59:27.854231  1569 pending_rounds.cc:85] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting all ops after (but not including) 4
I20260709 12:59:27.853775  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:27.859391  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:59:28.156760  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.873854  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:28.530421  1569 pending_rounds.cc:107] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:59:28.517669  1567 raft_consensus.cc:1275] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:28.530972  1570 rpcz_store.cc:276] 0709 12:59:26.545003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:27.170967 (+625964us) service_pool.cc:224] Handling call
0709 12:59:27.863876 (+692909us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b540024a4d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:27.864030 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":482740992}
I20260709 12:59:27.872363  1719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1853) took 2093 ms. Trace:
I20260709 12:59:27.926319  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:28.532373  1719 rpcz_store.cc:276] 0709 12:59:25.779124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:25.779243 (+   119us) service_pool.cc:224] Handling call
0709 12:59:25.786214 (+  6971us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:26.048201 (+261987us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:27.872139 (+1823938us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x7b540010ca54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:27.872307 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":600315648}
W20260709 12:59:27.868749  1725 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58782 (request call id 391) took 1741 ms (client timeout 1701 ms). Trace:
I20260709 12:59:28.533491  1648 raft_consensus.cc:2468] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 3.
W20260709 12:59:28.533653  1725 rpcz_store.cc:269] 0709 12:59:26.127479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:26.127597 (+   118us) service_pool.cc:224] Handling call
0709 12:59:27.223597 (+1096000us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b5800196e98. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef296b71 00007fa9ef296a22 00007fa9f81afc09 00007fa9f7309ee0 00007fa9f73d30ab 00007fa9f73d3131 00007fa9f73810a0 00007fa9f7380984 00007fa9f08fb6d4 00007fa9f08fb662
0709 12:59:27.868544 (+644947us) spinlock_profiling.cc:243] Waited 50 ms on lock 0x7b5400353754. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:27.868661 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":142702592}
I20260709 12:59:27.935325  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:59:27.881382  1473 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48478 (request call id 173) took 11744 ms (client timeout 15000 ms). Trace:
W20260709 12:59:28.517762  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 859864us
W20260709 12:59:28.044220  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.535609  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:28.535910  1542 leader_election.cc:304] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:28.535038  1575 pending_rounds.cc:85] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting all ops after (but not including) 5
I20260709 12:59:27.900990  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:59:28.521255  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:27.928505  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:28.529228  1650 raft_consensus.cc:2468] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
I20260709 12:59:28.134099  1615 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 12:59:27.910087  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 55489.3us
W20260709 12:59:28.538816  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 404829us
I20260709 12:59:28.530737  1644 raft_consensus.cc:2393] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 5: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:28.538300  1647 raft_consensus.cc:2393] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 4: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
W20260709 12:59:28.537683  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.023655  1573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36642 (request call id 2126) took 1034 ms. Trace:
I20260709 12:59:28.541576  1573 rpcz_store.cc:276] 0709 12:59:26.989128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:27.102004 (+112876us) service_pool.cc:224] Handling call
0709 12:59:28.023414 (+921410us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b54000aafd4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:28.023580 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":287401856}
I20260709 12:59:28.542636  1575 pending_rounds.cc:107] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:59:28.542989  1575 raft_consensus.cc:2889] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:28.543702  1575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 416) took 1254 ms. Trace:
I20260709 12:59:28.531996  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36642 (request call id 2142) took 1369 ms. Trace:
I20260709 12:59:28.545048  1567 rpcz_store.cc:276] 0709 12:59:27.162818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:27.696034 (+533216us) service_pool.cc:224] Handling call
0709 12:59:28.517331 (+821297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:28.531744 (+ 14413us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:28.531934 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:28.546497  1567 raft_consensus.cc:1240] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:59:27.930384  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:28.548094  1718 raft_consensus.cc:2376] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 4. Re-sending same reply.
I20260709 12:59:28.531569  1569 raft_consensus.cc:2889] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:59:28.538157  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.544051  1575 rpcz_store.cc:276] 0709 12:59:27.289576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:27.855742 (+566166us) service_pool.cc:224] Handling call
0709 12:59:27.857635 (+  1893us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:28.543495 (+685860us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:28.543655 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:28.374948   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:28.553263  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 412) took 1264 ms. Trace:
I20260709 12:59:28.553838  1569 rpcz_store.cc:276] 0709 12:59:27.288659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:27.715401 (+426742us) service_pool.cc:224] Handling call
0709 12:59:27.715733 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:28.553008 (+837275us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:28.553212 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:28.554979  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:28.556375  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 12:59:28.556730  1615 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:28.366423  3943 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.008s	sys 0.017s
I20260709 12:59:28.548264  1567 raft_consensus.cc:1240] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:28.569538  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 1785) took 1006 ms. Trace:
I20260709 12:59:28.570012  1567 rpcz_store.cc:276] 0709 12:59:27.562988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:28.547751 (+984763us) service_pool.cc:224] Handling call
0709 12:59:28.548066 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:28.569302 (+ 21236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:28.569487 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:28.571050  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:28.132354  4003 raft_consensus.cc:493] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:28.564042  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:28.565346  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:27.867301  3945 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:53290 (request call id 812) took 4087 ms. Trace:
I20260709 12:59:28.572960  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:27.891603  3905 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:59:28.560638  1615 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.573261  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:27.879931  1469 catalog_manager.cc:5697] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 2 to 3, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 3 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } }
I20260709 12:59:27.856091  3702 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:27.922616  4074 raft_consensus.cc:493] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:27.893144  4033 leader_election.cc:290] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:28.566619  1573 raft_consensus.cc:1275] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:59:28.588681  1573 pending_rounds.cc:85] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting all ops after (but not including) 6
I20260709 12:59:28.588979  1573 pending_rounds.cc:107] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:59:28.589234  1573 raft_consensus.cc:2889] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:28.589943  1573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 1783) took 1027 ms. Trace:
I20260709 12:59:28.590255  1573 rpcz_store.cc:276] 0709 12:59:27.562526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:28.542466 (+979940us) service_pool.cc:224] Handling call
0709 12:59:28.566141 (+ 23675us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:28.589697 (+ 23556us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:28.589882 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:28.591799  1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 409) took 1331 ms. Trace:
I20260709 12:59:28.594099  4037 raft_consensus.cc:2804] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:28.594532  4037 raft_consensus.cc:493] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:28.594862  4037 raft_consensus.cc:3060] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:28.575433  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:28.546553  3992 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:28.601684  3702 consensus_queue.cc:1059] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:28.602259  1572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 393) took 2076 ms. Trace:
I20260709 12:59:28.602735  3702 raft_consensus.cc:3055] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:28.603216  3702 raft_consensus.cc:740] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:28.550557  4001 raft_consensus.cc:2804] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:28.604111  3702 consensus_queue.cc:260] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:28.604732  4001 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:28.605189  4001 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:28.605355  3702 raft_consensus.cc:3060] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:28.569099  3943 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.875s	user 0.014s	sys 0.019s
W20260709 12:59:28.600447  2297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.578684  1567 raft_consensus.cc:3060] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:28.602613  1572 rpcz_store.cc:276] 0709 12:59:26.525483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:26.530177 (+  4694us) service_pool.cc:224] Handling call
0709 12:59:26.530412 (+   235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:26.980435 (+450023us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:28.602042 (+1621607us) spinlock_profiling.cc:243] Waited 449 ms on lock 0x7b5400245254. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:28.602199 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1033274112}
I20260709 12:59:28.609359  1575 raft_consensus.cc:3060] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:28.609423  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:28.613256  1576 raft_consensus.cc:3060] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:28.587216  1615 leader_election.cc:304] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:28.614672  1615 leader_election.cc:304] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:28.614665  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:28.609390  1469 catalog_manager.cc:5697] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } }
I20260709 12:59:28.592201  1721 rpcz_store.cc:276] 0709 12:59:27.260569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:27.260708 (+   139us) service_pool.cc:224] Handling call
0709 12:59:27.260990 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:27.574012 (+313022us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:28.591586 (+1017574us) spinlock_profiling.cc:243] Waited 312 ms on lock 0x7b54002aa8d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:28.591742 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":718544256}
I20260709 12:59:28.621325  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:28.621587  1572 raft_consensus.cc:1240] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:28.622081  1718 raft_consensus.cc:2393] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 6: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:59:28.621354  3605 consensus_queue.cc:1048] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:28.622951  1572 raft_consensus.cc:2955] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:59:28.608980  3943 raft_consensus.cc:493] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:28.633196  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:28.635860  2330 raft_consensus.cc:1275] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:28.636042  2327 raft_consensus.cc:1275] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:59:28.588019  4074 raft_consensus.cc:515] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:28.637969  1574 raft_consensus.cc:1275] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:59:28.638316  1574 pending_rounds.cc:85] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting all ops after (but not including) 1
I20260709 12:59:28.638551  1574 pending_rounds.cc:107] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:59:28.638768  1574 raft_consensus.cc:2889] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:28.638948  4074 leader_election.cc:290] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:28.639217  3795 consensus_queue.cc:1048] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:59:28.643180  4039 log.cc:927] Time spent T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 1.498s	user 0.012s	sys 0.018s
I20260709 12:59:28.580579  4003 raft_consensus.cc:515] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:27.876109  3993 raft_consensus.cc:2955] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 5 LEADER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
W20260709 12:59:28.535418  1473 rpcz_store.cc:269] 0709 12:59:16.137246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:16.137529 (+   283us) service_pool.cc:224] Handling call
0709 12:59:27.881133 (+11743604us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:20.452907 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:20.538037 (+ 85130us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:20.538070 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:59:20.538087 (+    17us) tablet.cc:662] Decoding operations
0709 12:59:20.854033 (+315946us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:20.854098 (+    65us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:20.854125 (+    27us) tablet.cc:685] Acquiring locks for 16 operations
0709 12:59:20.855336 (+  1211us) tablet.cc:701] Row locks acquired
0709 12:59:20.855355 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:59:20.855529 (+   174us) write_op.cc:270] Start()
0709 12:59:20.855637 (+   108us) write_op.cc:276] Timestamp: P: 1783601960855484 usec, L: 0
0709 12:59:20.855658 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:59:20.873160 (+ 17502us) log.cc:844] Serialized 6282 byte log entry
0709 12:59:22.138927 (+1265767us) op_driver.cc:464] REPLICATION: finished
0709 12:59:22.753695 (+614768us) write_op.cc:301] APPLY: starting
0709 12:59:22.753836 (+   141us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:22.811499 (+ 57663us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:22.816674 (+  5175us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:22.942121 (+125447us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:22.942484 (+   363us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 12:59:22.942564 (+    80us) write_op.cc:312] APPLY: finished
0709 12:59:22.943156 (+   592us) log.cc:844] Serialized 113 byte log entry
0709 12:59:22.943380 (+   224us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:22.943723 (+   343us) write_op.cc:454] Released schema lock
0709 12:59:22.943812 (+    89us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:22.944333 (+   521us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:22.944395 (+    62us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":147335,"reported_tablets":21,"child_traces":[["op",{"apply.queue_time_us":587837,"apply.run_cpu_time_us":6648,"apply.run_wall_time_us":190622,"num_ops":16,"prepare.queue_time_us":265090,"prepare.run_cpu_time_us":43201,"prepare.run_wall_time_us":808078,"raft.queue_time_us":148913,"raft.run_cpu_time_us":19250,"raft.run_wall_time_us":214860,"replication_time_us":1231873,"thread_start_us":591420,"threads_started":4,"wal-append.queue_time_us":897081,"wal-append.run_cpu_time_us":55979,"wal-append.run_wall_time_us":2187837}]]}
I20260709 12:59:28.625592  4033 raft_consensus.cc:2749] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:28.644441  1576 raft_consensus.cc:2468] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 3.
I20260709 12:59:28.620314  3673 raft_consensus.cc:2804] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:59:28.672307  1576 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37682 (request call id 403) took 2144 ms (client timeout 1637 ms). Trace:
W20260709 12:59:28.672784  1576 rpcz_store.cc:269] 0709 12:59:26.528113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:26.610424 (+ 82311us) service_pool.cc:224] Handling call
0709 12:59:28.604405 (+1993981us) spinlock_profiling.cc:243] Waited 6.76 ms on lock 0x7b5800011198. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef296b71 00007fa9ef296a22 00007fa9f81afc09 00007fa9f7309ee0 00007fa9f73d30ab 00007fa9f73d3131 00007fa9f73810a0 00007fa9f7380984 00007fa9f08fb6d4 00007fa9f08fb662
0709 12:59:28.672235 (+ 67830us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15542656}
I20260709 12:59:28.645648  1469 catalog_manager.cc:5697] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 3 to 4, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:28.578696  3945 rpcz_store.cc:276] 0709 12:59:23.780304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:23.780749 (+   445us) service_pool.cc:224] Handling call
0709 12:59:24.332428 (+551679us) ts_tablet_manager.cc:934] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66: Initiating tablet copy from peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
0709 12:59:27.491299 (+3158871us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:59:27.689788 (+198489us) tablet_metadata.cc:665] Metadata flushed
0709 12:59:27.689935 (+   147us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:59:27.866403 (+176468us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:59:27.866813 (+   410us) tablet_replica.cc:206] Creating consensus instance
0709 12:59:27.867167 (+   354us) ts_tablet_manager.cc:989] Replica registered.
0709 12:59:27.867223 (+    56us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":106837,"tablet-copy.queue_time_us":182304,"thread_start_us":479013,"threads_started":2}
I20260709 12:59:28.680487  1642 raft_consensus.cc:1275] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:59:28.681028  1642 pending_rounds.cc:85] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e: Aborting all ops after (but not including) 5
I20260709 12:59:28.681428  1642 pending_rounds.cc:107] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:59:28.681689  1642 raft_consensus.cc:2889] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:28.680469  1575 raft_consensus.cc:2468] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 5.
I20260709 12:59:28.683465  1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 1331) took 1758 ms. Trace:
I20260709 12:59:28.683926  1643 rpcz_store.cc:276] 0709 12:59:26.924700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:26.924841 (+   141us) service_pool.cc:224] Handling call
0709 12:59:26.933672 (+  8831us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:26.949232 (+ 15560us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:26.949267 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:26.967630 (+ 18363us) log.cc:844] Serialized 26 byte log entry
0709 12:59:27.140163 (+172533us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:27.140218 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:27.140314 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:28.642596 (+1502282us) spinlock_profiling.cc:243] Waited 2.57 ms on lock 0x7b4400022b4c. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef1f4c85 00007fa9ef1f56a2 00007fa9f1f671db 00007fa9f1f62aaf 00007fa9f1f5686e 00007fa9f1f55bb6 00007fa9f1f557d8 00007fa9f1f5f221 00007fa9f1f5f1d9 00007fa9f1f5f169
0709 12:59:28.656636 (+ 14040us) raft_consensus.cc:1685] finished
0709 12:59:28.656668 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:28.683401 (+ 26733us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15699,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":7078,"spinlock_wait_cycles":5903232,"thread_start_us":70981,"threads_started":1,"wal-append.queue_time_us":159663}
W20260709 12:59:28.696862  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 155704us
I20260709 12:59:28.698529  1689 leader_election.cc:304] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:28.700471  1539 leader_election.cc:304] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:59:28.725893  1539 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:59:28.646831  4056 raft_consensus.cc:493] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:28.738003  1576 raft_consensus.cc:1240] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:28.638852  4061 consensus_queue.cc:1048] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.096s
I20260709 12:59:28.630897  3943 raft_consensus.cc:515] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:28.746208  1469 catalog_manager.cc:5697] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 2 to 4, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:28.716243  3992 consensus_queue.cc:1059] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:59:28.731751  1539 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:28.736009  4073 raft_consensus.cc:2804] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:28.733642  4074 raft_consensus.cc:2804] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:28.737293  4056 raft_consensus.cc:3060] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:28.765362  1539 leader_election.cc:304] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:59:28.808032  1469 catalog_manager.cc:5697] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 2 to 3, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
W20260709 12:59:28.846351  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 81072.6us
I20260709 12:59:28.847636  1539 leader_election.cc:304] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:28.730940  4033 consensus_queue.cc:1048] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:59:28.851238  1539 leader_election.cc:304] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:28.852573  1539 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:28.854357  1539 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:28.855890  1575 pending_rounds.cc:85] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting all ops after (but not including) 3
I20260709 12:59:28.856320  1575 pending_rounds.cc:107] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:59:28.856653  1575 raft_consensus.cc:2889] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:28.815322  4073 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:28.818706  3702 consensus_queue.cc:1059] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.081s
I20260709 12:59:28.815454  3905 raft_consensus.cc:2749] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:28.897161  4073 raft_consensus.cc:3060] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:28.901168  4081 log.cc:927] Time spent T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:59:28.752708  3795 consensus_queue.cc:1048] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.110s
I20260709 12:59:28.752123  4037 raft_consensus.cc:515] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:28.856768  3965 raft_consensus.cc:2804] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:28.816461  4052 consensus_queue.cc:1048] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.088s
I20260709 12:59:28.900061  3919 raft_consensus.cc:2749] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:28.845714  4074 raft_consensus.cc:493] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:28.907218  3992 raft_consensus.cc:3055] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:28.912415  3905 raft_consensus.cc:2804] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:28.935164  3965 raft_consensus.cc:493] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:28.971876  1691 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:28.970567  3965 raft_consensus.cc:3060] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:28.962314  3919 raft_consensus.cc:3060] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:28.961894  3905 raft_consensus.cc:493] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:28.958379  3992 raft_consensus.cc:740] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:28.960075  4074 raft_consensus.cc:3060] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:28.960816  4001 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:28.993625  4003 leader_election.cc:290] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:28.997174  3905 raft_consensus.cc:3060] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:29.010874  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 474967us
I20260709 12:59:29.022042  1542 leader_election.cc:304] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:29.024058  1542 leader_election.cc:304] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
W20260709 12:59:29.074497  1614 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.016s	sys 0.028s
W20260709 12:59:29.077605  1614 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.017s	sys 0.028s
W20260709 12:59:29.002525  3940 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.922s	user 0.009s	sys 0.025s
I20260709 12:59:29.086242  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:29.088814  1646 raft_consensus.cc:1240] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 5. Current term is 6. Ops: []
W20260709 12:59:29.074644  4075 log.cc:927] Time spent T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.548s	user 0.000s	sys 0.005s
W20260709 12:59:29.091754  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:29.090607  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 1337) took 1345 ms. Trace:
I20260709 12:59:29.094568  1642 rpcz_store.cc:276] 0709 12:59:27.745758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:28.521744 (+775986us) service_pool.cc:224] Handling call
0709 12:59:28.522151 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:28.682089 (+159938us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:29.090389 (+408300us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b540030f554. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:29.090548 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":344987520}
I20260709 12:59:29.098222  1643 raft_consensus.cc:1275] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:59:29.099556  4079 log.cc:927] Time spent T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.572s	user 0.012s	sys 0.000s
I20260709 12:59:29.102596  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:29.103108  1571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36642 (request call id 2131) took 2033 ms. Trace:
I20260709 12:59:29.103488  1571 rpcz_store.cc:276] 0709 12:59:27.069342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:27.654005 (+584663us) service_pool.cc:224] Handling call
0709 12:59:27.654229 (+   224us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:27.785349 (+131120us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:27.785404 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:27.795454 (+ 10050us) log.cc:844] Serialized 26 byte log entry
0709 12:59:28.079220 (+283766us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:28.525106 (+445886us) log.cc:844] Serialized 14 byte log entry
0709 12:59:28.659204 (+134098us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:28.659301 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:28.958301 (+299000us) spinlock_profiling.cc:243] Waited 24.9 ms on lock 0x7b4400022b4c. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef1f4c85 00007fa9ef1f56a2 00007fa9f1f671db 00007fa9f1f62aaf 00007fa9f1f5686e 00007fa9f1f55bb6 00007fa9f1f557d8 00007fa9f1f5f221 00007fa9f1f5f1d9 00007fa9f1f5f169
0709 12:59:29.102793 (+144492us) raft_consensus.cc:1685] finished
0709 12:59:29.102915 (+   122us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:29.103048 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3226,"prepare.queue_time_us":445367,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":77830,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":193,"spinlock_wait_cycles":57352576,"thread_start_us":429914,"threads_started":3,"wal-append.queue_time_us":676009}
I20260709 12:59:29.105696  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:29.106385  1571 raft_consensus.cc:2376] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 3. Re-sending same reply.
I20260709 12:59:29.110632  1642 raft_consensus.cc:1240] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:59:29.113893  4083 consensus_queue.cc:1059] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:29.114697  1642 raft_consensus.cc:1240] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:29.115120  4083 raft_consensus.cc:493] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:29.118652  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:29.119472  1642 raft_consensus.cc:3060] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:29.127908  3945 tablet_copy_client.cc:806] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 0 data blocks...
I20260709 12:59:29.128747  3945 tablet_copy_client.cc:670] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Starting download of 1 WAL segments...
I20260709 12:59:29.129333  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:29.130110  1648 raft_consensus.cc:3060] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:29.133824  1574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 1772) took 2247 ms. Trace:
I20260709 12:59:29.134326  1574 rpcz_store.cc:276] 0709 12:59:26.886458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:27.388308 (+501850us) service_pool.cc:224] Handling call
0709 12:59:28.023634 (+635326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:28.681612 (+657978us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:29.132710 (+451098us) spinlock_profiling.cc:243] Waited 614 ms on lock 0x7b54000aafd4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:29.133572 (+   862us) spinlock_profiling.cc:243] Waited 627 ms on lock 0x7b54000aafd0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23ba8ad 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:29.133746 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2853619712}
I20260709 12:59:29.139839  1648 raft_consensus.cc:2468] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 3.
I20260709 12:59:29.142110  4003 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:29.142696  4003 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:29.150856  1649 raft_consensus.cc:1275] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:29.152632  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:29.153309  1649 raft_consensus.cc:3060] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:29.154114  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:29.154887  1647 raft_consensus.cc:3060] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:29.156394  1567 consensus_meta.cc:287] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.543s	user 0.009s	sys 0.000s
I20260709 12:59:29.156899  1567 raft_consensus.cc:2468] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6.
W20260709 12:59:29.085271  3940 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.005s	user 0.009s	sys 0.025s
I20260709 12:59:29.166174  1648 raft_consensus.cc:1240] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:29.169384  1646 raft_consensus.cc:1275] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:29.115716  4083 raft_consensus.cc:515] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:29.153278  3943 leader_election.cc:290] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:29.182576  1569 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.018s	sys 0.026s
W20260709 12:59:29.183148  1569 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.018s	sys 0.027s
W20260709 12:59:29.189864  1573 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.016s	sys 0.029s
W20260709 12:59:29.190443  1573 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.016s	sys 0.029s
I20260709 12:59:29.190853  1647 raft_consensus.cc:2468] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 4.
I20260709 12:59:29.191990  1642 raft_consensus.cc:2468] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 6.
I20260709 12:59:29.198001  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:29.198727  1644 raft_consensus.cc:3060] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Advancing to term 4
W20260709 12:59:29.204797  2295 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.019s	sys 0.079s
W20260709 12:59:29.205286  2295 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.019s	sys 0.079s
I20260709 12:59:29.217702  1651 raft_consensus.cc:1275] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:29.227252  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:29.227978  1646 raft_consensus.cc:2468] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 3.
I20260709 12:59:29.226816  1644 raft_consensus.cc:2468] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 4.
I20260709 12:59:29.231634  1645 raft_consensus.cc:1240] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:29.233531  1567 raft_consensus.cc:3055] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:29.234179  1567 raft_consensus.cc:740] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:29.190121  4003 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:29.242040  1572 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.047s	sys 0.053s
I20260709 12:59:29.152969  3992 consensus_queue.cc:260] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:29.243745  1572 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.047s	sys 0.053s
I20260709 12:59:29.235072  1567 consensus_queue.cc:260] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:29.246428  1567 raft_consensus.cc:3060] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:29.178021  3940 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:29.217711  4037 leader_election.cc:290] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:59:29.248445  1570 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.019s	sys 0.015s
W20260709 12:59:29.263091  1570 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.020s	sys 0.015s
W20260709 12:59:29.263486  1615 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.018s	sys 0.052s
W20260709 12:59:29.263867  1615 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.018s	sys 0.052s
W20260709 12:59:29.264178  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 589949us
W20260709 12:59:29.265336  1617 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.018s	sys 0.011s
W20260709 12:59:29.265748  1617 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.018s	sys 0.011s
I20260709 12:59:29.265833  1646 raft_consensus.cc:1275] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:59:29.266074  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 611499us
W20260709 12:59:29.276724  2297 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.006s	sys 0.026s
W20260709 12:59:29.277258  2297 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.006s	sys 0.027s
W20260709 12:59:29.277628  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 625674us
I20260709 12:59:29.239952  4085 raft_consensus.cc:2749] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:59:29.278484  3993 consensus_meta.cc:287] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.528s	user 0.005s	sys 0.006s
I20260709 12:59:29.306975  2297 leader_election.cc:304] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:29.318496  1574 raft_consensus.cc:1240] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:29.328996  1567 raft_consensus.cc:1275] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:59:29.329718  1567 pending_rounds.cc:85] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting all ops after (but not including) 5
I20260709 12:59:29.330273  1567 pending_rounds.cc:107] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:59:29.262483  4082 raft_consensus.cc:2749] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:59:29.349367  1568 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.017s	sys 0.051s
W20260709 12:59:29.352389  1689 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.014s	sys 0.049s
W20260709 12:59:29.410012  1568 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.017s	sys 0.052s
I20260709 12:59:29.411098  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36642 (request call id 2130) took 2421 ms. Trace:
I20260709 12:59:29.302039  4061 consensus_queue.cc:1048] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 12:59:29.411698  1568 rpcz_store.cc:276] 0709 12:59:26.989794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:27.629508 (+639714us) service_pool.cc:224] Handling call
0709 12:59:27.646195 (+ 16687us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:27.647752 (+  1557us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:27.647781 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:27.661231 (+ 13450us) log.cc:844] Serialized 26 byte log entry
0709 12:59:28.537168 (+875937us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:28.569350 (+ 32182us) log.cc:844] Serialized 14 byte log entry
0709 12:59:28.624441 (+ 55091us) spinlock_profiling.cc:243] Waited 5.38 ms on lock 0x7b18003b8a20. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef2ce3f3 00007fa9ef2d07c1 00007fa9ef2d0779 00007fa9ef2d0709 00007fa9ef2d06d1 00007fa9ef2cf9cd 000000000038f354 000000000038f199 00007fa9ef2b183a
0709 12:59:28.653811 (+ 29370us) spinlock_profiling.cc:243] Waited 4.13 ms on lock 0x7b18003b8a20. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef2b0e07 00007fa9f810bab9 00007fa9ef2cd69b 00007fa9ef2cb93f 00007fa9ef2cb455 00007fa9f23b3060 00007fa9f23c5716 00007fa9f23d6287 00007fa9f23d6208
0709 12:59:29.410651 (+756840us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:29.410763 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:29.410832 (+    69us) raft_consensus.cc:1685] finished
0709 12:59:29.410854 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:29.411025 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1162,"prepare.queue_time_us":31679,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":45033,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":16907,"spinlock_wait_cycles":21877760,"thread_start_us":978323,"threads_started":2,"wal-append.queue_time_us":894188}
I20260709 12:59:29.404676  4085 raft_consensus.cc:3055] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:29.411000  3928 consensus_queue.cc:1048] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:59:29.404935  4001 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:29.430697  1649 raft_consensus.cc:2468] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 5.
I20260709 12:59:29.432006  1642 raft_consensus.cc:1240] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:29.431669  4084 raft_consensus.cc:493] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:29.415851  4089 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
W20260709 12:59:29.410099  1689 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.014s	sys 0.049s
W20260709 12:59:29.442274  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 743763us
I20260709 12:59:29.279716  3940 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:29.358280  4091 raft_consensus.cc:493] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:29.447566  4091 raft_consensus.cc:515] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:29.374907  4087 raft_consensus.cc:2804] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:29.448953  3940 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:29.424247  4085 raft_consensus.cc:740] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:29.431061  4088 raft_consensus.cc:493] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:29.463351  4087 raft_consensus.cc:493] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:29.497788  1691 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:29.441175  3761 raft_consensus.cc:2749] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:29.428478  4003 consensus_queue.cc:1059] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.034s
W20260709 12:59:29.507658  1575 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.003s	sys 0.009s
W20260709 12:59:29.509079  1575 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.004s	sys 0.009s
I20260709 12:59:29.432485  3965 raft_consensus.cc:515] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:29.408564  1567 raft_consensus.cc:2889] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:59:29.501976  4063 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.978s	user 0.011s	sys 0.034s
W20260709 12:59:29.506170  4056 consensus_meta.cc:287] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.604s	user 0.008s	sys 0.003s
I20260709 12:59:29.450882  4001 consensus_queue.cc:1048] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.055s
I20260709 12:59:29.496389  3940 raft_consensus.cc:493] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
W20260709 12:59:29.521227  1690 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.788s	user 0.014s	sys 0.027s
I20260709 12:59:29.506560  4087 raft_consensus.cc:3060] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:29.451483  4084 raft_consensus.cc:515] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:29.537124  4099 raft_consensus.cc:3055] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:59:29.543462  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 519463us
W20260709 12:59:29.537134  4090 log.cc:927] Time spent T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 12:59:29.497807  4088 raft_consensus.cc:515] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:29.508157  4086 raft_consensus.cc:493] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:29.514933  4037 raft_consensus.cc:2804] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:59:29.539463  1690 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.014s	sys 0.028s
W20260709 12:59:29.561007  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 253981us
W20260709 12:59:29.560932  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:29.568567  2297 leader_election.cc:304] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:29.542834  4099 raft_consensus.cc:740] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
W20260709 12:59:29.574218  1688 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.890s	user 0.004s	sys 0.012s
W20260709 12:59:29.574697  1688 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.890s	user 0.004s	sys 0.012s
I20260709 12:59:29.539140  4056 raft_consensus.cc:515] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:29.545015  1542 leader_election.cc:304] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
W20260709 12:59:29.589534  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 44599.4us
W20260709 12:59:29.520833  4063 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.997s	user 0.011s	sys 0.035s
I20260709 12:59:29.461519  4089 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:29.556975  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:29.536377  3965 leader_election.cc:290] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:29.559692  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 1779) took 1998 ms. Trace:
I20260709 12:59:29.597572  1570 rpcz_store.cc:276] 0709 12:59:27.561345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:28.532395 (+971050us) service_pool.cc:224] Handling call
0709 12:59:28.557692 (+ 25297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:28.557947 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:59:28.574199 (+ 16252us) log.cc:844] Serialized 14 byte log entry
0709 12:59:29.559220 (+985021us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:29.559287 (+    67us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:29.559357 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:29.559445 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:29.559614 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46550,"prepare.queue_time_us":35899,"prepare.run_cpu_time_us":22,"prepare.run_wall_time_us":22,"raft.queue_time_us":177513,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":3636,"thread_start_us":948950,"threads_started":2,"wal-append.queue_time_us":993049}
W20260709 12:59:29.519241  2332 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.018s	sys 0.022s
W20260709 12:59:29.587908  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 320939us
W20260709 12:59:29.600417  2332 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.019s	sys 0.022s
W20260709 12:59:29.534288  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:29.569579  3943 raft_consensus.cc:493] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:29.546012  3940 raft_consensus.cc:515] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:29.537168  4083 leader_election.cc:290] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:29.607692  4083 consensus_queue.cc:1048] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:29.609894  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 12:59:29.606899  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 264213us
I20260709 12:59:29.610778  1542 leader_election.cc:304] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:29.637506  1720 raft_consensus.cc:1275] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:29.638767  2294 leader_election.cc:304] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4
W20260709 12:59:29.640682  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:29.586625  4122 raft_consensus.cc:3060] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:29.598404  4074 consensus_meta.cc:287] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.595s	user 0.008s	sys 0.003s
I20260709 12:59:29.644932  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
W20260709 12:59:29.646310  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 46078us
I20260709 12:59:29.647783  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:29.637275  3761 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:29.667376  2328 raft_consensus.cc:2468] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6.
I20260709 12:59:29.651938  4100 consensus_queue.cc:1059] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:59:29.644240  3905 consensus_meta.cc:287] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.559s	user 0.010s	sys 0.000s
I20260709 12:59:29.652710  3965 raft_consensus.cc:3060] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:29.651829  4115 raft_consensus.cc:493] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:29.651789  4093 consensus_queue.cc:1048] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:29.567375  4086 raft_consensus.cc:515] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:29.654263  3992 raft_consensus.cc:3060] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:29.694114  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 215583us
W20260709 12:59:29.654315  4102 log.cc:927] Time spent T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:59:29.654446  2294 leader_election.cc:304] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
W20260709 12:59:29.699844  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 45480.5us
W20260709 12:59:29.655328  4095 log.cc:927] Time spent T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
W20260709 12:59:29.656307  4105 log.cc:927] Time spent T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 12:59:29.656512  3673 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.976s	user 0.011s	sys 0.027s
W20260709 12:59:29.657191  4109 log.cc:927] Time spent T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:59:29.657671  4106 consensus_queue.cc:1059] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:29.658951  4092 consensus_queue.cc:1048] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:29.661674  4037 raft_consensus.cc:493] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:29.571504  4097 consensus_queue.cc:1059] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 12:59:29.594158  4098 raft_consensus.cc:2749] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:59:29.669165  1539 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.004s	sys 0.019s
W20260709 12:59:29.755414  1539 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.004s	sys 0.019s
I20260709 12:59:29.652338  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:29.663005  4064 raft_consensus.cc:2804] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:59:29.685961  2295 connection.cc:256] RPC call timeout handler was delayed by -1.1372708499999931s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2081s for a response
I20260709 12:59:29.696822  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:59:29.709476  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 122998us
W20260709 12:59:29.721000  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 455736us
I20260709 12:59:29.733381  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:29.560973  4085 consensus_queue.cc:260] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:29.610556  3943 raft_consensus.cc:515] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:29.676342  4074 raft_consensus.cc:515] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:29.665187  4063 consensus_queue.cc:1048] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:59:29.675962  4103 consensus_queue.cc:1048] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.086s
W20260709 12:59:29.746409  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 61543.1us
I20260709 12:59:29.791864  1568 raft_consensus.cc:1275] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:59:29.792310  1568 pending_rounds.cc:85] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting all ops after (but not including) 2
W20260709 12:59:29.743851  3673 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.064s	user 0.012s	sys 0.027s
W20260709 12:59:29.749713  1689 leader_election.cc:336] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Timed out: RequestConsensusVote RPC to 127.0.107.193:34373 timed out after 1.576s (SENT)
I20260709 12:59:29.680941  3761 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:29.778120  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:29.733345  4110 raft_consensus.cc:493] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:29.770854  1615 leader_election.cc:304] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:29.696117  3905 raft_consensus.cc:515] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:29.771747  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:29.763312  3993 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:57908 (request call id 18) took 14112 ms. Trace:
I20260709 12:59:29.793170  1688 leader_election.cc:304] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:29.789589  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:29.786496  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:29.789589  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:29.755740  4037 raft_consensus.cc:3060] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:29.802763  1689 leader_election.cc:304] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:29.807394  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:29.823414  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:29.823851  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:29.825039  1724 raft_consensus.cc:2410] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:59:29.808962  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:29.826447  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:29.827129  1567 raft_consensus.cc:2468] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 3.
I20260709 12:59:29.828101  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:29.829329  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:29.830605  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:29.831851  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:29.770208  4064 raft_consensus.cc:493] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:29.833226  4064 raft_consensus.cc:3060] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:29.838099  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:29.838701  1570 raft_consensus.cc:1240] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:29.775588  4101 raft_consensus.cc:3055] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:59:29.840116  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 93960us
I20260709 12:59:29.840806  1576 raft_consensus.cc:2393] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 4: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
W20260709 12:59:29.841115  1689 leader_election.cc:336] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Timed out: RequestConsensusVote RPC to 127.0.107.193:34373 timed out after 1.620s (SENT)
W20260709 12:59:29.842167  4127 log.cc:927] Time spent T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 12:59:29.842242  4084 leader_election.cc:290] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:29.843214  4094 log.cc:927] Time spent T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.179s	user 0.000s	sys 0.000s
I20260709 12:59:29.841796  1689 leader_election.cc:304] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:29.818879  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:29.873669  1575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 1800) took 1245 ms. Trace:
I20260709 12:59:29.785952  4129 raft_consensus.cc:2804] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:29.859804  1646 raft_consensus.cc:1240] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:29.840364  1540 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:29.777966  4098 raft_consensus.cc:493] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:29.869078  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:29.832477  1567 raft_consensus.cc:3060] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:29.748222  4100 consensus_queue.cc:1048] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.054s
I20260709 12:59:29.806953  4085 raft_consensus.cc:3060] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:29.874214  1575 rpcz_store.cc:276] 0709 12:59:28.628025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:28.761476 (+133451us) service_pool.cc:224] Handling call
0709 12:59:28.855685 (+ 94209us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:28.866474 (+ 10789us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:28.866520 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:28.867027 (+   507us) log.cc:844] Serialized 26 byte log entry
0709 12:59:29.509980 (+642953us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:29.510112 (+   132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:29.510287 (+   175us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:29.873438 (+363151us) raft_consensus.cc:1685] finished
0709 12:59:29.873465 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:29.873606 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":596786,"threads_started":1,"wal-append.queue_time_us":659765}
I20260709 12:59:29.792630  1568 pending_rounds.cc:107] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:59:29.876189  1573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 1787) took 2312 ms. Trace:
I20260709 12:59:29.811486  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:29.871785  4084 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:29.843230  3905 leader_election.cc:290] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:29.801963  3673 raft_consensus.cc:697] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 5 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:29.909718  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:29.699060  4115 raft_consensus.cc:515] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:29.913575  4061 consensus_queue.cc:1048] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:59:29.913720  4124 raft_consensus.cc:493] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:29.945760  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 105474us
W20260709 12:59:29.945390  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 244476us
I20260709 12:59:29.845453  4101 raft_consensus.cc:740] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:29.845152  4110 raft_consensus.cc:515] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:29.876044  4118 consensus_queue.cc:1059] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.293s
I20260709 12:59:29.744285  4099 consensus_queue.cc:260] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:59:30.282395  1576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37682 (request call id 417) took 1267 ms. Trace:
I20260709 12:59:29.954236  1568 raft_consensus.cc:2889] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:30.311669  1576 rpcz_store.cc:276] 0709 12:59:29.014575 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:29.014734 (+   159us) service_pool.cc:224] Handling call
0709 12:59:30.282141 (+1267407us) spinlock_profiling.cc:243] Waited 754 ms on lock 0x7b54002ec2d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:30.282319 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1733403520}
W20260709 12:59:30.313180  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:30.313555  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 12:59:30.137562  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 366744us
I20260709 12:59:30.088236  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:30.315428  1575 raft_consensus.cc:2468] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 2.
W20260709 12:59:29.971462  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 177066us
I20260709 12:59:30.333184  1615 leader_election.cc:304] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 12:59:30.107219  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:30.128456  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 335346us
I20260709 12:59:30.638631  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 12:59:30.406430  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 73354.3us
W20260709 12:59:30.389211  3992 consensus_meta.cc:287] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.684s	user 0.009s	sys 0.000s
W20260709 12:59:30.335282  4122 consensus_meta.cc:287] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.656s	user 0.004s	sys 0.005s
I20260709 12:59:30.508253  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:30.597296  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 359) took 1401 ms. Trace:
I20260709 12:59:30.171684  4100 raft_consensus.cc:2804] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:30.641844  4100 raft_consensus.cc:697] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 5 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:30.335474  4124 raft_consensus.cc:515] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:30.639954  1570 raft_consensus.cc:2393] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 3: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:30.376549  4138 raft_consensus.cc:493] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.088698  4116 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.159825  4052 consensus_queue.cc:1048] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.487s
I20260709 12:59:30.647042  4138 raft_consensus.cc:515] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:30.380728   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:59:30.282369  4087 consensus_meta.cc:287] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.741s	user 0.008s	sys 0.002s
I20260709 12:59:30.503930  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:29.949318  4129 raft_consensus.cc:697] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:30.378966  1571 raft_consensus.cc:2468] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 5.
I20260709 12:59:30.156289  4131 consensus_queue.cc:1059] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.726s
I20260709 12:59:30.640607  4122 raft_consensus.cc:2749] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:59:30.315575  3965 consensus_meta.cc:287] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.622s	user 0.009s	sys 0.000s
I20260709 12:59:29.935271  4104 consensus_queue.cc:1059] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.765s
I20260709 12:59:30.588440  4136 raft_consensus.cc:493] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.545693  4135 raft_consensus.cc:493] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:30.378744  4074 leader_election.cc:290] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:30.342986  4084 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:59:30.129825  4097 raft_consensus.cc:3055] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:30.644143  4100 consensus_queue.cc:237] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 12:59:30.647324  4116 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:30.802449  1719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 419) took 1188 ms. Trace:
W20260709 12:59:30.525018  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 211631us
I20260709 12:59:30.339093  1572 raft_consensus.cc:2393] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 4: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
W20260709 12:59:30.337916  2295 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.001s	sys 0.016s
W20260709 12:59:30.804435  2295 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.982s	user 0.007s	sys 0.025s
I20260709 12:59:30.035050  1567 raft_consensus.cc:2468] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 6.
W20260709 12:59:30.804826  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 982944us
I20260709 12:59:30.805017  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36642 (request call id 2151) took 1007 ms. Trace:
W20260709 12:59:30.186160  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:30.641738  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:30.805692  1567 rpcz_store.cc:276] 0709 12:59:29.797925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:29.831594 (+ 33669us) service_pool.cc:224] Handling call
0709 12:59:30.804958 (+973364us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:30.806316  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:30.806424  1576 raft_consensus.cc:2468] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 7.
W20260709 12:59:30.806838  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 965664us
W20260709 12:59:30.538570  1648 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.834s	user 0.001s	sys 0.021s
I20260709 12:59:30.175031  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 1786) took 2611 ms. Trace:
W20260709 12:59:30.404422  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 64878.4us
I20260709 12:59:30.641287  1647 rpcz_store.cc:276] 0709 12:59:29.195601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:29.195733 (+   132us) service_pool.cc:224] Handling call
0709 12:59:29.196150 (+   417us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:29.217308 (+ 21158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:29.217359 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:29.217825 (+   466us) log.cc:844] Serialized 26 byte log entry
0709 12:59:29.596630 (+378805us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:29.596694 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:29.596780 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:30.596994 (+1000214us) raft_consensus.cc:1685] finished
0709 12:59:30.597030 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:30.597210 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":157469,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":45505,"thread_start_us":316066,"threads_started":1,"wal-append.queue_time_us":1257863}
I20260709 12:59:30.652038  1575 raft_consensus.cc:2393] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 6: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:29.954371  1573 rpcz_store.cc:276] 0709 12:59:27.563409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:28.591027 (+1027618us) service_pool.cc:224] Handling call
0709 12:59:28.591353 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:28.612988 (+ 21635us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:28.613017 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:28.613453 (+   436us) log.cc:844] Serialized 26 byte log entry
0709 12:59:29.190959 (+577506us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:29.191024 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:29.191110 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:29.875965 (+684855us) raft_consensus.cc:1685] finished
0709 12:59:29.875987 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:29.876131 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21300,"raft.queue_time_us":30592,"raft.run_cpu_time_us":69,"raft.run_wall_time_us":69,"thread_start_us":569559,"threads_started":1,"wal-append.queue_time_us":886945}
W20260709 12:59:30.807605  1648 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.103s	user 0.006s	sys 0.023s
I20260709 12:59:30.383427  1722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 400) took 3917 ms. Trace:
I20260709 12:59:30.377489  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:30.041963  4056 leader_election.cc:290] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:29.943158  4098 raft_consensus.cc:515] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:30.296098  4089 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:31.051005  4033 raft_consensus.cc:493] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:31.244035  1574 raft_consensus.cc:1275] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:59:30.808033  1569 rpcz_store.cc:276] 0709 12:59:27.563198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:28.577664 (+1014466us) service_pool.cc:224] Handling call
0709 12:59:28.578841 (+  1177us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:29.183665 (+604824us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:29.183709 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:29.184279 (+   570us) log.cc:844] Serialized 26 byte log entry
0709 12:59:29.568674 (+384395us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:29.568714 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:29.568794 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:30.174789 (+605995us) raft_consensus.cc:1685] finished
0709 12:59:30.174812 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:30.174967 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":40759,"raft.run_cpu_time_us":67,"raft.run_wall_time_us":67,"thread_start_us":919906,"threads_started":2,"wal-append.queue_time_us":788246,"wal-append.run_cpu_time_us":1869,"wal-append.run_wall_time_us":1117421}
I20260709 12:59:31.244410  1574 pending_rounds.cc:85] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting all ops after (but not including) 2
I20260709 12:59:31.244839  1574 pending_rounds.cc:107] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:59:31.245105  1574 raft_consensus.cc:2889] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:31.245153  4098 leader_election.cc:290] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:30.803251  1719 rpcz_store.cc:276] 0709 12:59:29.614180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:29.616070 (+  1890us) service_pool.cc:224] Handling call
0709 12:59:29.653506 (+ 37436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:29.771548 (+118042us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:29.771576 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:29.789506 (+ 17930us) log.cc:844] Serialized 26 byte log entry
0709 12:59:30.086621 (+297115us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:30.086690 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:30.086801 (+   111us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:30.802182 (+715381us) raft_consensus.cc:1685] finished
0709 12:59:30.802206 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:30.802385 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44785,"raft.queue_time_us":133151,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":18319,"thread_start_us":343763,"threads_started":2,"wal-append.queue_time_us":704044}
W20260709 12:59:30.157069  4112 log.cc:927] Time spent T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.247s	user 0.000s	sys 0.001s
I20260709 12:59:31.246276  1722 rpcz_store.cc:276] 0709 12:59:26.465493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:26.492943 (+ 27450us) service_pool.cc:224] Handling call
0709 12:59:26.493181 (+   238us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:26.509577 (+ 16396us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:59:26.609573 (+ 99996us) log.cc:844] Serialized 14 byte log entry
0709 12:59:28.595053 (+1985480us) spinlock_profiling.cc:243] Waited 1.84 ms on lock 0x7b18003cc7c0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9f1f634bc 00007fa9ef2b148b 00007fa9f810bab9 00007fa9ef2cd69b 00007fa9ef2cb93f 00007fa9ef2cdc02 00007fa9f1f5520b 00007fa9f1f5ad23 00007fa9f1f5b23a
0709 12:59:29.006471 (+411418us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:29.013393 (+  6922us) log.cc:844] Serialized 26 byte log entry
0709 12:59:29.506400 (+493007us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:29.506459 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:29.506568 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:30.383046 (+876478us) raft_consensus.cc:1685] finished
0709 12:59:30.383159 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:30.383336 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":187654,"prepare.queue_time_us":76493,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":55,"raft.queue_time_us":590120,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":39963,"spinlock_wait_cycles":4226560,"thread_start_us":1180670,"threads_started":3,"wal-append.queue_time_us":1671664,"wal-append.run_cpu_time_us":1774,"wal-append.run_wall_time_us":1099126}
I20260709 12:59:31.248106  1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45148 (request call id 1963) took 2144 ms. Trace:
I20260709 12:59:30.826433  1572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36642 (request call id 2157) took 1026 ms. Trace:
W20260709 12:59:30.174885  4107 log.cc:927] Time spent T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.470s	user 0.000s	sys 0.001s
I20260709 12:59:30.831421  1575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36642 (request call id 2160) took 1019 ms. Trace:
I20260709 12:59:30.398881  3673 consensus_queue.cc:237] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:31.248728  1643 rpcz_store.cc:276] 0709 12:59:29.103933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:29.105651 (+  1718us) service_pool.cc:224] Handling call
0709 12:59:29.106040 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:29.106381 (+   341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:29.106413 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:29.106932 (+   519us) log.cc:844] Serialized 26 byte log entry
0709 12:59:29.561474 (+454542us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:29.561513 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:29.561578 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:31.247862 (+1686284us) raft_consensus.cc:1685] finished
0709 12:59:31.247889 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:31.248037 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":157944,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":14624,"thread_start_us":443781,"threads_started":1,"wal-append.queue_time_us":667627}
I20260709 12:59:31.251092  1575 rpcz_store.cc:276] 0709 12:59:29.813018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:30.316276 (+503258us) service_pool.cc:224] Handling call
0709 12:59:30.831344 (+515068us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:30.144642  3940 leader_election.cc:290] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:31.180120  4116 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:30.400694  4101 consensus_queue.cc:260] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:31.194677  4156 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:29.840958  3993 rpcz_store.cc:276] 0709 12:59:15.630805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:16.013729 (+382924us) service_pool.cc:224] Handling call
0709 12:59:17.358532 (+1344803us) log.cc:844] Serialized 506 byte log entry
0709 12:59:17.784126 (+425594us) spinlock_profiling.cc:243] Waited 859 ms on lock 0x7b54001748d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23c1735 00007fa9f7381d29 00007fa9f09001d4 00007fa9f0900162 00007fa9f0900091 00007fa9f090000c 00007fa9f08ff2c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:18.019985 (+235859us) spinlock_profiling.cc:243] Waited 1.38 ms on lock 0x7b180009e9e0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef248c0a 00007fa9f8988219 00007fa9f628f58f 00007fa9ef2ce571 00007fa9ef2d07c1 00007fa9ef2d0779 00007fa9ef2d0709 00007fa9ef2d06d1 00007fa9ef2cf9cd
0709 12:59:29.718881 (+11698896us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":292601,"raft.queue_time_us":105660,"raft.run_cpu_time_us":18775,"raft.run_wall_time_us":202858,"spinlock_wait_cycles":1979379200}
I20260709 12:59:31.253935  4101 raft_consensus.cc:3060] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:31.254014  4156 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:30.057884  4093 raft_consensus.cc:493] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:31.255223  4093 raft_consensus.cc:515] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:30.379709  4134 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:31.249596  4115 leader_election.cc:290] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:31.257296  4093 leader_election.cc:290] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:31.257078  4134 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:30.172967  4103 raft_consensus.cc:2804] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:31.199271  4074 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:31.258587  4074 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:31.259423  4134 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:30.182305  4091 leader_election.cc:290] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:30.651199  3919 consensus_meta.cc:287] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 1.654s	user 0.011s	sys 0.002s
I20260709 12:59:30.808635  4097 raft_consensus.cc:740] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
W20260709 12:59:30.345198  4073 consensus_meta.cc:287] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 1.413s	user 0.007s	sys 0.006s
I20260709 12:59:30.280586  4148 raft_consensus.cc:2749] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:31.261363  4073 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:30.921137  4136 raft_consensus.cc:515] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:31.260867  4138 leader_election.cc:290] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:30.924722  3905 raft_consensus.cc:493] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:31.264001  3905 raft_consensus.cc:515] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:31.264701  4136 leader_election.cc:290] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:30.172756  4088 leader_election.cc:290] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:31.005646  1645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 367) took 1763 ms. Trace:
I20260709 12:59:30.802484  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 12:59:31.060563  1691 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:30.659869  1617 leader_election.cc:304] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:30.926391  4162 raft_consensus.cc:493] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:31.267823  4162 raft_consensus.cc:515] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:31.268740  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:31.268416  4097 consensus_queue.cc:260] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:31.269769  1572 rpcz_store.cc:276] 0709 12:59:29.799867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:29.873355 (+ 73488us) service_pool.cc:224] Handling call
0709 12:59:30.826353 (+952998us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:31.270218  4162 leader_election.cc:290] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:31.270421  1574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36642 (request call id 2147) took 1482 ms. Trace:
I20260709 12:59:30.310601  4086 leader_election.cc:290] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:30.639397  4085 raft_consensus.cc:493] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:31.270963  1574 rpcz_store.cc:276] 0709 12:59:29.788169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:29.788283 (+   114us) service_pool.cc:224] Handling call
0709 12:59:29.788577 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:31.245573 (+1456996us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:31.270211 (+ 24638us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b54000ab4d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:31.270369 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3346052992}
I20260709 12:59:31.272758  4085 raft_consensus.cc:515] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:30.164690  3761 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:30.405328  3943 leader_election.cc:290] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:30.548064  4143 raft_consensus.cc:493] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:31.275230  4085 leader_election.cc:290] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:30.547751  4142 raft_consensus.cc:493] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:30.312758  4113 raft_consensus.cc:493] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:31.278568  4142 raft_consensus.cc:515] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:31.278870  4113 raft_consensus.cc:515] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:29.953899  4123 consensus_queue.cc:1059] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 1.367s
I20260709 12:59:30.650767  4087 raft_consensus.cc:515] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:30.960772  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:30.293606  4064 raft_consensus.cc:515] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:30.738063  3992 raft_consensus.cc:493] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:31.265870  1645 rpcz_store.cc:276] 0709 12:59:29.242487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:29.242627 (+   140us) service_pool.cc:224] Handling call
0709 12:59:29.279094 (+ 36467us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:29.597413 (+318319us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:29.597937 (+   524us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:29.598398 (+   461us) log.cc:844] Serialized 26 byte log entry
0709 12:59:30.029736 (+431338us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:30.029796 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:30.029892 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:31.005323 (+975431us) raft_consensus.cc:1685] finished
0709 12:59:31.005353 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:31.005556 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":257155,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":122,"thread_start_us":722623,"threads_started":2,"wal-append.queue_time_us":1169987}
I20260709 12:59:30.824496  4099 raft_consensus.cc:3060] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:30.931639  1648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 357) took 1743 ms. Trace:
I20260709 12:59:31.260780  3919 raft_consensus.cc:2749] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:30.926209  4131 raft_consensus.cc:3055] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:59:31.237149  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 433972us
I20260709 12:59:30.142733  4082 raft_consensus.cc:2804] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:30.968453  4104 raft_consensus.cc:3055] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:30.378563  4118 raft_consensus.cc:3055] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:59:30.807528  1689 leader_election.cc:336] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Timed out: RequestConsensusVote RPC to 127.0.107.193:34373 timed out after 1.695s (SENT)
I20260709 12:59:31.280927  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:31.275467  4143 raft_consensus.cc:515] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:30.922562  1571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36642 (request call id 2149) took 1133 ms. Trace:
I20260709 12:59:31.280180  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:31.245882  4098 raft_consensus.cc:493] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:31.290115  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 484635us
W20260709 12:59:31.290679  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 481095us
I20260709 12:59:31.292498  1720 raft_consensus.cc:1240] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:30.379287  3945 tablet_copy_client.cc:538] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:59:30.156155  4121 consensus_queue.cc:1048] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 1.141s
I20260709 12:59:30.406795  4125 raft_consensus.cc:2804] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:30.801425  4160 raft_consensus.cc:493] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:31.302737  1568 raft_consensus.cc:2468] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 4.
I20260709 12:59:31.303629  1648 rpcz_store.cc:276] 0709 12:59:29.188431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:29.188624 (+   193us) service_pool.cc:224] Handling call
0709 12:59:29.189040 (+   416us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:29.189464 (+   424us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:29.189497 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:29.220809 (+ 31312us) log.cc:844] Serialized 26 byte log entry
0709 12:59:29.669497 (+448688us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:30.811088 (+1141591us) log.cc:844] Serialized 14 byte log entry
0709 12:59:30.931238 (+120150us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:30.931334 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:30.931390 (+    56us) raft_consensus.cc:1685] finished
0709 12:59:30.931408 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:30.931569 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1084548,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":527,"raft.queue_time_us":475831,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":25942,"thread_start_us":1632818,"threads_started":3,"wal-append.queue_time_us":1020298}
W20260709 12:59:30.749004  4037 consensus_meta.cc:287] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.877s	user 0.011s	sys 0.000s
I20260709 12:59:30.377357  4110 leader_election.cc:290] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:30.337441  4106 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.002s	sys 0.012s
I20260709 12:59:30.925115  4154 consensus_queue.cc:1048] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.530s
I20260709 12:59:30.727475  4003 consensus_queue.cc:1048] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.655s
I20260709 12:59:30.921512  4135 raft_consensus.cc:515] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:31.573062  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 913214us
W20260709 12:59:31.506028  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:31.584213  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:31.584616  1617 leader_election.cc:304] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:30.540445  4133 raft_consensus.cc:2749] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:59:31.492318  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 50630.2us
I20260709 12:59:31.582775  1689 leader_election.cc:304] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:31.326500  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 12:59:31.616750  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 809193us
I20260709 12:59:31.616958  1575 raft_consensus.cc:2468] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 4.
I20260709 12:59:31.618185  2295 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:31.607713  1572 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:31.553184  1615 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:31.290766  3965 raft_consensus.cc:2749] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:31.583568  1571 rpcz_store.cc:276] 0709 12:59:29.789304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:29.789403 (+    99us) service_pool.cc:224] Handling call
0709 12:59:30.922319 (+1132916us) spinlock_profiling.cc:243] Waited 556 ms on lock 0x7b5400312c54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:30.922485 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1279721728}
W20260709 12:59:31.362980  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:31.545753  4165 log.cc:927] Time spent T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
W20260709 12:59:31.623894  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:31.288453  4074 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:31.617394  1689 leader_election.cc:336] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Timed out: RequestConsensusVote RPC to 127.0.107.193:34373 timed out after 1.721s (SENT)
W20260709 12:59:31.548579  4161 log.cc:927] Time spent T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
W20260709 12:59:31.630452  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 45949.1us
I20260709 12:59:31.295595  4156 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:31.624496  1688 leader_election.cc:304] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:31.634060  1688 leader_election.cc:304] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:31.300889  4142 leader_election.cc:290] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:31.549291  4064 leader_election.cc:290] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:31.547617  4087 leader_election.cc:290] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:31.567235  4088 raft_consensus.cc:493] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:31.365022  4086 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:31.464251  4123 raft_consensus.cc:3055] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:31.442195  4103 raft_consensus.cc:697] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 3 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:31.636165  4138 raft_consensus.cc:2764] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:59:31.636394  4147 raft_consensus.cc:2749] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:31.317586  3992 raft_consensus.cc:515] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:31.585657  4104 raft_consensus.cc:740] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:31.364648  4162 raft_consensus.cc:493] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:31.635020  1617 leader_election.cc:304] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:31.673167  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:31.673949  1617 leader_election.cc:304] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:31.675513  3702 raft_consensus.cc:2749] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:31.544945  4167 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:31.677078  4167 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:31.605299  4091 raft_consensus.cc:493] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:31.547369  4174 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:31.619367  4082 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:31.616456  4131 raft_consensus.cc:740] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:31.463569  4153 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:31.638517  4085 raft_consensus.cc:2804] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:31.632889  4171 consensus_queue.cc:1048] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:59:31.639606  1688 leader_election.cc:304] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66
W20260709 12:59:31.687635  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 48359.8us
I20260709 12:59:31.582759  4118 raft_consensus.cc:740] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:31.623354  4136 raft_consensus.cc:2749] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:31.623188  3943 raft_consensus.cc:493] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:31.623512  4093 raft_consensus.cc:493] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:31.482815  4134 consensus_queue.cc:1048] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.157s
I20260709 12:59:31.624960  4125 raft_consensus.cc:697] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 6 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:31.709066  1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 416) took 2095 ms. Trace:
I20260709 12:59:31.687148  4082 raft_consensus.cc:3060] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:31.243978  4033 raft_consensus.cc:515] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:31.306102  3928 consensus_queue.cc:1059] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.337s
I20260709 12:59:31.631453  4110 raft_consensus.cc:493] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:31.655846  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:31.656397  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:59:31.657099  1568 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36642 (request call id 2159) took 1856 ms (client timeout 2095 ms). Trace:
I20260709 12:59:31.657514  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:31.657735  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:31.628839  4116 raft_consensus.cc:493] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:31.399298  4084 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:31.305226  4122 consensus_queue.cc:1048] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.340s
I20260709 12:59:31.669505  1572 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7.
I20260709 12:59:31.628983  4001 consensus_queue.cc:1048] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:59:31.616894  4037 raft_consensus.cc:515] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:31.316494  4151 consensus_queue.cc:1059] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.342s
I20260709 12:59:31.615980  4098 raft_consensus.cc:515] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:31.644845  4133 raft_consensus.cc:2804] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:31.644837  4156 raft_consensus.cc:493] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:31.528326  4129 consensus_queue.cc:237] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:31.684264  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:31.684341  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:31.316075  4149 raft_consensus.cc:2764] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 12:59:31.679796  4091 raft_consensus.cc:515] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:31.650455  4123 raft_consensus.cc:740] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:31.688982  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:31.705185  3943 raft_consensus.cc:515] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:31.756609  4033 leader_election.cc:290] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:31.756405  4156 raft_consensus.cc:515] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:31.757375  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:31.757853  3943 leader_election.cc:290] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:31.758176  1717 raft_consensus.cc:2410] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:59:31.758482  4156 leader_election.cc:290] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:31.689477  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 82169.3us
I20260709 12:59:31.758870  3992 leader_election.cc:290] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:31.746798  4103 consensus_queue.cc:237] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:31.759680  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:31.760159  4168 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:31.701498  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:31.685740  1689 leader_election.cc:336] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Timed out: RequestConsensusVote RPC to 127.0.107.193:34373 timed out after 2.022s (SENT)
W20260709 12:59:31.704774  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 79205.1us
I20260709 12:59:31.615787  4160 raft_consensus.cc:515] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:31.649662  4088 raft_consensus.cc:515] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:31.651475  1648 raft_consensus.cc:1240] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:31.688587  4174 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:31.760793  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:59:31.756356  4175 log.cc:927] Time spent T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:59:31.706568  1617 leader_election.cc:304] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:31.780643  1650 raft_consensus.cc:2410] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 12:59:31.781148  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 74670.5us
I20260709 12:59:31.752094  4084 raft_consensus.cc:3055] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:31.781512  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:31.781780  4084 raft_consensus.cc:740] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:31.782182  1650 raft_consensus.cc:2468] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 4.
I20260709 12:59:31.782445  1617 leader_election.cc:304] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:31.782660  4135 leader_election.cc:290] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:31.783030  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:31.661123  4064 consensus_queue.cc:1048] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:59:31.710022  1721 rpcz_store.cc:276] 0709 12:59:29.613266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:29.642981 (+ 29715us) service_pool.cc:224] Handling call
0709 12:59:29.674192 (+ 31211us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:29.755012 (+ 80820us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:29.755076 (+    64us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:29.776935 (+ 21859us) log.cc:844] Serialized 26 byte log entry
0709 12:59:30.182639 (+405704us) spinlock_profiling.cc:243] Waited 2.4 ms on lock 0x7b18003cc940. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef2b0e07 00007fa9f810bab9 00007fa9ef2cd69b 00007fa9ef2cb93f 00007fa9ef2cdc02 00007fa9f1f5520b 00007fa9f1f5ad23 00007fa9f1f5b0d1 00007fa9f2376a0f
0709 12:59:30.560116 (+377477us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:30.560177 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:30.560277 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:31.704047 (+1143770us) raft_consensus.cc:1685] finished
0709 12:59:31.704068 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:31.709002 (+  4934us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":169614,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":14355,"spinlock_wait_cycles":5510912,"thread_start_us":457436,"threads_started":2,"wal-append.queue_time_us":1479352}
I20260709 12:59:31.654460  4086 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:59:31.739727  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:31.740216  1651 raft_consensus.cc:2393] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 4: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 12:59:31.740821  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:31.741575  1646 raft_consensus.cc:3060] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:31.741777  1649 raft_consensus.cc:3060] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:31.784478  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:31.788596  1689 leader_election.cc:304] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:31.689854  4148 raft_consensus.cc:2804] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:31.703172  4085 raft_consensus.cc:697] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 4 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:31.745940  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:31.800292  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:31.749807  1642 raft_consensus.cc:2393] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 3: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:59:31.802052  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:31.802784  1643 raft_consensus.cc:2393] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 7: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:31.802667  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:31.683758  4162 raft_consensus.cc:515] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:31.715552  4106 consensus_queue.cc:1059] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:59:31.755702  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:31.715422  4131 consensus_queue.cc:260] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:31.743216  4104 consensus_queue.cc:260] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 12:59:31.689762  4153 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:31.783326  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:31.785085  1650 raft_consensus.cc:2468] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 3.
W20260709 12:59:31.789042  2297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:31.742285  1644 raft_consensus.cc:2393] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 7: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:31.797556  2332 raft_consensus.cc:2468] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 3.
W20260709 12:59:31.708699  4172 log.cc:927] Time spent T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.267s	user 0.001s	sys 0.000s
I20260709 12:59:31.803565  1651 raft_consensus.cc:3060] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:31.783245  4156 raft_consensus.cc:2749] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:59:31.754863  1691 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:31.804513  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 118805us
I20260709 12:59:31.749249  4124 leader_election.cc:290] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:31.781365  4174 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:31.782653  4084 consensus_queue.cc:260] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:31.745981  4116 raft_consensus.cc:515] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:31.798301  3992 raft_consensus.cc:2749] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:31.784488  3702 raft_consensus.cc:2764] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:59:31.783712  4133 raft_consensus.cc:697] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 6 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:31.756374  4167 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:31.760746  4168 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:59:31.746093  4110 raft_consensus.cc:515] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:31.709846  4093 raft_consensus.cc:515] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:31.669107  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 118263us
W20260709 12:59:31.741021  1568 rpcz_store.cc:269] 0709 12:59:29.800467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:30.313222 (+512755us) service_pool.cc:224] Handling call
0709 12:59:31.656954 (+1343732us) spinlock_profiling.cc:243] Waited 965 ms on lock 0x7b54003b9054. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:31.657047 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2220549376}
I20260709 12:59:31.790459  1615 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 12:59:31.804747  1617 connection.cc:256] RPC call timeout handler was delayed by -1.7408632660000194s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1553s for a response
W20260709 12:59:32.023137  1542 leader_election.cc:336] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.994s (SENT)
W20260709 12:59:32.023500  1617 connection.cc:256] RPC call timeout handler was delayed by -1.5986632660000168s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17110000000000003s for a response
W20260709 12:59:32.023999  1617 connection.cc:256] RPC call timeout handler was delayed by -1.2899632660000293s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2054s for a response
W20260709 12:59:32.024514  1617 connection.cc:256] RPC call timeout handler was delayed by -1.2638632659999871s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20830000000000004s for a response
W20260709 12:59:32.024658  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 234122us
W20260709 12:59:32.024991  1617 connection.cc:256] RPC call timeout handler was delayed by -1.2224632660000339s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2129s for a response
W20260709 12:59:32.025900  1617 connection.cc:256] RPC call timeout handler was delayed by -1.1459632660000239s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2214s for a response
W20260709 12:59:31.914067  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 203663us
W20260709 12:59:31.886404  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 106284us
I20260709 12:59:31.888520  1649 raft_consensus.cc:2410] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:59:32.033113  2295 leader_election.cc:304] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:31.927359  1689 leader_election.cc:304] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 12:59:32.039271  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 111894us
W20260709 12:59:31.914927  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:31.807331  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:59:31.970415  4101 consensus_meta.cc:287] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.688s	user 0.010s	sys 0.000s
I20260709 12:59:31.957851  4113 leader_election.cc:290] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:31.923619  4104 raft_consensus.cc:3060] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:31.918473  4097 raft_consensus.cc:3060] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:31.973114  4168 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:31.917133  4084 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:31.919935  4153 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:32.074709  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:31.961702  4110 leader_election.cc:290] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:31.939956  4143 leader_election.cc:290] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:31.878170  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:31.875314  4125 consensus_queue.cc:237] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:31.955880  4098 leader_election.cc:290] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:32.080734  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:32.080623  4198 raft_consensus.cc:2749] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:31.971722  4093 leader_election.cc:290] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:31.957094  4162 leader_election.cc:290] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:31.909194  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:31.877493  4037 leader_election.cc:290] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:31.812512  4138 raft_consensus.cc:493] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.083616  4138 raft_consensus.cc:515] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:31.971355  4151 raft_consensus.cc:3055] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:32.084766  4151 raft_consensus.cc:740] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
W20260709 12:59:32.085610  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:31.888865  4149 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:32.084151  1542 leader_election.cc:336] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.027s (SENT)
I20260709 12:59:32.073323  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:32.069734  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:32.019737  1540 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:32.056777  1648 raft_consensus.cc:3060] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:32.067080  3702 raft_consensus.cc:2749] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:32.115801  4124 consensus_queue.cc:1059] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:32.114187  1542 leader_election.cc:304] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:31.956265  4160 leader_election.cc:290] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:31.954983  4073 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:31.955341  4181 log.cc:927] Time spent T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 12:59:31.954466  4088 leader_election.cc:290] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:31.969653  4086 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:31.910115  4147 consensus_queue.cc:1048] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.258s
I20260709 12:59:32.109005  4151 consensus_queue.cc:260] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:31.944602  4085 consensus_queue.cc:237] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:32.207372  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 12:59:32.449875  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 233001us
I20260709 12:59:31.874814  4091 leader_election.cc:290] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:31.960959  4083 raft_consensus.cc:3055] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:32.451493  4083 raft_consensus.cc:740] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:32.172911  1650 raft_consensus.cc:1240] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 3. Current term is 4. Ops: []
W20260709 12:59:32.124974  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 105715us
W20260709 12:59:32.249240  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 60916.4us
I20260709 12:59:31.910893  4131 raft_consensus.cc:3060] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:31.941254  4123 consensus_queue.cc:260] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:32.453920  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 279003us
I20260709 12:59:31.921162  4133 consensus_queue.cc:237] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:31.808288  4135 raft_consensus.cc:2749] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:31.888661  4148 raft_consensus.cc:697] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 5 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
W20260709 12:59:32.477664  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 393573us
I20260709 12:59:32.207463  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 12:59:32.479339  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:32.403810  4037 raft_consensus.cc:2804] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:32.207830  4098 raft_consensus.cc:2749] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:32.175933  4171 consensus_queue.cc:1048] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.314s
I20260709 12:59:32.180812  4149 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:32.264673  4064 raft_consensus.cc:2804] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:59:32.485661  4037 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:32.492568  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:32.492777  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:32.495486  4138 leader_election.cc:290] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:32.505856  1568 raft_consensus.cc:1240] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:59:32.173481  4184 consensus_queue.cc:1048] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.349s
I20260709 12:59:32.511289  2324 raft_consensus.cc:2393] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 4: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 12:59:32.511214  4064 raft_consensus.cc:697] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
W20260709 12:59:32.517434  4205 log.cc:927] Time spent T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 12:59:32.520377  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:32.521229  1644 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 4.
I20260709 12:59:32.522246  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:32.523401  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:32.177520  4136 consensus_queue.cc:1048] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.328s
I20260709 12:59:32.504989  4037 raft_consensus.cc:3060] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:32.255301  4168 consensus_queue.cc:1048] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.340s
W20260709 12:59:32.530042  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:32.260890  4169 consensus_queue.cc:1048] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.265s
I20260709 12:59:32.531339  1648 raft_consensus.cc:2468] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 4.
I20260709 12:59:32.181133  4155 consensus_queue.cc:1048] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.333s
I20260709 12:59:32.556373  1572 raft_consensus.cc:1240] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 5. Current term is 6. Ops: []
W20260709 12:59:32.564813  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 68493.2us
I20260709 12:59:32.581158  1644 raft_consensus.cc:1240] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 3. Current term is 4. Ops: []
W20260709 12:59:32.578877  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 390219us
W20260709 12:59:32.588951  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 52990.5us
W20260709 12:59:32.584748  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 420753us
I20260709 12:59:32.564637  3945 tablet_bootstrap.cc:492] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap starting.
W20260709 12:59:32.582962  4195 log.cc:927] Time spent T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.555s	user 0.004s	sys 0.000s
I20260709 12:59:32.651037  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:32.651696  2328 raft_consensus.cc:1240] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:32.651823  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:32.652812  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:32.653129  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:32.653479  2324 raft_consensus.cc:2468] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 6.
I20260709 12:59:32.654388  4212 raft_consensus.cc:493] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.654541  4124 consensus_queue.cc:1059] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:32.655103  4212 raft_consensus.cc:515] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:32.656011  4124 raft_consensus.cc:3055] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:32.656407  4124 raft_consensus.cc:740] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:32.657737  4212 leader_election.cc:290] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:32.658329  4124 consensus_queue.cc:260] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:32.541711  4064 consensus_queue.cc:237] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:32.602617  4154 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.001s	sys 0.013s
W20260709 12:59:32.663394  1646 consensus_meta.cc:287] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.838s	user 0.009s	sys 0.010s
W20260709 12:59:32.661230  1651 consensus_meta.cc:287] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.719s	user 0.013s	sys 0.002s
W20260709 12:59:32.666369  1649 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.000s	sys 0.013s
W20260709 12:59:32.669243  1649 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.000s	sys 0.014s
I20260709 12:59:32.670972  1572 raft_consensus.cc:1275] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:59:32.669348  1617 leader_election.cc:336] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.054s (SENT)
I20260709 12:59:32.677296  4149 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:32.677824  1651 raft_consensus.cc:2468] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6.
I20260709 12:59:32.679119  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:59:32.679616  4082 consensus_meta.cc:287] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.938s	user 0.007s	sys 0.007s
I20260709 12:59:32.680146  4082 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:32.681192  1642 raft_consensus.cc:1240] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:32.681620  1646 raft_consensus.cc:2468] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6.
I20260709 12:59:32.682282  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 1360) took 1026 ms. Trace:
I20260709 12:59:32.682549  4082 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:32.683175  4084 consensus_meta.cc:287] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.609s	user 0.009s	sys 0.002s
I20260709 12:59:32.682659  1646 rpcz_store.cc:276] 0709 12:59:31.655697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:31.657519 (+  1822us) service_pool.cc:224] Handling call
0709 12:59:32.682206 (+1024687us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:32.683753  1569 raft_consensus.cc:1240] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:59:32.685160  4148 consensus_queue.cc:237] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:32.687290  1651 raft_consensus.cc:1240] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 5 LEADER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:59:32.688877  1651 raft_consensus.cc:1240] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:59:32.690579  1643 raft_consensus.cc:1240] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:32.701957  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:32.703352  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:32.704450  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:32.713025  1643 raft_consensus.cc:2410] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:59:32.728420  1689 leader_election.cc:304] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 12:59:32.729785  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:32.730370  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:32.730641  4085 raft_consensus.cc:2749] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:32.731645  4085 consensus_queue.cc:1048] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:32.731868  1689 leader_election.cc:304] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:32.738376  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:32.739461  1651 raft_consensus.cc:2468] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 5.
I20260709 12:59:32.725328  4124 raft_consensus.cc:3060] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:32.731673  4214 raft_consensus.cc:493] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:32.769276  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 123597us
I20260709 12:59:32.773485  4084 raft_consensus.cc:2804] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:32.788596  4084 raft_consensus.cc:493] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:32.788864  1572 raft_consensus.cc:1240] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:32.789216  4084 raft_consensus.cc:3060] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:32.791131  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:32.791986  1573 raft_consensus.cc:2468] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 4.
I20260709 12:59:32.792811  4214 raft_consensus.cc:515] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:32.781073  1689 leader_election.cc:304] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:32.811496  1649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 372) took 1047 ms. Trace:
I20260709 12:59:32.811966  1649 rpcz_store.cc:276] 0709 12:59:31.763604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:32.034235 (+270631us) service_pool.cc:224] Handling call
0709 12:59:32.035208 (+   973us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:32.036021 (+   813us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:32.036060 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:32.041576 (+  5516us) log.cc:844] Serialized 26 byte log entry
0709 12:59:32.669813 (+628237us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:32.669865 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:32.669940 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:32.811281 (+141341us) raft_consensus.cc:1685] finished
0709 12:59:32.811300 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:32.811430 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4897,"raft.queue_time_us":27842,"raft.run_cpu_time_us":476,"raft.run_wall_time_us":86439,"thread_start_us":627656,"threads_started":1,"wal-append.queue_time_us":682644}
I20260709 12:59:32.813664  4082 raft_consensus.cc:493] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:32.814493  4082 raft_consensus.cc:515] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:32.818375  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:32.819465  1572 raft_consensus.cc:2468] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 6.
I20260709 12:59:32.823002  2294 leader_election.cc:304] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
W20260709 12:59:32.824745  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 83048.4us
I20260709 12:59:32.825450  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:32.870618  1722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 425) took 1602 ms. Trace:
I20260709 12:59:32.874250  4214 leader_election.cc:290] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:32.891607  1722 rpcz_store.cc:276] 0709 12:59:31.267640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:31.277379 (+  9739us) service_pool.cc:224] Handling call
0709 12:59:31.277680 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:31.886003 (+608323us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:59:32.028949 (+142946us) log.cc:844] Serialized 14 byte log entry
0709 12:59:32.129531 (+100582us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:32.159103 (+ 29572us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:32.453813 (+294710us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:32.826497 (+372684us) spinlock_profiling.cc:243] Waited 608 ms on lock 0x7b54002a99d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:32.826572 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:32.870345 (+ 43773us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":47114,"prepare.queue_time_us":67158,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":57,"raft.queue_time_us":45257,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":158,"spinlock_wait_cycles":1398200576,"thread_start_us":165802,"threads_started":2,"wal-append.queue_time_us":150097}
I20260709 12:59:32.893993  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
W20260709 12:59:32.887964  1542 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 3.142s (SENT) [suppressed 39 similar messages]
I20260709 12:59:32.872318  3905 leader_election.cc:290] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:32.872809  4106 raft_consensus.cc:2749] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:59:32.871328  4220 log.cc:927] Time spent T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
W20260709 12:59:32.825783  4097 consensus_meta.cc:287] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.666s	user 0.006s	sys 0.008s
I20260709 12:59:32.900892  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:32.913578  1572 raft_consensus.cc:1240] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 5. Current term is 6. Ops: []
W20260709 12:59:32.924851  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 180412us
W20260709 12:59:32.932178  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 44256.5us
I20260709 12:59:32.930616  4168 raft_consensus.cc:493] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.910377  1573 raft_consensus.cc:1240] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:32.904033  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 12:59:32.941623  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 132712us
W20260709 12:59:32.910871  4229 log.cc:927] Time spent T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.117s	user 0.001s	sys 0.001s
I20260709 12:59:32.914696  4106 raft_consensus.cc:493] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.914059  4131 raft_consensus.cc:493] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:32.898092  4155 raft_consensus.cc:2749] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:32.948905  2324 raft_consensus.cc:3060] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:32.953830  4171 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:32.954092  4131 raft_consensus.cc:515] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:32.954519  4171 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:32.955588  4168 raft_consensus.cc:515] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:32.957188  1688 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:32.958802  4168 leader_election.cc:290] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:32.959112  4133 raft_consensus.cc:493] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:32.960632  4085 raft_consensus.cc:2804] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:32.952483  1716 raft_consensus.cc:2468] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 4.
I20260709 12:59:32.965481  4085 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:32.974947  4085 raft_consensus.cc:3060] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:32.997524  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 1804) took 1719 ms. Trace:
I20260709 12:59:32.998271  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:32.999543  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:33.000209  1570 raft_consensus.cc:2468] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 3.
I20260709 12:59:33.001217  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:33.002537  1570 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 4.
I20260709 12:59:32.951692  4106 raft_consensus.cc:515] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:33.003428  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:32.997946  1569 rpcz_store.cc:276] 0709 12:59:31.277870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:31.280618 (+  2748us) service_pool.cc:224] Handling call
0709 12:59:31.308331 (+ 27713us) spinlock_profiling.cc:243] Waited 2.34 ms on lock 0x7b5800011198. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef296b71 00007fa9ef296eee 0000000000375939 00007fa9f730a1e0 00007fa9f73d30c4 00007fa9f73d3131 00007fa9f7394fc0 00007fa9f737f929 00007fa9f737f3d2 00007fa9f08f6bd4
0709 12:59:31.308565 (+   234us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:32.684224 (+1375659us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:32.997207 (+312983us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b540024a4d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:32.997449 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3166898432}
I20260709 12:59:33.005861  4106 leader_election.cc:290] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:33.006150  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 375) took 1241 ms. Trace:
I20260709 12:59:33.006762  1570 raft_consensus.cc:2468] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6.
I20260709 12:59:33.006613  1642 rpcz_store.cc:276] 0709 12:59:31.764466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:32.079669 (+315203us) service_pool.cc:224] Handling call
0709 12:59:32.680811 (+601142us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:32.681626 (+   815us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:33.005991 (+324365us) spinlock_profiling.cc:243] Waited 600 ms on lock 0x7b54002b3750. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23ba8ad 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:33.006100 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1381144448}
I20260709 12:59:33.008404  4122 consensus_queue.cc:1059] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:33.009219  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:33.006798  4106 consensus_queue.cc:1048] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:32.986604  2297 leader_election.cc:304] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 12:59:32.956394  4131 leader_election.cc:290] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:33.005913  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:33.021127  1569 raft_consensus.cc:2393] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 4: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
W20260709 12:59:33.022943  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 69395.3us
I20260709 12:59:32.956418  4171 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 12:59:33.024449  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 58477.4us
W20260709 12:59:33.029130  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 76758.8us
I20260709 12:59:33.028833  2324 raft_consensus.cc:2468] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 7.
I20260709 12:59:33.036899  2330 raft_consensus.cc:1275] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:59:33.048616  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:33.063118  2327 raft_consensus.cc:1240] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:59:33.067859  1576 raft_consensus.cc:2393] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 6: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:33.034102  4145 raft_consensus.cc:3055] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:33.070858  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:33.071702  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:59:33.036639  4037 consensus_meta.cc:287] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.503s	user 0.011s	sys 0.003s
I20260709 12:59:33.060907  3905 consensus_queue.cc:1059] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.015s
I20260709 12:59:33.026046  4133 raft_consensus.cc:515] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:33.070564  4145 raft_consensus.cc:740] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:33.025173  4084 raft_consensus.cc:515] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:33.076469  1615 leader_election.cc:304] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:33.081652  1688 leader_election.cc:304] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:33.090865  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:33.109318  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 12:59:33.078142  4197 log.cc:927] Time spent T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 1.142s	user 0.003s	sys 0.000s
W20260709 12:59:33.116102  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:33.117009  1643 raft_consensus.cc:2468] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 5.
I20260709 12:59:33.083024  4219 raft_consensus.cc:2804] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:33.119374  1649 raft_consensus.cc:2468] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 3.
I20260709 12:59:33.126938  1539 leader_election.cc:304] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:33.136819  4169 raft_consensus.cc:2804] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:33.130472  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:33.084406  4148 consensus_queue.cc:1059] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:59:33.137971  1615 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:33.137454  4169 raft_consensus.cc:493] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:33.150430  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 76262.9us
I20260709 12:59:33.111874  4037 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:33.152012  1573 raft_consensus.cc:1240] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:33.150575  4169 raft_consensus.cc:3060] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:33.130728  4219 raft_consensus.cc:493] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:33.161139  2325 raft_consensus.cc:2468] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6.
I20260709 12:59:33.169027  1719 raft_consensus.cc:2410] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 for term 7 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:59:33.162845  1576 raft_consensus.cc:2468] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 3.
I20260709 12:59:33.091933  4145 consensus_queue.cc:260] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:33.179288  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:33.180831  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:33.181499  1724 raft_consensus.cc:1240] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 4 LEADER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:33.181841  1717 raft_consensus.cc:2468] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 2.
I20260709 12:59:33.182798  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:33.183113  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:33.183584  1724 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
I20260709 12:59:33.162271  4219 raft_consensus.cc:3060] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:33.189842  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:59:33.192868  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 78374.4us
I20260709 12:59:33.196210  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:33.200700  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:33.151774  4085 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
W20260709 12:59:33.239579  2297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:33.198004  1615 leader_election.cc:304] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:33.189188  4149 raft_consensus.cc:2804] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:33.234829  1539 leader_election.cc:304] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:33.248695  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:33.242874  4241 raft_consensus.cc:3055] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:33.255345  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:33.242931  3905 raft_consensus.cc:2804] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:33.256902  4241 raft_consensus.cc:740] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:33.262219  1722 raft_consensus.cc:2376] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5. Re-sending same reply.
I20260709 12:59:33.265035  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:33.264740  4241 consensus_queue.cc:260] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:33.262558  3905 raft_consensus.cc:493] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:33.265861  3905 raft_consensus.cc:3060] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:33.266108  1721 raft_consensus.cc:2410] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:59:33.266223  4241 raft_consensus.cc:3060] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:33.267205  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:59:33.268679  4228 log.cc:927] Time spent T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 12:59:33.269311  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:33.270077  1725 raft_consensus.cc:3060] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:33.271255  4133 leader_election.cc:290] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:33.272296  4238 raft_consensus.cc:2804] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:33.272751  1717 raft_consensus.cc:2393] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 4: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:59:33.272918  4238 raft_consensus.cc:493] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:33.265105  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:33.274019  1722 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 7.
I20260709 12:59:33.275336  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:33.275127  3905 raft_consensus.cc:515] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:33.275758  1722 raft_consensus.cc:1275] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:59:33.276072  1724 raft_consensus.cc:2468] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 3.
I20260709 12:59:33.279023  3905 leader_election.cc:290] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:33.273415  4238 raft_consensus.cc:3060] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:33.268430  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 12:59:33.285200  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 151897us
I20260709 12:59:33.297464  4246 raft_consensus.cc:2749] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:33.298398  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:33.299435  1723 raft_consensus.cc:2393] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 6: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:59:33.303948  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:33.306236  1722 raft_consensus.cc:2410] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:59:33.302394  4084 leader_election.cc:290] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:33.365415  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 61892.4us
W20260709 12:59:33.366494  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 192348us
I20260709 12:59:33.369493  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:59:33.367702  4248 log.cc:927] Time spent T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
W20260709 12:59:33.373634  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 138943us
I20260709 12:59:33.348464  4037 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:33.387720  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:33.395342  1722 raft_consensus.cc:2468] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
I20260709 12:59:33.392930  1723 raft_consensus.cc:2468] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 7.
I20260709 12:59:33.400780  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:33.409127  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:33.410105  1723 raft_consensus.cc:2468] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
I20260709 12:59:33.411953  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:33.414964  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:33.416179  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:33.415408  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:33.417423  1615 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:33.416873  1722 raft_consensus.cc:2468] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6.
I20260709 12:59:33.418287  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:33.419098  1716 raft_consensus.cc:2468] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6.
W20260709 12:59:33.402953  1542 leader_election.cc:336] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.521s (SENT)
W20260709 12:59:33.423486  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:33.384140  4149 raft_consensus.cc:697] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 7 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:33.424683  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:33.429041  1716 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
I20260709 12:59:33.425902  1542 leader_election.cc:304] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:33.427978  1725 raft_consensus.cc:2468] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
I20260709 12:59:33.431402  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:33.432011  1722 raft_consensus.cc:2376] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5. Re-sending same reply.
W20260709 12:59:33.581609  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 164278us
W20260709 12:59:33.549767  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:33.476622  1539 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
W20260709 12:59:33.536731  2297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:33.540619  1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 437) took 1788 ms. Trace:
I20260709 12:59:33.463085  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:33.596602  1644 raft_consensus.cc:1240] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
W20260709 12:59:33.599736  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:33.583191  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 12:59:33.587950  4237 log.cc:927] Time spent T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.438s	user 0.000s	sys 0.003s
W20260709 12:59:33.601909  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 207277us
I20260709 12:59:33.602638  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:33.599807  1615 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 12:59:33.607287  1648 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57912 (request call id 376) took 1837 ms (client timeout 1686 ms). Trace:
I20260709 12:59:33.516049  4254 raft_consensus.cc:2804] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:33.548045  3928 raft_consensus.cc:3055] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:33.517449  4245 raft_consensus.cc:493] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.614252  1572 raft_consensus.cc:2468] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 3.
W20260709 12:59:33.607812  1648 rpcz_store.cc:269] 0709 12:59:31.764779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:31.780398 (+ 15619us) service_pool.cc:224] Handling call
0709 12:59:33.561471 (+1781073us) spinlock_profiling.cc:243] Waited 232 ms on lock 0x7b540030eb54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:33.602508 (+ 41037us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":534003584}
I20260709 12:59:33.592984  1720 rpcz_store.cc:276] 0709 12:59:31.747341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:31.747467 (+   126us) service_pool.cc:224] Handling call
0709 12:59:31.747765 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:31.798739 (+ 50974us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:31.798767 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:31.812888 (+ 14121us) log.cc:844] Serialized 26 byte log entry
0709 12:59:32.116505 (+303617us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:32.116653 (+   148us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:33.535618 (+1418965us) spinlock_profiling.cc:243] Waited 50.7 ms on lock 0x7b540007ec54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:33.535669 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:33.535721 (+    52us) raft_consensus.cc:1685] finished
0709 12:59:33.535736 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:33.536012 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":116664192,"thread_start_us":230646,"threads_started":1,"wal-append.queue_time_us":285940,"wal-append.run_cpu_time_us":9259,"wal-append.run_wall_time_us":1281742}
I20260709 12:59:33.439064  4037 raft_consensus.cc:2749] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:33.517256  4168 raft_consensus.cc:493] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.466048  4259 raft_consensus.cc:2804] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:59:33.616323  1542 leader_election.cc:336] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.524s (SENT)
I20260709 12:59:33.430771  4085 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:33.513609  4257 raft_consensus.cc:493] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:33.609205  3945 tablet_bootstrap.cc:700] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66: Time spent opening tablet: real 0.170s	user 0.002s	sys 0.017s
I20260709 12:59:33.606089  4241 raft_consensus.cc:2804] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:33.466558  4265 consensus_queue.cc:1059] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.146s
I20260709 12:59:33.620810  4129 consensus_queue.cc:1059] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:59:33.621503  1575 raft_consensus.cc:3060] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:33.438827  4244 consensus_queue.cc:1059] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.246s
I20260709 12:59:33.622149  4153 consensus_queue.cc:1048] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:59:33.623019  3673 raft_consensus.cc:2804] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:33.624716  4168 raft_consensus.cc:515] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:33.534612  4238 raft_consensus.cc:515] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:33.627091  4261 consensus_queue.cc:1059] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:33.628460  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:33.620278  4259 raft_consensus.cc:493] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:33.630905  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:33.632860  4247 raft_consensus.cc:3055] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:33.634109  1645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 1354) took 1982 ms. Trace:
I20260709 12:59:33.513454  4219 raft_consensus.cc:515] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:33.642632  1542 leader_election.cc:304] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:33.644086  4241 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:33.613727  3928 raft_consensus.cc:740] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
W20260709 12:59:33.643229  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 166748us
I20260709 12:59:33.551872  4169 raft_consensus.cc:515] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:33.515442  4149 consensus_queue.cc:237] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:33.666330  3673 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:33.641158  4245 raft_consensus.cc:515] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:33.644053  4257 raft_consensus.cc:515] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:33.676841  4247 raft_consensus.cc:740] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:33.712750  4241 raft_consensus.cc:3060] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:33.713822  4247 consensus_queue.cc:260] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:33.715415  4247 raft_consensus.cc:3060] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:33.716965  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 106857us
W20260709 12:59:33.717757  1542 leader_election.cc:336] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.608s (SENT)
I20260709 12:59:33.717522  3928 consensus_queue.cc:260] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:33.718207  1542 leader_election.cc:304] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:33.714289  4083 consensus_queue.cc:260] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:33.675810  1720 raft_consensus.cc:2410] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:59:33.719399  4258 raft_consensus.cc:2749] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:33.610335  4254 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:33.720073  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:33.720278  4254 raft_consensus.cc:3060] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:33.721084  1720 raft_consensus.cc:2410] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:59:33.688661  4168 leader_election.cc:290] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:33.672667  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 74427.7us
I20260709 12:59:33.721937  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:33.722246  2295 leader_election.cc:304] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:33.718608  3928 raft_consensus.cc:3060] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:33.677896  1571 raft_consensus.cc:2393] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 4: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:33.685521  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:33.722602  1720 raft_consensus.cc:2468] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6.
I20260709 12:59:33.727705  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:33.725948  3673 raft_consensus.cc:3060] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:33.729081  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:33.729677  1720 raft_consensus.cc:2468] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 4.
I20260709 12:59:33.675643  4259 raft_consensus.cc:3060] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:33.686697  4261 raft_consensus.cc:3055] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:33.731712  4261 raft_consensus.cc:740] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:33.708730  4238 leader_election.cc:290] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:33.732860  4261 consensus_queue.cc:260] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:33.733559  4123 raft_consensus.cc:3060] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:33.734304  4261 raft_consensus.cc:3060] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:33.735603  1650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 377) took 1970 ms. Trace:
I20260709 12:59:33.735980  1650 rpcz_store.cc:276] 0709 12:59:31.765033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:32.083184 (+318151us) service_pool.cc:224] Handling call
0709 12:59:32.083711 (+   527us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:32.453054 (+369343us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:33.735380 (+1282326us) spinlock_profiling.cc:243] Waited 69.9 ms on lock 0x7b54001752d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:33.735546 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":160840576}
I20260709 12:59:33.683475  4037 raft_consensus.cc:2749] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:33.737648  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:33.739192  1720 raft_consensus.cc:2468] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
I20260709 12:59:33.739894  4153 raft_consensus.cc:493] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.740562  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:33.712468  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:33.741456  1724 raft_consensus.cc:2468] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6.
I20260709 12:59:33.741984  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:33.742342  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:33.742815  1718 raft_consensus.cc:2393] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 6: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:59:33.743487  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:33.743665  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:33.744092  1724 raft_consensus.cc:2468] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 3.
I20260709 12:59:33.745451  1722 raft_consensus.cc:3060] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:33.747370  1720 raft_consensus.cc:2468] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 2.
I20260709 12:59:33.749948  4082 leader_election.cc:290] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:33.706278  4219 leader_election.cc:290] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:33.753063  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45148 (request call id 1975) took 1641 ms. Trace:
I20260709 12:59:33.753510  1644 rpcz_store.cc:276] 0709 12:59:32.161097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:32.593188 (+432091us) service_pool.cc:224] Handling call
0709 12:59:33.596263 (+1003075us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:33.597284 (+  1021us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:33.752861 (+155577us) spinlock_profiling.cc:243] Waited 993 ms on lock 0x7b540030eb50. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23ba8ad 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:33.753012 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2283521920}
I20260709 12:59:33.703915  4151 raft_consensus.cc:3060] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:33.757913  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:33.758842  1540 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:33.740461  4153 raft_consensus.cc:515] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:33.740823  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:59:33.724773  1542 leader_election.cc:336] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.640s (SENT)
I20260709 12:59:33.748235  4185 raft_consensus.cc:3055] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:33.779274  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:33.787094  1571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37682 (request call id 428) took 1677 ms. Trace:
I20260709 12:59:33.787420  1542 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:33.788957  1717 raft_consensus.cc:2468] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
I20260709 12:59:33.787575  1571 rpcz_store.cc:276] 0709 12:59:32.083988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:32.086516 (+  2528us) service_pool.cc:224] Handling call
0709 12:59:33.630658 (+1544142us) spinlock_profiling.cc:243] Waited 1.33 ms on lock 0x7b5800011198. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef296b71 00007fa9ef296a22 00007fa9f81afc09 00007fa9f7309ee0 00007fa9f73d30ab 00007fa9f73d3131 00007fa9f73810a0 00007fa9f7380984 00007fa9f08fb6d4 00007fa9f08fb662
0709 12:59:33.760906 (+130248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3067776}
I20260709 12:59:33.677007  1645 rpcz_store.cc:276] 0709 12:59:31.651263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:31.651813 (+   550us) service_pool.cc:224] Handling call
0709 12:59:31.681696 (+ 29883us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:32.033872 (+352176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:32.033927 (+    55us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:32.034023 (+    96us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:32.034143 (+   120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:33.633626 (+1599483us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b5400157f54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:33.633684 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:33.633876 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":99690,"raft.queue_time_us":97027,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":8759,"spinlock_wait_cycles":292181376}
I20260709 12:59:33.804600  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:33.759752  4257 leader_election.cc:290] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:33.806661  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:33.807698  1720 raft_consensus.cc:2410] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:59:33.806423  4246 raft_consensus.cc:2749] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:33.815837  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:33.802984  1718 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 7.
I20260709 12:59:33.787925  4082 raft_consensus.cc:2804] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:33.819025  1575 raft_consensus.cc:2468] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 4.
I20260709 12:59:33.819110  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:33.788409  4185 raft_consensus.cc:740] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
W20260709 12:59:33.820245  1575 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37682 (request call id 427) took 1736 ms (client timeout 1740 ms). Trace:
I20260709 12:59:33.820261  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 12:59:33.821722  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 65055.1us
W20260709 12:59:33.821249  1575 rpcz_store.cc:269] 0709 12:59:32.083603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:32.100727 (+ 17124us) service_pool.cc:224] Handling call
0709 12:59:33.582946 (+1482219us) spinlock_profiling.cc:243] Waited 25.9 ms on lock 0x7b5800011198. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef296b71 00007fa9ef296eee 0000000000375939 00007fa9f730a1e0 00007fa9f73d30c4 00007fa9f73d3131 00007fa9f73810a0 00007fa9f7380984 00007fa9f08fb6d4 00007fa9f08fb662
0709 12:59:33.820172 (+237226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":61381248}
W20260709 12:59:33.827956  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 103207us
I20260709 12:59:33.832845  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
W20260709 12:59:33.834539  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 112387us
I20260709 12:59:33.835528  1724 raft_consensus.cc:2468] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 4.
I20260709 12:59:33.837657  1724 raft_consensus.cc:1240] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:33.838315  4259 raft_consensus.cc:515] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:33.839238  4241 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:33.840233  4259 leader_election.cc:290] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:33.844985  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:33.845147  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:33.845283  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:33.845683  1570 raft_consensus.cc:2468] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 4.
I20260709 12:59:33.847440  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:33.848119  1717 raft_consensus.cc:3060] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:33.850389  1571 raft_consensus.cc:2393] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 5: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:33.844319  4275 raft_consensus.cc:2804] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:33.853535  4275 raft_consensus.cc:493] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:33.853803  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:33.853907  4275 raft_consensus.cc:3060] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:33.854863  1571 raft_consensus.cc:2410] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:59:33.855829  4257 raft_consensus.cc:493] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.856675  2327 raft_consensus.cc:3060] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:33.856326  4257 raft_consensus.cc:515] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:33.858944  4257 leader_election.cc:290] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:33.859444  4257 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.859927  4257 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:33.866724  4257 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:33.869367  4169 leader_election.cc:290] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:59:33.870277  1689 connection.cc:256] RPC call timeout handler was delayed by -1.4323478320000049s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2731s for a response
I20260709 12:59:33.862648  4153 leader_election.cc:290] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:59:33.870836  1689 connection.cc:256] RPC call timeout handler was delayed by -1.021047832000022s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31880000000000003s for a response
I20260709 12:59:33.874398  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:33.875092  1717 raft_consensus.cc:2468] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 5.
I20260709 12:59:33.876914  1570 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 5.
I20260709 12:59:33.841554  4185 consensus_queue.cc:260] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:33.880889  1539 leader_election.cc:336] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Timed out: RequestConsensusVote RPC to 127.0.107.194:37391 timed out after 1.649s (SENT)
I20260709 12:59:33.881035  2327 raft_consensus.cc:2468] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 4.
I20260709 12:59:33.886174  2295 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:33.887327  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:33.889030  4280 raft_consensus.cc:2749] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:33.884969  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:33.890817  1570 raft_consensus.cc:2393] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 4: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:33.864468  4275 raft_consensus.cc:515] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:33.871302  2297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:33.842581  4082 raft_consensus.cc:697] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:33.891203  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:33.893832  1725 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
W20260709 12:59:33.891554  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:33.894115  1540 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:33.896587  4185 raft_consensus.cc:3060] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:33.897811  4254 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:33.896502  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:33.899941  4082 consensus_queue.cc:237] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:33.864377  3673 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:59:33.914872  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:33.915879  4116 leader_election.cc:290] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:33.916254  4241 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:33.917441  4254 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:33.917943  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:33.918385  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:33.919914  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:33.913020  4275 leader_election.cc:290] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:59:33.921414  2297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:33.930682  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 51060us
I20260709 12:59:33.921552  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:34.073298  1689 leader_election.cc:304] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:34.074395  4106 raft_consensus.cc:2804] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:34.074906  4106 raft_consensus.cc:493] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:34.075276  4106 raft_consensus.cc:3060] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:34.075685  4255 raft_consensus.cc:493] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:33.921432  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 12:59:33.944564  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:33.937729  1722 raft_consensus.cc:2468] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 7.
W20260709 12:59:34.102236  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 216135us
W20260709 12:59:34.108290  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.098354  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:33.974105  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:33.922899  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
W20260709 12:59:34.111742  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.044539  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:33.994907  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 1356) took 2342 ms. Trace:
I20260709 12:59:33.976013  2330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53290 (request call id 833) took 1077 ms. Trace:
W20260709 12:59:34.120409  2297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:33.905423  4037 raft_consensus.cc:2804] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:34.118541  2330 rpcz_store.cc:276] 0709 12:59:32.889464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:32.889587 (+   123us) service_pool.cc:224] Handling call
0709 12:59:32.902477 (+ 12890us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:33.048321 (+145844us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:33.964382 (+916061us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b54008476d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:33.966831 (+  2449us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":248050944}
W20260709 12:59:33.996066  4236 log.cc:927] Time spent T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.845s	user 0.000s	sys 0.003s
I20260709 12:59:34.129400  4241 raft_consensus.cc:493] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:34.129606  2325 raft_consensus.cc:1240] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:59:34.130132  4241 raft_consensus.cc:515] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:34.133472  4037 raft_consensus.cc:697] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:34.133880  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:34.134606  4037 consensus_queue.cc:237] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:34.137759  4241 leader_election.cc:290] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:34.138634  4190 raft_consensus.cc:493] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:34.141264  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:34.142313  1651 raft_consensus.cc:2410] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:59:34.153537  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:34.155236  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:33.996713  4245 leader_election.cc:290] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:34.157557  1642 raft_consensus.cc:2393] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 5: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:33.972004  4098 raft_consensus.cc:493] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:34.159500  2324 raft_consensus.cc:1240] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:34.157500  2295 leader_election.cc:304] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:34.116882  1647 rpcz_store.cc:276] 0709 12:59:31.651893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:31.652021 (+   128us) service_pool.cc:224] Handling call
0709 12:59:31.652406 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:31.702617 (+ 50211us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:31.702663 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:31.709070 (+  6407us) log.cc:844] Serialized 26 byte log entry
0709 12:59:31.911181 (+202111us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:31.911229 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:33.994264 (+2083035us) spinlock_profiling.cc:243] Waited 49.9 ms on lock 0x7b54002d96d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:33.994331 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:33.994398 (+    67us) raft_consensus.cc:1685] finished
0709 12:59:33.994410 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:33.994710 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":114765568,"thread_start_us":168373,"threads_started":1,"wal-append.queue_time_us":207820,"wal-append.run_cpu_time_us":2856,"wal-append.run_wall_time_us":1062941}
I20260709 12:59:34.161563  4098 raft_consensus.cc:515] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:34.162896  4282 log.cc:927] Time spent T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:59:34.165023  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:34.170508  2325 raft_consensus.cc:2468] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 5.
I20260709 12:59:34.171768  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:34.173779  1649 raft_consensus.cc:2410] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:59:34.139374  4190 raft_consensus.cc:515] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:34.175194  1644 raft_consensus.cc:2393] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 6: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:34.177089  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 12:59:34.179718  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 106525us
I20260709 12:59:34.181434  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:34.164222  4098 leader_election.cc:290] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:34.185381  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:34.184137  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:34.186311  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:34.188649  1647 raft_consensus.cc:2410] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:59:34.190347  1539 leader_election.cc:336] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Timed out: RequestConsensusVote RPC to 127.0.107.194:37391 timed out after 2.176s (SENT)
I20260709 12:59:34.191166  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:34.194809  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:34.195888  1717 raft_consensus.cc:2468] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 3.
I20260709 12:59:34.202761  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:34.203372  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:34.203961  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:34.205327  2328 raft_consensus.cc:1275] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:59:34.197065  4285 raft_consensus.cc:2804] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:34.206892  4285 raft_consensus.cc:697] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
W20260709 12:59:34.207662  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 98573.6us
I20260709 12:59:34.207903  4285 consensus_queue.cc:237] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:34.212814  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:34.213384  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.214387  1571 raft_consensus.cc:1240] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:59:34.217516  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:34.120141  4255 raft_consensus.cc:515] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:34.220614  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:34.223037  1568 raft_consensus.cc:3060] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:34.223299  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:34.224774  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:34.230201  4261 raft_consensus.cc:493] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:34.230867  4261 raft_consensus.cc:515] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:34.230374  1572 raft_consensus.cc:1240] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 3. Current term is 4. Ops: []
W20260709 12:59:34.233341  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.235755  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:34.239902  1571 raft_consensus.cc:1275] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:59:34.238050  4281 log.cc:927] Time spent T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.360s	user 0.001s	sys 0.000s
I20260709 12:59:34.299423  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:59:34.313033  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.346127  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 12:59:34.288661  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.283310  4145 raft_consensus.cc:3060] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:34.253377  1647 raft_consensus.cc:2393] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 3: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:59:34.350775  1717 raft_consensus.cc:2468] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6.
I20260709 12:59:34.362983  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:34.364212  4106 raft_consensus.cc:515] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:34.358093  1725 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7.
I20260709 12:59:34.377262  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:34.386540  1716 raft_consensus.cc:1240] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 5. Current term is 7. Ops: []
I20260709 12:59:34.385390  1719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1295) took 1195 ms. Trace:
I20260709 12:59:34.391181  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:34.391623  4056 consensus_queue.cc:1048] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 12:59:34.392935  4118 consensus_queue.cc:260] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:34.402103  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:34.402935  1644 raft_consensus.cc:2393] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 5: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:34.390580  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:34.404969  1718 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 4.
I20260709 12:59:34.399467  1719 rpcz_store.cc:276] 0709 12:59:33.183839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:33.191821 (+  7982us) service_pool.cc:224] Handling call
0709 12:59:34.284205 (+1092384us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b5800196e98. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef296b71 00007fa9ef296a22 00007fa9f81afc09 00007fa9f7309ee0 00007fa9f73d30ab 00007fa9f73d3131 00007fa9f73810a0 00007fa9f7380984 00007fa9f08fb6d4 00007fa9f08fb662
0709 12:59:34.378844 (+ 94639us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2860416}
I20260709 12:59:34.414197  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:34.380386  4157 consensus_queue.cc:1059] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
W20260709 12:59:34.423583  2329 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32870 (request call id 249) took 2378 ms (client timeout 2951 ms). Trace:
I20260709 12:59:34.424326  4157 raft_consensus.cc:3055] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:34.424783  4157 raft_consensus.cc:740] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:34.414016  4261 leader_election.cc:290] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:34.433707  4190 leader_election.cc:290] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:34.441279  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:34.441494  1574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 434) took 1849 ms. Trace:
I20260709 12:59:34.442524  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
W20260709 12:59:34.443720  4185 consensus_meta.cc:287] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.547s	user 0.009s	sys 0.001s
I20260709 12:59:34.422219  4118 raft_consensus.cc:3060] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:34.427297  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:34.444798  1718 raft_consensus.cc:2468] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6.
I20260709 12:59:34.446022  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:34.446659  1644 raft_consensus.cc:2468] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 5.
I20260709 12:59:34.447547  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:59:34.424078  2329 rpcz_store.cc:269] 0709 12:59:32.045252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:32.107492 (+ 62240us) service_pool.cc:224] Handling call
0709 12:59:34.423389 (+2315897us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b54004a9cd4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:34.423521 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3361259392}
W20260709 12:59:34.449749  4247 consensus_meta.cc:287] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.734s	user 0.013s	sys 0.017s
I20260709 12:59:34.450047  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:34.434551  1651 raft_consensus.cc:1240] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:34.450687  1721 raft_consensus.cc:2410] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:59:34.451052  1647 raft_consensus.cc:2410] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:59:34.422127  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:34.453205  1651 raft_consensus.cc:1275] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:59:34.453625  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:34.437203  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:34.454835  1716 raft_consensus.cc:2468] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 3.
I20260709 12:59:34.455852  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:34.438210  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:34.433804  2297 leader_election.cc:304] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 12:59:34.443670  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:34.458750  1716 raft_consensus.cc:2410] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:59:34.458823  1642 raft_consensus.cc:2368] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 4. Current term is 5.
I20260709 12:59:34.452383  1647 raft_consensus.cc:1240] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 6 LEADER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:59:34.459530  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:59:34.480965  1617 leader_election.cc:336] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.553s (SENT)
I20260709 12:59:34.493769  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 12:59:34.496978  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 63248.2us
I20260709 12:59:34.497669  1643 raft_consensus.cc:2468] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 3.
I20260709 12:59:34.497066  1649 raft_consensus.cc:2468] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 7.
I20260709 12:59:34.498008  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:34.504910  1646 raft_consensus.cc:2376] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6. Re-sending same reply.
W20260709 12:59:34.505453  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.506074  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:34.498533  1617 leader_election.cc:304] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:34.507625  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:34.508278  1717 raft_consensus.cc:2468] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6.
I20260709 12:59:34.441856  1574 rpcz_store.cc:276] 0709 12:59:32.592625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:32.599266 (+  6641us) service_pool.cc:224] Handling call
0709 12:59:33.721283 (+1122017us) spinlock_profiling.cc:243] Waited 958 us on lock 0x7b5800011198. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef296b71 00007fa9ef296a22 00007fa9f81afc09 00007fa9f7309ee0 00007fa9f73d30ab 00007fa9f73d3131 00007fa9f7394fc0 00007fa9f737f929 00007fa9f737f3d2 00007fa9f08f6bd4
0709 12:59:33.721496 (+   213us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:33.721708 (+   212us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:33.721738 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:33.722300 (+   562us) log.cc:844] Serialized 26 byte log entry
0709 12:59:33.827800 (+105500us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:33.827849 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:33.827965 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:34.439172 (+611207us) raft_consensus.cc:1685] finished
0709 12:59:34.439195 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:34.441433 (+  2238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2203392,"thread_start_us":105092,"threads_started":1,"wal-append.queue_time_us":147527}
I20260709 12:59:34.509549  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:34.510018  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:34.510210  1717 raft_consensus.cc:2468] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 3.
I20260709 12:59:34.511410  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:34.508246  1718 raft_consensus.cc:2376] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7. Re-sending same reply.
I20260709 12:59:34.512209  1648 raft_consensus.cc:2393] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 4: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:34.512660  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:59:34.501204  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.512030  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:34.489056  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:34.513998  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:34.515327  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:34.517354  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:34.518059  1716 raft_consensus.cc:2393] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 6: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:59:34.518584  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:34.505649  1725 raft_consensus.cc:3060] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:34.529876  1644 raft_consensus.cc:1275] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:59:34.531316  2297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.530812  1568 raft_consensus.cc:2468] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 7.
I20260709 12:59:34.533488  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:34.537153  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:34.538766  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:34.539410  1569 raft_consensus.cc:2468] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6.
I20260709 12:59:34.541736  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:34.542646  1571 raft_consensus.cc:2393] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 3: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
W20260709 12:59:34.544094  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 63191.4us
I20260709 12:59:34.540311  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:34.547945  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:34.495406  4098 raft_consensus.cc:493] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:34.551468  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:34.506651  4287 raft_consensus.cc:2804] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:34.551092  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:34.552405  4287 raft_consensus.cc:697] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:34.553000  4250 consensus_queue.cc:1059] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:34.553932  4250 raft_consensus.cc:3055] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:34.553488  4287 consensus_queue.cc:237] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:34.554258  4250 raft_consensus.cc:740] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:34.555194  4250 consensus_queue.cc:260] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:34.558607  4250 raft_consensus.cc:3060] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:34.559737  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:34.562203  1643 raft_consensus.cc:3060] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:59:34.556692  4098 raft_consensus.cc:515] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:34.561203  1644 raft_consensus.cc:1275] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:34.560318  1648 raft_consensus.cc:1240] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:34.561605  1651 raft_consensus.cc:1240] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:34.557061  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 12:59:34.575686  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.577342  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:34.591509  1575 raft_consensus.cc:2376] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 6. Re-sending same reply.
I20260709 12:59:34.592293  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:34.595435  1725 raft_consensus.cc:2410] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 for term 7 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:59:34.596603  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 371954us
I20260709 12:59:34.597996  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:34.546967  4190 raft_consensus.cc:2749] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:34.605604  1571 raft_consensus.cc:2468] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 6.
I20260709 12:59:34.600317  1569 raft_consensus.cc:2376] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 6. Re-sending same reply.
I20260709 12:59:34.608275  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:59:34.609035  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.608382  1645 raft_consensus.cc:2393] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 5: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
W20260709 12:59:34.630820  1539 leader_election.cc:336] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Timed out: RequestConsensusVote RPC to 127.0.107.194:37391 timed out after 1.731s (SENT)
I20260709 12:59:34.634558  2329 raft_consensus.cc:1240] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:59:34.634334  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:34.635442  1651 raft_consensus.cc:2468] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 5.
I20260709 12:59:34.635982  3673 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:34.640477  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:34.641686  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:34.642625  1571 raft_consensus.cc:2393] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 5: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:34.643654  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:34.645231  2294 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 12:59:34.641893  1617 leader_election.cc:336] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.711s (SENT)
I20260709 12:59:34.607438  4082 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:34.647380  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:34.650810  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:34.651423  2330 raft_consensus.cc:2468] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6.
I20260709 12:59:34.660830  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:34.661158  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:34.662940  1617 leader_election.cc:304] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 12:59:34.668501  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.678684  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:34.679812  1569 raft_consensus.cc:2393] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 4: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
W20260709 12:59:34.686510  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.688905  1571 raft_consensus.cc:3060] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:34.680912  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:34.693056  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:34.688262  4129 raft_consensus.cc:2804] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:34.687959  3673 raft_consensus.cc:2749] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:34.687882  4122 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:34.757697  4106 leader_election.cc:290] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:34.690228  4190 raft_consensus.cc:493] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:34.698637  4210 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:34.758673  4129 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
W20260709 12:59:34.775359  4283 log.cc:927] Time spent T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.404s	user 0.000s	sys 0.003s
I20260709 12:59:34.647773  4082 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:34.789227  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 147206us
W20260709 12:59:34.810570  1573 consensus_meta.cc:287] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.694s	user 0.009s	sys 0.002s
I20260709 12:59:34.840140  1571 raft_consensus.cc:2468] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 5.
I20260709 12:59:34.880554  1573 raft_consensus.cc:2468] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 4.
I20260709 12:59:34.910658  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:34.915553  1573 raft_consensus.cc:2393] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 4: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:34.924304  1719 raft_consensus.cc:2468] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7.
W20260709 12:59:34.924726  4145 consensus_meta.cc:287] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.545s	user 0.007s	sys 0.004s
I20260709 12:59:34.825016  4129 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:34.797348  4122 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:34.856580  4190 raft_consensus.cc:515] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:34.856249  4210 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:34.926740  1569 raft_consensus.cc:2468] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 4.
W20260709 12:59:35.381791  1575 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36642 (request call id 2174) took 1404 ms (client timeout 1847 ms). Trace:
W20260709 12:59:35.395604  1575 rpcz_store.cc:269] 0709 12:59:33.977836 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.518348 (+540512us) service_pool.cc:224] Handling call
0709 12:59:35.061910 (+543562us) spinlock_profiling.cc:243] Waited 44.4 ms on lock 0x7b54002eb3d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:35.381721 (+319811us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":102023424}
I20260709 12:59:35.118757  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:35.076124  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:35.401350  1723 raft_consensus.cc:2468] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 3.
W20260709 12:59:35.402159  1723 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1318) took 1994 ms (client timeout 1750 ms). Trace:
W20260709 12:59:35.333647  1642 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.011s	sys 0.015s
W20260709 12:59:35.405186  1642 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.013s	sys 0.015s
I20260709 12:59:35.074611  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:59:35.392302  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 712400us
W20260709 12:59:35.407316  1539 leader_election.cc:336] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Timed out: RequestConsensusVote RPC to 127.0.107.194:37391 timed out after 2.083s (SENT)
W20260709 12:59:35.164430  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:35.394862  1719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1908) took 1047 ms. Trace:
I20260709 12:59:35.408288  1719 rpcz_store.cc:276] 0709 12:59:34.347381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.432677 (+ 85296us) service_pool.cc:224] Handling call
0709 12:59:35.394774 (+962097us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:34.987074  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 423953us
I20260709 12:59:35.406129  1649 raft_consensus.cc:2468] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6.
I20260709 12:59:35.011214  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 12:59:35.108958  1643 consensus_meta.cc:287] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.546s	user 0.007s	sys 0.004s
W20260709 12:59:35.420593  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:35.421358  1643 raft_consensus.cc:2468] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 5.
W20260709 12:59:35.421682  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:35.060938  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:35.420670  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
W20260709 12:59:35.423382  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:35.423830  1649 raft_consensus.cc:3060] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:35.424198  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:35.402725  1723 rpcz_store.cc:269] 0709 12:59:33.408182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:33.422630 (+ 14448us) service_pool.cc:224] Handling call
0709 12:59:35.075983 (+1653353us) spinlock_profiling.cc:243] Waited 4.31 ms on lock 0x7b5800196e98. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef296b71 00007fa9ef296eee 0000000000375939 00007fa9f730a1e0 00007fa9f73d30c4 00007fa9f73d3131 00007fa9f73810a0 00007fa9f7380984 00007fa9f08fb6d4 00007fa9f08fb662
0709 12:59:35.402070 (+326087us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9911168}
I20260709 12:59:35.429329  1539 leader_election.cc:304] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:35.429586  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:35.430399  1719 raft_consensus.cc:2468] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6.
I20260709 12:59:35.057219  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:35.432072  1570 raft_consensus.cc:3060] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:35.420621  1725 raft_consensus.cc:3060] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Advancing to term 5
W20260709 12:59:35.035761  4285 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.005s	sys 0.026s
W20260709 12:59:35.453909  2296 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.013s	sys 0.022s
W20260709 12:59:35.492226  2296 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.014s	sys 0.022s
W20260709 12:59:35.493345  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:34.991089  4083 raft_consensus.cc:3060] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:35.075665  4270 raft_consensus.cc:3055] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:59:35.505667  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 860486us
I20260709 12:59:35.501309  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:35.508502  1575 raft_consensus.cc:2376] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 6. Re-sending same reply.
I20260709 12:59:35.508744  1649 raft_consensus.cc:2468] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 7.
I20260709 12:59:35.501814  4122 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:35.502104  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:35.502246  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 448) took 1181 ms. Trace:
I20260709 12:59:35.514222  1720 raft_consensus.cc:1240] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 6. Current term is 7. Ops: [4.3-6.4]
W20260709 12:59:35.492087  4285 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.126s	user 0.012s	sys 0.027s
I20260709 12:59:35.503334  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:35.332206  4250 raft_consensus.cc:493] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:35.353729  4106 raft_consensus.cc:493] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:35.511327  1576 raft_consensus.cc:2468] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 6.
I20260709 12:59:35.514683  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
W20260709 12:59:35.514008  1722 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1314) took 2106 ms (client timeout 1766 ms). Trace:
I20260709 12:59:35.516566  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:35.431530  4098 leader_election.cc:290] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:35.502615  4210 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:35.513502  1723 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 4.
I20260709 12:59:35.517899  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
W20260709 12:59:35.493754  4287 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.707s	user 0.013s	sys 0.017s
I20260709 12:59:35.436137  4286 raft_consensus.cc:493] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:35.537271  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:35.520149  1719 raft_consensus.cc:2468] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 5.
I20260709 12:59:35.538206  1574 raft_consensus.cc:2410] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:59:35.512423  4270 raft_consensus.cc:740] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:35.541918  2294 leader_election.cc:304] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4
W20260709 12:59:35.526891  1721 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1319) took 2111 ms (client timeout 1649 ms). Trace:
I20260709 12:59:35.529047  1717 raft_consensus.cc:2410] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:59:35.532568  1725 raft_consensus.cc:2468] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 5.
I20260709 12:59:35.545131  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1916) took 1175 ms. Trace:
I20260709 12:59:35.545351  1650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 1396) took 1027 ms. Trace:
W20260709 12:59:35.532784  1722 rpcz_store.cc:269] 0709 12:59:33.407084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:33.432745 (+ 25661us) service_pool.cc:224] Handling call
0709 12:59:35.513810 (+2081065us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b540009bfd4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:35.513935 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":312467712}
I20260709 12:59:35.535192  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:35.536152  1646 raft_consensus.cc:2376] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6. Re-sending same reply.
I20260709 12:59:35.494607  4255 leader_election.cc:290] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:35.513913  1567 rpcz_store.cc:276] 0709 12:59:34.211983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.215002 (+  3019us) service_pool.cc:224] Handling call
0709 12:59:34.223128 (+  8126us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:34.223327 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:59:34.604221 (+380894us) log.cc:844] Serialized 14 byte log entry
0709 12:59:35.393221 (+789000us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:35.393303 (+    82us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:35.393382 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:35.393477 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:35.393639 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":5651,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":422865,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":10178,"thread_start_us":775802,"threads_started":2}
I20260709 12:59:35.547714  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 1397) took 1029 ms. Trace:
I20260709 12:59:35.546269  1575 raft_consensus.cc:2468] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6.
I20260709 12:59:35.553587  1646 rpcz_store.cc:276] 0709 12:59:34.517960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.541207 (+ 23247us) service_pool.cc:224] Handling call
0709 12:59:35.517706 (+976499us) spinlock_profiling.cc:243] Waited 2.27 ms on lock 0x7b5800181898. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef296b71 00007fa9ef296a22 00007fa9f81afc09 00007fa9f7309ee0 00007fa9f73d30ab 00007fa9f73d3131 00007fa9f73810a0 00007fa9f7380984 00007fa9f08fb6d4 00007fa9f08fb662
0709 12:59:35.547657 (+ 29951us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5217536}
I20260709 12:59:35.545704  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:35.549118  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:35.545756  1650 rpcz_store.cc:276] 0709 12:59:34.517638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.540602 (+ 22964us) service_pool.cc:224] Handling call
0709 12:59:35.514526 (+973924us) spinlock_profiling.cc:243] Waited 2.16 ms on lock 0x7b5800181898. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef296b71 00007fa9ef296a22 00007fa9f81afc09 00007fa9f7309ee0 00007fa9f73d30ab 00007fa9f73d3131 00007fa9f73810a0 00007fa9f7380984 00007fa9f08fb6d4 00007fa9f08fb662
0709 12:59:35.545293 (+ 30767us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4979072}
I20260709 12:59:35.523670  4116 raft_consensus.cc:2749] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:59:35.554662  1615 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:35.555536  1615 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:35.555845  1722 raft_consensus.cc:3060] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:35.544816  1721 rpcz_store.cc:269] 0709 12:59:33.408440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:33.423119 (+ 14679us) service_pool.cc:224] Handling call
0709 12:59:33.685260 (+262141us) spinlock_profiling.cc:243] Waited 7.92 ms on lock 0x7b5800196e98. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef296b71 00007fa9ef296eee 0000000000375939 00007fa9f730a1e0 00007fa9f73d30c4 00007fa9f73d3131 00007fa9f73810a0 00007fa9f7380984 00007fa9f08fb6d4 00007fa9f08fb662
0709 12:59:35.513486 (+1828226us) spinlock_profiling.cc:243] Waited 723 ms on lock 0x7b54000e33d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:35.519336 (+  5850us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1681675392}
W20260709 12:59:35.556381  1541 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.883s	user 0.021s	sys 0.026s
W20260709 12:59:35.560937  1541 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.003s	user 0.022s	sys 0.026s
W20260709 12:59:35.540216  4287 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.779s	user 0.014s	sys 0.017s
I20260709 12:59:35.545580  1717 rpcz_store.cc:276] 0709 12:59:34.369632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.513823 (+144191us) service_pool.cc:224] Handling call
0709 12:59:35.516191 (+1002368us) spinlock_profiling.cc:243] Waited 8.67 ms on lock 0x7b5800196e98. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef296b71 00007fa9ef296a22 00007fa9f81afc09 00007fa9f7309ee0 00007fa9f73d30ab 00007fa9f73d3131 00007fa9f73810a0 00007fa9f7380984 00007fa9f08fb6d4 00007fa9f08fb662
0709 12:59:35.545075 (+ 28884us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19936128}
I20260709 12:59:35.559896  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:35.563210  2295 leader_election.cc:304] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
W20260709 12:59:35.565119  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 157843us
I20260709 12:59:35.566089  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:35.567165  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:35.567307  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:35.582440  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:35.583554  1725 raft_consensus.cc:2468] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6.
I20260709 12:59:35.538079  4250 raft_consensus.cc:515] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:35.565277  1723 raft_consensus.cc:2376] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7. Re-sending same reply.
I20260709 12:59:35.586228  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:35.586977  1721 raft_consensus.cc:2468] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 3.
I20260709 12:59:35.590307  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:35.559715  4275 raft_consensus.cc:2804] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:35.591023  1650 raft_consensus.cc:2376] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 4. Re-sending same reply.
I20260709 12:59:35.519933  4157 consensus_queue.cc:260] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:35.597337  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 1825) took 1055 ms. Trace:
I20260709 12:59:35.597681  1567 rpcz_store.cc:276] 0709 12:59:34.541559 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.552849 (+1011290us) service_pool.cc:224] Handling call
0709 12:59:35.569042 (+ 16193us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:35.593002 (+ 23960us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:35.593027 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:35.597108 (+  4081us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:35.597156 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:35.597204 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:35.597291 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:35.547959  4122 consensus_queue.cc:1048] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:59:35.601714  1719 raft_consensus.cc:1240] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:35.603003  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 1827) took 1060 ms. Trace:
I20260709 12:59:35.607972  1567 rpcz_store.cc:276] 0709 12:59:34.542714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.602084 (+1059370us) service_pool.cc:224] Handling call
0709 12:59:35.602444 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:35.602647 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:35.602678 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:35.602726 (+    48us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:35.602767 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:35.602828 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:35.602944 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:35.604686  4300 raft_consensus.cc:493] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:35.612371  1719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1899) took 1407 ms. Trace:
I20260709 12:59:35.557107  4106 raft_consensus.cc:515] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:35.546602  4286 raft_consensus.cc:515] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:35.603401  1574 raft_consensus.cc:1275] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:59:35.623786  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 459) took 1381 ms. Trace:
I20260709 12:59:35.595887  4131 raft_consensus.cc:493] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:35.613193  1723 raft_consensus.cc:1240] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:35.612948  1719 rpcz_store.cc:276] 0709 12:59:34.199853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.583770 (+1383917us) service_pool.cc:224] Handling call
0709 12:59:35.598760 (+ 14990us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:35.607404 (+  8644us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:35.607626 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:35.617398  1722 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 5.
I20260709 12:59:35.592178  4287 raft_consensus.cc:493] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:35.566393  4255 consensus_queue.cc:1059] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:59:35.594164  4214 raft_consensus.cc:2804] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:35.594903  4275 raft_consensus.cc:493] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:35.624459  1574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 1824) took 1083 ms. Trace:
I20260709 12:59:35.624333  1717 rpcz_store.cc:276] 0709 12:59:34.242158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.584179 (+1342021us) service_pool.cc:224] Handling call
0709 12:59:35.584389 (+   210us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:35.608588 (+ 24199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:35.608622 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:35.623477 (+ 14855us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:35.623541 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:35.623618 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:35.623729 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:35.609090  1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1909) took 1241 ms. Trace:
I20260709 12:59:35.635320  1574 rpcz_store.cc:276] 0709 12:59:34.541311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.552620 (+1011309us) service_pool.cc:224] Handling call
0709 12:59:35.584047 (+ 31427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:35.624203 (+ 40156us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:35.624395 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:35.627672  1567 raft_consensus.cc:1240] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:35.636937  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 1829) took 1085 ms. Trace:
I20260709 12:59:35.629446  1722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 462) took 1255 ms. Trace:
I20260709 12:59:35.633831  1572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 1830) took 1069 ms. Trace:
I20260709 12:59:35.637296  1567 rpcz_store.cc:276] 0709 12:59:34.551118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.609340 (+1058222us) service_pool.cc:224] Handling call
0709 12:59:35.627560 (+ 18220us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:35.636659 (+  9099us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:35.636873 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:35.623287  4300 raft_consensus.cc:515] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:35.626605  1723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 461) took 1272 ms. Trace:
I20260709 12:59:35.638706  1723 rpcz_store.cc:276] 0709 12:59:34.354414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.589456 (+1235042us) service_pool.cc:224] Handling call
0709 12:59:35.609542 (+ 20086us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:35.626335 (+ 16793us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:35.626549 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:35.635955  1721 rpcz_store.cc:276] 0709 12:59:34.367629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.591527 (+1223898us) service_pool.cc:224] Handling call
0709 12:59:35.599919 (+  8392us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:35.608722 (+  8803us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:35.608749 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:35.608790 (+    41us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:35.608835 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:35.608921 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:35.609033 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:35.600023  4210 consensus_queue.cc:1059] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:59:35.639928  1722 rpcz_store.cc:276] 0709 12:59:34.375818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.628237 (+1252419us) service_pool.cc:224] Handling call
0709 12:59:35.628632 (+   395us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:35.628952 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:35.628981 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:35.629025 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:35.629065 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:35.629121 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:35.629379 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:35.637526  1572 rpcz_store.cc:276] 0709 12:59:34.564651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.630758 (+1066107us) service_pool.cc:224] Handling call
0709 12:59:35.633297 (+  2539us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:35.633491 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:35.633515 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:35.633570 (+    55us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:35.633616 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:35.633679 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:35.633782 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:35.629534  4131 raft_consensus.cc:515] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:35.649732  1723 raft_consensus.cc:1275] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:59:35.650107  1723 pending_rounds.cc:85] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4: Aborting all ops after (but not including) 2
I20260709 12:59:35.650315  1723 pending_rounds.cc:107] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:59:35.650590  1723 raft_consensus.cc:2889] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:35.654922  4286 leader_election.cc:290] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:35.657506  4300 leader_election.cc:290] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:35.609014  4270 consensus_queue.cc:260] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:35.658715  4270 raft_consensus.cc:3060] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:35.633380  4287 raft_consensus.cc:515] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:35.661109  4190 leader_election.cc:290] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:35.661949  4190 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:35.662725  4287 leader_election.cc:290] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:35.663918  1574 raft_consensus.cc:1240] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:35.664202  1572 raft_consensus.cc:1275] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:59:35.664441  1574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36642 (request call id 2182) took 1027 ms. Trace:
I20260709 12:59:35.664872  1572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36642 (request call id 2184) took 1027 ms. Trace:
W20260709 12:59:35.665136  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:35.665266  1572 rpcz_store.cc:276] 0709 12:59:34.637372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.643249 (+1005877us) service_pool.cc:224] Handling call
0709 12:59:35.663875 (+ 20626us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:35.664645 (+   770us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:35.664820 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:35.664863  1574 rpcz_store.cc:276] 0709 12:59:34.636770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.636289 (+999519us) service_pool.cc:224] Handling call
0709 12:59:35.663792 (+ 27503us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:35.664261 (+   469us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:35.664397 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:35.662460  4190 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:35.668888  4299 log.cc:927] Time spent T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
W20260709 12:59:35.669203  4296 log.cc:927] Time spent T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 12:59:35.670267  1724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1894) took 1487 ms. Trace:
I20260709 12:59:35.670281  1716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1898) took 1472 ms. Trace:
I20260709 12:59:35.642102  4275 raft_consensus.cc:3060] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:35.634831  4214 raft_consensus.cc:697] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:35.650672  4131 leader_election.cc:290] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:35.684643  1717 raft_consensus.cc:1275] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:59:35.685170  1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 463) took 1303 ms. Trace:
I20260709 12:59:35.685913  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1919) took 1305 ms. Trace:
I20260709 12:59:35.686439  1721 rpcz_store.cc:276] 0709 12:59:34.381541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.639843 (+1258302us) service_pool.cc:224] Handling call
0709 12:59:35.682708 (+ 42865us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:35.682895 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:35.682923 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:35.682970 (+    47us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:35.683015 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:35.683073 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:35.683204 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:35.688659  1570 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 5.
I20260709 12:59:35.678542  1716 rpcz_store.cc:276] 0709 12:59:34.199629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.518508 (+318879us) service_pool.cc:224] Handling call
0709 12:59:34.518776 (+   268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:34.519106 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:34.519133 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:34.519548 (+   415us) log.cc:844] Serialized 26 byte log entry
0709 12:59:34.855841 (+336293us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:34.855880 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:34.855962 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:35.670084 (+814122us) raft_consensus.cc:1685] finished
0709 12:59:35.670103 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:35.670224 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1805,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":57295,"thread_start_us":335898,"threads_started":1,"wal-append.queue_time_us":1044405}
I20260709 12:59:35.689405  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36640 (request call id 1836) took 1039 ms. Trace:
I20260709 12:59:35.690866  1723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1920) took 1294 ms. Trace:
I20260709 12:59:35.691596  1723 rpcz_store.cc:276] 0709 12:59:34.396083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.649023 (+1252940us) service_pool.cc:224] Handling call
0709 12:59:35.649359 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:35.690552 (+ 41193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:35.690798 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:35.693555  1574 raft_consensus.cc:1240] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:59:35.694463  1574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36642 (request call id 2189) took 1055 ms. Trace:
I20260709 12:59:35.694860  1574 rpcz_store.cc:276] 0709 12:59:34.638802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.667107 (+1028305us) service_pool.cc:224] Handling call
0709 12:59:35.693235 (+ 26128us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:35.694126 (+   891us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:35.694383 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:35.696420  1572 raft_consensus.cc:1275] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:35.697140  1572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36642 (request call id 2188) took 1058 ms. Trace:
I20260709 12:59:35.687014  1717 rpcz_store.cc:276] 0709 12:59:34.380467 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.636916 (+1256449us) service_pool.cc:224] Handling call
0709 12:59:35.644845 (+  7929us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:35.685646 (+ 40801us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:35.685863 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:35.697870  1572 rpcz_store.cc:276] 0709 12:59:34.638545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.666168 (+1027623us) service_pool.cc:224] Handling call
0709 12:59:35.695723 (+ 29555us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:35.696901 (+  1178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:35.697083 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:35.689783  1570 rpcz_store.cc:276] 0709 12:59:34.650323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.040015 (+389692us) service_pool.cc:224] Handling call
0709 12:59:35.689209 (+649194us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:35.701448  1572 raft_consensus.cc:1275] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:59:35.702123  1572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36642 (request call id 2192) took 1002 ms. Trace:
I20260709 12:59:35.702534  1572 rpcz_store.cc:276] 0709 12:59:34.699432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.699651 (+1000219us) service_pool.cc:224] Handling call
0709 12:59:35.699863 (+   212us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:35.701903 (+  2040us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:35.702076 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:35.699996  1716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1921) took 1287 ms. Trace:
I20260709 12:59:35.705260  1716 rpcz_store.cc:276] 0709 12:59:34.412938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.689621 (+1276683us) service_pool.cc:224] Handling call
0709 12:59:35.690009 (+   388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:35.699518 (+  9509us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:35.699567 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:35.699631 (+    64us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:35.699698 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:35.699786 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:35.699926 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:35.712850  1567 raft_consensus.cc:1240] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:59:35.713860  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36642 (request call id 2183) took 1076 ms. Trace:
I20260709 12:59:35.714293  1567 rpcz_store.cc:276] 0709 12:59:34.637115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.638305 (+1001190us) service_pool.cc:224] Handling call
0709 12:59:35.670605 (+ 32300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:35.713489 (+ 42884us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:35.713786 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:35.718226  1574 raft_consensus.cc:1240] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:35.670837  1724 rpcz_store.cc:276] 0709 12:59:34.182894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.189347 (+  6453us) service_pool.cc:224] Handling call
0709 12:59:34.201540 (+ 12193us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:34.236824 (+ 35284us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:34.236860 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:34.303679 (+ 66819us) log.cc:844] Serialized 26 byte log entry
0709 12:59:34.711587 (+407908us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:34.711648 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:34.711747 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:35.670066 (+958319us) raft_consensus.cc:1685] finished
0709 12:59:35.670088 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:35.670212 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1391,"raft.queue_time_us":9049,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":2555,"thread_start_us":308943,"threads_started":1,"wal-append.queue_time_us":1149437}
I20260709 12:59:35.719743  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:35.720371  1724 raft_consensus.cc:1240] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:35.720542  1572 raft_consensus.cc:2468] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 4.
I20260709 12:59:35.721279  1724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 469) took 1216 ms. Trace:
W20260709 12:59:35.721663  1601 heartbeater.cc:646] Failed to heartbeat to 127.0.107.254:42827 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.0.107.254:42827 timed out after 15.000s (SENT)
I20260709 12:59:35.721686  1724 rpcz_store.cc:276] 0709 12:59:34.504818 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.719819 (+1215001us) service_pool.cc:224] Handling call
0709 12:59:35.720176 (+   357us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:35.720964 (+   788us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:35.721219 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:35.723428  1724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 470) took 1187 ms. Trace:
I20260709 12:59:35.723803  1574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 1838) took 1031 ms. Trace:
I20260709 12:59:35.723848  1724 rpcz_store.cc:276] 0709 12:59:34.536245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.722646 (+1186401us) service_pool.cc:224] Handling call
0709 12:59:35.722935 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:35.723101 (+   166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:35.723126 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:35.723166 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:35.723205 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:35.723257 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:35.723376 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:35.700542  4131 raft_consensus.cc:3055] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:35.724246  1574 rpcz_store.cc:276] 0709 12:59:34.692007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.695587 (+1003580us) service_pool.cc:224] Handling call
0709 12:59:35.717986 (+ 22399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:35.723562 (+  5576us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:35.723748 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:35.730635  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:35.732002  1723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 465) took 1309 ms. Trace:
I20260709 12:59:35.733819  1723 rpcz_store.cc:276] 0709 12:59:34.422691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.692607 (+1269916us) service_pool.cc:224] Handling call
0709 12:59:35.717263 (+ 24656us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:35.717525 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:35.717569 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:35.725184 (+  7615us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:35.731754 (+  6570us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:35.731825 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:35.731947 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:35.734895  1724 raft_consensus.cc:1275] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:59:35.736063  1724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1934) took 1077 ms. Trace:
I20260709 12:59:35.736454  1724 rpcz_store.cc:276] 0709 12:59:34.659114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.725466 (+1066352us) service_pool.cc:224] Handling call
0709 12:59:35.725722 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:35.735793 (+ 10071us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:35.736007 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:35.741833  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 58218us
I20260709 12:59:35.715873  4116 raft_consensus.cc:493] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:35.740173  1716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1922) took 1313 ms. Trace:
I20260709 12:59:35.745162  1716 rpcz_store.cc:276] 0709 12:59:34.427020 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.706529 (+1279509us) service_pool.cc:224] Handling call
0709 12:59:35.726837 (+ 20308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:35.734019 (+  7182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:35.734050 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:35.739787 (+  5737us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:35.739851 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:35.739960 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:35.740101 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:35.741788  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 392) took 1139 ms. Trace:
I20260709 12:59:35.748754  1725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 460) took 1471 ms. Trace:
I20260709 12:59:35.749892  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:35.750284  2324 raft_consensus.cc:1275] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:35.750972  1647 raft_consensus.cc:2410] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:59:35.751467  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 1401) took 1232 ms. Trace:
I20260709 12:59:35.749424  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:35.752051  1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1893) took 1569 ms. Trace:
I20260709 12:59:35.752483  1720 rpcz_store.cc:276] 0709 12:59:34.182361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.182532 (+   171us) service_pool.cc:224] Handling call
0709 12:59:35.513961 (+1331429us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:35.516027 (+  2066us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:35.751842 (+235815us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b540009bfd0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23ba8ad 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:35.751994 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3033502592}
I20260709 12:59:35.752528  2330 raft_consensus.cc:2468] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 4.
I20260709 12:59:35.743251  1615 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:35.749178  1725 rpcz_store.cc:276] 0709 12:59:34.277983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.590051 (+1312068us) service_pool.cc:224] Handling call
0709 12:59:35.748014 (+157963us) spinlock_profiling.cc:243] Waited 3.46 ms on lock 0x7b5800196e98. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef296b71 00007fa9ef296a22 00007fa9f81afc09 00007fa9f7309ee0 00007fa9f73d30ab 00007fa9f73d3131 00007fa9f7394fc0 00007fa9f737f929 00007fa9f737f3d2 00007fa9f08f6bd4
0709 12:59:35.748206 (+   192us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:35.748390 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:35.748418 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:35.748463 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:35.748503 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:35.748593 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:35.748696 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7947008}
I20260709 12:59:35.751822  1647 rpcz_store.cc:276] 0709 12:59:34.519223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.540830 (+ 21607us) service_pool.cc:224] Handling call
0709 12:59:35.749738 (+1208908us) spinlock_profiling.cc:243] Waited 1.86 ms on lock 0x7b5800181898. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef296b71 00007fa9ef296a22 00007fa9f81afc09 00007fa9f7309ee0 00007fa9f73d30ab 00007fa9f73d3131 00007fa9f73810a0 00007fa9f7380984 00007fa9f08fb6d4 00007fa9f08fb662
0709 12:59:35.751409 (+  1671us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4270464}
I20260709 12:59:35.756429  1689 leader_election.cc:304] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:35.757965  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:35.730080  4285 raft_consensus.cc:493] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:35.763712  1539 leader_election.cc:336] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Timed out: RequestConsensusVote RPC to 127.0.107.194:37391 timed out after 1.750s (SENT)
W20260709 12:59:35.764605  1539 leader_election.cc:336] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Timed out: RequestConsensusVote RPC to 127.0.107.194:37391 timed out after 1.759s (SENT)
I20260709 12:59:35.747056  1642 rpcz_store.cc:276] 0709 12:59:34.602845 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.633880 (+ 31035us) service_pool.cc:224] Handling call
0709 12:59:34.639860 (+  5980us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:34.640073 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:59:34.657787 (+ 17714us) log.cc:844] Serialized 14 byte log entry
0709 12:59:35.741385 (+1083598us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:35.741475 (+    90us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:35.741533 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:35.741613 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:35.741730 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14503,"prepare.queue_time_us":17283,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":255965,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":78,"thread_start_us":1052440,"threads_started":2,"wal-append.queue_time_us":845465}
W20260709 12:59:35.765342  1539 leader_election.cc:336] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Timed out: RequestConsensusVote RPC to 127.0.107.194:37391 timed out after 1.766s (SENT)
I20260709 12:59:35.762784  1540 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:35.732882  4131 raft_consensus.cc:740] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:35.766604  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:59:35.765319  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 269743us
I20260709 12:59:35.758803  2329 raft_consensus.cc:2468] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
I20260709 12:59:35.769582  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:35.770358  1716 raft_consensus.cc:2468] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
I20260709 12:59:35.766326  2330 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb"
dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
mode: GRACEFUL
new_leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:39778
I20260709 12:59:35.772238  4098 raft_consensus.cc:2804] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:35.772445  2330 raft_consensus.cc:606] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 LEADER]: Received request to transfer leadership to TS 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:35.772774  4098 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:35.773279  4098 raft_consensus.cc:3060] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:35.775765  1718 raft_consensus.cc:2410] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:59:35.776211  4245 raft_consensus.cc:493] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:35.776778  4245 raft_consensus.cc:515] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:35.777465  1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1917) took 1407 ms. Trace:
I20260709 12:59:35.776832  4300 consensus_queue.cc:1048] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:35.767386  1723 raft_consensus.cc:2468] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 5.
I20260709 12:59:35.777920  1718 rpcz_store.cc:276] 0709 12:59:34.369905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.515022 (+145117us) service_pool.cc:224] Handling call
0709 12:59:35.777232 (+1262210us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b540007f154. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:35.777392 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2896494976}
I20260709 12:59:35.778573  4250 leader_election.cc:290] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:35.777977  4303 log.cc:927] Time spent T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 12:59:35.760156  4116 raft_consensus.cc:515] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:35.797325  4131 consensus_queue.cc:260] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:35.760394  4304 raft_consensus.cc:493] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:35.741792  4313 raft_consensus.cc:493] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:35.799345  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:35.799830  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:35.815804  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:35.803009  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:59:35.803365  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 383841us
I20260709 12:59:35.803804  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:35.818018  1720 raft_consensus.cc:2393] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 7: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
W20260709 12:59:35.804611  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 365020us
I20260709 12:59:35.806447  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:35.797863  4190 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:35.822429  1718 raft_consensus.cc:2393] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 6: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:35.814625  1540 leader_election.cc:304] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:35.809463  1724 raft_consensus.cc:1275] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
W20260709 12:59:35.809728  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 53375.1us
I20260709 12:59:35.823194  1724 pending_rounds.cc:85] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4: Aborting all ops after (but not including) 3
I20260709 12:59:35.823467  1724 pending_rounds.cc:107] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:59:35.823755  1724 raft_consensus.cc:2889] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:35.823851  1689 leader_election.cc:304] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:35.819514  1716 raft_consensus.cc:2468] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6.
I20260709 12:59:35.759939  4210 consensus_queue.cc:1059] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 12:59:35.812978  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36640 (request call id 1834) took 1191 ms. Trace:
I20260709 12:59:35.828014  1569 rpcz_store.cc:276] 0709 12:59:34.621177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:34.680662 (+ 59485us) service_pool.cc:224] Handling call
0709 12:59:35.812771 (+1132109us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b5400245754. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:35.812907 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":498859904}
I20260709 12:59:35.798480  4314 raft_consensus.cc:2804] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:59:35.825863  1617 leader_election.cc:336] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.621s (SENT)
W20260709 12:59:35.830871  1617 leader_election.cc:336] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.659s (SENT)
W20260709 12:59:35.815320  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 244714us
I20260709 12:59:35.798465  4245 leader_election.cc:290] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 12:59:35.897028  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 64941.1us
W20260709 12:59:35.819660  4219 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.900s	user 0.008s	sys 0.008s
I20260709 12:59:35.901047  1688 leader_election.cc:400] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 election: Vote denied by peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391) with higher term. Message: Invalid argument: T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 4. Current term is 5.
I20260709 12:59:35.901463  1688 leader_election.cc:403] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
W20260709 12:59:35.898738  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 67473.6us
I20260709 12:59:35.763173  4310 consensus_queue.cc:1059] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 12:59:35.778434  4285 raft_consensus.cc:515] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:35.905324  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 74487.5us
I20260709 12:59:35.825073  4083 raft_consensus.cc:2749] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:35.911437  2329 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c"
dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
mode: GRACEFUL
new_leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:39778
I20260709 12:59:35.827528  4037 raft_consensus.cc:2804] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:35.921818  4037 raft_consensus.cc:493] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:35.922289  4037 raft_consensus.cc:3060] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:35.925508  1642 raft_consensus.cc:1275] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:59:35.801893  4214 consensus_queue.cc:237] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:35.895998  4314 raft_consensus.cc:493] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:35.825594  4106 leader_election.cc:290] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:35.913590  1617 leader_election.cc:336] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.083s (SENT)
I20260709 12:59:35.896292  4131 raft_consensus.cc:3060] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:35.916713  4082 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:35.917207  4309 log.cc:927] Time spent T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:59:35.918797  1724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1937) took 1258 ms. Trace:
I20260709 12:59:35.963958  1724 rpcz_store.cc:276] 0709 12:59:34.660032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.737258 (+1077226us) service_pool.cc:224] Handling call
0709 12:59:35.803134 (+ 65876us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:35.829790 (+ 26656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:35.918589 (+ 88799us) spinlock_profiling.cc:243] Waited 65.6 ms on lock 0x7b540007f150. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23ba8ad 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:35.918738 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":150775552}
I20260709 12:59:35.919282  4129 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:35.920337  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:35.968325  1648 raft_consensus.cc:2468] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 4.
W20260709 12:59:35.969060  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:35.920998  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:35.970090  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 12:59:35.925635  4289 log.cc:927] Time spent T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 1.554s	user 0.005s	sys 0.019s
W20260709 12:59:35.912279  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 88514.7us
I20260709 12:59:35.952190  4083 raft_consensus.cc:2749] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391) with higher term. Message: Invalid argument: T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 4. Current term is 5.
I20260709 12:59:35.828609  4190 raft_consensus.cc:2764] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:59:36.005990  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 12:59:35.933508  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 108128us
I20260709 12:59:36.007551  1688 leader_election.cc:304] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:35.934163  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:35.936056  1644 raft_consensus.cc:1275] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:59:35.954550  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:35.815532  4250 consensus_queue.cc:1048] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.098s
I20260709 12:59:35.961961  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:35.962313  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:36.017836  2328 raft_consensus.cc:2468] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 4.
I20260709 12:59:35.967628  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
W20260709 12:59:35.985131  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 71565.1us
W20260709 12:59:36.019109  1617 leader_election.cc:336] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.129s (SENT)
I20260709 12:59:36.019577  1617 leader_election.cc:304] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 12:59:35.901194  4219 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.987s	user 0.009s	sys 0.009s
I20260709 12:59:35.950736  4314 raft_consensus.cc:3060] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:35.991931  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 227544us
I20260709 12:59:36.007014  1573 raft_consensus.cc:2468] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 6.
I20260709 12:59:36.015607  2325 raft_consensus.cc:1240] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 5. Current term is 6. Ops: []
W20260709 12:59:35.985741  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:36.009544  1647 raft_consensus.cc:2376] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 5. Re-sending same reply.
I20260709 12:59:35.828963  4304 raft_consensus.cc:515] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:36.031970  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:36.051285  1567 raft_consensus.cc:2468] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 4.
I20260709 12:59:36.021468  1542 leader_election.cc:304] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:36.023094  1688 leader_election.cc:304] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:35.825991  4313 raft_consensus.cc:515] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:35.955047  4124 consensus_queue.cc:1059] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:59:36.058283  1650 raft_consensus.cc:2468] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 6.
I20260709 12:59:36.034402  1642 raft_consensus.cc:2468] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 4.
I20260709 12:59:36.048374  2294 leader_election.cc:304] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:35.967275  4300 consensus_queue.cc:1048] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.078s
I20260709 12:59:36.050524  4310 raft_consensus.cc:2804] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:59:36.104715  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 85641.6us
I20260709 12:59:36.007006  4106 consensus_queue.cc:1048] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.084s
I20260709 12:59:36.103446  4083 raft_consensus.cc:2804] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:36.106652  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 12:59:36.119144  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 73332.7us
I20260709 12:59:36.120112  1615 leader_election.cc:304] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:36.100831  4310 raft_consensus.cc:493] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:36.135457  1615 leader_election.cc:304] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:36.127473  4083 raft_consensus.cc:697] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 7 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:36.073040  4190 consensus_queue.cc:1048] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 12:59:36.140933  4310 raft_consensus.cc:3060] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:36.124126  4245 consensus_queue.cc:1048] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:59:36.142254  4241 raft_consensus.cc:493] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:36.181140  1575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 1826) took 1638 ms. Trace:
I20260709 12:59:36.182682  1575 rpcz_store.cc:276] 0709 12:59:34.542477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.553464 (+1010987us) service_pool.cc:224] Handling call
0709 12:59:35.583538 (+ 30074us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:35.589581 (+  6043us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:59:35.914952 (+325371us) log.cc:844] Serialized 14 byte log entry
0709 12:59:36.179383 (+264431us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:36.179588 (+   205us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:36.179990 (+   402us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:36.180192 (+   202us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:36.180839 (+   647us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3034,"prepare.queue_time_us":213678,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"thread_start_us":515761,"threads_started":2}
I20260709 12:59:36.190359  4286 raft_consensus.cc:3055] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:36.190819  4286 raft_consensus.cc:740] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
W20260709 12:59:36.194409  1539 leader_election.cc:336] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Timed out: RequestConsensusVote RPC to 127.0.107.194:37391 timed out after 2.011s (SENT)
W20260709 12:59:36.195240  1539 leader_election.cc:336] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Timed out: RequestConsensusVote RPC to 127.0.107.194:37391 timed out after 2.139s (SENT)
I20260709 12:59:36.195636  1539 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:36.197429  1571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36642 (request call id 2185) took 1538 ms. Trace:
I20260709 12:59:36.197916  1571 rpcz_store.cc:276] 0709 12:59:34.637676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.657083 (+1019407us) service_pool.cc:224] Handling call
0709 12:59:35.657421 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:35.657855 (+   434us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:35.657898 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:35.658398 (+   500us) log.cc:844] Serialized 26 byte log entry
0709 12:59:35.723094 (+ 64696us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:36.005923 (+282829us) log.cc:844] Serialized 14 byte log entry
0709 12:59:36.176144 (+170221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:36.176236 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:36.176293 (+    57us) raft_consensus.cc:1685] finished
0709 12:59:36.176313 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:36.176486 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31546,"prepare.queue_time_us":85135,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":84359,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":1989,"thread_start_us":470692,"threads_started":3,"wal-append.queue_time_us":95134}
W20260709 12:59:36.188165  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 275451us
I20260709 12:59:36.160180  4116 leader_election.cc:290] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:36.161209  4319 raft_consensus.cc:2749] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:36.171602  4287 raft_consensus.cc:2804] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:59:36.217240  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:36.222111  1576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 1823) took 1681 ms. Trace:
I20260709 12:59:36.218412  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 12:59:36.214746  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 191743us
I20260709 12:59:36.192166  4300 raft_consensus.cc:2749] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:36.223235  2295 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:36.220285  1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 466) took 1797 ms. Trace:
I20260709 12:59:36.229463  1642 raft_consensus.cc:1275] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:59:36.231849  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:36.188771  4312 raft_consensus.cc:2764] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:59:36.241926  1642 raft_consensus.cc:2468] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 6.
W20260709 12:59:36.234478  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 103878us
I20260709 12:59:36.227149  1721 rpcz_store.cc:276] 0709 12:59:34.423048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.698472 (+1275424us) service_pool.cc:224] Handling call
0709 12:59:35.721862 (+ 23390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:35.722083 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:59:36.005691 (+283608us) log.cc:844] Serialized 14 byte log entry
0709 12:59:36.219867 (+214176us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:36.219921 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:59:36.219974 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:36.220062 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:36.220217 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8412,"prepare.queue_time_us":298056,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":6446,"thread_start_us":471134,"threads_started":3,"wal-append.queue_time_us":191754}
I20260709 12:59:36.255102  1615 leader_election.cc:304] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 12:59:36.249763  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 54544.2us
I20260709 12:59:36.258744  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:36.258970  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:36.259460  1650 raft_consensus.cc:2468] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 6.
I20260709 12:59:36.259842  1648 raft_consensus.cc:2468] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 5.
I20260709 12:59:36.222539  1576 rpcz_store.cc:276] 0709 12:59:34.541056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.534498 (+993442us) service_pool.cc:224] Handling call
0709 12:59:35.534820 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:35.548247 (+ 13427us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:59:35.823602 (+275355us) log.cc:844] Serialized 14 byte log entry
0709 12:59:36.221365 (+397763us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:36.221819 (+   454us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:36.221868 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:36.221938 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:36.222057 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":259321,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":51,"raft.queue_time_us":157765,"thread_start_us":525727,"threads_started":3,"wal-append.queue_time_us":254581}
I20260709 12:59:36.284715  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:36.263660  2295 leader_election.cc:304] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:36.287563  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:59:36.325325  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 182182us
W20260709 12:59:36.329610  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 66035.1us
W20260709 12:59:36.288206  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 239896us
W20260709 12:59:36.332826  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 340310us
I20260709 12:59:36.295797  4219 raft_consensus.cc:2804] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:36.196158  4241 raft_consensus.cc:515] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:36.228477  4129 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:36.298411  4319 raft_consensus.cc:2804] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:59:36.298858  4275 consensus_meta.cc:287] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.602s	user 0.009s	sys 0.000s
I20260709 12:59:36.302083  4083 consensus_queue.cc:237] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:36.253361  4287 raft_consensus.cc:697] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:36.258760  4285 leader_election.cc:290] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:36.330072  1647 raft_consensus.cc:1275] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:59:36.334084  1575 raft_consensus.cc:2468] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 6.
I20260709 12:59:36.295367  4116 raft_consensus.cc:2749] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:59:36.365268  4342 log.cc:927] Time spent T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:59:36.273329  2297 leader_election.cc:304] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 12:59:36.345283  1617 leader_election.cc:304] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:36.347966  1542 leader_election.cc:304] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
W20260709 12:59:36.357298  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:36.378146  1725 raft_consensus.cc:2410] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 12:59:36.379161  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 47658.7us
I20260709 12:59:36.380026  2294 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:36.338246  4219 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:36.339587  4145 raft_consensus.cc:2804] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:59:36.381287  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 119533us
W20260709 12:59:36.383096  4333 log.cc:927] Time spent T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 12:59:36.383307  4285 raft_consensus.cc:2804] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:36.383414  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:36.364106  4287 consensus_queue.cc:237] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:36.384240  4329 log.cc:927] Time spent T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.163s	user 0.000s	sys 0.001s
I20260709 12:59:36.384958  4348 raft_consensus.cc:2749] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:59:36.385968  4322 log.cc:927] Time spent T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:59:36.386023  4056 raft_consensus.cc:2804] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:36.347324  4319 raft_consensus.cc:493] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:36.102942  4327 consensus_queue.cc:1059] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:36.343462  4320 consensus_queue.cc:1048] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:59:36.420805  1647 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:36.383890  4241 leader_election.cc:290] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:36.437325  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 448556us
I20260709 12:59:36.504566  1689 leader_election.cc:304] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:36.506245  1689 leader_election.cc:304] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
W20260709 12:59:36.443845  4037 consensus_meta.cc:287] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.521s	user 0.011s	sys 0.000s
W20260709 12:59:36.480108  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:36.391624  4219 raft_consensus.cc:3060] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:36.391301  4145 raft_consensus.cc:493] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:36.357640  4275 raft_consensus.cc:515] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:36.495323  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 240289us
I20260709 12:59:36.427399  4285 raft_consensus.cc:493] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:36.538524  4037 raft_consensus.cc:515] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:36.494568  4319 raft_consensus.cc:3060] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:36.487681  4056 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:36.484990  4346 raft_consensus.cc:2749] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:36.557602  1573 raft_consensus.cc:2393] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 6: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:36.557878  4056 raft_consensus.cc:3060] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:36.559861  4275 leader_election.cc:290] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:36.561852  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:36.562490  1648 raft_consensus.cc:3060] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:36.566821  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 226371us
I20260709 12:59:36.567651  1542 leader_election.cc:304] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:36.568742  4241 raft_consensus.cc:2804] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:36.568934  1542 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:36.569212  4241 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:36.569671  4241 raft_consensus.cc:3060] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:36.570302  1542 leader_election.cc:304] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:59:36.572721  4301 raft_consensus.cc:2749] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:36.573594  4301 raft_consensus.cc:2804] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:36.574021  4301 raft_consensus.cc:493] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:36.574555  4301 raft_consensus.cc:3060] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:36.573923  4286 consensus_queue.cc:260] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:36.575218  4286 raft_consensus.cc:3060] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:36.555994  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:36.549407  4131 raft_consensus.cc:493] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:36.578088  4314 consensus_meta.cc:287] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.506s	user 0.007s	sys 0.000s
I20260709 12:59:36.578493  4131 raft_consensus.cc:515] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:36.578588  4314 raft_consensus.cc:515] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:36.538566  4331 log.cc:927] Time spent T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260709 12:59:36.577888  2325 raft_consensus.cc:3060] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:36.547066  4145 raft_consensus.cc:3060] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:36.552285  4313 leader_election.cc:290] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:36.544766  4250 raft_consensus.cc:2749] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:59:36.555727  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:36.546156  4338 raft_consensus.cc:2749] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:36.551935  1719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1914) took 2182 ms. Trace:
I20260709 12:59:36.555256  4285 raft_consensus.cc:3060] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:36.583379  1719 rpcz_store.cc:276] 0709 12:59:34.369096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.627282 (+1258186us) service_pool.cc:224] Handling call
0709 12:59:35.627610 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:35.644853 (+ 17243us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:35.644887 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:35.671193 (+ 26306us) log.cc:844] Serialized 26 byte log entry
0709 12:59:36.169271 (+498078us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:59:36.169329 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:36.169419 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:36.551667 (+382248us) raft_consensus.cc:1685] finished
0709 12:59:36.551696 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:36.551861 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":100150,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":135,"thread_start_us":450034,"threads_started":1,"wal-append.queue_time_us":488480}
I20260709 12:59:36.575915  4319 raft_consensus.cc:515] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:36.583817  4314 leader_election.cc:290] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:36.557524  4304 leader_election.cc:290] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:36.555807  4337 log.cc:927] Time spent T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
W20260709 12:59:36.596258  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 49301.2us
I20260709 12:59:36.543200  1617 leader_election.cc:304] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:36.597452  1542 leader_election.cc:304] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
W20260709 12:59:36.599557  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:36.600000  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:36.602363  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:36.603493  1615 leader_election.cc:304] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:36.612658  1648 raft_consensus.cc:2468] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 6.
W20260709 12:59:36.614053  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 220814us
I20260709 12:59:36.615252  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:36.615511  4353 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:36.615693  2332 raft_consensus.cc:1240] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 LEADER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:36.615940  2324 raft_consensus.cc:2468] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 6.
I20260709 12:59:36.616132  4353 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:36.616843  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:36.617506  1646 raft_consensus.cc:2468] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 4.
I20260709 12:59:36.618742  4355 raft_consensus.cc:2804] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:36.619180  4338 raft_consensus.cc:493] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:36.619803  4338 raft_consensus.cc:515] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:36.622035  4338 leader_election.cc:290] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:36.619237  4355 raft_consensus.cc:493] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:36.622464  4056 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:36.622874  4355 raft_consensus.cc:3060] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:36.624979  4037 leader_election.cc:290] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:36.625298  4313 consensus_queue.cc:1059] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:36.621548  1615 leader_election.cc:304] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:59:36.630990  1647 raft_consensus.cc:2468] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 6.
I20260709 12:59:36.632490  2325 raft_consensus.cc:2468] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 7.
I20260709 12:59:36.631363  1542 leader_election.cc:304] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:36.603883  4116 raft_consensus.cc:2804] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:36.634877  4116 raft_consensus.cc:493] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:36.635274  4116 raft_consensus.cc:3060] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:36.635345  4250 raft_consensus.cc:493] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:36.636617  1689 connection.cc:256] RPC call timeout handler was delayed by -1.5531656880000355s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1509s for a response
W20260709 12:59:36.637070  1689 connection.cc:256] RPC call timeout handler was delayed by -1.5468656880000253s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1516s for a response
W20260709 12:59:36.637435  1689 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:36.637913  1689 connection.cc:256] RPC call timeout handler was delayed by -1.3974656880000111s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16820000000000002s for a response
W20260709 12:59:36.638242  1689 connection.cc:256] RPC call timeout handler was delayed by -1.3947656880000068s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1685s for a response
W20260709 12:59:36.638556  1689 connection.cc:256] RPC call timeout handler was delayed by -1.3686656880000214s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1714s for a response
W20260709 12:59:36.638940  1689 connection.cc:256] RPC call timeout handler was delayed by -1.3650656880000156s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1718s for a response
W20260709 12:59:36.639253  1689 connection.cc:256] RPC call timeout handler was delayed by -1.3533656879999967s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17310000000000003s for a response
W20260709 12:59:36.639560  1689 connection.cc:256] RPC call timeout handler was delayed by -1.3218656880000026s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1766s for a response
W20260709 12:59:36.639868  1689 connection.cc:256] RPC call timeout handler was delayed by -1.2957656880000172s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1795s for a response
W20260709 12:59:36.640167  1689 connection.cc:256] RPC call timeout handler was delayed by -1.2831656879999969s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1809s for a response
I20260709 12:59:36.635972  4250 raft_consensus.cc:515] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 12:59:36.642402  4250 leader_election.cc:290] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373)
I20260709 12:59:36.642890  4250 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:36.643313  4250 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:36.640455  1689 connection.cc:256] RPC call timeout handler was delayed by -1.2489656879999984s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1847s for a response
W20260709 12:59:36.646243  1689 connection.cc:256] RPC call timeout handler was delayed by -1.1112656880000031s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2s for a response
W20260709 12:59:36.646622  1689 connection.cc:256] RPC call timeout handler was delayed by -1.1103656880000017s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2001s for a response
W20260709 12:59:36.647112  1689 connection.cc:256] RPC call timeout handler was delayed by -1.0788656880000076s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2036s for a response
W20260709 12:59:36.647531  1689 connection.cc:256] RPC call timeout handler was delayed by -1.0599656880000339s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2057s for a response
W20260709 12:59:36.647931  1689 connection.cc:256] RPC call timeout handler was delayed by -1.0392656880000004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20800000000000002s for a response
W20260709 12:59:36.648319  1689 connection.cc:256] RPC call timeout handler was delayed by -1.0140656880000165s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21080000000000002s for a response
I20260709 12:59:36.622799  4353 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:36.663712  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:36.665346  1615 leader_election.cc:304] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:36.666280  1689 leader_election.cc:304] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:36.634014  4327 raft_consensus.cc:2749] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:36.668799  4241 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:36.675782  1615 leader_election.cc:304] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:36.669210  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:59:36.670781  4270 consensus_meta.cc:287] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 1.009s	user 0.006s	sys 0.008s
W20260709 12:59:36.671685  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 176423us
I20260709 12:59:36.672015  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:36.677099  1646 raft_consensus.cc:2468] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 6.
W20260709 12:59:36.677805  1717 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.006s	sys 0.002s
W20260709 12:59:36.682826  1717 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.006s	sys 0.002s
I20260709 12:59:36.683548  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 468) took 2260 ms. Trace:
I20260709 12:59:36.683719  1615 leader_election.cc:304] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:36.683971  1717 rpcz_store.cc:276] 0709 12:59:34.423584 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.698811 (+1275227us) service_pool.cc:224] Handling call
0709 12:59:35.699097 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:35.703316 (+  4219us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:59:35.931124 (+227808us) log.cc:844] Serialized 14 byte log entry
0709 12:59:36.683211 (+752087us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:36.683263 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:36.683312 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:36.683377 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:36.683495 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":263318,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":41,"raft.queue_time_us":163204,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":23527,"thread_start_us":885063,"threads_started":3,"wal-append.queue_time_us":327327}
I20260709 12:59:36.663288  4131 leader_election.cc:290] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:36.661839  4338 raft_consensus.cc:493] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:36.689000  1617 leader_election.cc:304] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:36.663192  4304 raft_consensus.cc:2804] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:36.690099  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:36.689714  1615 leader_election.cc:304] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:36.698705  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:59:36.698840  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 67571.3us
I20260709 12:59:36.700420  1720 raft_consensus.cc:2468] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 5.
I20260709 12:59:36.701063  1542 leader_election.cc:304] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:36.681928  4319 leader_election.cc:290] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:36.686219  4056 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:36.687255  4353 raft_consensus.cc:2804] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:36.719308  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:36.722114  1646 raft_consensus.cc:3060] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:36.718665  1542 leader_election.cc:304] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
W20260709 12:59:36.720086  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 63078.8us
I20260709 12:59:36.726419  1689 leader_election.cc:304] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:36.726531  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:36.729473  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 12:59:36.737497  2295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:36.702167  4327 raft_consensus.cc:2804] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:36.690716  4347 raft_consensus.cc:2804] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:36.699286  4275 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:36.699443  4304 raft_consensus.cc:493] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:36.771673  4304 raft_consensus.cc:3060] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:36.773861  4301 raft_consensus.cc:515] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:36.705411  4270 raft_consensus.cc:2804] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:36.748996  2295 leader_election.cc:304] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:36.727226  4312 raft_consensus.cc:3055] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:59:36.753284  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:36.770082  2294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:36.784993  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:36.716025  4349 raft_consensus.cc:3060] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:36.717139  4364 raft_consensus.cc:493] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:36.791319  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 109819us
W20260709 12:59:36.799829  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 50913.7us
I20260709 12:59:36.738550  4330 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:36.800410  1617 leader_election.cc:304] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:36.721410  4353 raft_consensus.cc:493] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:36.796880  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:36.802796  2294 leader_election.cc:304] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:36.699133  4338 raft_consensus.cc:515] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:36.690646  4341 consensus_queue.cc:1059] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.085s
I20260709 12:59:36.747830  4351 raft_consensus.cc:2749] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:59:36.813431  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 87117.3us
W20260709 12:59:36.834357  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 134457us
I20260709 12:59:36.839520  1646 raft_consensus.cc:2468] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 5.
I20260709 12:59:36.799173  1688 leader_election.cc:304] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:36.768862  4131 raft_consensus.cc:2749] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:36.781018  4327 raft_consensus.cc:697] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 5 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:36.769827  4347 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:36.816262  1617 leader_election.cc:304] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:36.805724  4056 raft_consensus.cc:2804] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:59:36.821291  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 102710us
I20260709 12:59:36.843346  4366 raft_consensus.cc:2749] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:36.834131  4241 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:36.843911  4345 consensus_queue.cc:1048] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 12:59:36.845206  1724 raft_consensus.cc:1275] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:59:36.845279  4338 leader_election.cc:290] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:36.795214  4270 raft_consensus.cc:493] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:36.792309  4312 raft_consensus.cc:740] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:36.877161  4312 consensus_queue.cc:260] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:36.879024  4312 raft_consensus.cc:3060] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:36.805527  4353 raft_consensus.cc:3060] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:36.854297  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:36.841806  4098 consensus_meta.cc:287] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 1.068s	user 0.014s	sys 0.003s
I20260709 12:59:36.885890  4301 leader_election.cc:290] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:36.885771  4098 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:36.886417  4346 raft_consensus.cc:2804] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:36.886970  4346 raft_consensus.cc:493] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:36.887322  4346 raft_consensus.cc:3060] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:36.887605  1568 raft_consensus.cc:2393] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 5: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:36.857138  4347 raft_consensus.cc:3060] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:36.792744  4275 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:36.890038  4275 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:36.845801  4334 raft_consensus.cc:2749] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:36.891103  4219 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:36.820724  4250 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:36.859807  1689 leader_election.cc:304] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:36.866303  1542 leader_election.cc:304] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:36.805779  4356 consensus_queue.cc:1048] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:59:36.857301  4056 raft_consensus.cc:493] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:36.860209  4083 raft_consensus.cc:2804] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:36.875948  4270 raft_consensus.cc:3060] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:36.862789  4348 raft_consensus.cc:2804] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:36.892764  4366 raft_consensus.cc:493] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:36.864537  4362 raft_consensus.cc:2804] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:36.805689  4364 raft_consensus.cc:515] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:36.928439  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 62222.7us
W20260709 12:59:36.928848  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 93872.5us
I20260709 12:59:36.867580  4339 raft_consensus.cc:2749] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:36.814785  4330 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:36.896133  4056 raft_consensus.cc:3060] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:36.940169  4366 raft_consensus.cc:515] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:36.941128  4362 raft_consensus.cc:697] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:36.923846  4334 raft_consensus.cc:2804] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:36.993456  4334 raft_consensus.cc:493] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:36.994029  4334 raft_consensus.cc:3060] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:36.923636  4083 raft_consensus.cc:493] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:36.943151  4364 leader_election.cc:290] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:36.943658  1542 leader_election.cc:304] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:59:36.995138  4083 raft_consensus.cc:3060] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:36.995872  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 57875.3us
I20260709 12:59:36.944315  1689 leader_election.cc:304] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 12:59:36.997165  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 52948.4us
I20260709 12:59:36.997973  1689 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:36.999706  1689 leader_election.cc:304] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:36.941154  4219 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:36.953027  4098 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:37.001286  4339 raft_consensus.cc:2804] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:37.001535  1573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37682 (request call id 463) took 1007 ms. Trace:
I20260709 12:59:37.001740  4339 raft_consensus.cc:493] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:37.002209  4339 raft_consensus.cc:3060] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:37.001955  1573 rpcz_store.cc:276] 0709 12:59:35.994025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:36.091082 (+ 97057us) service_pool.cc:224] Handling call
0709 12:59:37.001350 (+910268us) spinlock_profiling.cc:243] Waited 439 ms on lock 0x7b5400103954. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:37.001479 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1009088896}
I20260709 12:59:37.002816  4348 raft_consensus.cc:493] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:37.003238  4348 raft_consensus.cc:3060] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:36.954242  1716 raft_consensus.cc:3055] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:37.004700  1716 raft_consensus.cc:740] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
W20260709 12:59:36.957226  4361 log.cc:927] Time spent T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:59:36.895891  4250 raft_consensus.cc:2749] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:36.965849  4335 raft_consensus.cc:3055] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:36.966985  4355 raft_consensus.cc:515] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:36.968040  4327 consensus_queue.cc:237] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:36.859702  4145 raft_consensus.cc:515] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:36.971240  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:36.971915  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 96373.7us
I20260709 12:59:36.978618  4285 raft_consensus.cc:515] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:36.982800  1721 raft_consensus.cc:1240] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:36.991014  4366 leader_election.cc:290] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:59:37.041364  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:36.992069  4362 consensus_queue.cc:237] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:37.000838  4338 raft_consensus.cc:2749] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:37.005055  1542 leader_election.cc:304] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
W20260709 12:59:37.058952  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 262164us
I20260709 12:59:37.059456  1725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1338) took 1315 ms. Trace:
W20260709 12:59:36.939798  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 137082us
I20260709 12:59:37.019232  1689 leader_election.cc:304] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:37.016438  4335 raft_consensus.cc:740] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:37.010295  4245 raft_consensus.cc:2749] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:37.059981  1716 consensus_queue.cc:260] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:37.021862  3945 tablet_bootstrap.cc:492] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
W20260709 12:59:37.049533  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 249043us
W20260709 12:59:37.081645  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 76657.4us
W20260709 12:59:37.067358  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 268201us
W20260709 12:59:37.055461  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 220377us
I20260709 12:59:37.024492  1617 leader_election.cc:304] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:37.059932  1725 rpcz_store.cc:276] 0709 12:59:35.744501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.755487 (+ 10986us) service_pool.cc:224] Handling call
0709 12:59:37.059265 (+1303778us) spinlock_profiling.cc:243] Waited 552 ms on lock 0x7b5400203d54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:37.059396 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1269690752}
I20260709 12:59:37.061435  2294 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:36.984696  4116 raft_consensus.cc:515] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:37.107309  1716 raft_consensus.cc:3060] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:37.076416  2332 raft_consensus.cc:2393] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 6: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 12:59:37.082387  1542 leader_election.cc:304] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:37.084815  4360 raft_consensus.cc:2749] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:37.085703  3945 tablet_bootstrap.cc:492] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66: Bootstrap complete.
I20260709 12:59:37.009790  4124 raft_consensus.cc:3055] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:37.016412  4345 raft_consensus.cc:2804] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:37.087232  4037 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:37.086696  4335 consensus_queue.cc:260] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:37.087692  4056 raft_consensus.cc:515] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:37.089694  4347 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:37.093143  1719 raft_consensus.cc:1275] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 12:59:37.133411  1719 pending_rounds.cc:85] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4: Aborting all ops after (but not including) 5
I20260709 12:59:37.093673  4353 raft_consensus.cc:515] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:37.098533  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:37.133713  1719 pending_rounds.cc:107] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:59:37.134073  1719 raft_consensus.cc:2889] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:37.134279  1717 raft_consensus.cc:2393] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 6: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:59:37.099757  4356 raft_consensus.cc:993] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66: : Instructing follower 89ac9d5e2fbc4536b03a1ff1dd3eb226 to start an election
I20260709 12:59:37.101671  4355 leader_election.cc:290] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:37.106145  1615 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 12:59:37.108505  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 47188.2us
I20260709 12:59:37.082530  1688 leader_election.cc:304] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:37.144867  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:37.145640  2330 raft_consensus.cc:2393] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 5: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 12:59:37.113607  4153 raft_consensus.cc:2804] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:59:37.075569  4361 log.cc:927] Time spent T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 12:59:37.114614  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 95490.1us
I20260709 12:59:37.169767  1615 leader_election.cc:304] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:37.171581  1689 leader_election.cc:304] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:37.172058  2294 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
W20260709 12:59:37.114930  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 90532.6us
I20260709 12:59:37.067459  4098 raft_consensus.cc:2804] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:37.116359  1542 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
W20260709 12:59:37.111984  4310 consensus_meta.cc:287] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.924s	user 0.013s	sys 0.000s
I20260709 12:59:37.104218  4270 raft_consensus.cc:515] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:37.136992  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:37.113353  4301 raft_consensus.cc:2749] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:37.048838  4250 raft_consensus.cc:493] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:37.146809  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 64391.9us
I20260709 12:59:37.114563  4124 raft_consensus.cc:740] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:37.119519  4190 raft_consensus.cc:2804] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:59:37.169788  1539 leader_election.cc:336] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Timed out: RequestConsensusVote RPC to 127.0.107.194:37391 timed out after 2.154s (SENT)
I20260709 12:59:37.184548  1539 leader_election.cc:304] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
W20260709 12:59:37.184849  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 68558.1us
I20260709 12:59:37.117439  4345 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
W20260709 12:59:37.174367  2295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:37.182924  1688 leader_election.cc:304] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:59:37.115252  4370 consensus_queue.cc:1048] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 12:59:37.133708  4349 raft_consensus.cc:2749] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:37.170518  3945 ts_tablet_manager.cc:1403] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66: Time spent bootstrapping tablet: real 4.987s	user 0.068s	sys 0.065s
I20260709 12:59:37.185636  1542 leader_election.cc:304] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:37.174824  4356 raft_consensus.cc:1081] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 LEADER]: Signalling peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 to start an election
W20260709 12:59:37.188740  1539 leader_election.cc:336] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Timed out: RequestConsensusVote RPC to 127.0.107.194:37391 timed out after 2.204s (SENT)
I20260709 12:59:37.189677  1689 leader_election.cc:304] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:37.175261  4355 raft_consensus.cc:2804] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:37.175948  4245 raft_consensus.cc:2749] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:37.173583  4131 raft_consensus.cc:2804] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:37.201278  4131 raft_consensus.cc:493] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:37.201689  4131 raft_consensus.cc:3060] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:37.181169  4310 raft_consensus.cc:515] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:37.135187  4037 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:59:37.204217  4348 raft_consensus.cc:515] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:37.205019  4286 raft_consensus.cc:2804] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:37.206151  4037 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:37.207852  4347 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:37.175014  4098 raft_consensus.cc:493] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:37.208576  4098 raft_consensus.cc:3060] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:37.209431  4353 leader_election.cc:290] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:37.186515  4241 raft_consensus.cc:2764] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:59:37.211139  4339 raft_consensus.cc:515] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:37.175313  4313 raft_consensus.cc:2749] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:37.184288  4190 raft_consensus.cc:493] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:37.194624  1542 leader_election.cc:304] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:37.213289  4190 raft_consensus.cc:3060] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:37.213493  4285 leader_election.cc:290] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:37.180039  4335 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:37.196013  1539 leader_election.cc:304] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:37.187803  4345 raft_consensus.cc:3060] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:37.186718  4153 raft_consensus.cc:697] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:37.217432  4153 consensus_queue.cc:237] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:37.218182  1469 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55606 (request call id 269) took 17041 ms (client timeout 15000 ms). Trace:
I20260709 12:59:37.201593  4377 raft_consensus.cc:2749] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:37.219154  4355 raft_consensus.cc:697] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 5 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:37.206081  4270 leader_election.cc:290] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:37.175086  4373 raft_consensus.cc:2804] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:37.206529  4348 leader_election.cc:290] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:37.198421  1688 leader_election.cc:304] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:37.208896  4124 consensus_queue.cc:260] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:37.231999  1688 leader_election.cc:304] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:37.227221  4157 raft_consensus.cc:3060] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:37.190642  4338 consensus_queue.cc:1048] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:59:37.240437  4377 raft_consensus.cc:2804] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:37.241065  4377 raft_consensus.cc:493] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:37.241585  4377 raft_consensus.cc:3060] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:37.242329  4145 leader_election.cc:290] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:37.186693  4250 raft_consensus.cc:515] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:37.244830  4353 raft_consensus.cc:2804] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:37.245350  4353 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:37.245689  4250 leader_election.cc:290] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:37.245812  4353 raft_consensus.cc:3060] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:37.246737  4330 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:37.247975  4037 raft_consensus.cc:2749] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:37.190949  4360 raft_consensus.cc:2804] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:37.248721  4360 raft_consensus.cc:493] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:37.248769  4313 consensus_queue.cc:1048] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:37.179600  1615 leader_election.cc:304] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:37.249523  4241 raft_consensus.cc:2749] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:59:37.186829  4351 raft_consensus.cc:2749] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:59:37.250113  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 70736.2us
I20260709 12:59:37.250394  4313 raft_consensus.cc:2749] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:37.221988  4301 raft_consensus.cc:2749] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:37.250883  1615 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:37.199144  4304 raft_consensus.cc:515] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:37.252820  4347 raft_consensus.cc:2764] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:59:37.253158  4304 leader_election.cc:290] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:37.255237  1573 raft_consensus.cc:1275] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:59:37.256311  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:37.256974  1568 raft_consensus.cc:2468] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 5.
I20260709 12:59:37.259992  4338 raft_consensus.cc:493] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:37.220230  4355 consensus_queue.cc:237] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:59:37.264766  1689 leader_election.cc:304] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 12:59:37.265808  1615 connection.cc:256] RPC call timeout handler was delayed by -1.0963588050000226s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18180000000000002s for a response
W20260709 12:59:37.266201  1615 connection.cc:256] RPC call timeout handler was delayed by -1.034258804999979s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1887s for a response
I20260709 12:59:37.268798  1716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 473) took 1540 ms. Trace:
I20260709 12:59:37.238173  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:37.270243  1646 raft_consensus.cc:2468] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 5.
I20260709 12:59:37.238943  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:37.270006  1716 rpcz_store.cc:276] 0709 12:59:35.728343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.825347 (+ 97004us) service_pool.cc:224] Handling call
0709 12:59:35.906260 (+ 80913us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:36.954115 (+1047855us) spinlock_profiling.cc:243] Waited 47.2 ms on lock 0x7b540036f9a0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f2332dc0 00007fa9f23bd1c0 00007fa9f23be231 00007fa9f23bad8f 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c
0709 12:59:37.268154 (+314039us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:37.268186 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:37.268226 (+    40us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:37.268261 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:37.268639 (+   378us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:37.268746 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":108609920}
I20260709 12:59:37.249186  4360 raft_consensus.cc:3060] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:37.294445  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 12:59:37.268749  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 80061.3us
W20260709 12:59:37.235709  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 55088.9us
W20260709 12:59:37.298269  2294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:37.236622  1542 leader_election.cc:304] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
W20260709 12:59:37.290571  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:37.291576  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:37.300283  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:37.301110  1569 raft_consensus.cc:2393] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 5: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:37.301241  1642 raft_consensus.cc:2393] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 5: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
W20260709 12:59:37.301647  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:37.310194  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:37.206184  4116 leader_election.cc:290] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:37.313529  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:37.316284  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:37.322861  1569 raft_consensus.cc:3060] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:37.323248  1572 raft_consensus.cc:2468] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6.
I20260709 12:59:37.323951  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:37.321195  1644 raft_consensus.cc:1275] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:59:37.325199  1644 pending_rounds.cc:85] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e: Aborting all ops after (but not including) 6
I20260709 12:59:37.325131  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:37.325574  1644 pending_rounds.cc:107] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:59:37.230440  4373 raft_consensus.cc:493] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:37.325865  1644 raft_consensus.cc:2889] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:59:37.298856  4255 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 12:59:37.311545  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:37.234644  4286 raft_consensus.cc:697] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:37.324608  2324 raft_consensus.cc:2468] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7.
I20260709 12:59:37.327899  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:37.330137  1643 raft_consensus.cc:1275] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:59:37.329608  1573 raft_consensus.cc:3060] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:37.330595  1650 raft_consensus.cc:2393] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 7: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:37.327589  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:37.330132  1615 leader_election.cc:304] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:37.333407  1651 raft_consensus.cc:1240] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:37.338320  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:37.338960  1567 raft_consensus.cc:3060] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:37.330587  1643 pending_rounds.cc:85] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e: Aborting all ops after (but not including) 5
I20260709 12:59:37.340042  1643 pending_rounds.cc:107] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:59:37.340328  1643 raft_consensus.cc:2889] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:59:37.346184  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 109667us
I20260709 12:59:37.346827  1542 leader_election.cc:304] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:37.349691  1568 raft_consensus.cc:1275] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 12:59:37.352408  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 152737us
I20260709 12:59:37.313113  4250 raft_consensus.cc:2749] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:37.356252  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:37.356590  1542 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:37.358682  1573 raft_consensus.cc:2468] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7.
I20260709 12:59:37.331296  4335 raft_consensus.cc:2749] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:37.267932  4270 consensus_queue.cc:1048] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 12:59:37.362087  1570 raft_consensus.cc:1240] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:37.363276  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:37.260510  4338 raft_consensus.cc:515] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:37.421972  4338 leader_election.cc:290] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 12:59:37.218556  1469 rpcz_store.cc:269] 0709 12:59:20.180322 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:20.180459 (+   137us) service_pool.cc:224] Handling call
0709 12:59:37.217928 (+17037469us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:29.593918 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:29.660176 (+ 66258us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:29.660244 (+    68us) write_op.cc:435] Acquired schema lock
0709 12:59:29.660268 (+    24us) tablet.cc:662] Decoding operations
0709 12:59:29.661152 (+   884us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:29.661239 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:29.661277 (+    38us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:59:29.662104 (+   827us) tablet.cc:701] Row locks acquired
0709 12:59:29.662171 (+    67us) write_op.cc:260] PREPARE: finished
0709 12:59:29.662386 (+   215us) write_op.cc:270] Start()
0709 12:59:29.662538 (+   152us) write_op.cc:276] Timestamp: P: 1783601969662299 usec, L: 0
0709 12:59:29.662567 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 12:59:29.777241 (+114674us) log.cc:844] Serialized 2090 byte log entry
0709 12:59:31.312342 (+1535101us) op_driver.cc:464] REPLICATION: finished
0709 12:59:31.599229 (+286887us) write_op.cc:301] APPLY: starting
0709 12:59:31.599346 (+   117us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:31.599583 (+   237us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:31.599758 (+   175us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:31.600830 (+  1072us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:31.601218 (+   388us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:59:31.601292 (+    74us) write_op.cc:312] APPLY: finished
0709 12:59:31.601642 (+   350us) log.cc:844] Serialized 47 byte log entry
0709 12:59:31.603277 (+  1635us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:31.603430 (+   153us) write_op.cc:454] Released schema lock
0709 12:59:31.603493 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:31.604036 (+   543us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:31.604069 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":266173,"reported_tablets":29,"child_traces":[["op",{"apply.queue_time_us":286539,"apply.run_cpu_time_us":3423,"apply.run_wall_time_us":4792,"num_ops":5,"prepare.queue_time_us":584327,"prepare.run_cpu_time_us":17872,"prepare.run_wall_time_us":814402,"raft.queue_time_us":661252,"raft.run_cpu_time_us":14185,"raft.run_wall_time_us":287816,"replication_time_us":1649594,"thread_start_us":1428039,"threads_started":4,"wal-append.queue_time_us":860997,"wal-append.run_cpu_time_us":9092,"wal-append.run_wall_time_us":1956052}]]}
I20260709 12:59:37.412081  4345 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
W20260709 12:59:37.426951  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 73784.9us
I20260709 12:59:37.427289  4345 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:37.429891  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:37.430522  1721 raft_consensus.cc:3060] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:59:37.427690  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:37.367678  1542 leader_election.cc:304] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:37.358119  4314 raft_consensus.cc:493] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:37.365898  4304 raft_consensus.cc:2804] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:37.371258  4124 raft_consensus.cc:3060] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:37.363468  4037 raft_consensus.cc:2804] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:37.353688  4366 raft_consensus.cc:2804] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:37.372785  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:59:37.379436  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:37.443732  1689 leader_election.cc:304] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:37.358103  4131 raft_consensus.cc:515] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:37.380709  4378 log.cc:927] Time spent T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:59:37.381421  4083 raft_consensus.cc:515] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:37.382339  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:37.454960  1568 raft_consensus.cc:3060] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:37.440707  1572 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb"
dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:37682
I20260709 12:59:37.382766  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:37.455790  1572 raft_consensus.cc:493] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:37.383447  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:37.384861  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:37.456898  1571 raft_consensus.cc:2393] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 7: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:37.385275  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:37.457471  1722 raft_consensus.cc:3060] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:37.386485  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:37.387745  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:37.388608  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:37.389860  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:37.458665  1649 raft_consensus.cc:2393] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 4: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
W20260709 12:59:37.395835  2294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:37.397552  4056 leader_election.cc:290] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:37.398913  1569 raft_consensus.cc:2468] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 7.
I20260709 12:59:37.371394  4334 raft_consensus.cc:515] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:37.402158  1688 leader_election.cc:304] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:37.460327  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:59:37.404611  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:37.405135  4353 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:37.359187  1615 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:37.407595  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:37.404400  1472 catalog_manager.cc:5697] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 4 to 6, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 6 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } }
I20260709 12:59:37.415722  4310 leader_election.cc:290] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:37.409628  4098 raft_consensus.cc:515] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:37.339545  4348 consensus_queue.cc:1048] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.078s
I20260709 12:59:37.320895  4347 consensus_queue.cc:1048] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:59:37.328114  4373 raft_consensus.cc:3060] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:37.354333  4339 leader_election.cc:290] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:37.418129  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
W20260709 12:59:37.419214  4346 consensus_meta.cc:287] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.531s	user 0.009s	sys 0.000s
I20260709 12:59:37.480595  4346 raft_consensus.cc:515] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:37.480734  3945 raft_consensus.cc:359] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:37.480775  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:37.482154  1645 raft_consensus.cc:2393] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 7: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:37.419696  4286 consensus_queue.cc:237] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:37.433908  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 137523us
I20260709 12:59:37.435271  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:37.438328  2327 raft_consensus.cc:2468] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 4.
W20260709 12:59:37.442437  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 74844.1us
I20260709 12:59:37.485569  1573 raft_consensus.cc:2393] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 6: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:37.485865  1542 leader_election.cc:304] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:37.444962  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:37.447640  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:37.486661  1647 raft_consensus.cc:3060] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:37.448014  1723 raft_consensus.cc:1240] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:37.440956  4314 raft_consensus.cc:515] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:37.493605  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:37.443498  4037 raft_consensus.cc:493] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:37.494272  4037 raft_consensus.cc:3060] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:37.496600  4064 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.497205  1645 raft_consensus.cc:2468] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 4.
I20260709 12:59:37.452915  4345 raft_consensus.cc:2749] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:37.497150  4064 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:37.441380  4304 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:37.498553  4304 raft_consensus.cc:3060] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:37.443382  4366 raft_consensus.cc:493] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:37.461097  1649 raft_consensus.cc:2468] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 7.
I20260709 12:59:37.442194  4370 raft_consensus.cc:493] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:37.461089  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 58995.6us
W20260709 12:59:37.462406  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 103477us
I20260709 12:59:37.510281  1647 raft_consensus.cc:2468] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 5.
I20260709 12:59:37.462646  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:37.464998  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:37.466399  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:37.511647  1651 raft_consensus.cc:2468] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 5.
I20260709 12:59:37.465651  1472 catalog_manager.cc:5697] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: config changed from index -1 to 2, term changed from 1 to 3, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194), NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New cstate: current_term: 3 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:59:37.467126  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:37.467967  4360 raft_consensus.cc:515] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:37.469955  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:37.515738  1575 raft_consensus.cc:3060] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:37.516137  1649 raft_consensus.cc:1240] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:37.517244  1649 raft_consensus.cc:1240] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:59:37.519215  1688 leader_election.cc:304] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:37.520875  2294 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:37.475000  1568 raft_consensus.cc:2468] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7.
I20260709 12:59:37.511065  1615 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:37.477555  1569 raft_consensus.cc:1240] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:37.478586  1574 raft_consensus.cc:1240] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:37.479839  4375 consensus_queue.cc:1048] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:37.482610  1642 raft_consensus.cc:1240] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:37.524386  4250 raft_consensus.cc:2804] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:37.450394  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:37.525164  4360 leader_election.cc:290] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:37.508703  4366 raft_consensus.cc:3060] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:37.509093  4312 raft_consensus.cc:2804] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:37.526757  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:37.527523  1643 raft_consensus.cc:3060] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:37.490860  1542 leader_election.cc:304] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:37.528669  2294 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:37.529421  1542 leader_election.cc:304] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:37.528926  1472 catalog_manager.cc:5697] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 3 to 4, leader changed from 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 4 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:37.529858  2294 leader_election.cc:304] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:37.530562  1542 leader_election.cc:304] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:37.531311  4318 raft_consensus.cc:2804] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:37.530972  1472 catalog_manager.cc:5697] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 12:59:37.531734  1542 leader_election.cc:304] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:37.532089  4056 raft_consensus.cc:2804] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:37.491469  4339 raft_consensus.cc:2764] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:59:37.532419  4083 leader_election.cc:290] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:37.533087  4339 raft_consensus.cc:2804] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:37.533243  4332 consensus_queue.cc:1059] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:37.533609  4339 raft_consensus.cc:697] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:37.533663  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:37.534607  4350 raft_consensus.cc:3055] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:37.534847  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:37.535175  4350 raft_consensus.cc:740] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:37.535794  4351 raft_consensus.cc:2804] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:37.441442  4335 raft_consensus.cc:2749] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:37.536024  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:37.493785  4131 leader_election.cc:290] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:37.536825  4335 raft_consensus.cc:2749] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:37.536254  4351 raft_consensus.cc:493] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:37.537859  4351 raft_consensus.cc:3060] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:37.504570  2329 raft_consensus.cc:606] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Received request to transfer leadership to TS 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:37.538525  2329 raft_consensus.cc:614] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:37.489910  4346 leader_election.cc:290] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:37.459151  1644 raft_consensus.cc:2393] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 5: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 12:59:37.539229  4064 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:37.514256  4330 consensus_queue.cc:1048] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:59:37.486727  1650 raft_consensus.cc:3060] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:37.540190  1644 raft_consensus.cc:1240] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:37.541575  1644 raft_consensus.cc:1275] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:59:37.541706  1646 raft_consensus.cc:1240] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:59:37.542752  1644 raft_consensus.cc:1275] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:59:37.514513  4376 consensus_queue.cc:1059] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:59:37.536267  4350 consensus_queue.cc:260] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:37.546181  4350 raft_consensus.cc:3060] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:37.525430  1576 raft_consensus.cc:3060] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:37.525341  4345 consensus_queue.cc:1059] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:37.535218  4116 raft_consensus.cc:2749] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:37.521327  4370 raft_consensus.cc:515] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:37.531786  4318 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:37.549674  3945 raft_consensus.cc:740] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 LEARNER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Initialized, Role: LEARNER
I20260709 12:59:37.549935  4318 raft_consensus.cc:3060] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:37.490804  2327 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53290 (request call id 843) took 1560 ms (client timeout 1887 ms). Trace:
I20260709 12:59:37.534662  4339 consensus_queue.cc:237] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:37.456171  1572 raft_consensus.cc:3060] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:37.550631  2327 rpcz_store.cc:269] 0709 12:59:35.930309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.932629 (+  2320us) service_pool.cc:224] Handling call
0709 12:59:37.490656 (+1558027us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54004f1fd4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:37.490751 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3097190784}
W20260709 12:59:37.525331  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 95808.6us
I20260709 12:59:37.553056  1689 leader_election.cc:304] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:37.553442  4056 raft_consensus.cc:697] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:37.554616  2329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:39778 (request call id 1) took 1648 ms. Trace:
I20260709 12:59:37.554502  4056 consensus_queue.cc:237] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:37.555907  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 67074.1us
I20260709 12:59:37.557735  4330 raft_consensus.cc:3055] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:37.558212  4330 raft_consensus.cc:740] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:37.559168  4330 consensus_queue.cc:260] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:37.559774  4312 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:37.560243  4312 raft_consensus.cc:3060] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:37.528275  4320 raft_consensus.cc:2804] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:37.560803  4320 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:37.561329  4320 raft_consensus.cc:3060] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:37.549288  4314 leader_election.cc:290] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:37.524992  4250 raft_consensus.cc:493] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:37.564411  2297 leader_election.cc:304] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:37.555053  2329 rpcz_store.cc:276] 0709 12:59:35.906554 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:35.906703 (+   149us) service_pool.cc:224] Handling call
0709 12:59:37.554404 (+1647701us) spinlock_profiling.cc:243] Waited 1.59 s on lock 0x7b54004f1fd4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23b5853 00007fa9f738360a 00007fa9f09097d4 00007fa9f0909762 00007fa9f0909691 00007fa9f090960c 00007fa9f09088c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:37.554530 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3656515328}
I20260709 12:59:37.566937  1651 raft_consensus.cc:3060] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:37.497381  1722 raft_consensus.cc:2468] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 6.
I20260709 12:59:37.583866  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:37.583981  1643 raft_consensus.cc:2468] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 7.
I20260709 12:59:37.543908  4377 raft_consensus.cc:515] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:37.579403  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:37.449007  4190 raft_consensus.cc:515] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:37.464071  4245 raft_consensus.cc:2804] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:37.584491  1570 raft_consensus.cc:2468] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 4.
W20260709 12:59:37.577507  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 45846.4us
I20260709 12:59:37.597309  1542 leader_election.cc:304] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:37.581275  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:37.598037  1644 raft_consensus.cc:3060] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:37.595002  1539 leader_election.cc:304] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:37.586560  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:37.605162  2297 leader_election.cc:304] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 12:59:37.612478  1575 raft_consensus.cc:2468] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 7.
I20260709 12:59:37.615124  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:37.615875  1646 raft_consensus.cc:2468] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 4.
I20260709 12:59:37.572885  4330 raft_consensus.cc:3060] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:37.620595  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 49886.5us
W20260709 12:59:37.628948  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 50413.4us
I20260709 12:59:37.630028  2295 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:37.634087  1648 raft_consensus.cc:1240] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:59:37.635041  1716 raft_consensus.cc:1240] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:37.592155  4250 raft_consensus.cc:3060] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:37.584642  4355 raft_consensus.cc:2749] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:37.649700  1651 raft_consensus.cc:2468] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 8.
I20260709 12:59:37.596163  4245 raft_consensus.cc:493] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:37.629499  4157 raft_consensus.cc:3060] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:37.661033  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 108086us
I20260709 12:59:37.679762  1688 leader_election.cc:304] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:37.679255  1472 catalog_manager.cc:5697] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 4 to 5, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 5 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } }
W20260709 12:59:37.683770  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 52329.2us
I20260709 12:59:37.686913  4116 raft_consensus.cc:3060] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:37.689180  4366 raft_consensus.cc:515] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:37.691497  4366 leader_election.cc:290] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:37.621341  4153 consensus_queue.cc:1048] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 12:59:37.683077  4083 consensus_queue.cc:1048] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
W20260709 12:59:37.693450  4388 log.cc:927] Time spent T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:59:37.693817  4147 raft_consensus.cc:2804] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:37.679504  4241 consensus_queue.cc:1048] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:59:37.695015  4310 consensus_queue.cc:1059] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:37.695639  1568 raft_consensus.cc:1240] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:37.695914  4310 raft_consensus.cc:3055] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:37.643178  4129 consensus_queue.cc:1048] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 12:59:37.696332  4310 raft_consensus.cc:740] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:37.697522  4098 leader_election.cc:290] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:37.697242  4310 consensus_queue.cc:260] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:37.588626  4064 consensus_queue.cc:1175] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0c7751452c4b46afa95251b9df7169d4" responder_term: 2 status { last_received { term: 2 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 2 index: 5 } }
I20260709 12:59:37.698907  4345 raft_consensus.cc:2804] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:37.651713  4335 raft_consensus.cc:2749] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:37.699651  4345 raft_consensus.cc:697] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 7 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:37.692056  4353 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:37.619377  3945 consensus_queue.cc:260] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:59:37.700932  4345 consensus_queue.cc:237] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:37.661144  4131 raft_consensus.cc:2804] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:37.703810  4131 raft_consensus.cc:697] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 6 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:37.704643  4362 consensus_queue.cc:1059] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:37.705737  4362 raft_consensus.cc:3055] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:37.705832  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:37.706143  4362 raft_consensus.cc:740] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:37.694113  4214 raft_consensus.cc:2804] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:37.707593  1647 raft_consensus.cc:1240] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:37.661638  4301 consensus_queue.cc:1048] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:59:37.737917  1572 raft_consensus.cc:515] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:37.600760  4376 consensus_queue.cc:1048] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:59:37.697420  1689 leader_election.cc:304] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:37.728181  1650 raft_consensus.cc:2468] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 7.
I20260709 12:59:37.728232  1644 raft_consensus.cc:2468] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 7.
I20260709 12:59:37.661883  1575 raft_consensus.cc:1240] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:37.749172  1573 raft_consensus.cc:1240] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:37.753815  1575 raft_consensus.cc:1275] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:59:37.724076  4310 raft_consensus.cc:3060] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:37.755481  1572 leader_election.cc:290] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:37.684278  4245 raft_consensus.cc:3060] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:37.832564  4190 leader_election.cc:290] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:37.704936  4131 consensus_queue.cc:237] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:37.765168  4377 leader_election.cc:290] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:37.766173  4147 raft_consensus.cc:697] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:37.767941  3945 ts_tablet_manager.cc:1434] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66: Time spent starting tablet: real 0.569s	user 0.006s	sys 0.006s
I20260709 12:59:37.768539  4372 raft_consensus.cc:493] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:37.768774  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 84328.5us
W20260709 12:59:37.773284  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:37.776338  4157 raft_consensus.cc:2749] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:37.846484  2295 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:37.777623  4214 raft_consensus.cc:697] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:37.778234  4037 raft_consensus.cc:515] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:37.847302  2295 leader_election.cc:304] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 12:59:37.850502  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 260192us
I20260709 12:59:37.779814  4318 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:37.780706  4250 raft_consensus.cc:515] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:37.781383  4116 raft_consensus.cc:2749] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:37.653193  4314 consensus_queue.cc:1059] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.138s
I20260709 12:59:37.781888  4312 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:37.782545  4373 raft_consensus.cc:515] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:37.797712  4304 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:59:37.705061  4334 leader_election.cc:290] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:37.706946  4362 consensus_queue.cc:260] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:37.938057  4147 consensus_queue.cc:237] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:37.939569  4318 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:37.940855  4214 consensus_queue.cc:237] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:37.941859  4250 leader_election.cc:290] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:37.905912  4335 raft_consensus.cc:493] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:37.945045  4335 raft_consensus.cc:515] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:37.807801  1472 catalog_manager.cc:5697] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 2 to 5, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 5 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } }
I20260709 12:59:37.947305  1645 raft_consensus.cc:1275] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:59:37.908169  4124 raft_consensus.cc:2804] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:37.835239  1722 raft_consensus.cc:1240] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:37.836360  1576 raft_consensus.cc:2468] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 5.
W20260709 12:59:37.839686  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 142344us
W20260709 12:59:37.847301  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 227489us
I20260709 12:59:37.964321  1689 leader_election.cc:304] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:37.964854  1539 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
W20260709 12:59:37.877152  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:37.886386  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:37.888612  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:37.839461  4106 raft_consensus.cc:2804] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:59:37.845543  3945 ts_tablet_manager.cc:1467] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66: Tablet startup took 648ms
I20260709 12:59:37.921111  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:37.984515  1649 raft_consensus.cc:1240] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:59:37.985179  1571 raft_consensus.cc:1240] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:37.984747  4314 raft_consensus.cc:493] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:38.024256  4314 raft_consensus.cc:515] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:38.026396  4314 leader_election.cc:290] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:38.027554  4312 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:37.994892  4106 raft_consensus.cc:697] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 6 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
W20260709 12:59:38.035073  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 371509us
I20260709 12:59:37.926044  4377 raft_consensus.cc:3055] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:37.851140  4372 raft_consensus.cc:515] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:37.854148  4153 raft_consensus.cc:2804] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:37.820560  1567 raft_consensus.cc:2468] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 4.
I20260709 12:59:37.960176  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:37.968479  4250 raft_consensus.cc:2749] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:59:37.968354  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:38.066581  1646 raft_consensus.cc:3060] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:37.970451  1539 leader_election.cc:304] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:37.974967  1688 leader_election.cc:304] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
W20260709 12:59:38.068153  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 93284us
I20260709 12:59:37.975641  1689 leader_election.cc:304] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 12:59:37.975963  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 378690us
I20260709 12:59:38.070474  1542 leader_election.cc:304] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:38.046348  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:38.071430  2330 raft_consensus.cc:3055] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:38.071779  2330 raft_consensus.cc:740] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
W20260709 12:59:38.051901  1721 consensus_meta.cc:287] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.621s	user 0.007s	sys 0.006s
I20260709 12:59:38.072738  1721 raft_consensus.cc:2468] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 7.
I20260709 12:59:38.043160  1472 catalog_manager.cc:5697] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 1 to 4, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 4 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } }
I20260709 12:59:37.845539  4328 consensus_queue.cc:1059] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 12:59:37.852023  1615 leader_election.cc:304] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 12:59:38.074527  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 222456us
I20260709 12:59:38.075687  1615 leader_election.cc:304] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:38.076975  1615 leader_election.cc:304] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:37.984447  4334 raft_consensus.cc:2749] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:38.087311  1615 leader_election.cc:304] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:38.069291  1688 leader_election.cc:304] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:37.995723  4124 raft_consensus.cc:697] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:38.042112  4377 raft_consensus.cc:740] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
W20260709 12:59:38.126976  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:38.128399  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 162767us
I20260709 12:59:38.141671  4037 leader_election.cc:290] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:38.055425  4153 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:38.146041  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 175670us
I20260709 12:59:38.148586  1539 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:38.129012  2330 consensus_queue.cc:260] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:38.143561  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:38.149765  2330 raft_consensus.cc:3060] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:38.086040  4327 raft_consensus.cc:2764] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:59:38.092729  4314 raft_consensus.cc:2804] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:38.151304  1472 catalog_manager.cc:5697] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 2 to 3, leader changed from 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:38.090134  4375 raft_consensus.cc:2804] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:38.092618  4190 raft_consensus.cc:2749] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:59:38.166852  1689 leader_election.cc:336] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Timed out: RequestConsensusVote RPC to 127.0.107.193:34373 timed out after 1.766s (SENT)
I20260709 12:59:38.093567  4338 raft_consensus.cc:2749] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:38.142966  4345 raft_consensus.cc:2804] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:38.101662  4355 raft_consensus.cc:2804] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:38.142982  4366 consensus_queue.cc:1059] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:59:38.187222  4335 leader_election.cc:290] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:38.187405  4370 leader_election.cc:290] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:38.101761  4346 consensus_queue.cc:1059] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.086s
W20260709 12:59:38.187848  4320 consensus_meta.cc:287] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.624s	user 0.010s	sys 0.005s
I20260709 12:59:38.152091  4334 raft_consensus.cc:2749] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:59:38.190099  4330 consensus_meta.cc:287] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.547s	user 0.008s	sys 0.002s
I20260709 12:59:38.190802  4190 consensus_queue.cc:1048] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:59:38.194169  4390 log.cc:927] Time spent T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.511s	user 0.010s	sys 0.000s
I20260709 12:59:38.129467  4328 consensus_queue.cc:1243] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer 0c7751452c4b46afa95251b9df7169d4 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:59:38.198760  4372 leader_election.cc:290] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:38.204751  4377 consensus_queue.cc:260] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:38.208096  4373 leader_election.cc:290] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:59:38.208745  4398 log.cc:927] Time spent T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.141s	user 0.000s	sys 0.002s
I20260709 12:59:38.210254  4124 consensus_queue.cc:237] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:38.172286  1646 raft_consensus.cc:2468] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 6.
W20260709 12:59:38.231057  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 64246.8us
W20260709 12:59:38.332850  1689 leader_election.cc:336] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Timed out: RequestConsensusVote RPC to 127.0.107.193:34373 timed out after 1.847s (SENT)
I20260709 12:59:38.044492  4106 consensus_queue.cc:237] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:38.156894  4153 raft_consensus.cc:3060] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:38.159716  4037 raft_consensus.cc:2804] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:38.143059  4312 consensus_queue.cc:1059] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.080s
I20260709 12:59:38.268373  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:38.350975  1722 raft_consensus.cc:2468] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 8.
I20260709 12:59:38.352841  2297 leader_election.cc:304] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 12:59:38.101675  4245 raft_consensus.cc:515] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:38.234164  4351 consensus_meta.cc:287] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.696s	user 0.010s	sys 0.000s
I20260709 12:59:38.215250  4314 raft_consensus.cc:697] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 8 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:38.230629  4375 raft_consensus.cc:697] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 7 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:38.355929  2330 raft_consensus.cc:2468] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
W20260709 12:59:38.358668  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:38.362650  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 292252us
I20260709 12:59:38.363683  1542 leader_election.cc:304] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:38.266368  4064 consensus_queue.cc:1059] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 12:59:38.296491  4397 raft_consensus.cc:2749] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:38.296216  4395 consensus_queue.cc:1059] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.099s
I20260709 12:59:38.354027  4360 raft_consensus.cc:3055] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:38.397974  4360 raft_consensus.cc:740] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
W20260709 12:59:38.377417  1689 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:34373 timed out after 2.000s (SENT) [suppressed 45 similar messages]
I20260709 12:59:38.342470  4037 raft_consensus.cc:493] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:38.404357  1716 raft_consensus.cc:1240] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:59:38.389813  4314 consensus_queue.cc:237] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:38.375574  4157 raft_consensus.cc:2804] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:59:38.395182  4350 consensus_meta.cc:287] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.849s	user 0.001s	sys 0.013s
I20260709 12:59:38.278939  4320 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:38.398840  4360 consensus_queue.cc:260] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:38.357132  4377 raft_consensus.cc:3060] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:38.411890  4122 raft_consensus.cc:3055] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:38.414343  4332 raft_consensus.cc:3055] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:38.415635  1540 leader_election.cc:304] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:38.472793  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 12:59:38.473526  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 57974.2us
I20260709 12:59:38.473883  1567 raft_consensus.cc:2368] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 6. Current term is 7.
I20260709 12:59:38.362862  4373 raft_consensus.cc:3055] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:38.417594  4327 raft_consensus.cc:3055] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:38.418159  1722 raft_consensus.cc:1240] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
W20260709 12:59:38.419071  4310 consensus_meta.cc:287] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.585s	user 0.008s	sys 0.000s
I20260709 12:59:38.420924  4245 leader_election.cc:290] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:38.423514  4157 raft_consensus.cc:493] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:38.353762  4304 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:38.409207  4037 raft_consensus.cc:3060] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:38.392185  4362 raft_consensus.cc:3060] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:38.425705  1688 leader_election.cc:304] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:38.427594  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:38.448809  1569 raft_consensus.cc:1240] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:59:38.450345  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:38.451421  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:38.512939  1568 raft_consensus.cc:2468] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 6.
I20260709 12:59:38.451908  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:38.452288  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:38.454273  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 12:59:38.455060  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:38.483065  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:38.488966  2330 raft_consensus.cc:1240] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:38.490594  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:38.421420  4116 raft_consensus.cc:3060] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:38.375525  4351 raft_consensus.cc:515] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:38.548571  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:38.487300  4327 raft_consensus.cc:740] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
W20260709 12:59:38.510211  4214 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.017s	sys 0.007s
I20260709 12:59:38.506562  1724 raft_consensus.cc:1275] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
W20260709 12:59:38.490592  2294 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.011s	sys 0.009s
I20260709 12:59:38.472021  4122 raft_consensus.cc:740] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:38.472385  4332 raft_consensus.cc:740] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:38.515529  1567 raft_consensus.cc:2393] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 5: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:38.435621  4250 consensus_queue.cc:1059] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.072s
I20260709 12:59:38.487947  4241 raft_consensus.cc:2804] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:38.484270  4373 raft_consensus.cc:740] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:38.531292  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:38.504508  4286 consensus_queue.cc:1059] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
W20260709 12:59:38.532174  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 106568us
W20260709 12:59:38.578099  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:38.578531  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:38.556417  4245 raft_consensus.cc:2804] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:59:38.537801  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:38.549248  1568 raft_consensus.cc:3060] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:38.570897  4339 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.876s	user 0.021s	sys 0.054s
I20260709 12:59:38.550158  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:38.503830  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:38.586645  1570 raft_consensus.cc:3060] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:38.505359  4360 raft_consensus.cc:3060] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:38.505807  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 402987us
I20260709 12:59:38.566512  1724 pending_rounds.cc:85] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4: Aborting all ops after (but not including) 6
W20260709 12:59:38.566639  2294 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.012s	sys 0.009s
I20260709 12:59:38.588680  1724 pending_rounds.cc:107] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:59:38.589001  1724 raft_consensus.cc:2889] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:38.589869  1615 leader_election.cc:304] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:38.502872  4350 consensus_queue.cc:1059] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 12:59:38.571379  1575 raft_consensus.cc:1240] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:38.572175  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:38.574457  1569 raft_consensus.cc:2393] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 6: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:38.594370  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:38.595219  1569 raft_consensus.cc:2393] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 6: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:38.491351  4098 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:38.580029  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:38.630043  1567 raft_consensus.cc:2393] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 7: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
W20260709 12:59:38.568499  4214 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.018s	sys 0.007s
I20260709 12:59:38.549093  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:38.631414  1572 raft_consensus.cc:2468] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 5.
W20260709 12:59:38.536605  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 379459us
I20260709 12:59:38.510452  4157 raft_consensus.cc:3060] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:38.633265  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:38.621657  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:38.634217  1576 raft_consensus.cc:2468] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 7.
I20260709 12:59:38.633972  1649 raft_consensus.cc:2393] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 8: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:38.623721  1571 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 7.
I20260709 12:59:38.584017  4241 raft_consensus.cc:697] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:38.646098  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 12:59:38.592280  4339 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.897s	user 0.021s	sys 0.054s
I20260709 12:59:38.585867  4355 raft_consensus.cc:697] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 7 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:38.630266  1568 raft_consensus.cc:2468] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 6.
W20260709 12:59:38.658093  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 280693us
I20260709 12:59:38.620437  4131 raft_consensus.cc:3055] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:38.618717  4345 raft_consensus.cc:697] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 7 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
W20260709 12:59:38.671763  1689 leader_election.cc:336] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Timed out: RequestConsensusVote RPC to 127.0.107.193:34373 timed out after 2.414s (SENT)
I20260709 12:59:38.628787  4366 raft_consensus.cc:2804] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:38.674907  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:38.683108  1572 raft_consensus.cc:2376] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 6. Re-sending same reply.
I20260709 12:59:38.675777  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:38.645346  4286 consensus_queue.cc:1243] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer 0c7751452c4b46afa95251b9df7169d4 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:59:38.677234  1650 raft_consensus.cc:1275] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:59:38.679913  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:38.684343  1569 raft_consensus.cc:3060] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:38.684760  1647 raft_consensus.cc:1275] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:38.711277  4414 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:38.715107  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:38.716715  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:38.717741  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:38.720281  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:38.721580  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:38.722636  1725 raft_consensus.cc:2393] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 5: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:59:38.657457  1570 raft_consensus.cc:2468] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 7.
I20260709 12:59:38.678318  4131 raft_consensus.cc:740] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:38.685614  4412 consensus_queue.cc:1059] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:59:38.686368  2330 raft_consensus.cc:1240] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:38.727350  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:38.727459  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:38.654186  4098 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:59:38.728330  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:38.689390  4366 raft_consensus.cc:697] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 4 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:38.728977  1723 raft_consensus.cc:2376] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 5. Re-sending same reply.
I20260709 12:59:38.729964  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:38.729743  4366 consensus_queue.cc:237] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:38.730666  4412 consensus_queue.cc:1059] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:38.731547  4412 raft_consensus.cc:3055] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:38.731220  4345 consensus_queue.cc:237] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:38.731909  4412 raft_consensus.cc:740] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:38.689138  4241 consensus_queue.cc:237] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:38.733213  4346 raft_consensus.cc:3055] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:38.733664  4346 raft_consensus.cc:740] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:38.689087  4355 consensus_queue.cc:237] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:38.644825  4245 raft_consensus.cc:697] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 6 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:38.691767  4327 consensus_queue.cc:260] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:38.737241  4327 raft_consensus.cc:3060] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:38.711898  4414 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:38.728487  4320 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:38.732844  4412 consensus_queue.cc:260] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:38.734630  4346 consensus_queue.cc:260] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:38.574321  4375 consensus_queue.cc:237] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:38.691757  4406 raft_consensus.cc:3055] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:38.727537  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:38.739019  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:38.772149  1722 raft_consensus.cc:3060] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:38.772266  1719 raft_consensus.cc:3060] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:38.742612  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:38.743141  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:38.744079  2324 raft_consensus.cc:1275] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:59:38.735939  4245 consensus_queue.cc:237] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:38.770817  4406 raft_consensus.cc:740] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:38.777527  4406 consensus_queue.cc:260] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:38.745002  4286 raft_consensus.cc:493] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:38.779150  4286 raft_consensus.cc:515] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:38.781059  4408 log.cc:927] Time spent T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260709 12:59:38.710271  4410 consensus_queue.cc:1059] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 12:59:38.738377  4338 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:38.782794  4338 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:59:38.749492  1724 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc"
dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
mode: GRACEFUL
new_leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:50592
I20260709 12:59:38.758795  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:38.765183  1569 raft_consensus.cc:2468] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 8.
I20260709 12:59:38.766553  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:38.766976  1650 raft_consensus.cc:1240] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:59:38.767194  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:38.793588  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:38.768325  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:38.657769  4373 consensus_queue.cc:260] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:38.785537  1724 raft_consensus.cc:606] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Received request to transfer leadership to TS 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:38.826268  1724 raft_consensus.cc:614] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:59:38.826118  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 12:59:38.862440  1617 leader_election.cc:336] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.516s (SENT)
I20260709 12:59:38.863184  1617 leader_election.cc:304] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 12:59:38.866078  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:38.785213  4416 log.cc:927] Time spent T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.154s	user 0.002s	sys 0.001s
W20260709 12:59:38.920469  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:38.697024  4332 consensus_queue.cc:260] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:38.935155  1617 leader_election.cc:336] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.589s (SENT)
I20260709 12:59:38.997555  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 12:59:39.234385  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 299259us
I20260709 12:59:38.996304  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:39.218274  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:39.235455  1724 raft_consensus.cc:2468] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7.
I20260709 12:59:39.217108  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:39.217525  1689 leader_election.cc:304] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 12:59:38.825699  4310 raft_consensus.cc:493] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
W20260709 12:59:38.976682  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:39.237903  1571 raft_consensus.cc:2410] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:59:39.225837  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:38.933621  1719 raft_consensus.cc:2468] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7.
I20260709 12:59:39.247488  1725 raft_consensus.cc:3060] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:38.940398  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 348950us
I20260709 12:59:39.215662  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45148 (request call id 2030) took 1290 ms. Trace:
I20260709 12:59:39.249298  1644 rpcz_store.cc:276] 0709 12:59:37.925585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:37.925963 (+   378us) service_pool.cc:224] Handling call
0709 12:59:37.926266 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:37.962290 (+ 36024us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:37.962343 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:38.002520 (+ 40177us) log.cc:844] Serialized 26 byte log entry
0709 12:59:38.364319 (+361799us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:38.364370 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:38.364459 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:38.782021 (+417562us) raft_consensus.cc:1685] finished
0709 12:59:38.782042 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:39.215599 (+433557us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10067,"raft.queue_time_us":138,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":21906,"thread_start_us":296323,"threads_started":1,"wal-append.queue_time_us":530674}
W20260709 12:59:39.083267  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:39.236771  4406 raft_consensus.cc:3060] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:37.984577  3945 ts_tablet_manager.cc:1469] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66: Trace:
0709 12:59:23.780304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:23.780749 (+   445us) service_pool.cc:224] Handling call
0709 12:59:24.332428 (+551679us) ts_tablet_manager.cc:934] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66: Initiating tablet copy from peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
0709 12:59:27.491299 (+3158871us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:59:27.689788 (+198489us) tablet_metadata.cc:665] Metadata flushed
0709 12:59:27.689935 (+   147us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:59:27.866403 (+176468us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:59:27.866813 (+   410us) tablet_replica.cc:206] Creating consensus instance
0709 12:59:27.867167 (+   354us) ts_tablet_manager.cc:989] Replica registered.
0709 12:59:27.867223 (+    56us) inbound_call.cc:177] Queueing success response
0709 12:59:29.127762 (+1260539us) spinlock_profiling.cc:243] Waited 5.14 ms on lock 0x7b4c00226ec0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f0687a20 00007fa9f0698a29 00007fa9f063d5e6 00007fa9f0652b13 00007fa9f0652945 00007fa9f06c57ad 00007fa9f7399198 00007fa9f7399137 00007fa9f739909c 00007fa9f7399038 00007fa9f7398300
0709 12:59:32.172289 (+3044527us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:59:37.231198 (+5058909us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:59:37.384972 (+153774us) tablet_replica.cc:261] Starting instrumentation
0709 12:59:37.385603 (+   631us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":106837,"mutex_wait_us":136780,"raft.queue_time_us":66780,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":92,"spinlock_wait_cycles":11827584,"tablet-copy.queue_time_us":182304,"tablet-download-pool.queue_time_us":435,"tablet-download-pool.run_cpu_time_us":1347,"tablet-download-pool.run_wall_time_us":1247414,"thread_start_us":479013,"threads_started":2}
I20260709 12:59:38.969400  4366 raft_consensus.cc:3055] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:39.255376  4366 raft_consensus.cc:740] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:39.225705  4338 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 12:59:39.258059  1689 connection.cc:256] RPC call timeout handler was delayed by -1.0819595969999796s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18020000000000003s for a response
W20260709 12:59:39.258586  1689 connection.cc:256] RPC call timeout handler was delayed by -1.0720595969999636s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18130000000000002s for a response
W20260709 12:59:39.216935  1542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:39.099081  4153 consensus_meta.cc:287] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.747s	user 0.011s	sys 0.001s
W20260709 12:59:39.261075  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:39.285045  1689 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:39.284806  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 12:59:39.285600  1689 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:38.930905  4346 raft_consensus.cc:3060] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:39.071267  4106 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.015s	sys 0.032s
W20260709 12:59:39.254040  4411 log.cc:927] Time spent T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.480s	user 0.000s	sys 0.001s
I20260709 12:59:39.331611  4370 raft_consensus.cc:493] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
W20260709 12:59:39.287375  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 69113.5us
I20260709 12:59:39.333280  2329 raft_consensus.cc:1240] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:38.894637  4373 raft_consensus.cc:3060] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:39.262506  1722 raft_consensus.cc:2468] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6.
I20260709 12:59:39.307626  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:39.070935  4417 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:39.069388  4339 raft_consensus.cc:493] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:39.237480  4355 raft_consensus.cc:2749] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:59:39.316505  4106 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.913s	user 0.018s	sys 0.045s
W20260709 12:59:39.317406  4422 log.cc:927] Time spent T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 12:59:39.317484  4414 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:39.306807  4308 raft_consensus.cc:493] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:39.259671  4419 raft_consensus.cc:2764] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:59:39.324879  4338 raft_consensus.cc:493] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
W20260709 12:59:39.327435  4360 consensus_meta.cc:287] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.734s	user 0.006s	sys 0.003s
I20260709 12:59:39.256768  4366 consensus_queue.cc:260] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:59:39.329643  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 12:59:39.331032  4157 consensus_meta.cc:287] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.671s	user 0.003s	sys 0.003s
I20260709 12:59:39.287001  1719 raft_consensus.cc:1240] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:59:39.234601  4412 raft_consensus.cc:3060] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:39.337181  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:39.338045  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:39.332242  4370 raft_consensus.cc:515] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:39.413123  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:39.288626  4332 raft_consensus.cc:3060] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:39.345476  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:39.362438  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:39.267208  4310 raft_consensus.cc:515] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:39.340250  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:39.442817  1719 raft_consensus.cc:1240] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 5. Current term is 6. Ops: []
W20260709 12:59:39.411118  4362 consensus_meta.cc:287] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.879s	user 0.007s	sys 0.004s
W20260709 12:59:39.423285  4037 consensus_meta.cc:287] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.875s	user 0.008s	sys 0.002s
I20260709 12:59:39.347987  4427 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:39.437513  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 12:59:39.412235  4413 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.005s	sys 0.014s
W20260709 12:59:39.443655  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:39.289251  4153 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:39.445524  1649 raft_consensus.cc:1240] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 7 LEADER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:39.383600  4250 raft_consensus.cc:493] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:39.344035  4320 consensus_queue.cc:1048] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.097s
I20260709 12:59:38.936671  4131 consensus_queue.cc:260] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:39.348366  4286 leader_election.cc:290] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:39.418291  4335 raft_consensus.cc:3055] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:39.418316  4355 raft_consensus.cc:493] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:39.465801  1571 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 5.
I20260709 12:59:39.345799  4339 raft_consensus.cc:515] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:39.459420  1725 raft_consensus.cc:2468] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 4.
I20260709 12:59:39.478386  1572 raft_consensus.cc:1275] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:39.348773  4350 consensus_queue.cc:1059] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.114s
I20260709 12:59:39.483444  1567 raft_consensus.cc:1275] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:59:39.437248  4436 raft_consensus.cc:493] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:39.409768  4338 raft_consensus.cc:515] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:39.344928  4417 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:39.495289  1570 raft_consensus.cc:3060] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:39.419816  4308 raft_consensus.cc:515] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:39.472111  4327 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:39.481216  4312 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.007s	sys 0.022s
I20260709 12:59:39.471217  4145 raft_consensus.cc:493] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:39.437382  4157 raft_consensus.cc:515] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:39.501049  1723 raft_consensus.cc:2410] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:59:39.534076  1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 507) took 1310 ms. Trace:
I20260709 12:59:39.537662  1720 rpcz_store.cc:276] 0709 12:59:38.223527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:38.229400 (+  5873us) service_pool.cc:224] Handling call
0709 12:59:38.275809 (+ 46409us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:38.276124 (+   315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:38.276154 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:38.325005 (+ 48851us) log.cc:844] Serialized 26 byte log entry
0709 12:59:38.629150 (+304145us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:38.629198 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:38.629269 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:39.533882 (+904613us) raft_consensus.cc:1685] finished
0709 12:59:39.533900 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:39.534021 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":239953,"threads_started":1,"wal-append.queue_time_us":608869}
I20260709 12:59:39.538614  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:39.539641  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:39.497572  4131 raft_consensus.cc:3060] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:39.485036  4366 raft_consensus.cc:3060] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:39.476693  4210 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.006s	sys 0.024s
I20260709 12:59:39.500761  1567 raft_consensus.cc:1240] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:39.540508  1720 raft_consensus.cc:2393] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 6: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 12:59:39.484741  4335 raft_consensus.cc:740] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:39.530642  4106 raft_consensus.cc:493] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:39.488221  4395 raft_consensus.cc:493] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
W20260709 12:59:39.547827  4432 log.cc:927] Time spent T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:59:39.467396  4037 raft_consensus.cc:515] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:39.532061  4434 log.cc:927] Time spent T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 12:59:39.539099  4375 raft_consensus.cc:493] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:39.534240  4436 raft_consensus.cc:515] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:39.626727  1643 raft_consensus.cc:1275] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:39.480697  4250 raft_consensus.cc:515] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:39.532971  4414 raft_consensus.cc:493] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
W20260709 12:59:39.542774  4116 consensus_meta.cc:287] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 1.012s	user 0.007s	sys 0.004s
W20260709 12:59:39.550726  1617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:39.554244  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 219671us
W20260709 12:59:39.553938  4210 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.011s	sys 0.026s
I20260709 12:59:39.565389  1567 raft_consensus.cc:1240] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:39.542215  4396 raft_consensus.cc:493] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:39.552878  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:39.470764  4427 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:39.560046  1570 raft_consensus.cc:2468] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 5.
I20260709 12:59:39.532065  4355 raft_consensus.cc:515] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:39.565016  4377 consensus_meta.cc:287] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 1.117s	user 0.010s	sys 0.001s
W20260709 12:59:39.650293  1617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:39.653116  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:39.540344  4327 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:39.643515  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:39.549968  4145 raft_consensus.cc:515] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:39.665895  1689 leader_election.cc:304] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:39.735718  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:39.687140  1650 raft_consensus.cc:1275] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:59:39.687140  1643 raft_consensus.cc:1275] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:39.735342  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:39.737735  1570 raft_consensus.cc:1240] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 3. Current term is 4. Ops: []
I20260709 12:59:39.749101  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
W20260709 12:59:39.741941  1617 leader_election.cc:336] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.684s (SENT)
I20260709 12:59:39.742769  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:39.753700  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
W20260709 12:59:39.687837  4418 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.998s	user 0.010s	sys 0.015s
I20260709 12:59:39.655417  4116 raft_consensus.cc:2749] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:39.564836  4106 raft_consensus.cc:515] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:39.776150  4106 leader_election.cc:290] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:39.778087  1573 raft_consensus.cc:2468] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 6.
I20260709 12:59:39.778162  4116 consensus_queue.cc:1059] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:39.780402  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:39.731791  4427 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:39.736059  4433 raft_consensus.cc:493] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:39.768899  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:39.819681  1650 raft_consensus.cc:2468] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 6.
I20260709 12:59:39.773800  1651 raft_consensus.cc:3060] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:39.719907  4448 raft_consensus.cc:493] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:39.734961  4413 raft_consensus.cc:493] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:39.709537  4440 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:39.640924  4350 raft_consensus.cc:493] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:39.684345  4153 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 12:59:39.815734  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 149917us
W20260709 12:59:39.817865  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 164034us
I20260709 12:59:39.770742  1720 raft_consensus.cc:2393] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 6: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
W20260709 12:59:39.771823  4418 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.083s	user 0.012s	sys 0.023s
I20260709 12:59:39.622695  4395 raft_consensus.cc:515] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:39.829027  4377 raft_consensus.cc:2749] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:39.656219  4414 raft_consensus.cc:515] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:39.829857  4420 log.cc:927] Time spent T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.407s	user 0.000s	sys 0.001s
I20260709 12:59:39.684669  4376 consensus_queue.cc:1048] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.131s
I20260709 12:59:39.636174  4375 raft_consensus.cc:515] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:39.708119  4335 consensus_queue.cc:260] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:39.749445  4396 raft_consensus.cc:515] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:39.949169  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 195506us
W20260709 12:59:40.056097  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:40.037529  4444 raft_consensus.cc:493] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:39.916384  1651 raft_consensus.cc:2468] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 5.
W20260709 12:59:39.974416  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:40.058408  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:39.900166  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:39.847339  1718 raft_consensus.cc:2468] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 4.
I20260709 12:59:39.964574  1647 raft_consensus.cc:2468] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6.
I20260709 12:59:40.037209  1661 tablet_copy_service.cc:342] P 4dbe7d47a2374afca075d3a98583b49e: Request end of tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-216561bf1aef403280c36c1e716ca3ad received from {username='slave'} at 127.0.0.1:57912
I20260709 12:59:40.067214  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:40.068735  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:40.062122  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:40.076406  1720 raft_consensus.cc:2393] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 6: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:59:40.076860  1689 leader_election.cc:304] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:40.077234  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:40.077886  1720 raft_consensus.cc:3060] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:40.073182  1647 raft_consensus.cc:2468] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6.
I20260709 12:59:40.080174  1689 leader_election.cc:304] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:40.082612  1689 leader_election.cc:304] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:40.088505  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
W20260709 12:59:40.063429  4446 log.cc:927] Time spent T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.147s	user 0.004s	sys 0.004s
I20260709 12:59:40.048234  4339 leader_election.cc:290] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:40.028265  4157 leader_election.cc:290] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:40.091284  2328 raft_consensus.cc:2368] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 4. Current term is 5.
I20260709 12:59:39.835225  4320 raft_consensus.cc:493] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:40.037034  4429 log.cc:927] Time spent T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.484s	user 0.001s	sys 0.001s
I20260709 12:59:39.901464  4310 leader_election.cc:290] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:40.093690  2330 raft_consensus.cc:3060] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 LEARNER]: Advancing to term 5
I20260709 12:59:40.048563  4338 leader_election.cc:290] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:40.095089  1689 leader_election.cc:304] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 12:59:40.217479  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 122595us
I20260709 12:59:40.218484  1689 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 12:59:40.168378  4450 log.cc:927] Time spent T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.079s	user 0.000s	sys 0.008s
I20260709 12:59:40.096767  1661 tablet_copy_service.cc:434] P 4dbe7d47a2374afca075d3a98583b49e: ending tablet copy session 05476b84d8f84d76a9a1f51b620a3c66-216561bf1aef403280c36c1e716ca3ad on tablet 216561bf1aef403280c36c1e716ca3ad with peer 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:59:40.223269  1689 leader_election.cc:304] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
W20260709 12:59:39.833647  4426 log.cc:927] Time spent T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.375s	user 0.000s	sys 0.001s
I20260709 12:59:39.822384  4370 leader_election.cc:290] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:40.072296  4413 raft_consensus.cc:515] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:40.125813  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:40.239053  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:40.074456  4350 raft_consensus.cc:515] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:40.072175  4440 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:40.098790  4245 raft_consensus.cc:3060] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:40.131528  2332 raft_consensus.cc:1217] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 LEARNER]: Deduplicated request from leader. Original: 5.3->[5.4-5.4]   Dedup: 5.4->[]
I20260709 12:59:40.221771  4310 raft_consensus.cc:3060] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:40.069231  4427 raft_consensus.cc:493] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.070307  4308 leader_election.cc:290] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 12:59:40.130012  4421 log.cc:927] Time spent T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.369s	user 0.000s	sys 0.001s
I20260709 12:59:40.070915  4397 raft_consensus.cc:3055] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:40.089512  4106 raft_consensus.cc:2749] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:40.173754  4442 raft_consensus.cc:493] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:40.174189  4435 log.cc:927] Time spent T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.213s	user 0.001s	sys 0.000s
I20260709 12:59:40.174563  4098 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:40.174903  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:40.177978  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:40.179033  1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1949) took 1459 ms. Trace:
I20260709 12:59:40.179244  1720 raft_consensus.cc:2468] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
W20260709 12:59:40.164429  4131 consensus_meta.cc:287] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.611s	user 0.016s	sys 0.000s
W20260709 12:59:40.159876  4312 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.007s	sys 0.028s
I20260709 12:59:40.180327  1576 raft_consensus.cc:1240] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:40.182137  4462 raft_consensus.cc:3055] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:59:40.182345  1649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45148 (request call id 2036) took 1485 ms. Trace:
I20260709 12:59:40.183144  1575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 1858) took 2520 ms. Trace:
I20260709 12:59:40.186051  4443 raft_consensus.cc:493] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.188318  4116 raft_consensus.cc:493] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
W20260709 12:59:40.189445  4407 log.cc:927] Time spent T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 1.497s	user 0.003s	sys 0.000s
I20260709 12:59:40.191175  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:59:40.194406  4438 log.cc:927] Time spent T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.555s	user 0.001s	sys 0.000s
W20260709 12:59:40.195428  1716 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1941) took 1482 ms (client timeout 1516 ms). Trace:
W20260709 12:59:40.199800  4366 consensus_meta.cc:287] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.647s	user 0.007s	sys 0.000s
I20260709 12:59:40.201185  4396 leader_election.cc:290] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:40.160740  4339 raft_consensus.cc:493] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:39.899765  4448 raft_consensus.cc:515] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:40.202018  4436 leader_election.cc:290] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:40.088744  4250 leader_election.cc:290] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:40.202836  4355 leader_election.cc:290] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:40.098655  4037 leader_election.cc:290] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:40.203212  4190 consensus_queue.cc:1059] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:40.204788  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:59:40.205742  4373 consensus_meta.cc:287] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.864s	user 0.009s	sys 0.000s
I20260709 12:59:40.206085  1617 leader_election.cc:304] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:39.834733  4433 raft_consensus.cc:515] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:40.209265  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 296653us
I20260709 12:59:40.096351  4335 raft_consensus.cc:3060] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:40.056939  4444 raft_consensus.cc:515] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:40.003098  4314 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.273s	user 0.008s	sys 0.010s
I20260709 12:59:40.220463  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:40.233954  1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 509) took 2008 ms. Trace:
I20260709 12:59:40.238267  4441 raft_consensus.cc:2804] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:39.839323  4419 raft_consensus.cc:493] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:40.215811  4327 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:40.250687  2332 raft_consensus.cc:2955] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 LEARNER]: Committing config change with OpId 5.4: config changed from index -1 to 4, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 12:59:40.235631  4338 raft_consensus.cc:2749] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:40.264755  2330 raft_consensus.cc:1275] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 LEARNER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:40.222231  4320 raft_consensus.cc:515] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:40.277630  1642 raft_consensus.cc:2468] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6.
I20260709 12:59:40.838536  4250 raft_consensus.cc:493] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.839107  4250 raft_consensus.cc:515] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:40.839321  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:40.840813  1647 raft_consensus.cc:1240] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:59:40.337553  4106 raft_consensus.cc:493] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.841547  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 1425) took 1108 ms. Trace:
I20260709 12:59:40.841982  1647 rpcz_store.cc:276] 0709 12:59:39.733564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:40.840212 (+1106648us) service_pool.cc:224] Handling call
0709 12:59:40.840597 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:40.841302 (+   705us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:40.841493 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:40.844036  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 1426) took 1110 ms. Trace:
I20260709 12:59:40.844883  4418 raft_consensus.cc:2749] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:40.845538  2326 raft_consensus.cc:1240] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 LEADER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:59:40.846161  2326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53306 (request call id 574) took 2080 ms. Trace:
I20260709 12:59:40.395752  1572 raft_consensus.cc:3060] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:40.847638  1720 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1352) took 1307 ms (client timeout 1644 ms). Trace:
W20260709 12:59:40.632308  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:40.490864  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:40.250341  4370 raft_consensus.cc:493] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.849037  1576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 1868) took 1521 ms. Trace:
I20260709 12:59:40.305866  1719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1959) took 1579 ms. Trace:
W20260709 12:59:40.395370  1573 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36642 (request call id 2195) took 1945 ms (client timeout 1813 ms). Trace:
W20260709 12:59:40.848719  1716 rpcz_store.cc:269] 0709 12:59:38.712984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:38.713103 (+   119us) service_pool.cc:224] Handling call
0709 12:59:40.195258 (+1482155us) spinlock_profiling.cc:243] Waited 866 ms on lock 0x7b5400203d54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:40.195375 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1991253888}
I20260709 12:59:40.844478  1647 rpcz_store.cc:276] 0709 12:59:39.733853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:40.843038 (+1109185us) service_pool.cc:224] Handling call
0709 12:59:40.843397 (+   359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:40.843650 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:40.843688 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:40.843742 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:40.843795 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:40.843860 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:40.843974 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:40.851120  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:40.850627  1720 rpcz_store.cc:269] 0709 12:59:39.548392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:40.077018 (+528626us) service_pool.cc:224] Handling call
0709 12:59:40.847582 (+770564us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:40.854779  1651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 1430) took 1035 ms. Trace:
I20260709 12:59:40.855523  1650 raft_consensus.cc:2393] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 5: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:40.234032  1689 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:40.856346  1718 rpcz_store.cc:276] 0709 12:59:38.720141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:38.721078 (+   937us) service_pool.cc:224] Handling call
0709 12:59:40.178869 (+1457791us) spinlock_profiling.cc:243] Waited 966 ms on lock 0x7b54002ac6d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:40.178976 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2222935296}
I20260709 12:59:40.857175  1649 rpcz_store.cc:276] 0709 12:59:38.697347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:38.697537 (+   190us) service_pool.cc:224] Handling call
0709 12:59:38.697858 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:39.468002 (+770144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:40.182120 (+714118us) spinlock_profiling.cc:243] Waited 744 ms on lock 0x7b54001d9a54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:40.182290 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1711329152}
I20260709 12:59:40.858374  1575 rpcz_store.cc:276] 0709 12:59:37.662699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:37.756208 (+ 93509us) service_pool.cc:224] Handling call
0709 12:59:37.782266 (+ 26058us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:38.593406 (+811140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:40.182913 (+1589507us) spinlock_profiling.cc:243] Waited 789 ms on lock 0x7b54000abed4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:40.183059 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1814365952}
I20260709 12:59:40.859915  2331 raft_consensus.cc:2393] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 8: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
W20260709 12:59:40.771438  1540 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.056s	sys 0.070s
W20260709 12:59:40.851478  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:40.846575  2326 rpcz_store.cc:276] 0709 12:59:38.766044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:38.766220 (+   176us) service_pool.cc:224] Handling call
0709 12:59:40.845109 (+2078889us) spinlock_profiling.cc:243] Waited 1.2 ms on lock 0x7b58000e6a98. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef296b71 00007fa9ef296a22 00007fa9f81afc09 00007fa9f7309ee0 00007fa9f73d30ab 00007fa9f73d3131 00007fa9f7394fc0 00007fa9f737f929 00007fa9f737f3d2 00007fa9f08f6bd4
0709 12:59:40.845305 (+   196us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:40.845936 (+   631us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:40.846109 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2755456}
I20260709 12:59:40.246519  4410 raft_consensus.cc:493] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.935541  1576 rpcz_store.cc:276] 0709 12:59:39.328141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:40.179852 (+851711us) service_pool.cc:224] Handling call
0709 12:59:40.180148 (+   296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:40.848801 (+668653us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:40.848983 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:40.936143  1573 rpcz_store.cc:269] 0709 12:59:38.449695 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:38.450119 (+   424us) service_pool.cc:224] Handling call
0709 12:59:40.395129 (+1945010us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b54003674d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:40.395279 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2909977472}
I20260709 12:59:40.941957  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:40.860181  1721 rpcz_store.cc:276] 0709 12:59:38.225829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:38.226302 (+   473us) service_pool.cc:224] Handling call
0709 12:59:38.226687 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:38.227088 (+   401us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:38.227139 (+    51us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:38.227737 (+   598us) log.cc:844] Serialized 26 byte log entry
0709 12:59:38.619710 (+391973us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:38.619775 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:38.619896 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:40.224893 (+1604997us) raft_consensus.cc:1685] finished
0709 12:59:40.233666 (+  8773us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:40.233872 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10794,"raft.queue_time_us":2339,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":29322,"thread_start_us":283395,"threads_started":1,"wal-append.queue_time_us":978433}
I20260709 12:59:40.942785  1572 raft_consensus.cc:1275] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:59:40.877878  1646 raft_consensus.cc:2468] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 4.
I20260709 12:59:40.934844  1719 rpcz_store.cc:276] 0709 12:59:38.726056 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:39.468356 (+742300us) service_pool.cc:224] Handling call
0709 12:59:39.486648 (+ 18292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:39.487035 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:39.487067 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:39.491980 (+  4913us) log.cc:844] Serialized 26 byte log entry
0709 12:59:39.747211 (+255231us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:39.747273 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:39.747368 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:40.305622 (+558254us) raft_consensus.cc:1685] finished
0709 12:59:40.305646 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:40.305806 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":538,"raft.queue_time_us":970,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":5581,"thread_start_us":195313,"threads_started":1,"wal-append.queue_time_us":432548}
I20260709 12:59:40.873246  1717 raft_consensus.cc:2410] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:59:40.951438  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:40.844569  4375 leader_election.cc:290] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:40.952116  1540 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.895s	user 0.056s	sys 0.073s
I20260709 12:59:40.970520  1647 raft_consensus.cc:1240] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 12:59:40.481719  4403 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.741s	user 0.000s	sys 0.027s
I20260709 12:59:40.961826  1643 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6.
I20260709 12:59:40.941156  1651 rpcz_store.cc:276] 0709 12:59:39.819447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:40.177733 (+358286us) service_pool.cc:224] Handling call
0709 12:59:40.854707 (+676974us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:40.738415  4122 consensus_queue.cc:260] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:40.692986  4332 consensus_meta.cc:287] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 1.225s	user 0.012s	sys 0.000s
I20260709 12:59:40.946789  1645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 1431) took 1117 ms. Trace:
I20260709 12:59:40.986513  1649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 1428) took 1214 ms. Trace:
W20260709 12:59:40.872560  4312 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.236s	user 0.032s	sys 0.056s
W20260709 12:59:40.971361  1615 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.771s	user 0.000s	sys 0.013s
I20260709 12:59:40.395123  4350 leader_election.cc:290] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:40.841210  4250 leader_election.cc:290] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:40.393297  4430 log.cc:927] Time spent T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.919s	user 0.005s	sys 0.000s
W20260709 12:59:40.378654  4412 consensus_meta.cc:287] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.942s	user 0.011s	sys 0.000s
I20260709 12:59:40.256569  4427 raft_consensus.cc:515] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:40.532974  4469 log.cc:927] Time spent T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 12:59:40.983218  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 1429) took 1170 ms. Trace:
I20260709 12:59:40.985684  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:40.985870  2323 raft_consensus.cc:1240] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:40.275344  4397 raft_consensus.cc:740] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
W20260709 12:59:40.281746  4406 consensus_meta.cc:287] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 1.028s	user 0.011s	sys 0.000s
W20260709 12:59:40.970902  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:40.854095  4314 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.124s	user 0.012s	sys 0.015s
W20260709 12:59:40.958649  4241 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.224s	user 0.009s	sys 0.008s
I20260709 12:59:40.973141  1650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 1424) took 1239 ms. Trace:
I20260709 12:59:41.185118  1650 rpcz_store.cc:276] 0709 12:59:39.733254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:40.190747 (+457493us) service_pool.cc:224] Handling call
0709 12:59:40.973075 (+782328us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:41.186224  2324 raft_consensus.cc:2468] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 6.
W20260709 12:59:41.158128  1723 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1950) took 2437 ms (client timeout 2488 ms). Trace:
W20260709 12:59:41.187606  1615 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.987s	user 0.000s	sys 0.027s
W20260709 12:59:41.170871  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:41.188261  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 987886us
W20260709 12:59:41.188078  1723 rpcz_store.cc:269] 0709 12:59:38.720484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:38.729704 (+  9220us) service_pool.cc:224] Handling call
0709 12:59:41.149338 (+2419634us) spinlock_profiling.cc:243] Waited 689 ms on lock 0x7b540009bad4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:41.158068 (+  8730us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1584055552}
W20260709 12:59:41.124974  1570 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.051s	user 0.006s	sys 0.021s
W20260709 12:59:41.175714  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:41.168229  2294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.166846  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
W20260709 12:59:41.042058  1721 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1355) took 1492 ms (client timeout 1725 ms). Trace:
W20260709 12:59:41.190348  1721 rpcz_store.cc:269] 0709 12:59:39.549233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:40.951212 (+1401979us) service_pool.cc:224] Handling call
0709 12:59:41.041972 (+ 90760us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:41.081223  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.191102  1573 raft_consensus.cc:1275] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:41.051673  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:40.940442  4116 raft_consensus.cc:515] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:41.178058  1647 rpcz_store.cc:276] 0709 12:59:39.812775 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:40.944662 (+1131887us) service_pool.cc:224] Handling call
0709 12:59:40.970212 (+ 25550us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:40.982808 (+ 12596us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:40.983138 (+   330us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:41.186363  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:40.553529  4346 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:41.187085  1716 raft_consensus.cc:3060] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:41.077888  2297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.187628  1569 raft_consensus.cc:2410] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 12:59:41.189781  1570 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.116s	user 0.007s	sys 0.022s
I20260709 12:59:41.192273  1719 raft_consensus.cc:2393] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 5: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
W20260709 12:59:41.206928  1719 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1360) took 1650 ms (client timeout 1816 ms). Trace:
W20260709 12:59:41.207408  1719 rpcz_store.cc:269] 0709 12:59:39.556828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:40.951544 (+1394716us) service_pool.cc:224] Handling call
0709 12:59:41.206859 (+255315us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:41.208518  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:41.192385  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:40.986847  1645 rpcz_store.cc:276] 0709 12:59:39.829199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:40.204521 (+375322us) service_pool.cc:224] Handling call
0709 12:59:40.946712 (+742191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:41.210742  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:41.211576  1645 raft_consensus.cc:2468] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 4.
W20260709 12:59:41.175964  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 941968us
I20260709 12:59:41.213480  1689 leader_election.cc:304] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 12:59:41.193188  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 987097us
I20260709 12:59:40.987026  1649 rpcz_store.cc:276] 0709 12:59:39.772141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:40.943412 (+1171271us) service_pool.cc:224] Handling call
0709 12:59:40.943768 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:40.986155 (+ 42387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:40.986189 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:40.986232 (+    43us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:40.986274 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:40.986342 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:40.986458 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41702,"raft.queue_time_us":41830,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":91}
I20260709 12:59:41.194087  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:41.214726  1720 raft_consensus.cc:3060] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:41.191152  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:41.214936  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:40.870667  4441 raft_consensus.cc:493] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:41.189041  1615 leader_election.cc:304] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:41.202478  2325 raft_consensus.cc:2410] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:59:41.215519  1721 raft_consensus.cc:2468] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 4.
I20260709 12:59:41.214792  1617 leader_election.cc:304] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
W20260709 12:59:41.216549  1721 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1347) took 1677 ms (client timeout 1949 ms). Trace:
W20260709 12:59:41.217115  1721 rpcz_store.cc:269] 0709 12:59:39.539424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.190943 (+1651519us) service_pool.cc:224] Handling call
0709 12:59:41.216453 (+ 25510us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:41.215555  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:40.957171  4396 raft_consensus.cc:493] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.218472  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:40.282852  4417 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:41.215613  1649 raft_consensus.cc:2468] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 6.
W20260709 12:59:41.122404  4415 log.cc:927] Time spent T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 2.392s	user 0.002s	sys 0.003s
W20260709 12:59:40.977768  4403 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.239s	user 0.000s	sys 0.032s
I20260709 12:59:40.945580  4131 raft_consensus.cc:493] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:40.393635  4413 leader_election.cc:290] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:41.157014  4414 leader_election.cc:290] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:41.123741  4444 leader_election.cc:290] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:40.958679  4395 leader_election.cc:290] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:41.209491  1573 raft_consensus.cc:2468] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 5.
W20260709 12:59:41.141100  4463 log.cc:927] Time spent T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.581s	user 0.000s	sys 0.001s
I20260709 12:59:41.201404  4286 raft_consensus.cc:493] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.934953  4106 raft_consensus.cc:515] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:41.228768  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:40.945348  4470 raft_consensus.cc:493] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:40.934429  4339 raft_consensus.cc:515] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:40.849442  4462 raft_consensus.cc:740] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:41.238963  1720 raft_consensus.cc:2468] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 4.
I20260709 12:59:40.969355  4338 raft_consensus.cc:493] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:41.284664  4479 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.285039  4338 raft_consensus.cc:515] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:41.285241  4479 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:41.287443  4338 leader_election.cc:290] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:41.240140  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:59:41.288318  1723 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1348) took 1748 ms (client timeout 1934 ms). Trace:
W20260709 12:59:41.288751  1723 rpcz_store.cc:269] 0709 12:59:39.539691 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.189762 (+1650071us) service_pool.cc:224] Handling call
0709 12:59:41.288259 (+ 98497us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:41.289722  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 12:59:41.226858  4458 log.cc:927] Time spent T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.922s	user 0.000s	sys 0.001s
I20260709 12:59:41.147660  4124 consensus_queue.cc:1048] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.110s
I20260709 12:59:41.291146  1724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1953) took 2567 ms. Trace:
W20260709 12:59:41.291182  1720 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1358) took 1741 ms (client timeout 1698 ms). Trace:
I20260709 12:59:41.158298  4448 leader_election.cc:290] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:59:41.142544  4466 log.cc:927] Time spent T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.900s	user 0.001s	sys 0.000s
I20260709 12:59:41.293517  4320 leader_election.cc:290] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:41.164858  4327 raft_consensus.cc:3055] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:41.294675  4327 raft_consensus.cc:740] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:41.257515  4417 raft_consensus.cc:493] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:41.295612  4327 consensus_queue.cc:260] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:41.295938  4417 raft_consensus.cc:515] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:40.306210  4442 raft_consensus.cc:515] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:41.296787  4327 raft_consensus.cc:3060] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:40.958454  4410 raft_consensus.cc:515] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:41.298614  4417 leader_election.cc:290] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:41.299063  4410 leader_election.cc:290] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:41.252578  4418 raft_consensus.cc:2804] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:41.299868  4418 raft_consensus.cc:697] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 5 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
W20260709 12:59:41.252514  1615 connection.cc:256] RPC call timeout handler was delayed by -1.1389681750000022s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 12:59:41.300666  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 1866) took 1993 ms. Trace:
I20260709 12:59:41.301611  1615 leader_election.cc:304] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:41.301153  4418 consensus_queue.cc:237] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:41.302584  4116 leader_election.cc:290] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:41.035748  4098 raft_consensus.cc:493] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:41.254038  4483 consensus_queue.cc:1048] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:41.303126  4286 raft_consensus.cc:515] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:41.303360  4098 raft_consensus.cc:515] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:41.302791  1615 leader_election.cc:400] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 election: Vote denied by peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423) with higher term. Message: Invalid argument: T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 4. Current term is 5.
I20260709 12:59:41.305059  1615 leader_election.cc:403] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
W20260709 12:59:41.305529  1720 rpcz_store.cc:269] 0709 12:59:39.556184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:40.951062 (+1394878us) service_pool.cc:224] Handling call
0709 12:59:41.291113 (+340051us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:41.253815  4397 consensus_queue.cc:260] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:41.142307  4362 raft_consensus.cc:3055] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:41.122592  4474 raft_consensus.cc:493] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:41.304565  4473 log.cc:927] Time spent T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.126s	user 0.000s	sys 0.003s
I20260709 12:59:41.141678  4433 leader_election.cc:290] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:41.305343  4444 raft_consensus.cc:493] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.319885  4098 leader_election.cc:290] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:41.322532  4444 raft_consensus.cc:515] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:41.324404  1719 raft_consensus.cc:3060] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:41.319764  4474 raft_consensus.cc:515] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:41.327040  4474 leader_election.cc:290] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:41.327997  4366 raft_consensus.cc:3060] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:41.328933  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 107054us
W20260709 12:59:41.329367  2325 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53306 (request call id 572) took 2586 ms (client timeout 1568 ms). Trace:
I20260709 12:59:41.257931  1617 leader_election.cc:304] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:41.250239  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:41.266026  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:41.331890  1650 raft_consensus.cc:2410] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:59:41.227147  4037 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.239880  4250 raft_consensus.cc:2804] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:41.336437  4250 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:41.337035  4250 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:41.339821  4106 leader_election.cc:290] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:41.092499  4440 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:41.229489  1721 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1361) took 1667 ms (client timeout 1996 ms). Trace:
W20260709 12:59:41.340950  1721 rpcz_store.cc:269] 0709 12:59:39.562466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.218152 (+1655686us) service_pool.cc:224] Handling call
0709 12:59:41.229414 (+ 11262us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:41.341521  4477 log.cc:927] Time spent T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:59:41.222971  4441 raft_consensus.cc:3060] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:41.241605  4346 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:41.273103  4414 raft_consensus.cc:493] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.242290  4396 raft_consensus.cc:515] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:41.344359  4414 raft_consensus.cc:515] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:41.346500  4396 leader_election.cc:290] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:41.346913  4414 leader_election.cc:290] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:41.348414  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:59:41.348923  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:41.329890  2325 rpcz_store.cc:269] 0709 12:59:38.743100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:38.743621 (+   521us) service_pool.cc:224] Handling call
0709 12:59:41.329109 (+2585488us) spinlock_profiling.cc:243] Waited 2.42 s on lock 0x7b5400690354. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:41.329279 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5554933504}
I20260709 12:59:41.278303  4145 leader_election.cc:290] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:41.221999  4412 raft_consensus.cc:493] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:41.280893  4470 raft_consensus.cc:515] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:41.283967  4310 consensus_meta.cc:287] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 1.026s	user 0.007s	sys 0.001s
I20260709 12:59:41.255487  4131 raft_consensus.cc:515] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:40.941767  4443 raft_consensus.cc:515] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:41.290331  1723 raft_consensus.cc:3060] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:59:41.220292  1689 leader_election.cc:304] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 12:59:41.319169  4245 consensus_meta.cc:287] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 1.070s	user 0.007s	sys 0.004s
W20260709 12:59:41.184981  4241 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.450s	user 0.009s	sys 0.008s
I20260709 12:59:41.073836  4436 raft_consensus.cc:493] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:41.150067  4332 consensus_queue.cc:1048] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.108s
I20260709 12:59:41.292877  4427 leader_election.cc:290] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:41.291637  1724 rpcz_store.cc:276] 0709 12:59:38.723722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:39.236368 (+512646us) service_pool.cc:224] Handling call
0709 12:59:39.289674 (+ 53306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:39.554625 (+264951us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:39.554655 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:39.684837 (+130182us) log.cc:844] Serialized 26 byte log entry
0709 12:59:39.962303 (+277466us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:59:39.962345 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:39.962412 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:41.290929 (+1328517us) raft_consensus.cc:1685] finished
0709 12:59:41.290950 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:41.291080 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":50934,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":94,"thread_start_us":445093,"threads_started":2,"wal-append.queue_time_us":511407}
I20260709 12:59:41.252102  4355 consensus_queue.cc:1059] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:59:40.941392  4419 raft_consensus.cc:515] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:41.301035  1567 rpcz_store.cc:276] 0709 12:59:39.307118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:39.749647 (+442529us) service_pool.cc:224] Handling call
0709 12:59:39.754610 (+  4963us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:39.947550 (+192940us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:39.947596 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:39.948217 (+   621us) log.cc:844] Serialized 26 byte log entry
0709 12:59:40.211624 (+263407us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:40.211686 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:40.211785 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:41.300411 (+1088626us) raft_consensus.cc:1685] finished
0709 12:59:41.300437 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:41.300598 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":336561,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":67109,"thread_start_us":455377,"threads_started":2,"wal-append.queue_time_us":439230}
I20260709 12:59:41.241359  4373 raft_consensus.cc:2749] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:41.306767  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:41.373174  4310 raft_consensus.cc:2749] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:41.332772  4480 raft_consensus.cc:2749] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:41.334918  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 1867) took 2022 ms. Trace:
I20260709 12:59:41.335481  4037 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:41.342015  2323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53290 (request call id 856) took 1179 ms. Trace:
I20260709 12:59:41.352505  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:41.342152  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:41.381220  4483 raft_consensus.cc:493] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.353894  1650 raft_consensus.cc:1240] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:41.356104  4433 raft_consensus.cc:2804] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:41.357746  4442 leader_election.cc:290] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:41.319280  4462 consensus_queue.cc:260] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:41.360677  1716 raft_consensus.cc:2468] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
I20260709 12:59:41.361861  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45148 (request call id 2039) took 1821 ms. Trace:
W20260709 12:59:41.432749  1716 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1359) took 1876 ms (client timeout 1661 ms). Trace:
I20260709 12:59:41.093281  4122 raft_consensus.cc:3060] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:41.433055  1644 rpcz_store.cc:276] 0709 12:59:39.540213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:39.540553 (+   340us) service_pool.cc:224] Handling call
0709 12:59:39.540893 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:39.541261 (+   368us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:59:41.200853 (+1659592us) spinlock_profiling.cc:243] Waited 39.6 ms on lock 0x7b180035b180. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9f1f634bc 00007fa9ef2b148b 00007fa9f810bab9 00007fa9ef2cd69b 00007fa9ef2cb93f 00007fa9ef2cb455 00007fa9f5db33c7 00007fa9f23c59a7 00007fa9f23d50bf
0709 12:59:41.201031 (+   178us) log.cc:844] Serialized 14 byte log entry
0709 12:59:41.361326 (+160295us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:41.361384 (+    58us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:41.361450 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:41.361650 (+   200us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:41.361803 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9634,"prepare.queue_time_us":144585,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":41,"raft.queue_time_us":28441,"raft.run_cpu_time_us":505,"raft.run_wall_time_us":74978,"spinlock_wait_cycles":93002880,"thread_start_us":379796,"threads_started":2,"wal-append.queue_time_us":183179}
W20260709 12:59:41.374454  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 154247us
I20260709 12:59:41.321319  4339 leader_election.cc:290] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:41.377930  2294 leader_election.cc:304] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:41.379199  1719 raft_consensus.cc:2468] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6.
W20260709 12:59:41.443620  1719 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1365) took 1797 ms (client timeout 1884 ms). Trace:
W20260709 12:59:41.444185  1719 rpcz_store.cc:269] 0709 12:59:39.646552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.208205 (+1561653us) service_pool.cc:224] Handling call
0709 12:59:41.324189 (+115984us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b5400203928. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f8198924 00007fa9f7381227 00007fa9f7380ab8 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:41.443540 (+119351us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23498496}
I20260709 12:59:41.445614  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:41.446475  1719 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
I20260709 12:59:41.447121  1719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1364) took 1807 ms. Trace:
I20260709 12:59:41.447518  1719 rpcz_store.cc:276] 0709 12:59:39.640083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.445262 (+1805179us) service_pool.cc:224] Handling call
0709 12:59:41.447049 (+  1787us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:41.380559  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:41.353060  4397 raft_consensus.cc:3060] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:41.308276  4362 raft_consensus.cc:740] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:41.318835  4417 raft_consensus.cc:2749] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:41.344362  4346 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:41.361567  4375 raft_consensus.cc:493] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:41.416165  1720 raft_consensus.cc:2393] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 6: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 12:59:41.480918  1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1349) took 1941 ms. Trace:
I20260709 12:59:41.481371  1720 rpcz_store.cc:276] 0709 12:59:39.539910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.306417 (+1766507us) service_pool.cc:224] Handling call
0709 12:59:41.480844 (+174427us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:41.482556  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:41.483258  1720 raft_consensus.cc:2468] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 5.
I20260709 12:59:41.484117  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:40.971226  4370 raft_consensus.cc:515] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:41.369639  4412 raft_consensus.cc:515] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:41.417142  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:41.492885  1567 raft_consensus.cc:2468] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 3.
I20260709 12:59:41.492960  4470 leader_election.cc:290] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:41.494122  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:41.420873  2323 rpcz_store.cc:276] 0709 12:59:40.162631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:40.246803 (+ 84172us) service_pool.cc:224] Handling call
0709 12:59:40.329488 (+ 82685us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:41.202342 (+872854us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:41.341726 (+139384us) spinlock_profiling.cc:243] Waited 656 ms on lock 0x7b54008476d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:41.341934 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1508717952}
I20260709 12:59:41.494901  1567 raft_consensus.cc:3060] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:41.495801  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:41.496708  2323 raft_consensus.cc:2468] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 4.
I20260709 12:59:41.417897  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:41.373780  4414 raft_consensus.cc:493] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:41.498873  4414 raft_consensus.cc:515] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:41.500630  4375 raft_consensus.cc:515] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:41.501338  4414 leader_election.cc:290] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:41.353578  4410 consensus_queue.cc:1048] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260709 12:59:41.501760  4145 raft_consensus.cc:2804] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:41.485447  4462 raft_consensus.cc:3060] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:41.502211  4145 raft_consensus.cc:493] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:41.353407  1615 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:41.502648  4145 raft_consensus.cc:3060] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:41.503224  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 149918us
I20260709 12:59:41.473079  4377 raft_consensus.cc:2749] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:41.504698  4419 leader_election.cc:290] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:41.505620  4417 raft_consensus.cc:2749] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:59:41.420701  1570 rpcz_store.cc:276] 0709 12:59:39.312994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:39.814816 (+501822us) service_pool.cc:224] Handling call
0709 12:59:39.839785 (+ 24969us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:39.840010 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:59:39.917216 (+ 77206us) log.cc:844] Serialized 14 byte log entry
0709 12:59:41.334362 (+1417146us) spinlock_profiling.cc:243] Waited 6.67 ms on lock 0x7b1800352a80. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9f1f634bc 00007fa9ef2b148b 00007fa9f810bab9 00007fa9ef2cd69b 00007fa9ef2cb93f 00007fa9ef2cb455 00007fa9f23b3060 00007fa9f23c5716 00007fa9f23d6287
0709 12:59:41.334481 (+   119us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:41.334545 (+    64us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:41.334605 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:41.334689 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:41.334847 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":33945,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":5713,"raft.queue_time_us":114696,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":74,"spinlock_wait_cycles":15332736,"thread_start_us":1299810,"threads_started":2,"wal-append.queue_time_us":179914,"wal-append.run_cpu_time_us":7114,"wal-append.run_wall_time_us":1087590}
I20260709 12:59:41.506955  1615 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:59:41.421763  1721 raft_consensus.cc:2393] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 7: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:41.507231  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:41.507944  1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1351) took 1967 ms. Trace:
I20260709 12:59:41.380129  4106 raft_consensus.cc:2749] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:41.508158  1570 raft_consensus.cc:3060] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:59:41.425002  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:41.509030  1724 raft_consensus.cc:2468] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 6.
I20260709 12:59:41.510023  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:41.510669  1724 raft_consensus.cc:2393] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 8: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:59:41.511061  1724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1346) took 1971 ms. Trace:
I20260709 12:59:41.511355  1724 rpcz_store.cc:276] 0709 12:59:39.539210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.509768 (+1970558us) service_pool.cc:224] Handling call
0709 12:59:41.510998 (+  1230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:41.512151  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:41.385321  4245 raft_consensus.cc:2749] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:41.428130  1650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 1433) took 1507 ms. Trace:
I20260709 12:59:41.512928  1650 rpcz_store.cc:276] 0709 12:59:39.921054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.349662 (+1428608us) service_pool.cc:224] Handling call
0709 12:59:41.350052 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:41.427778 (+ 77726us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:41.428062 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:41.429296  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 171460us
I20260709 12:59:41.514477  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:41.515043  1720 raft_consensus.cc:2468] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 6.
I20260709 12:59:41.516055  1720 raft_consensus.cc:1240] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:41.430693  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:41.516425  1570 raft_consensus.cc:2468] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 9.
W20260709 12:59:41.431448  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 125643us
I20260709 12:59:41.517374  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:41.517940  1570 raft_consensus.cc:2468] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7.
I20260709 12:59:41.518074  1723 raft_consensus.cc:2468] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 3.
W20260709 12:59:41.433251  1716 rpcz_store.cc:269] 0709 12:59:39.556506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:40.935441 (+1378935us) service_pool.cc:224] Handling call
0709 12:59:41.432674 (+497233us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:41.518584  1723 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1356) took 1969 ms (client timeout 2129 ms). Trace:
I20260709 12:59:41.384310  4448 consensus_queue.cc:1048] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.044s
W20260709 12:59:41.449980  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.439767  1689 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:41.508333  1721 rpcz_store.cc:276] 0709 12:59:39.540354 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.341820 (+1801466us) service_pool.cc:224] Handling call
0709 12:59:41.507886 (+166066us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:41.455694  2332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53290 (request call id 853) took 1386 ms. Trace:
I20260709 12:59:41.513870  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:41.458777  2329 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f"
dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
mode: GRACEFUL
new_leader_uuid: "4dbe7d47a2374afca075d3a98583b49e"
 from {username='slave'} at 127.0.0.1:39778
I20260709 12:59:41.460181  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 12:59:41.463002  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.521975  2329 raft_consensus.cc:606] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 LEADER]: Received request to transfer leadership to TS 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:41.465662  1651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 439) took 1552 ms. Trace:
I20260709 12:59:41.470345  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:41.523005  2295 leader_election.cc:304] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 12:59:41.480082  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 102237us
I20260709 12:59:41.388995  4436 raft_consensus.cc:515] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:41.523898  2294 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:41.431176  4483 raft_consensus.cc:515] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:41.505820  4479 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:41.376170  4484 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.389762  4444 leader_election.cc:290] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:41.384063  4320 consensus_queue.cc:1048] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:59:41.518882  1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1961) took 2789 ms. Trace:
I20260709 12:59:41.520704  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 12:59:41.520555  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 80864.4us
I20260709 12:59:41.523201  1571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 503) took 2832 ms. Trace:
I20260709 12:59:41.427575  4433 raft_consensus.cc:493] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:41.507159  4443 leader_election.cc:290] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:41.492137  4412 leader_election.cc:290] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:41.522650  1651 rpcz_store.cc:276] 0709 12:59:39.913314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:40.978268 (+1064954us) service_pool.cc:224] Handling call
0709 12:59:40.985857 (+  7589us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:40.986180 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:40.986208 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:41.240715 (+254507us) log.cc:844] Serialized 26 byte log entry
0709 12:59:41.430014 (+189299us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:41.431923 (+  1909us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:41.432021 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:41.465383 (+ 33362us) raft_consensus.cc:1685] finished
0709 12:59:41.465409 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:41.465589 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":49282,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":13818,"thread_start_us":175906,"threads_started":1,"wal-append.queue_time_us":207678}
I20260709 12:59:41.466310  4314 raft_consensus.cc:493] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.524029  1724 raft_consensus.cc:2410] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:59:41.678947  4436 leader_election.cc:290] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:41.679292  1724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1342) took 2141 ms. Trace:
I20260709 12:59:41.680658  1571 rpcz_store.cc:276] 0709 12:59:38.690984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:39.492705 (+801721us) service_pool.cc:224] Handling call
0709 12:59:39.492987 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:39.493184 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:59:39.542409 (+ 49225us) log.cc:844] Serialized 14 byte log entry
0709 12:59:41.322583 (+1780174us) spinlock_profiling.cc:243] Waited 7.02 ms on lock 0x7b1800278c80. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef2b0e07 00007fa9f810bab9 00007fa9ef2cd69b 00007fa9ef2cb93f 00007fa9ef2cdc02 00007fa9f1f5520b 00007fa9f1f5ad23 00007fa9f1f5b23a 00007fa9f23c5a2a
0709 12:59:41.521794 (+199211us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:41.522892 (+  1098us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:41.522974 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:41.523054 (+    80us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:41.523154 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":49100,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":3970,"raft.queue_time_us":110,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":37044,"spinlock_wait_cycles":16152320,"thread_start_us":198797,"threads_started":1}
W20260709 12:59:41.623952  1574 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36642 (request call id 2198) took 3172 ms (client timeout 2022 ms). Trace:
W20260709 12:59:41.678722  2324 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53306 (request call id 575) took 2885 ms (client timeout 2032 ms). Trace:
W20260709 12:59:41.677009  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 222241us
I20260709 12:59:41.619748  1718 raft_consensus.cc:2468] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6.
W20260709 12:59:41.518965  1723 rpcz_store.cc:269] 0709 12:59:39.549474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.289433 (+1739959us) service_pool.cc:224] Handling call
0709 12:59:41.518532 (+229099us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:41.684020  2324 rpcz_store.cc:269] 0709 12:59:38.793080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:38.793223 (+   143us) service_pool.cc:224] Handling call
0709 12:59:41.678467 (+2885244us) spinlock_profiling.cc:243] Waited 2.28 s on lock 0x7b54005604d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:41.678628 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5253416192}
W20260709 12:59:41.569391  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:41.690949  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 167123us
I20260709 12:59:41.680137  1720 rpcz_store.cc:276] 0709 12:59:38.743192 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.515631 (+2772439us) service_pool.cc:224] Handling call
0709 12:59:41.515886 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:41.516355 (+   469us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:41.516502 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:41.691562  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.560318  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:41.565178  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:41.692232  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:41.575953  1645 raft_consensus.cc:2468] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 4.
I20260709 12:59:41.520479  2332 rpcz_store.cc:276] 0709 12:59:40.069616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:40.069756 (+   140us) service_pool.cc:224] Handling call
0709 12:59:40.098107 (+ 28351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:40.242178 (+144071us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:59:41.201199 (+959021us) log.cc:844] Serialized 14 byte log entry
0709 12:59:41.455291 (+254092us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:41.455359 (+    68us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:41.455417 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:41.455495 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:41.455629 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20175,"raft.queue_time_us":45511,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":27493,"thread_start_us":181114,"threads_started":1,"wal-append.queue_time_us":262645}
I20260709 12:59:41.625371  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 12:59:41.632603  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:41.694962  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:41.696472  1569 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37682 (request call id 497) took 3192 ms (client timeout 2745 ms). Trace:
I20260709 12:59:41.684221  1719 raft_consensus.cc:3060] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:41.696889  1569 rpcz_store.cc:269] 0709 12:59:38.504479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:38.825843 (+321364us) service_pool.cc:224] Handling call
0709 12:59:41.696279 (+2870436us) spinlock_profiling.cc:243] Waited 2.36 s on lock 0x7b540024a4d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:41.696408 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5428858240}
W20260709 12:59:41.697573  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.524595  1650 raft_consensus.cc:2393] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 6: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:41.487561  4310 raft_consensus.cc:493] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:41.698840  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 1.45824e+06us
I20260709 12:59:41.695509  1688 leader_election.cc:304] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:41.698078  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:41.700317  1569 raft_consensus.cc:2468] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 5.
I20260709 12:59:41.692267  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:59:41.683172  1574 rpcz_store.cc:269] 0709 12:59:38.451582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:38.451686 (+   104us) service_pool.cc:224] Handling call
0709 12:59:41.623716 (+3172030us) spinlock_profiling.cc:243] Waited 2.88 s on lock 0x7b5400312754. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:41.623853 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6615008640}
I20260709 12:59:41.700596  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 12:59:42.290707  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.992758  1719 raft_consensus.cc:2468] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 9.
I20260709 12:59:42.007781  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:41.679711  1724 rpcz_store.cc:276] 0709 12:59:39.538220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.511904 (+1973684us) service_pool.cc:224] Handling call
0709 12:59:41.679236 (+167332us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:41.698112  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:42.293618  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:42.378970  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:41.704386  2326 raft_consensus.cc:2393] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 5: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 12:59:42.379731  1569 raft_consensus.cc:2468] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 4.
W20260709 12:59:41.841655  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 269607us
I20260709 12:59:41.696875  1723 raft_consensus.cc:1240] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:59:42.381745  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:41.974466  1572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36642 (request call id 2215) took 2711 ms. Trace:
I20260709 12:59:41.767254  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
W20260709 12:59:41.768006  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 72564.9us
I20260709 12:59:41.775127  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 501) took 3269 ms. Trace:
W20260709 12:59:41.777537  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 81495.9us
W20260709 12:59:41.725646  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.925213  1722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1955) took 3200 ms. Trace:
I20260709 12:59:42.294101  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:42.293038  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:42.382851  1569 raft_consensus.cc:2468] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7.
I20260709 12:59:42.389312  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:42.390255  1569 raft_consensus.cc:2393] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 7: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
W20260709 12:59:41.907639  1646 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 1420) took 2175 ms (client timeout 1698 ms). Trace:
W20260709 12:59:41.903918  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:42.292562  1539 connection.cc:256] RPC call timeout handler was delayed by -1.4146753050000029s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1996s for a response
W20260709 12:59:42.393219  1539 connection.cc:256] RPC call timeout handler was delayed by -1.2752571660000172s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1884s for a response
I20260709 12:59:42.388163  1723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1344) took 2849 ms. Trace:
I20260709 12:59:42.383862  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:42.290786  1570 raft_consensus.cc:2468] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 5.
I20260709 12:59:42.395053  1648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 424) took 4381 ms. Trace:
I20260709 12:59:42.395162  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37682 (request call id 516) took 1006 ms. Trace:
W20260709 12:59:41.829730  2297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:41.912968  1643 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 1427) took 2161 ms (client timeout 1509 ms). Trace:
I20260709 12:59:41.716913  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:41.705062  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:42.292713  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:41.567611  1567 raft_consensus.cc:2468] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 5.
I20260709 12:59:42.395663  1723 rpcz_store.cc:276] 0709 12:59:39.538746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.696315 (+2157569us) service_pool.cc:224] Handling call
0709 12:59:41.696644 (+   329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:42.382471 (+685827us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:42.388077 (+  5606us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:42.399125  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37682 (request call id 510) took 1030 ms. Trace:
I20260709 12:59:42.380867  1575 raft_consensus.cc:2468] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 3.
W20260709 12:59:41.964350  1718 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1357) took 2414 ms (client timeout 1683 ms). Trace:
W20260709 12:59:42.391181  1646 rpcz_store.cc:269] 0709 12:59:39.731979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:39.735057 (+  3078us) service_pool.cc:224] Handling call
0709 12:59:41.907437 (+2172380us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b540030f054. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:41.907556 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2591773952}
I20260709 12:59:42.293447  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:42.395504  1648 rpcz_store.cc:276] 0709 12:59:37.918403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:37.921736 (+  3333us) service_pool.cc:224] Handling call
0709 12:59:37.969052 (+ 47316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:37.985857 (+ 16805us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:37.985907 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:37.986475 (+   568us) log.cc:844] Serialized 26 byte log entry
0709 12:59:38.446516 (+460041us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:38.446586 (+    70us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:38.446676 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:40.188448 (+1741772us) spinlock_profiling.cc:243] Waited 5.38 ms on lock 0x7b4400022b4c. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef1f4c85 00007fa9ef1f56a2 00007fa9f1f671db 00007fa9f1f62aaf 00007fa9f1f5686e 00007fa9f1f55bb6 00007fa9f1f557d8 00007fa9f1f5f221 00007fa9f1f5f1d9 00007fa9f1f5f169
0709 12:59:41.816218 (+1627770us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b24002a1ce8. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef1549c4 00007fa9ef152acb 00007fa9ef30ddc9 00007fa9ef30da55 00007fa9ef30cfb0 00007fa9f1f83488 00007fa9f1f83be8 00007fa9f1f5b398 00007fa9f1f5676a 00007fa9f1f55bb6
0709 12:59:42.299401 (+483183us) raft_consensus.cc:1685] finished
0709 12:59:42.299431 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:42.299638 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":115,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":54337,"spinlock_wait_cycles":43755648,"thread_start_us":382085,"threads_started":1,"wal-append.queue_time_us":579273}
I20260709 12:59:42.402586  1574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36640 (request call id 1876) took 1036 ms. Trace:
W20260709 12:59:42.166602  1573 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.002s	sys 0.019s
I20260709 12:59:42.403091  1574 rpcz_store.cc:276] 0709 12:59:41.366316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.293230 (+926914us) service_pool.cc:224] Handling call
0709 12:59:42.402512 (+109282us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:42.403992  1573 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.907s	user 0.004s	sys 0.020s
W20260709 12:59:42.006696  1717 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1966) took 3262 ms (client timeout 2194 ms). Trace:
I20260709 12:59:42.404546  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 12:59:42.394089  1539 connection.cc:256] RPC call timeout handler was delayed by -1.255720875999998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2545s for a response
W20260709 12:59:41.867523  1642 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 1421) took 2119 ms (client timeout 2545 ms). Trace:
W20260709 12:59:42.404830  1717 rpcz_store.cc:269] 0709 12:59:38.804707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:39.216868 (+412161us) service_pool.cc:224] Handling call
0709 12:59:42.006403 (+2789535us) spinlock_profiling.cc:243] Waited 1.64 s on lock 0x7b54002ab7d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:42.006600 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3760882560}
I20260709 12:59:42.399632  1571 raft_consensus.cc:2468] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 3.
W20260709 12:59:42.417449  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:42.380240  1720 raft_consensus.cc:2468] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 3.
I20260709 12:59:42.418503  1539 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:59:42.407245  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:42.390875  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36640 (request call id 1879) took 1004 ms. Trace:
I20260709 12:59:41.854785  1644 raft_consensus.cc:1275] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:59:42.405036  2330 raft_consensus.cc:2468] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7.
I20260709 12:59:42.420037  1569 rpcz_store.cc:276] 0709 12:59:41.386265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.389044 (+1002779us) service_pool.cc:224] Handling call
0709 12:59:42.390789 (+  1745us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:42.400374  1718 rpcz_store.cc:269] 0709 12:59:39.549708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:40.941677 (+1391969us) service_pool.cc:224] Handling call
0709 12:59:41.964091 (+1022414us) spinlock_profiling.cc:243] Waited 563 ms on lock 0x7b54000e2254. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:41.964250 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1293997824}
I20260709 12:59:42.395565  1570 rpcz_store.cc:276] 0709 12:59:41.388348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.700342 (+311994us) service_pool.cc:224] Handling call
0709 12:59:42.395105 (+694763us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:42.421056  1642 rpcz_store.cc:269] 0709 12:59:39.732355 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:39.735428 (+  3073us) service_pool.cc:224] Handling call
0709 12:59:41.850996 (+2115568us) spinlock_profiling.cc:243] Waited 535 ms on lock 0x7b5400174dd4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:41.851180 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1231237376}
W20260709 12:59:42.383921  1617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:42.418862  1720 raft_consensus.cc:1240] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:42.423009  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:42.419799  2324 raft_consensus.cc:2468] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8.
I20260709 12:59:42.421833  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:42.423071  1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1350) took 2883 ms. Trace:
W20260709 12:59:42.392244  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:42.399668  1567 rpcz_store.cc:276] 0709 12:59:41.368165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.493800 (+125635us) service_pool.cc:224] Handling call
0709 12:59:42.399065 (+905265us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:42.425463  1720 rpcz_store.cc:276] 0709 12:59:39.540133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.418368 (+2878235us) service_pool.cc:224] Handling call
0709 12:59:42.418670 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:42.422806 (+  4136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:42.423014 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:42.425249  1571 raft_consensus.cc:2410] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 12:59:42.426204  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:42.426512  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:41.607120  4417 raft_consensus.cc:2804] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:41.621047  4351 leader_election.cc:290] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:59:42.400743  1643 rpcz_store.cc:269] 0709 12:59:39.751511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:39.753469 (+  1958us) service_pool.cc:224] Handling call
0709 12:59:41.912760 (+2159291us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54001748d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:41.912882 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2683576576}
I20260709 12:59:42.421918  1572 rpcz_store.cc:276] 0709 12:59:39.262913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:39.531064 (+268151us) service_pool.cc:224] Handling call
0709 12:59:40.395551 (+864487us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:40.950919 (+555368us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:41.974191 (+1023272us) spinlock_profiling.cc:243] Waited 864 ms on lock 0x7b54003674d0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23ba8ad 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:41.974378 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1987409280}
I20260709 12:59:41.694337  4350 raft_consensus.cc:2804] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:42.429119  1645 raft_consensus.cc:1240] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260709 12:59:42.009878  4441 consensus_meta.cc:287] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.667s	user 0.011s	sys 0.000s
I20260709 12:59:42.384953  1688 leader_election.cc:304] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:42.434257  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 12:59:41.803993  4498 log.cc:927] Time spent T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.152s	user 0.002s	sys 0.000s
I20260709 12:59:42.415205  1615 leader_election.cc:304] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:42.386590  1722 rpcz_store.cc:276] 0709 12:59:38.724582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:39.338300 (+613718us) service_pool.cc:224] Handling call
0709 12:59:39.338613 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:39.475038 (+136425us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:59:39.705843 (+230805us) log.cc:844] Serialized 14 byte log entry
0709 12:59:39.840469 (+134626us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:39.840544 (+    75us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:39.840611 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:40.253882 (+413271us) spinlock_profiling.cc:243] Waited 62.8 ms on lock 0x7b180044e480. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef2ce3f3 00007fa9ef2d07c1 00007fa9ef2d0779 00007fa9ef2d0709 00007fa9ef2d06d1 00007fa9ef2cf9cd 000000000038f354 000000000038f199 00007fa9ef2b183a
0709 12:59:41.924995 (+1671113us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b54002ab2d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:41.925045 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:41.925159 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21859,"prepare.queue_time_us":66696,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":83752,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":56896,"spinlock_wait_cycles":457581056,"thread_start_us":325623,"threads_started":2,"wal-append.queue_time_us":256020,"wal-append.run_cpu_time_us":982,"wal-append.run_wall_time_us":1013130}
I20260709 12:59:41.663982  4486 raft_consensus.cc:493] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:42.441239  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:41.693760  4433 raft_consensus.cc:3060] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:41.561272  4245 raft_consensus.cc:2804] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:41.523108  4472 raft_consensus.cc:493] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:41.677351  4131 leader_election.cc:290] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:42.009089  4145 consensus_meta.cc:287] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.506s	user 0.011s	sys 0.000s
W20260709 12:59:42.251803  4122 consensus_meta.cc:287] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.810s	user 0.009s	sys 0.001s
W20260709 12:59:41.989424  4397 consensus_meta.cc:287] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.520s	user 0.008s	sys 0.000s
W20260709 12:59:42.206146  4106 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.001s	sys 0.020s
I20260709 12:59:41.778061  4250 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:42.440364  4310 raft_consensus.cc:515] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:41.622857  4286 leader_election.cc:290] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:41.638695  4414 raft_consensus.cc:493] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:42.456135  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:42.457113  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 12:59:42.460312  2294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:41.699417  4476 raft_consensus.cc:3055] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:42.461139  2297 leader_election.cc:304] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
W20260709 12:59:42.187638  4462 consensus_meta.cc:287] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.685s	user 0.012s	sys 0.000s
I20260709 12:59:42.494208  2297 leader_election.cc:304] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:41.569869  4056 raft_consensus.cc:2804] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:42.301548  4098 raft_consensus.cc:493] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:41.757062  4366 raft_consensus.cc:2749] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423) with higher term. Message: Invalid argument: T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 4. Current term is 5.
I20260709 12:59:41.923451  4370 leader_election.cc:290] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:41.779505  4443 raft_consensus.cc:2804] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:41.919366  4037 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:41.575512  4327 consensus_queue.cc:1048] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.872s
I20260709 12:59:42.500005  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:41.816354  4483 leader_election.cc:290] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:41.676672  4362 consensus_queue.cc:260] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:41.694295  4444 consensus_queue.cc:1048] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.769s
I20260709 12:59:42.501328  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:42.501624  4362 raft_consensus.cc:3060] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:42.437806  4410 raft_consensus.cc:493] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:42.443086  4417 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:42.503235  4417 raft_consensus.cc:3060] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:42.491468  4414 raft_consensus.cc:515] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 12:59:42.497452  4286 raft_consensus.cc:2804] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:42.505959  4286 raft_consensus.cc:493] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:42.506346  4286 raft_consensus.cc:3060] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:42.506677  4414 leader_election.cc:290] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:42.506807  4250 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:41.757248  4419 consensus_queue.cc:1048] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.710s
I20260709 12:59:41.757073  4474 consensus_queue.cc:1059] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.768s
I20260709 12:59:41.776981  4436 consensus_queue.cc:1059] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.695s
I20260709 12:59:41.695593  4484 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:41.697981  4314 raft_consensus.cc:515] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:42.010592  4492 log.cc:927] Time spent T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.315s	user 0.001s	sys 0.000s
I20260709 12:59:42.477717  4350 raft_consensus.cc:697] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
W20260709 12:59:42.486485  4106 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.861s	user 0.002s	sys 0.022s
I20260709 12:59:42.485993  4131 raft_consensus.cc:2804] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:42.500098  4443 raft_consensus.cc:493] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:42.430850  4418 raft_consensus.cc:493] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:42.487789  4375 leader_election.cc:290] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:42.472461  4441 raft_consensus.cc:515] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:42.491689  4476 raft_consensus.cc:740] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:42.485442  4145 raft_consensus.cc:515] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:42.503206  4410 raft_consensus.cc:515] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:42.516809  4370 raft_consensus.cc:2804] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:42.521865  4443 raft_consensus.cc:3060] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:42.519786  4413 consensus_queue.cc:1059] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 12:59:42.481751  4486 raft_consensus.cc:515] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:42.483819  4472 raft_consensus.cc:515] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:42.522281  4480 consensus_queue.cc:1059] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.011s
I20260709 12:59:42.540937  4486 leader_election.cc:290] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:42.537917  4480 consensus_queue.cc:1243] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer 4dbe7d47a2374afca075d3a98583b49e log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:59:42.542399  4484 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:42.543272  4476 consensus_queue.cc:260] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:42.454080  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:42.569792  1572 raft_consensus.cc:2393] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 3: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:42.572890  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:42.575439  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:42.575603  1542 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:42.576468  1572 raft_consensus.cc:2468] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 5.
I20260709 12:59:42.577930  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:42.594141  1569 raft_consensus.cc:2393] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 4: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:42.595510  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:42.416466  1574 raft_consensus.cc:2376] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 8. Re-sending same reply.
I20260709 12:59:42.596494  1569 raft_consensus.cc:2468] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 3.
I20260709 12:59:42.599736  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:42.580287  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:42.429526  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:42.600886  1540 leader_election.cc:304] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:42.601213  1569 raft_consensus.cc:2468] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 4.
I20260709 12:59:42.601665  1575 raft_consensus.cc:2368] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 6. Current term is 7.
I20260709 12:59:42.602077  1570 raft_consensus.cc:2393] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 6: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:42.603474  1575 raft_consensus.cc:1240] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:42.603546  1569 raft_consensus.cc:1275] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:42.603994  1570 raft_consensus.cc:1275] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:42.581542  1542 leader_election.cc:304] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:42.604288  1575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 1873) took 1358 ms. Trace:
I20260709 12:59:42.604758  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 1874) took 1328 ms. Trace:
W20260709 12:59:42.576041  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 157504us
I20260709 12:59:42.605027  1575 rpcz_store.cc:276] 0709 12:59:41.246356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.602564 (+1356208us) service_pool.cc:224] Handling call
0709 12:59:42.603159 (+   595us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:42.603978 (+   819us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:42.604205 (+   227us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:42.605225  1570 rpcz_store.cc:276] 0709 12:59:41.307351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.603032 (+1295681us) service_pool.cc:224] Handling call
0709 12:59:42.603552 (+   520us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:42.604469 (+   917us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:42.604702 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:42.607389  1575 raft_consensus.cc:1275] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:42.580287  1576 raft_consensus.cc:2410] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:59:42.598084  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:42.607990  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 506) took 1240 ms. Trace:
I20260709 12:59:42.583565  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:42.436163  1567 raft_consensus.cc:2468] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 4.
I20260709 12:59:42.609104  1571 raft_consensus.cc:2468] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 4.
I20260709 12:59:42.610518  1567 raft_consensus.cc:1275] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:59:42.611207  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 507) took 1243 ms. Trace:
I20260709 12:59:42.612128  1567 rpcz_store.cc:276] 0709 12:59:41.367670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.609312 (+1241642us) service_pool.cc:224] Handling call
0709 12:59:42.609923 (+   611us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:42.610985 (+  1062us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:42.611158 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:42.611234  1571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 508) took 1243 ms. Trace:
I20260709 12:59:42.466140  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:42.471714  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:42.615273  1643 raft_consensus.cc:2468] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 5.
I20260709 12:59:42.459427  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45148 (request call id 2047) took 1302 ms. Trace:
I20260709 12:59:42.616400  1651 raft_consensus.cc:2468] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 5.
I20260709 12:59:42.617283  1719 raft_consensus.cc:1240] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:42.617071  1644 rpcz_store.cc:276] 0709 12:59:41.157442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.461124 (+303682us) service_pool.cc:224] Handling call
0709 12:59:41.852642 (+391518us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:42.420263 (+567621us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:42.459161 (+ 38898us) spinlock_profiling.cc:243] Waited 382 ms on lock 0x7b5400174dd0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23ba8ad 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:42.459338 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":878938368}
I20260709 12:59:42.467382  1649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 440) took 2547 ms. Trace:
I20260709 12:59:42.475564  1721 raft_consensus.cc:1275] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:42.483283  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:42.619447  1649 rpcz_store.cc:276] 0709 12:59:39.919672 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.242725 (+1323053us) service_pool.cc:224] Handling call
0709 12:59:41.243092 (+   367us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:41.350986 (+107894us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:41.351031 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:41.361648 (+ 10617us) log.cc:844] Serialized 26 byte log entry
0709 12:59:41.471257 (+109609us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:41.471298 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:41.992943 (+521645us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b54002b3754. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:41.993007 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:42.438728 (+445721us) raft_consensus.cc:1685] finished
0709 12:59:42.438754 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:42.467307 (+ 28553us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":247442176,"thread_start_us":64653,"threads_started":1,"wal-append.queue_time_us":327658}
I20260709 12:59:42.472283  1718 raft_consensus.cc:1240] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:42.622576  1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 515) took 1661 ms. Trace:
I20260709 12:59:42.622973  1718 rpcz_store.cc:276] 0709 12:59:40.961116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.471754 (+1510638us) service_pool.cc:224] Handling call
0709 12:59:42.472066 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:42.621961 (+149895us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:42.622364 (+   403us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:42.623701  1722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 516) took 1662 ms. Trace:
I20260709 12:59:42.624914  1718 raft_consensus.cc:1275] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:59:42.625481  1650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 443) took 1383 ms. Trace:
I20260709 12:59:42.624097  1722 rpcz_store.cc:276] 0709 12:59:40.961341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.622221 (+1660880us) service_pool.cc:224] Handling call
0709 12:59:42.622867 (+   646us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:42.623241 (+   374us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:42.623265 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:42.623315 (+    50us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:42.623343 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:42.623394 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:42.623500 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:42.626192  1650 rpcz_store.cc:276] 0709 12:59:41.242080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.772612 (+530532us) service_pool.cc:224] Handling call
0709 12:59:42.290097 (+517485us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:42.290475 (+   378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:42.290502 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:42.291126 (+   624us) log.cc:844] Serialized 26 byte log entry
0709 12:59:42.463932 (+172806us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:42.463973 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:42.464052 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:42.624734 (+160682us) raft_consensus.cc:1685] finished
0709 12:59:42.624783 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:42.625134 (+   351us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8663,"raft.queue_time_us":13270,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":44912,"spinlock_wait_cycles":1869568,"thread_start_us":172501,"threads_started":1,"wal-append.queue_time_us":237975}
I20260709 12:59:42.628819  1722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 518) took 1650 ms. Trace:
I20260709 12:59:42.629339  1722 rpcz_store.cc:276] 0709 12:59:40.978118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.627226 (+1649108us) service_pool.cc:224] Handling call
0709 12:59:42.627723 (+   497us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:42.628200 (+   477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:42.628240 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:42.628314 (+    74us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:42.628540 (+   226us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:42.628609 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:42.628746 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:42.630429  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 218097us
I20260709 12:59:42.631624  1615 leader_election.cc:304] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:42.469456  1717 raft_consensus.cc:1275] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:59:42.632936  1722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 519) took 1597 ms. Trace:
I20260709 12:59:42.633363  1615 leader_election.cc:304] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:42.634179  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1363) took 3010 ms. Trace:
I20260709 12:59:42.634737  1717 rpcz_store.cc:276] 0709 12:59:39.623506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.468828 (+2845322us) service_pool.cc:224] Handling call
0709 12:59:42.469138 (+   310us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:42.633554 (+164416us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:42.634002 (+   448us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:42.445426  1646 raft_consensus.cc:1240] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:42.635398  1615 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:42.615505  1716 raft_consensus.cc:1240] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:42.638433  1572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 509) took 1270 ms. Trace:
I20260709 12:59:42.639326  1717 raft_consensus.cc:1240] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 12:59:42.639395  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 1872) took 1412 ms. Trace:
I20260709 12:59:42.470898  1723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 514) took 1510 ms. Trace:
I20260709 12:59:42.625614  1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 517) took 1658 ms. Trace:
I20260709 12:59:42.640394  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 520) took 1558 ms. Trace:
I20260709 12:59:42.647154  1717 rpcz_store.cc:276] 0709 12:59:41.082204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.638168 (+1555964us) service_pool.cc:224] Handling call
0709 12:59:42.638736 (+   568us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:42.640085 (+  1349us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:42.640309 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:42.646921  1723 rpcz_store.cc:276] 0709 12:59:40.960715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.470120 (+1509405us) service_pool.cc:224] Handling call
0709 12:59:42.470379 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:42.470559 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:42.470590 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:42.470634 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:42.470678 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:42.470741 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:42.470845 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:42.649115  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:42.650736  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:42.651582  1723 raft_consensus.cc:1275] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:59:42.653059  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:42.653162  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:42.652323  1723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 523) took 1397 ms. Trace:
I20260709 12:59:42.480252  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:42.502604  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:42.697834  4397 raft_consensus.cc:493] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:42.698029  4443 raft_consensus.cc:515] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:42.698658  1725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1960) took 3928 ms. Trace:
I20260709 12:59:42.698796  4397 raft_consensus.cc:515] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:42.699107  1725 rpcz_store.cc:276] 0709 12:59:38.726361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:39.496152 (+769791us) service_pool.cc:224] Handling call
0709 12:59:39.496560 (+   408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:39.531560 (+ 35000us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:39.531592 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:39.533644 (+  2052us) log.cc:844] Serialized 26 byte log entry
0709 12:59:41.406734 (+1873090us) spinlock_profiling.cc:243] Waited 2.71 ms on lock 0x7b18003eb180. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef2b0e07 00007fa9f810bab9 00007fa9ef2cd69b 00007fa9ef2cb93f 00007fa9ef2cdc02 00007fa9f1f5520b 00007fa9f1f5ad23 00007fa9f1f5b0d1 00007fa9f2376a0f
0709 12:59:41.471973 (+ 65239us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:41.472096 (+   123us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:41.472241 (+   145us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:42.482994 (+1010753us) raft_consensus.cc:1685] finished
0709 12:59:42.483014 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:42.654281 (+171267us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4461,"raft.queue_time_us":103,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":33124,"spinlock_wait_cycles":6237952,"thread_start_us":56845,"threads_started":1,"wal-append.queue_time_us":2104249}
I20260709 12:59:42.701129  4414 raft_consensus.cc:2804] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:42.701323  1724 raft_consensus.cc:2468] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 6.
I20260709 12:59:42.701480  4037 raft_consensus.cc:493] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:42.701833  4414 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:42.702316  4037 raft_consensus.cc:515] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:42.693614  2294 leader_election.cc:304] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:42.703066  4462 raft_consensus.cc:2804] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:42.703675  4462 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:42.703794  1724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 526) took 1351 ms. Trace:
I20260709 12:59:42.704123  4462 raft_consensus.cc:3060] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:42.704730  1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1964) took 3960 ms. Trace:
I20260709 12:59:42.496884  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:42.705330  1721 rpcz_store.cc:276] 0709 12:59:38.744070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.520539 (+2776469us) service_pool.cc:224] Handling call
0709 12:59:41.521632 (+  1093us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:42.620148 (+1098516us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:42.685555 (+ 65407us) spinlock_profiling.cc:243] Waited 954 ms on lock 0x7b54000cdad4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:42.704517 (+ 18962us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2194945664}
I20260709 12:59:42.706944  4484 raft_consensus.cc:493] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:42.487255  2327 raft_consensus.cc:2410] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:59:42.490491  2328 raft_consensus.cc:2468] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 4.
I20260709 12:59:42.489977  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 12:59:42.746680  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 278592us
I20260709 12:59:42.747268  2330 raft_consensus.cc:2468] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 3.
I20260709 12:59:42.495646  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:42.747774  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:42.749480  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:42.749971  2329 raft_consensus.cc:2393] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 7: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 12:59:42.654836  1718 rpcz_store.cc:276] 0709 12:59:40.967530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.623895 (+1656365us) service_pool.cc:224] Handling call
0709 12:59:42.624342 (+   447us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:42.625371 (+  1029us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:42.625552 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:42.614049  1571 rpcz_store.cc:276] 0709 12:59:41.367870 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.609795 (+1241925us) service_pool.cc:224] Handling call
0709 12:59:42.610252 (+   457us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:42.610764 (+   512us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:42.610791 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:42.610856 (+    65us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:59:42.610911 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:42.611111 (+   200us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:42.611190 (+    79us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:42.656992  4320 raft_consensus.cc:2749] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:42.657677  1567 raft_consensus.cc:1275] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:59:42.707996  4484 raft_consensus.cc:515] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:42.529385  4370 raft_consensus.cc:493] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:42.660719  4350 consensus_queue.cc:237] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:42.661886  4314 leader_election.cc:290] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:42.662565  4410 leader_election.cc:290] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:42.663064  4366 raft_consensus.cc:2804] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:42.665215  4375 raft_consensus.cc:2804] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:42.608458  1570 rpcz_store.cc:276] 0709 12:59:41.367476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.606546 (+1239070us) service_pool.cc:224] Handling call
0709 12:59:42.607075 (+   529us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:42.607561 (+   486us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:42.607594 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:42.607664 (+    70us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:42.607719 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:42.607844 (+   125us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:42.607941 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:42.673687  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 73100.9us
I20260709 12:59:42.653990  1723 rpcz_store.cc:276] 0709 12:59:41.255015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.650357 (+1395342us) service_pool.cc:224] Handling call
0709 12:59:42.650933 (+   576us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:42.652074 (+  1141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:42.652267 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:42.608038  1575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 505) took 1240 ms. Trace:
I20260709 12:59:42.633599  1722 rpcz_store.cc:276] 0709 12:59:41.035580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.631225 (+1595645us) service_pool.cc:224] Handling call
0709 12:59:42.631792 (+   567us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:42.632281 (+   489us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:42.632323 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:42.632410 (+    87us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:59:42.632493 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:42.632599 (+   106us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:42.632866 (+   267us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:42.767087  1575 rpcz_store.cc:276] 0709 12:59:41.367217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.606318 (+1239101us) service_pool.cc:224] Handling call
0709 12:59:42.606814 (+   496us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:42.607833 (+  1019us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:42.607993 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:42.635308  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 54066.5us
I20260709 12:59:42.640223  1569 rpcz_store.cc:276] 0709 12:59:41.191908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.602038 (+1410130us) service_pool.cc:224] Handling call
0709 12:59:42.602787 (+   749us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:42.604194 (+  1407us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:42.604423 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:42.653985  1646 raft_consensus.cc:2376] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6. Re-sending same reply.
I20260709 12:59:42.639112  1572 rpcz_store.cc:276] 0709 12:59:41.368017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.636260 (+1268243us) service_pool.cc:224] Handling call
0709 12:59:42.637499 (+  1239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:42.637989 (+   490us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:42.638025 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:42.638103 (+    78us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:42.638157 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:42.638236 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:42.638370 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:42.520607  4056 raft_consensus.cc:697] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
W20260709 12:59:42.675262  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 67691.7us
I20260709 12:59:42.521967  4131 raft_consensus.cc:493] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:42.544760  4476 raft_consensus.cc:3060] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:42.692178  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:42.498572  4098 raft_consensus.cc:515] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:42.695778  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:42.697077  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:42.708050  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:42.704380  1724 rpcz_store.cc:276] 0709 12:59:41.352021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.702433 (+1350412us) service_pool.cc:224] Handling call
0709 12:59:42.703002 (+   569us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:42.703429 (+   427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:42.703457 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:42.703527 (+    70us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:42.703566 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:42.703624 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:42.703730 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:42.729605  1717 raft_consensus.cc:1240] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 4. Current term is 5. Ops: []
W20260709 12:59:42.692056  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 307060us
I20260709 12:59:42.702461  1725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 524) took 1427 ms. Trace:
I20260709 12:59:42.737517  4413 raft_consensus.cc:493] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:42.737787  4153 raft_consensus.cc:493] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:42.744802  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:42.745743  1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1366) took 3080 ms. Trace:
W20260709 12:59:42.658557  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 164288us
W20260709 12:59:42.754159  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 50219.9us
I20260709 12:59:42.745888  4351 raft_consensus.cc:493] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:42.753556  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:42.698068  4245 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:42.758450  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 1877) took 1382 ms. Trace:
I20260709 12:59:42.702376  4414 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:42.525254  4418 raft_consensus.cc:515] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:42.795413  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:42.848680  1567 rpcz_store.cc:276] 0709 12:59:41.372429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.656755 (+1284326us) service_pool.cc:224] Handling call
0709 12:59:42.657216 (+   461us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:42.753216 (+ 96000us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:42.755002 (+  1786us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:42.849617  1725 rpcz_store.cc:276] 0709 12:59:41.275255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.701316 (+1426061us) service_pool.cc:224] Handling call
0709 12:59:42.701749 (+   433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:42.702104 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:42.702133 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:42.702206 (+    73us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:42.702241 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:42.702305 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:42.702409 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:42.809810  1571 raft_consensus.cc:1275] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:59:42.799062  1644 raft_consensus.cc:2393] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 4: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:42.807397  1575 raft_consensus.cc:1275] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:59:42.802381  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 515) took 1421 ms. Trace:
I20260709 12:59:42.799261  1570 raft_consensus.cc:1275] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:59:42.859750  1569 rpcz_store.cc:276] 0709 12:59:41.380930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.771957 (+1391027us) service_pool.cc:224] Handling call
0709 12:59:42.801653 (+ 29696us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:42.801950 (+   297us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:42.801984 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:42.802048 (+    64us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:42.802094 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:42.802165 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:42.802294 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:42.853796  1571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 513) took 1480 ms. Trace:
I20260709 12:59:42.864615  1571 rpcz_store.cc:276] 0709 12:59:41.373159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.764462 (+1391303us) service_pool.cc:224] Handling call
0709 12:59:42.809212 (+ 44750us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:42.853555 (+ 44343us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:42.853744 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:42.807210  4320 raft_consensus.cc:993] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66: : Instructing follower 4dbe7d47a2374afca075d3a98583b49e to start an election
I20260709 12:59:42.860714  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 514) took 1484 ms. Trace:
I20260709 12:59:42.805707  4510 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:42.881973  4510 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:59:42.882925  4418 leader_election.cc:290] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:42.800935  4397 leader_election.cc:290] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:42.850457  4245 raft_consensus.cc:3060] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:42.869877  4122 raft_consensus.cc:2804] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:42.870404  4056 consensus_queue.cc:237] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:42.871358  4441 leader_election.cc:290] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:42.872334  4410 raft_consensus.cc:493] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:42.873124  4153 raft_consensus.cc:515] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:42.810173  4370 raft_consensus.cc:3060] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:42.876339  4145 leader_election.cc:290] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:42.865691  4327 raft_consensus.cc:2804] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:42.765722  4366 raft_consensus.cc:493] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
W20260709 12:59:42.884610  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 88129.8us
I20260709 12:59:42.765918  4375 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:42.799474  4131 raft_consensus.cc:3060] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:42.883893  4351 raft_consensus.cc:515] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:42.884497  4510 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:42.784714  4443 leader_election.cc:290] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:42.802105  4037 leader_election.cc:290] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:42.834411  1720 rpcz_store.cc:276] 0709 12:59:39.665351 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.469260 (+2803909us) service_pool.cc:224] Handling call
0709 12:59:42.469510 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:42.744999 (+275489us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:42.745058 (+    59us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:42.745110 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:42.745174 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:42.745292 (+   118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:42.745515 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":33017,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":89,"thread_start_us":274874,"threads_started":1}
I20260709 12:59:42.910683  1649 raft_consensus.cc:2376] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6. Re-sending same reply.
I20260709 12:59:42.919579  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:42.867424  1570 rpcz_store.cc:276] 0709 12:59:41.376263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.770073 (+1393810us) service_pool.cc:224] Handling call
0709 12:59:42.798710 (+ 28637us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:42.860465 (+ 61755us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:42.860663 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:42.912648  4397 raft_consensus.cc:2804] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:42.810290  4286 raft_consensus.cc:515] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:42.930254  1574 raft_consensus.cc:2468] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6.
I20260709 12:59:42.869351  1575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 1878) took 1492 ms. Trace:
W20260709 12:59:42.941366  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 61194.7us
I20260709 12:59:42.931721  1643 raft_consensus.cc:2376] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 4. Re-sending same reply.
I20260709 12:59:42.949697  1575 rpcz_store.cc:276] 0709 12:59:41.377206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.770202 (+1392996us) service_pool.cc:224] Handling call
0709 12:59:42.806925 (+ 36723us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:42.859686 (+ 52761us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:42.869274 (+  9588us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:42.932394  1647 raft_consensus.cc:2468] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 5.
I20260709 12:59:42.935469  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:42.936190  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:42.927336  4375 raft_consensus.cc:3060] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:42.925622  4366 raft_consensus.cc:3060] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:42.961457  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:42.962600  4436 raft_consensus.cc:493] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:42.963430  4436 raft_consensus.cc:515] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:42.964874  4098 leader_election.cc:290] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:42.964675  4410 raft_consensus.cc:515] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:42.967245  4410 leader_election.cc:290] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:42.951933  4397 raft_consensus.cc:493] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:42.968878  4397 raft_consensus.cc:3060] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:42.970392  4484 leader_election.cc:290] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:42.962664  1646 raft_consensus.cc:2468] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8.
I20260709 12:59:42.968365  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 521) took 1330 ms. Trace:
I20260709 12:59:42.972589  1569 rpcz_store.cc:276] 0709 12:59:41.638303 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.860914 (+1222611us) service_pool.cc:224] Handling call
0709 12:59:42.933102 (+ 72188us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:42.967988 (+ 34886us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:42.968020 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:42.968070 (+    50us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:42.968110 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:42.968183 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:42.968300 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:42.972647  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 61062.3us
I20260709 12:59:42.982514  1539 leader_election.cc:304] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:42.984272  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:42.988306  1575 raft_consensus.cc:2468] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 7.
W20260709 12:59:43.001561  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 67384.3us
I20260709 12:59:43.007404  1615 leader_election.cc:304] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:43.010694  2297 leader_election.cc:304] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e
W20260709 12:59:43.008780  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 54523.3us
I20260709 12:59:42.932888  4413 raft_consensus.cc:515] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:43.009629  4145 raft_consensus.cc:1081] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 LEADER]: Signalling peer 4dbe7d47a2374afca075d3a98583b49e to start an election
I20260709 12:59:43.018512  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 12:59:43.035185  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:43.036131  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:43.039018  4513 raft_consensus.cc:3060] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:43.040328  1573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 1870) took 1848 ms. Trace:
I20260709 12:59:43.040772  1573 rpcz_store.cc:276] 0709 12:59:41.191435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.267623 (+ 76188us) service_pool.cc:224] Handling call
0709 12:59:41.267898 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:41.496758 (+228860us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:59:42.404460 (+907702us) log.cc:844] Serialized 14 byte log entry
0709 12:59:42.629426 (+224966us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:42.629538 (+   112us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:42.629658 (+   120us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:43.039900 (+410242us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b540017eb54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:43.039948 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:43.040140 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":888384,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":376542,"spinlock_wait_cycles":525784448,"thread_start_us":1125490,"threads_started":3}
I20260709 12:59:43.043445  4483 raft_consensus.cc:493] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.044927  4515 raft_consensus.cc:2749] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:43.045677  4286 leader_election.cc:290] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:43.047333  1716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1962) took 4303 ms. Trace:
I20260709 12:59:43.050881  1540 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:43.054908  4397 raft_consensus.cc:515] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:43.007984  4037 raft_consensus.cc:493] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:43.058494  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 130925us
I20260709 12:59:43.028296  1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 532) took 1322 ms. Trace:
I20260709 12:59:43.047780  1716 rpcz_store.cc:276] 0709 12:59:38.743557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.518687 (+2775130us) service_pool.cc:224] Handling call
0709 12:59:41.518949 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:42.637426 (+1118477us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:43.046979 (+409553us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b540040c9d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:43.047272 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2520260992}
W20260709 12:59:43.064409  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 79603.7us
W20260709 12:59:43.054958  2327 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53306 (request call id 571) took 4312 ms (client timeout 1758 ms). Trace:
I20260709 12:59:43.070390  1570 raft_consensus.cc:1240] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:43.044088  4483 raft_consensus.cc:515] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:43.087550  1569 raft_consensus.cc:2393] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 9: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
W20260709 12:59:43.071637  2327 rpcz_store.cc:269] 0709 12:59:38.742805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:38.742914 (+   109us) service_pool.cc:224] Handling call
0709 12:59:43.054590 (+4311676us) spinlock_profiling.cc:243] Waited 3.71 s on lock 0x7b5400632254. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:43.054754 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8539746048}
I20260709 12:59:43.083340  1571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36642 (request call id 2218) took 1379 ms. Trace:
I20260709 12:59:43.063246  1718 rpcz_store.cc:276] 0709 12:59:41.705556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.750737 (+1045181us) service_pool.cc:224] Handling call
0709 12:59:42.866270 (+115533us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:42.968621 (+102351us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:59:42.968983 (+   362us) log.cc:844] Serialized 14 byte log entry
0709 12:59:43.027826 (+ 58843us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:43.027980 (+   154us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:43.028044 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:43.028113 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:43.028238 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5832,"prepare.queue_time_us":38225,"prepare.run_wall_time_us":39,"raft.queue_time_us":50794,"thread_start_us":37099,"threads_started":1}
I20260709 12:59:43.092088  1571 rpcz_store.cc:276] 0709 12:59:41.697076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.889171 (+1192095us) service_pool.cc:224] Handling call
0709 12:59:42.936755 (+ 47584us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:43.069321 (+132566us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:43.069353 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:43.075996 (+  6643us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:43.076037 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:43.076103 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:43.076222 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46740,"raft.queue_time_us":49592,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":13268}
I20260709 12:59:43.075320  4510 raft_consensus.cc:493] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.098740  2294 leader_election.cc:304] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:43.101322  1571 raft_consensus.cc:1275] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:59:43.102639  4037 raft_consensus.cc:515] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:43.092790  4427 raft_consensus.cc:2804] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:43.107483  4427 raft_consensus.cc:493] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:43.107949  4427 raft_consensus.cc:3060] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:43.108793  4098 raft_consensus.cc:2804] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:43.109261  4098 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:43.109638  4098 raft_consensus.cc:3060] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:43.107858  4351 leader_election.cc:290] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:43.117525  4441 raft_consensus.cc:493] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.108037  1539 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:43.123901  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:43.120071  4441 raft_consensus.cc:515] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:43.127491  4441 leader_election.cc:290] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:43.127784  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:43.128922  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:43.132364  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:43.132861  4517 raft_consensus.cc:493] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.133322  1651 raft_consensus.cc:2468] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 6.
I20260709 12:59:43.133697  4517 raft_consensus.cc:515] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:43.137431  1647 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57912 (request call id 441) took 1935 ms (client timeout 1583 ms). Trace:
W20260709 12:59:43.138118  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 141290us
I20260709 12:59:43.141429  4474 consensus_queue.cc:1048] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:59:43.137919  1647 rpcz_store.cc:269] 0709 12:59:41.201565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.206033 (+  4468us) service_pool.cc:224] Handling call
0709 12:59:43.137166 (+1931133us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b540030dc54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:43.137337 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2961895680}
W20260709 12:59:43.148340  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 77268.8us
W20260709 12:59:43.183861  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 215731us
W20260709 12:59:43.185158  1542 leader_election.cc:336] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.508s (SENT)
W20260709 12:59:43.185796  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:43.186230  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:43.186723  1615 leader_election.cc:304] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:43.187805  1615 leader_election.cc:304] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:43.188095  4362 raft_consensus.cc:2804] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:43.188334  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 12:59:43.189020  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 81090.6us
I20260709 12:59:43.189203  1574 raft_consensus.cc:3060] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:43.189985  1539 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:43.191807  1539 leader_election.cc:304] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:43.193629  4413 leader_election.cc:290] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:43.194280  4413 raft_consensus.cc:2804] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:43.194775  4413 raft_consensus.cc:493] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:43.195235  4413 raft_consensus.cc:3060] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:43.136427  4517 leader_election.cc:290] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:43.146353  4462 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:59:43.203604  4462 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:43.187809  4403 raft_consensus.cc:2804] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:43.207640  4403 raft_consensus.cc:493] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:43.208070  4403 raft_consensus.cc:3060] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:43.210647  1719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1345) took 3671 ms. Trace:
I20260709 12:59:43.180351  4510 raft_consensus.cc:515] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:43.211185  1719 rpcz_store.cc:276] 0709 12:59:39.538985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.307390 (+2768405us) service_pool.cc:224] Handling call
0709 12:59:42.307780 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:42.617885 (+310105us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:43.210304 (+592419us) spinlock_profiling.cc:243] Waited 309 ms on lock 0x7b5400112e54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:43.210563 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":710455040}
I20260709 12:59:43.213492  4510 leader_election.cc:290] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:43.214154  4510 raft_consensus.cc:2804] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:43.214519  4510 raft_consensus.cc:493] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:43.214880  4510 raft_consensus.cc:3060] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:43.216861  4476 consensus_queue.cc:1059] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:59:43.189208  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:43.188560  4362 raft_consensus.cc:493] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:43.220834  4362 raft_consensus.cc:3060] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:43.221019  4527 log.cc:927] Time spent T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 12:59:43.221884  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:43.221983  4366 raft_consensus.cc:515] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:43.222728  1650 raft_consensus.cc:2468] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 2.
I20260709 12:59:43.185623  1542 leader_election.cc:304] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
W20260709 12:59:43.243993  4417 consensus_meta.cc:287] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.740s	user 0.012s	sys 0.009s
I20260709 12:59:43.244547  4417 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:43.246933  4417 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:43.247640  4417 raft_consensus.cc:3055] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:43.248056  4417 raft_consensus.cc:740] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:43.234694  4397 leader_election.cc:290] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:43.250679  4037 leader_election.cc:290] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:43.254987  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:43.255914  1650 raft_consensus.cc:2468] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 6.
I20260709 12:59:43.225308  4472 leader_election.cc:290] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:43.256440  4525 raft_consensus.cc:2804] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:43.257318  4525 raft_consensus.cc:697] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:43.257822  4375 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:43.258801  4525 consensus_queue.cc:237] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:59:43.182346  4515 raft_consensus.cc:2749] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:43.204339  4245 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:59:43.224471  4366 leader_election.cc:290] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:43.261847  1642 raft_consensus.cc:1240] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:59:43.261886  4351 raft_consensus.cc:493] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.262420  4514 raft_consensus.cc:2749] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:59:43.262919  1617 leader_election.cc:336] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.747s (SENT)
I20260709 12:59:43.263090  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:43.238267  2295 leader_election.cc:304] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 12:59:43.264853  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 73130.7us
I20260709 12:59:43.216248  4414 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:43.264881  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:43.265425  4375 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:43.265901  4433 consensus_meta.cc:287] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.780s	user 0.013s	sys 0.001s
I20260709 12:59:43.266539  2294 leader_election.cc:304] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:43.266567  1574 raft_consensus.cc:2468] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 6.
I20260709 12:59:43.279562  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:43.262197  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 12:59:43.260879  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 71810.1us
I20260709 12:59:43.272107  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 522) took 2029 ms. Trace:
I20260709 12:59:43.271814  1572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 517) took 1860 ms. Trace:
I20260709 12:59:43.284219  1717 rpcz_store.cc:276] 0709 12:59:41.242266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.648355 (+1406089us) service_pool.cc:224] Handling call
0709 12:59:42.697289 (+ 48934us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:42.837511 (+140222us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:43.270784 (+433273us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b54002346d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:43.272046 (+  1262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27767552}
W20260709 12:59:43.286644  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 234150us
I20260709 12:59:43.279718  1617 leader_election.cc:304] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:43.284281  1572 rpcz_store.cc:276] 0709 12:59:41.408450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.768587 (+1360137us) service_pool.cc:224] Handling call
0709 12:59:42.861150 (+ 92563us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:42.916604 (+ 55454us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:42.916632 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:42.946521 (+ 29889us) log.cc:844] Serialized 26 byte log entry
0709 12:59:43.086180 (+139659us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:43.086224 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:43.086311 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:43.268175 (+181864us) raft_consensus.cc:1685] finished
0709 12:59:43.268200 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:43.268353 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61793,"raft.queue_time_us":141228,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":26810,"thread_start_us":126906,"threads_started":2,"wal-append.queue_time_us":237108}
I20260709 12:59:43.294245  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:43.291857  1570 raft_consensus.cc:2468] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6.
I20260709 12:59:43.294971  1574 raft_consensus.cc:2468] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7.
W20260709 12:59:43.296782  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 111642us
W20260709 12:59:43.297585  1542 leader_election.cc:336] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.509s (SENT)
I20260709 12:59:43.299481  4366 raft_consensus.cc:2749] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:43.301185  2295 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:43.302349  4286 raft_consensus.cc:2804] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:43.302800  4286 raft_consensus.cc:493] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:43.303191  4286 raft_consensus.cc:3060] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:43.303982  1567 raft_consensus.cc:1240] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 12:59:43.299611  1617 leader_election.cc:336] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.769s (SENT)
I20260709 12:59:43.303697  1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 531) took 1645 ms. Trace:
I20260709 12:59:43.286043  4098 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:43.289845  4037 raft_consensus.cc:2749] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:43.292728  4056 raft_consensus.cc:2804] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:43.288154  4370 raft_consensus.cc:515] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:43.300280  4351 raft_consensus.cc:515] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:43.306984  1721 rpcz_store.cc:276] 0709 12:59:41.657974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.706978 (+1049004us) service_pool.cc:224] Handling call
0709 12:59:42.707544 (+   566us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:42.758576 (+ 51032us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:42.758612 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:42.808247 (+ 49635us) log.cc:844] Serialized 26 byte log entry
0709 12:59:42.910441 (+102194us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:42.910490 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:42.910569 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:43.303467 (+392898us) raft_consensus.cc:1685] finished
0709 12:59:43.303501 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:43.303638 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":62504,"raft.run_cpu_time_us":330,"raft.run_wall_time_us":87464,"thread_start_us":96230,"threads_started":1,"wal-append.queue_time_us":473360}
W20260709 12:59:43.333770  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 117145us
I20260709 12:59:43.319490  4056 raft_consensus.cc:493] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:43.329198  4366 consensus_queue.cc:1048] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 12:59:43.320027  4375 consensus_queue.cc:1048] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:59:43.339190  4486 raft_consensus.cc:493] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.339897  4486 raft_consensus.cc:515] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:43.342486  4486 leader_election.cc:290] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:43.318799  4410 consensus_queue.cc:1048] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:59:43.343443  1643 raft_consensus.cc:1240] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:59:43.345716  4532 consensus_queue.cc:1048] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:43.349265  1539 leader_election.cc:304] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:43.349656  4056 raft_consensus.cc:3060] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:43.351052  4037 raft_consensus.cc:2804] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:43.351658  4037 raft_consensus.cc:697] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:43.352747  4037 consensus_queue.cc:237] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:43.353650  2294 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:43.294644  4433 raft_consensus.cc:515] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:43.357139  4521 raft_consensus.cc:2804] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:43.357709  4521 raft_consensus.cc:697] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
W20260709 12:59:43.362970  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:43.335180  1689 connection.cc:256] RPC call timeout handler was delayed by -2.1538086600000383s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15680000000000002s for a response
W20260709 12:59:43.370236  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 230574us
I20260709 12:59:43.370676  1615 leader_election.cc:304] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 12:59:43.371635  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 44223.5us
I20260709 12:59:43.371932  4447 raft_consensus.cc:2804] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:43.372378  4447 raft_consensus.cc:493] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:43.372843  4447 raft_consensus.cc:3060] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:43.374047  1542 leader_election.cc:336] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.547s (SENT)
I20260709 12:59:43.374523  1542 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
W20260709 12:59:43.372788  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 73239.5us
I20260709 12:59:43.335250  4530 raft_consensus.cc:2749] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:59:43.382042  4145 consensus_queue.cc:1048] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:43.385541  4131 raft_consensus.cc:515] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:43.387953  4131 leader_election.cc:290] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:43.379138  1688 leader_election.cc:304] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:42.384503  1568 rpcz_store.cc:276] 0709 12:59:38.505523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:39.492134 (+986611us) service_pool.cc:224] Handling call
0709 12:59:39.492406 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:39.537770 (+ 45364us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:59:39.744126 (+206356us) log.cc:844] Serialized 14 byte log entry
0709 12:59:40.159535 (+415409us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:40.159592 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:40.159641 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:41.774876 (+1615235us) spinlock_profiling.cc:243] Waited 45.1 ms on lock 0x7b540040c4d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:41.774921 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:41.775063 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5117,"prepare.queue_time_us":82509,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":222100,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"spinlock_wait_cycles":103707392,"thread_start_us":615728,"threads_started":3,"wal-append.queue_time_us":490887,"wal-append.run_cpu_time_us":2601,"wal-append.run_wall_time_us":2060754}
I20260709 12:59:43.393805  1539 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:43.310073  4417 consensus_queue.cc:260] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:43.396595  1615 leader_election.cc:304] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:43.402228  1688 leader_election.cc:304] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:43.403290  1688 leader_election.cc:304] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:43.404738  4486 raft_consensus.cc:2804] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:59:43.404945  4131 raft_consensus.cc:2804] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:43.405184  4486 raft_consensus.cc:493] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:43.405511  4131 raft_consensus.cc:493] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:43.367945  4370 leader_election.cc:290] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:43.405803  4486 raft_consensus.cc:3060] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:43.407485  1617 leader_election.cc:336] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.781s (SENT)
I20260709 12:59:43.405982  4131 raft_consensus.cc:3060] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:43.408069  1617 leader_election.cc:304] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:43.408702  4443 raft_consensus.cc:2804] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:43.409145  4443 raft_consensus.cc:493] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:43.409472  4443 raft_consensus.cc:3060] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:43.410183  1617 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.854s (SENT) [suppressed 41 similar messages]
I20260709 12:59:43.374097  4414 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:43.411180  1689 connection.cc:256] RPC call timeout handler was delayed by -1.9828086600000461s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1758s for a response
W20260709 12:59:43.411602  1689 connection.cc:256] RPC call timeout handler was delayed by -1.9522086600000534s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17920000000000003s for a response
W20260709 12:59:43.411908  1689 connection.cc:256] RPC call timeout handler was delayed by -1.7362086600000453s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20320000000000002s for a response
W20260709 12:59:43.412200  1689 connection.cc:256] RPC call timeout handler was delayed by -1.5859086600000296s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21989999999999998s for a response
W20260709 12:59:43.412588  1689 connection.cc:256] RPC call timeout handler was delayed by -1.2888167870000302s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 12:59:43.413687  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:43.414426  1721 raft_consensus.cc:2393] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 6: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:59:43.415434  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:43.415310  4362 raft_consensus.cc:515] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:43.416718  4106 raft_consensus.cc:493] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.417053  4521 consensus_queue.cc:237] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:43.419234  4543 raft_consensus.cc:2749] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:43.417274  4106 raft_consensus.cc:515] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:43.407232  4286 raft_consensus.cc:515] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:43.453346  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 61158.4us
I20260709 12:59:43.369186  4511 consensus_queue.cc:1048] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.072s
I20260709 12:59:43.375244  4433 leader_election.cc:290] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:43.436631  1615 leader_election.cc:304] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:43.377753  4513 raft_consensus.cc:2749] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:43.439391  4510 raft_consensus.cc:515] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:43.442625  1721 raft_consensus.cc:1275] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:59:43.442788  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:43.444317  1716 raft_consensus.cc:3055] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:43.445660  4514 raft_consensus.cc:2749] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:43.438388  4098 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:43.450660  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:43.458423  1716 raft_consensus.cc:740] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:43.458110  1721 pending_rounds.cc:85] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4: Aborting all ops after (but not including) 3
I20260709 12:59:43.463167  4480 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.463877  4480 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:43.462512  1721 pending_rounds.cc:107] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:59:43.464852  1721 raft_consensus.cc:2889] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:59:43.463081  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 89057.9us
W20260709 12:59:43.469225  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 97463.4us
I20260709 12:59:43.455574  4427 raft_consensus.cc:515] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:43.468124  4417 raft_consensus.cc:3060] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:43.471973  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:43.472678  1719 raft_consensus.cc:1275] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:43.472981  1720 raft_consensus.cc:2393] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 5: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:59:43.473251  1651 raft_consensus.cc:1240] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:43.465433  4370 raft_consensus.cc:2804] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:43.473975  4370 raft_consensus.cc:493] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:43.457455  4414 raft_consensus.cc:493] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.455776  4410 raft_consensus.cc:2804] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:43.474054  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 12:59:43.481088  4526 log.cc:927] Time spent T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 12:59:43.481431  4410 raft_consensus.cc:493] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:43.486883  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:43.489176  1575 raft_consensus.cc:2468] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 5.
I20260709 12:59:43.474301  4427 leader_election.cc:290] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:43.474426  4370 raft_consensus.cc:3060] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:43.492308  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 12:59:43.493489  1542 leader_election.cc:336] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.644s (SENT)
I20260709 12:59:43.494582  1542 leader_election.cc:304] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:43.485462  1716 consensus_queue.cc:260] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:43.494729  1539 leader_election.cc:304] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:43.496778  4351 leader_election.cc:290] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:43.496915  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:43.497071  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:43.497368  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:43.498052  1721 raft_consensus.cc:2393] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 7: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:59:43.498149  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 12:59:43.498413  1617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:43.498706  1575 raft_consensus.cc:3060] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:43.498893  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:43.499605  2329 raft_consensus.cc:2368] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 6. Current term is 7.
I20260709 12:59:43.500782  1572 raft_consensus.cc:3060] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:43.491669  4414 raft_consensus.cc:515] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:43.489055  4410 raft_consensus.cc:3060] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:43.506635  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:43.509389  1542 leader_election.cc:336] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.661s (SENT)
I20260709 12:59:43.488888  4433 raft_consensus.cc:493] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.514253  4514 raft_consensus.cc:2749] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:43.518383  1572 raft_consensus.cc:2468] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 8.
I20260709 12:59:43.519754  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:43.520190  4530 consensus_queue.cc:1048] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:43.522594  4419 raft_consensus.cc:493] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.523512  4403 raft_consensus.cc:515] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:43.525192  1574 raft_consensus.cc:1240] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:59:43.533699  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:43.553335  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
W20260709 12:59:43.548745  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 43674.9us
I20260709 12:59:43.551396  2329 raft_consensus.cc:2468] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6.
I20260709 12:59:43.560324  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:43.562649  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:43.556492  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:43.567263  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:43.564845  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:43.554287  4037 raft_consensus.cc:2749] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:59:43.574575  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:43.583344  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 96716.6us
W20260709 12:59:43.604058  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:43.568730  4433 raft_consensus.cc:515] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:43.582270  4419 raft_consensus.cc:515] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:43.943408  1575 raft_consensus.cc:2468] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 8.
W20260709 12:59:43.621030  1539 leader_election.cc:336] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Timed out: RequestConsensusVote RPC to 127.0.107.194:37391 timed out after 1.683s (SENT)
I20260709 12:59:44.045821  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:43.817492  1646 raft_consensus.cc:2468] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
W20260709 12:59:44.083809  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 462796us
I20260709 12:59:43.981642  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 453) took 1511 ms. Trace:
I20260709 12:59:44.078044  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:59:43.823457  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:44.086215  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 12:59:43.632035  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 53436.9us
I20260709 12:59:44.027595  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:44.045432  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:43.673106  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
W20260709 12:59:43.745404  1691 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:43.678226  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:44.081638  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:44.053085  1716 raft_consensus.cc:3060] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:44.027273  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:43.678035  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
W20260709 12:59:43.957731  1576 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36640 (request call id 1875) took 2602 ms (client timeout 1941 ms). Trace:
I20260709 12:59:44.005909  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 12:59:44.096798  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:44.085183  1648 raft_consensus.cc:2468] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6.
I20260709 12:59:43.687865  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:59:43.985126  1649 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 1440) took 1333 ms (client timeout 1683 ms). Trace:
W20260709 12:59:43.630342  1617 leader_election.cc:336] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.992s (SENT)
W20260709 12:59:44.132947  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 623542us
I20260709 12:59:43.672298  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:44.084897  1642 rpcz_store.cc:276] 0709 12:59:42.470387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.470576 (+   189us) service_pool.cc:224] Handling call
0709 12:59:42.470876 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:43.281805 (+810929us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:43.981284 (+699479us) spinlock_profiling.cc:243] Waited 778 ms on lock 0x7b54001752d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:43.981543 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1788408192}
I20260709 12:59:44.132369  1719 raft_consensus.cc:2376] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 4. Re-sending same reply.
W20260709 12:59:43.904410  4447 consensus_meta.cc:287] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.531s	user 0.009s	sys 0.000s
W20260709 12:59:44.025568  4538 log.cc:927] Time spent T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.781s	user 0.003s	sys 0.000s
W20260709 12:59:44.133932  1649 rpcz_store.cc:269] 0709 12:59:42.651883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.652418 (+   535us) service_pool.cc:224] Handling call
0709 12:59:43.984905 (+1332487us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b54001f8954. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:43.985051 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":479434496}
W20260709 12:59:44.132082  1576 rpcz_store.cc:269] 0709 12:59:41.354945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:41.704789 (+349844us) service_pool.cc:224] Handling call
0709 12:59:43.957404 (+2252615us) spinlock_profiling.cc:243] Waited 174 ms on lock 0x7b54002710d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:43.957625 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":399886592}
I20260709 12:59:43.632519  1644 raft_consensus.cc:2468] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
I20260709 12:59:43.597505  4480 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:43.596783  4484 raft_consensus.cc:2749] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 LEADER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:44.047657  4153 leader_election.cc:290] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:59:44.145838  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 480048us
I20260709 12:59:43.612672  4441 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:43.854449  4418 raft_consensus.cc:3055] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:44.143815  1570 raft_consensus.cc:3060] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:43.905249  4510 leader_election.cc:290] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:43.979969  2332 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53290 (request call id 861) took 1686 ms (client timeout 1941 ms). Trace:
W20260709 12:59:44.062103  4443 consensus_meta.cc:287] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.652s	user 0.006s	sys 0.005s
I20260709 12:59:43.830106  4427 raft_consensus.cc:493] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.060748  4436 leader_election.cc:290] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:43.958873  4122 raft_consensus.cc:493] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:44.029542  4327 raft_consensus.cc:493] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
W20260709 12:59:44.152922  1542 leader_election.cc:336] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.683s (SENT)
I20260709 12:59:44.222244  1542 leader_election.cc:304] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:44.164203  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:44.165411  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:44.166218  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:44.223169  1648 raft_consensus.cc:3060] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:44.148422  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:44.223887  1646 raft_consensus.cc:3060] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:43.674033  4362 leader_election.cc:290] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:43.921291  4414 leader_election.cc:290] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:43.675362  4403 leader_election.cc:290] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:44.021802  2323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53306 (request call id 583) took 1522 ms. Trace:
W20260709 12:59:44.159605  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 97374.5us
I20260709 12:59:43.753513  4545 consensus_queue.cc:1048] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.611s
I20260709 12:59:44.186401  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:44.230414  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:43.758872  4320 consensus_queue.cc:1048] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.404s
I20260709 12:59:44.189329  2295 leader_election.cc:304] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:44.233206  1647 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:44.135197  4106 leader_election.cc:290] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:44.230698  1720 raft_consensus.cc:2376] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 4. Re-sending same reply.
I20260709 12:59:43.843055  4056 raft_consensus.cc:515] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:43.612462  4521 consensus_queue.cc:1048] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.559s
I20260709 12:59:43.673894  4413 raft_consensus.cc:515] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:43.977455  4518 raft_consensus.cc:493] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
W20260709 12:59:44.181236  2332 rpcz_store.cc:269] 0709 12:59:42.292932 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.293106 (+   174us) service_pool.cc:224] Handling call
0709 12:59:43.979487 (+1686381us) spinlock_profiling.cc:243] Waited 542 ms on lock 0x7b540069c154. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:43.979728 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1245807488}
I20260709 12:59:44.213348  1642 raft_consensus.cc:1240] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:59:44.206439  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:43.680845  4131 raft_consensus.cc:515] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:44.219946  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 589597us
W20260709 12:59:44.175414  4486 consensus_meta.cc:287] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.769s	user 0.010s	sys 0.003s
I20260709 12:59:44.245584  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:43.961443  4483 leader_election.cc:290] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:44.147811  4447 raft_consensus.cc:515] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:44.225335  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:44.173019  4418 raft_consensus.cc:740] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
W20260709 12:59:44.224509  4417 consensus_meta.cc:287] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.752s	user 0.011s	sys 0.000s
I20260709 12:59:44.223099  4122 raft_consensus.cc:3060] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:44.238339  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 49124.7us
I20260709 12:59:44.224726  4327 raft_consensus.cc:3060] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:44.246577  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 93712.2us
I20260709 12:59:44.248055  1644 raft_consensus.cc:2393] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 8: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:44.220906  4427 raft_consensus.cc:515] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:44.249899  1615 leader_election.cc:400] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: Vote denied by peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423) with higher term. Message: Invalid argument: T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 6. Current term is 7.
I20260709 12:59:44.268155  1615 leader_election.cc:403] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:44.255810  1717 raft_consensus.cc:2393] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 7: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:59:44.256958  1651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45148 (request call id 2053) took 1117 ms. Trace:
W20260709 12:59:44.269122  1542 leader_election.cc:336] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.698s (SENT)
I20260709 12:59:44.217634  4441 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:44.268851  1651 rpcz_store.cc:276] 0709 12:59:43.139338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.139536 (+   198us) service_pool.cc:224] Handling call
0709 12:59:43.139886 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:43.473641 (+333755us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:44.256739 (+783098us) spinlock_profiling.cc:243] Waited 333 ms on lock 0x7b54002b1e54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:44.256902 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":766218496}
I20260709 12:59:44.221833  4443 raft_consensus.cc:515] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:44.243542  4362 raft_consensus.cc:2804] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:44.244243  4514 raft_consensus.cc:2749] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:44.261883  1643 raft_consensus.cc:2368] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 4. Current term is 5.
I20260709 12:59:44.265808  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:44.251729  1721 raft_consensus.cc:2376] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7. Re-sending same reply.
I20260709 12:59:44.280433  1650 raft_consensus.cc:2393] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 7: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
W20260709 12:59:44.268712  4370 consensus_meta.cc:287] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.751s	user 0.010s	sys 0.000s
I20260709 12:59:44.289970  4131 leader_election.cc:290] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:44.310402  1651 raft_consensus.cc:1240] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:44.293128  4286 leader_election.cc:290] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:44.294907  4413 leader_election.cc:290] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:44.249197  4518 raft_consensus.cc:515] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:44.299290  1617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:44.283542  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 48790.7us
I20260709 12:59:44.324050  1615 leader_election.cc:304] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:44.315640  1647 raft_consensus.cc:2410] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 12:59:44.281507  4553 log.cc:927] Time spent T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:59:44.316577  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:44.231119  2323 rpcz_store.cc:276] 0709 12:59:42.499258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.502364 (+  3106us) service_pool.cc:224] Handling call
0709 12:59:44.021325 (+1518961us) spinlock_profiling.cc:243] Waited 582 ms on lock 0x7b54007b3c54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:44.021586 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1338353920}
I20260709 12:59:44.322806  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:44.331354  1645 raft_consensus.cc:3060] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:59:44.255007  4486 raft_consensus.cc:515] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:44.326037  1723 raft_consensus.cc:2368] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 6. Current term is 7.
W20260709 12:59:44.326624  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 58910.6us
I20260709 12:59:44.334195  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
W20260709 12:59:44.334197  1542 leader_election.cc:336] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.725s (SENT)
I20260709 12:59:44.317057  4436 raft_consensus.cc:3060] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:59:44.339167  1539 leader_election.cc:304] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:44.339422  1542 leader_election.cc:304] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:44.340250  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:44.341593  1720 raft_consensus.cc:2410] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 5 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:59:44.333833  4418 consensus_queue.cc:260] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:44.345490  4552 log.cc:927] Time spent T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:59:44.345561  4418 raft_consensus.cc:3060] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:44.345979  4486 leader_election.cc:290] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:44.350886  4419 leader_election.cc:290] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:44.351855  4441 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:44.302054  1642 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f"
dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
 from {username='slave'} at 127.0.0.1:57912
W20260709 12:59:44.354802  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 210900us
I20260709 12:59:44.359704  1718 raft_consensus.cc:1275] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 12:59:44.360158  1718 pending_rounds.cc:85] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4: Aborting all ops after (but not including) 3
I20260709 12:59:44.331035  4362 raft_consensus.cc:697] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:44.361127  1647 raft_consensus.cc:1240] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:44.362003  1722 raft_consensus.cc:2468] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7.
I20260709 12:59:44.335325  4510 raft_consensus.cc:493] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:44.338855  4417 raft_consensus.cc:2804] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:44.367401  1716 raft_consensus.cc:1275] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 12:59:44.368801  1721 raft_consensus.cc:2393] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 6: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:59:44.316216  4370 raft_consensus.cc:515] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:44.370318  1716 pending_rounds.cc:85] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4: Aborting all ops after (but not including) 3
W20260709 12:59:44.374238  4410 consensus_meta.cc:287] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.832s	user 0.010s	sys 0.000s
I20260709 12:59:44.377121  1615 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:44.377637  1718 pending_rounds.cc:107] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 12:59:44.381727  1718 raft_consensus.cc:2889] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:44.378409  1716 pending_rounds.cc:107] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:59:44.382344  1716 raft_consensus.cc:2889] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:44.384992  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:44.385718  2323 raft_consensus.cc:3060] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:44.388062  1646 raft_consensus.cc:2468] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 7.
I20260709 12:59:44.380935  1539 leader_election.cc:304] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 12:59:44.390218  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:44.393391  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:44.394230  1716 raft_consensus.cc:2393] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 6: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:59:44.362452  4433 leader_election.cc:290] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:44.394331  1615 leader_election.cc:304] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:44.400218  4476 raft_consensus.cc:2804] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:44.400671  4476 raft_consensus.cc:493] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:44.401042  4476 raft_consensus.cc:3060] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:44.401074  1615 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:44.403055  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:44.403853  1574 raft_consensus.cc:2468] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 6.
I20260709 12:59:44.407346  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:44.397578  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:44.396026  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:44.376411  4417 raft_consensus.cc:493] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:44.408263  1643 raft_consensus.cc:2468] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 4.
I20260709 12:59:44.420689  1572 raft_consensus.cc:1275] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:59:44.420847  4417 raft_consensus.cc:3060] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:44.421793  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:44.422250  1572 raft_consensus.cc:1240] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:59:44.422567  1721 raft_consensus.cc:2468] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6.
I20260709 12:59:44.423478  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:44.423659  1569 raft_consensus.cc:1275] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:44.424079  1721 raft_consensus.cc:2468] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 5.
I20260709 12:59:44.424793  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:44.424932  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:44.415293  4427 leader_election.cc:290] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:44.390422  4410 raft_consensus.cc:515] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:44.425810  4310 leader_election.cc:290] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:44.426244  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:44.426657  1725 raft_consensus.cc:1240] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:59:44.427196  1719 raft_consensus.cc:2410] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:59:44.427400  4410 leader_election.cc:290] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:44.424996  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:44.428007  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:44.425836  1722 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6.
I20260709 12:59:44.428926  1719 raft_consensus.cc:3060] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:44.429194  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:44.429863  1722 raft_consensus.cc:1240] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:44.427893  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:44.432444  1716 raft_consensus.cc:1240] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:44.433429  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:44.434496  1569 raft_consensus.cc:3060] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:44.435619  4417 raft_consensus.cc:515] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:44.435920  4476 raft_consensus.cc:515] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:44.436666  4250 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 12:59:44.438409  4476 leader_election.cc:290] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:44.440660  4442 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.441162  4442 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:44.442086  1569 raft_consensus.cc:2468] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 4.
I20260709 12:59:44.442291  1719 raft_consensus.cc:2468] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 8.
I20260709 12:59:44.443647  1646 raft_consensus.cc:2393] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 7: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:44.414565  1539 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:44.448885  2332 raft_consensus.cc:1240] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 5. Current term is 7. Ops: []
W20260709 12:59:44.449730  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 53864.3us
W20260709 12:59:44.451174  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 58307.8us
I20260709 12:59:44.452447  1570 raft_consensus.cc:2468] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 5.
I20260709 12:59:44.389061  4557 raft_consensus.cc:2804] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:59:44.454685  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:44.455919  4362 consensus_queue.cc:237] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:44.464804  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:44.465608  2326 raft_consensus.cc:2393] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 7: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 12:59:44.468408  4447 leader_election.cc:290] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:59:44.469110  1617 leader_election.cc:336] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.619s (SENT)
I20260709 12:59:44.469570  1617 leader_election.cc:304] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 12:59:44.470774  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 75194.4us
I20260709 12:59:44.389351  4122 raft_consensus.cc:515] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:44.398159  4413 raft_consensus.cc:2749] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:44.413785  4484 raft_consensus.cc:2804] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:44.388687  4510 raft_consensus.cc:515] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:44.479213  1648 raft_consensus.cc:2468] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 9.
I20260709 12:59:44.473418  4122 leader_election.cc:290] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:44.488875  4524 raft_consensus.cc:2804] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:44.398339  4558 raft_consensus.cc:2749] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:44.444665  4433 raft_consensus.cc:2804] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:59:44.510705  1691 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:44.580016  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:44.586573  4476 raft_consensus.cc:493] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:44.582243  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:44.592410  1648 raft_consensus.cc:2393] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 6: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:44.572945  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:44.593266  2329 raft_consensus.cc:2393] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 5: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 12:59:44.499720  1647 raft_consensus.cc:2468] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 4.
W20260709 12:59:44.583738  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 70854.2us
I20260709 12:59:44.587574  1572 raft_consensus.cc:3060] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:44.587903  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:44.563318  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
W20260709 12:59:44.610946  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 283567us
W20260709 12:59:44.611939  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 136191us
W20260709 12:59:44.613124  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 141367us
W20260709 12:59:44.613922  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 212901us
I20260709 12:59:44.492452  1645 raft_consensus.cc:2468] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 7.
I20260709 12:59:44.497020  1651 raft_consensus.cc:3060] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:44.588517  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:44.620420  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:44.621748  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:44.454391  4056 leader_election.cc:290] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:44.626556  1642 raft_consensus.cc:493] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:59:44.626994  1642 raft_consensus.cc:3060] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:44.575824  4447 raft_consensus.cc:2749] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:59:44.474623  4557 raft_consensus.cc:493] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:44.490231  4518 leader_election.cc:290] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:44.580957  4524 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:44.633492  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 156554us
W20260709 12:59:44.634150  1542 leader_election.cc:336] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.816s (SENT)
I20260709 12:59:44.587419  2323 raft_consensus.cc:2468] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 8.
I20260709 12:59:44.638204  2295 leader_election.cc:304] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:44.641022  1539 leader_election.cc:400] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 election: Vote denied by peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391) with higher term. Message: Invalid argument: T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 4. Current term is 5.
I20260709 12:59:44.624432  4433 raft_consensus.cc:697] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 8 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:44.688066  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:44.693351  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:44.686955  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
W20260709 12:59:44.689590  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:44.624976  4414 consensus_queue.cc:1059] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 12:59:44.692410  1689 leader_election.cc:304] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:44.623621  4484 raft_consensus.cc:697] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:44.715867  1539 leader_election.cc:403] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:59:44.714304  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:44.716277  1647 raft_consensus.cc:2393] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 5: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
W20260709 12:59:44.714582  1617 leader_election.cc:336] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.108s (SENT)
I20260709 12:59:44.718040  1722 raft_consensus.cc:2468] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6.
I20260709 12:59:44.718235  1617 leader_election.cc:304] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:44.717226  1643 raft_consensus.cc:2468] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 6.
I20260709 12:59:44.621230  4286 consensus_queue.cc:1048] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
W20260709 12:59:44.720469  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 79655.3us
I20260709 12:59:44.720619  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:44.721378  1643 raft_consensus.cc:2468] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 4.
I20260709 12:59:44.717614  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 12:59:44.723438  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 89342.8us
I20260709 12:59:44.687513  4530 consensus_queue.cc:1048] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:59:44.728690  4567 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:44.721621  1539 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:44.734819  1572 raft_consensus.cc:2468] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 5.
W20260709 12:59:44.713431  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 69566us
I20260709 12:59:44.737509  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:44.736618  1642 raft_consensus.cc:515] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:44.739172  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:44.637081  4524 raft_consensus.cc:3060] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:44.755486  1725 raft_consensus.cc:2393] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 3: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:59:44.632349  4557 raft_consensus.cc:3060] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:44.757688  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:44.721644  4436 raft_consensus.cc:2749] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423) with higher term. Message: Invalid argument: T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 6. Current term is 7.
I20260709 12:59:44.777375  1647 raft_consensus.cc:2468] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 7.
I20260709 12:59:44.778134  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:59:44.758208  1542 leader_election.cc:336] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.934s (SENT)
I20260709 12:59:44.646045  4145 consensus_queue.cc:1059] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 12:59:44.779035  1542 leader_election.cc:304] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:44.644443  4410 consensus_queue.cc:1059] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.104s
W20260709 12:59:44.780020  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 142953us
W20260709 12:59:44.782723  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 144590us
I20260709 12:59:44.783488  2295 leader_election.cc:304] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:44.757968  1716 raft_consensus.cc:2468] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 4.
I20260709 12:59:44.632303  4476 raft_consensus.cc:515] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:44.637547  4122 consensus_queue.cc:1059] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.142s
I20260709 12:59:44.786772  2295 leader_election.cc:304] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:44.727998  4484 consensus_queue.cc:237] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:44.776618  4418 raft_consensus.cc:2749] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:44.793768  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 520) took 3267 ms. Trace:
I20260709 12:59:44.803506  1567 rpcz_store.cc:276] 0709 12:59:41.526885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:42.857468 (+1330583us) service_pool.cc:224] Handling call
0709 12:59:42.870500 (+ 13032us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:43.305478 (+434978us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:44.793542 (+1488064us) spinlock_profiling.cc:243] Waited 433 ms on lock 0x7b5400314554. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:44.793716 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":996322688}
I20260709 12:59:44.738915  4558 raft_consensus.cc:2749] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391) with higher term. Message: Invalid argument: T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 4. Current term is 5.
I20260709 12:59:44.741166  4518 raft_consensus.cc:2749] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:59:44.788112  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 143175us
I20260709 12:59:44.742331  4362 raft_consensus.cc:2804] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:59:44.800506  1617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:44.811370  1617 leader_election.cc:336] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.595s (SENT)
I20260709 12:59:44.719278  4546 consensus_queue.cc:1059] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 12:59:44.780898  4414 raft_consensus.cc:2804] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:44.808060  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:44.815265  2294 leader_election.cc:304] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:44.816897  4483 raft_consensus.cc:2804] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:44.741412  4567 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:44.814831  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 122531us
I20260709 12:59:44.823200  1643 raft_consensus.cc:2410] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 8 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:59:44.794756  4545 raft_consensus.cc:2804] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:44.825446  2294 leader_election.cc:304] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:44.826362  4448 consensus_queue.cc:1059] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:59:44.816192  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 94658.2us
I20260709 12:59:44.838701  4414 raft_consensus.cc:697] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:44.853466  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:44.811523  4037 raft_consensus.cc:2749] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 LEADER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:44.859630  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 12:59:44.863212  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 120904us
I20260709 12:59:44.866016  1720 raft_consensus.cc:3060] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:44.866217  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:44.867336  4546 raft_consensus.cc:3055] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:44.867712  4546 raft_consensus.cc:740] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:44.868345  1719 raft_consensus.cc:2468] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 5.
I20260709 12:59:44.868571  4546 consensus_queue.cc:260] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:44.858625  4362 raft_consensus.cc:697] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:44.869848  1719 raft_consensus.cc:1275] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:59:44.870019  4546 raft_consensus.cc:3060] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:44.870215  1724 raft_consensus.cc:1240] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 2. Current term is 3. Ops: []
I20260709 12:59:44.870365  4362 consensus_queue.cc:237] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:44.871740  4510 leader_election.cc:290] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:44.869273  4565 log.cc:927] Time spent T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:59:44.854674  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:44.874262  1725 raft_consensus.cc:3060] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:44.872701  1721 raft_consensus.cc:3060] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:44.836274  4545 raft_consensus.cc:493] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:44.876046  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 50731.4us
I20260709 12:59:44.832355  4056 consensus_queue.cc:1059] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:59:44.880671  4414 consensus_queue.cc:237] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:44.885252  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:44.882546  4530 raft_consensus.cc:2804] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:44.885855  4476 leader_election.cc:290] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:44.887673  1717 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1968) took 1474 ms (client timeout 1854 ms). Trace:
I20260709 12:59:44.924723  1644 raft_consensus.cc:2468] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 7.
I20260709 12:59:44.910429  1689 leader_election.cc:304] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 12:59:44.925402  1717 rpcz_store.cc:269] 0709 12:59:43.413614 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.415130 (+  1516us) service_pool.cc:224] Handling call
0709 12:59:44.887467 (+1472337us) spinlock_profiling.cc:243] Waited 839 ms on lock 0x7b54002a99d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:44.887592 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1930510720}
I20260709 12:59:44.823307  4433 consensus_queue.cc:237] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:44.947227  4567 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:44.964483  1648 raft_consensus.cc:1275] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:59:44.861178  4569 raft_consensus.cc:2804] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:44.880285  4545 raft_consensus.cc:3060] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:44.920773  1651 raft_consensus.cc:2468] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 7.
I20260709 12:59:44.911761  1571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 1907) took 1354 ms. Trace:
I20260709 12:59:44.922031  1719 raft_consensus.cc:3060] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:44.931296  4572 raft_consensus.cc:493] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:44.933868  4530 raft_consensus.cc:493] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:44.936995  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:44.951068  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:44.876482  4518 consensus_queue.cc:1048] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:59:44.960234  1645 raft_consensus.cc:1240] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:44.961547  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:44.975848  1725 raft_consensus.cc:2468] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 6.
W20260709 12:59:44.967327  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 89641us
I20260709 12:59:44.979754  1721 raft_consensus.cc:2468] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 7.
W20260709 12:59:44.980235  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 101230us
I20260709 12:59:44.968760  2294 leader_election.cc:304] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
W20260709 12:59:45.031890  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:45.037173  1615 leader_election.cc:304] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
W20260709 12:59:44.921818  4327 consensus_meta.cc:287] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.654s	user 0.008s	sys 0.001s
W20260709 12:59:45.037175  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 68498.1us
W20260709 12:59:45.039856  1617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:45.040385  1617 leader_election.cc:336] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.714s (SENT)
I20260709 12:59:45.040771  1617 leader_election.cc:304] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:44.959014  4310 raft_consensus.cc:2749] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:59:45.046100  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 163000us
I20260709 12:59:45.047263  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:44.977582  1571 rpcz_store.cc:276] 0709 12:59:43.557618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.954845 (+397227us) service_pool.cc:224] Handling call
0709 12:59:44.025184 (+ 70339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:44.176083 (+150899us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:59:44.362474 (+186391us) log.cc:844] Serialized 14 byte log entry
0709 12:59:44.739000 (+376526us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:44.756351 (+ 17351us) log.cc:844] Serialized 26 byte log entry
0709 12:59:44.756557 (+   206us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:44.756591 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:44.756655 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:44.911568 (+154913us) raft_consensus.cc:1685] finished
0709 12:59:44.911586 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:44.911711 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":151844,"prepare.queue_time_us":322947,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":50,"raft.queue_time_us":222929,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":26159,"thread_start_us":457067,"threads_started":2,"wal-append.queue_time_us":341627}
I20260709 12:59:45.050583  1716 raft_consensus.cc:3060] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:45.037926  4530 raft_consensus.cc:3060] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:45.023005  4483 raft_consensus.cc:697] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:45.038030  4546 raft_consensus.cc:493] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:45.042191  4569 raft_consensus.cc:697] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:45.043543  4145 raft_consensus.cc:2804] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:45.050799  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:44.954741  4557 raft_consensus.cc:515] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:45.059247  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:45.047819  4510 raft_consensus.cc:2804] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:45.071481  1689 leader_election.cc:304] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:45.051805  4418 raft_consensus.cc:2749] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:59:45.078773  1723 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1978) took 1411 ms (client timeout 1781 ms). Trace:
W20260709 12:59:45.084968  1723 rpcz_store.cc:269] 0709 12:59:43.667065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.667228 (+   163us) service_pool.cc:224] Handling call
0709 12:59:45.075945 (+1408717us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b5400112e54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:45.078717 (+  2772us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":542096128}
I20260709 12:59:45.072854  2329 raft_consensus.cc:2468] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 5.
I20260709 12:59:45.087723  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
W20260709 12:59:45.088374  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 48019.9us
W20260709 12:59:45.089057  1617 leader_election.cc:336] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.090s (SENT)
I20260709 12:59:45.089383  1617 leader_election.cc:304] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:45.043215  4327 raft_consensus.cc:515] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:45.037336  4572 raft_consensus.cc:515] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:45.097877  1716 raft_consensus.cc:2468] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 4.
I20260709 12:59:45.052548  4153 consensus_queue.cc:1048] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:59:45.099977  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:45.094911  4510 raft_consensus.cc:697] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 8 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:45.104264  1719 raft_consensus.cc:2468] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 7.
I20260709 12:59:45.105830  1647 raft_consensus.cc:1240] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:45.112514  1720 raft_consensus.cc:2468] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 7.
I20260709 12:59:45.097738  4145 raft_consensus.cc:697] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:45.078408  4546 raft_consensus.cc:515] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:45.119262  1542 connection.cc:256] RPC call timeout handler was delayed by -1.6173691089999807s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21230000000000004s for a response
W20260709 12:59:45.119640  1542 connection.cc:256] RPC call timeout handler was delayed by -1.6150379179999845s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1996s for a response
W20260709 12:59:45.119866  1542 connection.cc:256] RPC call timeout handler was delayed by -1.537937597999985s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24020000000000002s for a response
I20260709 12:59:45.121613  1569 raft_consensus.cc:1240] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:59:45.122427  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:45.125977  2329 raft_consensus.cc:3060] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:45.122972  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:45.109795  4310 raft_consensus.cc:2749] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:45.109598  4436 raft_consensus.cc:2749] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:59:45.153156  1542 leader_election.cc:336] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.949s (SENT)
I20260709 12:59:45.153663  1542 leader_election.cc:304] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:45.158360  4327 leader_election.cc:290] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:45.161257  2332 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb"
dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
mode: GRACEFUL
new_leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:39778
I20260709 12:59:45.123268  4483 consensus_queue.cc:237] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:45.170487  4577 log.cc:927] Time spent T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 12:59:45.171252  4566 log.cc:927] Time spent T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.552s	user 0.004s	sys 0.000s
I20260709 12:59:45.170032  4510 consensus_queue.cc:237] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:45.192200  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:45.120837  4122 consensus_queue.cc:1059] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
W20260709 12:59:45.195412  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:45.186980  4484 raft_consensus.cc:2749] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:45.224756  1539 leader_election.cc:304] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:45.232245  4557 leader_election.cc:290] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:45.234054  4245 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:45.232613  4571 raft_consensus.cc:2804] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:59:45.238495  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 90901.1us
W20260709 12:59:45.243921  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 154878us
I20260709 12:59:45.241923  4571 raft_consensus.cc:493] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:45.248826  4571 raft_consensus.cc:3060] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:45.249837  4546 leader_election.cc:290] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:45.252768  4572 leader_election.cc:290] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:45.253795  2297 leader_election.cc:304] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 12:59:45.256902  4570 consensus_queue.cc:1059] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:59:45.258123  4570 raft_consensus.cc:2804] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:45.258253  4410 raft_consensus.cc:1064] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e: attempting to promote NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 to VOTER
I20260709 12:59:45.258680  4570 raft_consensus.cc:697] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:45.243611  4580 consensus_queue.cc:1048] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
W20260709 12:59:45.245464  4582 log.cc:927] Time spent T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 12:59:45.246781  1542 connection.cc:256] RPC call timeout handler was delayed by -1.4365334100000382s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1877s for a response
I20260709 12:59:45.174304  4569 consensus_queue.cc:237] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:45.247428  4548 log.cc:927] Time spent T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 1.683s	user 0.010s	sys 0.013s
I20260709 12:59:45.240245  4145 consensus_queue.cc:237] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:45.274909  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:45.503309  1646 raft_consensus.cc:3060] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:45.504161  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:45.504994  1542 connection.cc:256] RPC call timeout handler was delayed by -1.430233410000028s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1884s for a response
W20260709 12:59:45.505448  1542 connection.cc:256] RPC call timeout handler was delayed by -1.2652375979999988s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2705s for a response
W20260709 12:59:45.505851  1542 connection.cc:256] RPC call timeout handler was delayed by -1.2097334100000694s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2129s for a response
W20260709 12:59:45.258778  4410 raft_consensus.cc:1068] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e: Unable to promote non-voter 05476b84d8f84d76a9a1f51b620a3c66: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:59:45.294381  2329 raft_consensus.cc:2468] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 9.
I20260709 12:59:45.276942  4543 raft_consensus.cc:3055] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:45.259300  4579 raft_consensus.cc:3055] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:59:45.346354  4589 raft_consensus.cc:493] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:45.527593  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 318267us
W20260709 12:59:45.537034  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 489501us
I20260709 12:59:45.270270  4530 raft_consensus.cc:515] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:45.539084  1646 raft_consensus.cc:2468] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 7.
I20260709 12:59:45.543823  1539 leader_election.cc:304] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:45.272951  4524 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:45.514801  4579 raft_consensus.cc:740] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:45.498353  4545 raft_consensus.cc:515] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:45.513723  4543 raft_consensus.cc:740] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
W20260709 12:59:45.546314  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 44033.3us
W20260709 12:59:45.554836  1542 leader_election.cc:336] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.877s (SENT)
I20260709 12:59:45.555296  1542 leader_election.cc:304] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
W20260709 12:59:45.553395  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 46041.6us
W20260709 12:59:45.556717  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:45.559773  1691 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:45.562624  1716 raft_consensus.cc:1275] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:59:45.527343  4589 raft_consensus.cc:515] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:45.565752  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:45.566537  1723 raft_consensus.cc:2468] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 5.
I20260709 12:59:45.567698  4524 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:45.567914  4589 leader_election.cc:290] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:59:45.565925  4583 log.cc:927] Time spent T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.405s	user 0.003s	sys 0.008s
I20260709 12:59:45.568943  4579 consensus_queue.cc:260] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:45.570209  4579 raft_consensus.cc:3060] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:59:45.571054  2295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:45.571547  4310 consensus_queue.cc:1059] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:45.571811  1688 leader_election.cc:304] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:45.572039  1570 raft_consensus.cc:1240] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:59:45.573592  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:45.588920  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:45.547281  4572 raft_consensus.cc:2804] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:45.598968  2332 raft_consensus.cc:606] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Received request to transfer leadership to TS 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:45.537889  4571 raft_consensus.cc:515] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:45.656251  2332 raft_consensus.cc:614] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:59:45.656407  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 83071.8us
I20260709 12:59:45.600946  1576 raft_consensus.cc:1275] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:59:45.642688  1723 raft_consensus.cc:1240] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 2. Current term is 3. Ops: []
W20260709 12:59:45.649175  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 102848us
W20260709 12:59:45.565197  1617 leader_election.cc:336] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.194s (SENT)
I20260709 12:59:45.588852  4525 raft_consensus.cc:2749] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:59:45.648639  4555 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.210s	user 0.012s	sys 0.007s
I20260709 12:59:45.690387  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:45.691675  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:45.600332  4591 consensus_queue.cc:1059] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.095s
I20260709 12:59:45.695770  4591 raft_consensus.cc:2804] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:45.696169  4591 raft_consensus.cc:493] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:45.696516  4591 raft_consensus.cc:3060] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:45.698593  1649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45148 (request call id 2064) took 1348 ms. Trace:
I20260709 12:59:45.699021  1649 rpcz_store.cc:276] 0709 12:59:44.350468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:45.165177 (+814709us) service_pool.cc:224] Handling call
0709 12:59:45.249164 (+ 83987us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:45.249520 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:45.249564 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:45.250158 (+   594us) log.cc:844] Serialized 26 byte log entry
0709 12:59:45.378711 (+128553us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:45.378767 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:45.379266 (+   499us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:45.698380 (+319114us) raft_consensus.cc:1685] finished
0709 12:59:45.698400 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:45.698534 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":128033,"threads_started":1,"wal-append.queue_time_us":293112}
W20260709 12:59:45.680742  4555 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.242s	user 0.020s	sys 0.016s
I20260709 12:59:45.600235  4543 consensus_queue.cc:260] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:59:45.709833  4543 raft_consensus.cc:3060] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:45.710162  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:45.711020  1649 raft_consensus.cc:2393] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 7: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
W20260709 12:59:45.714011  1542 leader_election.cc:336] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.884s (SENT)
I20260709 12:59:45.714915  1542 leader_election.cc:304] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:45.655597  4572 raft_consensus.cc:697] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:45.716367  1567 raft_consensus.cc:1275] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:45.717826  1642 leader_election.cc:290] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:45.717869  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 163887us
I20260709 12:59:45.718114  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:45.735080  1689 leader_election.cc:304] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
W20260709 12:59:45.735677  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 163929us
I20260709 12:59:45.737308  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:57912 (request call id 457) took 1584 ms. Trace:
I20260709 12:59:45.738054  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:45.737862  1642 rpcz_store.cc:276] 0709 12:59:44.158692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.259895 (+101203us) service_pool.cc:224] Handling call
0709 12:59:45.707737 (+1447842us) spinlock_profiling.cc:243] Waited 274 ms on lock 0x7b54002d8cd4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23b2a3d 00007fa9f7382cd0 00007fa9f0907254 00007fa9f09071e2 00007fa9f0907111 00007fa9f090708c 00007fa9f0906342 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:45.730493 (+ 22756us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":8812,"spinlock_wait_cycles":629362944}
I20260709 12:59:45.601660  4483 consensus_queue.cc:1059] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.114s
I20260709 12:59:45.556851  4570 consensus_queue.cc:237] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:45.757262  1688 leader_election.cc:304] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
W20260709 12:59:45.758769  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 44822.3us
I20260709 12:59:45.761348  1642 raft_consensus.cc:1240] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:45.761993  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 468) took 1177 ms. Trace:
I20260709 12:59:45.762272  1642 rpcz_store.cc:276] 0709 12:59:44.584917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:45.760930 (+1176013us) service_pool.cc:224] Handling call
0709 12:59:45.761198 (+   268us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:45.761776 (+   578us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:45.761944 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:45.773020  1567 raft_consensus.cc:1240] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:59:45.774205  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:45.751267  4557 raft_consensus.cc:2749] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:45.777420  1649 raft_consensus.cc:1240] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:45.778247  1649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45148 (request call id 2067) took 1322 ms. Trace:
I20260709 12:59:45.778649  1649 rpcz_store.cc:276] 0709 12:59:44.455563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:45.755353 (+1299790us) service_pool.cc:224] Handling call
0709 12:59:45.777188 (+ 21835us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:45.777943 (+   755us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:45.778180 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:45.783224  1617 leader_election.cc:336] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.488s (SENT)
W20260709 12:59:45.792143  1542 leader_election.cc:336] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.996s (SENT)
I20260709 12:59:45.792678  1542 leader_election.cc:304] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:45.794456  1649 raft_consensus.cc:1275] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:45.794948  1642 raft_consensus.cc:1275] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:59:45.795526  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 469) took 1210 ms. Trace:
I20260709 12:59:45.795832  1688 leader_election.cc:304] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:45.747572  4580 consensus_queue.cc:1048] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:59:45.798058  1649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 1466) took 1158 ms. Trace:
I20260709 12:59:45.800419  1649 rpcz_store.cc:276] 0709 12:59:44.639194 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:45.779487 (+1140293us) service_pool.cc:224] Handling call
0709 12:59:45.794036 (+ 14549us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:45.794917 (+   881us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:45.798004 (+  3087us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:45.795835  1642 rpcz_store.cc:276] 0709 12:59:44.585196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:45.762943 (+1177747us) service_pool.cc:224] Handling call
0709 12:59:45.780912 (+ 17969us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:45.795297 (+ 14385us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:45.795476 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:45.790956  4600 consensus_queue.cc:1048] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:59:45.923281  1651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57912 (request call id 463) took 1601 ms. Trace:
W20260709 12:59:45.987319  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 195193us
I20260709 12:59:45.995540  1651 rpcz_store.cc:276] 0709 12:59:44.322275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.333938 (+ 11663us) service_pool.cc:224] Handling call
0709 12:59:45.923049 (+1589111us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b540030d754. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:45.923201 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":372949888}
I20260709 12:59:45.797035  4557 raft_consensus.cc:2749] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:59:45.806815  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 43594.6us
I20260709 12:59:45.824566  1649 raft_consensus.cc:1275] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:59:45.998029  1651 raft_consensus.cc:1240] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:59:45.998399  1649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 1467) took 1358 ms. Trace:
I20260709 12:59:45.998873  1649 rpcz_store.cc:276] 0709 12:59:44.639513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:45.801408 (+1161895us) service_pool.cc:224] Handling call
0709 12:59:45.812444 (+ 11036us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:45.998073 (+185629us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:45.998276 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:45.808276  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:46.000087  1571 raft_consensus.cc:3060] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:46.006917  1617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:45.976516  4595 log.cc:927] Time spent T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.318s	user 0.001s	sys 0.000s
W20260709 12:59:46.009651  1617 leader_election.cc:336] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.854s (SENT)
I20260709 12:59:46.010257  1617 leader_election.cc:304] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:45.828491  4545 leader_election.cc:290] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:46.013154  1719 raft_consensus.cc:1275] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:46.011900  1642 raft_consensus.cc:1240] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:59:46.023836  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 471) took 1090 ms. Trace:
I20260709 12:59:46.024384  1642 rpcz_store.cc:276] 0709 12:59:44.933745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:45.805179 (+871434us) service_pool.cc:224] Handling call
0709 12:59:46.011581 (+206402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:46.023510 (+ 11929us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:46.023765 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:46.026180  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 320388us
I20260709 12:59:45.806649  4606 raft_consensus.cc:3055] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:45.977028  4530 leader_election.cc:290] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:45.977773  4414 raft_consensus.cc:493] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:46.003286  4310 raft_consensus.cc:2749] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:59:46.015921  4587 log.cc:927] Time spent T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.387s	user 0.001s	sys 0.001s
W20260709 12:59:46.052659  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 256878us
I20260709 12:59:46.053166  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:46.053817  1719 raft_consensus.cc:3060] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:46.052706  1542 leader_election.cc:336] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.129s (SENT)
I20260709 12:59:46.054308  1542 leader_election.cc:304] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:46.013700  4410 raft_consensus.cc:2749] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:46.059198  2297 leader_election.cc:304] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 12:59:46.060703  1644 raft_consensus.cc:1240] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
W20260709 12:59:46.064652  1650 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 1455) took 2487 ms (client timeout 2140 ms). Trace:
I20260709 12:59:46.049959  4571 leader_election.cc:290] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:59:46.065147  1650 rpcz_store.cc:269] 0709 12:59:43.572807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:43.572921 (+   114us) service_pool.cc:224] Handling call
0709 12:59:46.060126 (+2487205us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b54001f8e54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:46.060275 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":413842688}
I20260709 12:59:46.068233  2297 leader_election.cc:304] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 12:59:46.069011  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 59398.1us
W20260709 12:59:46.082314  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:46.086001  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 539) took 1270 ms. Trace:
I20260709 12:59:46.085667  4591 raft_consensus.cc:515] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:46.056490  4414 raft_consensus.cc:515] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:46.088300  1648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45148 (request call id 2062) took 1738 ms. Trace:
W20260709 12:59:46.091610  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:46.095517  1570 rpcz_store.cc:276] 0709 12:59:44.815170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.819664 (+  4494us) service_pool.cc:224] Handling call
0709 12:59:44.819988 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:45.572396 (+752408us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:46.085746 (+513350us) spinlock_profiling.cc:243] Waited 752 ms on lock 0x7b54002710d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:46.085941 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1729006464}
W20260709 12:59:46.106266  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:46.120244  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 63152.2us
I20260709 12:59:46.118180  1648 rpcz_store.cc:276] 0709 12:59:44.349881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:45.049412 (+699531us) service_pool.cc:224] Handling call
0709 12:59:45.071226 (+ 21814us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:45.098242 (+ 27016us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:45.098278 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:45.105559 (+  7281us) log.cc:844] Serialized 26 byte log entry
0709 12:59:45.244620 (+139061us) spinlock_profiling.cc:243] Waited 8.92 ms on lock 0x7b4800043d58. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f72e4aa1 00007fa9f72dbb37 00007fa9f72db9ca 00007fa9f73d326f 00007fa9f73d2f37 00007fa9f73e755c 00007fa9f73e7508 00007fa9f73e7488 00007fa9f73e7443 00007fa9f73e66ec 00007fa9f6310a96
0709 12:59:45.325082 (+ 80462us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:45.325147 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:45.325249 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:46.087947 (+762698us) raft_consensus.cc:1685] finished
0709 12:59:46.087966 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:46.088234 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18651,"raft.run_cpu_time_us":1714,"raft.run_wall_time_us":139099,"spinlock_wait_cycles":20507392,"thread_start_us":168265,"threads_started":1,"wal-append.queue_time_us":410837}
I20260709 12:59:45.806881  4572 consensus_queue.cc:237] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:46.139969  1540 connection.cc:256] RPC call timeout handler was delayed by -2.0710259980000387s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16240000000000002s for a response
W20260709 12:59:46.140974  1540 connection.cc:256] RPC call timeout handler was delayed by -1.5841848140000252s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1587s for a response
W20260709 12:59:46.141678  1540 connection.cc:256] RPC call timeout handler was delayed by -1.2648515399999951s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1789s for a response
W20260709 12:59:46.142191  1540 connection.cc:256] RPC call timeout handler was delayed by -1.1641417809999552s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1684s for a response
W20260709 12:59:46.069730  1617 leader_election.cc:336] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.888s (SENT)
W20260709 12:59:46.145090  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 75545.9us
I20260709 12:59:46.149719  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 546) took 1189 ms. Trace:
I20260709 12:59:46.059700  4606 raft_consensus.cc:740] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:46.066782  4557 raft_consensus.cc:2749] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:59:46.154731  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 102078us
W20260709 12:59:46.159605  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 75062.9us
I20260709 12:59:46.119400  4525 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.133476  4580 raft_consensus.cc:2804] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:46.170986  1689 leader_election.cc:304] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e
W20260709 12:59:46.174043  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 84321.5us
I20260709 12:59:46.150272  1717 rpcz_store.cc:276] 0709 12:59:44.960510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.968480 (+  7970us) service_pool.cc:224] Handling call
0709 12:59:45.035130 (+ 66650us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:45.115711 (+ 80581us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:45.115747 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:45.166031 (+ 50284us) log.cc:844] Serialized 26 byte log entry
0709 12:59:45.508295 (+342264us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:45.508329 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:45.508392 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:46.149441 (+641049us) raft_consensus.cc:1685] finished
0709 12:59:46.149471 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:46.149642 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":37850,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":8712,"thread_start_us":392462,"threads_started":2,"wal-append.queue_time_us":374337}
I20260709 12:59:46.129644  4578 consensus_queue.cc:1048] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:59:46.192677  1646 raft_consensus.cc:2410] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:59:46.177850  4555 raft_consensus.cc:2804] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:46.195444  4555 raft_consensus.cc:493] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:46.196022  4555 raft_consensus.cc:3060] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:46.196187  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45148 (request call id 2063) took 1846 ms. Trace:
I20260709 12:59:46.196906  1644 rpcz_store.cc:276] 0709 12:59:44.350169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:45.088729 (+738560us) service_pool.cc:224] Handling call
0709 12:59:46.060383 (+971654us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:46.061145 (+   762us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:46.195905 (+134760us) spinlock_profiling.cc:243] Waited 971 ms on lock 0x7b54001f8e50. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23ba8ad 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:46.196104 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2233857280}
W20260709 12:59:46.201243  4586 log.cc:927] Time spent T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 1.044s	user 0.003s	sys 0.021s
I20260709 12:59:46.205139  1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1989) took 1924 ms. Trace:
I20260709 12:59:46.205746  1718 rpcz_store.cc:276] 0709 12:59:44.280681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.280815 (+   134us) service_pool.cc:224] Handling call
0709 12:59:44.354913 (+ 74098us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:44.398467 (+ 43554us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:46.204834 (+1806367us) spinlock_profiling.cc:243] Waited 32.5 ms on lock 0x7b54002ab7d0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23ba8ad 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:46.205055 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":74792192}
I20260709 12:59:46.213369  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 460) took 1969 ms. Trace:
I20260709 12:59:46.213982  1647 rpcz_store.cc:276] 0709 12:59:44.244167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.782497 (+538330us) service_pool.cc:224] Handling call
0709 12:59:44.793872 (+ 11375us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:45.106211 (+312339us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:46.213036 (+1106825us) spinlock_profiling.cc:243] Waited 312 ms on lock 0x7b54001f7f54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:46.213285 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":717028736}
I20260709 12:59:46.234395  1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45148 (request call id 2068) took 1778 ms. Trace:
I20260709 12:59:46.235138  1643 rpcz_store.cc:276] 0709 12:59:44.455926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.737167 (+281241us) service_pool.cc:224] Handling call
0709 12:59:46.234060 (+1496893us) spinlock_profiling.cc:243] Waited 34.1 ms on lock 0x7b54001f9354. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:46.234294 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":78445824}
W20260709 12:59:46.242750  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:46.243402  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:46.248234  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:46.250356  2329 raft_consensus.cc:3055] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:46.250875  2329 raft_consensus.cc:740] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:46.251387  2332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:39778 (request call id 3) took 1124 ms. Trace:
I20260709 12:59:46.251825  2329 consensus_queue.cc:260] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:46.253796  2329 raft_consensus.cc:3060] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:46.260113  2326 raft_consensus.cc:1275] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:59:46.261312  1615 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:46.262032  4543 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:46.262550  4543 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:46.264401  4443 leader_election.cc:290] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:46.266368  4514 raft_consensus.cc:3055] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:46.266819  4514 raft_consensus.cc:740] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:46.267752  4514 consensus_queue.cc:260] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:46.269172  4521 raft_consensus.cc:3055] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:59:46.310065  1691 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:46.269801  1615 leader_election.cc:304] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:46.266408  4543 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:46.270743  1724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 544) took 1394 ms. Trace:
I20260709 12:59:46.178870  4310 raft_consensus.cc:2764] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 12:59:46.271823  4250 raft_consensus.cc:3055] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:59:46.183251  4579 consensus_meta.cc:287] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.613s	user 0.008s	sys 0.005s
I20260709 12:59:46.178627  4601 raft_consensus.cc:3055] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:46.368634  1724 rpcz_store.cc:276] 0709 12:59:44.876750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:44.876937 (+   187us) service_pool.cc:224] Handling call
0709 12:59:46.219493 (+1342556us) spinlock_profiling.cc:243] Waited 3.35 ms on lock 0x7b5800196e98. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef296b71 00007fa9ef296a22 00007fa9f81afc09 00007fa9f7309ee0 00007fa9f73d30ab 00007fa9f73d3131 00007fa9f7394fc0 00007fa9f737f929 00007fa9f737f3d2 00007fa9f08f6bd4
0709 12:59:46.219762 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:46.220280 (+   518us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:46.220321 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:46.220380 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:46.220439 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:46.220514 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:46.270684 (+ 50170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7702272}
I20260709 12:59:46.252007  2332 rpcz_store.cc:276] 0709 12:59:45.126844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:45.150574 (+ 23730us) service_pool.cc:224] Handling call
0709 12:59:46.251095 (+1100521us) spinlock_profiling.cc:243] Waited 437 ms on lock 0x7b5400846a54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23b5853 00007fa9f738360a 00007fa9f09097d4 00007fa9f0909762 00007fa9f0909691 00007fa9f090960c 00007fa9f09088c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:46.251249 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1004902144}
I20260709 12:59:46.379843  4606 consensus_queue.cc:260] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:46.381150  4610 log.cc:927] Time spent T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.379s	user 0.000s	sys 0.001s
I20260709 12:59:46.281397  4145 consensus_queue.cc:1059] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.100s
W20260709 12:59:46.388193  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 234001us
W20260709 12:59:46.390326  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 111334us
I20260709 12:59:46.182773  4056 consensus_queue.cc:1048] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.191s
W20260709 12:59:46.393338  1542 leader_election.cc:336] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.558s (SENT)
I20260709 12:59:46.176149  4525 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:46.184407  4530 consensus_queue.cc:1059] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.191s
W20260709 12:59:46.397269  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 316159us
W20260709 12:59:46.394963  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 325238us
I20260709 12:59:46.288409  4521 raft_consensus.cc:740] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:46.183476  4570 consensus_queue.cc:1059] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.203s
W20260709 12:59:46.423545  1617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:46.430543  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 284551us
I20260709 12:59:46.282147  4286 consensus_queue.cc:1059] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.117s
I20260709 12:59:46.375073  4250 raft_consensus.cc:740] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:46.383883  4601 raft_consensus.cc:740] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:46.435631  1689 leader_election.cc:304] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:46.371567  4557 consensus_queue.cc:1048] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 12:59:46.143313  4615 raft_consensus.cc:2804] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:46.030640  4609 raft_consensus.cc:2804] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:46.463685  2329 raft_consensus.cc:1275] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:59:46.467002  1719 raft_consensus.cc:2468] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 6.
W20260709 12:59:46.471146  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 222465us
W20260709 12:59:46.544245  1617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:46.559557  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 204706us
I20260709 12:59:46.445158  4606 raft_consensus.cc:3060] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:46.628113  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:46.629269  1643 raft_consensus.cc:2393] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 7: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
W20260709 12:59:46.515139  4403 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
W20260709 12:59:46.673032  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 251444us
W20260709 12:59:46.639339  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 208106us
W20260709 12:59:46.654256  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:46.470679  4615 raft_consensus.cc:493] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:46.443770  4310 consensus_queue.cc:1059] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.189s
W20260709 12:59:46.681963  1569 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.048s	sys 0.054s
I20260709 12:59:46.416111  4556 consensus_queue.cc:1059] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.148s
W20260709 12:59:46.688131  1569 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.048s	sys 0.055s
I20260709 12:59:46.688508  1572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 545) took 1115 ms. Trace:
I20260709 12:59:46.694212  1572 rpcz_store.cc:276] 0709 12:59:45.572850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:45.572968 (+   118us) service_pool.cc:224] Handling call
0709 12:59:45.643889 (+ 70921us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:45.697258 (+ 53369us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:45.697297 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:45.697796 (+   499us) log.cc:844] Serialized 26 byte log entry
0709 12:59:45.774632 (+ 76836us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:45.774751 (+   119us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:45.774838 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:46.688240 (+913402us) raft_consensus.cc:1685] finished
0709 12:59:46.688267 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:46.688434 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5104,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":11242,"thread_start_us":74759,"threads_started":1,"wal-append.queue_time_us":105322}
W20260709 12:59:46.711768  1542 leader_election.cc:336] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.960s (SENT)
I20260709 12:59:46.712424  1542 leader_election.cc:304] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
W20260709 12:59:46.717491  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 447722us
W20260709 12:59:46.725574  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 51338.6us
W20260709 12:59:46.727814  2295 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.008s	sys 0.044s
W20260709 12:59:46.728295  2295 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.008s	sys 0.044s
W20260709 12:59:46.728483  1691 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:46.728658  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 550885us
W20260709 12:59:46.738854  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:46.749943  2297 leader_election.cc:304] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
W20260709 12:59:46.750816  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 276817us
I20260709 12:59:46.682091  4615 raft_consensus.cc:3060] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:46.698176  4414 leader_election.cc:290] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:46.693926  4580 raft_consensus.cc:697] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:46.766001  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:46.785995  4619 raft_consensus.cc:2804] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:46.786588  4619 raft_consensus.cc:697] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 8 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:46.786414  4580 consensus_queue.cc:237] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:46.787497  4619 consensus_queue.cc:237] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:46.788242  1571 consensus_meta.cc:287] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.788s	user 0.008s	sys 0.000s
W20260709 12:59:46.788781  1540 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.021s	sys 0.021s
I20260709 12:59:46.758718  4591 leader_election.cc:290] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:46.789490  1571 raft_consensus.cc:2468] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 7.
W20260709 12:59:46.790192  1540 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.021s	sys 0.021s
W20260709 12:59:46.797359  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 641851us
I20260709 12:59:46.789991  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
W20260709 12:59:46.788645  4614 log.cc:927] Time spent T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.604s	user 0.000s	sys 0.001s
I20260709 12:59:46.775571  4350 raft_consensus.cc:2804] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:46.763501  4320 consensus_queue.cc:1048] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:59:46.852761  1540 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:46.872896  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:46.735280  4521 consensus_queue.cc:260] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:46.780884  4557 consensus_queue.cc:1059] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.074s
I20260709 12:59:46.791064  4442 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:46.882921  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:46.886564  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 12:59:46.886891  4621 log.cc:927] Time spent T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 12:59:46.887871  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:46.888638  1574 raft_consensus.cc:2393] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 5: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 12:59:46.889573  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:46.890131  1570 raft_consensus.cc:2468] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6.
I20260709 12:59:46.892251  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:46.892838  1643 raft_consensus.cc:3060] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:46.892989  4624 raft_consensus.cc:3055] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:59:46.893357  4622 log.cc:927] Time spent T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 12:59:46.894063  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:46.894745  1572 raft_consensus.cc:2368] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 5. Current term is 6.
I20260709 12:59:46.901005  4627 consensus_queue.cc:1048] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.148s
I20260709 12:59:46.921828  2332 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e"
dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
mode: GRACEFUL
new_leader_uuid: "4dbe7d47a2374afca075d3a98583b49e"
 from {username='slave'} at 127.0.0.1:39778
I20260709 12:59:46.788673  4623 consensus_queue.cc:1059] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.241s
I20260709 12:59:46.888569  4625 raft_consensus.cc:2749] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:46.946041  1643 raft_consensus.cc:2468] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 5.
I20260709 12:59:46.961845  1688 leader_election.cc:304] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:46.874701  4417 leader_election.cc:290] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:46.879001  4350 raft_consensus.cc:697] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:46.982707  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:46.964623  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 12:59:46.969125  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:46.981809  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 12:59:46.964361  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 196379us
I20260709 12:59:47.005247  1575 raft_consensus.cc:3060] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:47.000682  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 282191us
I20260709 12:59:47.002393  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:47.001621  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 550) took 1325 ms. Trace:
I20260709 12:59:47.006660  1570 raft_consensus.cc:3060] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:47.003163  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:47.007930  1574 raft_consensus.cc:2393] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 7: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 12:59:47.004755  1573 raft_consensus.cc:2468] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6.
I20260709 12:59:46.981843  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:47.010289  1567 raft_consensus.cc:2468] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7.
I20260709 12:59:46.767959  4250 consensus_queue.cc:260] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:46.922726  4442 raft_consensus.cc:493] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:47.014335  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 92241.7us
I20260709 12:59:46.926676  4591 raft_consensus.cc:493] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:46.893419  4624 raft_consensus.cc:740] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:46.882647  4635 consensus_queue.cc:1059] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.150s
W20260709 12:59:47.045835  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:47.131369  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:47.218294  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:47.129231  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 122494us
W20260709 12:59:47.090940  2295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:47.221752  2295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:47.041813  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:47.225447  1573 raft_consensus.cc:3060] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:47.137822  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 12:59:47.149796  1691 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:47.246308  1617 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.003s	sys 0.007s
I20260709 12:59:47.256207  2332 raft_consensus.cc:606] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 LEADER]: Received request to transfer leadership to TS 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:47.048808  1574 raft_consensus.cc:1240] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 12:59:47.257253  1617 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.004s	sys 0.008s
I20260709 12:59:47.049013  1649 raft_consensus.cc:1240] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:47.049384  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:46.958882  4627 raft_consensus.cc:2749] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:47.255880  1570 raft_consensus.cc:2468] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7.
I20260709 12:59:47.260885  1649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45148 (request call id 2075) took 1202 ms. Trace:
I20260709 12:59:47.262318  1575 raft_consensus.cc:2468] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7.
I20260709 12:59:47.261978  1649 rpcz_store.cc:276] 0709 12:59:46.056277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.048518 (+992241us) service_pool.cc:224] Handling call
0709 12:59:47.048834 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:47.257985 (+209151us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:47.258218 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:47.045917  4620 log.cc:927] Time spent T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 12:59:47.268242  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:47.268989  1645 raft_consensus.cc:2393] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 5: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:59:47.258952  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:47.270227  1650 raft_consensus.cc:2393] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 7: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
W20260709 12:59:47.272130  1617 leader_election.cc:336] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.014s (SENT)
I20260709 12:59:47.272722  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:47.272832  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:47.273062  1643 raft_consensus.cc:1240] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:47.273221  1647 raft_consensus.cc:1275] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:59:47.274258  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:47.295979  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:47.357388  1648 raft_consensus.cc:2468] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6.
I20260709 12:59:47.358610  1468 catalog_manager.cc:5697] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:47.359797  4624 consensus_queue.cc:260] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:47.360867  4601 consensus_queue.cc:260] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:47.362569  4601 raft_consensus.cc:3060] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:47.363528  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:47.364390  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:47.367316  4608 log.cc:927] Time spent T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 1.558s	user 0.012s	sys 0.016s
I20260709 12:59:47.368983  1570 raft_consensus.cc:1275] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 12:59:47.370323  4606 consensus_meta.cc:287] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.729s	user 0.009s	sys 0.001s
W20260709 12:59:47.373054  4555 consensus_meta.cc:287] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 1.176s	user 0.011s	sys 0.000s
I20260709 12:59:47.373605  4555 raft_consensus.cc:515] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:47.355717  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:47.377024  1644 raft_consensus.cc:3060] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:47.260027  1568 raft_consensus.cc:2376] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 5. Re-sending same reply.
I20260709 12:59:47.137543  4310 raft_consensus.cc:2804] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:59:47.382987  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:47.049789  4543 raft_consensus.cc:493] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:47.047359  4417 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:47.388410  2326 raft_consensus.cc:2393] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 7: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 12:59:47.417881  2295 leader_election.cc:304] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 12:59:47.396175  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 124061us
W20260709 12:59:47.419718  1617 leader_election.cc:336] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.078s (SENT)
I20260709 12:59:47.420260  1617 leader_election.cc:304] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:47.016099  4641 raft_consensus.cc:2749] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:59:47.427416  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 736856us
I20260709 12:59:47.025717  4623 raft_consensus.cc:3055] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:59:47.398240  1615 leader_election.cc:336] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Timed out: RequestConsensusVote RPC to 127.0.107.193:34373 timed out after 1.941s (SENT)
I20260709 12:59:47.429306  1615 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:47.360922  4624 raft_consensus.cc:3060] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:47.446231  1542 leader_election.cc:336] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 3.077s (SENT)
I20260709 12:59:47.456979  1542 leader_election.cc:304] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:47.446277  1689 leader_election.cc:304] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 12:59:47.394002  4626 raft_consensus.cc:3055] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:47.250010  4525 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:47.394731  4625 raft_consensus.cc:493] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:47.331117  4633 raft_consensus.cc:493] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:47.256311  4442 raft_consensus.cc:515] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:47.159849  4350 consensus_queue.cc:237] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:47.268842  4591 raft_consensus.cc:515] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:47.455124  4250 raft_consensus.cc:3060] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:47.440459  4623 raft_consensus.cc:740] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:47.463420  4626 raft_consensus.cc:740] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:47.439706  4417 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:47.478978  4579 raft_consensus.cc:2804] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:47.445575  4543 raft_consensus.cc:515] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:47.521603  4629 log.cc:927] Time spent T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.347s	user 0.000s	sys 0.001s
I20260709 12:59:47.521052  4623 consensus_queue.cc:260] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:47.522815  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 76609.6us
I20260709 12:59:47.528987  4442 leader_election.cc:290] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:47.479784  4320 consensus_queue.cc:1048] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:59:47.555246  4417 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:47.534006  4628 log.cc:927] Time spent T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.172s	user 0.000s	sys 0.003s
W20260709 12:59:47.557963  4615 consensus_meta.cc:287] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.776s	user 0.011s	sys 0.000s
I20260709 12:59:47.558480  4615 raft_consensus.cc:515] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:47.559701  2327 raft_consensus.cc:3055] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:47.560199  2327 raft_consensus.cc:740] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:47.519129  4525 raft_consensus.cc:2749] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:47.509624  4625 raft_consensus.cc:515] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:47.514050  4633 raft_consensus.cc:515] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:47.560496  4615 leader_election.cc:290] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 12:59:47.585738  4654 log.cc:927] Time spent T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.403s	user 0.002s	sys 0.000s
I20260709 12:59:47.586164  4625 leader_election.cc:290] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:47.587909  2297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:47.588279  4633 leader_election.cc:290] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:47.539858  4543 leader_election.cc:290] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:47.541420  4153 raft_consensus.cc:3055] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:47.593330  4153 raft_consensus.cc:740] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:47.594503  4153 consensus_queue.cc:260] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:47.561474  4648 raft_consensus.cc:476] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 LEADER]: Not starting pre-election -- already a leader
I20260709 12:59:47.549028  4626 consensus_queue.cc:260] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:47.561705  4414 raft_consensus.cc:493] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:47.596560  4626 raft_consensus.cc:3060] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:47.596379  4414 raft_consensus.cc:515] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:47.598920  4414 leader_election.cc:290] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:47.562456  4525 raft_consensus.cc:476] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 LEADER]: Not starting pre-election -- already a leader
I20260709 12:59:47.550072  4655 raft_consensus.cc:2749] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:59:47.600011  4514 raft_consensus.cc:3060] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:47.569199  1573 raft_consensus.cc:2468] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 8.
W20260709 12:59:47.573355  4639 log.cc:927] Time spent T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.404s	user 0.002s	sys 0.001s
W20260709 12:59:47.561909  1542 connection.cc:256] RPC call timeout handler was delayed by -1.212742440999989s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33140000000000003s for a response
W20260709 12:59:47.601673  1542 connection.cc:256] RPC call timeout handler was delayed by -1.098544110999967s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1535s for a response
W20260709 12:59:47.601956  1542 connection.cc:256] RPC call timeout handler was delayed by -1.051744111000005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1587s for a response
I20260709 12:59:47.602051  1576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 559) took 1509 ms. Trace:
I20260709 12:59:47.602456  4525 raft_consensus.cc:493] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:47.602933  4525 raft_consensus.cc:515] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:47.552274  4555 leader_election.cc:290] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:47.557889  4623 raft_consensus.cc:3060] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:47.604920  4525 leader_election.cc:290] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:47.602459  1576 rpcz_store.cc:276] 0709 12:59:46.092770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.093037 (+   267us) service_pool.cc:224] Handling call
0709 12:59:46.146668 (+ 53631us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:46.420397 (+273729us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:46.420470 (+    73us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:46.420964 (+   494us) log.cc:844] Serialized 26 byte log entry
0709 12:59:46.736588 (+315624us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:46.736629 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:46.736725 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:47.572597 (+835872us) spinlock_profiling.cc:243] Waited 22.1 ms on lock 0x7b4400022b4c. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef1f4c85 00007fa9ef1f56a2 00007fa9f1f671db 00007fa9f1f62aaf 00007fa9f1f5686e 00007fa9f1f55bb6 00007fa9f1f557d8 00007fa9f1f5f221 00007fa9f1f5f1d9 00007fa9f1f5f169
0709 12:59:47.601782 (+ 29185us) raft_consensus.cc:1685] finished
0709 12:59:47.601803 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:47.601998 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1669,"raft.queue_time_us":44812,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":79613,"spinlock_wait_cycles":50887040,"thread_start_us":547103,"threads_started":2,"wal-append.queue_time_us":616872}
I20260709 12:59:47.550518  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:47.608125  1642 raft_consensus.cc:2393] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 6: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:47.608044  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:47.604514  4370 leader_election.cc:290] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:47.609068  1718 raft_consensus.cc:3060] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:47.535516  4591 leader_election.cc:290] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:47.600446  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45148 (request call id 2070) took 2042 ms. Trace:
I20260709 12:59:47.615576  1646 rpcz_store.cc:276] 0709 12:59:45.558080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:45.751871 (+193791us) service_pool.cc:224] Handling call
0709 12:59:47.600261 (+1848390us) spinlock_profiling.cc:243] Waited 417 ms on lock 0x7b54000992d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:47.600389 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":960007552}
W20260709 12:59:47.608639  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:47.621870  4521 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:47.561269  2327 consensus_queue.cc:260] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:47.644810  4525 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:47.645612  4525 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:47.655088  4643 raft_consensus.cc:3055] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:47.655696  4643 raft_consensus.cc:740] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:47.454352  1644 raft_consensus.cc:2468] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6.
I20260709 12:59:47.006965  1569 rpcz_store.cc:276] 0709 12:59:45.676381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:45.676677 (+   296us) service_pool.cc:224] Handling call
0709 12:59:45.698995 (+ 22318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:45.699239 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:59:46.166268 (+467029us) log.cc:844] Serialized 14 byte log entry
0709 12:59:47.001222 (+834954us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:47.001289 (+    67us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:47.001347 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:47.001425 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:47.001565 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18999,"prepare.queue_time_us":174297,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":57,"raft.queue_time_us":229007,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":32661,"spinlock_wait_cycles":83075968,"thread_start_us":1280992,"threads_started":3,"wal-append.queue_time_us":794667}
W20260709 12:59:47.665565  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:47.660184  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 183470us
I20260709 12:59:47.667847  2327 raft_consensus.cc:3060] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:47.681474  1542 leader_election.cc:336] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.535s (SENT)
I20260709 12:59:47.682126  1542 leader_election.cc:304] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:47.683485  4652 raft_consensus.cc:2749] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:47.689494  4643 consensus_queue.cc:260] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:47.690997  4643 raft_consensus.cc:3060] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:47.691586  1576 raft_consensus.cc:1275] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:59:47.683516  4414 raft_consensus.cc:493] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:47.693475  4414 raft_consensus.cc:515] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:47.693907  4448 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:47.694504  4636 raft_consensus.cc:493] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:47.683668  4648 raft_consensus.cc:493] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:47.695185  4636 raft_consensus.cc:515] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:47.695926  4414 leader_election.cc:290] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:47.695865  4648 raft_consensus.cc:515] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:47.689688  4579 raft_consensus.cc:697] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
W20260709 12:59:47.696667  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 271196us
I20260709 12:59:47.697474  4579 consensus_queue.cc:237] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:47.698038  4648 leader_election.cc:290] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:47.690997  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:47.694410  4448 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:47.702034  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:47.710404  1722 raft_consensus.cc:2468] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 4.
I20260709 12:59:47.703246  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:47.716449  2332 raft_consensus.cc:2468] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6.
I20260709 12:59:47.716543  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:47.708918  1718 raft_consensus.cc:2468] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 6.
W20260709 12:59:47.717792  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:47.709159  1568 raft_consensus.cc:2410] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 12:59:47.715181  1542 leader_election.cc:336] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.797s (SENT)
I20260709 12:59:47.750864  1542 leader_election.cc:304] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:47.595927  4153 raft_consensus.cc:3060] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:47.754760  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:47.754941  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:59:47.751868  1691 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:47.755620  2332 raft_consensus.cc:2410] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:59:47.752802  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 12:59:47.757126  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 337436us
W20260709 12:59:47.758584  1617 leader_election.cc:336] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.617s (SENT)
I20260709 12:59:47.759080  1617 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 12:59:47.760365  2295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:47.761631  2295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:47.751233  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:47.752177  1720 raft_consensus.cc:1275] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:59:47.750511  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:47.764079  1717 raft_consensus.cc:2468] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 5.
I20260709 12:59:47.753073  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:47.771229  2329 raft_consensus.cc:1275] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 12:59:47.773921  1617 leader_election.cc:336] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.683s (SENT)
W20260709 12:59:47.775025  1617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:47.776144  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:47.776206  1617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:47.778509  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:47.779531  1721 raft_consensus.cc:2393] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 6: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:59:47.755970   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260709 12:59:47.783970  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 385784us
W20260709 12:59:47.784911  1617 leader_election.cc:336] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.775s (SENT)
I20260709 12:59:47.714149  4641 raft_consensus.cc:2749] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:59:47.762032  2295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:47.711376  4310 raft_consensus.cc:697] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 5 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
W20260709 12:59:47.794158  2295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:47.798482  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 83335.9us
W20260709 12:59:47.799005  1617 leader_election.cc:336] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.154s (SENT)
W20260709 12:59:47.799425  1542 leader_election.cc:336] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.155s (SENT)
I20260709 12:59:47.799928  1542 leader_election.cc:304] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:47.793368  2329 raft_consensus.cc:3060] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 LEARNER]: Advancing to term 6
I20260709 12:59:47.799425  1617 leader_election.cc:304] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:47.754197  4245 raft_consensus.cc:493] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:47.807403  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:47.808135  1721 raft_consensus.cc:2393] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 6: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:59:47.759912  4588 raft_consensus.cc:2749] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:47.826537  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:47.780414  4370 raft_consensus.cc:493] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:47.829928  1617 leader_election.cc:336] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.223s (SENT)
I20260709 12:59:47.836272  1617 leader_election.cc:304] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 12:59:47.839244  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:47.832504  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:47.841090  2329 raft_consensus.cc:1275] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 LEARNER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:59:47.841384  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:47.833081  4417 raft_consensus.cc:2749] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:47.784049  4543 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:47.830319  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 45169.6us
I20260709 12:59:47.846920  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:47.850859  1723 raft_consensus.cc:2368] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 5. Current term is 6.
I20260709 12:59:47.850567  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:47.851409  1571 raft_consensus.cc:2468] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6.
I20260709 12:59:47.854216  2326 raft_consensus.cc:1240] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:47.854709  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:47.854899  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:47.855273  1725 raft_consensus.cc:2376] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 4. Re-sending same reply.
I20260709 12:59:47.827143  4648 raft_consensus.cc:2749] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:47.862648  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 12:59:47.845346  4634 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.000s	sys 0.014s
W20260709 12:59:47.842238  4609 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.984s	user 0.005s	sys 0.021s
I20260709 12:59:47.871565  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:47.871914  2297 leader_election.cc:304] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 12:59:47.873127  1540 leader_election.cc:304] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:47.871568  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:47.875550  1725 raft_consensus.cc:2368] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 7. Current term is 8.
I20260709 12:59:47.886121  1568 raft_consensus.cc:2393] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 7: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
W20260709 12:59:47.867432  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 378605us
I20260709 12:59:47.860421  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:47.830502  4245 raft_consensus.cc:515] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:47.870265  4634 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.000s	sys 0.014s
I20260709 12:59:47.891527  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:47.894414  1723 raft_consensus.cc:2368] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 5. Current term is 6.
I20260709 12:59:47.895141  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:59:47.902667  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:47.872035  4609 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.124s	user 0.005s	sys 0.021s
I20260709 12:59:47.904038  1539 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:47.904955  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 12:59:47.912053  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 59982.7us
I20260709 12:59:47.848845  4370 raft_consensus.cc:515] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:47.889521  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:47.946533  4636 leader_election.cc:290] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:47.946648  4572 raft_consensus.cc:2749] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:47.947157  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:47.947752  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:47.947943  1718 raft_consensus.cc:2468] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 7.
I20260709 12:59:47.948340  1723 raft_consensus.cc:2468] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 4.
I20260709 12:59:47.949076  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:47.949230  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:47.949786  1718 raft_consensus.cc:2468] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6.
I20260709 12:59:47.866814  4667 raft_consensus.cc:3060] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:47.946676  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:47.951081  1568 raft_consensus.cc:2468] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6.
I20260709 12:59:47.952093  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:47.952638  1568 raft_consensus.cc:2468] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7.
I20260709 12:59:47.887048  4417 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:47.874178  4525 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:47.965135  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 61164us
I20260709 12:59:47.896400  4414 raft_consensus.cc:2804] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:47.895929  4530 raft_consensus.cc:2804] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:47.949852  1723 raft_consensus.cc:2468] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
I20260709 12:59:47.954169  1721 raft_consensus.cc:2376] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6. Re-sending same reply.
I20260709 12:59:47.927606  1724 raft_consensus.cc:2393] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 5: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:59:47.957085  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:47.965109  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 12:59:47.973631  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 60299.9us
I20260709 12:59:47.856402  4543 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:47.968134  1539 leader_election.cc:304] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:48.006821  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:48.008128  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:48.009262  1568 raft_consensus.cc:2410] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 12:59:48.005867  1615 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:47.998946  2325 raft_consensus.cc:2468] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6.
I20260709 12:59:47.906313  4609 raft_consensus.cc:697] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 6 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
W20260709 12:59:48.019873  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.019282  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:48.032150  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:48.032902  1647 raft_consensus.cc:3060] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:48.034474  4634 raft_consensus.cc:493] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:47.979790  4655 raft_consensus.cc:2749] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:48.029887  1724 raft_consensus.cc:2468] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
I20260709 12:59:48.035656  1722 raft_consensus.cc:2468] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
I20260709 12:59:48.036370  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:48.036448  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:47.983292  4414 raft_consensus.cc:493] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:48.049659  1723 raft_consensus.cc:2393] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 7: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:59:48.051735  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:48.018520  4525 raft_consensus.cc:2804] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:48.053726  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:48.054942  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:48.057425  1643 raft_consensus.cc:2410] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 8 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:59:48.060036  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:48.060659  1642 raft_consensus.cc:1240] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:48.063263  1647 raft_consensus.cc:2468] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 8.
I20260709 12:59:48.031862  4530 raft_consensus.cc:697] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
W20260709 12:59:48.071096  1617 leader_election.cc:336] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.894s (SENT)
I20260709 12:59:48.071568  1617 leader_election.cc:304] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:48.076228  2327 raft_consensus.cc:2468] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 5.
W20260709 12:59:48.080560  2327 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53290 (request call id 885) took 1832 ms (client timeout 1516 ms). Trace:
W20260709 12:59:48.081022  2327 rpcz_store.cc:269] 0709 12:59:46.247728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:46.247893 (+   165us) service_pool.cc:224] Handling call
0709 12:59:47.559559 (+1311666us) spinlock_profiling.cc:243] Waited 28.9 ms on lock 0x7b54006c6ea0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f2332dc0 00007fa9f23bee18 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:48.080464 (+520905us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":66381568}
I20260709 12:59:48.087024  4643 raft_consensus.cc:493] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.086616  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:48.088349  1647 raft_consensus.cc:2393] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 7: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:48.087755  4643 raft_consensus.cc:515] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:47.945426  4649 consensus_queue.cc:1048] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.165s
I20260709 12:59:47.926105  4588 consensus_queue.cc:1059] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.170s
I20260709 12:59:48.096876  4588 raft_consensus.cc:3055] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:48.097345  4588 raft_consensus.cc:740] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:48.098340  4588 consensus_queue.cc:260] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:47.906405  4641 consensus_queue.cc:1048] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.194s
I20260709 12:59:48.035126  4634 raft_consensus.cc:515] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:48.125118  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:48.133976  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.151762  4667 raft_consensus.cc:2749] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:47.981271  4417 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:59:48.049268  4414 raft_consensus.cc:3060] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:48.049052  4514 raft_consensus.cc:493] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.018797  4648 consensus_queue.cc:1059] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 12:59:47.978864  4310 consensus_queue.cc:237] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:48.164868  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:59:48.210948  1691 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.157922  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:48.185060  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:59:48.225255  1542 leader_election.cc:336] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.707s (SENT)
I20260709 12:59:48.226735  4643 leader_election.cc:290] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:48.226884  1542 leader_election.cc:304] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:48.227119  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:48.227571  1646 raft_consensus.cc:1240] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:48.228816  4514 raft_consensus.cc:515] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:48.229573  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:59:48.230774  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.231197  4649 raft_consensus.cc:2749] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:48.170945  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:48.237123  1643 raft_consensus.cc:3060] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:59:48.213999  2332 raft_consensus.cc:2468] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
I20260709 12:59:48.230726  1720 raft_consensus.cc:2410] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:59:48.171657  2295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.240350  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:48.241577  1724 raft_consensus.cc:2410] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:59:48.242252  1725 raft_consensus.cc:2468] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 7.
I20260709 12:59:48.226187  4588 raft_consensus.cc:3060] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:48.053241  4245 leader_election.cc:290] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:48.163550  1718 raft_consensus.cc:2376] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6. Re-sending same reply.
W20260709 12:59:48.209717  4657 log.cc:927] Time spent T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.380s	user 0.000s	sys 0.001s
I20260709 12:59:48.238287  2297 leader_election.cc:304] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 12:59:48.056222  4525 raft_consensus.cc:493] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:48.157074  4616 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
W20260709 12:59:48.195952  4647 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.017s	sys 0.004s
W20260709 12:59:48.255785  4647 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.891s	user 0.021s	sys 0.004s
W20260709 12:59:48.255587  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 184503us
I20260709 12:59:48.256799  4514 leader_election.cc:290] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:48.257694  4525 raft_consensus.cc:3060] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:48.258020  1617 leader_election.cc:336] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.657s (SENT)
I20260709 12:59:48.228322  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:48.251286  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:59:48.190893  4664 log.cc:927] Time spent T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.331s	user 0.000s	sys 0.001s
W20260709 12:59:48.246299  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.250624  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:48.193917  4665 raft_consensus.cc:493] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.159682  4572 consensus_queue.cc:1048] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.166s
I20260709 12:59:48.195793  4670 consensus_queue.cc:1059] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.286s
I20260709 12:59:48.198145  4609 consensus_queue.cc:237] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:48.302376  2295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.315564  1643 raft_consensus.cc:2468] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 6.
I20260709 12:59:48.324910  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:59:48.419698  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:48.380275  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 325771us
I20260709 12:59:48.427857  1725 raft_consensus.cc:2410] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
W20260709 12:59:48.423067  1574 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.015s	sys 0.010s
I20260709 12:59:48.335345  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:59:48.429827  1574 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.016s	sys 0.010s
W20260709 12:59:48.301338  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 63112.4us
I20260709 12:59:48.430816  1724 raft_consensus.cc:2393] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 8: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
W20260709 12:59:48.426579  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:48.259570  1617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.155861  4350 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.428109  1718 raft_consensus.cc:2393] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 6: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
W20260709 12:59:48.432482  1617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.236840  4623 raft_consensus.cc:493] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.165153  4448 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 12:59:48.436807  1617 leader_election.cc:336] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.164s (SENT)
I20260709 12:59:48.442924  1540 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 12:59:48.388244  4674 log.cc:927] Time spent T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.191s	user 0.002s	sys 0.000s
W20260709 12:59:48.444892  2295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:48.261075  4671 log.cc:927] Time spent T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:59:48.249555  4650 raft_consensus.cc:2764] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:59:48.186820  4410 raft_consensus.cc:493] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:48.260458  4673 log.cc:927] Time spent T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:59:48.317958  4626 raft_consensus.cc:2804] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:48.429720  1615 leader_election.cc:304] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:48.455667  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 12:59:48.447773  1617 leader_election.cc:336] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.811s (SENT)
I20260709 12:59:48.457223  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:48.457995  1648 raft_consensus.cc:2468] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 4.
I20260709 12:59:48.252228  4636 consensus_queue.cc:1048] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.195s
I20260709 12:59:48.334275  4543 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:48.360191  4370 leader_election.cc:290] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:48.452013  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:48.475837  1723 raft_consensus.cc:2468] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6.
I20260709 12:59:48.452907  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:48.458546  1615 leader_election.cc:304] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:48.476804  1724 raft_consensus.cc:2468] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 4.
I20260709 12:59:48.477419  1615 leader_election.cc:304] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:48.478377  1615 leader_election.cc:304] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:48.437371  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:48.237264  4530 consensus_queue.cc:237] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:48.446434  4514 raft_consensus.cc:2804] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:48.444011  4649 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:48.453896  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:48.453450  4410 raft_consensus.cc:515] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:48.262023  4634 leader_election.cc:290] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:48.463831  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:48.482295  1720 raft_consensus.cc:2393] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 7: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:59:48.449759  4417 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:59:48.496043  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.497979  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:48.461426  4626 raft_consensus.cc:493] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:48.554666  4626 raft_consensus.cc:3060] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:48.555950  4685 log.cc:927] Time spent T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:59:48.499109  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:48.557173  4122 raft_consensus.cc:493] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.553321  4667 raft_consensus.cc:2764] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:59:48.557731  4122 raft_consensus.cc:515] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:48.464915  4691 raft_consensus.cc:2804] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:48.559214  4691 raft_consensus.cc:697] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 5 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:48.560290  4691 consensus_queue.cc:237] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:48.561100  4670 raft_consensus.cc:493] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.561641  4670 raft_consensus.cc:515] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:48.485941  4543 raft_consensus.cc:2804] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:48.564198  4543 raft_consensus.cc:493] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:48.564706  4543 raft_consensus.cc:3060] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:48.566550  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:48.567889  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:48.568032  4647 consensus_queue.cc:1059] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:48.568651  1723 raft_consensus.cc:2393] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 7: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:59:48.569301  4647 consensus_queue.cc:1048] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:48.569590  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:48.570267  1723 raft_consensus.cc:2468] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
I20260709 12:59:48.571082  4647 raft_consensus.cc:3055] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:48.571242  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:59:48.571590  4675 log.cc:927] Time spent T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.366s	user 0.001s	sys 0.001s
I20260709 12:59:48.571863  1650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 1481) took 1348 ms. Trace:
I20260709 12:59:48.443861  4350 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:48.564061  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:48.573486  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:48.574086  4350 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:48.579325  1651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 1479) took 1356 ms. Trace:
I20260709 12:59:48.579741  1651 rpcz_store.cc:276] 0709 12:59:47.222546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.222680 (+   134us) service_pool.cc:224] Handling call
0709 12:59:47.223067 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:47.255506 (+ 32439us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:47.255537 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:47.273792 (+ 18255us) log.cc:844] Serialized 26 byte log entry
0709 12:59:47.476919 (+203127us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:59:47.476962 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:47.477030 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:48.579124 (+1102094us) raft_consensus.cc:1685] finished
0709 12:59:48.579144 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:48.579269 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":273337,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":8641,"thread_start_us":107900,"threads_started":1,"wal-append.queue_time_us":430365}
I20260709 12:59:48.581651  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:48.582206  4667 consensus_queue.cc:1048] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:48.582933  1651 raft_consensus.cc:1240] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:48.583330  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:48.584826  4410 leader_election.cc:290] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:48.586745  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:48.571565  4647 raft_consensus.cc:740] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:48.587872  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:48.588056  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:48.445837  4623 raft_consensus.cc:515] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:48.434686  4665 raft_consensus.cc:515] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:48.572280  1650 rpcz_store.cc:276] 0709 12:59:47.223168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.329309 (+106141us) service_pool.cc:224] Handling call
0709 12:59:47.329771 (+   462us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:47.330196 (+   425us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:47.330236 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:47.455884 (+125648us) log.cc:844] Serialized 26 byte log entry
0709 12:59:47.973036 (+517152us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:47.973074 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:47.973193 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:48.571655 (+598462us) raft_consensus.cc:1685] finished
0709 12:59:48.571678 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:48.571805 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":194653,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":90,"spinlock_wait_cycles":4352,"thread_start_us":462771,"threads_started":1,"wal-append.queue_time_us":682653}
W20260709 12:59:48.603336  1691 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.590776  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:59:48.589896  1542 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 3.032s (SENT) [suppressed 70 similar messages]
I20260709 12:59:48.607812  1576 raft_consensus.cc:1275] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:59:48.571921  1723 raft_consensus.cc:2468] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 4.
I20260709 12:59:48.607262  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:48.592237  1718 raft_consensus.cc:2393] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 7: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:48.596870  1724 raft_consensus.cc:2393] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 6: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:59:48.608251  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:48.624028  1719 raft_consensus.cc:2410] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:59:48.599453  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:48.626816  1650 raft_consensus.cc:1240] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 5. Current term is 6. Ops: [4.6-5.7]
I20260709 12:59:48.630767  2324 raft_consensus.cc:2410] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:59:48.594139  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:48.588464  1722 raft_consensus.cc:2468] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 7.
I20260709 12:59:48.560192  4122 leader_election.cc:290] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:59:48.625530  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 126733us
W20260709 12:59:48.592659  4688 log.cc:927] Time spent T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
W20260709 12:59:48.591674  4682 log.cc:927] Time spent T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 12:59:48.606447  4588 raft_consensus.cc:493] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.681246  4665 leader_election.cc:290] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:48.681470  4588 raft_consensus.cc:515] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:48.683940  4588 leader_election.cc:290] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:48.634135  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:48.684616  1648 raft_consensus.cc:2376] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 7. Re-sending same reply.
I20260709 12:59:48.685987  1648 raft_consensus.cc:1275] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:59:48.687148  1648 raft_consensus.cc:1275] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:59:48.636196  1644 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.014s	sys 0.041s
W20260709 12:59:48.688267  1644 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.015s	sys 0.041s
I20260709 12:59:48.475186  4619 consensus_queue.cc:1048] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.163s
I20260709 12:59:48.627656  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:48.690029  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:48.690778  1718 raft_consensus.cc:2393] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 8: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:59:48.690969  4623 leader_election.cc:290] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:48.691542  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:48.692176  1718 raft_consensus.cc:2468] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
I20260709 12:59:48.693117  4676 raft_consensus.cc:2749] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:48.588128  4647 consensus_queue.cc:260] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:48.697376  4647 raft_consensus.cc:3060] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:48.628566  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:48.662362  1649 raft_consensus.cc:2376] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 7. Re-sending same reply.
W20260709 12:59:48.632061  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.701076  1724 raft_consensus.cc:2410] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:59:48.701270  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.664043  1651 raft_consensus.cc:1275] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:59:48.496570  4514 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:48.702016  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:48.702443  4514 raft_consensus.cc:3060] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:48.702800  1724 raft_consensus.cc:2393] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 7: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:48.703629  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:48.668546  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:48.631752  1650 raft_consensus.cc:1240] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:48.627934  4525 raft_consensus.cc:515] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:48.669680  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:48.668418  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:48.634236  4370 raft_consensus.cc:2804] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:48.673149  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:48.580382  4626 raft_consensus.cc:515] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:48.644054  4442 consensus_queue.cc:1048] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 12:59:48.589094  4414 raft_consensus.cc:515] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:48.676824  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:48.716967  2330 raft_consensus.cc:2368] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 5. Current term is 6.
I20260709 12:59:48.676952  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:48.677204  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:48.719312  1573 raft_consensus.cc:2368] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 6. Current term is 7.
I20260709 12:59:48.677587  4571 consensus_queue.cc:1059] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:48.677765  4634 consensus_queue.cc:1048] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:48.678774  4670 leader_election.cc:290] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:48.633392  4649 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:48.671629  1615 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:48.704473  1724 raft_consensus.cc:2410] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:59:48.704852  1722 raft_consensus.cc:2468] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 7.
I20260709 12:59:48.704862  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 568) took 1003 ms. Trace:
I20260709 12:59:48.727016  1570 rpcz_store.cc:276] 0709 12:59:47.701000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.701438 (+   438us) service_pool.cc:224] Handling call
0709 12:59:47.753888 (+ 52450us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:47.754167 (+   279us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:47.754210 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:47.823435 (+ 69225us) log.cc:844] Serialized 26 byte log entry
0709 12:59:48.174075 (+350640us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:59:48.463148 (+289073us) log.cc:844] Serialized 14 byte log entry
0709 12:59:48.464052 (+   904us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:48.464128 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:48.704633 (+240505us) raft_consensus.cc:1685] finished
0709 12:59:48.704661 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:48.704803 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5418,"prepare.queue_time_us":87160,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":3813,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":33263,"thread_start_us":587830,"threads_started":2,"wal-append.queue_time_us":596289}
I20260709 12:59:48.705806  1569 raft_consensus.cc:2368] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 5. Current term is 6.
I20260709 12:59:48.730445  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:48.706700  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:48.707055  1576 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:48.709061  2295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.720700  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:48.733743  1567 raft_consensus.cc:2393] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 5: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
W20260709 12:59:48.733829  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 62281.3us
I20260709 12:59:48.734684  1615 leader_election.cc:304] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:48.739817  1718 raft_consensus.cc:1275] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:59:48.741705  1724 raft_consensus.cc:1275] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:48.741783  1722 raft_consensus.cc:1275] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:59:48.747128  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:48.706645  4370 raft_consensus.cc:493] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:48.733404  4642 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.372s	user 0.001s	sys 0.025s
I20260709 12:59:48.750358  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:48.750614  1724 raft_consensus.cc:1275] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:59:48.706817  4525 leader_election.cc:290] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:48.759693  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:48.760231  1573 raft_consensus.cc:2468] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 6.
I20260709 12:59:48.753961  1719 raft_consensus.cc:1275] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:59:48.764393  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:48.765374  1567 raft_consensus.cc:2468] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 8.
I20260709 12:59:48.760455  1569 raft_consensus.cc:2393] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 6: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
W20260709 12:59:48.784467  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 51139.6us
I20260709 12:59:48.785060  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:48.785709  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:48.789357  4122 consensus_queue.cc:1048] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:48.791014  2324 raft_consensus.cc:1240] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
W20260709 12:59:48.704854  4652 consensus_queue.cc:1175] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" responder_term: 5 status { last_received { term: 5 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 5 index: 4 } }
I20260709 12:59:48.793169  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:48.793206  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:48.794410  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:48.795064  1568 raft_consensus.cc:2393] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 6: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:48.795732  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:48.796936  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:48.796878  4543 raft_consensus.cc:515] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:48.797622  2331 raft_consensus.cc:2376] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 5. Re-sending same reply.
I20260709 12:59:48.798511  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:48.798696  2326 raft_consensus.cc:2468] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 3.
I20260709 12:59:48.798975  4543 leader_election.cc:290] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:48.799646  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:48.799865  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:48.788887  4619 consensus_queue.cc:1059] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 12:59:48.800607  1568 raft_consensus.cc:2410] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 8 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:59:48.801113  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:48.801832  1568 raft_consensus.cc:1240] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:59:48.802234  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:48.803073  1568 raft_consensus.cc:1240] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:48.803313  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:48.800336  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:48.804797  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:48.805244  1569 raft_consensus.cc:2393] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 5: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:48.805770  4623 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.806392  1569 raft_consensus.cc:1275] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:59:48.806308  4623 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:59:48.808404  4623 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:48.809183  1567 raft_consensus.cc:1240] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:48.809365  2324 raft_consensus.cc:2468] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6.
W20260709 12:59:48.809581  1689 connection.cc:256] RPC call timeout handler was delayed by -5.2201544029999809s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1754s for a response
W20260709 12:59:48.811295  1689 connection.cc:256] RPC call timeout handler was delayed by -5.12025440299999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1865s for a response
W20260709 12:59:48.811606  1689 connection.cc:256] RPC call timeout handler was delayed by -5.0626544029999536s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19290000000000002s for a response
W20260709 12:59:48.811884  1689 connection.cc:256] RPC call timeout handler was delayed by -5.0302544029999581s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1965s for a response
W20260709 12:59:48.812145  1689 connection.cc:256] RPC call timeout handler was delayed by -5.0059544029999756s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19920000000000002s for a response
W20260709 12:59:48.812417  1689 connection.cc:256] RPC call timeout handler was delayed by -4.998754402999964s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2s for a response
W20260709 12:59:48.812708  1689 connection.cc:256] RPC call timeout handler was delayed by -4.92585440299996s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2081s for a response
W20260709 12:59:48.812968  1689 connection.cc:256] RPC call timeout handler was delayed by -4.8241544029999659s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2194s for a response
W20260709 12:59:48.813231  1689 connection.cc:256] RPC call timeout handler was delayed by -4.0249544029999811s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30820000000000003s for a response
W20260709 12:59:48.813535  1689 connection.cc:256] RPC call timeout handler was delayed by -4.0159544029999665s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30920000000000003s for a response
W20260709 12:59:48.813812  1689 connection.cc:256] RPC call timeout handler was delayed by -3.9457544029999667s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.317s for a response
W20260709 12:59:48.814086  1689 connection.cc:256] RPC call timeout handler was delayed by -3.5713544029999866s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.35860000000000003s for a response
I20260709 12:59:48.815619  1689 leader_election.cc:304] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:48.816769  4525 raft_consensus.cc:493] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:48.817447  4525 raft_consensus.cc:515] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:48.820120  4525 leader_election.cc:290] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:48.747978  4636 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.747754  4665 raft_consensus.cc:2749] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:48.761653  4370 raft_consensus.cc:3060] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:48.759313  4642 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.398s	user 0.002s	sys 0.025s
I20260709 12:59:48.706323  4417 consensus_queue.cc:1048] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:59:48.751055  4670 raft_consensus.cc:493] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.850112  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 12:59:48.891971  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 76407.8us
I20260709 12:59:48.897176  1573 raft_consensus.cc:2468] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 7.
I20260709 12:59:48.830718  1576 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 8.
I20260709 12:59:48.852509  1574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 1930) took 1175 ms. Trace:
I20260709 12:59:48.890587  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:48.825136  4667 consensus_queue.cc:1048] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 12:59:48.837551  4691 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:48.800266  4514 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:48.840636  4623 raft_consensus.cc:2749] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:48.898329  1574 rpcz_store.cc:276] 0709 12:59:47.677101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.699849 (+ 22748us) service_pool.cc:224] Handling call
0709 12:59:47.750559 (+ 50710us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:47.750773 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:59:48.435359 (+684586us) log.cc:844] Serialized 14 byte log entry
0709 12:59:48.851916 (+416557us) log.cc:844] Serialized 14 byte log entry
0709 12:59:48.852074 (+   158us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:48.852130 (+    56us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:48.852186 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:48.852274 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:48.852426 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2660,"prepare.queue_time_us":498879,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":87,"thread_start_us":1073574,"threads_started":2}
I20260709 12:59:48.901746  1689 leader_election.cc:304] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:48.906571  4414 leader_election.cc:290] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:48.916600  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 176827us
I20260709 12:59:48.899880  4626 leader_election.cc:290] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:48.893810  4636 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:48.901257  4670 raft_consensus.cc:515] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:48.926106  4609 raft_consensus.cc:2749] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:59:48.942655  2295 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:48.949961  2326 raft_consensus.cc:2468] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7.
I20260709 12:59:48.918224  4691 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:48.951026  4362 raft_consensus.cc:2804] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:48.966320  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 12:59:48.964268  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 215391us
W20260709 12:59:48.969128  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 209024us
I20260709 12:59:48.980847  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:48.985415  1570 raft_consensus.cc:2393] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 7: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:48.970412  4362 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:48.984426  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:48.996047  1574 raft_consensus.cc:3060] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:48.989676  4636 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 12:59:48.990449  2295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:48.991983  4514 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:48.993527  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:49.014005  1689 leader_election.cc:400] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373) with higher term. Message: Invalid argument: T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 6. Current term is 7.
I20260709 12:59:49.014122  1572 raft_consensus.cc:2468] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 7.
I20260709 12:59:48.998381  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:49.006661  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:49.015386  1650 raft_consensus.cc:2393] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 5: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:49.015547  1651 raft_consensus.cc:2393] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 6: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:49.017076  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:49.017370  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:49.017876  1642 raft_consensus.cc:2393] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 8: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:59:49.018064  1651 raft_consensus.cc:2393] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 5: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:59:49.018663  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:49.019027  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:49.020182  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:49.020694  1651 raft_consensus.cc:2468] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
I20260709 12:59:49.021970  1651 raft_consensus.cc:1275] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:59:49.022040  4691 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:49.025748  1688 leader_election.cc:304] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:49.028716  4609 raft_consensus.cc:2804] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:49.029217  4609 raft_consensus.cc:697] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 8 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
W20260709 12:59:49.031891  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 80041.3us
W20260709 12:59:49.032891  2294 leader_election.cc:336] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Timed out: RequestConsensusVote RPC to 127.0.107.194:37391 timed out after 1.592s (SENT)
I20260709 12:59:49.034348  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:49.035154  1650 raft_consensus.cc:2393] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 7: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:49.031901  1642 raft_consensus.cc:2376] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6. Re-sending same reply.
I20260709 12:59:48.995445  4649 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:49.036633  4702 log.cc:927] Time spent T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:59:49.007174  4362 raft_consensus.cc:3060] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:49.040439  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 45401.7us
I20260709 12:59:49.030126  4609 consensus_queue.cc:237] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:49.041821  1689 leader_election.cc:304] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:59:49.042713  4310 raft_consensus.cc:2804] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:49.042972  1689 leader_election.cc:304] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:59:49.043139  4310 raft_consensus.cc:493] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:49.043577  4310 raft_consensus.cc:3060] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:49.043821  4623 raft_consensus.cc:2804] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:49.044245  4623 raft_consensus.cc:493] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:49.044646  4623 raft_consensus.cc:3060] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:49.045327  4518 raft_consensus.cc:3055] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:49.045733  4518 raft_consensus.cc:740] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:49.046550  4518 consensus_queue.cc:260] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:49.041975  2295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:49.049373  1689 leader_election.cc:304] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:49.050899  1689 leader_election.cc:304] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:49.051481  2332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32870 (request call id 297) took 1249 ms. Trace:
I20260709 12:59:49.051844  2332 rpcz_store.cc:276] 0709 12:59:47.802419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.826290 (+ 23871us) service_pool.cc:224] Handling call
0709 12:59:49.051319 (+1225029us) spinlock_profiling.cc:243] Waited 385 ms on lock 0x7b5400494b54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:49.051424 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":885128576}
I20260709 12:59:49.053524  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:49.054188  4370 raft_consensus.cc:515] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:49.054548  4650 raft_consensus.cc:2804] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:49.054958  4650 raft_consensus.cc:493] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:49.055328  4650 raft_consensus.cc:3060] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:49.057899  1574 raft_consensus.cc:2468] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 8.
I20260709 12:59:49.062736  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:49.063617  1651 raft_consensus.cc:2410] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 8 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:59:49.064858  1539 leader_election.cc:304] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 12:59:49.034533  4703 log.cc:927] Time spent T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:59:49.066704  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:49.065146  2294 leader_election.cc:304] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:49.047673  4518 raft_consensus.cc:3060] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:49.070554  2297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:49.056375  4370 leader_election.cc:290] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:49.077839  4708 consensus_queue.cc:1048] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:59:49.080416  4525 raft_consensus.cc:2804] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:49.082947  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45148 (request call id 2079) took 1052 ms. Trace:
I20260709 12:59:49.083619  4670 leader_election.cc:290] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:49.083411  1646 rpcz_store.cc:276] 0709 12:59:48.030330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:48.041177 (+ 10847us) service_pool.cc:224] Handling call
0709 12:59:48.059482 (+ 18305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:48.227968 (+168486us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:49.082713 (+854745us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b5400174dd4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:49.082888 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":386120448}
I20260709 12:59:49.084558  4670 raft_consensus.cc:2749] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:49.085371  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:49.086139  1643 raft_consensus.cc:2393] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 6: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:49.085861  4362 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:49.087069  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:49.087598  1643 raft_consensus.cc:2468] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8.
I20260709 12:59:49.088891  4690 raft_consensus.cc:493] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.089401  4690 raft_consensus.cc:515] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:49.089768  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:49.091506  4690 leader_election.cc:290] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:49.092422  1643 raft_consensus.cc:2393] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 7: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:49.095965  1539 leader_election.cc:304] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:49.093509  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:49.096954  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:49.102329  1650 raft_consensus.cc:2393] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 6: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:49.106986  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:49.107595  2323 raft_consensus.cc:2376] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 5. Re-sending same reply.
W20260709 12:59:49.109129  1716 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1370) took 1357 ms (client timeout 1508 ms). Trace:
W20260709 12:59:49.109543  1716 rpcz_store.cc:269] 0709 12:59:47.752096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.752520 (+   424us) service_pool.cc:224] Handling call
0709 12:59:49.108953 (+1356433us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54002ab2d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:49.109072 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2624292096}
I20260709 12:59:49.110010  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:49.111658  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:49.113579  1615 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:49.115303  1615 leader_election.cc:304] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:49.080992  4525 raft_consensus.cc:493] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:49.119587  4525 raft_consensus.cc:3060] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:49.104068  4362 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:49.081010  4310 raft_consensus.cc:515] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:49.122442  4668 log.cc:927] Time spent T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.927s	user 0.005s	sys 0.001s
I20260709 12:59:49.122638  4310 leader_election.cc:290] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:49.117164  1615 leader_election.cc:304] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:49.123589  4690 raft_consensus.cc:2804] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:49.123878  1575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 560) took 1756 ms. Trace:
I20260709 12:59:49.124306  1615 leader_election.cc:304] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:49.124366  1575 rpcz_store.cc:276] 0709 12:59:47.367884 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.394974 (+ 27090us) service_pool.cc:224] Handling call
0709 12:59:47.395338 (+   364us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:47.423754 (+ 28416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:47.423786 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:47.446027 (+ 22241us) log.cc:844] Serialized 26 byte log entry
0709 12:59:47.977613 (+531586us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:47.977661 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:47.977729 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:49.121840 (+1144111us) spinlock_profiling.cc:243] Waited 23.1 ms on lock 0x7b4400022b4c. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef1f4c85 00007fa9ef1f56a2 00007fa9f1f671db 00007fa9f1f62aaf 00007fa9f1f5686e 00007fa9f1f55bb6 00007fa9f1f557d8 00007fa9f1f5f221 00007fa9f1f5f1d9 00007fa9f1f5f169
0709 12:59:49.123537 (+  1697us) raft_consensus.cc:1685] finished
0709 12:59:49.123557 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:49.123819 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7648,"raft.queue_time_us":380,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":31338,"spinlock_wait_cycles":53168512,"thread_start_us":453495,"threads_started":1,"wal-append.queue_time_us":722853}
I20260709 12:59:49.124476  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:49.126751  1644 raft_consensus.cc:2468] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 7.
I20260709 12:59:49.125576  1615 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:49.128383  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:49.128937  1569 raft_consensus.cc:3060] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:49.100435  4635 raft_consensus.cc:2749] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:59:49.136415  1542 leader_election.cc:336] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.587s (SENT)
I20260709 12:59:49.146277  1542 leader_election.cc:304] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:49.101550  4649 raft_consensus.cc:2804] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:49.128821  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
W20260709 12:59:49.147527  1542 leader_election.cc:336] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.590s (SENT)
I20260709 12:59:49.150169  1650 raft_consensus.cc:3060] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Advancing to term 6
W20260709 12:59:49.145925  1617 leader_election.cc:336] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.732s (SENT)
I20260709 12:59:49.054986  4623 raft_consensus.cc:515] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:49.103015  4707 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.149390  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
W20260709 12:59:49.152447  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 101609us
I20260709 12:59:49.153091  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:59:49.151906  1615 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:49.154135  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:49.154611  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:49.155216  1644 raft_consensus.cc:2376] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 6. Re-sending same reply.
I20260709 12:59:49.118930  4619 raft_consensus.cc:2764] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:59:49.125118  4676 raft_consensus.cc:2749] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:49.103646  4448 consensus_queue.cc:1048] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:59:49.152441  4655 raft_consensus.cc:2804] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:49.158238  4707 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:49.149931  4649 raft_consensus.cc:493] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:49.103475  4624 consensus_queue.cc:1048] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:59:49.164710  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:49.176141  4525 raft_consensus.cc:515] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:49.201524  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:49.202091  1644 raft_consensus.cc:2468] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 9.
I20260709 12:59:49.203112  1644 raft_consensus.cc:1240] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:59:49.203401  4525 leader_election.cc:290] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:49.169003  4370 raft_consensus.cc:2804] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:49.204800  4370 raft_consensus.cc:697] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 5 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:49.205699  4370 consensus_queue.cc:237] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:49.209134  1571 raft_consensus.cc:1240] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:59:49.146083  4690 raft_consensus.cc:697] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 6 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:49.150846  4709 raft_consensus.cc:2749] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:49.175738  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:49.177671  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:49.230788  1720 raft_consensus.cc:2410] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:59:49.155944  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:49.192554  1650 raft_consensus.cc:2468] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 6.
I20260709 12:59:49.196892  4655 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:49.198022  1569 raft_consensus.cc:2468] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 9.
W20260709 12:59:49.198108  1542 leader_election.cc:336] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.656s (SENT)
I20260709 12:59:49.234684  1542 leader_election.cc:304] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:49.198624  1689 leader_election.cc:304] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
W20260709 12:59:49.219596  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:49.210006  4649 raft_consensus.cc:3060] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:49.115212  4350 consensus_queue.cc:1048] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:59:49.232398  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:49.239964  1650 raft_consensus.cc:3060] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:49.247300  1650 raft_consensus.cc:2468] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6.
W20260709 12:59:49.249114  1721 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1376) took 1419 ms (client timeout 1683 ms). Trace:
W20260709 12:59:49.249555  1721 rpcz_store.cc:269] 0709 12:59:47.829999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.830229 (+   230us) service_pool.cc:224] Handling call
0709 12:59:49.248923 (+1418694us) spinlock_profiling.cc:243] Waited 98.8 ms on lock 0x7b54000e2254. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:49.249046 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":227145984}
W20260709 12:59:49.253130  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 54590.5us
I20260709 12:59:49.236455  4655 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:49.231753  4648 consensus_queue.cc:1059] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 12:59:49.237138  4525 raft_consensus.cc:2749] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:49.250524  4410 raft_consensus.cc:2749] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:49.259315  1569 raft_consensus.cc:1275] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:59:49.254287  4518 raft_consensus.cc:2804] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:49.268947  4609 raft_consensus.cc:493] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.269526  4609 raft_consensus.cc:515] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:49.277249  4690 consensus_queue.cc:237] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:49.282156  1689 leader_election.cc:304] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:49.287631  2295 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:49.302867  1689 leader_election.cc:400] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 election: Vote denied by peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373) with higher term. Message: Invalid argument: T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 6. Current term is 7.
I20260709 12:59:49.295279  4706 consensus_queue.cc:1048] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 12:59:49.306324  4670 raft_consensus.cc:2749] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:49.307271  4670 consensus_queue.cc:1059] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:49.308151  4670 raft_consensus.cc:3055] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:49.309315  4707 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 12:59:49.308983  1617 leader_election.cc:336] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.049s (SENT)
I20260709 12:59:49.308224  1645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 473) took 1257 ms. Trace:
I20260709 12:59:49.309401  4670 raft_consensus.cc:740] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:49.311158  4670 consensus_queue.cc:260] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:49.312479  4670 raft_consensus.cc:3060] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:49.310338  1645 rpcz_store.cc:276] 0709 12:59:48.050720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:48.050911 (+   191us) service_pool.cc:224] Handling call
0709 12:59:48.051207 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:48.054202 (+  2995us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:48.054229 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:48.059717 (+  5488us) log.cc:844] Serialized 26 byte log entry
0709 12:59:49.172873 (+1113156us) spinlock_profiling.cc:243] Waited 6.12 ms on lock 0x7b1800376660. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef2b0e07 00007fa9f810bab9 00007fa9ef2cd69b 00007fa9ef2cb93f 00007fa9ef2cdc02 00007fa9f1f5520b 00007fa9f1f5ad23 00007fa9f1f5b0d1 00007fa9f2376a0f
0709 12:59:49.248841 (+ 75968us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:49.248887 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:49.248967 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:49.307959 (+ 58992us) raft_consensus.cc:1685] finished
0709 12:59:49.307976 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:49.308169 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2661,"raft.queue_time_us":7812,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":86589,"spinlock_wait_cycles":14071680,"thread_start_us":66430,"threads_started":1,"wal-append.queue_time_us":1149320}
I20260709 12:59:49.304719  1688 leader_election.cc:304] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:49.305840  2294 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:49.318923  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:49.319790  1646 raft_consensus.cc:2410] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 7 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:59:49.281257  4518 raft_consensus.cc:493] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:49.329088  2294 leader_election.cc:304] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:49.303864  1689 leader_election.cc:400] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373) with higher term. Message: Invalid argument: T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 5. Current term is 6.
I20260709 12:59:49.333808  1689 leader_election.cc:403] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:49.328442  2295 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:49.308331  4623 leader_election.cc:290] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:49.266147  4650 raft_consensus.cc:515] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:49.392261  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:49.358641  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:49.393231  1540 leader_election.cc:304] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:49.404417  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 12:59:49.326351  4720 log.cc:927] Time spent T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:59:49.321077  4717 raft_consensus.cc:2804] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:49.394449  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:49.391811  4648 raft_consensus.cc:493] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:49.443624  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 115275us
W20260709 12:59:49.418159  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 89164.7us
I20260709 12:59:49.446887  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:49.418967  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:49.420109  2330 raft_consensus.cc:2393] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 6: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:49.447772  1573 raft_consensus.cc:2468] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7.
I20260709 12:59:49.332877  4518 raft_consensus.cc:3060] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:49.327049  4706 raft_consensus.cc:2804] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:49.452878  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:49.453682  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:49.336275  4635 raft_consensus.cc:2804] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:59:49.472834  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 169088us
I20260709 12:59:49.409364  4588 raft_consensus.cc:2804] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:49.479334  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:49.480580  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:49.394955  4310 raft_consensus.cc:2749] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373) with higher term. Message: Invalid argument: T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 5. Current term is 6.
I20260709 12:59:49.483834  1689 leader_election.cc:304] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:49.443403  4717 raft_consensus.cc:493] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:49.489336  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:49.488569  4588 raft_consensus.cc:493] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:49.528466  1576 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6.
I20260709 12:59:49.489831  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:49.532159  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:49.477219  4609 leader_election.cc:290] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:49.472470  4530 raft_consensus.cc:2804] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:49.533071  4655 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:49.507612  1689 leader_election.cc:304] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:49.541145  1572 raft_consensus.cc:2393] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 6: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:49.543412  1574 raft_consensus.cc:2376] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7. Re-sending same reply.
I20260709 12:59:49.530139  4623 raft_consensus.cc:3060] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:49.509917  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
W20260709 12:59:49.555344  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 47808.6us
W20260709 12:59:49.545945  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 99440.9us
I20260709 12:59:49.473495  4448 raft_consensus.cc:2804] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:49.476754  4706 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:49.561511  4706 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:49.566546  4678 log.cc:927] Time spent T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 1.370s	user 0.000s	sys 0.007s
I20260709 12:59:49.568377  2330 raft_consensus.cc:2468] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6.
I20260709 12:59:49.568631  4530 raft_consensus.cc:697] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:49.569772  4530 consensus_queue.cc:237] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:49.573289  1647 raft_consensus.cc:2393] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 8: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:49.574100  4655 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:49.572116  1689 leader_election.cc:304] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:49.577018  4609 raft_consensus.cc:2749] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:59:49.545879  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 164572us
I20260709 12:59:49.557057  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 12:59:49.555857  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 110136us
I20260709 12:59:49.577852  1573 raft_consensus.cc:2468] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7.
I20260709 12:59:49.473026  4648 raft_consensus.cc:515] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:49.472790  4601 consensus_queue.cc:1048] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 12:59:49.575196  1643 raft_consensus.cc:1275] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:59:49.579377  1617 leader_election.cc:336] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.158s (SENT)
I20260709 12:59:49.591121  1617 leader_election.cc:304] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:49.481999  4635 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:49.537467  4717 raft_consensus.cc:3060] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:49.556056  1651 raft_consensus.cc:1240] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:49.545105  4588 raft_consensus.cc:3060] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:49.596017  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:49.596640  1573 raft_consensus.cc:2376] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 8. Re-sending same reply.
I20260709 12:59:49.578472  4609 raft_consensus.cc:2804] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:49.600561  1648 raft_consensus.cc:1275] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:59:49.598646  1617 leader_election.cc:336] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.516s (SENT)
W20260709 12:59:49.601341  1649 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57912 (request call id 474) took 1550 ms (client timeout 1592 ms). Trace:
W20260709 12:59:49.601899  1649 rpcz_store.cc:269] 0709 12:59:48.051072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:48.051471 (+   399us) service_pool.cc:224] Handling call
0709 12:59:49.600104 (+1548633us) spinlock_profiling.cc:243] Waited 610 ms on lock 0x7b54003ce954. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:49.601198 (+  1094us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1402886912}
I20260709 12:59:49.578413  4655 raft_consensus.cc:493] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:49.607388  4649 raft_consensus.cc:515] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:49.615149  4543 raft_consensus.cc:3055] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:49.615679  4543 raft_consensus.cc:740] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:49.616922  4543 consensus_queue.cc:260] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:49.618513  4641 raft_consensus.cc:3055] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:49.599150  4635 raft_consensus.cc:3060] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:49.626533  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:49.627163  1574 raft_consensus.cc:3060] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:49.630316  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:49.631137  1576 raft_consensus.cc:2393] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 7: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:49.621593  4655 raft_consensus.cc:515] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:49.633936  4648 leader_election.cc:290] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:49.634109  4655 leader_election.cc:290] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:49.634693  4641 raft_consensus.cc:740] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:49.636137  1572 raft_consensus.cc:1240] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 8. Current term is 9. Ops: [7.7-8.8]
I20260709 12:59:49.635929  4641 consensus_queue.cc:260] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:49.637352  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:49.637600  4641 raft_consensus.cc:3060] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:49.639717  4650 leader_election.cc:290] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:49.640014  1574 raft_consensus.cc:2468] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7.
I20260709 12:59:49.633967  1576 raft_consensus.cc:1240] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:49.640069  4635 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:49.641389  4723 log.cc:927] Time spent T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 12:59:49.625015  1691 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:49.644474  1717 raft_consensus.cc:1275] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:59:49.645792  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:49.646271  1717 raft_consensus.cc:1275] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:59:49.646353  1642 raft_consensus.cc:2468] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 7.
I20260709 12:59:49.587441  4619 raft_consensus.cc:493] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.647867  1717 raft_consensus.cc:1240] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 4. Current term is 5. Ops: []
I20260709 12:59:49.647640  4619 raft_consensus.cc:515] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:49.649576  4623 raft_consensus.cc:2749] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:49.650275  4619 leader_election.cc:290] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:49.613633  4588 raft_consensus.cc:515] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:49.625833  4543 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:49.603664  4609 raft_consensus.cc:493] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:49.653560  4609 raft_consensus.cc:3060] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:49.653436  1468 catalog_manager.cc:5697] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 3 to 4, leader changed from 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 4 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:49.656598   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 12:59:49.604116  4666 raft_consensus.cc:2749] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:59:49.657806  1575 raft_consensus.cc:2393] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 5: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:49.666285  1615 leader_election.cc:304] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 12:59:49.669827  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 45798.3us
I20260709 12:59:49.672777  1571 raft_consensus.cc:1275] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:49.674489  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:49.678298  1540 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:49.680908  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:49.681248  1615 leader_election.cc:304] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:49.681480  1573 raft_consensus.cc:2376] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7. Re-sending same reply.
I20260709 12:59:49.593677  4448 raft_consensus.cc:697] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:49.682307  1615 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:49.683343  1615 leader_election.cc:304] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:49.685840  1615 leader_election.cc:304] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:49.687549  2330 raft_consensus.cc:1240] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 9. Current term is 10. Ops: []
I20260709 12:59:49.688771  4666 raft_consensus.cc:2804] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:49.689137  4666 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:49.689471  4666 raft_consensus.cc:3060] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:49.655757  1468 catalog_manager.cc:5697] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 3 to 5, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 5 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:49.691797  4676 raft_consensus.cc:2749] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:49.692494  4676 raft_consensus.cc:2804] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:49.692873  4676 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:49.693195  4676 raft_consensus.cc:3060] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:49.693284  4729 consensus_queue.cc:1048] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:49.694198  4286 raft_consensus.cc:493] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.694692  4286 raft_consensus.cc:515] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:49.697539  4667 raft_consensus.cc:2804] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:49.698089  4667 raft_consensus.cc:697] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 7 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:49.699122  4667 consensus_queue.cc:237] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:49.699765  4687 raft_consensus.cc:3055] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:49.700165  4687 raft_consensus.cc:740] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:49.701396  4687 consensus_queue.cc:260] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:49.702577  4687 raft_consensus.cc:3060] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:49.701360  4448 consensus_queue.cc:237] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:49.704191  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:49.698135  4286 leader_election.cc:290] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:49.706465  1540 leader_election.cc:304] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:49.710094  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:49.711400  1717 raft_consensus.cc:2468] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 3.
I20260709 12:59:49.714952  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:49.715461  1717 raft_consensus.cc:3060] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:49.716964  1540 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:49.688125  4518 raft_consensus.cc:515] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:49.680366  4635 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 12:59:49.728313  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:49.709932  4571 raft_consensus.cc:2749] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:49.722744  4619 raft_consensus.cc:2804] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:49.718520  4525 raft_consensus.cc:2749] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:49.726718  4518 leader_election.cc:290] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:49.684757  4648 raft_consensus.cc:493] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:49.745007  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:49.748378  1716 raft_consensus.cc:1240] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 4. Current term is 5. Ops: []
W20260709 12:59:49.748462  1617 leader_election.cc:336] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.690s (SENT)
I20260709 12:59:49.744051  4571 raft_consensus.cc:2804] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:49.744814  4648 raft_consensus.cc:515] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:49.757180  4588 leader_election.cc:290] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:49.758293  1719 raft_consensus.cc:1275] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:59:49.759771  4525 consensus_queue.cc:1059] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:49.762766  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:49.767174  4649 leader_election.cc:290] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:49.801097  4732 consensus_queue.cc:1059] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:49.801800  1648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 486) took 1541 ms. Trace:
I20260709 12:59:49.802019  4732 raft_consensus.cc:3055] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:49.802436  4732 raft_consensus.cc:740] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:49.802227  1648 rpcz_store.cc:276] 0709 12:59:48.260454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:48.687751 (+427297us) service_pool.cc:224] Handling call
0709 12:59:49.600249 (+912498us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:49.600897 (+   648us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:49.801602 (+200705us) spinlock_profiling.cc:243] Waited 912 ms on lock 0x7b54003ce950. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23ba8ad 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:49.801740 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2097844096}
I20260709 12:59:49.803369  4732 consensus_queue.cc:260] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:49.804643  4732 raft_consensus.cc:3060] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:49.804971  2331 raft_consensus.cc:2468] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
I20260709 12:59:49.811288  4652 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.811825  4652 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:49.814073  4652 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:49.820137  4626 consensus_queue.cc:1048] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:59:49.826020  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:49.827926  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:49.829981  1643 raft_consensus.cc:1275] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:59:49.832544  1643 raft_consensus.cc:1240] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:59:49.835116  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:49.835460  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:49.835875  1569 raft_consensus.cc:2468] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 6.
I20260709 12:59:49.767343  2297 leader_election.cc:304] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:49.767489  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:49.836997  1724 raft_consensus.cc:2468] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 4.
W20260709 12:59:49.837191  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 69917.8us
I20260709 12:59:49.768039  4153 consensus_queue.cc:1048] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:49.768646  4286 consensus_queue.cc:1048] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:59:49.839265  4286 consensus_queue.cc:1243] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer 0c7751452c4b46afa95251b9df7169d4 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:59:49.769279  4555 consensus_queue.cc:1059] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:59:49.741945  4619 raft_consensus.cc:697] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 8 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
W20260709 12:59:49.837080  1617 leader_election.cc:336] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.879s (SENT)
I20260709 12:59:49.841190  4619 consensus_queue.cc:237] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:49.750190  4635 consensus_queue.cc:1059] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:59:49.775460  4706 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:49.844408  4636 raft_consensus.cc:2804] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:59:49.844933  4636 raft_consensus.cc:493] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:49.845369  4636 raft_consensus.cc:3060] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:59:49.846328  4706 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:49.846885  4708 raft_consensus.cc:1064] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226: attempting to promote NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 to VOTER
I20260709 12:59:49.777956  4648 leader_election.cc:290] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:49.851819  4711 raft_consensus.cc:3055] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:49.852264  4711 raft_consensus.cc:740] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:49.852368  4635 raft_consensus.cc:3055] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:49.852887  4635 raft_consensus.cc:740] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:49.853209  4711 consensus_queue.cc:260] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:49.782730  4717 raft_consensus.cc:515] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:49.786957  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:49.853935  4635 consensus_queue.cc:260] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:49.787568  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 478768us
I20260709 12:59:49.855265  4635 raft_consensus.cc:3060] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:49.856211  4717 leader_election.cc:290] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 12:59:49.856606  1542 leader_election.cc:336] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 4.231s (SENT)
I20260709 12:59:49.857049  1542 leader_election.cc:304] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
W20260709 12:59:49.857522  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:49.787292  4666 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:49.792793  4571 raft_consensus.cc:697] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:49.859988  4666 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:49.859709  4571 consensus_queue.cc:237] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:49.793388  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:49.860419  4708 consensus_queue.cc:237] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:49.861129  4687 raft_consensus.cc:2749] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:49.865782  4286 consensus_queue.cc:1059] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:49.866770  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:49.868325  4153 raft_consensus.cc:3055] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:59:49.868753  4153 raft_consensus.cc:740] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:49.869517  4153 consensus_queue.cc:260] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:49.870818  4153 raft_consensus.cc:3060] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:49.876430  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:49.877719  1643 raft_consensus.cc:2468] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 6.
I20260709 12:59:49.879052  4711 raft_consensus.cc:3060] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:59:49.876781  1617 leader_election.cc:336] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.920s (SENT)
I20260709 12:59:49.879503  4687 raft_consensus.cc:3055] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:59:49.880690  2295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:49.882544  1468 catalog_manager.cc:5697] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 1 to 3, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 3 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:49.906941  4370 raft_consensus.cc:493] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.907550  4370 raft_consensus.cc:515] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:49.911051  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 339829us
I20260709 12:59:49.911182  4555 consensus_queue.cc:1048] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:49.912047  1689 leader_election.cc:304] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:49.912410  4370 leader_election.cc:290] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:49.896912  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:49.913887  1643 raft_consensus.cc:3060] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:49.897542  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:49.899112  1617 leader_election.cc:304] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:49.899159  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:49.917305  1568 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:49.899878  4708 raft_consensus.cc:493] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.917953  2294 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
W20260709 12:59:49.905014  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 189233us
I20260709 12:59:49.901283  4687 raft_consensus.cc:740] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:49.910213  2297 leader_election.cc:304] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
W20260709 12:59:49.910537  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:49.896272  1717 raft_consensus.cc:2468] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 6.
I20260709 12:59:49.918617  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:49.922749  1645 raft_consensus.cc:2393] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 8: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:49.924407  1689 leader_election.cc:304] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 12:59:49.932245  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:49.933918  1689 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:49.936021  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:49.939558  1689 leader_election.cc:304] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:49.944744  4709 raft_consensus.cc:493] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:49.945595  4709 raft_consensus.cc:515] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:49.946416  1643 raft_consensus.cc:2468] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 10.
W20260709 12:59:49.950696  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 73957us
W20260709 12:59:49.951821  1617 leader_election.cc:336] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.928s (SENT)
I20260709 12:59:49.933247  4717 raft_consensus.cc:2749] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:49.955662  2294 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:49.957110  1689 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:49.959820  1615 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:49.961498  1615 leader_election.cc:304] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:49.964895  4655 raft_consensus.cc:2749] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:59:49.965494  1617 leader_election.cc:336] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.091s (SENT)
I20260709 12:59:49.965664  4655 raft_consensus.cc:2804] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:49.965969  1617 leader_election.cc:304] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:49.966202  4655 raft_consensus.cc:697] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 7 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:49.967435  4738 consensus_queue.cc:1048] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:59:49.968308  4739 raft_consensus.cc:2749] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:49.924749  4145 consensus_queue.cc:1048] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:59:49.964727  4667 consensus_queue.cc:1059] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:49.967195  4655 consensus_queue.cc:237] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:49.941946  4623 raft_consensus.cc:2749] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:49.918493  4609 raft_consensus.cc:515] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:49.947798  4670 raft_consensus.cc:2749] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:49.996264  1615 leader_election.cc:304] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:49.947465  4626 raft_consensus.cc:2804] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:49.997596  1689 leader_election.cc:304] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 12:59:49.998594  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 45080.7us
I20260709 12:59:49.928035  4708 raft_consensus.cc:515] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:49.935114  4732 consensus_queue.cc:1048] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
W20260709 12:59:50.001425  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 47236.5us
W20260709 12:59:50.002378  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 46801.4us
I20260709 12:59:49.947624  4734 raft_consensus.cc:2749] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:49.955286  4579 raft_consensus.cc:2804] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:49.955452  4652 raft_consensus.cc:2749] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:59:49.996685  4310 raft_consensus.cc:2804] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:50.008474  1615 leader_election.cc:304] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:50.010102  1689 leader_election.cc:304] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:50.021070  1540 leader_election.cc:304] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:50.024603  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:50.025539  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:50.026135  1724 raft_consensus.cc:2468] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6.
I20260709 12:59:50.027374  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:50.028301  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:50.029284  1722 raft_consensus.cc:2368] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 5. Current term is 6.
I20260709 12:59:50.022790  1717 pending_rounds.cc:85] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4: Aborting all ops after (but not including) 4
I20260709 12:59:50.030097  1717 pending_rounds.cc:107] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 12:59:50.030339  1717 raft_consensus.cc:2889] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:50.031306  1539 leader_election.cc:304] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:59:50.032779  1724 raft_consensus.cc:2368] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 7. Current term is 8.
I20260709 12:59:50.034786  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:50.035820  2330 raft_consensus.cc:1240] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:59:50.037479  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:50.013995  4370 raft_consensus.cc:2804] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:50.039718  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:50.007257  4569 raft_consensus.cc:2804] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:59:50.048767  4752 log.cc:927] Time spent T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 12:59:50.040968  4417 raft_consensus.cc:2749] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:50.050068  4609 leader_election.cc:290] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:50.050313  1539 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:59:50.051223  4514 raft_consensus.cc:2804] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:50.051568  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:50.051755  4514 raft_consensus.cc:697] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:50.052313  4641 raft_consensus.cc:2804] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:50.052913  4641 raft_consensus.cc:697] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:50.052806  4514 consensus_queue.cc:237] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:50.053452  4708 leader_election.cc:290] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:50.053930  4641 consensus_queue.cc:237] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:50.040408  1569 raft_consensus.cc:3060] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:50.056077  4636 raft_consensus.cc:515] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:50.042253  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:50.042428  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:50.042905  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:50.043011  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:50.059762  1722 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6.
I20260709 12:59:50.059870  1718 raft_consensus.cc:2468] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 4.
I20260709 12:59:50.060103  1568 raft_consensus.cc:2468] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 8.
I20260709 12:59:50.043641  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:50.061122  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:50.011355  4626 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:50.044323  1472 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55626 (request call id 256) took 23065 ms (client timeout 15000 ms). Trace:
I20260709 12:59:50.043815  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:49.907469  1468 catalog_manager.cc:5697] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 4 to 5, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 5 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:50.067780  4370 raft_consensus.cc:697] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 7 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:50.068270  2327 raft_consensus.cc:1275] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:59:50.068848  4370 consensus_queue.cc:237] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:50.069339  1468 catalog_manager.cc:5697] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 3 to 6, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 6 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } }
I20260709 12:59:50.040932  4571 raft_consensus.cc:2804] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:50.046264  4709 leader_election.cc:290] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:50.012768  4579 raft_consensus.cc:493] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:50.047634  1617 leader_election.cc:336] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.089s (SENT)
W20260709 12:59:50.105170  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 92533us
I20260709 12:59:50.105414  1617 leader_election.cc:304] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:50.061945  1574 raft_consensus.cc:2468] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7.
I20260709 12:59:50.044710  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:50.064020  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:50.107493  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:50.107597  1650 raft_consensus.cc:1240] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 9. Current term is 10. Ops: [7.7-9.8]
I20260709 12:59:50.108096  1724 raft_consensus.cc:3060] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:50.064265  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:50.109051  1722 raft_consensus.cc:2410] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:59:50.065765  1539 leader_election.cc:304] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:59:50.066433  1571 raft_consensus.cc:2410] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 6 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:59:50.063315  2331 raft_consensus.cc:2393] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 8: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
W20260709 12:59:50.072803  1542 leader_election.cc:336] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.123s (SENT)
I20260709 12:59:50.110397  1542 leader_election.cc:304] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:50.018342  4717 raft_consensus.cc:2749] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:50.081198  2329 raft_consensus.cc:1275] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 LEARNER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:59:50.103540  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:50.122983  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:59:50.124194  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 58567.4us
I20260709 12:59:50.130165  1647 raft_consensus.cc:2393] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 5: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
W20260709 12:59:50.123351  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 75753.7us
W20260709 12:59:50.131096  1617 leader_election.cc:336] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.128s (SENT)
I20260709 12:59:50.132405  1569 raft_consensus.cc:2468] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 8.
I20260709 12:59:50.134473  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:50.059080  4650 raft_consensus.cc:3060] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:50.140034  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:50.141615  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:50.142349  1722 raft_consensus.cc:2368] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 7. Current term is 8.
I20260709 12:59:50.143469  1650 raft_consensus.cc:1275] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:59:50.135844  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:50.145615  1644 raft_consensus.cc:3060] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:59:50.071131  1468 catalog_manager.cc:5697] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 4 to 5, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 5 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:50.151628  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:50.072708  4310 raft_consensus.cc:697] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 8 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:50.151903  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:50.075928  4626 raft_consensus.cc:3060] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:50.169916  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:50.181641  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:50.182042  1647 raft_consensus.cc:2410] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:59:50.182323  1648 raft_consensus.cc:3060] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:50.006103  4687 consensus_queue.cc:260] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:50.003311  4676 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:59:50.122452  4579 raft_consensus.cc:3060] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:50.186542  1720 raft_consensus.cc:2393] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 7: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:59:50.196805  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:50.149310  2323 raft_consensus.cc:2368] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 3. Current term is 4.
W20260709 12:59:50.198271  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 125512us
W20260709 12:59:50.205106  1542 leader_election.cc:336] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.241s (SENT)
W20260709 12:59:50.205404  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 50591.3us
I20260709 12:59:50.205560  1542 leader_election.cc:304] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
W20260709 12:59:50.206737  1542 leader_election.cc:336] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.402s (SENT)
I20260709 12:59:50.207154  1542 leader_election.cc:304] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:50.144631  4652 raft_consensus.cc:2749] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:50.134182  4571 raft_consensus.cc:697] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:50.140833  4709 raft_consensus.cc:2804] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:59:50.200941  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 94872.4us
I20260709 12:59:50.201071  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:50.218190  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:50.155280  4731 raft_consensus.cc:2749] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:50.136873  4417 consensus_queue.cc:1059] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 12:59:50.155282  4636 leader_election.cc:290] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:50.151793  4569 raft_consensus.cc:697] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:50.218581  1718 raft_consensus.cc:3060] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:59:50.228430  1542 leader_election.cc:336] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.503s (SENT)
W20260709 12:59:50.229777  1542 leader_election.cc:336] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.587s (SENT)
I20260709 12:59:50.230199  1542 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:50.224159  1644 raft_consensus.cc:2468] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 4.
I20260709 12:59:50.226776  2295 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:50.209888  4572 raft_consensus.cc:2749] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:50.237080  4546 raft_consensus.cc:2804] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:50.240737  4731 raft_consensus.cc:2749] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:50.192421  4588 consensus_queue.cc:1048] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:59:50.216744  4690 consensus_queue.cc:1048] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:59:50.202121  4649 consensus_queue.cc:1059] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:59:50.245458  1468 catalog_manager.cc:5697] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 2 to 5, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 5 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:59:50.228662  4417 consensus_queue.cc:1243] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer 05476b84d8f84d76a9a1f51b620a3c66 log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260709 12:59:50.062732  1472 rpcz_store.cc:269] 0709 12:59:26.975516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:26.975795 (+   279us) service_pool.cc:224] Handling call
0709 12:59:50.004885 (+23029090us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:39.226293 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:39.465633 (+239340us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:39.473593 (+  7960us) write_op.cc:435] Acquired schema lock
0709 12:59:39.481149 (+  7556us) tablet.cc:662] Decoding operations
0709 12:59:39.968820 (+487671us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:40.030921 (+ 62101us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:40.046992 (+ 16071us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:59:40.206432 (+159440us) tablet.cc:701] Row locks acquired
0709 12:59:40.206468 (+    36us) write_op.cc:260] PREPARE: finished
0709 12:59:40.206659 (+   191us) write_op.cc:270] Start()
0709 12:59:40.206802 (+   143us) write_op.cc:276] Timestamp: P: 1783601980206596 usec, L: 0
0709 12:59:40.206823 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:59:40.717341 (+510518us) log.cc:844] Serialized 3306 byte log entry
0709 12:59:41.777108 (+1059767us) op_driver.cc:464] REPLICATION: finished
0709 12:59:41.906398 (+129290us) spinlock_profiling.cc:243] Waited 43.4 ms on lock 0x7b540041ee54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23b6e28 00007fa9f5df1581 00007fa9f5df0d58 00007fa9f5df59f1 00007fa9f5df59a9 00007fa9f5df5939 00007fa9f5df5901 00007fa9f5df4b2d 000000000038f354 000000000038f199
0709 12:59:42.502110 (+595712us) spinlock_profiling.cc:243] Waited 45.6 ms on lock 0x7b18000bf9e0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef2ce3f3 00007fa9ef2d07c1 00007fa9ef2d0779 00007fa9ef2d0709 00007fa9ef2d06d1 00007fa9ef2cf9cd 000000000038f354 000000000038f199 00007fa9ef2b183a
0709 12:59:42.502278 (+   168us) write_op.cc:301] APPLY: starting
0709 12:59:42.502359 (+    81us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:42.502614 (+   255us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:42.502649 (+    35us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:42.538489 (+ 35840us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:42.538713 (+   224us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 12:59:42.538741 (+    28us) write_op.cc:312] APPLY: finished
0709 12:59:42.539002 (+   261us) log.cc:844] Serialized 65 byte log entry
0709 12:59:42.539191 (+   189us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:42.539300 (+   109us) write_op.cc:454] Released schema lock
0709 12:59:42.539357 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:42.539742 (+   385us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:42.539761 (+    19us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":207895,"reported_tablets":29,"child_traces":[["op",{"apply.queue_time_us":585638,"apply.run_cpu_time_us":3716,"apply.run_wall_time_us":37438,"num_ops":8,"prepare.queue_time_us":557254,"prepare.run_cpu_time_us":33663,"prepare.run_wall_time_us":2849098,"raft.queue_time_us":412328,"raft.run_cpu_time_us":11349,"raft.run_wall_time_us":612423,"replication_time_us":1568454,"spinlock_wait_cycles":204771456,"thread_start_us":1127353,"threads_started":4,"wal-append.queue_time_us":531669,"wal-append.run_cpu_time_us":80996,"wal-append.run_wall_time_us":2280906}]]}
I20260709 12:59:50.263434  1722 raft_consensus.cc:2468] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 8.
I20260709 12:59:50.216428  4709 raft_consensus.cc:493] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:50.272630  1718 raft_consensus.cc:2468] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 4.
I20260709 12:59:50.273239  1648 raft_consensus.cc:2468] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 9.
W20260709 12:59:50.295809  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:50.332090  2297 leader_election.cc:304] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
W20260709 12:59:50.296119  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:50.254733  4525 raft_consensus.cc:2749] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:59:50.329183  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 121793us
I20260709 12:59:50.333920  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:50.335741  1615 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:50.335762  1722 raft_consensus.cc:2410] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 12:59:50.340081  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 110325us
W20260709 12:59:50.340764  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:50.320088  4546 raft_consensus.cc:697] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:50.347500  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 12:59:50.347492  1542 leader_election.cc:336] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.705s (SENT)
I20260709 12:59:50.349498  1542 leader_election.cc:304] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:50.356164  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:50.334846  4709 raft_consensus.cc:3060] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:50.337533  4350 raft_consensus.cc:2804] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:59:50.355562  4417 raft_consensus.cc:2749] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:59:50.430033  1650 raft_consensus.cc:1275] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:59:50.426685  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 79280.3us
W20260709 12:59:50.414666  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 187971us
I20260709 12:59:50.416656  1722 raft_consensus.cc:2468] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 8.
I20260709 12:59:50.435467  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:50.355214  4571 consensus_queue.cc:237] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:50.432554  1468 catalog_manager.cc:5697] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 3 to 6, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 6 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } }
I20260709 12:59:50.445099  1718 raft_consensus.cc:2468] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 5.
I20260709 12:59:50.448938  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:50.449584  1718 raft_consensus.cc:2376] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 8. Re-sending same reply.
W20260709 12:59:50.453893  4756 log.cc:927] Time spent T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.162s	user 0.001s	sys 0.000s
I20260709 12:59:50.337132  4310 consensus_queue.cc:237] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:50.458401  4751 log.cc:927] Time spent T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.265s	user 0.001s	sys 0.000s
I20260709 12:59:50.464111  1724 raft_consensus.cc:2468] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 5.
I20260709 12:59:50.465807  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:50.465914  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:50.414177  4525 raft_consensus.cc:2749] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:50.488967  1723 raft_consensus.cc:2468] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6.
I20260709 12:59:50.489157  1722 raft_consensus.cc:2376] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 8. Re-sending same reply.
I20260709 12:59:50.492838  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:50.493538  1722 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6.
I20260709 12:59:50.494040  1651 raft_consensus.cc:1275] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:59:50.494436  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:50.495028  1722 raft_consensus.cc:2376] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 5. Re-sending same reply.
I20260709 12:59:50.495908  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:50.497622  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:50.498858  1717 raft_consensus.cc:2410] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:59:50.492861  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:50.500321  1723 raft_consensus.cc:3060] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:50.502406  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:50.503312  1722 raft_consensus.cc:2376] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6. Re-sending same reply.
I20260709 12:59:50.504582  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:50.505685  1722 raft_consensus.cc:2368] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 7. Current term is 8.
I20260709 12:59:50.491698  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:50.490753  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:50.518296  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:50.519289  1717 raft_consensus.cc:2368] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 5. Current term is 6.
I20260709 12:59:50.522149  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:50.523053  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:50.523370  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:50.523730  1722 raft_consensus.cc:2468] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 4.
I20260709 12:59:50.524549  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:50.524448  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:50.525296  1722 raft_consensus.cc:2468] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7.
I20260709 12:59:50.525403  1724 raft_consensus.cc:2468] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7.
I20260709 12:59:50.526201  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:50.526356  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:50.527073  1722 raft_consensus.cc:2410] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:59:50.527707  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:50.528247  1722 raft_consensus.cc:1275] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:59:50.529237  1724 raft_consensus.cc:1240] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:50.530223  1722 raft_consensus.cc:1240] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:59:50.365710  4569 consensus_queue.cc:237] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:50.532572  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:50.444916  4350 raft_consensus.cc:697] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:50.547297  1717 raft_consensus.cc:1240] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 12:59:50.556344  4760 log.cc:927] Time spent T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.237s	user 0.000s	sys 0.001s
W20260709 12:59:50.559211  1542 leader_election.cc:336] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.140s (SENT)
I20260709 12:59:50.558763  4350 consensus_queue.cc:237] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:50.559716  1542 leader_election.cc:304] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:50.563122  4769 raft_consensus.cc:2749] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:50.569077  1722 raft_consensus.cc:1275] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:59:50.588734  1723 raft_consensus.cc:2468] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7.
W20260709 12:59:50.608894  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 44275.2us
W20260709 12:59:50.616216  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:50.617137  1722 raft_consensus.cc:1240] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 8 LEADER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 7. Current term is 8. Ops: []
W20260709 12:59:50.627491  1542 leader_election.cc:336] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.928s (SENT)
I20260709 12:59:50.620510  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:50.632329  1723 raft_consensus.cc:2376] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 8. Re-sending same reply.
I20260709 12:59:50.491698  4636 consensus_queue.cc:1048] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.104s
I20260709 12:59:50.493556  4546 consensus_queue.cc:237] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:50.663755  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:59:50.668105  1542 leader_election.cc:336] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.232s (SENT)
I20260709 12:59:50.668638  1542 leader_election.cc:304] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:50.596549  4623 consensus_queue.cc:1048] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
W20260709 12:59:50.649098  4733 log.cc:927] Time spent T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:59:50.699795  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:50.700841  1723 raft_consensus.cc:2368] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 3. Current term is 4.
W20260709 12:59:50.679255  4711 consensus_meta.cc:287] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.765s	user 0.007s	sys 0.004s
I20260709 12:59:50.705247   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:50.681017  4514 raft_consensus.cc:2749] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:50.716326  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:50.718856  1542 leader_election.cc:304] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:50.720333  1542 leader_election.cc:304] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:50.725170  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:50.725849  1723 raft_consensus.cc:3060] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:50.730804  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:50.731526  1716 raft_consensus.cc:2468] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7.
W20260709 12:59:50.731832  4579 consensus_meta.cc:287] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.517s	user 0.006s	sys 0.000s
I20260709 12:59:50.725378  4769 raft_consensus.cc:2749] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:59:50.734455  4626 consensus_meta.cc:287] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.529s	user 0.008s	sys 0.003s
I20260709 12:59:50.734975  4626 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:50.736150  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:59:50.738387  4635 consensus_meta.cc:287] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.883s	user 0.009s	sys 0.001s
W20260709 12:59:50.738549  4771 log.cc:927] Time spent T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
I20260709 12:59:50.742555  2330 raft_consensus.cc:2393] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 7: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 12:59:50.743135  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:59:50.750083  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 44703us
I20260709 12:59:50.712911  4122 raft_consensus.cc:493] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:50.765668  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:50.790405  1689 leader_election.cc:304] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 12:59:50.796041  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 45120.6us
W20260709 12:59:50.799356  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 165726us
W20260709 12:59:50.801918  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 81657.2us
I20260709 12:59:50.732297  4579 raft_consensus.cc:515] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:50.807607  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:50.809132  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:50.809530  1689 leader_election.cc:304] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:50.817816  1568 raft_consensus.cc:2468] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 7.
I20260709 12:59:50.818620  1689 leader_election.cc:304] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:50.811290  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:50.819621  1567 raft_consensus.cc:3060] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:50.810204  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:50.820264  1689 leader_election.cc:304] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:50.812817  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:50.822185  1570 raft_consensus.cc:1275] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:59:50.818773  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:50.824671  1568 raft_consensus.cc:3060] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:50.860800  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:50.823357  1716 raft_consensus.cc:1275] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:59:50.832518  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:50.813711  1723 raft_consensus.cc:2468] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 8.
I20260709 12:59:50.798846  4734 raft_consensus.cc:2749] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:50.797447  4514 raft_consensus.cc:2764] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:59:50.868722  1575 raft_consensus.cc:1275] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:59:50.876266  2326 raft_consensus.cc:1240] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:50.879328  1575 pending_rounds.cc:85] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting all ops after (but not including) 2
I20260709 12:59:50.884509  1575 pending_rounds.cc:107] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:59:50.885283  1575 raft_consensus.cc:2889] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:50.826962  4670 raft_consensus.cc:2749] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:50.874176  1568 raft_consensus.cc:2468] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 8.
I20260709 12:59:50.797519  4122 raft_consensus.cc:515] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:50.934687  4780 log.cc:927] Time spent T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:59:50.823485  4769 consensus_queue.cc:1048] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.110s
I20260709 12:59:50.941946  1723 raft_consensus.cc:1275] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:59:50.943703  4770 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:50.944628  4770 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:59:50.877128  4623 raft_consensus.cc:2749] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:50.947484  4770 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:50.887975  4626 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:50.966351  4579 leader_election.cc:290] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:59:50.971951  4709 consensus_meta.cc:287] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.559s	user 0.010s	sys 0.000s
I20260709 12:59:50.972697  4709 raft_consensus.cc:515] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:50.987887  1573 raft_consensus.cc:1240] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:50.815867  4571 consensus_queue.cc:1048] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.070s
I20260709 12:59:50.868337  4655 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:50.880396  4753 log.cc:927] Time spent T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 12:59:50.981936  4650 consensus_meta.cc:287] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.830s	user 0.010s	sys 0.000s
W20260709 12:59:51.023072  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 202978us
I20260709 12:59:51.024267  1689 leader_election.cc:304] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:51.025799  1689 leader_election.cc:304] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:51.032097  1689 leader_election.cc:304] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:51.033427  1689 leader_election.cc:400] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 election: Vote denied by peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423) with higher term. Message: Invalid argument: T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 5. Current term is 6.
I20260709 12:59:51.033769  1689 leader_election.cc:403] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
W20260709 12:59:51.035218  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:51.026206  4650 raft_consensus.cc:2749] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:51.032234  4734 raft_consensus.cc:2764] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 12:59:51.060333  4676 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:51.061089  4650 raft_consensus.cc:2749] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423) with higher term. Message: Invalid argument: T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 5. Current term is 6.
I20260709 12:59:51.062992  4122 leader_election.cc:290] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:51.072119  2323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53290 (request call id 904) took 1039 ms. Trace:
I20260709 12:59:51.072604  2323 rpcz_store.cc:276] 0709 12:59:50.032407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.040248 (+  7841us) service_pool.cc:224] Handling call
0709 12:59:51.071908 (+1031660us) spinlock_profiling.cc:243] Waited 7.44 ms on lock 0x7b540062e154. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:51.072056 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17105792}
I20260709 12:59:51.074697  1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2012) took 1050 ms. Trace:
I20260709 12:59:51.075206  1720 rpcz_store.cc:276] 0709 12:59:50.023967 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.024359 (+   392us) service_pool.cc:224] Handling call
0709 12:59:51.074512 (+1050153us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b54002265d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:51.074625 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":370223872}
I20260709 12:59:51.079167  1719 raft_consensus.cc:2468] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7.
I20260709 12:59:51.020684  4655 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:51.053989  4623 raft_consensus.cc:2749] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:51.104842  1567 raft_consensus.cc:2468] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 5.
W20260709 12:59:51.094661  4794 log.cc:927] Time spent T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.053s	user 0.000s	sys 0.003s
W20260709 12:59:51.094730  4779 log.cc:927] Time spent T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:59:51.124373  4655 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:51.136926  4571 raft_consensus.cc:493] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:51.178944  4571 raft_consensus.cc:515] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:51.183342  4571 leader_election.cc:290] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:51.138917  4514 raft_consensus.cc:493] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:51.137521  4655 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:51.200896  4655 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:51.203794  4655 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:51.210216  4772 log.cc:927] Time spent T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.562s	user 0.000s	sys 0.001s
I20260709 12:59:51.211019  1644 raft_consensus.cc:1275] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:59:51.213140  4623 raft_consensus.cc:493] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:51.213866  4623 raft_consensus.cc:515] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:51.216804  4757 raft_consensus.cc:493] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:51.217445  4757 raft_consensus.cc:515] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:51.219910  4757 leader_election.cc:290] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:51.225118  4623 leader_election.cc:290] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:51.226275  1644 raft_consensus.cc:1275] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:59:51.227464  1719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2014) took 1202 ms. Trace:
I20260709 12:59:51.179906  4709 leader_election.cc:290] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:51.237663  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:51.233533  4670 raft_consensus.cc:2749] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:51.250176  4687 raft_consensus.cc:3060] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:59:51.237687  4514 raft_consensus.cc:515] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:51.235860  1539 leader_election.cc:304] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:51.236205  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:51.275941  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:51.276933  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:51.365913  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:51.286899  4787 raft_consensus.cc:493] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:51.367568  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:51.309001  1647 raft_consensus.cc:3055] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:51.367800  4787 raft_consensus.cc:515] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:51.368711  1647 raft_consensus.cc:740] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:51.368901  1651 raft_consensus.cc:3060] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:51.370251  4787 leader_election.cc:290] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:51.369804  1647 consensus_queue.cc:260] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:51.371256  1647 raft_consensus.cc:3060] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:51.227969  1719 rpcz_store.cc:276] 0709 12:59:50.025502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.025989 (+   487us) service_pool.cc:224] Handling call
0709 12:59:51.227270 (+1201281us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54000e2254. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:51.227396 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2301877504}
I20260709 12:59:51.288266  2326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53290 (request call id 905) took 1254 ms. Trace:
I20260709 12:59:51.313843  4783 raft_consensus.cc:493] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:51.373346  4783 raft_consensus.cc:515] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:51.326586  1645 raft_consensus.cc:1275] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:59:51.347029  1567 raft_consensus.cc:1240] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:51.351451  1569 raft_consensus.cc:1275] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:59:51.306705  1615 leader_election.cc:304] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 12:59:51.379015  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 72431.7us
I20260709 12:59:51.379176  4655 raft_consensus.cc:2804] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:51.379801  4655 raft_consensus.cc:493] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:51.380108  1615 leader_election.cc:304] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:51.380313  4655 raft_consensus.cc:3060] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:51.382197  4738 raft_consensus.cc:2804] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:51.382318  1615 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:51.382687  4738 raft_consensus.cc:697] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 8 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:51.383621  4738 consensus_queue.cc:237] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:51.363384  4769 raft_consensus.cc:2804] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:51.386664  4769 raft_consensus.cc:697] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
W20260709 12:59:51.387127  1542 leader_election.cc:336] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.761s (SENT)
I20260709 12:59:51.387756  1542 leader_election.cc:304] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:51.277267  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:51.389730  4525 raft_consensus.cc:2749] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:51.277655  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
W20260709 12:59:51.277812  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 350713us
I20260709 12:59:51.395563  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:51.396293  1719 raft_consensus.cc:3060] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:51.326907  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:51.348546  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:51.349422  1568 raft_consensus.cc:1240] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 8. Current term is 9. Ops: [7.7-8.8]
I20260709 12:59:51.400511  1576 raft_consensus.cc:3060] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:51.363195  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 127258us
I20260709 12:59:51.400548  1643 raft_consensus.cc:2468] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 7.
I20260709 12:59:51.403419  1615 leader_election.cc:400] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Vote denied by peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423) with higher term. Message: Invalid argument: T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 3. Current term is 4.
I20260709 12:59:51.403853  1615 leader_election.cc:403] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:59:51.292450  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:51.145367  4676 raft_consensus.cc:493] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:51.419427  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:51.420080  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:51.422943  1568 raft_consensus.cc:1275] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:59:51.424924  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:51.427057  1568 raft_consensus.cc:1275] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:59:51.284180  4761 log.cc:927] Time spent T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.919s	user 0.003s	sys 0.000s
I20260709 12:59:51.372242  2326 rpcz_store.cc:276] 0709 12:59:50.033831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.033938 (+   107us) service_pool.cc:224] Handling call
0709 12:59:50.034188 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:50.880136 (+845948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:51.287939 (+407803us) spinlock_profiling.cc:243] Waited 842 ms on lock 0x7b54006c66d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:51.288135 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1935985920}
W20260709 12:59:51.433211  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:51.453146  1645 raft_consensus.cc:1275] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:59:51.387674  4769 consensus_queue.cc:237] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:51.442904  2330 raft_consensus.cc:1275] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:59:51.472605  2330 pending_rounds.cc:85] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66: Aborting all ops after (but not including) 6
I20260709 12:59:51.472862  2330 pending_rounds.cc:107] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:59:51.473100  2330 raft_consensus.cc:2889] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:51.443729  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:59:51.443778  1542 leader_election.cc:336] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.586s (SENT)
I20260709 12:59:51.474318  1643 raft_consensus.cc:2468] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6.
I20260709 12:59:51.474403  1542 leader_election.cc:304] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:51.444684  2327 raft_consensus.cc:2468] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 5.
I20260709 12:59:51.447253  2323 raft_consensus.cc:1240] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:51.422405  4731 consensus_queue.cc:1048] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:59:51.417200  4588 raft_consensus.cc:493] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:51.413900  4708 raft_consensus.cc:493] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:51.413646  4525 raft_consensus.cc:493] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:51.450736  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:51.459249  1576 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7.
I20260709 12:59:51.440663  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:51.466441  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:51.470216  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:51.471853  1567 raft_consensus.cc:1275] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:59:51.475180  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 409918us
I20260709 12:59:51.467787  1688 leader_election.cc:304] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:51.269029  4514 leader_election.cc:290] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:51.488896  1718 raft_consensus.cc:1275] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:51.595666  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:51.596660  1567 raft_consensus.cc:2468] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 4.
I20260709 12:59:51.411595  1651 raft_consensus.cc:2468] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 7.
W20260709 12:59:51.584378  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 126255us
I20260709 12:59:51.577891  1573 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 8.
W20260709 12:59:51.565753  1689 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.000s	sys 0.010s
W20260709 12:59:51.599786  1689 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.001s	sys 0.010s
W20260709 12:59:51.478034  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:51.588140  2329 raft_consensus.cc:2410] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:59:51.424127  4648 consensus_queue.cc:1048] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.156s
I20260709 12:59:51.478664  4571 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:51.614627  2295 leader_election.cc:304] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:51.425386  4676 raft_consensus.cc:515] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:51.576033  4588 raft_consensus.cc:515] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:51.577623  4789 consensus_queue.cc:1059] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.238s
I20260709 12:59:51.478960  4787 consensus_queue.cc:1048] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.985s
W20260709 12:59:51.938827  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 340062us
I20260709 12:59:52.461894  1573 raft_consensus.cc:1275] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:59:51.948109  4781 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.861s	user 0.098s	sys 0.305s
I20260709 12:59:52.462800  1573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 1983) took 1022 ms. Trace:
I20260709 12:59:52.463331  1573 rpcz_store.cc:276] 0709 12:59:51.440111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.599515 (+159404us) service_pool.cc:224] Handling call
0709 12:59:52.461498 (+861983us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:52.462476 (+   978us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:52.462680 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:52.463792  1572 raft_consensus.cc:2468] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 6.
W20260709 12:59:51.969924  4773 log.cc:927] Time spent T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
W20260709 12:59:52.011580  1717 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.791s	user 0.000s	sys 0.026s
I20260709 12:59:51.836627  1719 raft_consensus.cc:2468] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 6.
I20260709 12:59:52.466413  1719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58782 (request call id 613) took 1072 ms. Trace:
W20260709 12:59:52.063632  1642 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.719s	user 0.008s	sys 0.020s
W20260709 12:59:52.467243  1642 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.123s	user 0.013s	sys 0.028s
I20260709 12:59:51.987179  4670 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:52.467816  4676 leader_election.cc:290] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:59:52.465961  1717 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.246s	user 0.000s	sys 0.029s
W20260709 12:59:52.458811  2332 consensus_meta.cc:287] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 1.042s	user 0.011s	sys 0.014s
W20260709 12:59:51.972721  1648 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.762s	user 0.015s	sys 0.057s
I20260709 12:59:52.096145  1649 raft_consensus.cc:1275] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:59:52.459609  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:59:52.474311  1648 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.264s	user 0.025s	sys 0.063s
I20260709 12:59:52.468174  4670 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:52.474725  1721 raft_consensus.cc:2468] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 5.
I20260709 12:59:51.795307  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:52.466845  1719 rpcz_store.cc:276] 0709 12:59:51.394102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.395232 (+  1130us) service_pool.cc:224] Handling call
0709 12:59:52.466358 (+1071126us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:59:51.783224  1542 leader_election.cc:336] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 3.032s (SENT)
I20260709 12:59:52.475920  1576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37682 (request call id 627) took 1029 ms. Trace:
I20260709 12:59:52.476061  1542 leader_election.cc:304] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
W20260709 12:59:52.468195  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 1.43479e+06us
I20260709 12:59:51.799851  1647 raft_consensus.cc:1275] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:59:52.477159  1647 pending_rounds.cc:85] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e: Aborting all ops after (but not including) 7
W20260709 12:59:51.961248  1650 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.754s	user 0.014s	sys 0.017s
I20260709 12:59:52.477346  1689 leader_election.cc:304] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 12:59:51.640556  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 172876us
W20260709 12:59:52.477939  1650 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.271s	user 0.022s	sys 0.018s
W20260709 12:59:51.946488  1725 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.728s	user 0.006s	sys 0.018s
I20260709 12:59:52.458074  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 12:59:52.479573  1725 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.261s	user 0.007s	sys 0.035s
I20260709 12:59:52.473970  2332 raft_consensus.cc:2468] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 5.
I20260709 12:59:52.480194  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36640 (request call id 1982) took 1040 ms. Trace:
I20260709 12:59:52.476475  1576 rpcz_store.cc:276] 0709 12:59:51.446951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.582092 (+135141us) service_pool.cc:224] Handling call
0709 12:59:52.475841 (+893749us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:52.480515  2332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53306 (request call id 599) took 1205 ms. Trace:
W20260709 12:59:52.292759  1646 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.966s	user 0.015s	sys 0.025s
W20260709 12:59:52.482177  1646 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.155s	user 0.018s	sys 0.027s
W20260709 12:59:52.462886  4781 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.405s	user 0.108s	sys 0.308s
I20260709 12:59:52.477423  1647 pending_rounds.cc:107] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:59:51.475792  4817 raft_consensus.cc:2749] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423) with higher term. Message: Invalid argument: T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 3. Current term is 4.
W20260709 12:59:52.491230  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:52.112416  4803 log.cc:927] Time spent T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.274s	user 0.001s	sys 0.001s
W20260709 12:59:52.483129  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:52.510777  1615 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.046s	user 0.012s	sys 0.010s
W20260709 12:59:52.511343  1615 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.046s	user 0.012s	sys 0.010s
W20260709 12:59:52.511710  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 1.0666e+06us
W20260709 12:59:52.504575  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 721376us
I20260709 12:59:52.506376  1647 raft_consensus.cc:2889] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:52.506935  1574 raft_consensus.cc:1275] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:59:52.480688  1567 rpcz_store.cc:276] 0709 12:59:51.439889 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.597732 (+157843us) service_pool.cc:224] Handling call
0709 12:59:52.480119 (+882387us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:52.481460  2332 rpcz_store.cc:276] 0709 12:59:51.275311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.277375 (+  2064us) service_pool.cc:224] Handling call
0709 12:59:52.480433 (+1203058us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:59:52.508975  4770 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:52.588078  1572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37682 (request call id 616) took 1086 ms. Trace:
I20260709 12:59:52.588707  1572 rpcz_store.cc:276] 0709 12:59:51.419747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.419853 (+   106us) service_pool.cc:224] Handling call
0709 12:59:52.506144 (+1086291us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b540017e154. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:52.506301 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2398695168}
I20260709 12:59:51.583295  4783 leader_election.cc:290] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:52.598730  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 514) took 2100 ms. Trace:
W20260709 12:59:51.815232  4763 log.cc:927] Time spent T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
W20260709 12:59:51.945595  4738 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.054s	sys 0.074s
W20260709 12:59:51.987111  4739 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.011s	sys 0.013s
I20260709 12:59:52.599086  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:59:51.894084  4813 log.cc:927] Time spent T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.474s	user 0.001s	sys 0.000s
W20260709 12:59:51.952519  4687 consensus_meta.cc:287] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.702s	user 0.008s	sys 0.000s
I20260709 12:59:52.037550  4717 raft_consensus.cc:493] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
W20260709 12:59:52.598656  4543 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 12:59:51.674624  4708 raft_consensus.cc:515] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:52.465915  4588 leader_election.cc:290] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:51.479521  4740 raft_consensus.cc:2749] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:52.602577  1647 rpcz_store.cc:276] 0709 12:59:50.426737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.426879 (+   142us) service_pool.cc:224] Handling call
0709 12:59:50.427230 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:51.308886 (+881656us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b5400346fa0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f2332dc0 00007fa9f23bd1c0 00007fa9f23be231 00007fa9f23bad8f 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c
0709 12:59:52.526447 (+1217561us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:52.526821 (+   374us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":27458304}
I20260709 12:59:52.362593  4806 raft_consensus.cc:493] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:52.444555  4655 consensus_meta.cc:287] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 1.063s	user 0.013s	sys 0.000s
I20260709 12:59:51.904740  4706 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:51.475777  4649 consensus_queue.cc:1048] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 1.059s
I20260709 12:59:52.602824  4770 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:52.638221  1724 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.151s	user 0.019s	sys 0.021s
W20260709 12:59:52.667846  1724 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.181s	user 0.019s	sys 0.021s
I20260709 12:59:51.828785  4734 raft_consensus.cc:2804] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:52.644292  1649 raft_consensus.cc:2468] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 6.
I20260709 12:59:52.586850  4731 raft_consensus.cc:2749] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:51.480811  4623 consensus_queue.cc:1048] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 1.138s
I20260709 12:59:52.526221  4676 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:52.660266  4687 raft_consensus.cc:493] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:51.638885  4555 consensus_queue.cc:1048] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 1.003s
I20260709 12:59:52.600296  4782 raft_consensus.cc:3055] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:52.655190  1570 raft_consensus.cc:1275] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:59:52.640885  4738 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.254s	user 0.058s	sys 0.089s
I20260709 12:59:52.694753  4738 raft_consensus.cc:493] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:52.695441  4738 raft_consensus.cc:515] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:52.696944  4709 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:52.664294  4740 consensus_queue.cc:1048] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:59:52.666776  4706 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:52.703902  4670 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:52.664978  4806 raft_consensus.cc:515] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:52.705636  4670 raft_consensus.cc:2749] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:52.706478  4670 raft_consensus.cc:493] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:52.707541  4806 leader_election.cc:290] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:52.710536  4770 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:52.618283  4789 raft_consensus.cc:2804] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:59:52.643777  4739 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.259s	user 0.011s	sys 0.035s
I20260709 12:59:51.753068  4525 raft_consensus.cc:515] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:52.662416  1645 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.878s	user 0.000s	sys 0.034s
I20260709 12:59:51.613261  4619 raft_consensus.cc:2749] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:52.669571  1647 raft_consensus.cc:1275] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:59:52.508769  4571 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:51.697165  4145 consensus_queue.cc:1048] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.987s
I20260709 12:59:52.657653  4717 raft_consensus.cc:515] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:52.660049  1644 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.722s	user 0.009s	sys 0.032s
W20260709 12:59:52.734802  1644 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.853s	user 0.009s	sys 0.032s
W20260709 12:59:52.716071  1645 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.931s	user 0.000s	sys 0.034s
W20260709 12:59:52.717353  1617 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.139s	user 0.018s	sys 0.040s
W20260709 12:59:52.715672  4690 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.900s	user 0.085s	sys 0.097s
I20260709 12:59:52.681950  4734 raft_consensus.cc:493] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:52.664812  4655 raft_consensus.cc:515] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:52.697649  4709 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:52.736178  1617 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.158s	user 0.019s	sys 0.040s
I20260709 12:59:52.736845  1645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 522) took 1135 ms. Trace:
I20260709 12:59:52.701439  4706 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:52.715096  4789 raft_consensus.cc:493] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:52.728025  1568 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.276s	user 0.016s	sys 0.040s
W20260709 12:59:52.769200  1568 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.317s	user 0.016s	sys 0.041s
I20260709 12:59:52.745814  1645 rpcz_store.cc:276] 0709 12:59:51.601395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.601968 (+   573us) service_pool.cc:224] Handling call
0709 12:59:51.616902 (+ 14934us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:51.617128 (+   226us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:59:51.766826 (+149698us) log.cc:844] Serialized 14 byte log entry
0709 12:59:52.736232 (+969406us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:52.736303 (+    71us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:52.736374 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:52.736466 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:52.736767 (+   301us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51649,"prepare.queue_time_us":149330,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":13749,"thread_start_us":951371,"threads_started":1}
I20260709 12:59:52.713570  4782 raft_consensus.cc:740] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:52.772850  1617 leader_election.cc:304] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:52.707084  4670 raft_consensus.cc:515] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:52.814363  1574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 1981) took 1374 ms. Trace:
I20260709 12:59:52.814949  1574 rpcz_store.cc:276] 0709 12:59:51.439641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.439779 (+   138us) service_pool.cc:224] Handling call
0709 12:59:52.506478 (+1066699us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:52.526369 (+ 19891us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:52.814120 (+287751us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b540017e150. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23ba8ad 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:52.814293 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2452372736}
W20260709 12:59:52.737993  4690 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.943s	user 0.085s	sys 0.098s
I20260709 12:59:52.849898  4731 raft_consensus.cc:493] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:52.819986  4806 raft_consensus.cc:493] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:52.850726  4731 raft_consensus.cc:515] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
W20260709 12:59:52.819371  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 46588.6us
I20260709 12:59:52.853719  1647 raft_consensus.cc:1275] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:59:52.854346  1617 leader_election.cc:304] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:52.855595  1617 leader_election.cc:304] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:52.857343  1617 leader_election.cc:304] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:52.713987  4676 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:52.714886  4687 raft_consensus.cc:515] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:52.744333  4734 raft_consensus.cc:3060] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:52.851241  4806 raft_consensus.cc:515] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:52.787652  4789 raft_consensus.cc:3060] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:52.787146  4739 raft_consensus.cc:493] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:52.856230  4649 raft_consensus.cc:493] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:52.919279  4655 leader_election.cc:290] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:59:52.920253  4805 log.cc:927] Time spent T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.812s	user 0.006s	sys 0.012s
I20260709 12:59:52.932492  1651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 521) took 1331 ms. Trace:
W20260709 12:59:53.075347  1689 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.026s	sys 0.036s
W20260709 12:59:53.076005  1689 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.027s	sys 0.036s
W20260709 12:59:53.076237  1650 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.014s	sys 0.005s
W20260709 12:59:53.076994  1650 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.014s	sys 0.006s
I20260709 12:59:53.075739  1651 rpcz_store.cc:276] 0709 12:59:51.601058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.680934 (+ 79876us) service_pool.cc:224] Handling call
0709 12:59:52.464851 (+783917us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:52.465106 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:59:52.465398 (+   292us) log.cc:844] Serialized 14 byte log entry
0709 12:59:52.931972 (+466574us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:52.932058 (+    86us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:52.932136 (+    78us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:52.932247 (+   111us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:52.932407 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":20213,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":56,"raft.queue_time_us":1457,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":906,"thread_start_us":466190,"threads_started":1,"wal-append.queue_time_us":532763}
I20260709 12:59:53.078493  1650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 1509) took 1873 ms. Trace:
W20260709 12:59:53.080965  1717 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.005s	sys 0.016s
W20260709 12:59:53.081491  1717 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.005s	sys 0.016s
W20260709 12:59:53.084043  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 606706us
I20260709 12:59:53.085367  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 620) took 1662 ms. Trace:
I20260709 12:59:53.085922  1570 rpcz_store.cc:276] 0709 12:59:51.422923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.423025 (+   102us) service_pool.cc:224] Handling call
0709 12:59:51.423262 (+   237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:52.694019 (+1270757us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.084669 (+390650us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b540024a4d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:53.085131 (+   462us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2832312064}
W20260709 12:59:52.950168  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 1.33555e+06us
I20260709 12:59:53.092146  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 611) took 1674 ms. Trace:
I20260709 12:59:53.092720  1569 rpcz_store.cc:276] 0709 12:59:51.417413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.417551 (+   138us) service_pool.cc:224] Handling call
0709 12:59:51.417873 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:52.738277 (+1320404us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:52.738326 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:52.738388 (+    62us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:52.738437 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.091580 (+353143us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54002eaed4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:53.091649 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:53.091949 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3036043648}
W20260709 12:59:52.970214  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 454504us
W20260709 12:59:53.064492  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 543814us
I20260709 12:59:53.095857  1539 leader_election.cc:304] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 12:59:53.070024  1542 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.000s	sys 0.014s
W20260709 12:59:53.098299  1542 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.000s	sys 0.014s
W20260709 12:59:53.098964  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 572605us
I20260709 12:59:53.066756  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 1978) took 1629 ms. Trace:
W20260709 12:59:53.073190  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 215736us
I20260709 12:59:53.100963  1568 rpcz_store.cc:276] 0709 12:59:51.437381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.437507 (+   126us) service_pool.cc:224] Handling call
0709 12:59:51.437809 (+   302us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:51.438125 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:51.438161 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:51.452007 (+ 13846us) log.cc:844] Serialized 26 byte log entry
0709 12:59:52.769817 (+1317810us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:52.769879 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:52.769982 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:53.065815 (+295833us) raft_consensus.cc:1685] finished
0709 12:59:53.065887 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:53.066392 (+   505us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16201,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":10696,"thread_start_us":1317322,"threads_started":1,"wal-append.queue_time_us":1485507}
I20260709 12:59:53.102820  1571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 613) took 1684 ms. Trace:
W20260709 12:59:53.070640  1616 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.022s	sys 0.039s
I20260709 12:59:53.103912  1617 leader_election.cc:304] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
W20260709 12:59:53.067346  1540 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.001s	sys 0.013s
W20260709 12:59:53.104846  1540 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.001s	sys 0.014s
I20260709 12:59:53.104887  1689 leader_election.cc:304] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:52.971979  4525 leader_election.cc:290] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:53.104313  1616 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.023s	sys 0.039s
I20260709 12:59:52.978230  4571 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:52.925522  4623 raft_consensus.cc:493] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:52.916970  4649 raft_consensus.cc:515] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:52.980903  4670 leader_election.cc:290] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:52.988860  4676 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:52.941497  4687 leader_election.cc:290] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:53.208474  4619 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:53.214182  4851 raft_consensus.cc:493] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.214778  4619 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:52.940160  4717 leader_election.cc:290] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:53.030783  4709 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:52.946923  4731 leader_election.cc:290] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:53.185050  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:53.033461  4738 leader_election.cc:290] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:52.913187  4739 raft_consensus.cc:515] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:52.911554  4782 consensus_queue.cc:260] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:53.001418  4789 raft_consensus.cc:515] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:53.028149  4801 log.cc:927] Time spent T 00000000000000000000000000000000 P fcfaa17e55ae48e194c5d95ca24a659f: Append to log took a long time: real 0.146s	user 0.000s	sys 0.002s
W20260709 12:59:52.989768  4808 log.cc:927] Time spent T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.104s	user 0.001s	sys 0.001s
W20260709 12:59:52.999402  4814 log.cc:927] Time spent T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
W20260709 12:59:52.939136  4815 log.cc:927] Time spent T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 12:59:52.921947  4819 log.cc:927] Time spent T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:59:52.925613  4824 raft_consensus.cc:2749] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:53.026304  4827 raft_consensus.cc:493] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:53.023136  4831 raft_consensus.cc:493] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:53.167929  4822 consensus_queue.cc:1059] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.077s
I20260709 12:59:53.020516  4836 raft_consensus.cc:493] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.022955  4840 raft_consensus.cc:493] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.103427  1571 rpcz_store.cc:276] 0709 12:59:51.417968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.420855 (+  2887us) service_pool.cc:224] Handling call
0709 12:59:51.421145 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:52.669443 (+1248298us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:52.669490 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:52.669547 (+    57us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:52.669595 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.102210 (+432615us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b5400103954. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:53.102294 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:53.102612 (+   318us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2870237568}
I20260709 12:59:53.078972  1650 rpcz_store.cc:276] 0709 12:59:51.205421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.205790 (+   369us) service_pool.cc:224] Handling call
0709 12:59:51.206229 (+   439us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:51.206489 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:59:51.206800 (+   311us) log.cc:844] Serialized 14 byte log entry
0709 12:59:53.077681 (+1870881us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:53.077817 (+   136us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:53.077930 (+   113us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.078073 (+   143us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:53.078326 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18344,"prepare.queue_time_us":641,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":248442,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":6996,"thread_start_us":1851769,"threads_started":2,"wal-append.queue_time_us":1647671}
I20260709 12:59:53.149907  4849 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:53.156257  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 58762.5us
I20260709 12:59:53.158202  4734 raft_consensus.cc:515] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:53.159363  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:53.177723  4842 consensus_queue.cc:1059] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.079s
W20260709 12:59:53.161722  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 54211.9us
I20260709 12:59:53.161926  4769 raft_consensus.cc:493] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:53.159894  4820 raft_consensus.cc:2804] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:53.170668  4623 raft_consensus.cc:515] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:53.185001  4783 raft_consensus.cc:493] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.192806  4145 raft_consensus.cc:493] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:53.215265  4851 raft_consensus.cc:515] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:52.938978  4806 leader_election.cc:290] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:53.192799  4837 raft_consensus.cc:493] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
W20260709 12:59:53.159852  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:53.220510  4709 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.273288  4709 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:53.221282  4525 raft_consensus.cc:493] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:53.277475  4525 raft_consensus.cc:515] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:53.221637  4641 raft_consensus.cc:493] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:53.281471  4641 raft_consensus.cc:515] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:53.282166  4690 raft_consensus.cc:2749] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:53.282606  1725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2055) took 2818 ms. Trace:
I20260709 12:59:53.222899  1651 raft_consensus.cc:2393] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 9: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:53.284191  4641 leader_election.cc:290] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:53.232903  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:53.238941  1648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 1510) took 2031 ms. Trace:
I20260709 12:59:53.233341  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:53.229146  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:53.276161  4709 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:53.222661  2294 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:53.263691  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 608) took 2594 ms. Trace:
I20260709 12:59:53.247771  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:59:53.248907  1615 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.004s	sys 0.010s
W20260709 12:59:53.231480  4848 log.cc:927] Time spent T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:59:53.241140  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45148 (request call id 2100) took 1915 ms. Trace:
I20260709 12:59:53.250490  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 517) took 1908 ms. Trace:
W20260709 12:59:53.271329  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 166720us
I20260709 12:59:53.234097  1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 523) took 1607 ms. Trace:
I20260709 12:59:53.240382  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:53.280347  4525 leader_election.cc:290] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:53.266418  2295 leader_election.cc:304] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:53.225874  4708 leader_election.cc:290] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:53.283078  1725 rpcz_store.cc:276] 0709 12:59:50.463654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.533468 (+ 69814us) service_pool.cc:224] Handling call
0709 12:59:50.533752 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:50.534097 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:59:51.218309 (+684212us) spinlock_profiling.cc:243] Waited 27.8 ms on lock 0x7b180047ab20. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef248c0a 00007fa9f8988219 00007fa9ef2d0a40 00007fa9ef2cb4e4 00007fa9ef2cb455 00007fa9f5db33c7 00007fa9f23c59a7 00007fa9f23d50bf 00007fa9f23d5038
0709 12:59:52.493320 (+1275011us) log.cc:844] Serialized 14 byte log entry
0709 12:59:53.169255 (+675935us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:53.255834 (+ 86579us) spinlock_profiling.cc:243] Waited 39.2 ms on lock 0x7b4800240258. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f72e4aa1 00007fa9f72dbb37 00007fa9f72db9ca 00007fa9f73d326f 00007fa9f73d2f37 00007fa9f73e755c 00007fa9f73e7508 00007fa9f73e7488 00007fa9f73e7443 00007fa9f73e66ec 00007fa9f6310a96
0709 12:59:53.271822 (+ 15988us) log.cc:844] Serialized 26 byte log entry
0709 12:59:53.279763 (+  7941us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:53.280075 (+   312us) log.cc:844] Serialized 14 byte log entry
0709 12:59:53.281367 (+  1292us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.282161 (+   794us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:53.282204 (+    43us) raft_consensus.cc:1685] finished
0709 12:59:53.282217 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:53.282414 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34341,"prepare.queue_time_us":687466,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":71,"raft.queue_time_us":122662,"raft.run_cpu_time_us":3719,"raft.run_wall_time_us":78353,"spinlock_wait_cycles":154201728,"thread_start_us":1762933,"threads_started":3,"wal-append.queue_time_us":395396}
W20260709 12:59:53.311523  1615 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.004s	sys 0.010s
I20260709 12:59:53.262284  2297 leader_election.cc:304] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e
W20260709 12:59:53.236238  1542 leader_election.cc:336] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.934s (SENT)
I20260709 12:59:53.262044  4623 leader_election.cc:290] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:53.267448  4851 leader_election.cc:290] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:53.237066  4740 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.242321  4649 leader_election.cc:290] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:53.259500  4820 raft_consensus.cc:493] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:53.240054  4619 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:53.250761  4833 raft_consensus.cc:2804] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:53.214182  4852 raft_consensus.cc:2749] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:53.266256  4738 raft_consensus.cc:3055] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:53.256635  4842 raft_consensus.cc:493] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.272298  4739 leader_election.cc:290] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:53.309759  1646 rpcz_store.cc:276] 0709 12:59:51.325284 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.325446 (+   162us) service_pool.cc:224] Handling call
0709 12:59:51.325897 (+   451us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:51.326253 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:51.326280 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:51.326688 (+   408us) log.cc:844] Serialized 26 byte log entry
0709 12:59:52.482681 (+1155993us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:52.482735 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:52.482819 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:53.240622 (+757803us) raft_consensus.cc:1685] finished
0709 12:59:53.240666 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:53.240940 (+   274us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":336,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":99,"thread_start_us":1155635,"threads_started":1,"wal-append.queue_time_us":1521204}
I20260709 12:59:53.269308  4782 raft_consensus.cc:3060] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:53.288122  1648 rpcz_store.cc:276] 0709 12:59:51.207900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.208048 (+   148us) service_pool.cc:224] Handling call
0709 12:59:51.208574 (+   526us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:51.208910 (+   336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:51.208933 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:51.210021 (+  1088us) log.cc:844] Serialized 564 byte log entry
0709 12:59:52.474853 (+1264832us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:52.474895 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:52.475022 (+   127us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:53.238391 (+763369us) raft_consensus.cc:1685] finished
0709 12:59:53.238435 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:53.238685 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":1264561,"threads_started":1,"wal-append.queue_time_us":1540812}
I20260709 12:59:53.245370  4822 raft_consensus.cc:3055] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:53.240144  4855 raft_consensus.cc:493] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.250900  4310 raft_consensus.cc:2749] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:53.259244  4543 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.259021  4676 raft_consensus.cc:493] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:53.328506  4820 raft_consensus.cc:3060] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:53.257159  4769 raft_consensus.cc:515] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:53.370620  4834 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.250710  4655 raft_consensus.cc:2749] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:53.330814  1649 raft_consensus.cc:2468] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 6.
I20260709 12:59:53.254616  4734 leader_election.cc:290] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:53.250682  4829 raft_consensus.cc:2749] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:53.265192  4783 raft_consensus.cc:515] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:53.234107  4850 raft_consensus.cc:493] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:53.375664  4850 raft_consensus.cc:515] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:53.377239  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 524) took 1605 ms. Trace:
I20260709 12:59:53.329290  1542 leader_election.cc:304] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:53.378314  4850 leader_election.cc:290] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:53.335040  1689 leader_election.cc:304] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:53.337410  4649 raft_consensus.cc:493] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
W20260709 12:59:53.379033  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 142913us
I20260709 12:59:53.245402  4831 raft_consensus.cc:515] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:53.379568  4649 raft_consensus.cc:515] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:53.380856  4687 raft_consensus.cc:2749] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:59:53.336794  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:53.381796  4831 leader_election.cc:290] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:53.382200  4649 leader_election.cc:290] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:53.337461  1568 raft_consensus.cc:2468] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 5.
I20260709 12:59:53.339255  4525 raft_consensus.cc:493] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:53.383446  4525 raft_consensus.cc:515] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:53.384768  4829 consensus_queue.cc:1048] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:53.386379  4525 leader_election.cc:290] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:53.384354  4856 consensus_queue.cc:1059] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 12:59:53.258749  4601 consensus_queue.cc:1048] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 12:59:53.389299  1615 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:53.389757  4601 raft_consensus.cc:2804] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:53.377794  1644 rpcz_store.cc:276] 0709 12:59:51.688728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.814318 (+125590us) service_pool.cc:224] Handling call
0709 12:59:51.814708 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:51.814949 (+   241us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:59:52.735331 (+920382us) log.cc:844] Serialized 14 byte log entry
0709 12:59:53.280422 (+545091us) log.cc:844] Serialized 14 byte log entry
0709 12:59:53.281640 (+  1218us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:53.281716 (+    76us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:53.281827 (+   111us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.284739 (+  2912us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:53.293926 (+  9187us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":93733,"prepare.run_cpu_time_us":84,"prepare.run_wall_time_us":87,"raft.queue_time_us":42593,"raft.run_cpu_time_us":443,"raft.run_wall_time_us":23846,"thread_start_us":1396333,"threads_started":3,"wal-append.queue_time_us":411341}
I20260709 12:59:53.343549  4709 raft_consensus.cc:493] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:53.390231  4601 raft_consensus.cc:493] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:53.371587  4834 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:53.390825  4601 raft_consensus.cc:3060] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:53.391039  4709 raft_consensus.cc:515] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:53.266566  4824 consensus_queue.cc:1048] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.066s
I20260709 12:59:53.393350  4834 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:53.246886  4840 raft_consensus.cc:515] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:53.344694  4789 leader_election.cc:290] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:53.395922  4840 leader_election.cc:290] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:53.265671  4145 raft_consensus.cc:515] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:53.398296  4145 leader_election.cc:290] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:53.248356  4849 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:59:53.400637  4849 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:53.331286  4738 raft_consensus.cc:740] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:53.250612  4817 consensus_queue.cc:1059] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.165s
W20260709 12:59:53.353493  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 91486.1us
I20260709 12:59:53.352227  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:53.394039  4709 leader_election.cc:290] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:53.402185  4738 consensus_queue.cc:260] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:53.351346  4641 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:53.329758  4833 raft_consensus.cc:493] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:53.409646  4833 raft_consensus.cc:3060] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:53.410262  4739 raft_consensus.cc:2804] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:53.411854  4817 raft_consensus.cc:3055] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:53.228658  4770 consensus_queue.cc:1048] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.174s
I20260709 12:59:53.412370  4817 raft_consensus.cc:740] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:53.246145  4836 raft_consensus.cc:515] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:53.414040  4817 consensus_queue.cc:260] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:53.360581  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 96264.9us
I20260709 12:59:53.361229  4806 raft_consensus.cc:493] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:53.360998  4676 raft_consensus.cc:515] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:53.362640  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 140394us
W20260709 12:59:53.363644  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 97487.1us
I20260709 12:59:53.416424  4806 raft_consensus.cc:515] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:53.418004  4789 consensus_queue.cc:1048] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:59:53.419452  4739 raft_consensus.cc:697] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 7 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:53.363469  4740 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:53.420593  4655 consensus_queue.cc:1175] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" responder_term: 6 status { last_received { term: 6 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 6 index: 4 } }
I20260709 12:59:53.364563  4843 raft_consensus.cc:2804] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:53.423923  4843 raft_consensus.cc:697] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:53.362603  4543 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:53.433694  4709 consensus_queue.cc:1059] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:53.244498  4827 raft_consensus.cc:515] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:53.436265  4709 consensus_queue.cc:1243] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer 05476b84d8f84d76a9a1f51b620a3c66 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:59:53.436902  4687 raft_consensus.cc:3055] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:53.437301  4687 raft_consensus.cc:740] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:53.438485  4687 consensus_queue.cc:260] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:53.439934  4687 raft_consensus.cc:3060] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:53.370836  4769 leader_election.cc:290] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:53.371366  4855 raft_consensus.cc:515] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:53.335672  4822 raft_consensus.cc:740] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:53.442142  4822 consensus_queue.cc:260] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:53.387418  4856 raft_consensus.cc:3055] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:53.444295  4856 raft_consensus.cc:740] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:53.445912  4856 consensus_queue.cc:260] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:53.447875  4856 raft_consensus.cc:3060] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:53.309883  1642 rpcz_store.cc:276] 0709 12:59:51.341874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.342444 (+   570us) service_pool.cc:224] Handling call
0709 12:59:51.342845 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:51.343265 (+   420us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:51.343303 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:51.343852 (+   549us) log.cc:844] Serialized 26 byte log entry
0709 12:59:52.467724 (+1123872us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:52.467766 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:52.467836 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:52.938529 (+470693us) spinlock_profiling.cc:243] Waited 23.4 ms on lock 0x7b4400022b4c. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef1f4c85 00007fa9ef1f56a2 00007fa9f1f671db 00007fa9f1f62aaf 00007fa9f1f5686e 00007fa9f1f55bb6 00007fa9f1f557d8 00007fa9f1f5f221 00007fa9f1f5f1d9 00007fa9f1f5f169
0709 12:59:53.249985 (+311456us) raft_consensus.cc:1685] finished
0709 12:59:53.250017 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:53.250321 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1462,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":98,"spinlock_wait_cycles":53749120,"thread_start_us":1123482,"threads_started":1,"wal-append.queue_time_us":1383575}
I20260709 12:59:53.268829  4837 raft_consensus.cc:515] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:53.312088  1643 rpcz_store.cc:276] 0709 12:59:51.601766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.601871 (+   105us) service_pool.cc:224] Handling call
0709 12:59:52.468318 (+866447us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:52.468549 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:59:52.858683 (+390134us) log.cc:844] Serialized 14 byte log entry
0709 12:59:53.188259 (+329576us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:53.189537 (+  1278us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:59:53.189699 (+   162us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.189885 (+   186us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:53.208695 (+ 18810us) inbound_call.cc:177] Queueing success response
0709 12:59:53.230458 (+ 21763us) spinlock_profiling.cc:243] Waited 1.77 ms on lock 0x7b4400022b4c. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef1f4c85 00007fa9ef1f56a2 00007fa9f1f671db 00007fa9f1f62aaf 00007fa9f1f5686e 00007fa9f1f55bb6 00007fa9f1f557d8 00007fa9f1f5f221 00007fa9f1f5f1d9 00007fa9f1f5f169
0709 12:59:53.273757 (+ 43299us) spinlock_profiling.cc:243] Waited 24 ms on lock 0x7b4800043d58. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f72e4aa1 00007fa9f72dbb37 00007fa9f72db9ca 00007fa9f73d326f 00007fa9f73d2f37 00007fa9f73e755c 00007fa9f73e7508 00007fa9f73e7488 00007fa9f73e7443 00007fa9f73e66ec 00007fa9f6310a96
Metrics: {"mutex_wait_us":17990,"prepare.queue_time_us":178528,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":39982,"raft.run_cpu_time_us":1811,"raft.run_wall_time_us":77076,"spinlock_wait_cycles":59327744,"thread_start_us":684272,"threads_started":2,"wal-append.queue_time_us":284453}
I20260709 12:59:53.402097  1651 raft_consensus.cc:2468] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 6.
I20260709 12:59:53.349582  4708 raft_consensus.cc:493] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:53.451402  4708 raft_consensus.cc:515] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:53.380187  1542 leader_election.cc:336] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 3.314s (SENT)
I20260709 12:59:53.456838  1542 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:53.359977  4706 raft_consensus.cc:2804] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:53.458740  4706 raft_consensus.cc:697] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:53.297510  1717 rpcz_store.cc:276] 0709 12:59:50.614823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.614986 (+   163us) service_pool.cc:224] Handling call
0709 12:59:50.615303 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:50.615520 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:59:52.473678 (+1858158us) log.cc:844] Serialized 14 byte log entry
0709 12:59:53.172520 (+698842us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:53.182506 (+  9986us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:53.190512 (+  8006us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.194650 (+  4138us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:53.208919 (+ 14269us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":604179,"prepare.queue_time_us":606117,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":101901,"raft.run_cpu_time_us":352,"raft.run_wall_time_us":19734,"thread_start_us":1939768,"threads_started":3,"wal-append.queue_time_us":550125}
I20260709 12:59:53.425297  4641 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:53.376307  4783 leader_election.cc:290] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:53.364830  4842 raft_consensus.cc:515] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:53.425310  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:53.430218  4843 consensus_queue.cc:237] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:53.432770  4649 consensus_queue.cc:1048] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:53.461054  4145 consensus_queue.cc:1048] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:59:53.497607  1568 raft_consensus.cc:3060] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:59:53.460425  4844 consensus_queue.cc:1048] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:59:53.499478  2294 leader_election.cc:304] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:53.502761  4855 leader_election.cc:290] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:53.504159  4709 raft_consensus.cc:2749] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:59:53.505308  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 174645us
I20260709 12:59:53.508649  4543 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:53.509294  4850 raft_consensus.cc:2749] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:53.460399  4706 consensus_queue.cc:237] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:53.517756  4708 leader_election.cc:290] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:53.522529  4783 raft_consensus.cc:2804] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:53.523180  4783 raft_consensus.cc:493] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:53.523650  4783 raft_consensus.cc:3060] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:53.528647  4738 raft_consensus.cc:3060] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:53.529136  4836 leader_election.cc:290] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:53.530117  4641 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:53.531191  1689 leader_election.cc:304] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 12:59:53.531569  4145 consensus_queue.cc:1048] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:53.532647  1689 leader_election.cc:304] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 12:59:53.533936  4831 raft_consensus.cc:2804] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:59:53.534754  4831 raft_consensus.cc:697] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 5 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:53.536149  4827 leader_election.cc:290] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:53.458529  4739 consensus_queue.cc:237] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:59:53.536844  4740 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:53.536922  4850 raft_consensus.cc:2804] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:59:53.559903  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 179798us
I20260709 12:59:53.552235  4836 raft_consensus.cc:493] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.563877  4145 consensus_queue.cc:1048] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:53.564739  4543 consensus_queue.cc:1048] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:53.568213  1617 leader_election.cc:304] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:53.575287  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:53.577607  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:53.577807  4833 raft_consensus.cc:515] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:53.578492  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:53.579492  1717 raft_consensus.cc:2393] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 6: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:59:53.575466  1568 raft_consensus.cc:2468] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 6.
I20260709 12:59:53.580950  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:53.581096  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:53.578544  1725 raft_consensus.cc:2393] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 7: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:59:53.591498  2295 leader_election.cc:304] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:53.596563  1617 leader_election.cc:400] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 3 pre-election: Vote denied by peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473) with higher term. Message: Invalid argument: T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 3. Current term is 4.
I20260709 12:59:53.596669  4806 leader_election.cc:290] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:53.601236  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:53.602100  1717 raft_consensus.cc:2368] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 7. Current term is 8.
I20260709 12:59:53.602195  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:53.602778  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:53.603026  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:53.603389  1716 raft_consensus.cc:2468] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6.
W20260709 12:59:53.603412  1617 connection.cc:256] RPC call timeout handler was delayed by -2.0501678090000155s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18700000000000003s for a response
I20260709 12:59:53.603814  1725 raft_consensus.cc:2393] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 6: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
W20260709 12:59:53.604038  1617 connection.cc:256] RPC call timeout handler was delayed by -1.80688898599999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20440000000000003s for a response
W20260709 12:59:53.604422  1617 connection.cc:256] RPC call timeout handler was delayed by -1.6110149419999971s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2174s for a response
W20260709 12:59:53.604817  1617 connection.cc:256] RPC call timeout handler was delayed by -1.3840801350000334s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2838s for a response
I20260709 12:59:53.601434  1718 raft_consensus.cc:1240] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:53.536239  4831 consensus_queue.cc:237] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:53.619529  1542 leader_election.cc:336] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.851s (SENT)
I20260709 12:59:53.623374  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:53.569499  4850 raft_consensus.cc:697] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 5 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:53.593465  4822 raft_consensus.cc:3060] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:53.631364  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:53.632433  1542 leader_election.cc:304] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:53.632778  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:53.616952  4817 raft_consensus.cc:3060] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:53.595077  4676 leader_election.cc:290] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:53.633319  1615 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:53.636320  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:53.640087  1651 raft_consensus.cc:2468] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 5.
W20260709 12:59:53.645624  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 52621.4us
I20260709 12:59:53.575528  4820 raft_consensus.cc:515] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:53.592775  4836 raft_consensus.cc:515] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:53.634694  4844 raft_consensus.cc:2804] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:53.663427  1724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 617) took 2142 ms. Trace:
I20260709 12:59:53.659003  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:53.659876  1719 raft_consensus.cc:2468] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8.
I20260709 12:59:53.705927  1725 raft_consensus.cc:2410] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 12:59:53.710072  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:53.650094  4676 raft_consensus.cc:2804] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:53.703946  4649 raft_consensus.cc:2749] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:53.649483  4833 leader_election.cc:290] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:53.719152  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:53.663946  1724 rpcz_store.cc:276] 0709 12:59:51.414457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:51.414996 (+   539us) service_pool.cc:224] Handling call
0709 12:59:51.415313 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:51.415503 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:59:51.486535 (+ 71032us) log.cc:844] Serialized 14 byte log entry
0709 12:59:53.087044 (+1600509us) log.cc:844] Serialized 14 byte log entry
0709 12:59:53.317952 (+230908us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:53.321183 (+  3231us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:59:53.333450 (+ 12267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.408178 (+ 74728us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:53.556360 (+148182us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38341,"prepare.queue_time_us":764182,"prepare.run_cpu_time_us":100,"prepare.run_wall_time_us":3793,"raft.queue_time_us":160750,"raft.run_cpu_time_us":307,"raft.run_wall_time_us":5740,"thread_start_us":1821767,"threads_started":3,"wal-append.queue_time_us":1151831}
I20260709 12:59:53.704093  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:53.724936  1720 raft_consensus.cc:3060] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:53.725719  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:53.726926  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 113427us
I20260709 12:59:53.665740  4842 leader_election.cc:290] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:59:53.743374  1542 connection.cc:256] RPC call timeout handler was delayed by -1.032512617000009s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2235s for a response
I20260709 12:59:53.729272  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:53.738277  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:53.649583  4601 raft_consensus.cc:515] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:53.729403  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:53.748852  2294 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:53.715652  4844 raft_consensus.cc:697] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:53.715957  4676 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:53.754513  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:53.762526  2332 raft_consensus.cc:1275] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:59:53.760684  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 43876.7us
I20260709 12:59:53.742622  4770 raft_consensus.cc:493] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.765326  4833 raft_consensus.cc:493] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.771826  1648 raft_consensus.cc:3060] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:53.767257  1721 raft_consensus.cc:2410] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:59:53.776322  1720 raft_consensus.cc:2468] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 9.
I20260709 12:59:53.779139  1717 raft_consensus.cc:1275] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:59:53.778265  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:59:53.778343  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 54713.7us
I20260709 12:59:53.784953  1649 raft_consensus.cc:2410] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:59:53.752125  4676 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:53.795444  4601 leader_election.cc:290] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:53.798236  4858 raft_consensus.cc:493] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.798920  4858 raft_consensus.cc:515] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:53.799486  2329 raft_consensus.cc:1275] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:59:53.800491  1646 raft_consensus.cc:2393] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 8: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:53.800874  4862 raft_consensus.cc:493] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:53.801445  4862 raft_consensus.cc:515] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:53.802016  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:53.802832  2323 raft_consensus.cc:2393] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 7: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 12:59:53.803203  4861 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.803795  4861 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:53.804204  1617 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.870s (SENT) [suppressed 19 similar messages]
I20260709 12:59:53.805552  4853 raft_consensus.cc:2749] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:59:53.806861  4864 log.cc:927] Time spent T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:59:53.828243  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:59:54.166453  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:54.296384  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:53.850229  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:59:53.908699  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 104522us
I20260709 12:59:54.228163  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:54.297379  1725 raft_consensus.cc:2468] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 7.
I20260709 12:59:53.936444  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:59:53.907059  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 79575.2us
W20260709 12:59:54.098263  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 52273.6us
W20260709 12:59:54.313048  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 569252us
I20260709 12:59:54.319411  2294 leader_election.cc:304] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 12:59:53.911603  1542 leader_election.cc:336] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.571s (SENT)
I20260709 12:59:54.298229  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:53.833149  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:54.339975  1542 leader_election.cc:304] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
W20260709 12:59:54.023159  4871 log.cc:927] Time spent T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 12:59:53.993065  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:53.949425  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 12:59:54.133311  4863 log.cc:927] Time spent T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.317s	user 0.001s	sys 0.000s
I20260709 12:59:54.294425  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:53.854663  4555 raft_consensus.cc:2804] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:54.130399  4837 leader_election.cc:290] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:54.364735  1643 raft_consensus.cc:2468] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 7.
I20260709 12:59:53.832844  4687 raft_consensus.cc:493] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:53.789448  4842 consensus_queue.cc:1048] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.534s
I20260709 12:59:54.128515  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:54.262713  4858 leader_election.cc:290] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:54.369292  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:54.186666  4862 leader_election.cc:290] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:53.956758  4820 leader_election.cc:290] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:54.372767  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:54.169971  4861 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:54.374454  2295 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.014s	sys 0.026s
I20260709 12:59:53.797080  4770 raft_consensus.cc:515] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:54.377617  1725 raft_consensus.cc:2368] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 7. Current term is 8.
I20260709 12:59:53.854943  4731 raft_consensus.cc:493] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:54.376996  1570 raft_consensus.cc:3060] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:59:54.367816  4738 consensus_meta.cc:287] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.837s	user 0.008s	sys 0.011s
W20260709 12:59:54.393522  2295 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.015s	sys 0.026s
I20260709 12:59:54.394443  1645 raft_consensus.cc:2468] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 7.
I20260709 12:59:54.405187  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:54.405927  1649 raft_consensus.cc:2468] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 6.
I20260709 12:59:53.855214  4833 raft_consensus.cc:515] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:54.366532  4555 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:54.400868  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:54.409178  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:54.409677  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45148 (request call id 2109) took 1137 ms. Trace:
I20260709 12:59:54.409842  1725 raft_consensus.cc:2376] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 9. Re-sending same reply.
I20260709 12:59:54.410071  1647 rpcz_store.cc:276] 0709 12:59:53.158043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.168992 (+ 10949us) service_pool.cc:224] Handling call
0709 12:59:53.181312 (+ 12320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:53.333836 (+152524us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:53.333868 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:53.342655 (+  8787us) log.cc:844] Serialized 26 byte log entry
0709 12:59:53.468211 (+125556us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:53.468264 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:53.468339 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:54.294790 (+826451us) raft_consensus.cc:1685] finished
0709 12:59:54.294811 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:54.294924 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":22856,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":172,"thread_start_us":243200,"threads_started":2,"wal-append.queue_time_us":286215}
W20260709 12:59:54.409411  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:54.404417  4783 consensus_meta.cc:287] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.880s	user 0.014s	sys 0.000s
I20260709 12:59:54.349613  4838 raft_consensus.cc:2804] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:53.914093  4850 consensus_queue.cc:237] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:53.947616  4844 consensus_queue.cc:237] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:54.417922  1615 leader_election.cc:304] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:54.434868  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:54.434530  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:54.400249  4836 leader_election.cc:290] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 12:59:54.439749  1617 leader_election.cc:336] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.174s (SENT)
I20260709 12:59:54.440021  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:54.413403  4555 raft_consensus.cc:3060] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:54.378001  4837 raft_consensus.cc:2749] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:54.374905  4856 consensus_queue.cc:1048] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 12:59:54.452725  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:54.455715  1717 raft_consensus.cc:2410] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:59:54.426525  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:54.457003  1719 raft_consensus.cc:2410] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 8 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:59:54.419795  4783 raft_consensus.cc:515] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:54.431197  4838 raft_consensus.cc:493] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:54.465909  4838 raft_consensus.cc:3060] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:54.467240  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 64052.5us
I20260709 12:59:54.431780  4687 raft_consensus.cc:515] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:54.484871  4731 raft_consensus.cc:515] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:54.487593  4738 raft_consensus.cc:2804] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:54.488941  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:54.454216  4858 raft_consensus.cc:493] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
W20260709 12:59:54.504287  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 70878.3us
I20260709 12:59:54.466421  4837 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.498675  4738 raft_consensus.cc:493] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:54.523741  4770 leader_election.cc:290] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:54.525977  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:54.526930  1716 raft_consensus.cc:2468] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 8.
I20260709 12:59:54.529515  1688 leader_election.cc:304] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:54.530208  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:54.531581  4783 leader_election.cc:290] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:54.518281  4738 raft_consensus.cc:3060] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:54.536180  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:54.542261  4731 leader_election.cc:290] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:59:54.461843  4766 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.001s	sys 0.052s
W20260709 12:59:54.569169  1648 consensus_meta.cc:287] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.790s	user 0.008s	sys 0.004s
I20260709 12:59:54.569705  1648 raft_consensus.cc:2468] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 8.
I20260709 12:59:54.564476  1570 raft_consensus.cc:2468] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 7.
I20260709 12:59:54.589285  4858 raft_consensus.cc:515] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:54.592941  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 12:59:54.599453  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 89094.6us
W20260709 12:59:54.566476  4766 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.002s	sys 0.052s
I20260709 12:59:54.601459  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:54.604928  2295 leader_election.cc:304] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:54.607841  1651 raft_consensus.cc:1275] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:59:54.569269  4836 raft_consensus.cc:2804] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:54.624202  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:54.630472  1717 raft_consensus.cc:2393] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 7: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:59:54.631559  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:54.634346  1649 raft_consensus.cc:1275] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:59:54.635067  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:54.638856  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:54.635936  1721 raft_consensus.cc:2468] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6.
I20260709 12:59:54.586982  4837 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:54.618566  4836 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:54.620114  4843 raft_consensus.cc:2804] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:54.648497  4886 raft_consensus.cc:493] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:54.649263  4883 log.cc:927] Time spent T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:59:54.651033  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:54.663046  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:54.667145  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:54.641440  4770 raft_consensus.cc:493] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:54.670503  1717 raft_consensus.cc:2410] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:59:54.652122  4836 raft_consensus.cc:3060] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:54.645272  4856 raft_consensus.cc:493] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:54.711185  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:54.711885  1721 raft_consensus.cc:2376] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 9. Re-sending same reply.
I20260709 12:59:54.720252  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:54.722078  1648 raft_consensus.cc:3060] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:54.666180  4843 raft_consensus.cc:697] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:54.718828  1647 raft_consensus.cc:3055] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:54.733158  1649 raft_consensus.cc:1240] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 6. Current term is 7. Ops: [4.6-6.7]
I20260709 12:59:54.735227  2330 raft_consensus.cc:1240] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:59:54.732439  1647 raft_consensus.cc:740] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:54.739264  1647 consensus_queue.cc:260] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:54.740557  1647 raft_consensus.cc:3060] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:54.755014  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 637) took 1126 ms. Trace:
I20260709 12:59:54.767519  1568 rpcz_store.cc:276] 0709 12:59:53.629417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.631972 (+  2555us) service_pool.cc:224] Handling call
0709 12:59:53.636216 (+  4244us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:53.742864 (+106648us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:53.742895 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:53.783363 (+ 40468us) log.cc:844] Serialized 26 byte log entry
0709 12:59:54.426825 (+643462us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:54.426880 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:54.426977 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:54.754745 (+327768us) raft_consensus.cc:1685] finished
0709 12:59:54.754775 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:54.754944 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13174,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":19114,"thread_start_us":498838,"threads_started":1,"wal-append.queue_time_us":786038}
I20260709 12:59:54.746994  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:54.747431  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:54.752887  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:54.770519  1716 raft_consensus.cc:2468] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
I20260709 12:59:54.716907  4833 leader_election.cc:290] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:54.776602  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:54.791433  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:59:54.794559  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:54.809741  1540 leader_election.cc:336] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423): Timed out: RequestConsensusVote RPC to 127.0.107.196:34423 timed out after 1.540s (SENT)
I20260709 12:59:54.820197  1540 leader_election.cc:304] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:54.826773  1719 raft_consensus.cc:2393] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 8: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:59:54.774061  4858 leader_election.cc:290] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:54.731189  4856 raft_consensus.cc:515] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:54.835096  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:59:54.836359  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 306911us
I20260709 12:59:54.836918  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:54.838157  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 537) took 1216 ms. Trace:
I20260709 12:59:54.734521  4770 raft_consensus.cc:515] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:54.836725  1719 raft_consensus.cc:2468] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
I20260709 12:59:54.839638  1644 rpcz_store.cc:276] 0709 12:59:53.621491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.628866 (+  7375us) service_pool.cc:224] Handling call
0709 12:59:53.631369 (+  2503us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:53.631730 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:59:53.845285 (+213555us) log.cc:844] Serialized 14 byte log entry
0709 12:59:54.083303 (+238018us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:54.174023 (+ 90720us) log.cc:844] Serialized 26 byte log entry
0709 12:59:54.174215 (+   192us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:54.174262 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:54.174355 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:54.837902 (+663547us) raft_consensus.cc:1685] finished
0709 12:59:54.837930 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:54.838087 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":504612,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":416,"raft.run_cpu_time_us":229,"raft.run_wall_time_us":37940,"thread_start_us":437765,"threads_started":2,"wal-append.queue_time_us":611233}
W20260709 12:59:54.838971  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:54.752735  4731 consensus_queue.cc:1048] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
W20260709 12:59:54.845741  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:54.846253  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:54.852506  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:54.850771  1724 raft_consensus.cc:2468] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6.
I20260709 12:59:54.853276  1719 raft_consensus.cc:2468] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
I20260709 12:59:54.857797  1716 raft_consensus.cc:2393] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 6: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:59:54.871829  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:54.872911  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:54.877314  1717 raft_consensus.cc:2468] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 7.
I20260709 12:59:54.874194  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:54.906785  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:54.871912  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:54.872963  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:54.863406  4858 raft_consensus.cc:2749] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:59:54.849555  4687 leader_election.cc:290] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:54.886615  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:54.874455  1688 leader_election.cc:304] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:54.907620  1646 raft_consensus.cc:2468] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6.
I20260709 12:59:54.914489  1716 raft_consensus.cc:2468] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 7.
I20260709 12:59:54.829843  4833 consensus_queue.cc:1048] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
W20260709 12:59:54.917953  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 74955.6us
W20260709 12:59:54.909128  4676 consensus_meta.cc:287] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 1.063s	user 0.012s	sys 0.002s
W20260709 12:59:54.923746  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 1.06489e+06us
I20260709 12:59:54.927033  1648 raft_consensus.cc:2468] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 7.
W20260709 12:59:54.928057  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 53712.6us
I20260709 12:59:54.931172  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:54.927340  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:54.936647  1717 raft_consensus.cc:3060] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:54.939682  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:54.941110  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:54.941968  1716 raft_consensus.cc:2468] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 7.
I20260709 12:59:54.950001  2297 leader_election.cc:304] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:54.951056  4873 raft_consensus.cc:2804] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:54.951484  4873 raft_consensus.cc:493] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:54.951917  4873 raft_consensus.cc:3060] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:54.956169  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:54.957257  1688 leader_election.cc:304] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
W20260709 12:59:54.961333  4881 log.cc:927] Time spent T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.463s	user 0.002s	sys 0.000s
W20260709 12:59:54.964349  4888 log.cc:927] Time spent T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
I20260709 12:59:54.938732  4893 raft_consensus.cc:2804] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:54.965334  4893 raft_consensus.cc:493] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:54.955240  4861 raft_consensus.cc:493] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:54.966717  4861 raft_consensus.cc:515] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:54.968327  4856 leader_election.cc:290] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:54.969179  1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 635) took 1208 ms. Trace:
I20260709 12:59:54.969697  1720 rpcz_store.cc:276] 0709 12:59:53.760314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.787995 (+ 27681us) service_pool.cc:224] Handling call
0709 12:59:53.788470 (+   475us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:53.946592 (+158122us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:53.946642 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:54.088551 (+141909us) log.cc:844] Serialized 26 byte log entry
0709 12:59:54.569532 (+480981us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:54.569586 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:54.569658 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:54.968939 (+399281us) raft_consensus.cc:1685] finished
0709 12:59:54.968959 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:54.969092 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5217,"raft.queue_time_us":74315,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":12537,"thread_start_us":324572,"threads_started":1,"wal-append.queue_time_us":479904}
I20260709 12:59:54.972187  4838 raft_consensus.cc:515] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:54.965823  4893 raft_consensus.cc:3060] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:54.710444  4886 raft_consensus.cc:515] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:54.978760  2326 consensus_meta.cc:287] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.607s	user 0.009s	sys 0.000s
I20260709 12:59:54.997854  2326 raft_consensus.cc:2468] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8.
I20260709 12:59:54.940519  1719 raft_consensus.cc:2468] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 4.
I20260709 12:59:54.878335  4843 consensus_queue.cc:237] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:55.000954  1647 raft_consensus.cc:1275] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
W20260709 12:59:55.002194  1542 leader_election.cc:336] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.960s (SENT)
I20260709 12:59:55.003194  1542 leader_election.cc:304] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:55.001528  1647 pending_rounds.cc:85] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e: Aborting all ops after (but not including) 6
I20260709 12:59:54.933171  4837 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:59:54.984870  4831 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.008s	sys 0.012s
W20260709 12:59:55.010207  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 201461us
I20260709 12:59:55.007748  1647 pending_rounds.cc:107] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:59:55.021678  1647 raft_consensus.cc:2889] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:54.928782  4676 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:55.023903  1648 raft_consensus.cc:1275] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:59:55.012863  4831 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.008s	sys 0.012s
W20260709 12:59:55.032881  4894 log.cc:927] Time spent T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 12:59:55.036147  1647 raft_consensus.cc:1240] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 12:59:55.046322  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 94173.4us
I20260709 12:59:55.033461  4858 raft_consensus.cc:493] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:55.075807  1617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:55.079799  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 94539.6us
I20260709 12:59:55.026844  4738 raft_consensus.cc:515] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:55.081863  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 71805.4us
W20260709 12:59:55.074352  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 135060us
I20260709 12:59:55.072093  4837 raft_consensus.cc:2749] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:55.103109  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:55.106385  1647 raft_consensus.cc:2468] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6.
I20260709 12:59:55.070508  4831 raft_consensus.cc:493] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
W20260709 12:59:55.118490  1542 leader_election.cc:336] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.976s (SENT)
W20260709 12:59:55.120806  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 48845us
I20260709 12:59:55.101243  4770 leader_election.cc:290] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:55.101377  1688 leader_election.cc:304] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:55.133745  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 12:59:55.122740  4891 log.cc:927] Time spent T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.242s	user 0.000s	sys 0.001s
I20260709 12:59:55.145200  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:59:55.147800  4902 log.cc:927] Time spent T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
W20260709 12:59:55.150341  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.132404  4833 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.116180  4858 raft_consensus.cc:515] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:55.180421  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:55.140481  4731 consensus_queue.cc:1059] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:59:55.157743  4838 leader_election.cc:290] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:55.172380  4856 raft_consensus.cc:493] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.210104  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:55.141801  4831 raft_consensus.cc:515] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:55.218538  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 107129us
I20260709 12:59:55.173373  4915 raft_consensus.cc:2804] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:59:55.243737  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.245363  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:55.223676  4915 raft_consensus.cc:493] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:55.248114  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:55.250813  2329 raft_consensus.cc:1240] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 12:59:55.275099  4899 log.cc:927] Time spent T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
I20260709 12:59:55.276846  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:55.280961  4831 leader_election.cc:290] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:55.281847  4908 log.cc:927] Time spent T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 12:59:55.198189  4833 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:55.221360  4856 raft_consensus.cc:515] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:55.294307  4892 log.cc:927] Time spent T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.236s	user 0.000s	sys 0.001s
I20260709 12:59:55.240000  4676 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:55.309060  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:59:55.299471  4911 log.cc:927] Time spent T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
W20260709 12:59:55.304169  4555 consensus_meta.cc:287] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.827s	user 0.006s	sys 0.006s
I20260709 12:59:55.299937  4687 raft_consensus.cc:493] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.240316  4886 leader_election.cc:290] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:59:55.321834  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 165327us
I20260709 12:59:55.295068  4731 consensus_queue.cc:1059] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
W20260709 12:59:55.327755  1542 leader_election.cc:336] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.176s (SENT)
I20260709 12:59:55.330514  1542 leader_election.cc:304] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:55.326148  1688 leader_election.cc:304] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:55.335152  1720 raft_consensus.cc:3055] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:55.335561  1720 raft_consensus.cc:740] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
W20260709 12:59:55.337109  4910 log.cc:927] Time spent T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 12:59:55.337118  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:55.313174  4738 leader_election.cc:290] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:55.341408  1716 raft_consensus.cc:1275] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:59:55.309505  4915 raft_consensus.cc:3060] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:55.348249  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:55.348592  4731 raft_consensus.cc:3055] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:59:55.348876  1648 raft_consensus.cc:3060] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:55.348976  4731 raft_consensus.cc:740] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:55.349953  4731 consensus_queue.cc:260] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:55.353701  4731 raft_consensus.cc:3060] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:55.353706  4856 leader_election.cc:290] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:55.328063  4555 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:55.362416  4555 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:55.363662  4858 leader_election.cc:290] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:55.364639  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:55.365209  2326 raft_consensus.cc:2468] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
I20260709 12:59:55.366281  1540 leader_election.cc:304] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:55.368898  1717 raft_consensus.cc:2468] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 7.
I20260709 12:59:55.369359  4837 raft_consensus.cc:2749] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:55.369496  4903 raft_consensus.cc:2764] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 12:59:55.370185  1542 leader_election.cc:336] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.998s (SENT)
I20260709 12:59:55.370412  4858 raft_consensus.cc:2804] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:55.370631  1542 leader_election.cc:304] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:55.370873  4858 raft_consensus.cc:493] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:55.371299  4858 raft_consensus.cc:3060] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:55.371027  4873 raft_consensus.cc:515] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:55.371747  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:55.372033  4817 consensus_meta.cc:287] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 1.730s	user 0.008s	sys 0.005s
I20260709 12:59:55.366219  4922 consensus_queue.cc:1048] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 12:59:55.331049  4687 raft_consensus.cc:515] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:55.374581  4687 leader_election.cc:290] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:55.377781  2330 raft_consensus.cc:1240] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:59:55.336290  1720 consensus_queue.cc:260] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:55.378963  1720 raft_consensus.cc:3060] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:59:55.385501  4919 log.cc:927] Time spent T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 12:59:55.386984  2323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32870 (request call id 321) took 1577 ms. Trace:
I20260709 12:59:55.387462  2323 rpcz_store.cc:276] 0709 12:59:53.809335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.833096 (+ 23761us) service_pool.cc:224] Handling call
0709 12:59:54.186203 (+353107us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:54.434882 (+248679us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:54.439430 (+  4548us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:54.828670 (+389240us) log.cc:844] Serialized 564 byte log entry
0709 12:59:55.120975 (+292305us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:55.122343 (+  1368us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:55.137846 (+ 15503us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:55.386688 (+248842us) raft_consensus.cc:1685] finished
0709 12:59:55.386720 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:55.386894 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":228480,"threads_started":1,"wal-append.queue_time_us":330914}
I20260709 12:59:55.389226  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:55.389616  4833 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:55.390930  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 12:59:55.398733  1542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.399117  4687 raft_consensus.cc:2749] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:55.399487  4837 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.400070  4929 raft_consensus.cc:2804] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:55.400017  4837 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:55.400851  4929 raft_consensus.cc:697] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 8 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:55.402383  4837 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:55.403060  4822 consensus_meta.cc:287] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 1.761s	user 0.007s	sys 0.007s
I20260709 12:59:55.403924  1647 raft_consensus.cc:2468] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8.
I20260709 12:59:55.404376  4739 raft_consensus.cc:493] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.404742  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:55.404889  4739 raft_consensus.cc:515] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:55.405350  1642 raft_consensus.cc:2468] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8.
I20260709 12:59:55.405893  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:55.406111  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:55.406454  1649 raft_consensus.cc:2468] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6.
I20260709 12:59:55.407328  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:55.408335  1651 raft_consensus.cc:2410] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 9 because replica has last-logged OpId of term: 7 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:59:55.409461  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:55.411145  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:55.411465  1648 raft_consensus.cc:2468] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 7.
W20260709 12:59:55.427115  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 106553us
I20260709 12:59:55.428287  2294 leader_election.cc:304] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:55.431851  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:55.438788  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:55.439604  1574 raft_consensus.cc:2468] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 7.
I20260709 12:59:55.440990  1572 raft_consensus.cc:1275] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:59:55.443696  4858 raft_consensus.cc:515] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:55.445878  4903 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.446412  4903 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:55.448297  1568 raft_consensus.cc:2393] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 6: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:55.449049  1720 raft_consensus.cc:1275] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:59:55.449765  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:55.450394  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:55.455086  1570 raft_consensus.cc:2468] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 4.
I20260709 12:59:55.450845  1725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1455) took 1018 ms. Trace:
I20260709 12:59:55.450946  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:55.469561  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:55.470332  1569 raft_consensus.cc:3060] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:55.471968  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:55.469995  1725 rpcz_store.cc:276] 0709 12:59:54.432827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:54.440659 (+  7832us) service_pool.cc:224] Handling call
0709 12:59:54.458394 (+ 17735us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:54.506720 (+ 48326us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:59:54.935075 (+428355us) log.cc:844] Serialized 14 byte log entry
0709 12:59:55.156117 (+221042us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:55.176943 (+ 20826us) log.cc:844] Serialized 26 byte log entry
0709 12:59:55.177107 (+   164us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:55.177408 (+   301us) log.cc:844] Serialized 14 byte log entry
0709 12:59:55.366185 (+188777us) spinlock_profiling.cc:243] Waited 5.02 ms on lock 0x7b1800264e80. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef2ce522 00007fa9ef2d07c1 00007fa9ef2d0779 00007fa9ef2d0709 00007fa9ef2d06d1 00007fa9ef2cf9cd 000000000038f354 000000000038f199 00007fa9ef2b183a
0709 12:59:55.426769 (+ 60584us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:55.426892 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:55.450621 (+ 23729us) raft_consensus.cc:1685] finished
0709 12:59:55.450642 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:55.450774 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":128395,"prepare.queue_time_us":559228,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":81,"raft.queue_time_us":125113,"raft.run_cpu_time_us":447,"raft.run_wall_time_us":72369,"spinlock_wait_cycles":21312000,"thread_start_us":638315,"threads_started":3,"wal-append.queue_time_us":206371}
I20260709 12:59:55.477218  1720 pending_rounds.cc:85] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4: Aborting all ops after (but not including) 6
I20260709 12:59:55.482501  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:55.401778  4929 consensus_queue.cc:237] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:55.486469  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:55.487032  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:55.487955  1720 pending_rounds.cc:107] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:59:55.471215  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:55.491061  1720 raft_consensus.cc:2889] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:55.496984  1572 raft_consensus.cc:2468] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 7.
I20260709 12:59:55.473475  4145 raft_consensus.cc:2804] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:55.486336  4837 raft_consensus.cc:493] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
W20260709 12:59:55.499562  1542 leader_election.cc:336] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.684s (SENT)
I20260709 12:59:55.500080  1650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 538) took 1878 ms. Trace:
I20260709 12:59:55.501259  1569 raft_consensus.cc:2468] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 8.
I20260709 12:59:55.502556  1571 raft_consensus.cc:2468] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 7.
I20260709 12:59:55.502933  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:59:55.503293  1542 leader_election.cc:336] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.734s (SENT)
I20260709 12:59:55.500383  1650 rpcz_store.cc:276] 0709 12:59:53.621965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.627116 (+  5151us) service_pool.cc:224] Handling call
0709 12:59:53.630835 (+  3719us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:59:54.294699 (+663864us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:59:54.368929 (+ 74230us) log.cc:844] Serialized 14 byte log entry
0709 12:59:54.525449 (+156520us) spinlock_profiling.cc:243] Waited 3.52 ms on lock 0x7b18002997a0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef2b0e07 00007fa9f810bab9 00007fa9ef2cd69b 00007fa9ef2cb93f 00007fa9ef2cdc02 00007fa9f1f5520b 00007fa9f1f5ad23 00007fa9f1f5b23a 00007fa9f23c5a2a
0709 12:59:54.701173 (+175724us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:59:54.741804 (+ 40631us) log.cc:844] Serialized 78 byte log entry
0709 12:59:54.741988 (+   184us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:54.742042 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:55.398864 (+656822us) spinlock_profiling.cc:243] Waited 176 ms on lock 0x7b54002b4654. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:55.398916 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:55.413042 (+ 14126us) raft_consensus.cc:1685] finished
0709 12:59:55.413067 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:55.500015 (+ 86948us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":61349,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":46002,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":13059,"spinlock_wait_cycles":412498176,"thread_start_us":148120,"threads_started":1,"wal-append.queue_time_us":428520}
I20260709 12:59:55.503767  1542 leader_election.cc:304] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:55.504623  4731 raft_consensus.cc:2749] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:55.508195  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:55.509020  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:55.509917  1572 raft_consensus.cc:2410] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:59:55.510298  4145 raft_consensus.cc:697] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:55.510193  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:55.510767  4890 raft_consensus.cc:3055] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:55.488337  4858 leader_election.cc:290] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:55.511125  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:55.511284  4145 consensus_queue.cc:237] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:55.512828  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:55.513423  1569 raft_consensus.cc:2468] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 8.
I20260709 12:59:55.513509  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:55.514309  1572 raft_consensus.cc:2393] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 7: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:55.511186  4890 raft_consensus.cc:740] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:55.518304  4890 consensus_queue.cc:260] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:55.488557  4833 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.520937  4890 raft_consensus.cc:3060] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:55.521238  1573 raft_consensus.cc:1275] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:59:55.521099  4833 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:59:55.520397  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:55.523375  4833 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:55.509460  4837 raft_consensus.cc:515] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:55.524237  4903 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:55.524945  1567 raft_consensus.cc:2393] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 7: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:55.525748  4837 leader_election.cc:290] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:59:55.499289  4836 consensus_meta.cc:287] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.744s	user 0.004s	sys 0.007s
I20260709 12:59:55.526539  4836 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:55.528424  1724 raft_consensus.cc:2393] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 8: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
W20260709 12:59:55.499485  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 71336.2us
I20260709 12:59:55.553344  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:55.516031  4915 raft_consensus.cc:515] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:55.560628  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.561919  4915 leader_election.cc:290] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:55.563627  4873 leader_election.cc:290] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:55.571194  4858 raft_consensus.cc:493] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.571527  4861 leader_election.cc:290] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:55.571810  4858 raft_consensus.cc:515] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:55.559682  1572 raft_consensus.cc:1275] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:59:55.572151  4836 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 12:59:55.572786  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:55.576242  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 48693.8us
I20260709 12:59:55.586319  4858 leader_election.cc:290] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:55.592941  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:59:55.597685  4893 consensus_meta.cc:287] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.588s	user 0.005s	sys 0.006s
I20260709 12:59:55.598268  4893 raft_consensus.cc:515] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:55.602866  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:55.603554  1644 raft_consensus.cc:2468] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6.
I20260709 12:59:55.604321  4893 leader_election.cc:290] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:55.607110  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 49660.5us
I20260709 12:59:55.608862  4925 consensus_queue.cc:1048] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
W20260709 12:59:55.643392  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:55.645782  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.663955  4858 consensus_queue.cc:1048] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:59:55.664567  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:59:55.677771  1689 connection.cc:256] RPC call timeout handler was delayed by -2.6467373219999786s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15460000000000002s for a response
W20260709 12:59:55.682265  1689 connection.cc:256] RPC call timeout handler was delayed by -2.3632373219999749s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18610000000000002s for a response
W20260709 12:59:55.682688  1689 connection.cc:256] RPC call timeout handler was delayed by -2.23003732199993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2009s for a response
W20260709 12:59:55.683069  1689 connection.cc:256] RPC call timeout handler was delayed by -2.1922373219999827s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20510000000000003s for a response
W20260709 12:59:55.683439  1689 connection.cc:256] RPC call timeout handler was delayed by -2.1697373219999463s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2076s for a response
W20260709 12:59:55.683780  1689 connection.cc:256] RPC call timeout handler was delayed by -2.1580373219999274s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2089s for a response
W20260709 12:59:55.684125  1689 connection.cc:256] RPC call timeout handler was delayed by -2.1391373219999537s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.211s for a response
W20260709 12:59:55.684460  1689 connection.cc:256] RPC call timeout handler was delayed by -2.022137321999935s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22400000000000003s for a response
W20260709 12:59:55.684834  1689 connection.cc:256] RPC call timeout handler was delayed by -1.2895373219999442s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3054s for a response
I20260709 12:59:55.687318  1721 raft_consensus.cc:1240] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:55.687428  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:55.688222  1725 raft_consensus.cc:3060] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:55.691869  4927 consensus_queue.cc:1048] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:55.712956  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:55.713486  4927 consensus_queue.cc:1243] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:59:55.681336  4806 raft_consensus.cc:493] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.714980  4806 raft_consensus.cc:515] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:55.698815  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:55.699198  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:55.717149  2330 raft_consensus.cc:3060] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:55.717329  4806 leader_election.cc:290] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:55.693292  4930 consensus_queue.cc:1048] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 12:59:55.610683  4893 raft_consensus.cc:493] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:55.719607  4893 raft_consensus.cc:515] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:55.677397  4858 consensus_queue.cc:1059] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:59:55.700706  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:55.702945  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:55.721661  4920 consensus_queue.cc:1048] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:55.703289  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:55.716332  1716 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6.
I20260709 12:59:55.703531  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:55.704013  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:55.704198  1720 raft_consensus.cc:1275] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:59:55.707717  1717 raft_consensus.cc:1240] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 7. Current term is 8. Ops: []
W20260709 12:59:55.724879  4938 log.cc:927] Time spent T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260709 12:59:55.696301  4616 consensus_queue.cc:1048] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 12:59:55.709268  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:55.702646  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:55.730811  1576 raft_consensus.cc:1275] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:59:55.731210  1573 pending_rounds.cc:85] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting all ops after (but not including) 6
I20260709 12:59:55.731526  1573 pending_rounds.cc:107] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:59:55.731781  1573 raft_consensus.cc:2889] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:55.734737  4893 leader_election.cc:290] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:55.720988  4858 raft_consensus.cc:3055] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:55.735917  4858 raft_consensus.cc:740] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:55.737023  4858 consensus_queue.cc:260] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:55.738526  4858 raft_consensus.cc:3060] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:55.743335  1725 raft_consensus.cc:2468] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 9.
I20260709 12:59:55.746011  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:55.748898  2330 raft_consensus.cc:2468] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6.
W20260709 12:59:55.749377  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 109715us
I20260709 12:59:55.749727  1723 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6.
I20260709 12:59:55.753799  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:55.754264  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:55.755996  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:55.756897  1721 raft_consensus.cc:1275] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:59:55.758561  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:55.759127  1718 raft_consensus.cc:3060] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:55.760200  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:55.760975  1644 raft_consensus.cc:2410] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 12:59:55.750819  4930 consensus_queue.cc:1059] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 12:59:55.765208  1723 raft_consensus.cc:1275] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:59:55.769286  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:55.749173  4929 raft_consensus.cc:493] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:55.770321  1542 leader_election.cc:304] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:55.771909  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:55.774118  1721 raft_consensus.cc:3060] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:55.775017  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:55.775754  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:55.776508  1716 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6.
I20260709 12:59:55.778542  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:55.779152  1720 raft_consensus.cc:2468] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6.
I20260709 12:59:55.781912  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:55.784399  2297 leader_election.cc:304] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 12:59:55.786770  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:55.788340  1720 raft_consensus.cc:1240] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:59:55.777612  4890 raft_consensus.cc:2749] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:55.759665  4872 consensus_queue.cc:1048] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:59:55.785956  1716 pending_rounds.cc:85] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4: Aborting all ops after (but not including) 4
I20260709 12:59:55.811005  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:55.811537  1716 pending_rounds.cc:107] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 12:59:55.812031  1716 raft_consensus.cc:2889] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:55.814671  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:55.815402  1650 raft_consensus.cc:2468] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 7.
I20260709 12:59:55.816329  4766 raft_consensus.cc:2804] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:55.818112  4766 raft_consensus.cc:697] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:55.819001  4766 consensus_queue.cc:237] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:55.820482  1617 leader_election.cc:336] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.843s (SENT)
W20260709 12:59:55.829555  1722 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1443) took 2230 ms (client timeout 1586 ms). Trace:
W20260709 12:59:55.830073  1722 rpcz_store.cc:269] 0709 12:59:53.598656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:53.601823 (+  3167us) service_pool.cc:224] Handling call
0709 12:59:55.829292 (+2227469us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b540040ced4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:55.829446 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3233220352}
I20260709 12:59:55.836228  1724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1466) took 1088 ms. Trace:
I20260709 12:59:55.836687  1724 rpcz_store.cc:276] 0709 12:59:54.748106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:54.861056 (+112950us) service_pool.cc:224] Handling call
0709 12:59:55.836010 (+974954us) spinlock_profiling.cc:243] Waited 655 ms on lock 0x7b54002265d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:55.836166 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1507336448}
I20260709 12:59:55.838507  2295 leader_election.cc:304] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:55.839123  4922 raft_consensus.cc:3055] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:55.839560  4922 raft_consensus.cc:740] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
W20260709 12:59:55.840072  1617 leader_election.cc:336] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.898s (SENT)
I20260709 12:59:55.840698  4920 raft_consensus.cc:2749] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:55.840984  1617 leader_election.cc:304] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:55.843173  4820 raft_consensus.cc:2749] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:55.856307  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:59:55.870231  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.870239  1718 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7.
I20260709 12:59:55.874584  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:55.870846  1540 leader_election.cc:304] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:55.875435  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:55.876035  1643 raft_consensus.cc:3060] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:55.876422  1717 raft_consensus.cc:1275] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:59:55.881769  2294 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:55.882346  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:55.882880  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:55.883668  1717 raft_consensus.cc:2393] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 7: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:55.779754  4929 raft_consensus.cc:515] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:55.885425  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:55.888125  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:55.888291  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:55.899482  1721 raft_consensus.cc:2468] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 8.
W20260709 12:59:55.904979  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 146998us
I20260709 12:59:55.908321  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:55.912057  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:59:55.924444  1542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:55.892817  4906 raft_consensus.cc:2749] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:59:55.929749  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:55.934391  1646 raft_consensus.cc:3055] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:59:55.934829  1646 raft_consensus.cc:740] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:55.935665  1646 consensus_queue.cc:260] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:55.936882  1646 raft_consensus.cc:3060] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:55.890393  4890 raft_consensus.cc:2804] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:55.946633  1643 raft_consensus.cc:2468] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 6.
I20260709 12:59:55.947813  1646 raft_consensus.cc:1275] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:59:55.948604  1719 raft_consensus.cc:2410] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:59:55.880977  4806 raft_consensus.cc:493] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:55.954988  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:55.955190  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:55.956684  1721 raft_consensus.cc:2468] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 9.
I20260709 12:59:55.957628  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:55.958076  1646 raft_consensus.cc:1240] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:55.960979  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:55.961316  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:55.961966  1643 raft_consensus.cc:3060] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:59:55.962044  1646 raft_consensus.cc:2393] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 7: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:55.965611  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:55.968143  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:55.966298  1724 raft_consensus.cc:2376] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 8. Re-sending same reply.
I20260709 12:59:55.974324  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:55.973037  1567 raft_consensus.cc:2468] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 7.
I20260709 12:59:55.878880  4922 consensus_queue.cc:260] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:55.959230  4890 raft_consensus.cc:697] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:56.011339  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:59:56.012642  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:56.012336  1724 raft_consensus.cc:2376] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 8. Re-sending same reply.
I20260709 12:59:56.014614  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:56.015450  1718 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6.
I20260709 12:59:55.959177  4806 raft_consensus.cc:515] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:56.036082  1643 raft_consensus.cc:2468] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 8.
I20260709 12:59:56.079281  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:56.079947  1721 raft_consensus.cc:2376] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7. Re-sending same reply.
I20260709 12:59:56.087518  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:56.095536  2294 leader_election.cc:304] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:56.101200  1645 raft_consensus.cc:1275] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:59:56.103525  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:56.115731  1722 raft_consensus.cc:1240] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:56.119840  4913 consensus_queue.cc:1048] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
W20260709 12:59:56.126372  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:56.129694  1615 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:56.131531  4789 consensus_queue.cc:1048] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:56.132413  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 12:59:56.134682  4942 log.cc:927] Time spent T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 12:59:56.134956  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:56.135432  1576 raft_consensus.cc:1275] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:59:56.135612  1572 raft_consensus.cc:3060] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:56.135844  1576 pending_rounds.cc:85] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting all ops after (but not including) 6
I20260709 12:59:56.136147  1576 pending_rounds.cc:107] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:59:56.141209  4929 leader_election.cc:290] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:56.141719  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:56.143151  4890 consensus_queue.cc:237] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:56.144340  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:56.144974  1647 raft_consensus.cc:2376] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 7. Re-sending same reply.
I20260709 12:59:56.145609  1567 raft_consensus.cc:1275] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:59:56.136381  1576 raft_consensus.cc:2889] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:56.152247  4739 leader_election.cc:290] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:59:56.152931  4941 log.cc:927] Time spent T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
I20260709 12:59:56.152366  1572 raft_consensus.cc:2468] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 8.
I20260709 12:59:56.156481  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:56.174943  2330 raft_consensus.cc:1240] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 LEADER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:56.187919  1651 raft_consensus.cc:2368] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 6. Current term is 7.
I20260709 12:59:56.117396  4706 raft_consensus.cc:2804] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:56.222685  4706 raft_consensus.cc:697] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:56.223716  4706 consensus_queue.cc:237] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:56.227421  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:56.230834  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:56.152951  4739 raft_consensus.cc:2749] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:56.236857  4806 leader_election.cc:290] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:56.238674  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:56.239569  1568 raft_consensus.cc:2410] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:59:56.248263  1688 leader_election.cc:304] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
W20260709 12:59:56.256424  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:56.263459  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:59:56.264442  4858 consensus_meta.cc:287] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.525s	user 0.010s	sys 0.000s
I20260709 12:59:56.163549  4929 consensus_queue.cc:1059] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.104s
I20260709 12:59:56.269917  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:56.270503  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:56.272648  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:56.272967  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:56.270569  1571 raft_consensus.cc:2468] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7.
I20260709 12:59:56.276050  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:56.282872  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:56.283146  4917 consensus_queue.cc:1048] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:59:56.284552  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:56.273916  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:56.292701  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:56.295783  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:56.296602  1724 raft_consensus.cc:3060] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:56.272872  4806 raft_consensus.cc:2804] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:59:56.286599  4940 log.cc:927] Time spent T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.325s	user 0.001s	sys 0.000s
W20260709 12:59:56.428480  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:56.468106  1617 leader_election.cc:336] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.870s (SENT)
I20260709 12:59:56.491376  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:56.492861  1643 raft_consensus.cc:1275] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:59:56.549454  1542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:56.598660  1644 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.000s	sys 0.014s
W20260709 12:59:56.599242  1644 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.000s	sys 0.014s
W20260709 12:59:56.634836  1649 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.004s	sys 0.012s
W20260709 12:59:56.635442  1649 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.004s	sys 0.012s
I20260709 12:59:56.488242  4836 raft_consensus.cc:493] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
W20260709 12:59:56.661334  1717 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.000s	sys 0.016s
W20260709 12:59:56.661990  1717 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.000s	sys 0.017s
W20260709 12:59:56.662190  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 194125us
W20260709 12:59:56.716396  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:56.596195  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 12:59:56.723037  1647 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.006s	sys 0.014s
W20260709 12:59:56.667325  4940 log.cc:927] Time spent T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 12:59:56.759404  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:56.764799  1718 raft_consensus.cc:2468] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 8.
W20260709 12:59:56.761623  1647 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.006s	sys 0.014s
I20260709 12:59:56.761718  1721 raft_consensus.cc:1275] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:59:56.762240  1617 leader_election.cc:336] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.027s (SENT)
I20260709 12:59:56.763561  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:56.789736  1719 raft_consensus.cc:2468] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 4.
I20260709 12:59:56.792094  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:56.793744  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:59:56.790658  1617 leader_election.cc:336] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.044s (SENT)
I20260709 12:59:56.759464  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:56.809108  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 12:59:56.814801  1723 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.846s	user 0.005s	sys 0.026s
W20260709 12:59:56.815155  1723 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.847s	user 0.005s	sys 0.026s
I20260709 12:59:56.816823  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 12:59:56.824739  2294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:56.830284  1716 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.831s	user 0.012s	sys 0.025s
W20260709 12:59:56.832000  1716 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.833s	user 0.013s	sys 0.025s
I20260709 12:59:56.831874  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:56.832805  1718 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6.
I20260709 12:59:56.834743  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:56.835469  1573 raft_consensus.cc:2393] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 7: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:56.837868  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:56.838881  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:56.839393  1569 raft_consensus.cc:2468] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 8.
I20260709 12:59:56.840142  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:56.840617  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:56.841253  1570 raft_consensus.cc:2468] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 8.
W20260709 12:59:56.841678  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 51073.1us
I20260709 12:59:56.841741  4838 consensus_queue.cc:1059] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:59:56.842034  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:56.842661  1570 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:56.844764  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:56.846665  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 12:59:56.847297  1719 raft_consensus.cc:2376] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 8. Re-sending same reply.
I20260709 12:59:56.848197  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:56.848438  1569 raft_consensus.cc:3060] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:59:56.694325  4836 raft_consensus.cc:515] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:56.844276  4616 raft_consensus.cc:3055] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:56.858184  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:56.859243  1719 raft_consensus.cc:2393] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 7: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
W20260709 12:59:56.875411  1617 leader_election.cc:336] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.114s (SENT)
I20260709 12:59:56.876096  1617 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:56.834261  1689 leader_election.cc:304] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 12:59:56.829409  4890 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.006s	sys 0.030s
I20260709 12:59:56.907660  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:56.910159  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:59:56.862151  1648 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.014s	sys 0.029s
W20260709 12:59:56.914547  1648 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.014s	sys 0.029s
I20260709 12:59:56.921347  1720 raft_consensus.cc:2468] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 8.
I20260709 12:59:56.939392  1721 raft_consensus.cc:3060] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:56.913935  4890 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.006s	sys 0.030s
I20260709 12:59:56.861882  4616 raft_consensus.cc:740] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:56.946655  1648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 562) took 1077 ms. Trace:
I20260709 12:59:56.938681  4770 raft_consensus.cc:2749] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:57.018563  1570 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 9.
I20260709 12:59:57.037571  1573 raft_consensus.cc:1217] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Deduplicated request from leader. Original: 5.6->[6.7-6.7]   Dedup: 6.7->[]
I20260709 12:59:57.038234  1573 raft_consensus.cc:1240] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 12:59:57.037875  1724 consensus_meta.cc:287] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.741s	user 0.010s	sys 0.000s
I20260709 12:59:57.041877  1724 raft_consensus.cc:2468] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7.
I20260709 12:59:56.979058  4953 raft_consensus.cc:493] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:57.047946  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 283895us
I20260709 12:59:57.073585  2330 raft_consensus.cc:3060] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 LEARNER]: Advancing to term 7
I20260709 12:59:57.074420  2325 raft_consensus.cc:1240] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:57.082088  1689 leader_election.cc:304] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:57.086371  1649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 558) took 1228 ms. Trace:
I20260709 12:59:57.089864  1569 raft_consensus.cc:2468] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7.
I20260709 12:59:57.086099  1723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2086) took 1308 ms. Trace:
W20260709 12:59:57.109186  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 263232us
I20260709 12:59:57.086831  1649 rpcz_store.cc:276] 0709 12:59:55.866911 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:55.867111 (+   200us) service_pool.cc:224] Handling call
0709 12:59:55.878743 (+ 11632us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:59:55.888346 (+  9603us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:55.888376 (+    30us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:59:55.942101 (+ 53725us) log.cc:844] Serialized 78 byte log entry
0709 12:59:56.636277 (+694176us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:56.636336 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:56.636484 (+   148us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:57.086147 (+449663us) raft_consensus.cc:1685] finished
0709 12:59:57.086170 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:57.086319 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14752,"raft.queue_time_us":15135,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":13862,"thread_start_us":645194,"threads_started":1,"wal-append.queue_time_us":1020545}
W20260709 12:59:57.113798  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 264033us
I20260709 12:59:57.099673  1723 rpcz_store.cc:276] 0709 12:59:55.777739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:55.777829 (+    90us) service_pool.cc:224] Handling call
0709 12:59:55.778139 (+   310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:55.782661 (+  4522us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:55.782680 (+    19us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:55.791832 (+  9152us) log.cc:844] Serialized 26 byte log entry
0709 12:59:56.815488 (+1023656us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:56.815523 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:56.815595 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:57.085882 (+270287us) raft_consensus.cc:1685] finished
0709 12:59:57.085908 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:57.086039 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25786,"raft.queue_time_us":4255,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":2595,"thread_start_us":847731,"threads_started":1,"wal-append.queue_time_us":1198961}
W20260709 12:59:57.111711  4945 log.cc:927] Time spent T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 12:59:57.121455  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:57.059955  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:57.138604  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:57.146075  1569 raft_consensus.cc:2468] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 8.
I20260709 12:59:57.149097  2330 raft_consensus.cc:1275] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 LEARNER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:59:57.151259  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:57.162155  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:57.162819  1572 raft_consensus.cc:2468] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7.
I20260709 12:59:57.169814  1572 raft_consensus.cc:1275] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:59:57.173324  4922 raft_consensus.cc:3060] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:57.175941  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:57.176589  1572 raft_consensus.cc:2468] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7.
I20260709 12:59:57.178274  1645 raft_consensus.cc:1240] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:57.193087  4555 raft_consensus.cc:493] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.193776  4555 raft_consensus.cc:515] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:56.974910  1648 rpcz_store.cc:276] 0709 12:59:55.868914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:55.881920 (+ 13006us) service_pool.cc:224] Handling call
0709 12:59:55.882183 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:55.882346 (+   163us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:59:56.167374 (+285028us) log.cc:844] Serialized 14 byte log entry
0709 12:59:56.946212 (+778838us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:56.946279 (+    67us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:59:56.946343 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:56.946427 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:56.946585 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":58665,"prepare.queue_time_us":352150,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":24,"raft.queue_time_us":59620,"thread_start_us":986395,"threads_started":2}
I20260709 12:59:57.201817  1645 raft_consensus.cc:3055] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:57.202337  1645 raft_consensus.cc:740] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:57.203392  1645 consensus_queue.cc:260] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:57.204578  1645 raft_consensus.cc:3060] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:57.209196  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:57.210180  1643 raft_consensus.cc:2468] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 7.
I20260709 12:59:57.196278  4555 leader_election.cc:290] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:57.212667  2294 leader_election.cc:304] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 12:59:57.216814  4555 raft_consensus.cc:2804] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:57.220007  4555 raft_consensus.cc:493] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:57.222654  4555 raft_consensus.cc:3060] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:57.149426  1725 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.012s	sys 0.016s
W20260709 12:59:57.232013  1725 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.012s	sys 0.017s
I20260709 12:59:57.232762  1725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 670) took 1073 ms. Trace:
I20260709 12:59:57.233136  1725 rpcz_store.cc:276] 0709 12:59:56.159746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:56.159866 (+   120us) service_pool.cc:224] Handling call
0709 12:59:56.225610 (+ 65744us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:56.225808 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:59:56.595837 (+370029us) log.cc:844] Serialized 14 byte log entry
0709 12:59:57.232400 (+636563us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:57.232458 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:57.232503 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:57.232592 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:57.232705 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":834,"prepare.queue_time_us":787876,"prepare.run_cpu_time_us":2963,"prepare.run_wall_time_us":11512,"raft.queue_time_us":487493,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":119,"thread_start_us":994083,"threads_started":2}
I20260709 12:59:57.239162  1721 raft_consensus.cc:2468] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 8.
W20260709 12:59:57.244995  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 53546.6us
I20260709 12:59:57.119448  4929 raft_consensus.cc:2749] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:59:57.246417  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 164501us
I20260709 12:59:57.097368  4953 raft_consensus.cc:515] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:57.286463  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 464873us
I20260709 12:59:57.287410  1689 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 12:59:57.291862  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 248041us
W20260709 12:59:57.288720  1644 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.012s	sys 0.055s
I20260709 12:59:57.301548  1725 raft_consensus.cc:1240] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:57.305190  1723 raft_consensus.cc:1275] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:59:57.258680  4960 consensus_queue.cc:1048] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.052s
W20260709 12:59:57.313334  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:57.296702  4861 raft_consensus.cc:493] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:57.300182  4836 leader_election.cc:290] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 12:59:57.338747  4955 log.cc:927] Time spent T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
W20260709 12:59:57.339697  4952 log.cc:927] Time spent T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
I20260709 12:59:57.340479  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 571) took 1210 ms. Trace:
W20260709 12:59:57.341382  4948 log.cc:927] Time spent T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.233s	user 0.000s	sys 0.000s
I20260709 12:59:57.340921  1647 rpcz_store.cc:276] 0709 12:59:56.129750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:56.145586 (+ 15836us) service_pool.cc:224] Handling call
0709 12:59:56.145960 (+   374us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:56.770880 (+624920us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:56.770926 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:56.771517 (+   591us) log.cc:844] Serialized 26 byte log entry
0709 12:59:57.144802 (+373285us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:57.144852 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:57.144933 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:57.340264 (+195331us) raft_consensus.cc:1685] finished
0709 12:59:57.340283 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:57.340420 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":88295,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":76,"thread_start_us":911690,"threads_started":2,"wal-append.queue_time_us":501352}
I20260709 12:59:57.342300  1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2111) took 1059 ms. Trace:
I20260709 12:59:57.342665  1721 rpcz_store.cc:276] 0709 12:59:56.282361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:56.797094 (+514733us) service_pool.cc:224] Handling call
0709 12:59:57.342134 (+545040us) spinlock_profiling.cc:243] Waited 94 ms on lock 0x7b5400112e54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:57.342244 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":216249600}
I20260709 12:59:57.343664  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 572) took 1200 ms. Trace:
I20260709 12:59:57.344007  1642 rpcz_store.cc:276] 0709 12:59:56.143045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:56.220959 (+ 77914us) service_pool.cc:224] Handling call
0709 12:59:56.241245 (+ 20286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:56.241592 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:59:56.241927 (+   335us) log.cc:844] Serialized 14 byte log entry
0709 12:59:56.716156 (+474229us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:56.773543 (+ 57387us) log.cc:844] Serialized 26 byte log entry
0709 12:59:56.773731 (+   188us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:56.773783 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:56.773879 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:57.343487 (+569608us) raft_consensus.cc:1685] finished
0709 12:59:57.343504 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:57.343614 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":650,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":2792,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":204,"thread_start_us":473671,"threads_started":1,"wal-append.queue_time_us":703694}
I20260709 12:59:57.346061  4953 leader_election.cc:290] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:57.247025  4616 consensus_queue.cc:260] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:57.357481  4890 consensus_queue.cc:1048] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:59:57.361817  1689 leader_election.cc:304] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:57.371285  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:57.358619  4893 raft_consensus.cc:3055] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:59:57.377913  4893 raft_consensus.cc:740] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:57.379170  1569 raft_consensus.cc:2468] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 8.
I20260709 12:59:57.347425  4967 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.380905  4893 consensus_queue.cc:260] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:57.397784  1617 leader_election.cc:336] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.570s (SENT)
I20260709 12:59:57.369354  4836 raft_consensus.cc:2749] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:57.347644  4861 raft_consensus.cc:515] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:57.118700  4837 raft_consensus.cc:2955] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 LEADER]: Committing config change with OpId 6.6: config changed from index 4 to 6, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
W20260709 12:59:57.424727  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:57.398270  4963 raft_consensus.cc:493] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.402413  4893 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:59:57.427697  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 77112us
W20260709 12:59:57.426677  1717 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.764s	user 0.013s	sys 0.015s
I20260709 12:59:57.400260  4962 raft_consensus.cc:2749] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:59:57.429206  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 318743us
W20260709 12:59:57.429231  1717 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.766s	user 0.014s	sys 0.015s
I20260709 12:59:57.434190  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 669) took 1325 ms. Trace:
I20260709 12:59:57.434574  1717 rpcz_store.cc:276] 0709 12:59:56.109134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:56.109259 (+   125us) service_pool.cc:224] Handling call
0709 12:59:56.109528 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:56.109718 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:59:56.662567 (+552849us) log.cc:844] Serialized 14 byte log entry
0709 12:59:57.433623 (+771056us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:59:57.433703 (+    80us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:59:57.433777 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:57.433894 (+   117us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:57.434084 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48440,"prepare.queue_time_us":873879,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"thread_start_us":1274338,"threads_started":2}
I20260709 12:59:57.419121  4977 raft_consensus.cc:493] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:57.450476  1617 leader_election.cc:336] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.636s (SENT)
I20260709 12:59:57.453186  1645 raft_consensus.cc:1275] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:59:57.454167  1615 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:57.465113  4806 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.868s	user 0.028s	sys 0.012s
W20260709 12:59:57.465582  4806 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.889s	user 0.028s	sys 0.012s
I20260709 12:59:57.465898  4806 raft_consensus.cc:697] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 8 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:57.466958  4806 consensus_queue.cc:237] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:57.430512  4960 raft_consensus.cc:2749] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:59:57.441704  4949 log.cc:927] Time spent T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.213s	user 0.000s	sys 0.001s
I20260709 12:59:56.303857   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:59:57.469626  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:57.402770  4967 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:57.485236  1689 leader_election.cc:304] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:57.456349  4971 raft_consensus.cc:493] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:57.428848  4969 consensus_queue.cc:1048] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
W20260709 12:59:57.548214  1617 leader_election.cc:336] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.701s (SENT)
I20260709 12:59:57.427464  4963 raft_consensus.cc:515] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:57.602789  1716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2083) took 1853 ms. Trace:
I20260709 12:59:57.400046  2323 raft_consensus.cc:2955] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 4 to 6, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:59:57.627986  1615 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
W20260709 12:59:57.626914  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 140027us
I20260709 12:59:57.595253  4960 raft_consensus.cc:2749] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:59:57.614800  1716 rpcz_store.cc:276] 0709 12:59:55.749714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:55.777133 (+ 27419us) service_pool.cc:224] Handling call
0709 12:59:55.785817 (+  8684us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:55.951721 (+165904us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:55.951757 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:55.952563 (+   806us) log.cc:844] Serialized 26 byte log entry
0709 12:59:56.833854 (+881291us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:59:57.398681 (+564827us) log.cc:844] Serialized 14 byte log entry
0709 12:59:57.398893 (+   212us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:57.398974 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:57.602540 (+203566us) raft_consensus.cc:1685] finished
0709 12:59:57.602565 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:57.602722 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":277990,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":27839,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":2382,"thread_start_us":1288893,"threads_started":2,"wal-append.queue_time_us":1061805}
W20260709 12:59:57.630903  1617 leader_election.cc:336] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.838s (SENT)
I20260709 12:59:57.634207  1617 leader_election.cc:304] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:57.475493  4977 raft_consensus.cc:515] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:57.636624  1615 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:57.640445  1539 leader_election.cc:304] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 12:59:57.643247  1542 leader_election.cc:336] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.552s (SENT)
I20260709 12:59:57.643705  1542 leader_election.cc:304] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
W20260709 12:59:57.644919  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 190407us
W20260709 12:59:57.664111  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 125705us
W20260709 12:59:57.666242  1542 leader_election.cc:336] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.680s (SENT)
I20260709 12:59:57.668025  1542 leader_election.cc:304] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:57.505913  4971 raft_consensus.cc:515] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:57.675025  1689 leader_election.cc:304] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:57.644129  4983 raft_consensus.cc:2749] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:59:57.676236  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 45387us
W20260709 12:59:57.679593  1617 leader_election.cc:336] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.817s (SENT)
W20260709 12:59:57.685024  1542 leader_election.cc:336] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.710s (SENT)
W20260709 12:59:57.696300  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 446124us
W20260709 12:59:57.719698  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:57.735773  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 56214.5us
W20260709 12:59:57.735443  4984 log.cc:927] Time spent T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 12:59:57.716892  4983 raft_consensus.cc:2749] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:57.718838  4960 raft_consensus.cc:2804] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:59:57.846846  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 181027us
W20260709 12:59:57.885656  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:57.785413  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 153788us
W20260709 12:59:57.795272  1691 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:57.831913  4974 raft_consensus.cc:2749] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:59:57.833813  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 147853us
W20260709 12:59:57.888725  1542 leader_election.cc:336] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.892s (SENT)
W20260709 12:59:57.889281  1542 leader_election.cc:336] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.897s (SENT)
I20260709 12:59:57.889640  1542 leader_election.cc:304] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:57.674423  4976 raft_consensus.cc:2749] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:57.670830  4953 consensus_queue.cc:1048] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 12:59:57.834607  1615 leader_election.cc:304] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 12:59:57.832306  4989 log.cc:927] Time spent T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.158s	user 0.000s	sys 0.004s
W20260709 12:59:57.835801  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 151885us
I20260709 12:59:57.837442  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 564) took 1968 ms. Trace:
W20260709 12:59:57.839483  1617 leader_election.cc:336] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.882s (SENT)
I20260709 12:59:57.892095  1617 leader_election.cc:304] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:57.895715  4998 raft_consensus.cc:493] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:57.891937  1644 rpcz_store.cc:276] 0709 12:59:55.869522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:55.916069 (+ 46547us) service_pool.cc:224] Handling call
0709 12:59:55.916558 (+   489us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:56.599726 (+683168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:56.599769 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:56.600300 (+   531us) log.cc:844] Serialized 26 byte log entry
0709 12:59:57.296066 (+695766us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:59:57.296103 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:57.296169 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:57.837247 (+541078us) raft_consensus.cc:1685] finished
0709 12:59:57.837267 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:57.837389 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":31295,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":7812,"thread_start_us":1165427,"threads_started":2,"wal-append.queue_time_us":737313}
I20260709 12:59:57.896889  4967 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:57.896359  4998 raft_consensus.cc:515] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:57.899353  4998 leader_election.cc:290] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:57.901149  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 66631.6us
W20260709 12:59:57.902060  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 228979us
I20260709 12:59:57.904567  1539 leader_election.cc:304] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:57.908803  1615 leader_election.cc:304] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 12:59:57.893558  4555 consensus_meta.cc:287] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.643s	user 0.003s	sys 0.010s
I20260709 12:59:57.887696  4960 raft_consensus.cc:697] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 8 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 12:59:57.889801  4970 raft_consensus.cc:2804] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:59:57.941924  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 52657.7us
W20260709 12:59:57.944809  1542 leader_election.cc:336] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.613s (SENT)
I20260709 12:59:57.945339  1542 leader_election.cc:304] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:57.947156  1539 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
W20260709 12:59:57.911163  4988 log.cc:927] Time spent T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.065s	user 0.000s	sys 0.010s
I20260709 12:59:57.907992  4967 raft_consensus.cc:493] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:57.888232  4969 consensus_queue.cc:1048] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.056s
W20260709 12:59:57.950279  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 53919.5us
W20260709 12:59:57.954058  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 69331.4us
W20260709 12:59:57.953125  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 47067.1us
W20260709 12:59:57.959389  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 119934us
W20260709 12:59:57.957782  1542 leader_election.cc:336] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.629s (SENT)
W20260709 12:59:57.961436  1617 leader_election.cc:336] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.705s (SENT)
I20260709 12:59:57.961881  1542 leader_election.cc:304] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:57.958707  1539 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
W20260709 12:59:57.963212  1542 leader_election.cc:336] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.162s (SENT)
I20260709 12:59:57.963510  1539 leader_election.cc:304] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:57.963924  1542 leader_election.cc:304] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:57.965051  4960 consensus_queue.cc:237] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:57.965726  1689 leader_election.cc:304] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:57.967027  1689 leader_election.cc:304] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:57.967845  4836 raft_consensus.cc:2749] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:57.968251  1689 leader_election.cc:304] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:57.968662  4836 raft_consensus.cc:2804] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:59:57.969198  4836 raft_consensus.cc:493] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:57.969609  4836 raft_consensus.cc:3060] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:59:57.970341  4616 raft_consensus.cc:3060] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:57.970757  1689 leader_election.cc:304] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:57.971910  4893 raft_consensus.cc:2749] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:57.972134  1689 leader_election.cc:304] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:57.972857  4985 raft_consensus.cc:2764] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:59:57.973351  4893 raft_consensus.cc:2749] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:57.973598  4992 raft_consensus.cc:2749] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:57.905683  4838 consensus_queue.cc:1048] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:59:57.974097  1689 leader_election.cc:304] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:57.974913  4893 raft_consensus.cc:2804] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:57.975273  4893 raft_consensus.cc:493] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:57.975592  4893 raft_consensus.cc:3060] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:57.976038  1689 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:57.977087  1574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 2002) took 1140 ms. Trace:
I20260709 12:59:57.977172  4820 raft_consensus.cc:2804] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:59:57.977799  4820 raft_consensus.cc:697] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 8 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:57.977589  1574 rpcz_store.cc:276] 0709 12:59:56.836940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:56.868420 (+ 31480us) service_pool.cc:224] Handling call
0709 12:59:56.868785 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:59:57.258505 (+389720us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:57.258551 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:59:57.290014 (+ 31463us) log.cc:844] Serialized 26 byte log entry
0709 12:59:57.474000 (+183986us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:59:57.474056 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:57.474128 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:57.976864 (+502736us) raft_consensus.cc:1685] finished
0709 12:59:57.976887 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:57.977016 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":424189,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":8910,"spinlock_wait_cycles":475392,"thread_start_us":556762,"threads_started":2,"wal-append.queue_time_us":441608}
I20260709 12:59:57.978978  4820 consensus_queue.cc:237] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:57.980615  5003 log.cc:927] Time spent T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:59:57.980852  4985 raft_consensus.cc:2749] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:57.982753  1689 leader_election.cc:304] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
W20260709 12:59:57.983428  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:57.986606  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:57.987406  1644 raft_consensus.cc:2393] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 8: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:57.988721  4985 raft_consensus.cc:2804] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:57.989157  4985 raft_consensus.cc:493] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:57.989487  4985 raft_consensus.cc:3060] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:57.957130  5002 raft_consensus.cc:2749] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:57.991336  4953 raft_consensus.cc:2749] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:57.992120  4953 raft_consensus.cc:2749] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:57.913715  4993 raft_consensus.cc:2749] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:57.948372  4983 consensus_queue.cc:1048] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 12:59:57.995922  4967 raft_consensus.cc:515] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:57.998498  4967 leader_election.cc:290] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:57.943598  4970 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:57.999181  4970 raft_consensus.cc:3060] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:59:58.000473  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:58.000893  4976 raft_consensus.cc:2749] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:57.944207  4974 raft_consensus.cc:2749] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:59:58.016022  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 55754.5us
W20260709 12:59:58.014837  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 112954us
I20260709 12:59:58.037747  1615 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:58.044512  1615 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:58.045634  1615 leader_election.cc:304] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:58.014629  4858 raft_consensus.cc:2749] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:57.942108  4555 raft_consensus.cc:515] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:58.056419  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:58.057335  1615 leader_election.cc:304] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:58.058616  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:58.060971  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 12:59:58.070015  5008 raft_consensus.cc:2764] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:59:58.070052  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:58.037215  5002 raft_consensus.cc:2804] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:59:58.071147  4555 leader_election.cc:290] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:58.071409  5002 raft_consensus.cc:493] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
W20260709 12:59:58.071161  4991 log.cc:927] Time spent T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.331s	user 0.000s	sys 0.010s
I20260709 12:59:58.071830  5002 raft_consensus.cc:3060] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:59:58.072983  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:58.073191  5005 raft_consensus.cc:2749] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:58.074076  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:58.074164  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:58.073030  1615 leader_election.cc:304] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 12:59:58.075388  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 112219us
W20260709 12:59:58.075975  1542 leader_election.cc:336] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.187s (SENT)
I20260709 12:59:57.992087  4893 raft_consensus.cc:515] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:58.076694  4974 raft_consensus.cc:2749] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:58.076964  1615 leader_election.cc:304] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 12:59:58.077469  1542 leader_election.cc:336] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.235s (SENT)
I20260709 12:59:58.077797  1615 leader_election.cc:304] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:58.077893  1542 leader_election.cc:304] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:58.078092  4893 leader_election.cc:290] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:58.078509  5008 raft_consensus.cc:2749] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:59:58.078675  1615 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:58.079715  5008 raft_consensus.cc:2804] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:58.079979  1615 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:58.080225  2331 raft_consensus.cc:2468] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 8.
I20260709 12:59:58.080063  5008 raft_consensus.cc:493] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:58.080792  2327 raft_consensus.cc:1240] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:58.080940  5008 raft_consensus.cc:3060] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:58.029161  4992 raft_consensus.cc:2749] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:58.082856  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 1999) took 1270 ms. Trace:
W20260709 12:59:58.091995  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 129970us
W20260709 12:59:58.096206  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 132746us
I20260709 12:59:58.080673  5005 raft_consensus.cc:2749] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:58.055202  4983 raft_consensus.cc:2749] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:59:58.065140  4993 raft_consensus.cc:2749] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:59:58.080612  4953 raft_consensus.cc:2804] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:58.100410  1539 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:58.087436  1567 rpcz_store.cc:276] 0709 12:59:56.812788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:56.812904 (+   116us) service_pool.cc:224] Handling call
0709 12:59:56.849243 (+ 36339us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:59:57.284769 (+435526us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:57.284818 (+    49us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:59:57.298790 (+ 13972us) log.cc:844] Serialized 78 byte log entry
0709 12:59:57.489463 (+190673us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:59:57.489523 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:57.489646 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:58.082658 (+593012us) raft_consensus.cc:1685] finished
0709 12:59:58.082678 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:58.082807 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":395119,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":12157,"thread_start_us":542915,"threads_started":2,"wal-append.queue_time_us":321241}
W20260709 12:59:58.111541  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 66675.4us
I20260709 12:59:58.111618  4962 raft_consensus.cc:493] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:58.112739  4969 raft_consensus.cc:493] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.113092  4806 raft_consensus.cc:493] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
W20260709 12:59:58.113687  1689 connection.cc:256] RPC call timeout handler was delayed by -1.7988106540000217s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16000000000000003s for a response
W20260709 12:59:58.125756  1689 connection.cc:256] RPC call timeout handler was delayed by -1.7493106539999985s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1655s for a response
W20260709 12:59:58.126174  1689 connection.cc:256] RPC call timeout handler was delayed by -1.6800106540000002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17320000000000002s for a response
W20260709 12:59:58.123628  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 46175.4us
I20260709 12:59:58.090317  5001 raft_consensus.cc:2804] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:59:58.126556  1689 connection.cc:256] RPC call timeout handler was delayed by -1.6341106540000396s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17830000000000001s for a response
I20260709 12:59:58.119526  1615 leader_election.cc:304] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:58.131346  1539 leader_election.cc:304] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
W20260709 12:59:58.137482  1689 connection.cc:256] RPC call timeout handler was delayed by -1.4226106540000387s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20179999999999998s for a response
W20260709 12:59:58.137912  1689 connection.cc:256] RPC call timeout handler was delayed by -1.2624106540000071s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21960000000000002s for a response
I20260709 12:59:58.134496  1643 raft_consensus.cc:1275] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:59:58.136653  2295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:59:58.137770  1542 leader_election.cc:336] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.637s (SENT)
W20260709 12:59:58.139230  1689 connection.cc:256] RPC call timeout handler was delayed by -1.0338106540000354s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24500000000000002s for a response
W20260709 12:59:58.139758  1542 leader_election.cc:336] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.701s (SENT)
I20260709 12:59:58.139868  1689 leader_election.cc:304] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:58.126259  2330 raft_consensus.cc:2468] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 8.
I20260709 12:59:58.140435  1542 leader_election.cc:304] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:58.142495  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:58.142329  1615 leader_election.cc:304] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:58.145210  1615 leader_election.cc:304] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:59:58.118759  4997 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:59:58.146750  1542 leader_election.cc:336] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.703s (SENT)
I20260709 12:59:58.148679  1542 leader_election.cc:304] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
W20260709 12:59:58.149974  1542 leader_election.cc:336] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.789s (SENT)
I20260709 12:59:58.150482  1542 leader_election.cc:304] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 12:59:58.118916  4974 raft_consensus.cc:2749] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:58.119297  4953 raft_consensus.cc:493] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:58.156086  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:58.160668  1539 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:58.161082  1569 raft_consensus.cc:2393] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 7: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:58.156697  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:58.157481  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:58.158592  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:58.159442  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:58.124253  4861 leader_election.cc:290] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:58.132593  4837 raft_consensus.cc:2749] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:59:58.168884  1539 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 12:59:58.132424  5005 raft_consensus.cc:493] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:58.172792  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:58.177019  1572 raft_consensus.cc:2410] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 9 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:59:58.173949  1567 raft_consensus.cc:1240] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 LEADER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 5. Current term is 6. Ops: []
I20260709 12:59:58.133585  4963 leader_election.cc:290] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:58.144997  4983 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:58.133267  4806 raft_consensus.cc:515] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:58.126533  4962 raft_consensus.cc:515] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:58.146082  4706 consensus_queue.cc:1048] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 12:59:58.206139  1539 leader_election.cc:304] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:58.160794  4967 raft_consensus.cc:2749] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:58.225028  5014 raft_consensus.cc:2804] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:58.194269  4861 raft_consensus.cc:2804] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:59:58.245966  1542 leader_election.cc:336] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.379s (SENT)
I20260709 12:59:58.258836  1542 leader_election.cc:304] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:58.215818  4996 raft_consensus.cc:493] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.154441  4976 raft_consensus.cc:2749] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:58.126382  4969 raft_consensus.cc:515] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:58.182287  4960 raft_consensus.cc:2749] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:58.169219  4953 raft_consensus.cc:3060] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:58.228118  5011 raft_consensus.cc:2749] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:59:58.181300  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 56293.2us
W20260709 12:59:58.216107  5006 log.cc:927] Time spent T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:59:58.205006  4974 raft_consensus.cc:2804] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:58.154271  4987 raft_consensus.cc:2749] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:59:58.167419  4858 raft_consensus.cc:2749] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:58.238998  4983 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:58.181272  1615 leader_election.cc:304] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:58.297082  4983 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:58.279146  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 180586us
W20260709 12:59:58.283701  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 143891us
I20260709 12:59:58.288877  4976 raft_consensus.cc:493] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:58.269876  5002 raft_consensus.cc:515] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:58.290287  4962 leader_election.cc:290] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:58.290288  5011 raft_consensus.cc:2804] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:58.248263  5014 raft_consensus.cc:493] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:58.256044  4861 raft_consensus.cc:493] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:58.331346  1542 leader_election.cc:336] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.949s (SENT)
I20260709 12:59:58.272001  4806 leader_election.cc:290] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:58.245398  5020 consensus_queue.cc:1048] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 12:59:58.294086  4974 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:58.268095  4996 raft_consensus.cc:515] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:58.250240  5013 raft_consensus.cc:2804] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:59:58.161016  4997 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:58.276990  4967 raft_consensus.cc:2749] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:59:58.325591  1689 leader_election.cc:304] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:58.205425  5005 raft_consensus.cc:515] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:58.330572  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:58.330722  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:58.306077  5001 raft_consensus.cc:697] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 9 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:58.331836  1542 leader_election.cc:304] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:58.314834  4983 raft_consensus.cc:493] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.332880  4861 raft_consensus.cc:3060] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:58.304618  5017 consensus_queue.cc:1048] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
W20260709 12:59:58.407353  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 72221.9us
I20260709 12:59:58.427084  4770 raft_consensus.cc:2804] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:58.427563  4770 raft_consensus.cc:493] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:59:58.435048  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:58.343528  4974 raft_consensus.cc:3060] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:58.331441  5014 raft_consensus.cc:3060] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:58.405658  2330 raft_consensus.cc:2468] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 7.
I20260709 12:59:58.332818  5011 raft_consensus.cc:697] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 12:59:58.436549  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
W20260709 12:59:58.398718  1617 leader_election.cc:336] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.944s (SENT)
I20260709 12:59:58.459353  1644 raft_consensus.cc:3060] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Advancing to term 9
W20260709 12:59:58.459867  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 111127us
I20260709 12:59:58.459687  5011 consensus_queue.cc:237] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:58.334401  4976 raft_consensus.cc:515] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:58.461221  4958 log.cc:927] Time spent T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 1.232s	user 0.003s	sys 0.003s
I20260709 12:59:58.427910  4770 raft_consensus.cc:3060] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:58.439692  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 12:59:58.464994  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 118390us
I20260709 12:59:58.464592  1643 raft_consensus.cc:2468] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 7.
I20260709 12:59:58.427946  4996 leader_election.cc:290] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 12:59:58.457913  1542 leader_election.cc:336] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.109s (SENT)
I20260709 12:59:58.406802  4858 raft_consensus.cc:2749] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:58.403787  5013 raft_consensus.cc:697] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 7 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 12:59:58.411137  4983 raft_consensus.cc:515] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:58.462319  4987 raft_consensus.cc:493] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:58.482862  4987 raft_consensus.cc:515] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:58.485591  4987 leader_election.cc:290] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:58.489352  4976 leader_election.cc:290] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:58.490447  5013 consensus_queue.cc:237] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:58.494462  5023 raft_consensus.cc:493] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:58.495193  5023 raft_consensus.cc:515] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:58.497565  5023 leader_election.cc:290] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:58.498080  1722 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2105) took 2217 ms (client timeout 1570 ms). Trace:
W20260709 12:59:58.498449  1722 rpcz_store.cc:269] 0709 12:59:56.280803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:56.284265 (+  3462us) service_pool.cc:224] Handling call
0709 12:59:58.497893 (+2213628us) spinlock_profiling.cc:243] Waited 1.72 s on lock 0x7b54002265d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:58.498018 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3959937408}
I20260709 12:59:58.498843  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 12:59:58.499416  1572 raft_consensus.cc:3060] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:58.505270  1567 raft_consensus.cc:1275] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:59:58.505642  1567 pending_rounds.cc:85] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting all ops after (but not including) 6
I20260709 12:59:58.505883  1567 pending_rounds.cc:107] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:59:58.506138  1567 raft_consensus.cc:2889] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:59:58.512593  1572 raft_consensus.cc:2468] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 9.
W20260709 12:59:58.512935  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 306842us
W20260709 12:59:58.516055  1542 leader_election.cc:336] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.236s (SENT)
I20260709 12:59:58.515504  1539 leader_election.cc:400] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391) with higher term. Message: Invalid argument: T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 6. Current term is 7.
I20260709 12:59:58.516664  1539 leader_election.cc:403] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:59:58.516604  1542 leader_election.cc:304] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
W20260709 12:59:58.516403  4970 consensus_meta.cc:287] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.517s	user 0.008s	sys 0.003s
W20260709 12:59:58.544690  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 363479us
I20260709 12:59:58.537891  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:58.473855  5001 consensus_queue.cc:237] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:58.554483  5025 consensus_queue.cc:1048] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:59:58.556603  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:58.556911  5030 consensus_queue.cc:1048] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:59:58.559206  4983 leader_election.cc:290] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:58.455471  4985 raft_consensus.cc:515] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:58.564980  4997 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:58.567394  2295 leader_election.cc:304] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:58.569859  4145 raft_consensus.cc:2804] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:59:58.570395  4145 raft_consensus.cc:697] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 12:59:58.570745  4920 consensus_queue.cc:1048] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:59:58.571271  4145 consensus_queue.cc:237] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:58.574260  4836 consensus_meta.cc:287] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.604s	user 0.006s	sys 0.004s
I20260709 12:59:58.578205  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:58.580817  1642 raft_consensus.cc:1240] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:58.521867  4976 raft_consensus.cc:2749] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391) with higher term. Message: Invalid argument: T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 6. Current term is 7.
I20260709 12:59:58.579238  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:58.521525  4858 raft_consensus.cc:2749] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:59:58.586252  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:58.597702  1642 raft_consensus.cc:2468] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6.
I20260709 12:59:58.542479  5023 consensus_queue.cc:1048] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 12:59:58.599005  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 12:59:58.600088  1575 raft_consensus.cc:2410] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:59:58.602643  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:58.605201  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:58.574704  4836 raft_consensus.cc:515] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:58.611819  5005 leader_election.cc:290] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:58.612708  5024 raft_consensus.cc:493] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:58.613252  5024 raft_consensus.cc:515] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:58.615386  5024 leader_election.cc:290] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:58.616092  5002 leader_election.cc:290] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:58.575114  4969 leader_election.cc:290] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:58.617823  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:58.625087  1539 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 12:59:58.603544  5008 consensus_meta.cc:287] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.522s	user 0.000s	sys 0.012s
I20260709 12:59:58.597604  4977 leader_election.cc:290] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:58.627501  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:58.603791  4983 raft_consensus.cc:493] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:58.607841  1649 raft_consensus.cc:2955] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 4 to 6, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 12:59:58.576736  4970 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:58.642841  4836 leader_election.cc:290] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:58.644003  4970 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:58.633246  4987 raft_consensus.cc:2804] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:59:58.648898  4987 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:58.649248  4987 raft_consensus.cc:3060] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:58.649946  4971 leader_election.cc:290] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:58.652916  1574 raft_consensus.cc:2393] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 8: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 12:59:58.653103  4953 raft_consensus.cc:515] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:58.653828  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:59:58.655233  4953 leader_election.cc:290] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:58.633646  5008 raft_consensus.cc:515] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:58.642110  5022 log.cc:927] Time spent T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
I20260709 12:59:58.659654  5008 leader_election.cc:290] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:58.662343  1644 raft_consensus.cc:2468] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 9.
I20260709 12:59:58.665081  4770 raft_consensus.cc:515] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:58.610107  4890 consensus_queue.cc:1059] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
W20260709 12:59:58.673187  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 211271us
I20260709 12:59:58.677244  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:58.672667  1642 raft_consensus.cc:2468] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6.
I20260709 12:59:58.673161  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:58.679585  1648 raft_consensus.cc:2468] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6.
I20260709 12:59:58.680421  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:58.680574  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:58.681228  1648 raft_consensus.cc:2410] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:59:58.681730  1642 raft_consensus.cc:2393] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 9: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 12:59:58.684125  1539 leader_election.cc:304] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:58.697242  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:58.702567  1539 leader_election.cc:304] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 12:59:58.637698  4983 raft_consensus.cc:515] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:58.724326  1651 raft_consensus.cc:1275] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:59:58.729243  4770 leader_election.cc:290] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:58.716177  1617 leader_election.cc:304] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:58.705855  4967 raft_consensus.cc:3055] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:59:58.746492  5005 raft_consensus.cc:2749] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:58.714735  4820 raft_consensus.cc:493] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:58.747313  4820 raft_consensus.cc:515] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:58.749503  4820 leader_election.cc:290] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:58.724663  4970 raft_consensus.cc:2804] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:59:58.725996  4971 raft_consensus.cc:2804] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:59:58.759235  4861 raft_consensus.cc:515] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:58.762357  4983 leader_election.cc:290] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:58.740429  4967 raft_consensus.cc:740] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
W20260709 12:59:58.770346  5004 log.cc:927] Time spent T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.651s	user 0.002s	sys 0.000s
I20260709 12:59:58.771020  4967 consensus_queue.cc:260] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:58.776877  4998 raft_consensus.cc:2749] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:59:58.780791  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 166340us
I20260709 12:59:58.782814  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:58.783401  1722 raft_consensus.cc:2468] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 8.
I20260709 12:59:58.718585  5024 consensus_queue.cc:1048] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:59:58.820515  4890 raft_consensus.cc:493] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:58.821111  4890 raft_consensus.cc:515] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:58.821982  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:58.822536  1649 raft_consensus.cc:1240] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 8. Current term is 9. Ops: []
I20260709 12:59:58.739324  5013 consensus_queue.cc:1048] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:59:58.823159  4890 leader_election.cc:290] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:58.833613  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 12:59:59.365342  5028 log.cc:927] Time spent T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.898s	user 0.003s	sys 0.000s
I20260709 12:59:58.868335  4974 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:59.412727  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
W20260709 12:59:58.900480  1617 leader_election.cc:336] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.509s (SENT)
W20260709 12:59:59.413636  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 513180us
W20260709 12:59:59.405454  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 1.09713e+06us
W20260709 12:59:59.132721  1542 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 3.225s (SENT) [suppressed 60 similar messages]
I20260709 12:59:59.417081  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:59.418187  1689 leader_election.cc:304] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:59.412128  4974 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 12:59:59.459745  1643 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.721s	user 0.047s	sys 0.054s
W20260709 12:59:59.462940  1643 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.047s	sys 0.056s
I20260709 12:59:58.764567  4971 raft_consensus.cc:493] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
W20260709 12:59:59.205813  5048 log.cc:927] Time spent T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 12:59:58.767326  4985 leader_election.cc:290] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 12:59:58.788594  4970 raft_consensus.cc:697] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
W20260709 12:59:58.949899  5015 log.cc:927] Time spent T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:59:59.478952  1651 raft_consensus.cc:1240] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 8. Current term is 9. Ops: []
W20260709 12:59:59.037153  5051 log.cc:927] Time spent T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.089s	user 0.000s	sys 0.006s
I20260709 12:59:59.051589  4770 raft_consensus.cc:493] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
W20260709 12:59:59.483107  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 350408us
I20260709 12:59:59.002171  5011 raft_consensus.cc:493] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 12:59:58.947115  4916 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:59.480218  2297 leader_election.cc:304] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 12:59:59.467343  4967 raft_consensus.cc:3060] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:59:59.450165  4861 leader_election.cc:290] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:59.476248  4971 raft_consensus.cc:3060] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:58.864401  4987 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:58.954939  5014 raft_consensus.cc:515] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 12:59:59.486716  4969 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.047s	sys 0.062s
I20260709 12:59:59.487253  4985 raft_consensus.cc:493] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:59.506278  1469 catalog_manager.cc:5697] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:59:59.512373  1650 raft_consensus.cc:1240] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 7. Current term is 8. Ops: []
I20260709 12:59:59.510003  4985 raft_consensus.cc:515] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:59.515801  4985 leader_election.cc:290] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 12:59:59.504962  4969 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.047s	sys 0.063s
I20260709 12:59:59.516287  4985 raft_consensus.cc:2749] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:59.489054  4770 raft_consensus.cc:515] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:59.521097  4985 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:59.521560  4145 raft_consensus.cc:2804] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:59:59.493496  5011 raft_consensus.cc:515] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:59.524025  1724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 693) took 1484 ms. Trace:
I20260709 12:59:59.524667  4985 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 12:59:59.526542  1724 rpcz_store.cc:276] 0709 12:59:58.039222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.039352 (+   130us) service_pool.cc:224] Handling call
0709 12:59:58.039645 (+   293us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:59:58.065487 (+ 25842us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:59:58.065532 (+    45us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:59:58.092041 (+ 26509us) log.cc:844] Serialized 52 byte log entry
0709 12:59:58.304145 (+212104us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:59:58.309184 (+  5039us) log.cc:844] Serialized 14 byte log entry
0709 12:59:58.309458 (+   274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:58.309559 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:59:58.773777 (+464218us) spinlock_profiling.cc:243] Waited 1.64 ms on lock 0x7b180048c8e0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef248c0a 00007fa9f8988219 00007fa9f628f58f 00007fa9ef2ce571 00007fa9ef2d07c1 00007fa9ef2d0779 00007fa9ef2d0709 00007fa9ef2d06d1 00007fa9ef2cf9cd
0709 12:59:59.360465 (+586688us) spinlock_profiling.cc:243] Waited 2.4 ms on lock 0x7b4400022b4c. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef1f4c85 00007fa9ef1f56a2 00007fa9f1f671db 00007fa9f1f62aaf 00007fa9f1f5686e 00007fa9f1f55bb6 00007fa9f1f557d8 00007fa9f1f5f221 00007fa9f1f5f1d9 00007fa9f1f5f169
0709 12:59:59.523830 (+163365us) raft_consensus.cc:1685] finished
0709 12:59:59.523852 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:59:59.523973 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16726,"prepare.queue_time_us":2163,"raft.queue_time_us":43800,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":24267,"spinlock_wait_cycles":35624320,"thread_start_us":176408,"threads_started":1,"wal-append.queue_time_us":289360}
I20260709 12:59:59.496757  4916 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:59.533625  4987 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:59.524885  4145 raft_consensus.cc:493] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:59:59.536144  4145 raft_consensus.cc:3060] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:59:59.544580  4971 raft_consensus.cc:515] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:59.546066  1567 raft_consensus.cc:1240] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 6. Current term is 7. Ops: []
I20260709 12:59:59.521485  4970 consensus_queue.cc:237] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 12:59:59.552767  2330 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32870 (request call id 346) took 1222 ms (client timeout 1608 ms). Trace:
I20260709 12:59:59.555523  4985 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 12:59:59.553172  2330 rpcz_store.cc:269] 0709 12:59:58.330380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.330507 (+   127us) service_pool.cc:224] Handling call
0709 12:59:59.549690 (+1219183us) spinlock_profiling.cc:243] Waited 59.5 ms on lock 0x7b54006c5a54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 12:59:59.549842 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":136846592}
I20260709 12:59:59.559567  1650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 590) took 1103 ms. Trace:
I20260709 12:59:59.559975  1650 rpcz_store.cc:276] 0709 12:59:58.455914 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.457349 (+  1435us) service_pool.cc:224] Handling call
0709 12:59:58.473686 (+ 16337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:59:59.515815 (+1042129us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:59:59.559314 (+ 43499us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b540040f1d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 12:59:59.559495 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2388188416}
I20260709 12:59:59.564034  4770 leader_election.cc:290] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:59.572615  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:59.573294  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:59.576323  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:59.582466  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:59.583256  1642 raft_consensus.cc:2393] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 9: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 12:59:59.583382  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 12:59:59.584429  2323 raft_consensus.cc:2393] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 8: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 12:59:59.591768  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 12:59:59.632953  1650 raft_consensus.cc:1275] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 12:59:59.641645  1542 leader_election.cc:336] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.503s (SENT)
I20260709 12:59:59.643097  1542 leader_election.cc:304] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
W20260709 12:59:59.639719  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 223950us
I20260709 12:59:59.645278  1689 leader_election.cc:304] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 12:59:59.646337  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 155852us
I20260709 12:59:59.590229  4974 raft_consensus.cc:493] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 12:59:59.649858  1689 leader_election.cc:304] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 12:59:59.634496  4985 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:59:59.639416  5013 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
W20260709 12:59:59.667402  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 138669us
I20260709 12:59:59.670737  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:59.671336  1646 raft_consensus.cc:3060] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:59:59.675236  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 12:59:59.675833  1650 raft_consensus.cc:3060] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Advancing to term 8
W20260709 12:59:59.677574  1542 leader_election.cc:336] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.567s (SENT)
I20260709 12:59:59.678069  1542 leader_election.cc:304] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:59.679225  1689 leader_election.cc:304] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 12:59:59.695636  1646 raft_consensus.cc:2468] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 7.
I20260709 12:59:59.655310  4974 raft_consensus.cc:515] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:59.673215  4969 raft_consensus.cc:2749] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:59.659250  4985 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 12:59:59.672098  5013 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 12:59:59.695827  5014 leader_election.cc:290] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:59.699424  4971 leader_election.cc:290] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:59.700307  5062 raft_consensus.cc:2749] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:59.712177  5069 raft_consensus.cc:2749] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:59.720213  5060 raft_consensus.cc:493] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 12:59:59.729378  5011 leader_election.cc:290] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 12:59:59.740361  4974 leader_election.cc:290] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 12:59:59.908589  5064 raft_consensus.cc:493] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:00.128095  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 434207us
I20260709 13:00:00.153828  4993 raft_consensus.cc:1064] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e: attempting to promote NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 to VOTER
I20260709 13:00:00.155297  5055 raft_consensus.cc:493] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 12:59:59.881541  5071 raft_consensus.cc:2749] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:00.158568  5013 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:00.161011  5074 raft_consensus.cc:493] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:00.161208  4770 raft_consensus.cc:493] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
W20260709 13:00:00.163844  4967 consensus_meta.cc:287] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.667s	user 0.009s	sys 0.012s
W20260709 13:00:00.164291  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 486699us
I20260709 13:00:00.164486  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 12:59:59.735551  5070 raft_consensus.cc:2749] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:59:59.934983  5066 raft_consensus.cc:493] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:00.173434  4985 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:00:00.165611  5068 log.cc:927] Time spent T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.471s	user 0.000s	sys 0.009s
I20260709 13:00:00.166852  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:00.174500  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:00.198103  1469 catalog_manager.cc:5697] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:00.167852  1650 raft_consensus.cc:2468] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8.
W20260709 13:00:00.168113  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 489229us
I20260709 13:00:00.361331  1689 leader_election.cc:304] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:00.260874  4916 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:00:00.290144  4923 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.004s	sys 0.009s
I20260709 13:00:00.193923  5073 raft_consensus.cc:493] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:00.365271  5070 raft_consensus.cc:2749] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:00:00.365906  4923 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.004s	sys 0.010s
I20260709 13:00:00.366029  5071 raft_consensus.cc:493] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.366225  5066 raft_consensus.cc:515] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:00.366729  5071 raft_consensus.cc:515] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:00.367247  5011 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:00.367790  5011 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:00.368726  5066 leader_election.cc:290] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:00.368932  5071 leader_election.cc:290] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:00:00.351173  1542 leader_election.cc:336] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.617s (SENT)
I20260709 13:00:00.351727  5074 raft_consensus.cc:515] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:00.369530  1542 leader_election.cc:304] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:00.369722  5011 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:00.371088  5074 leader_election.cc:290] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:00.371709  5074 raft_consensus.cc:2749] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:00.371917  4974 raft_consensus.cc:493] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:00.372400  5074 raft_consensus.cc:493] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.372501  4974 raft_consensus.cc:515] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 13:00:00.372951  5074 raft_consensus.cc:515] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:00.374775  4974 leader_election.cc:290] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:00.374976  5074 leader_election.cc:290] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:00.168952  1642 raft_consensus.cc:1240] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:00.375891  4974 raft_consensus.cc:493] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:00.376392  5071 raft_consensus.cc:493] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:00.376983  5071 raft_consensus.cc:515] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:00.379185  5071 leader_election.cc:290] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:00.365978  5060 raft_consensus.cc:515] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:00.210381  2297 leader_election.cc:304] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:00.195623  4969 raft_consensus.cc:493] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:00.353870  5005 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
W20260709 13:00:00.354543  1540 connection.cc:256] RPC call timeout handler was delayed by -1.0034592629999679s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16080000000000003s for a response
I20260709 13:00:00.354831  4770 raft_consensus.cc:515] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:00.390780  4782 raft_consensus.cc:2749] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:00.393772  5060 leader_election.cc:290] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:00.395473  1568 raft_consensus.cc:1275] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:00:00.355450  4970 raft_consensus.cc:493] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:00.195782  5078 raft_consensus.cc:493] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
W20260709 13:00:00.165702  4145 consensus_meta.cc:287] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.629s	user 0.012s	sys 0.008s
I20260709 13:00:00.388973  5066 raft_consensus.cc:493] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
W20260709 13:00:00.406224  4993 raft_consensus.cc:1068] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e: Unable to promote non-voter 05476b84d8f84d76a9a1f51b620a3c66: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:00:00.406474  4145 raft_consensus.cc:515] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:00.406584  5066 raft_consensus.cc:515] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:00.362565  1689 leader_election.cc:304] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
W20260709 13:00:00.409090  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 46612.8us
I20260709 13:00:00.409946  1689 leader_election.cc:304] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:00.410568  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:00.411165  1689 leader_election.cc:304] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:00.411902  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:00.412686  1572 raft_consensus.cc:2468] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 8.
W20260709 13:00:00.388006  1617 leader_election.cc:336] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.630s (SENT)
I20260709 13:00:00.388726  5073 raft_consensus.cc:515] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:00.405568  5067 log.cc:927] Time spent T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.730s	user 0.003s	sys 0.008s
I20260709 13:00:00.411294  1570 raft_consensus.cc:2368] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 7. Current term is 8.
I20260709 13:00:00.352666  1722 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 6.
W20260709 13:00:00.414346  1617 leader_election.cc:336] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.687s (SENT)
W20260709 13:00:00.382268  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 171988us
I20260709 13:00:00.412294  1689 leader_election.cc:304] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e
W20260709 13:00:00.421515  1617 leader_election.cc:336] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.803s (SENT)
I20260709 13:00:00.427290  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:00.433440  1644 raft_consensus.cc:3060] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:00:00.423471  2294 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:00.436465  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:00.408553  5066 leader_election.cc:290] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:00.455870  1644 raft_consensus.cc:2468] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 9.
I20260709 13:00:00.459968  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:00.417309  4985 raft_consensus.cc:2749] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:00.402823  5074 raft_consensus.cc:493] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:00.467248  5074 raft_consensus.cc:515] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:00.417079  4145 leader_election.cc:290] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:00.431380  5070 raft_consensus.cc:2804] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:00:00.468603  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 144857us
W20260709 13:00:00.481242  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 68986.8us
I20260709 13:00:00.422583  5077 raft_consensus.cc:2749] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:00.388675  4974 raft_consensus.cc:515] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:00.432281  4927 consensus_queue.cc:1048] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:00:00.484813  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:00.485359  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:00.423060  5011 raft_consensus.cc:493] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:00.485934  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:00.403934  4969 raft_consensus.cc:515] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:00.489212  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:00.486596  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:00.487221  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:00.490089  1717 raft_consensus.cc:2393] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 7: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:00.487980  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:00.352720  5055 raft_consensus.cc:515] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:00.492833  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:00.352356  5064 raft_consensus.cc:515] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:00.496646  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:00.497608  1722 raft_consensus.cc:2393] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 9: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:00.434583  5060 consensus_queue.cc:1059] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:00:00.502938  1718 raft_consensus.cc:1275] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:00:00.491632  5088 raft_consensus.cc:2804] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:00.492282  4770 leader_election.cc:290] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:00.493670  1717 raft_consensus.cc:2410] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:00:00.507506  1724 raft_consensus.cc:2393] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 8: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:00.494045  1719 raft_consensus.cc:2410] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:00:00.494625  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:00.461165  5080 raft_consensus.cc:493] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:00.404196  5005 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:00.461181  5084 raft_consensus.cc:2749] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:00.499399  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:00.420807  4970 raft_consensus.cc:515] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:00.488890  1721 raft_consensus.cc:2468] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 9.
I20260709 13:00:00.500625  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:00.502007  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:00.516707  1723 raft_consensus.cc:2468] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 4.
I20260709 13:00:00.517068  1567 raft_consensus.cc:3060] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:00.505085  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:00.493952  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:00.518051  1725 raft_consensus.cc:2468] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 7.
I20260709 13:00:00.432557  5078 raft_consensus.cc:515] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:00.509799  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:00.515154  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:00.512399  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:00.517307  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:00.508625  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:00.485359  4876 consensus_queue.cc:1048] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:00:00.523795  1718 raft_consensus.cc:2393] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 8: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:00.502043  5064 leader_election.cc:290] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:00.519616  1570 raft_consensus.cc:3060] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:00.525283  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:00.525993  1720 raft_consensus.cc:2393] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 6: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:00.519069  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:00.529009  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:00.529057  1725 raft_consensus.cc:2468] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
I20260709 13:00:00.528128  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:00.530539  1575 raft_consensus.cc:3060] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:00:00.493742  5011 raft_consensus.cc:515] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:00.530117  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:00.535229  1725 raft_consensus.cc:2368] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 6. Current term is 7.
I20260709 13:00:00.536149  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:00.545557  1719 raft_consensus.cc:2468] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 7.
I20260709 13:00:00.532858  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:00.531670  1646 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 6.
I20260709 13:00:00.546747  1716 raft_consensus.cc:2468] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
I20260709 13:00:00.546890  1721 raft_consensus.cc:2468] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
I20260709 13:00:00.532054  1723 raft_consensus.cc:2393] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 5: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:00.536420  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:00:00.535662  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 90379.6us
I20260709 13:00:00.537194  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:00.548519  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:00.513885  5074 leader_election.cc:290] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:00.549235  1574 raft_consensus.cc:2468] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6.
I20260709 13:00:00.549877  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:00.550462  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:00.553925  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:00.551146  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 13:00:00.547941  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 90314.5us
I20260709 13:00:00.549130  1717 raft_consensus.cc:2468] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 4.
I20260709 13:00:00.524924  5070 raft_consensus.cc:697] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 8 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:00.556682  5070 consensus_queue.cc:237] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:00.554586  1720 raft_consensus.cc:2376] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 7. Re-sending same reply.
I20260709 13:00:00.554109  1718 raft_consensus.cc:2468] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 7.
I20260709 13:00:00.563395  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:00.566051  1723 raft_consensus.cc:2468] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8.
I20260709 13:00:00.568847  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:00.569916  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:00.570107  4974 leader_election.cc:290] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:00.518354  4913 consensus_queue.cc:1059] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:00:00.570511  1719 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 7.
I20260709 13:00:00.571677  1574 raft_consensus.cc:1240] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:00.577135  1575 raft_consensus.cc:2468] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 9.
I20260709 13:00:00.584107  1567 raft_consensus.cc:2468] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 9.
I20260709 13:00:00.586102  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:00.587368  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:00.601954  1719 raft_consensus.cc:3055] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:00.544203  5055 leader_election.cc:290] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:00.534330  5060 consensus_queue.cc:1059] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:00:00.602363  1719 raft_consensus.cc:740] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:00.563446  5064 consensus_queue.cc:1048] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
W20260709 13:00:00.740965  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 133383us
I20260709 13:00:00.614046  1539 leader_election.cc:304] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 13:00:00.633816  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 48847.6us
I20260709 13:00:00.745014  2294 leader_election.cc:304] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:00.604101  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:00:00.634153  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 49008.8us
I20260709 13:00:00.526630  5080 raft_consensus.cc:515] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:00.697086  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:00.750521  5070 raft_consensus.cc:3055] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:00.750944  1644 raft_consensus.cc:2393] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 8: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:00.750988  5070 raft_consensus.cc:740] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:00.697356  5013 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:00.752210  5013 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:00.741189  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:00.746505  1725 raft_consensus.cc:2368] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 6. Current term is 7.
I20260709 13:00:00.753249  1651 raft_consensus.cc:2368] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 8. Current term is 9.
W20260709 13:00:00.744917  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 222659us
I20260709 13:00:00.752079  5070 consensus_queue.cc:260] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:00.754992  5070 raft_consensus.cc:3060] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:00.617146  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:00.757077  5060 consensus_queue.cc:1059] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:00.757827  5060 consensus_queue.cc:1243] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer 4dbe7d47a2374afca075d3a98583b49e log is divergent from this leader: its last log entry 7.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:00:00.758353  5060 raft_consensus.cc:3055] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:00.758733  5060 raft_consensus.cc:740] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:00.632048  1570 raft_consensus.cc:2468] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 9.
I20260709 13:00:00.759562  5060 consensus_queue.cc:260] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:00.749266  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 174623us
W20260709 13:00:00.762221  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 148249us
I20260709 13:00:00.743852  1719 consensus_queue.cc:260] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:00.777880  1719 raft_consensus.cc:3060] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:00.763146  1539 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:00.910945  1644 raft_consensus.cc:1275] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:00:00.929446  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 51793.7us
W20260709 13:00:00.931526  1617 leader_election.cc:336] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.225s (SENT)
W20260709 13:00:00.932559  1617 leader_election.cc:336] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.535s (SENT)
I20260709 13:00:00.933110  1617 leader_election.cc:304] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:00:00.910080  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 385793us
I20260709 13:00:00.934474  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:00.945227  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:00.949607  1644 raft_consensus.cc:2468] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 7.
I20260709 13:00:00.936152  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 13:00:00.802361  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 53583.5us
I20260709 13:00:00.950798  1725 raft_consensus.cc:2393] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 6: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:00.763247  1574 raft_consensus.cc:1275] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:00:00.949757  1542 leader_election.cc:336] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.715s (SENT)
I20260709 13:00:00.731156  5014 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
W20260709 13:00:00.947609  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 202656us
I20260709 13:00:00.963922  2294 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:00.745093  5073 leader_election.cc:290] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:00:00.954732  1542 leader_election.cc:336] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.478s (SENT)
I20260709 13:00:00.961568  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:00.662222  5082 raft_consensus.cc:493] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:00.965355  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 202269us
I20260709 13:00:00.660615  4770 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:00.953048  1718 raft_consensus.cc:2393] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 8: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:00.927336  5060 raft_consensus.cc:3060] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:00.970443  4965 raft_consensus.cc:2804] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:00.972752  5005 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:00.972885  5080 leader_election.cc:290] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:00.973990  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:01.052311  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:00.962070  4783 raft_consensus.cc:2804] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:00.977221  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:01.053207  1725 raft_consensus.cc:2468] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6.
I20260709 13:00:00.980804  4969 leader_election.cc:290] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:00.981554  5092 consensus_queue.cc:1059] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:00:00.981953  5013 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:00.985548  5071 raft_consensus.cc:2804] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:00.986773  5011 leader_election.cc:290] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:00.987087  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:00.987931  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:01.066352  1643 raft_consensus.cc:2468] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8.
I20260709 13:00:01.067305  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:00.988720  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:00.989675  1645 raft_consensus.cc:1275] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:00:00.990257  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:01.070263  1649 raft_consensus.cc:2468] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 7.
I20260709 13:00:00.990892  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:00.991880  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:00.966336  5098 consensus_queue.cc:1059] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:00:00.997251  1570 raft_consensus.cc:1275] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:00:00.997864  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:01.073223  1576 raft_consensus.cc:3060] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:00.986797  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:00.694761  4993 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:00.762410  5095 raft_consensus.cc:493] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:01.006966  1542 leader_election.cc:304] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:01.009492  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:01.007187  1723 raft_consensus.cc:2468] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8.
W20260709 13:00:01.016206  1572 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.019s	sys 0.047s
I20260709 13:00:01.020972  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:00.764998  5066 raft_consensus.cc:2804] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:00.965587  1574 raft_consensus.cc:1275] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:00:01.083015  1644 raft_consensus.cc:2410] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:00:01.083566  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:01.033504  1615 leader_election.cc:304] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:00.741230  4920 consensus_queue.cc:1059] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.226s
I20260709 13:00:01.042590  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:01.081595  1647 raft_consensus.cc:2393] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 9: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:01.043526  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 13:00:01.082499  1572 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.020s	sys 0.047s
W20260709 13:00:01.081023  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 148522us
I20260709 13:00:01.085857  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:01.082223  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:00.798959  5078 leader_election.cc:290] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:01.074819  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:00:01.081681  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 126982us
W20260709 13:00:01.085438  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 52061.2us
W20260709 13:00:01.087203  1542 leader_election.cc:336] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.460s (SENT)
I20260709 13:00:01.091144  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:01.091969  1719 raft_consensus.cc:2468] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
I20260709 13:00:01.089447  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:01.093114  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:01.093034  1718 raft_consensus.cc:2468] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8.
I20260709 13:00:01.043180  5055 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:01.100809  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:01.051479  4965 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:01.051824  4890 raft_consensus.cc:493] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:01.063045  5074 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:01.006989  5014 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:01.112895  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:01.118340  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:01.119165  1719 raft_consensus.cc:2468] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 4.
I20260709 13:00:01.122995  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:01.124080  1718 raft_consensus.cc:2393] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 5: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
W20260709 13:00:01.103011  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 139157us
I20260709 13:00:01.100809  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:01.085323  5071 raft_consensus.cc:697] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:01.097348  5013 raft_consensus.cc:2804] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:00:01.135150  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:01.144186  4783 raft_consensus.cc:697] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:01.089620  5073 raft_consensus.cc:493] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:01.045317  5082 raft_consensus.cc:515] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:01.051626  4770 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:01.106396  4965 raft_consensus.cc:3060] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:01.153376  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:01.181387  1723 raft_consensus.cc:2376] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7. Re-sending same reply.
I20260709 13:00:01.182521  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:00:01.131932  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 88396.2us
I20260709 13:00:01.156687  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:01.157217  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:01.160583  1645 raft_consensus.cc:1240] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:00:01.102559  5078 raft_consensus.cc:493] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:01.115510  5097 raft_consensus.cc:3055] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:01.179726  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:01.084944  4993 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:01.276160  2330 raft_consensus.cc:1275] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:00:01.212299  1643 raft_consensus.cc:2468] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 7.
W20260709 13:00:01.222747  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 134348us
I20260709 13:00:01.331224  1718 raft_consensus.cc:2468] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 9.
I20260709 13:00:01.213726  1723 raft_consensus.cc:2468] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
I20260709 13:00:01.315817  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:01.213025  1539 leader_election.cc:400] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391) with higher term. Message: Invalid argument: T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 8. Current term is 9.
I20260709 13:00:01.330665  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:01.316015  1576 raft_consensus.cc:2468] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 9.
I20260709 13:00:01.334213  1539 leader_election.cc:403] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:01.299716  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 13:00:01.338423  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 125583us
I20260709 13:00:01.339789  1539 leader_election.cc:304] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:01.089416  5095 raft_consensus.cc:515] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:01.177557  4970 leader_election.cc:290] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:01.209245  5116 raft_consensus.cc:2749] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:01.423516  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:01.111645  5055 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:01.432598  1723 raft_consensus.cc:2468] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6.
I20260709 13:00:01.429286  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:01.434175  2327 raft_consensus.cc:3060] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:01.427714  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 88006.7us
W20260709 13:00:01.430603  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 97462us
I20260709 13:00:01.431059  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:01.431272  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
W20260709 13:00:01.438357  5107 log.cc:927] Time spent T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.193s	user 0.000s	sys 0.000s
I20260709 13:00:01.164147  5013 raft_consensus.cc:493] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:01.316026  5011 raft_consensus.cc:493] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:01.331691  5097 raft_consensus.cc:740] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:01.213575  5111 raft_consensus.cc:493] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:01.126318  4890 raft_consensus.cc:515] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:01.125664  5074 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:01.210192  5073 raft_consensus.cc:515] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:01.313038  2323 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "608abea191d946228bed666c5560fd0a"
dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
mode: GRACEFUL
new_leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:39778
I20260709 13:00:02.092231  5013 raft_consensus.cc:3060] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:01.448062  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:02.093611  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:01.551939  1570 raft_consensus.cc:2468] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 9.
W20260709 13:00:02.094326  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:01.762017  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 13:00:01.715588  1542 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.034s	sys 0.057s
W20260709 13:00:02.095110  1542 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.005s	user 0.034s	sys 0.074s
W20260709 13:00:02.003042  1647 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.019s	sys 0.040s
I20260709 13:00:01.446883  1646 raft_consensus.cc:2468] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 10.
W20260709 13:00:02.096093  1647 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.023s	sys 0.045s
I20260709 13:00:01.646351  2327 raft_consensus.cc:2468] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8.
I20260709 13:00:01.547186  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:01.525471  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:01.544627  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
W20260709 13:00:01.733211  5066 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.006s	sys 0.023s
I20260709 13:00:01.642977  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 2028) took 1152 ms. Trace:
I20260709 13:00:01.524210  4783 consensus_queue.cc:237] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:01.244705  4969 raft_consensus.cc:493] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:02.103566  1568 raft_consensus.cc:1240] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 7. Current term is 8. Ops: []
W20260709 13:00:02.085088  1615 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.001s	sys 0.009s
W20260709 13:00:02.147418  1615 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.001s	sys 0.009s
I20260709 13:00:02.145639  1567 rpcz_store.cc:276] 0709 13:00:00.490969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.585950 (+ 94981us) service_pool.cc:224] Handling call
0709 13:00:00.741946 (+155996us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:00.742148 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:00:01.211211 (+469063us) log.cc:844] Serialized 14 byte log entry
0709 13:00:01.642604 (+431393us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:01.642665 (+    61us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:01.642713 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:01.642776 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:01.642915 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":139978,"prepare.queue_time_us":20463,"prepare.run_cpu_time_us":9053,"prepare.run_wall_time_us":152187,"raft.queue_time_us":261085,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"thread_start_us":802203,"threads_started":2}
W20260709 13:00:02.147727  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 710983us
W20260709 13:00:01.445890  5099 log.cc:927] Time spent T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
W20260709 13:00:02.152566  1617 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.006s	sys 0.005s
I20260709 13:00:02.152769  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 13:00:02.157636  1617 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.006s	sys 0.005s
W20260709 13:00:01.465934  5070 consensus_meta.cc:287] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.710s	user 0.008s	sys 0.002s
I20260709 13:00:01.341383  5078 raft_consensus.cc:515] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:02.161284  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 13:00:01.783049  5103 log.cc:927] Time spent T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.570s	user 0.000s	sys 0.001s
I20260709 13:00:02.165338  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 13:00:01.807344  5104 log.cc:927] Time spent T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.283s	user 0.000s	sys 0.000s
I20260709 13:00:02.175805  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:02.176693  1569 raft_consensus.cc:2468] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 8.
I20260709 13:00:02.165851  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 13:00:02.152050  5066 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.036s	user 0.013s	sys 0.033s
I20260709 13:00:01.421298  5115 raft_consensus.cc:2749] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391) with higher term. Message: Invalid argument: T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 8. Current term is 9.
I20260709 13:00:02.178166  1725 raft_consensus.cc:2468] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 9.
I20260709 13:00:01.973093  5055 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:02.139886  5114 raft_consensus.cc:493] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:01.902463  5113 raft_consensus.cc:493] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:02.150566  5098 raft_consensus.cc:493] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:02.034229  5082 leader_election.cc:290] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:01.806314  5116 raft_consensus.cc:493] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
W20260709 13:00:02.194631  1542 leader_election.cc:336] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.696s (SENT)
I20260709 13:00:02.245386  1542 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
W20260709 13:00:02.246429  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 51834.4us
W20260709 13:00:02.247172  1542 leader_election.cc:336] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.838s (SENT)
I20260709 13:00:01.815912  5095 leader_election.cc:290] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:01.643631  5112 raft_consensus.cc:2804] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:02.198405  5134 raft_consensus.cc:493] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:02.207361  4965 consensus_meta.cc:287] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.925s	user 0.008s	sys 0.001s
W20260709 13:00:02.207762  1468 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55620 (request call id 274) took 35228 ms (client timeout 15000 ms). Trace:
I20260709 13:00:02.208001  1723 raft_consensus.cc:2468] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6.
I20260709 13:00:02.209323  5078 leader_election.cc:290] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:02.209256  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:02.152278  4969 raft_consensus.cc:515] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:02.277381  1716 raft_consensus.cc:2410] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:00:02.278121  1716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1519) took 1674 ms. Trace:
I20260709 13:00:02.278264  4969 leader_election.cc:290] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:02.278638  1716 rpcz_store.cc:276] 0709 13:00:00.603526 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.605255 (+  1729us) service_pool.cc:224] Handling call
0709 13:00:02.209115 (+1603860us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b5800196e98. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef296b71 00007fa9ef296a22 00007fa9f81afc09 00007fa9f7309ee0 00007fa9f73d30ab 00007fa9f73d3131 00007fa9f73810a0 00007fa9f7380984 00007fa9f08fb6d4 00007fa9f08fb662
0709 13:00:02.277999 (+ 68884us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":429895040}
I20260709 13:00:02.279254  4965 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:02.210533  1469 catalog_manager.cc:5697] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 4 to 6, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 6 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:02.281590  5014 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:02.282370  4981 raft_consensus.cc:3055] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:02.282800  4981 raft_consensus.cc:740] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:02.281983  1469 catalog_manager.cc:5697] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:02.283859  4965 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:02.283671  4981 consensus_queue.cc:260] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:02.261194  1468 rpcz_store.cc:269] 0709 12:59:26.983629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:26.994691 (+ 11062us) service_pool.cc:224] Handling call
0709 13:00:02.207491 (+35212800us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:59:50.712165 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:59:50.948664 (+236499us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:59:50.948731 (+    67us) write_op.cc:435] Acquired schema lock
0709 12:59:50.948758 (+    27us) tablet.cc:662] Decoding operations
0709 12:59:50.950138 (+  1380us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:59:50.950266 (+   128us) write_op.cc:641] Partition lock acquired for write op
0709 12:59:50.950305 (+    39us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:59:50.951459 (+  1154us) tablet.cc:701] Row locks acquired
0709 12:59:50.951540 (+    81us) write_op.cc:260] PREPARE: finished
0709 12:59:50.951759 (+   219us) write_op.cc:270] Start()
0709 12:59:50.951952 (+   193us) write_op.cc:276] Timestamp: P: 1783601990951680 usec, L: 0
0709 12:59:50.951984 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 12:59:51.028156 (+ 76172us) log.cc:844] Serialized 3636 byte log entry
0709 12:59:53.460153 (+2431997us) op_driver.cc:464] REPLICATION: finished
0709 12:59:54.021996 (+561843us) spinlock_profiling.cc:243] Waited 2.22 ms on lock 0x7b5400400028. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f87779e1 00007fa9f877664c 00007fa9f5df2845 00007fa9f5df6d61 00007fa9f5df6d19 00007fa9f5df6ca9 00007fa9f5df6c71 00007fa9f5df5e9d 000000000038f354 000000000038f199 00007fa9ef2ce475
0709 12:59:54.022121 (+   125us) write_op.cc:301] APPLY: starting
0709 12:59:54.022273 (+   152us) tablet.cc:1367] starting BulkCheckPresence
0709 12:59:54.022729 (+   456us) tablet.cc:1370] finished BulkCheckPresence
0709 12:59:54.022806 (+    77us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:59:54.538146 (+515340us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:59:54.538546 (+   400us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 12:59:54.538606 (+    60us) write_op.cc:312] APPLY: finished
0709 12:59:54.539092 (+   486us) log.cc:844] Serialized 71 byte log entry
0709 12:59:54.874004 (+334912us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:54.959901 (+ 85897us) write_op.cc:454] Released schema lock
0709 12:59:54.959976 (+    75us) write_op.cc:341] FINISH: Updating metrics
0709 12:59:54.960513 (+   537us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:59:54.960588 (+    75us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5572808,"reported_tablets":29,"child_traces":[["op",{"apply.queue_time_us":172759,"apply.run_cpu_time_us":56428,"apply.run_wall_time_us":1315239,"num_ops":9,"prepare.queue_time_us":98575,"prepare.run_cpu_time_us":423863,"prepare.run_wall_time_us":1940131,"raft.queue_time_us":229079,"raft.run_cpu_time_us":8831,"raft.run_wall_time_us":95634,"replication_time_us":2507896,"spinlock_wait_cycles":5094784,"thread_start_us":1998882,"threads_started":5,"wal-append.queue_time_us":2062090,"wal-append.run_cpu_time_us":18876,"wal-append.run_wall_time_us":2675710}]]}
I20260709 13:00:01.446121  4970 consensus_queue.cc:1048] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.730s
I20260709 13:00:02.214536  1572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 2021) took 1793 ms. Trace:
I20260709 13:00:02.161799  4770 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:02.298120  5128 raft_consensus.cc:2749] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:00:02.162504  5106 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.002s	sys 0.008s
I20260709 13:00:02.219010  5115 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:02.301534  5115 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:02.139439  5097 consensus_queue.cc:260] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:02.227700  5055 consensus_queue.cc:1048] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:02.226249  5122 raft_consensus.cc:493] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:02.231650  4890 leader_election.cc:290] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:02.221518  5113 raft_consensus.cc:515] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:02.219122  5114 raft_consensus.cc:515] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:02.184500  5066 raft_consensus.cc:697] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:02.316759  5141 consensus_queue.cc:1048] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:00:02.317366  5066 consensus_queue.cc:237] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:02.318172  1570 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36640 (request call id 2040) took 1286 ms (client timeout 1625 ms). Trace:
W20260709 13:00:02.318626  1570 rpcz_store.cc:269] 0709 13:00:01.032110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:01.081952 (+ 49842us) service_pool.cc:224] Handling call
0709 13:00:02.317987 (+1236035us) spinlock_profiling.cc:243] Waited 465 ms on lock 0x7b54003f5cd4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:02.318113 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1070318976}
I20260709 13:00:02.238891  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:02.319916  5115 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:02.319968  1724 raft_consensus.cc:2468] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6.
W20260709 13:00:02.320657  1724 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1521) took 1704 ms (client timeout 2100 ms). Trace:
I20260709 13:00:02.314422  1722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1501) took 1815 ms. Trace:
W20260709 13:00:02.321069  1724 rpcz_store.cc:269] 0709 13:00:00.616053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.664597 (+ 48544us) service_pool.cc:224] Handling call
0709 13:00:02.238748 (+1574151us) spinlock_profiling.cc:243] Waited 187 ms on lock 0x7b5800196e98. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef296b71 00007fa9ef296a22 00007fa9f81afc09 00007fa9f7309ee0 00007fa9f73d30ab 00007fa9f73d3131 00007fa9f73810a0 00007fa9f7380984 00007fa9f08fb6d4 00007fa9f08fb662
0709 13:00:02.320596 (+ 81848us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":429785472}
I20260709 13:00:02.239852  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:02.240712  5136 consensus_queue.cc:1048] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:02.241556  5098 raft_consensus.cc:515] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:02.137200  5011 raft_consensus.cc:515] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:02.244585  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 80301.5us
I20260709 13:00:02.344226  1540 leader_election.cc:304] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:02.345772  5011 leader_election.cc:290] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:02.345890  1540 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:02.260870  5134 raft_consensus.cc:515] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:02.266650  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36640 (request call id 2038) took 1274 ms. Trace:
I20260709 13:00:02.258940  4993 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:02.132691  5111 raft_consensus.cc:515] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:02.273823  5060 consensus_meta.cc:287] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 1.222s	user 0.013s	sys 0.000s
I20260709 13:00:02.275301  4930 raft_consensus.cc:3055] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:02.291159  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:01.590453  5071 consensus_queue.cc:237] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:02.293224  2331 raft_consensus.cc:1240] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:02.381016  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 615) took 1219 ms. Trace:
I20260709 13:00:02.381474  1644 rpcz_store.cc:276] 0709 13:00:01.161924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:01.162276 (+   352us) service_pool.cc:224] Handling call
0709 13:00:01.162640 (+   364us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:01.239290 (+ 76650us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:01.239324 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:01.239369 (+    45us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:01.239413 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:02.380777 (+1141364us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b54002b1954. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:02.380824 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:02.380956 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40941312}
W20260709 13:00:02.383157  5077 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:00:02.383263  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:02.347095  5097 raft_consensus.cc:3060] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:02.303447  1469 catalog_manager.cc:5697] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 3 to 4, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 4 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:02.253839  5112 raft_consensus.cc:493] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:02.316097  5113 leader_election.cc:290] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:02.340361  5093 raft_consensus.cc:493] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:02.342082  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:02.321313  1722 rpcz_store.cc:276] 0709 13:00:00.499155 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.554865 (+ 55710us) service_pool.cc:224] Handling call
0709 13:00:00.569190 (+ 14325us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:00.569634 (+   444us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:00.569660 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:00.570785 (+  1125us) log.cc:844] Serialized 590 byte log entry
0709 13:00:00.610131 (+ 39346us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:02.234220 (+1624089us) spinlock_profiling.cc:243] Waited 23.5 ms on lock 0x7b24003dcc58. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef1549c4 00007fa9ef152acb 00007fa9ef30ddc9 00007fa9ef30da55 00007fa9ef30cfb0 00007fa9f1f83488 00007fa9f1f83be8 00007fa9f1f5b398 00007fa9f1f5676a 00007fa9f1f55bb6
0709 13:00:02.310618 (+ 76398us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b1800310960. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9f1f634bc 00007fa9ef2b148b 00007fa9f810bab9 00007fa9ef2cd69b 00007fa9ef2cb93f 00007fa9ef2cb455 00007fa9f5db33c7 00007fa9f23c59a7 00007fa9f23d50bf
0709 13:00:02.313629 (+  3011us) log.cc:844] Serialized 14 byte log entry
0709 13:00:02.313944 (+   315us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:02.314060 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:02.314126 (+    66us) raft_consensus.cc:1685] finished
0709 13:00:02.314148 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:02.314341 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":703856,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":176284,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":4082,"spinlock_wait_cycles":90310400,"thread_start_us":498348,"threads_started":2,"wal-append.queue_time_us":557174}
I20260709 13:00:02.343101  1720 raft_consensus.cc:2410] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:00:02.350225  1569 rpcz_store.cc:276] 0709 13:00:00.992236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:01.042175 (+ 49939us) service_pool.cc:224] Handling call
0709 13:00:02.266409 (+1224234us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b5400314554. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:02.266549 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2510790400}
I20260709 13:00:02.294045  1572 rpcz_store.cc:276] 0709 13:00:00.421236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.466578 (+ 45342us) service_pool.cc:224] Handling call
0709 13:00:00.467019 (+   441us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:00.467419 (+   400us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:00:00.468574 (+  1155us) log.cc:844] Serialized 14 byte log entry
0709 13:00:01.121349 (+652775us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:01.122083 (+   734us) log.cc:844] Serialized 52 byte log entry
0709 13:00:01.122243 (+   160us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:01.122281 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:01.122354 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:02.214306 (+1091952us) raft_consensus.cc:1685] finished
0709 13:00:02.214325 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:02.214475 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":10464,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":126357,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":65257,"thread_start_us":617898,"threads_started":2,"wal-append.queue_time_us":721790}
I20260709 13:00:02.352001  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:02.402114  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:02.401782  1469 catalog_manager.cc:5697] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 3 to 9. New cstate: current_term: 9 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:02.403075  5134 leader_election.cc:290] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:02.403373  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:02.353690  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:02.403673  1469 catalog_manager.cc:5697] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:02.367620  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 13:00:02.353634  1651 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.232s	user 0.008s	sys 0.021s
W20260709 13:00:02.405841  1651 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.293s	user 0.009s	sys 0.022s
I20260709 13:00:02.405619  1469 catalog_manager.cc:5697] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:02.406563  1651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 1580) took 1642 ms. Trace:
I20260709 13:00:02.310122  5128 raft_consensus.cc:493] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.369753  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 13:00:02.369776  1691 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:58782 dropped due to backpressure: service queue is full with 50 items
I20260709 13:00:02.409304  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:02.307438  4965 consensus_queue.cc:1059] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 13:00:02.254712  5116 raft_consensus.cc:515] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:02.351164  5115 raft_consensus.cc:2749] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:02.384949  5070 raft_consensus.cc:493] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.347610  5122 raft_consensus.cc:515] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:02.414768  5113 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:02.409786  5093 raft_consensus.cc:515] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:02.275990  5074 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:02.414808  5128 raft_consensus.cc:515] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:02.417759  5093 leader_election.cc:290] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:02.376616  5013 raft_consensus.cc:515] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:02.419123  5128 leader_election.cc:290] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:02.419636  5013 leader_election.cc:290] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:02.398893  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:02.420976  4882 raft_consensus.cc:3055] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:02.421420  4882 raft_consensus.cc:740] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:02.395532  1689 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1526) took 1442 ms. Trace:
I20260709 13:00:02.421698  5098 leader_election.cc:290] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:02.367766  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 57415us
I20260709 13:00:02.422223  4882 consensus_queue.cc:260] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:02.423074  1615 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:02.423264  4882 raft_consensus.cc:3060] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:02.425922  5136 raft_consensus.cc:2804] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:02.426192  5111 leader_election.cc:290] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:02.426484  5136 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:02.426941  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 616) took 1263 ms. Trace:
I20260709 13:00:02.427001  5136 raft_consensus.cc:3060] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:02.406972  1651 rpcz_store.cc:276] 0709 13:00:00.764109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.764438 (+   329us) service_pool.cc:224] Handling call
0709 13:00:00.932904 (+168466us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:00.933152 (+   248us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:00.960980 (+ 27828us) log.cc:844] Serialized 14 byte log entry
0709 13:00:01.112772 (+151792us) log.cc:844] Serialized 14 byte log entry
0709 13:00:02.269025 (+1156253us) spinlock_profiling.cc:243] Waited 20.6 ms on lock 0x7b18002a5380. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef2ce3f3 00007fa9ef2d07c1 00007fa9ef2d0779 00007fa9ef2d0709 00007fa9ef2d06d1 00007fa9ef2cf9cd 000000000038f354 000000000038f199 00007fa9ef2b183a
0709 13:00:02.406225 (+137200us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:02.406280 (+    55us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:02.406330 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:02.406404 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:02.406509 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75668,"prepare.queue_time_us":27535,"prepare.run_cpu_time_us":128,"prepare.run_wall_time_us":3866,"raft.queue_time_us":402322,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":86662,"spinlock_wait_cycles":47298816,"thread_start_us":1433453,"threads_started":2,"wal-append.queue_time_us":149465}
I20260709 13:00:02.404397  5114 leader_election.cc:290] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:02.409343  1720 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1515) took 1825 ms (client timeout 1503 ms). Trace:
I20260709 13:00:02.372936  4930 raft_consensus.cc:740] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
W20260709 13:00:02.433351  1720 rpcz_store.cc:269] 0709 13:00:00.584123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.587109 (+  2986us) service_pool.cc:224] Handling call
0709 13:00:02.239712 (+1652603us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b5800196e98. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef296b71 00007fa9ef296a22 00007fa9f81afc09 00007fa9f7309ee0 00007fa9f73d30ab 00007fa9f73d3131 00007fa9f73810a0 00007fa9f7380984 00007fa9f08fb6d4 00007fa9f08fb662
0709 13:00:02.409253 (+169541us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":433462144}
I20260709 13:00:02.434537  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 609) took 2044 ms. Trace:
I20260709 13:00:02.434897  5073 leader_election.cc:290] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:02.436055  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:02.436458  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:02.437553  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:02.438113  1570 raft_consensus.cc:2468] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 8.
I20260709 13:00:02.438107  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:02.439486  1722 raft_consensus.cc:3060] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:02.410220  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:02.408960  5005 raft_consensus.cc:2749] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:02.352556  5132 consensus_queue.cc:1048] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.079s
I20260709 13:00:02.398067  5112 raft_consensus.cc:3060] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:02.409652  4985 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.846s	user 0.017s	sys 0.013s
I20260709 13:00:02.415469  5113 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:02.440351  1724 raft_consensus.cc:2468] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6.
I20260709 13:00:02.440620  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:02.427460  1647 rpcz_store.cc:276] 0709 13:00:01.163253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:01.163405 (+   152us) service_pool.cc:224] Handling call
0709 13:00:01.245280 (+ 81875us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:01.322595 (+ 77315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:01.322628 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:01.323096 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 13:00:02.096674 (+773578us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:02.096736 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:02.426563 (+329827us) spinlock_profiling.cc:243] Waited 53.2 ms on lock 0x7b54001f8454. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:02.426608 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:02.426651 (+    43us) raft_consensus.cc:1685] finished
0709 13:00:02.426665 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:02.426871 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23674,"raft.queue_time_us":121712,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":81098,"spinlock_wait_cycles":122342144,"thread_start_us":657132,"threads_started":1,"wal-append.queue_time_us":950830}
I20260709 13:00:02.434948  1642 rpcz_store.cc:276] 0709 13:00:00.389771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.394847 (+  5076us) service_pool.cc:224] Handling call
0709 13:00:00.395125 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:00.395297 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:00:00.507667 (+112370us) log.cc:844] Serialized 14 byte log entry
0709 13:00:00.985611 (+477944us) spinlock_profiling.cc:243] Waited 1.67 ms on lock 0x7b18002f3080. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9f1f634bc 00007fa9ef2b148b 00007fa9f810bab9 00007fa9ef2cd69b 00007fa9ef2cb93f 00007fa9ef2cdc02 00007fa9f1f5520b 00007fa9f1f5ad23 00007fa9f1f5b23a
0709 13:00:02.434018 (+1448407us) spinlock_profiling.cc:243] Waited 21.2 ms on lock 0x7b18002f3080. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9f1f634bc 00007fa9ef2b148b 00007fa9f810bab9 00007fa9ef2cd69b 00007fa9ef2cb93f 00007fa9ef2cb455 00007fa9f23b3060 00007fa9f23c5716 00007fa9f23d6287
0709 13:00:02.434182 (+   164us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:02.434230 (+    48us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:02.434291 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:02.434369 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:02.434481 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":154097,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":10550,"raft.queue_time_us":92670,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":8434,"spinlock_wait_cycles":52693120,"thread_start_us":272772,"threads_started":3,"wal-append.queue_time_us":102945,"wal-append.run_cpu_time_us":1218,"wal-append.run_wall_time_us":1179654}
I20260709 13:00:02.449229  1724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2126) took 1021 ms. Trace:
I20260709 13:00:02.449331  1573 raft_consensus.cc:2376] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 9. Re-sending same reply.
I20260709 13:00:02.449592  1724 rpcz_store.cc:276] 0709 13:00:01.428070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.409962 (+981892us) service_pool.cc:224] Handling call
0709 13:00:02.449175 (+ 39213us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:02.450354  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:02.411633  1469 catalog_manager.cc:5697] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:02.444036  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:02.445235  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:02.414197  1568 raft_consensus.cc:1240] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 LEADER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:02.422022  1689 rpcz_store.cc:276] 0709 13:00:00.953453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.395452 (+1441999us) inbound_call.cc:177] Queueing failure response
Metrics: {}
W20260709 13:00:02.476243  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:02.479281  1576 raft_consensus.cc:2376] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 9. Re-sending same reply.
I20260709 13:00:02.480559  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:02.482242  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:02.483042  1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1520) took 1879 ms. Trace:
I20260709 13:00:02.483354  1721 rpcz_store.cc:276] 0709 13:00:00.603772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.733444 (+129672us) service_pool.cc:224] Handling call
0709 13:00:02.289638 (+1556194us) spinlock_profiling.cc:243] Waited 1.83 ms on lock 0x7b5800196e98. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef296b71 00007fa9ef296a22 00007fa9f81afc09 00007fa9f7309ee0 00007fa9f73d30ab 00007fa9f73d3131 00007fa9f73810a0 00007fa9f7380984 00007fa9f08fb6d4 00007fa9f08fb662
0709 13:00:02.482106 (+192468us) spinlock_profiling.cc:243] Waited 1.8 ms on lock 0x7b5800196e98. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef296e9c 00007fa9ef296a5b 00007fa9f81afc09 00007fa9f7309ee0 00007fa9f73d30ab 00007fa9f73d3131 00007fa9f73810a0 00007fa9f7380984 00007fa9f08fb6d4 00007fa9f08fb662
0709 13:00:02.482980 (+   874us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8329216}
W20260709 13:00:02.485055  5140 log.cc:927] Time spent T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:00:02.485651  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:02.465829  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:02.409786  1691 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:58782 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2136)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2127)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2124)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2130)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2144)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2120)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1532)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2149)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2147)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2150)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1533)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2151)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1538)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2152)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2148)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2143)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2153)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1524)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1529)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1543)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1531)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1530)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2154)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1534)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1528)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1542)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2121)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2122)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 716)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 717)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 718)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 719)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 721)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 723)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2125)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2129)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2133)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2135)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2137)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2138)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2139)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2140)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2142)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2145)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2146)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 724)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 725)
I20260709 13:00:02.487360  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:02.488698  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 13:00:02.489364  1542 leader_election.cc:336] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 3.276s (SENT)
I20260709 13:00:02.451663  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:02.489897  1542 leader_election.cc:304] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:02.489449  1569 raft_consensus.cc:2376] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 9. Re-sending same reply.
I20260709 13:00:02.490490  1573 raft_consensus.cc:2393] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 8: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:02.490901  1567 raft_consensus.cc:2376] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 9. Re-sending same reply.
W20260709 13:00:02.464967  4985 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.899s	user 0.018s	sys 0.014s
I20260709 13:00:02.493377  1469 catalog_manager.cc:5697] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:00:02.481278  5088 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.926s	user 0.000s	sys 0.012s
I20260709 13:00:02.445263  5070 raft_consensus.cc:515] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:02.496531  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:02.504740  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:02.505002  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:02.491600  5128 raft_consensus.cc:2749] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:02.511197  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 13:00:02.498019  5088 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.946s	user 0.001s	sys 0.012s
I20260709 13:00:02.447934  5073 consensus_queue.cc:1048] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:00:02.516031  1573 raft_consensus.cc:3060] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:02.511965  1469 catalog_manager.cc:5697] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 13:00:02.467765  5113 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:02.523244  1719 raft_consensus.cc:2410] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
I20260709 13:00:02.495710  5013 raft_consensus.cc:493] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
W20260709 13:00:02.533264  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:02.567155  1688 leader_election.cc:336] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Timed out: RequestConsensusVote RPC to 127.0.107.194:37391 timed out after 1.535s (SENT)
I20260709 13:00:02.568984  1469 catalog_manager.cc:5697] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:02.571084  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:02.586618  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:02.580760  1469 catalog_manager.cc:5697] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:02.587519  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 13:00:02.590816  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:02.584756  1573 raft_consensus.cc:2468] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 9.
I20260709 13:00:02.593258  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:02.586287  2323 raft_consensus.cc:606] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 LEADER]: Received request to transfer leadership to TS 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:02.593814  2326 raft_consensus.cc:2393] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 7: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 13:00:02.594125  5013 raft_consensus.cc:515] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:02.519985  5088 raft_consensus.cc:697] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 8 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:02.593636  5137 raft_consensus.cc:493] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:02.600173  5137 raft_consensus.cc:515] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:02.599896  1469 catalog_manager.cc:5697] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 3 to 4, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 4 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:00:02.581741  5143 log.cc:927] Time spent T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:00:02.523880  5141 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:02.601550  1469 catalog_manager.cc:5697] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: config changed from index -1 to 4, NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) added. New cstate: current_term: 5 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 13:00:02.602249  5141 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:02.603492  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:02.603117  1469 catalog_manager.cc:5697] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 1 to 2, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:02.605000  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:02.606626  1469 catalog_manager.cc:5697] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 1 to 7, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 7 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:02.608356  5088 consensus_queue.cc:237] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:02.608280  1469 catalog_manager.cc:5697] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 1 to 5, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 5 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:02.612761  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:02.613370  1644 raft_consensus.cc:2468] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8.
W20260709 13:00:02.613502  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:02.521884  5120 raft_consensus.cc:493] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:02.613469  1469 catalog_manager.cc:5697] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 3 to 6, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 6 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:02.618019  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:02.619026  1642 raft_consensus.cc:2393] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 9: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:02.619885  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:02.621713  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:02.622143  2323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:39778 (request call id 5) took 1402 ms. Trace:
I20260709 13:00:02.621945  1469 catalog_manager.cc:5697] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 2 to 5, leader changed from 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 5 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:00:02.622529  1651 raft_consensus.cc:2468] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8.
I20260709 13:00:02.623350  1469 catalog_manager.cc:5697] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:02.624019  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:02.640080  1651 raft_consensus.cc:2468] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 7.
I20260709 13:00:02.544941  5071 consensus_queue.cc:1059] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.076s
I20260709 13:00:02.624794  5137 leader_election.cc:290] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:02.624904  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:02.645773  1644 raft_consensus.cc:2468] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
I20260709 13:00:02.625505  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:02.626051  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:02.626681  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:02.627535  1469 catalog_manager.cc:5697] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:02.628603  1722 raft_consensus.cc:2468] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 9.
I20260709 13:00:02.622488  2323 rpcz_store.cc:276] 0709 13:00:01.241539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:01.275487 (+ 33948us) service_pool.cc:224] Handling call
0709 13:00:02.586091 (+1310604us) spinlock_profiling.cc:243] Waited 4.04 ms on lock 0x7b58000e6a98. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef296b71 00007fa9ef296a22 00007fa9f81afc09 00007fa9f7309ee0 00007fa9f73d30ab 00007fa9f73d3131 00007fa9f7397c40 00007fa9f7383bb9 00007fa9f738347c 00007fa9f09097d4
0709 13:00:02.594845 (+  8754us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9286912}
I20260709 13:00:02.647126  1645 raft_consensus.cc:2468] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 9.
I20260709 13:00:02.629621  4930 consensus_queue.cc:260] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:02.633668  5111 raft_consensus.cc:1064] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e: attempting to promote NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 to VOTER
I20260709 13:00:02.633725  5141 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:02.631989  5136 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:02.667520  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:02.637691  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:02.663242  5074 raft_consensus.cc:3055] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:02.665349  5116 leader_election.cc:290] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:02.647863  1722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2132) took 1139 ms. Trace:
I20260709 13:00:02.654089  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:02.701428  1717 raft_consensus.cc:2468] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 9.
I20260709 13:00:02.671037  4930 raft_consensus.cc:3060] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:02.702150  1717 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1517) took 2113 ms (client timeout 2478 ms). Trace:
I20260709 13:00:02.655412  1539 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 13:00:02.666509  5122 leader_election.cc:290] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:02.688094  2323 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f"
dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
mode: GRACEFUL
new_leader_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:39778
I20260709 13:00:02.635425  1615 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 13:00:02.668363  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:02.721984  2323 raft_consensus.cc:606] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 LEADER]: Received request to transfer leadership to TS 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:02.660811  1469 catalog_manager.cc:5697] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 2 to 7, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 7 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:02.702446  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:00:02.721129  1717 rpcz_store.cc:269] 0709 13:00:00.588441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.588577 (+   136us) service_pool.cc:224] Handling call
0709 13:00:02.637560 (+2048983us) spinlock_profiling.cc:243] Waited 892 us on lock 0x7b5800196e98. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef296b71 00007fa9ef296eee 0000000000375939 00007fa9f730a1e0 00007fa9f73d30c4 00007fa9f73d3131 00007fa9f73810a0 00007fa9f7380984 00007fa9f08fb6d4 00007fa9f08fb662
0709 13:00:02.702093 (+ 64533us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2051328}
I20260709 13:00:02.722934  1720 raft_consensus.cc:2468] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7.
I20260709 13:00:02.723438  1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2136) took 1213 ms. Trace:
I20260709 13:00:02.723765  1720 rpcz_store.cc:276] 0709 13:00:01.510167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.702188 (+1192021us) service_pool.cc:224] Handling call
0709 13:00:02.723382 (+ 21194us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:02.724377  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 69116.6us
I20260709 13:00:02.693859  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:02.702416  1722 rpcz_store.cc:276] 0709 13:00:01.508888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.400112 (+891224us) service_pool.cc:224] Handling call
0709 13:00:02.647809 (+247697us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:02.725208  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 89841.6us
W20260709 13:00:02.711374  1723 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2134) took 1201 ms (client timeout 1526 ms). Trace:
W20260709 13:00:02.726002  1723 rpcz_store.cc:269] 0709 13:00:01.509530 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.154803 (+645273us) service_pool.cc:224] Handling call
0709 13:00:02.711206 (+556403us) spinlock_profiling.cc:243] Waited 31.5 ms on lock 0x7b5400354154. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:02.711315 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":72357632}
W20260709 13:00:02.727380  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:02.710465  1571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 747) took 1160 ms. Trace:
I20260709 13:00:02.727949  1571 rpcz_store.cc:276] 0709 13:00:01.550209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:01.550357 (+   148us) service_pool.cc:224] Handling call
0709 13:00:01.550730 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:02.346475 (+795745us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:02.346516 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:02.346580 (+    64us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:02.346627 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:02.710197 (+363570us) spinlock_profiling.cc:243] Waited 795 ms on lock 0x7b5400313154. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:02.710247 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:02.710400 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1829574528}
W20260709 13:00:02.730137  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:02.730952  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:02.731194  5005 raft_consensus.cc:2804] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:02.731637  1573 raft_consensus.cc:2468] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 5.
I20260709 13:00:02.731710  5005 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:02.732220  5005 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:02.733799  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:02.657464  5120 raft_consensus.cc:515] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:02.734390  1723 raft_consensus.cc:2468] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6.
I20260709 13:00:02.735426  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:02.735987  1723 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6.
I20260709 13:00:02.736668  5120 leader_election.cc:290] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:02.736878  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:02.737800  1722 raft_consensus.cc:2368] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 8. Current term is 9.
I20260709 13:00:02.738184  1722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1532) took 1740 ms. Trace:
I20260709 13:00:02.738559  1722 rpcz_store.cc:276] 0709 13:00:00.998085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.736596 (+1738511us) service_pool.cc:224] Handling call
0709 13:00:02.738129 (+  1533us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:02.737974  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:02.726361  1615 leader_election.cc:304] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:02.739856  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:02.740664  1722 raft_consensus.cc:2393] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 7: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:02.741047  1722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1533) took 1742 ms. Trace:
I20260709 13:00:02.742588  1722 rpcz_store.cc:276] 0709 13:00:00.998430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.739420 (+1740990us) service_pool.cc:224] Handling call
0709 13:00:02.740997 (+  1577us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:02.743503  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:02.740950  1615 leader_election.cc:304] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 13:00:02.671838  5111 raft_consensus.cc:1068] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e: Unable to promote non-voter 05476b84d8f84d76a9a1f51b620a3c66: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:00:02.739624  1717 raft_consensus.cc:2468] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 9.
I20260709 13:00:02.755264  1615 leader_election.cc:304] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:02.756098  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:02.756732  1722 raft_consensus.cc:2376] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 9. Re-sending same reply.
I20260709 13:00:02.757648  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:02.758229  1722 raft_consensus.cc:2468] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6.
I20260709 13:00:02.759053  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:02.759765  1722 raft_consensus.cc:2468] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7.
W20260709 13:00:02.765937  1542 leader_election.cc:336] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 3.225s (SENT)
I20260709 13:00:02.766510  1542 leader_election.cc:304] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:02.768031  4974 raft_consensus.cc:2749] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:02.730983  5116 raft_consensus.cc:2804] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:02.773818  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:02.772369  1647 raft_consensus.cc:2393] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 10: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:02.772660  1615 leader_election.cc:304] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:02.773645  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:02.777169  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:02.778039  1722 raft_consensus.cc:2468] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6.
I20260709 13:00:02.697130  5013 leader_election.cc:290] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:02.701359  5074 raft_consensus.cc:740] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:02.779842  1615 leader_election.cc:304] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:02.781090  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:02.784400  1717 raft_consensus.cc:2468] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6.
I20260709 13:00:02.784801  1615 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:02.785163  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1538) took 1785 ms. Trace:
I20260709 13:00:02.746441  5132 raft_consensus.cc:2749] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:02.779847  1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2120) took 1652 ms. Trace:
I20260709 13:00:02.782584  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:00:02.786008  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:02.787930  1615 leader_election.cc:304] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:02.788194  1720 rpcz_store.cc:276] 0709 13:00:01.127134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.744212 (+1617078us) service_pool.cc:224] Handling call
0709 13:00:02.779766 (+ 35554us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:02.788816  1722 raft_consensus.cc:2468] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 7.
I20260709 13:00:02.781612  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:02.789126  1615 leader_election.cc:304] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:02.789384  1722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1524) took 1846 ms. Trace:
I20260709 13:00:02.785707  1717 rpcz_store.cc:276] 0709 13:00:01.000099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.755768 (+1755669us) service_pool.cc:224] Handling call
0709 13:00:02.785087 (+ 29319us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:02.789793  1722 rpcz_store.cc:276] 0709 13:00:00.943137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.782293 (+1839156us) service_pool.cc:224] Handling call
0709 13:00:02.789318 (+  7025us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:02.791198  5134 raft_consensus.cc:2804] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:02.791034  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:02.791568  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:02.791785  5134 raft_consensus.cc:697] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 9 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:02.792022  1722 raft_consensus.cc:2393] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 9: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:02.792378  5106 raft_consensus.cc:2804] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:02.792515  1722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1530) took 1795 ms. Trace:
I20260709 13:00:02.792999  5106 raft_consensus.cc:697] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 9 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:02.792930  1722 rpcz_store.cc:276] 0709 13:00:00.997367 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.790764 (+1793397us) service_pool.cc:224] Handling call
0709 13:00:02.792459 (+  1695us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:02.793991  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:02.791132  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:02.794962  1720 raft_consensus.cc:2468] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 7.
I20260709 13:00:02.795127  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:02.795454  1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1543) took 1732 ms. Trace:
I20260709 13:00:02.774359  5116 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:02.663363  5112 raft_consensus.cc:515] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:02.796139  1646 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 1584) took 1822 ms (client timeout 2234 ms). Trace:
W20260709 13:00:02.796546  1646 rpcz_store.cc:269] 0709 13:00:00.973878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.986514 (+ 12636us) service_pool.cc:224] Handling call
0709 13:00:02.795952 (+1809438us) spinlock_profiling.cc:243] Waited 373 ms on lock 0x7b54002b4654. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:02.796064 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":857443072}
I20260709 13:00:02.797228  1576 raft_consensus.cc:2468] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7.
I20260709 13:00:02.786618  5013 raft_consensus.cc:2749] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:02.783054  5137 raft_consensus.cc:2804] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:02.792690  5134 consensus_queue.cc:237] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:02.798623  5137 raft_consensus.cc:697] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 9 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:02.798803  1722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1534) took 1800 ms. Trace:
I20260709 13:00:02.799224  1722 rpcz_store.cc:276] 0709 13:00:00.998792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.794900 (+1796108us) service_pool.cc:224] Handling call
0709 13:00:02.798740 (+  3840us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:02.799526  5137 consensus_queue.cc:237] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:02.800498  1722 raft_consensus.cc:1275] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:00:02.801198  1722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1528) took 1834 ms. Trace:
I20260709 13:00:02.801318  1717 raft_consensus.cc:2468] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8.
I20260709 13:00:02.801581  1722 rpcz_store.cc:276] 0709 13:00:00.966798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.799912 (+1833114us) service_pool.cc:224] Handling call
0709 13:00:02.800201 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:02.800922 (+   721us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:02.801139 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:02.794042  5106 consensus_queue.cc:237] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:02.803102  1722 raft_consensus.cc:1275] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:00:02.803686  1722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1542) took 1758 ms. Trace:
W20260709 13:00:02.804129  1725 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2116) took 1720 ms (client timeout 1509 ms). Trace:
I20260709 13:00:02.795825  1720 rpcz_store.cc:276] 0709 13:00:01.063674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.789179 (+1725505us) service_pool.cc:224] Handling call
0709 13:00:02.795401 (+  6222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:02.790654  5141 raft_consensus.cc:2749] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:02.779000  5131 raft_consensus.cc:2804] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:02.810683  5131 raft_consensus.cc:697] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 9 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:02.811064  2294 leader_election.cc:304] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:02.811645  5131 consensus_queue.cc:237] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:02.813455  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:02.814198  5136 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:02.815469  1725 rpcz_store.cc:269] 0709 13:00:01.083822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:01.086723 (+  2901us) service_pool.cc:224] Handling call
0709 13:00:02.803976 (+1717253us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b540034c454. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:02.804069 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2438854016}
I20260709 13:00:02.803997  1722 rpcz_store.cc:276] 0709 13:00:01.044903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.802526 (+1757623us) service_pool.cc:224] Handling call
0709 13:00:02.802799 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:02.803455 (+   656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:02.803635 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:02.827586  1617 leader_election.cc:336] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.526s (SENT)
I20260709 13:00:02.828192  1617 leader_election.cc:304] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:02.827068  1615 leader_election.cc:304] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:02.824877  1723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1529) took 1828 ms. Trace:
I20260709 13:00:02.849915  1723 rpcz_store.cc:276] 0709 13:00:00.996969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.779231 (+1782262us) service_pool.cc:224] Handling call
0709 13:00:02.824810 (+ 45579us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:02.801918  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1531) took 1804 ms. Trace:
I20260709 13:00:02.852768  5136 raft_consensus.cc:2804] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:02.852880  1615 leader_election.cc:304] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:02.853426  5136 raft_consensus.cc:697] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 9 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:02.853785  5135 raft_consensus.cc:2804] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:02.854172  5135 raft_consensus.cc:493] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:02.854584  5135 raft_consensus.cc:3060] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:02.854319  5136 consensus_queue.cc:237] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:02.851701  1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2121) took 1700 ms. Trace:
I20260709 13:00:02.796172  5116 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:02.856950  1720 rpcz_store.cc:276] 0709 13:00:01.151645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.805366 (+1653721us) service_pool.cc:224] Handling call
0709 13:00:02.851187 (+ 45821us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:02.851375 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:02.851408 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:02.851448 (+    40us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:02.851488 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:02.851543 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:02.851647 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:02.852661  1717 rpcz_store.cc:276] 0709 13:00:00.997755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.790387 (+1792632us) service_pool.cc:224] Handling call
0709 13:00:02.801857 (+ 11470us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:02.859081  1719 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2119) took 1746 ms (client timeout 1803 ms). Trace:
I20260709 13:00:02.861402  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:02.860632  2331 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2"
dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
mode: GRACEFUL
new_leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:39778
I20260709 13:00:02.862465  2331 raft_consensus.cc:606] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 LEADER]: Received request to transfer leadership to TS 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:00:02.861644  1719 rpcz_store.cc:269] 0709 13:00:01.112380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:01.136455 (+ 24075us) service_pool.cc:224] Handling call
0709 13:00:02.858884 (+1722429us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b5400203d54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:02.859023 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3012101504}
I20260709 13:00:02.865844  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:02.868099  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:02.868835  1724 raft_consensus.cc:2468] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7.
I20260709 13:00:02.869300  1724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2127) took 1362 ms. Trace:
I20260709 13:00:02.869640  1724 rpcz_store.cc:276] 0709 13:00:01.506985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.867859 (+1360874us) service_pool.cc:224] Handling call
0709 13:00:02.869245 (+  1386us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:02.870391  1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 716) took 1691 ms. Trace:
I20260709 13:00:02.871423  1724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 719) took 1691 ms. Trace:
I20260709 13:00:02.800621  5070 leader_election.cc:290] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:02.872690  1539 leader_election.cc:304] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:02.878103  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:02.879961  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:02.880806  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:02.880901  5074 consensus_queue.cc:260] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:02.852025  5013 raft_consensus.cc:2749] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:02.883042  1573 raft_consensus.cc:1240] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:02.862555  4890 raft_consensus.cc:2749] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:02.884855  2328 raft_consensus.cc:2393] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 7: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 13:00:02.885102  1725 raft_consensus.cc:1240] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:02.885341  1719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 718) took 1706 ms. Trace:
I20260709 13:00:02.885815  1725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2122) took 1710 ms. Trace:
I20260709 13:00:02.878997  1572 raft_consensus.cc:2468] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 5.
I20260709 13:00:02.886252  1725 rpcz_store.cc:276] 0709 13:00:01.175678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.857243 (+1681565us) service_pool.cc:224] Handling call
0709 13:00:02.884937 (+ 27694us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:02.885530 (+   593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:02.885762 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:02.851318  4961 raft_consensus.cc:2804] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:02.887169  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 717) took 1708 ms. Trace:
I20260709 13:00:02.892282  1717 rpcz_store.cc:276] 0709 13:00:01.178887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.861476 (+1682589us) service_pool.cc:224] Handling call
0709 13:00:02.886693 (+ 25217us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:02.886861 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:02.886887 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:02.886929 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:02.886961 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:02.887014 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:02.887120 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:02.885718  1719 rpcz_store.cc:276] 0709 13:00:01.179252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.865164 (+1685912us) service_pool.cc:224] Handling call
0709 13:00:02.884827 (+ 19663us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:02.884990 (+   163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:02.885016 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:02.885057 (+    41us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:02.885123 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:02.885183 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:02.885286 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:02.872368  1724 rpcz_store.cc:276] 0709 13:00:01.179941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.870287 (+1690346us) service_pool.cc:224] Handling call
0709 13:00:02.870553 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:02.870730 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:02.870757 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:02.870800 (+    43us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:02.870839 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:02.870891 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:02.871371 (+   480us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:02.870883  1720 rpcz_store.cc:276] 0709 13:00:01.178516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.861326 (+1682810us) service_pool.cc:224] Handling call
0709 13:00:02.869764 (+  8438us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:02.869977 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:02.870013 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:02.870068 (+    55us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:02.870121 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:02.870193 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:02.870326 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:02.898646  1721 raft_consensus.cc:2468] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 9.
I20260709 13:00:02.902721  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:02.900303  1651 raft_consensus.cc:1240] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:02.904554  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:02.938586  1716 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 9.
I20260709 13:00:02.905638  2325 raft_consensus.cc:1275] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:00:02.939220  1716 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2124) took 1691 ms (client timeout 2225 ms). Trace:
W20260709 13:00:02.939639  1716 rpcz_store.cc:269] 0709 13:00:01.247571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.813110 (+1565539us) service_pool.cc:224] Handling call
0709 13:00:02.939156 (+126046us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:02.937407  1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2130) took 1429 ms. Trace:
I20260709 13:00:02.940922  1721 rpcz_store.cc:276] 0709 13:00:01.508184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.865608 (+1357424us) service_pool.cc:224] Handling call
0709 13:00:02.937347 (+ 71739us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:02.945950  1716 raft_consensus.cc:1240] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:00:02.912389  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 723) took 1668 ms. Trace:
I20260709 13:00:02.920948  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:02.946434  1717 rpcz_store.cc:276] 0709 13:00:01.243736 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.911548 (+1667812us) service_pool.cc:224] Handling call
0709 13:00:02.911863 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:02.912045 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:02.912071 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:02.912129 (+    58us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:02.912164 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:02.912224 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:02.912329 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:02.922766  4981 raft_consensus.cc:3060] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:02.923866  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:02.924443  5112 leader_election.cc:290] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:02.925117  1725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 721) took 1714 ms. Trace:
I20260709 13:00:02.929991  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:02.932148  2326 raft_consensus.cc:2468] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 8.
I20260709 13:00:02.906754  1539 leader_election.cc:304] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 13:00:02.481437  1689 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:49996 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2144)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2120)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1532)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2149)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2147)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2150)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1533)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2151)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1538)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2152)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2148)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2143)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2153)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1524)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1529)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1543)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1531)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1530)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2154)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1534)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1528)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1542)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2121)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2122)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 716)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 717)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 718)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 719)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 721)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 723)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2125)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2129)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2133)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2135)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2137)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2138)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2139)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2140)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2142)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2145)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2146)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 724)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 725)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 727)
W20260709 13:00:03.080725  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 130118us
I20260709 13:00:03.371928  2294 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:00:03.000029  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:03.373503  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:03.373994  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:03.374562  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:03.311496  2297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:03.311462  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:03.060079  5011 consensus_queue.cc:1048] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.372s
I20260709 13:00:03.383488  1651 raft_consensus.cc:2468] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 7.
I20260709 13:00:02.891469  4961 raft_consensus.cc:493] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:03.384073  1575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 744) took 2443 ms. Trace:
I20260709 13:00:03.383415  1716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2129) took 1875 ms. Trace:
I20260709 13:00:03.384958  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 13:00:03.290014  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:03.397843  1716 rpcz_store.cc:276] 0709 13:00:01.507808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.940332 (+1432524us) service_pool.cc:224] Handling call
0709 13:00:02.945725 (+  5393us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:03.383144 (+437419us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:03.383358 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:03.075995  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:02.954120  1615 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:00:03.406921  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 452858us
I20260709 13:00:03.408020  1615 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:03.408687  4770 raft_consensus.cc:2749] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:03.384567  1725 rpcz_store.cc:276] 0709 13:00:01.210435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.887157 (+1676722us) service_pool.cc:224] Handling call
0709 13:00:02.924644 (+ 37487us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:02.924825 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:02.924851 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:02.924894 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:02.924924 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:02.924975 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:02.925064 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:03.409530  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:03.410013  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:00:03.387025  5131 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.002s	sys 0.012s
I20260709 13:00:03.391405  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:00:03.410627  5131 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.002s	sys 0.013s
I20260709 13:00:03.410604  1725 raft_consensus.cc:2468] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7.
I20260709 13:00:03.411278  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:03.412096  1725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2137) took 1901 ms. Trace:
W20260709 13:00:03.393850  5116 consensus_meta.cc:287] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.518s	user 0.006s	sys 0.003s
I20260709 13:00:03.412439  1725 rpcz_store.cc:276] 0709 13:00:01.510459 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:03.411379 (+1900920us) service_pool.cc:224] Handling call
0709 13:00:03.411650 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:03.411822 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:03.411846 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:03.411884 (+    38us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:03.411919 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:03.411968 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:03.412054 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:03.412734  5116 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:03.414191  5131 raft_consensus.cc:3060] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:03.414940  5135 consensus_meta.cc:287] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.560s	user 0.009s	sys 0.000s
I20260709 13:00:03.415156  1576 raft_consensus.cc:1240] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:03.415465  5135 raft_consensus.cc:515] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:03.380954  4930 raft_consensus.cc:2749] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:03.412240  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:03.363935  4963 raft_consensus.cc:993] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66: : Instructing follower 89ac9d5e2fbc4536b03a1ff1dd3eb226 to start an election
W20260709 13:00:03.313490  5102 net_util.cc:396] Time spent resolve address for 127.0.107.195: real 0.215s	user 0.000s	sys 0.000s
W20260709 13:00:03.363298  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 411824us
I20260709 13:00:02.891861  5075 raft_consensus.cc:2804] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:03.370043  1717 raft_consensus.cc:1275] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:00:03.419245  1650 raft_consensus.cc:1240] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 5. Current term is 6. Ops: []
W20260709 13:00:03.326706  5005 consensus_meta.cc:287] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.594s	user 0.008s	sys 0.001s
I20260709 13:00:03.396960  1575 rpcz_store.cc:276] 0709 13:00:00.927411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:00.927564 (+   153us) service_pool.cc:224] Handling call
0709 13:00:00.927870 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:00.930616 (+  2746us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:02.714857 (+1784241us) spinlock_profiling.cc:243] Waited 9.56 ms on lock 0x7b1800466f60. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9f1f634bc 00007fa9ef2b148b 00007fa9f810bab9 00007fa9ef2cd69b 00007fa9ef2cb93f 00007fa9ef2cb455 00007fa9f5db33c7 00007fa9f23c59a7 00007fa9f23d50bf
0709 13:00:02.715011 (+   154us) log.cc:844] Serialized 14 byte log entry
0709 13:00:02.732674 (+ 17663us) spinlock_profiling.cc:243] Waited 8.66 ms on lock 0x7b48000beed8. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f72e4aa1 00007fa9f72dbb37 00007fa9f72db9ca 00007fa9f73d326f 00007fa9f73d2f37 00007fa9f73e755c 00007fa9f73e7508 00007fa9f73e7488 00007fa9f73e7443 00007fa9f73e66ec 00007fa9f6310a96
0709 13:00:02.850784 (+118110us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:02.860800 (+ 10016us) log.cc:844] Serialized 26 byte log entry
0709 13:00:02.860929 (+   129us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:02.860958 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:02.861024 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:03.370375 (+509351us) raft_consensus.cc:1685] finished
0709 13:00:03.370405 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:03.370527 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18729,"prepare.queue_time_us":149741,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":51,"raft.queue_time_us":6466,"raft.run_cpu_time_us":3800,"raft.run_wall_time_us":1799376,"spinlock_wait_cycles":41912960,"thread_start_us":217486,"threads_started":2,"wal-append.queue_time_us":649509}
I20260709 13:00:03.420186  1615 leader_election.cc:304] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:03.012020  5082 raft_consensus.cc:2804] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:03.379472  1719 raft_consensus.cc:1240] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:00:03.424120  1719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2125) took 2033 ms. Trace:
W20260709 13:00:03.404505  1542 leader_election.cc:336] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 3.835s (SENT)
I20260709 13:00:03.421907  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:03.424701  1719 rpcz_store.cc:276] 0709 13:00:01.391019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.933951 (+1542932us) service_pool.cc:224] Handling call
0709 13:00:03.378988 (+445037us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:03.423815 (+ 44827us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:03.424057 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:03.425166  1542 leader_election.cc:304] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:03.419317  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2135) took 1909 ms. Trace:
I20260709 13:00:03.427081  1717 rpcz_store.cc:276] 0709 13:00:01.509838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.948047 (+1438209us) service_pool.cc:224] Handling call
0709 13:00:03.369708 (+421661us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:03.419022 (+ 49314us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:03.419256 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:03.400779  4961 raft_consensus.cc:3060] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:03.429171  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:03.456081  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:03.462836  1688 leader_election.cc:304] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:03.463573  5131 raft_consensus.cc:2749] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:03.431860  4770 raft_consensus.cc:2749] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:03.421272  5075 raft_consensus.cc:493] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:03.464929  5075 raft_consensus.cc:3060] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:03.465281  5088 raft_consensus.cc:2804] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:03.465785  5088 raft_consensus.cc:493] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:03.457866  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:03.472182  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:03.478338  1716 raft_consensus.cc:2468] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6.
W20260709 13:00:03.422289  5134 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.011s	sys 0.012s
I20260709 13:00:03.488672  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:03.454197  5111 raft_consensus.cc:493] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:03.495288  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:03.501163  1719 raft_consensus.cc:2410] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 4.
W20260709 13:00:03.471782  5106 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.006s	sys 0.022s
W20260709 13:00:03.474658  5136 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.012s	sys 0.021s
W20260709 13:00:03.499965  4974 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.007s	sys 0.038s
W20260709 13:00:03.503842  5136 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.013s	sys 0.021s
I20260709 13:00:03.496855  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:03.477042  5108 raft_consensus.cc:1081] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 LEADER]: Signalling peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 to start an election
I20260709 13:00:03.476828  5088 raft_consensus.cc:3060] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:03.422586  5005 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:03.504209  4974 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.008s	sys 0.038s
I20260709 13:00:03.508545  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:03.526413  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:03.526702  1643 raft_consensus.cc:3060] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:03.527199  1719 raft_consensus.cc:2468] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 9.
W20260709 13:00:03.509822  5106 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.006s	sys 0.023s
I20260709 13:00:03.518353  1651 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8"
dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
mode: GRACEFUL
new_leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:35470
I20260709 13:00:03.520907  5082 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:03.522924  1574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 2060) took 1027 ms. Trace:
I20260709 13:00:03.536823  1646 raft_consensus.cc:1240] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:03.515491  5135 leader_election.cc:290] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:03.517695  1645 raft_consensus.cc:1240] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 9 LEADER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:03.535146  1651 raft_consensus.cc:606] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Received request to transfer leadership to TS 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:03.556741  1651 raft_consensus.cc:614] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:00:03.486872  5134 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.015s	sys 0.012s
I20260709 13:00:03.536895  1574 rpcz_store.cc:276] 0709 13:00:02.495191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.570954 (+ 75763us) service_pool.cc:224] Handling call
0709 13:00:02.615730 (+ 44776us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:02.616197 (+   467us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:02.616236 (+    39us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:02.617897 (+  1661us) log.cc:844] Serialized 52 byte log entry
0709 13:00:02.803006 (+185109us) spinlock_profiling.cc:243] Waited 22.5 ms on lock 0x7b180006dea0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef2b0e07 00007fa9f810bab9 00007fa9ef2cd69b 00007fa9ef2cb93f 00007fa9ef2cdc02 00007fa9f1f5520b 00007fa9f1f5ad23 00007fa9f1f5b0d1 00007fa9f2376a0f
0709 13:00:02.992826 (+189820us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:02.992886 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:02.992981 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:03.522588 (+529607us) raft_consensus.cc:1685] finished
0709 13:00:03.522612 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:03.522863 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1561,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":6466,"spinlock_wait_cycles":51642752,"thread_start_us":189564,"threads_started":1,"wal-append.queue_time_us":813387}
I20260709 13:00:03.557651  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:03.575378  1649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 614) took 2410 ms. Trace:
I20260709 13:00:03.537647  5082 raft_consensus.cc:3060] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:03.575943  1649 rpcz_store.cc:276] 0709 13:00:01.161464 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:01.161605 (+   141us) service_pool.cc:224] Handling call
0709 13:00:02.797534 (+1635929us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:02.797709 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:02.797739 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:02.797806 (+    67us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:02.797842 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:02.797894 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:03.571962 (+774068us) spinlock_profiling.cc:243] Waited 1.59 s on lock 0x7b54002b4650. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23ba8ad 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:03.572091 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3652867328}
I20260709 13:00:03.512981  5111 raft_consensus.cc:515] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:03.585971  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 181479us
W20260709 13:00:03.587456  1542 leader_election.cc:336] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 3.895s (SENT)
I20260709 13:00:03.587842  1542 leader_election.cc:304] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:03.614073  1643 raft_consensus.cc:1275] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:03.617106  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:00:03.621765  1691 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:03.632357  5074 raft_consensus.cc:3060] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:03.645201  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:03.646080  1720 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6.
I20260709 13:00:03.647140  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:00:03.649905  1718 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58782 (request call id 720) took 2469 ms (client timeout 1526 ms). Trace:
W20260709 13:00:03.650417  1718 rpcz_store.cc:269] 0709 13:00:01.180224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:01.333426 (+153202us) service_pool.cc:224] Handling call
0709 13:00:03.649671 (+2316245us) spinlock_profiling.cc:243] Waited 1.92 s on lock 0x7b540007dd54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:03.649828 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4423459712}
I20260709 13:00:03.651780  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:03.653441  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:03.654775  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:03.655400  1724 raft_consensus.cc:2468] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7.
I20260709 13:00:03.658017  1723 raft_consensus.cc:1275] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:00:03.658779  1723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2140) took 2147 ms. Trace:
I20260709 13:00:03.659145  1723 rpcz_store.cc:276] 0709 13:00:01.511434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:03.657265 (+2145831us) service_pool.cc:224] Handling call
0709 13:00:03.657627 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:03.658487 (+   860us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:03.658718 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:03.662081  1722 raft_consensus.cc:1275] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:00:03.662737  1722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2145) took 1534 ms. Trace:
I20260709 13:00:03.663022  1722 rpcz_store.cc:276] 0709 13:00:02.128313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:03.661380 (+1533067us) service_pool.cc:224] Handling call
0709 13:00:03.661704 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:03.662477 (+   773us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:03.662680 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:03.670262  5155 log.cc:927] Time spent T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:00:03.672761  4974 raft_consensus.cc:2749] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:03.675882  5005 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:03.656337  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:03.697054  1724 raft_consensus.cc:2468] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7.
I20260709 13:00:03.698827  1724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 724) took 1410 ms. Trace:
I20260709 13:00:03.699323  1724 rpcz_store.cc:276] 0709 13:00:02.292307 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:03.697904 (+1405597us) service_pool.cc:224] Handling call
0709 13:00:03.698253 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:03.698447 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:03.698485 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:03.698538 (+    53us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:03.698582 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:03.698660 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:03.698767 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:03.652431  1718 raft_consensus.cc:3060] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:03.648350  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:03.702376  1720 raft_consensus.cc:2376] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 9. Re-sending same reply.
I20260709 13:00:03.704675  1724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 727) took 1216 ms. Trace:
I20260709 13:00:03.695840  1722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2146) took 1549 ms. Trace:
I20260709 13:00:03.708400  1722 rpcz_store.cc:276] 0709 13:00:02.146891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:03.663913 (+1517022us) service_pool.cc:224] Handling call
0709 13:00:03.664204 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:03.664407 (+   203us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:03.664444 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:03.664497 (+    53us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:03.695532 (+ 31035us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:03.695635 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:03.695774 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:03.710708  1722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 728) took 1190 ms. Trace:
I20260709 13:00:03.711341  1722 rpcz_store.cc:276] 0709 13:00:02.519985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:03.709733 (+1189748us) service_pool.cc:224] Handling call
0709 13:00:03.710089 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:03.710302 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:03.710339 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:03.710392 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:03.710439 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:03.710509 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:03.710645 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:03.688166  5116 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:03.767599  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 179978us
W20260709 13:00:03.771670  1542 leader_election.cc:336] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.527s (SENT)
W20260709 13:00:03.772447  1568 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.007s	sys 0.034s
I20260709 13:00:03.772454  1542 leader_election.cc:304] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
W20260709 13:00:03.782483  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 875648us
I20260709 13:00:03.783815  1539 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 13:00:03.791289  1642 raft_consensus.cc:1240] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 9 LEADER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:03.799216  1645 raft_consensus.cc:1275] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:03.802637  1539 leader_election.cc:304] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:03.805655  1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 725) took 1508 ms. Trace:
I20260709 13:00:03.806206  1720 rpcz_store.cc:276] 0709 13:00:02.297093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:03.703207 (+1406114us) service_pool.cc:224] Handling call
0709 13:00:03.804666 (+101459us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:03.805124 (+   458us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:03.805151 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:03.805210 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:03.805235 (+    25us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:03.805308 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:03.805443 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:03.808068  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 13:00:03.808806  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:03.809615  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:03.810300  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:03.810823  1719 raft_consensus.cc:2468] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6.
I20260709 13:00:03.811798  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:03.813977  1645 raft_consensus.cc:1240] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:03.814709  1648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45148 (request call id 2160) took 2789 ms. Trace:
I20260709 13:00:03.816012  1720 raft_consensus.cc:1275] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:00:03.716440  1724 rpcz_store.cc:276] 0709 13:00:02.488236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:03.703771 (+1215535us) service_pool.cc:224] Handling call
0709 13:00:03.704096 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:03.704289 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:03.704324 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:03.704372 (+    48us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:03.704414 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:03.704478 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:03.704605 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:03.819217  1724 raft_consensus.cc:1275] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:00:03.819710  1724 pending_rounds.cc:85] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4: Aborting all ops after (but not including) 3
I20260709 13:00:03.825462  1724 pending_rounds.cc:107] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:00:03.825966  1724 raft_consensus.cc:2889] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:03.826498  1724 pending_rounds.cc:107] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:00:03.826874  1724 raft_consensus.cc:2889] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:03.832154  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:03.837628  4985 consensus_queue.cc:1048] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:03.838236  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 1595) took 1226 ms. Trace:
I20260709 13:00:03.838881  1647 rpcz_store.cc:276] 0709 13:00:02.611653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.611757 (+   104us) service_pool.cc:224] Handling call
0709 13:00:03.837590 (+1225833us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b54002b3754. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:03.837929 (+   339us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":288155392}
I20260709 13:00:03.842231  1644 raft_consensus.cc:1240] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 9. Current term is 10. Ops: []
W20260709 13:00:03.845104  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:03.849794  2323 raft_consensus.cc:1275] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:03.853708  1539 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:03.855021  2327 raft_consensus.cc:2468] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8.
I20260709 13:00:03.860275  4985 consensus_queue.cc:1059] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:03.861567  4985 consensus_queue.cc:1243] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer 4dbe7d47a2374afca075d3a98583b49e log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:00:03.861707  4996 raft_consensus.cc:493] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:03.862265  4985 raft_consensus.cc:3055] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:03.862861  4985 raft_consensus.cc:740] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:03.862553  4996 raft_consensus.cc:515] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:03.865608  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 621) took 1046 ms. Trace:
I20260709 13:00:03.866228  1644 rpcz_store.cc:276] 0709 13:00:02.818772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.818904 (+   132us) service_pool.cc:224] Handling call
0709 13:00:03.841402 (+1022498us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:03.843164 (+  1762us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:03.865293 (+ 22129us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54002b3750. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23ba8ad 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:03.865524 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2350140160}
I20260709 13:00:03.815201  1648 rpcz_store.cc:276] 0709 13:00:01.025089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:01.090389 (+ 65300us) service_pool.cc:224] Handling call
0709 13:00:01.090732 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:01.298025 (+207293us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:01.419117 (+121092us) log.cc:844] Serialized 14 byte log entry
0709 13:00:02.643010 (+1223893us) spinlock_profiling.cc:243] Waited 1.4 ms on lock 0x7b1800086080. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef2b0e07 00007fa9f810bab9 00007fa9ef2cd69b 00007fa9ef2cb93f 00007fa9ef2cdc02 00007fa9f1f5520b 00007fa9f1f5ad23 00007fa9f1f5b23a 00007fa9f23c5a2a
0709 13:00:02.953039 (+310029us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:02.953091 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:02.953159 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:03.813180 (+860021us) spinlock_profiling.cc:243] Waited 41.7 ms on lock 0x7b1800086080. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef29c2a6 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419
0709 13:00:03.814156 (+   976us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b54001739d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:03.814201 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:03.814471 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":94396,"prepare.queue_time_us":120374,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":94523,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":77127,"spinlock_wait_cycles":575302400,"thread_start_us":215023,"threads_started":1,"wal-append.queue_time_us":1939607}
I20260709 13:00:03.869143  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 624) took 1047 ms. Trace:
I20260709 13:00:03.869805  1646 rpcz_store.cc:276] 0709 13:00:02.821262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.823351 (+  2089us) service_pool.cc:224] Handling call
0709 13:00:02.823744 (+   393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:03.537346 (+713602us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:03.868601 (+331255us) spinlock_profiling.cc:243] Waited 713 ms on lock 0x7b540030f554. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:03.868969 (+   368us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1639434112}
W20260709 13:00:03.874986  2327 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32870 (request call id 367) took 1521 ms (client timeout 1628 ms). Trace:
I20260709 13:00:03.876117  5011 raft_consensus.cc:2804] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:03.864955  4985 consensus_queue.cc:260] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:03.875692  2327 rpcz_store.cc:269] 0709 13:00:02.353267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.353427 (+   160us) service_pool.cc:224] Handling call
0709 13:00:03.874592 (+1521165us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b54004a9cd4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:03.874829 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3334285696}
I20260709 13:00:03.934729  4974 raft_consensus.cc:2749] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:03.876161  5071 raft_consensus.cc:2804] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:03.937614  5071 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:03.938163  5071 raft_consensus.cc:3060] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:03.876731  5073 raft_consensus.cc:2804] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:03.876765  5011 raft_consensus.cc:493] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:03.944862  5073 raft_consensus.cc:493] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:03.955112  5116 raft_consensus.cc:2749] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:03.959160  4996 leader_election.cc:290] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:03.959913  1540 leader_election.cc:304] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:03.979034  4843 consensus_queue.cc:1048] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:00:03.955850  5115 consensus_queue.cc:1048] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.012s
W20260709 13:00:03.965989  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:03.999993  1617 leader_election.cc:336] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.557s (SENT)
I20260709 13:00:03.945380  5011 raft_consensus.cc:3060] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:03.973891  1724 raft_consensus.cc:1275] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:00:03.986311  5128 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.014979  5097 consensus_queue.cc:1059] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:03.973255  4985 raft_consensus.cc:3060] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:04.026018  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:04.002257  5073 raft_consensus.cc:3060] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:04.052146  1617 leader_election.cc:304] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:03.968576  5111 leader_election.cc:290] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:04.075296  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 2062) took 1414 ms. Trace:
W20260709 13:00:04.100386  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 60944.6us
I20260709 13:00:04.078382  1568 rpcz_store.cc:276] 0709 13:00:02.646118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.671564 (+ 25446us) service_pool.cc:224] Handling call
0709 13:00:02.932250 (+260686us) spinlock_profiling.cc:243] Waited 1.47 ms on lock 0x7b5800011198. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef296b71 00007fa9ef296a22 00007fa9f81afc09 00007fa9f7309ee0 00007fa9f73d30ab 00007fa9f73d3131 00007fa9f7394fc0 00007fa9f737f929 00007fa9f737f3d2 00007fa9f08f6bd4
0709 13:00:02.932442 (+   192us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:02.935595 (+  3153us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:02.935624 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:02.936073 (+   449us) log.cc:844] Serialized 26 byte log entry
0709 13:00:03.773731 (+837658us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:03.773902 (+   171us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:03.774095 (+   193us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:04.032702 (+258607us) raft_consensus.cc:1685] finished
0709 13:00:04.032720 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:04.060838 (+ 28118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":520968,"raft.queue_time_us":695,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":42628,"spinlock_wait_cycles":3372416,"thread_start_us":675702,"threads_started":1,"wal-append.queue_time_us":1009142}
W20260709 13:00:04.113478  1542 leader_election.cc:336] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.908s (SENT)
I20260709 13:00:04.123340  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:04.134543  1542 leader_election.cc:304] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
W20260709 13:00:04.140712  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 181102us
I20260709 13:00:04.084802  5128 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:04.155241  1718 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 7.
I20260709 13:00:04.136837  5111 raft_consensus.cc:2749] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:00:04.151140  1567 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.019s	sys 0.024s
W20260709 13:00:04.151458  1616 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.007s	sys 0.038s
W20260709 13:00:04.149636  1717 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.033s	sys 0.083s
W20260709 13:00:04.165611  2295 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.034s	sys 0.051s
W20260709 13:00:04.155588  1615 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.026s	sys 0.091s
W20260709 13:00:04.175479  2295 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.034s	sys 0.051s
W20260709 13:00:04.175563  1615 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.027s	sys 0.091s
I20260709 13:00:04.143231  5115 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
W20260709 13:00:04.173625  1616 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.008s	sys 0.039s
W20260709 13:00:04.177728  1567 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.020s	sys 0.024s
W20260709 13:00:04.176656  1717 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.034s	sys 0.084s
W20260709 13:00:04.170558  1725 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.006s	sys 0.023s
I20260709 13:00:04.178213  5122 raft_consensus.cc:2804] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:00:04.179044  2331 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.012s	sys 0.022s
W20260709 13:00:04.170902  5137 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.026s	sys 0.031s
I20260709 13:00:04.184402  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:00:04.185359  1725 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.006s	sys 0.024s
W20260709 13:00:04.187249  4961 consensus_meta.cc:287] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.687s	user 0.005s	sys 0.017s
I20260709 13:00:04.178467  5097 raft_consensus.cc:3055] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:04.188889  1576 raft_consensus.cc:1275] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:00:04.190382  2331 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.012s	sys 0.024s
W20260709 13:00:04.189230  1569 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.001s	sys 0.002s
W20260709 13:00:04.184881  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 702213us
I20260709 13:00:04.181595  5122 raft_consensus.cc:493] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
W20260709 13:00:04.215096  1569 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.002s	sys 0.003s
I20260709 13:00:04.217447  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 2057) took 1746 ms. Trace:
I20260709 13:00:04.217940  1569 rpcz_store.cc:276] 0709 13:00:02.471132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.506305 (+ 35173us) service_pool.cc:224] Handling call
0709 13:00:02.506541 (+   236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:02.506703 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:00:02.760520 (+253817us) log.cc:844] Serialized 14 byte log entry
0709 13:00:03.011735 (+251215us) log.cc:844] Serialized 14 byte log entry
0709 13:00:03.579935 (+568200us) spinlock_profiling.cc:243] Waited 21.8 ms on lock 0x7b180000fe80. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef248c0a 00007fa9f8988219 00007fa9ef2d0a40 00007fa9ef2cb4e4 00007fa9ef2cb455 00007fa9f23b3060 00007fa9f23c5716 00007fa9f23d6287 00007fa9f23d6208
0709 13:00:03.680094 (+100159us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b180000fe80. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef29c2a6 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef2ce3f3 00007fa9ef2d07c1
0709 13:00:03.681806 (+  1712us) spinlock_profiling.cc:243] Waited 34.4 ms on lock 0x7b180000fe80. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef2ce3f3 00007fa9ef2d07c1 00007fa9ef2d0779 00007fa9ef2d0709 00007fa9ef2d06d1 00007fa9ef2cf9cd 000000000038f354 000000000038f199 00007fa9ef2b183a
0709 13:00:04.216682 (+534876us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:04.216860 (+   178us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:04.216984 (+   124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:04.217122 (+   138us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:04.217379 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":351487,"prepare.queue_time_us":262628,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":80,"raft.queue_time_us":620222,"raft.run_cpu_time_us":291,"raft.run_wall_time_us":16886,"spinlock_wait_cycles":153086464,"thread_start_us":1127316,"threads_started":3,"wal-append.queue_time_us":757199}
W20260709 13:00:04.221935  5088 consensus_meta.cc:287] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.658s	user 0.015s	sys 0.001s
I20260709 13:00:04.222178  4890 raft_consensus.cc:2749] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:04.222491  5088 raft_consensus.cc:515] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:04.225487  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:04.225863  4145 consensus_queue.cc:1059] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:00:04.190264  5137 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.027s	sys 0.032s
W20260709 13:00:04.236295  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 236511us
I20260709 13:00:04.190480  5097 raft_consensus.cc:740] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:04.230762  5122 raft_consensus.cc:3060] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:04.241451  1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2133) took 2625 ms. Trace:
I20260709 13:00:04.181682  4843 consensus_queue.cc:1059] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:00:04.189990  4961 raft_consensus.cc:515] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:04.249475  5112 raft_consensus.cc:2749] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:00:04.249722  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 46597.5us
W20260709 13:00:04.250864  5082 consensus_meta.cc:287] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.617s	user 0.012s	sys 0.002s
W20260709 13:00:04.251282  1617 leader_election.cc:336] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.709s (SENT)
I20260709 13:00:04.251391  5082 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:04.251812  1617 leader_election.cc:304] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:04.253098  4843 raft_consensus.cc:3055] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:04.253561  4843 raft_consensus.cc:740] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:04.253228  5097 consensus_queue.cc:260] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:04.253930  5082 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:04.255087  5097 raft_consensus.cc:3060] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:04.254745  4843 consensus_queue.cc:260] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:04.259898  4961 leader_election.cc:290] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:00:04.255318  5184 log.cc:927] Time spent T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:00:04.222110  5171 raft_consensus.cc:493] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:04.270533  5115 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:04.271153  5171 raft_consensus.cc:515] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:04.275856  1615 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 13:00:04.276214  5178 raft_consensus.cc:493] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
W20260709 13:00:04.276703  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 186574us
I20260709 13:00:04.277079  5178 raft_consensus.cc:515] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:04.278473  5128 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:04.279817  1643 raft_consensus.cc:2468] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 8.
I20260709 13:00:04.280954  1716 raft_consensus.cc:2393] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 8: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:04.287047  4145 raft_consensus.cc:3055] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:04.287601  4145 raft_consensus.cc:740] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:04.244346  1721 rpcz_store.cc:276] 0709 13:00:01.509213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.942350 (+1433137us) service_pool.cc:224] Handling call
0709 13:00:02.942686 (+   336us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:00:02.943970 (+  1284us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:02.944003 (+    33us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:00:02.944719 (+   716us) log.cc:844] Serialized 78 byte log entry
0709 13:00:03.817623 (+872904us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:00:03.817725 (+   102us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:03.817868 (+   143us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:04.125106 (+307238us) raft_consensus.cc:1685] finished
0709 13:00:04.125131 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:04.134223 (+  9092us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":150,"raft.run_cpu_time_us":475,"raft.run_wall_time_us":403161,"thread_start_us":493793,"threads_started":1,"wal-append.queue_time_us":949913}
I20260709 13:00:04.334429  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:04.335250  2329 raft_consensus.cc:2468] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8.
I20260709 13:00:04.346776  1540 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:04.318711  5137 raft_consensus.cc:2749] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:00:04.354940  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:04.341348  4145 consensus_queue.cc:260] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:04.384162  4890 raft_consensus.cc:2804] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:00:04.447247  5184 log.cc:927] Time spent T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 13:00:04.495795  1723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2142) took 2631 ms. Trace:
I20260709 13:00:04.496048  2329 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad"
dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
mode: GRACEFUL
new_leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:39778
I20260709 13:00:04.481215  5115 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:04.446246  5082 raft_consensus.cc:2804] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:04.527104  5082 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:04.527714  5082 raft_consensus.cc:3060] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:04.537042  5169 raft_consensus.cc:493] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:04.537757  4882 raft_consensus.cc:993] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66: : Instructing follower 89ac9d5e2fbc4536b03a1ff1dd3eb226 to start an election
I20260709 13:00:04.537940  5169 raft_consensus.cc:515] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:04.538527  4882 raft_consensus.cc:1081] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 LEADER]: Signalling peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 to start an election
I20260709 13:00:04.540297  5186 consensus_queue.cc:1059] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:00:04.549614  5074 consensus_meta.cc:287] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.916s	user 0.011s	sys 0.006s
I20260709 13:00:04.550292  4974 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:04.550590  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 274927us
I20260709 13:00:04.550835  4974 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:04.497089  2329 raft_consensus.cc:606] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 LEADER]: Received request to transfer leadership to TS 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:00:04.557730  5075 consensus_meta.cc:287] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 1.092s	user 0.006s	sys 0.013s
I20260709 13:00:04.558367  5075 raft_consensus.cc:515] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:04.559384  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:04.491127  5088 leader_election.cc:290] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:04.563787  5088 raft_consensus.cc:493] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.565438  1570 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "608abea191d946228bed666c5560fd0a"
dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:37682
I20260709 13:00:04.496335  1723 rpcz_store.cc:276] 0709 13:00:01.864555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:03.660082 (+1795527us) service_pool.cc:224] Handling call
0709 13:00:03.693160 (+ 33078us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:03.706832 (+ 13672us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:03.706873 (+    41us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:03.818740 (+111867us) log.cc:844] Serialized 52 byte log entry
0709 13:00:04.097827 (+279087us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:04.118623 (+ 20796us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:04.129162 (+ 10539us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:04.258391 (+129229us) raft_consensus.cc:1685] finished
0709 13:00:04.258414 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:04.495560 (+237146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":554,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":9560,"thread_start_us":270246,"threads_started":1,"wal-append.queue_time_us":352512}
I20260709 13:00:04.521648  2294 leader_election.cc:304] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
W20260709 13:00:04.505033  1542 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 3.019s (SENT) [suppressed 57 similar messages]
I20260709 13:00:04.478084  4890 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:04.567530  1570 raft_consensus.cc:493] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:04.595522  1570 raft_consensus.cc:3060] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:04.599373  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 94360.3us
W20260709 13:00:04.603694  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 97693.9us
I20260709 13:00:04.613080  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
W20260709 13:00:04.617218  1542 leader_election.cc:336] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.804s (SENT)
I20260709 13:00:04.617496  5171 leader_election.cc:290] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:04.618384  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 2067) took 1676 ms. Trace:
I20260709 13:00:04.618808  4145 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:04.618831  1567 rpcz_store.cc:276] 0709 13:00:02.942091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:02.942267 (+   176us) service_pool.cc:224] Handling call
0709 13:00:03.460291 (+518024us) spinlock_profiling.cc:243] Waited 3.35 ms on lock 0x7b5800011198. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef296b71 00007fa9ef296a22 00007fa9f81afc09 00007fa9f7309ee0 00007fa9f73d30ab 00007fa9f73d3131 00007fa9f7394fc0 00007fa9f737f929 00007fa9f737f3d2 00007fa9f08f6bd4
0709 13:00:03.460480 (+   189us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:03.460708 (+   228us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:00:04.181515 (+720807us) log.cc:844] Serialized 14 byte log entry
0709 13:00:04.503857 (+322342us) log.cc:844] Serialized 14 byte log entry
0709 13:00:04.519300 (+ 15443us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:04.594924 (+ 75624us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:04.618068 (+ 23144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:04.618181 (+   113us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:04.618307 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":772,"prepare.queue_time_us":283292,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":73,"raft.queue_time_us":42760,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":144,"spinlock_wait_cycles":46666496,"thread_start_us":969149,"threads_started":3,"wal-append.queue_time_us":246795}
W20260709 13:00:04.622148  5180 log.cc:927] Time spent T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.340s	user 0.009s	sys 0.005s
I20260709 13:00:04.623355  1720 raft_consensus.cc:1275] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:00:04.623708  1720 pending_rounds.cc:85] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4: Aborting all ops after (but not including) 8
I20260709 13:00:04.623924  1720 pending_rounds.cc:107] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:00:04.624137  1720 raft_consensus.cc:2889] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:04.624297  5188 log.cc:927] Time spent T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.372s	user 0.000s	sys 0.011s
W20260709 13:00:04.618443  1542 leader_election.cc:336] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.051s (SENT)
I20260709 13:00:04.625170  1542 leader_election.cc:304] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:04.625439  4930 raft_consensus.cc:2804] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:04.625649  1716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2158) took 1195 ms. Trace:
I20260709 13:00:04.625949  4930 raft_consensus.cc:493] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:04.626591  4930 raft_consensus.cc:3060] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:04.626220  1716 rpcz_store.cc:276] 0709 13:00:03.429899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:03.485181 (+ 55282us) service_pool.cc:224] Handling call
0709 13:00:04.625433 (+1140252us) spinlock_profiling.cc:243] Waited 719 ms on lock 0x7b540007f154. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:04.625584 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1654112512}
I20260709 13:00:04.629159  4996 raft_consensus.cc:993] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66: : Instructing follower 0c7751452c4b46afa95251b9df7169d4 to start an election
I20260709 13:00:04.633924  4770 raft_consensus.cc:1064] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e: attempting to promote NON_VOTER 05476b84d8f84d76a9a1f51b620a3c66 to VOTER
I20260709 13:00:04.635154  1570 raft_consensus.cc:515] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:04.484386  5116 raft_consensus.cc:493] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:04.479425  5178 leader_election.cc:290] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:00:04.637364  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 386141us
I20260709 13:00:04.564263  5088 raft_consensus.cc:515] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:04.600553  4890 raft_consensus.cc:3060] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:04.636705  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 111723us
W20260709 13:00:04.645599  5073 consensus_meta.cc:287] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.566s	user 0.012s	sys 0.000s
I20260709 13:00:04.657963  1615 leader_election.cc:304] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:04.644485  4843 raft_consensus.cc:3060] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:04.660261  1617 leader_election.cc:336] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.734s (SENT)
W20260709 13:00:04.659580  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:04.661113  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:04.661419  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:04.661689  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:04.662323  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 433393us
I20260709 13:00:04.652691  5075 leader_election.cc:290] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:00:04.656021  5011 consensus_meta.cc:287] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.599s	user 0.009s	sys 0.004s
I20260709 13:00:04.668416  1725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2138) took 3157 ms. Trace:
I20260709 13:00:04.656185  5178 raft_consensus.cc:2749] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:04.636211  4770 consensus_queue.cc:237] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 4, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:04.683779  1722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 731) took 1056 ms. Trace:
I20260709 13:00:04.662408  4961 raft_consensus.cc:1081] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 LEADER]: Signalling peer 0c7751452c4b46afa95251b9df7169d4 to start an election
I20260709 13:00:04.669947  1725 rpcz_store.cc:276] 0709 13:00:01.510774 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:03.413450 (+1902676us) service_pool.cc:224] Handling call
0709 13:00:03.413734 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:03.421922 (+  8188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:03.421954 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:03.454673 (+ 32719us) log.cc:844] Serialized 26 byte log entry
0709 13:00:04.255687 (+801014us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:04.508749 (+253062us) log.cc:844] Serialized 14 byte log entry
0709 13:00:04.665147 (+156398us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:04.668128 (+  2981us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:04.668182 (+    54us) raft_consensus.cc:1685] finished
0709 13:00:04.668200 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:04.668351 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":407977,"raft.queue_time_us":164717,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":7701,"thread_start_us":1085784,"threads_started":3,"wal-append.queue_time_us":645048}
I20260709 13:00:04.686164  1570 leader_election.cc:290] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:04.689132  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 70760.2us
I20260709 13:00:04.660507  5073 raft_consensus.cc:515] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:04.685878  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:04.672856  5169 leader_election.cc:290] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:04.670200  5116 raft_consensus.cc:515] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:04.703109  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 47370.3us
I20260709 13:00:04.704315  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:04.705673  1568 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2"
dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:37682
I20260709 13:00:04.706236  1568 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:04.706586  1568 raft_consensus.cc:3060] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:04.684507  4985 consensus_meta.cc:287] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.630s	user 0.007s	sys 0.000s
I20260709 13:00:04.707425  5112 raft_consensus.cc:493] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.707589  5088 leader_election.cc:290] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:04.709255  2329 raft_consensus.cc:3055] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:04.673681  5011 raft_consensus.cc:515] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:04.709827  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2139) took 3198 ms. Trace:
I20260709 13:00:04.698511  5171 raft_consensus.cc:2804] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:00:04.709052  5071 consensus_meta.cc:287] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.768s	user 0.010s	sys 0.004s
I20260709 13:00:04.714432  2323 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e"
dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
mode: GRACEFUL
new_leader_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:39778
I20260709 13:00:04.715291  2329 raft_consensus.cc:740] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
W20260709 13:00:04.717916  1617 leader_election.cc:336] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.814s (SENT)
W20260709 13:00:04.717468  1542 leader_election.cc:336] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.100s (SENT)
I20260709 13:00:04.720957  1542 leader_election.cc:304] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:04.686342  1722 rpcz_store.cc:276] 0709 13:00:03.623445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:03.715264 (+ 91819us) service_pool.cc:224] Handling call
0709 13:00:03.715535 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:03.715764 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:00:03.717541 (+  1777us) log.cc:844] Serialized 14 byte log entry
0709 13:00:04.621203 (+903662us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b4400022b4c. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef1f4c85 00007fa9ef1f56a2 00007fa9f1f671db 00007fa9f1f62aaf 00007fa9f1f5686e 00007fa9f1f55bb6 00007fa9f1f557d8 00007fa9f1f5f221 00007fa9f1f5f1d9 00007fa9f1f5f169
0709 13:00:04.649350 (+ 28147us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:04.659287 (+  9937us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:04.659335 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:04.663603 (+  4268us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:04.679839 (+ 16236us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":158058,"prepare.queue_time_us":369,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":1327,"raft.queue_time_us":376696,"raft.run_cpu_time_us":66,"raft.run_wall_time_us":67,"spinlock_wait_cycles":24594304,"thread_start_us":744258,"threads_started":2,"wal-append.queue_time_us":475977}
I20260709 13:00:04.686370  5082 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:04.722726  2323 raft_consensus.cc:606] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 LEADER]: Received request to transfer leadership to TS 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:04.726938  5178 raft_consensus.cc:2749] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:04.729735  5116 leader_election.cc:290] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:04.731859  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:04.737043  1575 raft_consensus.cc:1240] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:04.737835  1646 raft_consensus.cc:1240] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 5. Current term is 6. Ops: []
W20260709 13:00:04.738102  5172 log.cc:927] Time spent T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.106s	user 0.000s	sys 0.002s
I20260709 13:00:04.741077  1615 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:04.741976  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:04.743636  4974 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:04.746582  4974 raft_consensus.cc:493] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.745977  4930 raft_consensus.cc:515] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:04.747166  4974 raft_consensus.cc:515] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:04.748319  5111 raft_consensus.cc:2749] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:04.722922  5071 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:04.750288  5173 consensus_queue.cc:1059] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:04.751324  5173 raft_consensus.cc:3055] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:04.751657  5071 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:04.751976  5173 raft_consensus.cc:740] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
W20260709 13:00:04.753243  5183 log.cc:927] Time spent T 00000000000000000000000000000000 P fcfaa17e55ae48e194c5d95ca24a659f: Append to log took a long time: real 0.479s	user 0.008s	sys 0.004s
I20260709 13:00:04.753305  5173 consensus_queue.cc:260] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:04.754415  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:04.732877  5011 leader_election.cc:290] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:04.754812  5173 raft_consensus.cc:3060] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:04.755273  1568 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:04.762693  4974 leader_election.cc:290] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:04.724025  5112 raft_consensus.cc:515] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:04.763187  5174 log.cc:927] Time spent T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.516s	user 0.007s	sys 0.005s
I20260709 13:00:04.718595  5171 raft_consensus.cc:493] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:04.716387  1717 rpcz_store.cc:276] 0709 13:00:01.511129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:03.428060 (+1916931us) service_pool.cc:224] Handling call
0709 13:00:03.457049 (+ 28989us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:03.457317 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:00:03.477846 (+ 20529us) log.cc:844] Serialized 14 byte log entry
0709 13:00:04.344715 (+866869us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b180041afa0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef248c0a 00007fa9f8988219 00007fa9ef2d0a40 00007fa9ef2cb4e4 00007fa9ef2cb455 00007fa9f23b3060 00007fa9f23c5716 00007fa9f23d6287 00007fa9f23d6208
0709 13:00:04.631470 (+286755us) spinlock_profiling.cc:243] Waited 1.83 ms on lock 0x7b180041afa0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef2ce3f3 00007fa9ef2d07c1 00007fa9ef2d0779 00007fa9ef2d0709 00007fa9ef2d06d1 00007fa9ef2cf9cd 000000000038f354 000000000038f199 00007fa9ef2b183a
0709 13:00:04.692293 (+ 60823us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:04.695961 (+  3668us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:04.702786 (+  6825us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:04.706675 (+  3889us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:04.709785 (+  3110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3667,"prepare.queue_time_us":22946,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":34,"raft.queue_time_us":381803,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":127,"spinlock_wait_cycles":39582976,"thread_start_us":1023937,"threads_started":2,"wal-append.queue_time_us":696642}
I20260709 13:00:04.769230  5108 consensus_queue.cc:1059] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:04.781814  5112 leader_election.cc:290] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:04.782196  5108 raft_consensus.cc:3055] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:04.782725  5108 raft_consensus.cc:740] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
W20260709 13:00:04.771481  1617 leader_election.cc:336] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.889s (SENT)
I20260709 13:00:04.780921  4930 leader_election.cc:290] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:00:04.781394  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:04.780566  1575 raft_consensus.cc:1240] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:04.763164  5082 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:04.784690  5171 raft_consensus.cc:3060] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:04.785183  1617 leader_election.cc:304] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:04.718151  5122 raft_consensus.cc:515] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:04.790964  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:04.795018  1572 raft_consensus.cc:2468] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 8.
W20260709 13:00:04.790916  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 78833.1us
I20260709 13:00:04.798244  1568 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:04.763993  5169 raft_consensus.cc:493] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:04.801229  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:04.802027  1643 raft_consensus.cc:3060] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:04.789569   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:00:04.806412  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:04.807271  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:04.810359  5169 raft_consensus.cc:515] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:04.810850  2331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32870 (request call id 376) took 1386 ms. Trace:
I20260709 13:00:04.811240  2331 rpcz_store.cc:276] 0709 13:00:03.424076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:03.424226 (+   150us) service_pool.cc:224] Handling call
0709 13:00:03.471648 (+ 47422us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:03.480844 (+  9196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:03.480875 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:03.489579 (+  8704us) log.cc:844] Serialized 26 byte log entry
0709 13:00:04.246557 (+756978us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:04.272634 (+ 26077us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:04.272752 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:04.762451 (+489699us) spinlock_profiling.cc:243] Waited 23.7 ms on lock 0x7b4400022b4c. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef1f4c85 00007fa9ef1f56a2 00007fa9f1f671db 00007fa9f1f62aaf 00007fa9f1f5686e 00007fa9f1f55bb6 00007fa9f1f557d8 00007fa9f1f5f221 00007fa9f1f5f1d9 00007fa9f1f5f169
0709 13:00:04.810548 (+ 48097us) raft_consensus.cc:1685] finished
0709 13:00:04.810568 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:04.810777 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8813,"raft.queue_time_us":9421,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":4555,"spinlock_wait_cycles":54503808,"thread_start_us":700966,"threads_started":1,"wal-append.queue_time_us":684836}
I20260709 13:00:04.813555  1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 740) took 1014 ms. Trace:
I20260709 13:00:04.813970  1720 rpcz_store.cc:276] 0709 13:00:03.799477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.191259 (+391782us) service_pool.cc:224] Handling call
0709 13:00:04.232804 (+ 41545us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:04.624509 (+391705us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:04.813357 (+188848us) spinlock_profiling.cc:243] Waited 390 ms on lock 0x7b540007dd54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:04.813499 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":897352960}
I20260709 13:00:04.814785  5082 raft_consensus.cc:2749] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:04.816197  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:00:04.816730  5191 log.cc:927] Time spent T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.263s	user 0.003s	sys 0.000s
I20260709 13:00:04.817225  1569 raft_consensus.cc:2410] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:00:04.818425  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:04.817123  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:04.819212  2324 raft_consensus.cc:3055] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:04.820111  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:04.819128  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:00:04.820493  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 49100.5us
I20260709 13:00:04.819556  2324 raft_consensus.cc:740] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:04.821362  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 13:00:04.823215  5205 log.cc:927] Time spent T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 13:00:04.826885   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:04.820772  5073 leader_election.cc:290] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:04.835497  2332 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 7.
I20260709 13:00:04.832379  2324 consensus_queue.cc:260] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:04.834131  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:04.836740  2324 raft_consensus.cc:3060] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:04.836771  2327 raft_consensus.cc:2368] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 8. Current term is 9.
I20260709 13:00:04.843349  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:04.844417  1643 raft_consensus.cc:2468] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 9.
I20260709 13:00:04.784235  5108 consensus_queue.cc:260] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:04.845547  2294 leader_election.cc:304] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
W20260709 13:00:04.847244  1617 leader_election.cc:336] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.735s (SENT)
I20260709 13:00:04.849638  1571 raft_consensus.cc:1240] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 8. Current term is 10. Ops: []
I20260709 13:00:04.848222  4882 consensus_queue.cc:1059] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 13:00:04.861052  5169 leader_election.cc:290] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:04.865121  5108 raft_consensus.cc:3060] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:04.866952  5192 log.cc:927] Time spent T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.305s	user 0.002s	sys 0.000s
I20260709 13:00:04.872550  2324 raft_consensus.cc:2468] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 11.
I20260709 13:00:04.877140  1540 leader_election.cc:400] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 election: Vote denied by peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423) with higher term. Message: Invalid argument: T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 8. Current term is 9.
I20260709 13:00:04.877344  1572 raft_consensus.cc:1240] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 8. Current term is 9. Ops: []
W20260709 13:00:04.878386  1617 leader_election.cc:336] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.933s (SENT)
I20260709 13:00:04.878856  1617 leader_election.cc:304] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:04.872787  4843 raft_consensus.cc:2804] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:04.879865  4843 raft_consensus.cc:697] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:04.877570  1540 leader_election.cc:403] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:00:04.880894  4843 consensus_queue.cc:237] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:04.885675  1540 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:04.887229  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:04.903095  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:04.904026  1570 raft_consensus.cc:2410] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:00:04.907473  4770 raft_consensus.cc:2749] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:04.914167  1572 raft_consensus.cc:2393] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 9: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
W20260709 13:00:04.917680  2295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:04.890344  5112 raft_consensus.cc:3060] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:04.890775  5071 raft_consensus.cc:2804] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:04.912562  5171 raft_consensus.cc:515] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:04.929145  1571 raft_consensus.cc:1275] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:00:04.934743  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:04.935644  1572 raft_consensus.cc:2410] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:00:04.937506  1570 raft_consensus.cc:1240] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 8. Current term is 9. Ops: []
W20260709 13:00:04.945322  2297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:04.945207  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 66879.9us
I20260709 13:00:04.947341  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:04.951956  1647 raft_consensus.cc:2393] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 8: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
W20260709 13:00:04.956835  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:04.935433  5071 raft_consensus.cc:697] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:04.971961  1722 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f"
dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:58782
I20260709 13:00:04.972565  1722 raft_consensus.cc:493] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:04.972936  1722 raft_consensus.cc:3060] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:04.973393  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:04.973697  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:04.974011  1718 raft_consensus.cc:2376] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 7. Re-sending same reply.
I20260709 13:00:04.979825  2323 raft_consensus.cc:2468] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8.
I20260709 13:00:04.979452  1722 raft_consensus.cc:515] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:04.982038  5071 consensus_queue.cc:237] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:04.982935  1717 raft_consensus.cc:1240] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:04.985076  1722 leader_election.cc:290] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:04.985194  5210 log.cc:927] Time spent T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.215s	user 0.000s	sys 0.002s
W20260709 13:00:04.986325  1617 leader_election.cc:336] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.964s (SENT)
I20260709 13:00:04.986768  1617 leader_election.cc:304] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:04.989282  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:04.989905  1649 raft_consensus.cc:3060] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:04.947659  4890 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:05.021512  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:05.030243  5171 leader_election.cc:290] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:05.037293  1572 raft_consensus.cc:2410] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 13:00:05.043288  1649 raft_consensus.cc:2468] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 7.
I20260709 13:00:05.045543  5201 raft_consensus.cc:3055] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:05.046056  5201 raft_consensus.cc:740] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:05.045565  1688 leader_election.cc:304] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:05.047226  5216 raft_consensus.cc:2804] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:05.047999  5216 raft_consensus.cc:697] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 7 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:05.049497  5216 consensus_queue.cc:237] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:05.047008  5201 consensus_queue.cc:260] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:05.053634  5131 raft_consensus.cc:2749] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:05.053867  5122 leader_election.cc:290] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:05.067389  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:05.072841  5131 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:05.073740  5131 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:05.088589  2326 raft_consensus.cc:2468] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6.
W20260709 13:00:05.093883  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 125643us
W20260709 13:00:05.096138  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:05.097805  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:05.104841  1570 raft_consensus.cc:1275] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:00:05.105538  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:05.106091  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:05.106854  1575 raft_consensus.cc:2393] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 9: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:05.107048  1567 raft_consensus.cc:1240] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:05.109367  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:05.093235  5201 raft_consensus.cc:3060] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:05.095242  5115 raft_consensus.cc:493] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:05.107080  4890 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:05.125654  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:05.125691  5115 raft_consensus.cc:515] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:05.129091  1647 raft_consensus.cc:1240] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:05.129534  5115 leader_election.cc:290] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:00:05.130518  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:05.131438  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:05.147966  5112 raft_consensus.cc:2749] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423) with higher term. Message: Invalid argument: T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 8. Current term is 9.
I20260709 13:00:05.153126  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:05.153884  1572 raft_consensus.cc:3060] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:05.155210  1540 leader_election.cc:304] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:05.156916  1571 raft_consensus.cc:1240] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:05.157101  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:05.158015  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:05.158232  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:05.158613  2331 raft_consensus.cc:3060] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:05.158901  1567 raft_consensus.cc:2393] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 9: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:05.158766  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:05.124908  2323 raft_consensus.cc:2468] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 9.
W20260709 13:00:05.137796  1615 connection.cc:256] RPC call timeout handler was delayed by -1.3775588740000444s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:00:05.169411  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 13:00:05.171001  1617 leader_election.cc:336] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.592s (SENT)
W20260709 13:00:05.172595  1617 leader_election.cc:336] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.954s (SENT)
I20260709 13:00:05.173985  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:05.174777  1646 raft_consensus.cc:2393] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 9: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:05.176105  1644 raft_consensus.cc:1275] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:00:05.173460  1617 leader_election.cc:336] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.978s (SENT)
I20260709 13:00:05.178325  1650 raft_consensus.cc:1275] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:05.181459  1575 raft_consensus.cc:1275] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:00:05.174480  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:05.183458  1649 raft_consensus.cc:2368] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 7. Current term is 8.
I20260709 13:00:05.193014  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:05.196394  1648 raft_consensus.cc:2393] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 10: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:05.193243  5209 raft_consensus.cc:493] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:05.197769  5209 raft_consensus.cc:515] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:05.198037  2329 consensus_queue.cc:260] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:05.199090  2329 raft_consensus.cc:3060] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:05.210214  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:05.213713  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:05.214587  1644 raft_consensus.cc:2468] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 7.
I20260709 13:00:05.222319  2331 raft_consensus.cc:2468] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 9.
I20260709 13:00:05.200248  5209 leader_election.cc:290] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:05.167734  5112 raft_consensus.cc:2804] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:05.369345  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:05.372182  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:05.372975  1643 raft_consensus.cc:2393] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 6: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:05.379448  2329 raft_consensus.cc:2468] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8.
I20260709 13:00:05.381475  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:05.382206  1615 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:05.382681  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:05.383678  1615 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:05.384223  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:05.384743  5111 raft_consensus.cc:2804] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:05.385179  5111 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:05.385531  5111 raft_consensus.cc:3060] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:05.389891  4770 raft_consensus.cc:2804] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:05.390507  4770 raft_consensus.cc:697] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 9 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:05.391458  4770 consensus_queue.cc:237] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:05.393311  5111 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:05.394383  1643 raft_consensus.cc:3060] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:05.395426  5111 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:05.398130  5111 consensus_queue.cc:1048] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:05.401710  1643 raft_consensus.cc:2468] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 9.
I20260709 13:00:05.409693  4770 consensus_queue.cc:1048] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:05.410593  1615 leader_election.cc:304] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:05.412282  5111 raft_consensus.cc:2749] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:05.415016  4770 consensus_queue.cc:1059] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:05.418820  4770 consensus_queue.cc:1048] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:05.420415  4770 raft_consensus.cc:3055] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:05.420785  4770 raft_consensus.cc:740] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:05.421646  4770 consensus_queue.cc:260] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:05.422860  4770 raft_consensus.cc:3060] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:05.423100  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:05.423739  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:05.426240  5169 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:05.426877  5169 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:05.431000  5169 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:05.439379  5074 raft_consensus.cc:493] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:05.440059  5074 raft_consensus.cc:515] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:05.442018  1576 raft_consensus.cc:1275] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:00:05.442329  5074 leader_election.cc:290] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:05.443892  5088 raft_consensus.cc:493] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:05.444423  5088 raft_consensus.cc:515] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:05.451066  5088 leader_election.cc:290] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:00:05.487114  1689 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:05.487882  5088 raft_consensus.cc:493] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:05.488411  5088 raft_consensus.cc:515] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 13:00:05.490653  5088 leader_election.cc:290] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373)
W20260709 13:00:05.491185  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:05.493194  5088 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:05.493834  5088 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 13:00:05.494886  5131 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:05.497510  5088 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:00:05.498404  1689 connection.cc:256] RPC call timeout handler was delayed by -4.204612882000049s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1778s for a response
I20260709 13:00:05.498862  5088 raft_consensus.cc:493] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
W20260709 13:00:05.499372  1689 connection.cc:256] RPC call timeout handler was delayed by -4.0363128820000043s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1965s for a response
W20260709 13:00:05.499774  1689 connection.cc:256] RPC call timeout handler was delayed by -3.7852128819999962s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22440000000000004s for a response
W20260709 13:00:05.500185  1689 connection.cc:256] RPC call timeout handler was delayed by -1.6936128820000249s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.4568s for a response
W20260709 13:00:05.500962  1689 connection.cc:256] RPC call timeout handler was delayed by -1.6729128820000483s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.45910000000000006s for a response
I20260709 13:00:05.500063  5088 raft_consensus.cc:515] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:05.501755  1689 leader_election.cc:304] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:05.503470  1689 leader_election.cc:304] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:05.504905  1689 leader_election.cc:304] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:05.506273  1689 leader_election.cc:304] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:05.507409  5088 leader_election.cc:290] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:05.508836  5088 raft_consensus.cc:2749] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:05.509151  1689 leader_election.cc:304] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:05.510481  5088 raft_consensus.cc:2749] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:05.511772  5088 raft_consensus.cc:2749] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:05.515307  1689 leader_election.cc:304] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:05.524360  5088 raft_consensus.cc:2749] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:05.555606  5088 raft_consensus.cc:2749] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:05.527715  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:05.524402  5131 raft_consensus.cc:493] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
W20260709 13:00:05.554744  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:05.562886  5131 raft_consensus.cc:515] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:05.578435  5131 leader_election.cc:290] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:05.558387  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:05.581919  1572 raft_consensus.cc:2468] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 9.
I20260709 13:00:05.569005  5112 raft_consensus.cc:697] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:05.583540  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:05.584841  5112 consensus_queue.cc:237] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:05.597537  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:05.599308  1615 leader_election.cc:304] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:05.600288  4770 consensus_queue.cc:1048] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:05.601989  5131 raft_consensus.cc:2804] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:05.591746  5203 consensus_queue.cc:1048] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:05.602703  5131 raft_consensus.cc:697] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 9 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:05.586108  5088 raft_consensus.cc:2749] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:05.612061  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:05.612742  1574 raft_consensus.cc:3060] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:05.604038  5131 consensus_queue.cc:237] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:05.616961  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:05.618345  1576 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7.
I20260709 13:00:05.623476  1574 raft_consensus.cc:2468] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 8.
I20260709 13:00:05.527194  1689 leader_election.cc:304] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:05.626243  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:05.628229  1569 raft_consensus.cc:2368] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 8. Current term is 9.
I20260709 13:00:05.636016  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:05.636929  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:05.630475  5088 raft_consensus.cc:2749] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:05.640588  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:05.638639  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:05.638028  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:05.647624  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:05.642087  1646 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 7.
W20260709 13:00:05.655838  5216 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.000s	sys 0.043s
W20260709 13:00:05.662705  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:05.663538  1540 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:05.664780  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:05.665546  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:05.667824  1650 raft_consensus.cc:2368] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 8. Current term is 9.
I20260709 13:00:05.668812  1615 leader_election.cc:304] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:05.671149  1615 leader_election.cc:400] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 election: Vote denied by peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373) with higher term. Message: Invalid argument: T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 8. Current term is 9.
I20260709 13:00:05.671416  1615 leader_election.cc:403] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
W20260709 13:00:05.656415  5216 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.000s	sys 0.045s
I20260709 13:00:05.674119  4770 raft_consensus.cc:2749] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373) with higher term. Message: Invalid argument: T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 8. Current term is 9.
I20260709 13:00:05.673242  5082 raft_consensus.cc:2804] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:00:05.681783  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 154757us
I20260709 13:00:05.673372  5115 raft_consensus.cc:2804] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:05.688818  1689 leader_election.cc:304] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:05.689739  5115 raft_consensus.cc:697] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:05.688436  5082 raft_consensus.cc:697] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 8 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:05.706931  5216 raft_consensus.cc:2749] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:05.712724  1644 raft_consensus.cc:1240] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 9 LEADER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:05.714287  5115 consensus_queue.cc:237] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:05.716665  1689 leader_election.cc:304] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:05.717537  5088 raft_consensus.cc:2749] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:00:05.717978  1689 leader_election.cc:304] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:05.718780  5088 raft_consensus.cc:2749] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:05.719897  1689 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:05.729408  1689 leader_election.cc:304] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:05.731593  1689 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:05.732637  5203 raft_consensus.cc:2749] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:05.733422  5203 raft_consensus.cc:2749] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:00:05.194802  1542 leader_election.cc:336] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.163s (SENT)
W20260709 13:00:05.734728  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 539948us
I20260709 13:00:05.738037  5088 raft_consensus.cc:2749] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:05.736681  5082 consensus_queue.cc:237] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:05.739243  1689 leader_election.cc:304] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:05.742390  1539 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:05.743227  1650 raft_consensus.cc:3060] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:05.743340  5011 raft_consensus.cc:2749] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:05.744956  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:05.745162  5088 raft_consensus.cc:2749] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:05.745774  1646 raft_consensus.cc:2393] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 6: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:05.746026  5071 consensus_queue.cc:1048] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:05.748153  5011 consensus_queue.cc:1048] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:05.748777  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:05.749624  1539 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:05.751176  5071 raft_consensus.cc:3060] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:05.753963  1542 leader_election.cc:336] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.239s (SENT)
I20260709 13:00:05.756999  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:05.754434  1542 leader_election.cc:304] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:05.758271  1539 leader_election.cc:400] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 election: Vote denied by peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391) with higher term. Message: Invalid argument: T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 7. Current term is 8.
I20260709 13:00:05.758335  5112 raft_consensus.cc:2749] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:05.758805  1539 leader_election.cc:403] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:00:05.760890  5112 raft_consensus.cc:2749] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391) with higher term. Message: Invalid argument: T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 7. Current term is 8.
I20260709 13:00:05.764246  1539 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:05.761160  1650 raft_consensus.cc:1275] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:00:05.765430  1539 leader_election.cc:400] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 election: Vote denied by peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391) with higher term. Message: Invalid argument: T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 8. Current term is 9.
I20260709 13:00:05.772352  1689 leader_election.cc:304] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:05.773952  5088 raft_consensus.cc:2749] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:05.768136  5112 raft_consensus.cc:2804] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:00:05.810339  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 44174.3us
I20260709 13:00:05.812105  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:05.812173  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:05.812908  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:05.813289  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:05.813364  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:05.813935  1718 raft_consensus.cc:2468] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8.
I20260709 13:00:05.814553  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:05.815331  1722 raft_consensus.cc:2468] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
I20260709 13:00:05.816020  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:05.816907  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:05.817673  1725 raft_consensus.cc:2410] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:00:05.802058  5115 consensus_queue.cc:1048] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 13:00:05.824652  1723 raft_consensus.cc:2393] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 8: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:05.772826  5122 consensus_queue.cc:1048] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:00:05.803963  5112 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:05.835644  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:05.836766  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:05.835453  5112 raft_consensus.cc:3060] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:05.838083  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:05.840389  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:05.841441  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:05.841126  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:05.846323  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:05.847065  1718 raft_consensus.cc:2393] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 6: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:05.834637  5071 raft_consensus.cc:2749] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:05.847770  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:05.850488  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:05.853168  1716 raft_consensus.cc:2468] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8.
I20260709 13:00:05.857105  2324 raft_consensus.cc:1240] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:05.858613  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:05.851868  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:05.860414  1725 raft_consensus.cc:2393] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 9: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:05.860689  1721 raft_consensus.cc:2468] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 7.
I20260709 13:00:05.860867  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:05.862013  2332 raft_consensus.cc:2393] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 8: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:05.862880  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:05.864346  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:05.867731  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:05.869072  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:05.869349  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:05.869856  2332 raft_consensus.cc:2393] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 7: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 13:00:05.870211  1648 raft_consensus.cc:3060] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:05.861258  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:05.873229  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:05.874150  1724 raft_consensus.cc:2368] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 7. Current term is 8.
I20260709 13:00:05.875074  1723 raft_consensus.cc:2393] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 5: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:05.876091  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:05.877596  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:05.877724  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:05.877969  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:05.878206  1649 raft_consensus.cc:3060] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:05.878685  1716 raft_consensus.cc:2368] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 7. Current term is 8.
I20260709 13:00:05.878654  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:05.879379  1725 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 9.
I20260709 13:00:05.879575  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:05.880105  1716 raft_consensus.cc:3060] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:05.880199  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:05.880831  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:05.880903  1725 raft_consensus.cc:2468] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 7.
I20260709 13:00:05.881460  1724 raft_consensus.cc:2468] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
I20260709 13:00:05.881811  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:05.882169  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:05.882501  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:05.882705  1717 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 7.
I20260709 13:00:05.882861  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:05.883019  1724 raft_consensus.cc:3060] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:05.883883  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:05.884864  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:05.885064  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:05.885866  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:05.886142  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:05.886420  1723 raft_consensus.cc:2468] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 9.
I20260709 13:00:05.886942  1718 raft_consensus.cc:2410] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 10 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:00:05.887439  1716 raft_consensus.cc:2468] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 9.
I20260709 13:00:05.871922  5112 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:05.905273  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:05.907655  1719 raft_consensus.cc:2468] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 9.
I20260709 13:00:05.908684  5112 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:05.909103  2295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:05.910432  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:05.911141  1717 raft_consensus.cc:3060] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:05.912457  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:05.913120  1719 raft_consensus.cc:2468] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 7.
W20260709 13:00:05.914820  1573 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.756s	user 0.014s	sys 0.029s
W20260709 13:00:05.915160  1573 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.757s	user 0.014s	sys 0.029s
I20260709 13:00:05.910548  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:05.916966  1721 raft_consensus.cc:2368] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 8. Current term is 9.
I20260709 13:00:05.918735  1724 raft_consensus.cc:2468] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8.
I20260709 13:00:05.931123  1649 raft_consensus.cc:2468] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 9.
I20260709 13:00:05.937292  5088 raft_consensus.cc:493] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:05.937887  5088 raft_consensus.cc:515] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:05.945255  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 104485us
I20260709 13:00:05.955596  1539 leader_election.cc:304] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:05.958635  1648 raft_consensus.cc:2468] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8.
I20260709 13:00:05.952229  5088 leader_election.cc:290] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:05.959942  5071 raft_consensus.cc:2804] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:05.967278  1717 raft_consensus.cc:2468] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 10.
I20260709 13:00:05.969309  1615 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:05.968858  5088 raft_consensus.cc:493] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:05.971534  1689 leader_election.cc:304] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:05.969154  5071 raft_consensus.cc:697] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:05.970674  5169 raft_consensus.cc:2749] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:05.972891  5199 raft_consensus.cc:493] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:05.973459  5199 raft_consensus.cc:515] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:05.973783  1689 leader_election.cc:304] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:05.975414  5199 leader_election.cc:290] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:05.975785  1689 leader_election.cc:304] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:05.976400  5203 consensus_queue.cc:1059] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:05.977056  1689 leader_election.cc:304] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:05.977151  5216 raft_consensus.cc:2749] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:05.977324  5203 raft_consensus.cc:2749] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:05.977875  5216 raft_consensus.cc:3055] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:05.978062  5203 raft_consensus.cc:2749] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:05.978302  5216 raft_consensus.cc:740] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:05.979302  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:05.979278  5216 consensus_queue.cc:260] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:05.972913  5071 consensus_queue.cc:237] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:05.982430  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:05.971654  5088 raft_consensus.cc:515] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:05.983487  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:05.984058  1721 raft_consensus.cc:2468] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 4.
I20260709 13:00:05.984689  5088 leader_election.cc:290] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:05.975924  5199 raft_consensus.cc:2749] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:05.980476  5216 raft_consensus.cc:3060] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:05.990665  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:05.991124  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:05.991381  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:05.991971  1719 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7.
I20260709 13:00:05.992230  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:05.992822  1649 raft_consensus.cc:3060] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:05.991956  1724 raft_consensus.cc:2393] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 8: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:05.993546  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:05.994294  1722 raft_consensus.cc:2393] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 9: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:05.995477  1721 raft_consensus.cc:1275] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:00:05.999876  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:06.000998  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:06.001644  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:06.002095  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:06.002944  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:06.003568  1722 raft_consensus.cc:2468] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 9.
I20260709 13:00:06.009687  1540 leader_election.cc:304] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:06.010589  5247 raft_consensus.cc:2804] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:06.011158  5247 raft_consensus.cc:697] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:06.012126  5247 consensus_queue.cc:237] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:06.014504  1649 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8.
W20260709 13:00:06.026400  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 167271us
I20260709 13:00:06.030503  2326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32870 (request call id 387) took 1240 ms. Trace:
I20260709 13:00:06.031139  2326 rpcz_store.cc:276] 0709 13:00:04.790356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:04.806044 (+ 15688us) service_pool.cc:224] Handling call
0709 13:00:06.030356 (+1224312us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b54004f1fd4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:06.030448 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":590003968}
W20260709 13:00:06.040113  5229 log.cc:927] Time spent T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.400s	user 0.002s	sys 0.001s
I20260709 13:00:06.040664  5247 consensus_queue.cc:1048] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:06.042770  5247 consensus_queue.cc:1048] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:00:06.044035  1689 leader_election.cc:304] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:06.044824  5092 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.045588  1689 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:06.045518  5092 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:06.046581  5200 raft_consensus.cc:2749] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:06.046700  1542 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:06.047971  5092 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:06.048954  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:06.049289  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:06.049804  2324 raft_consensus.cc:2368] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 8. Current term is 9.
I20260709 13:00:06.050130  2332 raft_consensus.cc:2393] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 11: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:06.050805  5247 raft_consensus.cc:2749] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:06.051064  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:06.046301  5216 raft_consensus.cc:2749] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:06.051743  2329 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7.
I20260709 13:00:06.052830  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:06.053597  2331 raft_consensus.cc:2393] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 8: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:06.055629  4923 consensus_queue.cc:1059] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:06.048904  1542 leader_election.cc:304] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:06.057518  5247 raft_consensus.cc:2749] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 LEADER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:06.057943  4923 raft_consensus.cc:3055] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:06.058382  4923 raft_consensus.cc:740] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:06.059044  1542 leader_election.cc:304] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:06.059294  4923 consensus_queue.cc:260] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:06.061254  2297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:06.061681  2297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:06.064728  5247 raft_consensus.cc:2749] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:06.065738  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:06.066341  4920 consensus_queue.cc:1048] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:06.069959  4882 raft_consensus.cc:993] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66: : Instructing follower 89ac9d5e2fbc4536b03a1ff1dd3eb226 to start an election
I20260709 13:00:06.071930  4882 raft_consensus.cc:1081] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 LEADER]: Signalling peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 to start an election
I20260709 13:00:06.072875  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:06.073599  1574 raft_consensus.cc:2468] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 10.
I20260709 13:00:06.066370  2323 raft_consensus.cc:3060] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:06.080175  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:06.066388  1542 leader_election.cc:304] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:06.081521  2326 raft_consensus.cc:1275] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 LEARNER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:00:06.083177  2323 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8.
I20260709 13:00:06.083424  2332 raft_consensus.cc:1275] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:00:06.084019  5247 raft_consensus.cc:2749] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:06.086179  1542 leader_election.cc:304] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:06.086745  1575 raft_consensus.cc:1275] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:00:06.086949  5247 raft_consensus.cc:2749] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:06.087284  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:06.092980  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:06.094612  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
W20260709 13:00:06.095367  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 74238.9us
I20260709 13:00:06.088284  1542 leader_election.cc:304] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
W20260709 13:00:06.096742  1617 leader_election.cc:336] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.221s (SENT)
I20260709 13:00:06.097247  1617 leader_election.cc:304] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:06.097301  4923 raft_consensus.cc:3060] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:06.098186  5247 raft_consensus.cc:2804] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:00:06.098578  1617 leader_election.cc:336] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.572s (SENT)
I20260709 13:00:06.098656  5247 raft_consensus.cc:493] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:06.099200  5247 raft_consensus.cc:3060] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:06.099846  1617 leader_election.cc:336] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.963s (SENT)
I20260709 13:00:06.101065  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:06.102135  5252 raft_consensus.cc:2749] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:06.109198  1615 leader_election.cc:400] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 election: Vote denied by peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423) with higher term. Message: Invalid argument: T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 8. Current term is 9.
W20260709 13:00:06.116412  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 51853.4us
I20260709 13:00:06.117408  2297 leader_election.cc:304] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
W20260709 13:00:06.120453  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 48398.1us
I20260709 13:00:06.120817  4981 raft_consensus.cc:2749] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:00:06.124011  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 52862.7us
I20260709 13:00:06.126497  2295 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:06.127245  4882 raft_consensus.cc:2804] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:06.127712  4882 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:06.128100  4882 raft_consensus.cc:3060] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:06.128562  1542 leader_election.cc:400] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 election: Vote denied by peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473) with higher term. Message: Invalid argument: T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 7. Current term is 8.
I20260709 13:00:06.129629  1542 leader_election.cc:304] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:06.139797  5247 raft_consensus.cc:515] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:06.143180  1644 raft_consensus.cc:1275] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:00:06.132877  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:06.140930  5011 raft_consensus.cc:3060] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:06.130478  5201 consensus_meta.cc:287] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 1.006s	user 0.015s	sys 0.003s
I20260709 13:00:06.142110  1542 leader_election.cc:304] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:06.146862  1721 raft_consensus.cc:2468] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6.
I20260709 13:00:06.147230  5112 raft_consensus.cc:2749] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:06.148873  1542 leader_election.cc:400] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473) with higher term. Message: Invalid argument: T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 7. Current term is 8.
I20260709 13:00:06.149873  1542 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:06.150676  5112 raft_consensus.cc:2804] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:06.151106  5112 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:06.151470  5112 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:06.153014  5247 leader_election.cc:290] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:06.156138  1542 leader_election.cc:304] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:06.157783  1569 raft_consensus.cc:1240] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:06.157344  5247 raft_consensus.cc:2804] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:06.141700  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:06.160408  5247 raft_consensus.cc:493] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:06.161087  1647 raft_consensus.cc:2468] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 10.
I20260709 13:00:06.161435  5201 raft_consensus.cc:493] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.162091  5201 raft_consensus.cc:515] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:06.163005  5011 raft_consensus.cc:2749] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:06.157661  1542 leader_election.cc:304] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:06.164665  5011 raft_consensus.cc:2804] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:00:06.164834  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 55767.1us
I20260709 13:00:06.165235  5201 leader_election.cc:290] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:06.165345  5011 raft_consensus.cc:493] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:06.166062  5011 raft_consensus.cc:3060] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:06.167459  1688 leader_election.cc:304] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
W20260709 13:00:06.174113  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 47650.4us
I20260709 13:00:06.174273  5186 consensus_queue.cc:1059] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:06.175117  5186 consensus_queue.cc:1243] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer 4dbe7d47a2374afca075d3a98583b49e log is divergent from this leader: its last log entry 9.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:00:06.175621  5186 raft_consensus.cc:2749] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:06.175844  5173 consensus_queue.cc:1048] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:06.034276   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:06.176352  5186 raft_consensus.cc:3055] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:06.177894  5186 raft_consensus.cc:740] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:06.161136  5247 raft_consensus.cc:3060] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:06.178267  1569 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad"
dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:37682
I20260709 13:00:06.178850  1569 raft_consensus.cc:493] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:06.179296  1569 raft_consensus.cc:3060] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:06.178849  5186 consensus_queue.cc:260] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:06.180305  5186 raft_consensus.cc:3060] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:06.183610  4882 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:06.184703  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 60593.7us
I20260709 13:00:06.100283  1617 leader_election.cc:304] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:06.189738  5252 raft_consensus.cc:2749] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:00:06.189935  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 90156us
I20260709 13:00:06.190770  1569 raft_consensus.cc:515] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:06.192406  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:06.194057  1569 leader_election.cc:290] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:06.197062  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:06.209026  1722 raft_consensus.cc:2468] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 9.
I20260709 13:00:06.211601  1721 raft_consensus.cc:2468] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6.
W20260709 13:00:06.220652  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:06.165920  1615 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:00:06.248346  1505 debug-util.cc:398] Leaking SignalData structure 0x7b08001d73a0 after lost signal to thread 434
I20260709 13:00:06.236371  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:00:06.239686  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:06.246635  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 57554.9us
W20260709 13:00:06.253882  1505 debug-util.cc:398] Leaking SignalData structure 0x7b0800036f60 after lost signal to thread 1508
W20260709 13:00:06.255344  1505 debug-util.cc:398] Leaking SignalData structure 0x7b08001d7940 after lost signal to thread 1600
W20260709 13:00:06.256453  1505 debug-util.cc:398] Leaking SignalData structure 0x7b08003db080 after lost signal to thread 1675
W20260709 13:00:06.256752  1505 debug-util.cc:398] Leaking SignalData structure 0x7b08003db0a0 after lost signal to thread 1676
W20260709 13:00:06.257803  1505 debug-util.cc:398] Leaking SignalData structure 0x7b080038dcc0 after lost signal to thread 1749
W20260709 13:00:06.258066  1505 debug-util.cc:398] Leaking SignalData structure 0x7b08003173e0 after lost signal to thread 1750
W20260709 13:00:06.259191  1505 debug-util.cc:398] Leaking SignalData structure 0x7b08003f5780 after lost signal to thread 2356
I20260709 13:00:06.173242  1542 leader_election.cc:304] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
W20260709 13:00:06.265303  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 99506.1us
I20260709 13:00:06.266250  1615 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:06.267434  1615 leader_election.cc:304] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:06.250941  2332 raft_consensus.cc:2468] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 7.
I20260709 13:00:06.302649  5137 raft_consensus.cc:2749] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:06.302641  5173 consensus_queue.cc:1048] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:06.303647  5137 consensus_queue.cc:1048] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:06.309171  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:06.309907  1569 raft_consensus.cc:3060] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:06.289055  5209 raft_consensus.cc:2764] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:00:06.268821  5252 raft_consensus.cc:2749] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:00:06.334281  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 161111us
I20260709 13:00:06.335906  1542 leader_election.cc:304] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
W20260709 13:00:06.337044  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 82896.5us
I20260709 13:00:06.338140  1542 leader_election.cc:304] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:06.338510  1540 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:06.306907  5115 raft_consensus.cc:2749] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:06.303573  5111 consensus_queue.cc:1059] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:00:06.293318  5112 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:06.345183  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:06.346140  2323 raft_consensus.cc:3055] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:06.346541  2323 raft_consensus.cc:740] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:06.349771  2332 raft_consensus.cc:1275] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:06.340793  5074 raft_consensus.cc:2749] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:06.349515  2323 consensus_queue.cc:260] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:06.351995  1569 raft_consensus.cc:2468] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 11.
I20260709 13:00:06.355255  2326 raft_consensus.cc:1275] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:00:06.345556  5246 raft_consensus.cc:2749] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:06.356769  2323 raft_consensus.cc:3060] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:06.353669  2295 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:06.347764  5071 raft_consensus.cc:2804] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:06.369202  2331 raft_consensus.cc:1275] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:06.366709  1542 leader_election.cc:304] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:06.375650  2323 raft_consensus.cc:2468] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 7.
I20260709 13:00:06.378201  4923 raft_consensus.cc:2804] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:06.379024  4923 raft_consensus.cc:697] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:06.380344  4923 consensus_queue.cc:237] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:06.388149  5201 consensus_queue.cc:1048] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:06.394063  5112 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:06.405552  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:06.406256  1648 raft_consensus.cc:3060] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:06.410853  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 101483us
I20260709 13:00:06.413915  1617 leader_election.cc:304] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:00:06.415055  1469 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48478 (request call id 174) took 19400 ms (client timeout 15000 ms). Trace:
I20260709 13:00:06.356253  4882 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:00:06.428131  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 83575.4us
W20260709 13:00:06.429863  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 87660.6us
W20260709 13:00:06.415535  1469 rpcz_store.cc:269] 0709 12:59:47.014433 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:47.041508 (+ 27075us) service_pool.cc:224] Handling call
0709 13:00:06.414801 (+19373293us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:03.504578 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:03.505297 (+   719us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:03.505355 (+    58us) write_op.cc:435] Acquired schema lock
0709 13:00:03.505378 (+    23us) tablet.cc:662] Decoding operations
0709 13:00:03.507267 (+  1889us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:03.507359 (+    92us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:03.507386 (+    27us) tablet.cc:685] Acquiring locks for 23 operations
0709 13:00:03.520405 (+ 13019us) tablet.cc:701] Row locks acquired
0709 13:00:03.520463 (+    58us) write_op.cc:260] PREPARE: finished
0709 13:00:03.535940 (+ 15477us) write_op.cc:270] Start()
0709 13:00:03.576902 (+ 40962us) write_op.cc:276] Timestamp: P: 1783602003530282 usec, L: 0
0709 13:00:03.579707 (+  2805us) op_driver.cc:348] REPLICATION: starting
0709 13:00:03.731552 (+151845us) log.cc:844] Serialized 9089 byte log entry
0709 13:00:04.751164 (+1019612us) spinlock_profiling.cc:243] Waited 18.3 ms on lock 0x7b4400022b4c. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef1f4c85 00007fa9ef1f56a2 00007fa9f1f671db 00007fa9f1f62aaf 00007fa9f1f5686e 00007fa9f1f55bb6 00007fa9f1f557d8 00007fa9f1f5f221 00007fa9f1f5f1d9 00007fa9f1f5f169
0709 13:00:04.773905 (+ 22741us) op_driver.cc:464] REPLICATION: finished
0709 13:00:04.978722 (+204817us) spinlock_profiling.cc:243] Waited 5.53 ms on lock 0x7b4400022b4c. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef1f4c85 00007fa9ef1f56a2 00007fa9f1f671db 00007fa9f1f62aaf 00007fa9ef2b10ac 00007fa9f810bab9 00007fa9ef2cd69b 00007fa9ef2cb93f 00007fa9ef2cdc02 00007fa9f5df1ef0
0709 13:00:05.061559 (+ 82837us) write_op.cc:301] APPLY: starting
0709 13:00:05.061715 (+   156us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:05.062319 (+   604us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:05.062374 (+    55us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:05.108931 (+ 46557us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:05.109407 (+   476us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=23
0709 13:00:05.109459 (+    52us) write_op.cc:312] APPLY: finished
0709 13:00:05.110085 (+   626us) log.cc:844] Serialized 158 byte log entry
0709 13:00:05.114944 (+  4859us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:05.115347 (+   403us) write_op.cc:454] Released schema lock
0709 13:00:05.115425 (+    78us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:05.115936 (+   511us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:05.115966 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6176678,"reported_tablets":33,"child_traces":[["op",{"apply.queue_time_us":287337,"apply.run_cpu_time_us":6930,"apply.run_wall_time_us":54354,"num_ops":23,"prepare.queue_time_us":585502,"prepare.run_cpu_time_us":20322,"prepare.run_wall_time_us":682885,"raft.queue_time_us":18485,"raft.run_cpu_time_us":12927,"raft.run_wall_time_us":316457,"replication_time_us":1193957,"spinlock_wait_cycles":54768256,"thread_start_us":1208698,"threads_started":4,"wal-append.queue_time_us":502159,"wal-append.run_cpu_time_us":20874,"wal-append.run_wall_time_us":1871114}]]}
I20260709 13:00:06.437508  5252 consensus_queue.cc:1059] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:00:06.453166  1474 catalog_manager.cc:5697] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 5 to 6, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 6 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 13:00:06.454782  1540 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 13:00:06.455453  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 88843.8us
I20260709 13:00:06.478192  1542 leader_election.cc:304] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:06.407816  5247 raft_consensus.cc:515] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:06.481810  1540 leader_election.cc:304] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:06.406898  5071 raft_consensus.cc:697] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:06.467348  1648 raft_consensus.cc:2468] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 11.
I20260709 13:00:06.479463  1542 leader_election.cc:304] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:06.416725  5074 raft_consensus.cc:2749] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:06.487795  5266 consensus_queue.cc:1048] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:00:06.433420  5131 consensus_queue.cc:1059] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:00:06.436275  5011 raft_consensus.cc:515] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 13:00:06.497037  1474 catalog_manager.cc:5697] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:06.461145  5209 consensus_queue.cc:1048] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:00:06.482201  5169 raft_consensus.cc:2804] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:06.484558  5246 raft_consensus.cc:2804] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:06.484930  5203 raft_consensus.cc:493] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:06.493451  5115 raft_consensus.cc:2804] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:00:06.526803  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 96235us
I20260709 13:00:06.481971  5171 consensus_queue.cc:1048] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.031s
W20260709 13:00:06.542064  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:06.488366  5269 raft_consensus.cc:2804] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:06.491559  5112 consensus_queue.cc:1048] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
W20260709 13:00:06.546814  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 47283.1us
I20260709 13:00:06.512704  5169 raft_consensus.cc:493] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:06.507967  5111 raft_consensus.cc:3055] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:06.517266  5246 raft_consensus.cc:493] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:06.493609  5268 consensus_queue.cc:1048] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:00:06.523710  5186 raft_consensus.cc:493] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:06.547706  5201 raft_consensus.cc:493] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:06.539014  5074 consensus_queue.cc:1048] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:00:06.555544  5169 raft_consensus.cc:3060] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:06.586839  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 107452us
I20260709 13:00:06.556027  5111 raft_consensus.cc:740] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:06.552795  5200 raft_consensus.cc:493] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
W20260709 13:00:06.606760  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:06.556666  5216 raft_consensus.cc:493] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:06.542071  5203 raft_consensus.cc:515] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:06.615624  1474 catalog_manager.cc:5697] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 3 to 4, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 4 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } }
I20260709 13:00:06.564606  5115 raft_consensus.cc:697] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:06.578944  5266 raft_consensus.cc:3055] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:06.565173  5246 raft_consensus.cc:3060] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:06.565672  5278 raft_consensus.cc:2749] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:06.556192  5175 consensus_queue.cc:1048] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 13:00:06.629981  1474 catalog_manager.cc:5697] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 2 to 5, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 5 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:06.634008  5115 consensus_queue.cc:237] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:06.578341  5071 consensus_queue.cc:237] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:06.638067  5279 raft_consensus.cc:493] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:06.612675  5201 raft_consensus.cc:515] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:06.606521  1542 leader_election.cc:304] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:06.657718  2332 raft_consensus.cc:1275] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:06.665575  1474 catalog_manager.cc:5697] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 4 to 7, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 7 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
W20260709 13:00:06.670394  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 116580us
W20260709 13:00:06.644011  5264 log.cc:927] Time spent T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
I20260709 13:00:06.621981  5266 raft_consensus.cc:740] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:06.605947  5186 raft_consensus.cc:515] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:06.648111  5261 log.cc:927] Time spent T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.218s	user 0.000s	sys 0.001s
I20260709 13:00:06.623849  5216 raft_consensus.cc:515] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:06.701207  1474 catalog_manager.cc:5697] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 4 to 6, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 6 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } }
I20260709 13:00:06.703433  1575 raft_consensus.cc:1275] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:00:06.700119  1569 raft_consensus.cc:1240] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:06.638672  5279 raft_consensus.cc:515] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:06.641937  5274 consensus_queue.cc:1048] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.051s
I20260709 13:00:06.704851  5268 consensus_queue.cc:1048] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:00:06.720758  1574 raft_consensus.cc:1275] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:00:06.712234  5269 raft_consensus.cc:697] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:06.690408  5278 raft_consensus.cc:2749] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:00:06.736316  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 129874us
I20260709 13:00:06.624017  5200 raft_consensus.cc:515] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:06.772886  1542 leader_election.cc:304] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:06.705178  5175 consensus_queue.cc:1059] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:00:06.719781  5247 leader_election.cc:290] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:06.781322  1474 catalog_manager.cc:5697] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 1 to 4, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 4 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:06.787808  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 112883us
I20260709 13:00:06.789773  1474 catalog_manager.cc:5697] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:06.782828  5011 leader_election.cc:290] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:06.714685  5111 consensus_queue.cc:260] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:06.842303  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 69523.3us
I20260709 13:00:06.842182  1474 catalog_manager.cc:5697] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 3 to 5, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 5 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:06.840656  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 47622.9us
I20260709 13:00:06.846215  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:06.846640  5296 raft_consensus.cc:493] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:06.847579  5296 raft_consensus.cc:515] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:06.850243  5296 leader_election.cc:290] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:06.865988  1542 leader_election.cc:400] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473) with higher term. Message: Invalid argument: T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 8. Current term is 9.
I20260709 13:00:06.867440  1474 catalog_manager.cc:5697] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } }
I20260709 13:00:06.886525  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:06.826364  5278 raft_consensus.cc:2804] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:06.901209  1474 catalog_manager.cc:5697] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 7 to 8, leader changed from 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 8 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:06.787626  5266 consensus_queue.cc:260] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:06.896613  5201 leader_election.cc:290] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:06.919350  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 59267.5us
I20260709 13:00:06.922254  1474 catalog_manager.cc:5697] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 2 to 5, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 5 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:06.925400  1542 leader_election.cc:304] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:06.902055  5203 leader_election.cc:290] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:06.935725  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:06.936228  1568 raft_consensus.cc:1240] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:06.911046  5278 raft_consensus.cc:493] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:06.937495  5278 raft_consensus.cc:3060] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:06.920442  5269 consensus_queue.cc:237] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:06.917187  4981 raft_consensus.cc:493] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:06.942111  1474 catalog_manager.cc:5697] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 3 to 7, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 7 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:06.917224  5186 leader_election.cc:290] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:06.943910  1474 catalog_manager.cc:5697] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 1 to 4, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 4 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:00:06.958748  1567 raft_consensus.cc:1240] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:06.968767  5286 raft_consensus.cc:2804] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:06.970274  1642 raft_consensus.cc:1275] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:00:06.971943  1474 catalog_manager.cc:5697] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 3 to 6, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 6 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:06.979548  5246 raft_consensus.cc:515] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:06.952425  4981 raft_consensus.cc:515] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:06.981850  5200 leader_election.cc:290] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:06.990965  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:06.991788  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:06.991701  1717 pending_rounds.cc:85] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4: Aborting all ops after (but not including) 7
I20260709 13:00:07.005934  1724 raft_consensus.cc:2393] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 6: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:07.006027  1717 pending_rounds.cc:107] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4: Aborting uncommitted NO_OP operation due to leader change: 5.8
I20260709 13:00:07.006557  1717 raft_consensus.cc:2889] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:06.992586  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:07.007263  1722 raft_consensus.cc:2468] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8.
I20260709 13:00:06.992736  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:06.997654  1474 catalog_manager.cc:5697] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 6 to 7, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 7 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:07.008315  1716 raft_consensus.cc:3060] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:07.024391  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:07.025223  1719 raft_consensus.cc:2468] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 7.
I20260709 13:00:06.960732  5279 leader_election.cc:290] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:07.027889  1474 catalog_manager.cc:5697] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 5 to 8, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 8 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:07.028492  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:07.031409  1722 raft_consensus.cc:3060] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:07.032323  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:07.032966  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:07.033527  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:07.029385  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:07.034540  1724 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:07.034749  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:07.035825  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:06.988186  5169 raft_consensus.cc:515] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:07.039292  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:07.041170  1723 raft_consensus.cc:3060] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:07.002545  5286 raft_consensus.cc:697] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:07.042307  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:00:07.043460  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 252987us
I20260709 13:00:07.045369  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:07.045962  1719 raft_consensus.cc:3060] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:07.045720  1617 leader_election.cc:304] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:07.039932  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:07.044183  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:00:07.047283  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 56885.6us
I20260709 13:00:07.048913  1617 leader_election.cc:304] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:07.047137  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:07.047797  1576 raft_consensus.cc:2468] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 6.
I20260709 13:00:07.051214  1573 raft_consensus.cc:2393] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 8: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:07.055008  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:07.056411  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:07.059146  5294 raft_consensus.cc:2804] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:07.059883  1724 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 10.
I20260709 13:00:07.060176  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:07.060710  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:07.061136  1724 raft_consensus.cc:3060] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:07.060883  1725 raft_consensus.cc:2468] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6.
I20260709 13:00:07.061723  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:07.058746  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:07.063738  1647 raft_consensus.cc:1240] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:07.066425  1722 raft_consensus.cc:2468] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 7.
I20260709 13:00:07.069869  1716 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8.
I20260709 13:00:07.059587  5294 raft_consensus.cc:493] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:07.075563  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:07.077775  5294 raft_consensus.cc:3060] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:07.058645  5301 raft_consensus.cc:2749] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:07.081457  1572 raft_consensus.cc:1240] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:00:07.083504  1723 raft_consensus.cc:2468] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6.
I20260709 13:00:07.084445  1724 raft_consensus.cc:2468] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8.
I20260709 13:00:07.083778  1617 leader_election.cc:304] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:07.088871  5301 raft_consensus.cc:2749] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:07.091368  5301 consensus_queue.cc:1048] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:07.093674  1617 leader_election.cc:304] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:07.093782  5281 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:07.098453  5281 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:07.101601  5281 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:07.126713  4981 leader_election.cc:290] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:00:07.132787  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:07.133601  1568 raft_consensus.cc:1275] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:00:07.134776  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:07.135497  1572 raft_consensus.cc:2468] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 9.
W20260709 13:00:07.138931  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 44058.4us
I20260709 13:00:07.140875  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:07.145346  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:07.146323  1723 raft_consensus.cc:2468] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 8.
I20260709 13:00:07.148202  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:07.155061  1575 raft_consensus.cc:2393] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 8: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:07.166271  2297 leader_election.cc:304] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
W20260709 13:00:07.179688  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 86077.4us
I20260709 13:00:07.180918  1617 leader_election.cc:304] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:07.190371  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:07.163211  5246 leader_election.cc:290] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:07.196882  5249 raft_consensus.cc:2749] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:07.167933  5286 consensus_queue.cc:237] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:07.149438  5294 raft_consensus.cc:515] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:07.164310  5310 raft_consensus.cc:2749] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:07.206967  5294 leader_election.cc:290] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:07.177251  5288 raft_consensus.cc:493] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:07.223110  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 164995us
W20260709 13:00:07.233922  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 53113.2us
I20260709 13:00:07.244297  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:07.246789  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:07.221626  4923 raft_consensus.cc:2804] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:07.211001  4770 raft_consensus.cc:3055] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:07.254590  2295 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:07.255436  5275 consensus_queue.cc:1048] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:07.256697  1617 leader_election.cc:304] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:07.267477  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:07.270170  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:07.207006  5278 raft_consensus.cc:515] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:07.274521  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:07.275008  1617 leader_election.cc:304] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 13:00:07.251940  4923 raft_consensus.cc:493] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:07.277738  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:07.282716  5259 raft_consensus.cc:2804] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:07.287209  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:07.293262  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:07.253470  4770 raft_consensus.cc:740] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:07.312114  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:07.298146  1617 leader_election.cc:304] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:07.268179  5289 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:07.313824  1689 leader_election.cc:304] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:07.312613  5259 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:07.289461  5310 raft_consensus.cc:2804] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:07.292645  5301 raft_consensus.cc:2804] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:07.294682  4923 raft_consensus.cc:3060] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:07.292891  5175 raft_consensus.cc:493] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:07.331805  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:07.336359  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:07.259513  5288 raft_consensus.cc:515] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:07.332504  5306 raft_consensus.cc:2749] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:00:07.351632  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 53579.7us
I20260709 13:00:07.335036  5259 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:07.349939  5224 raft_consensus.cc:993] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66: : Instructing follower 0c7751452c4b46afa95251b9df7169d4 to start an election
I20260709 13:00:07.335412  5310 raft_consensus.cc:493] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:07.369038  1718 raft_consensus.cc:1240] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 13:00:07.338347  5301 raft_consensus.cc:493] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:07.371569  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:07.376893  1718 raft_consensus.cc:1275] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:00:07.387329  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:07.386538  5295 raft_consensus.cc:2804] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:00:07.393302  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 60298.9us
I20260709 13:00:07.332139  5289 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:07.396106  1689 leader_election.cc:304] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:07.376778  5301 raft_consensus.cc:3060] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:07.402554  1689 leader_election.cc:304] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:07.373929  5310 raft_consensus.cc:3060] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:07.409531  1689 leader_election.cc:304] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:07.381851  5224 raft_consensus.cc:1081] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 LEADER]: Signalling peer 0c7751452c4b46afa95251b9df7169d4 to start an election
I20260709 13:00:07.391758  5298 raft_consensus.cc:493] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
W20260709 13:00:07.486373  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 76909.7us
I20260709 13:00:07.486393  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:07.353155  5175 raft_consensus.cc:515] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:07.485736  5200 raft_consensus.cc:2749] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:07.489853  1689 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:07.494441  1719 raft_consensus.cc:2468] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8.
I20260709 13:00:07.495332  1717 raft_consensus.cc:1240] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 13:00:07.495699  1689 leader_election.cc:304] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:07.497167  1689 leader_election.cc:304] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:00:07.490706  5318 log.cc:927] Time spent T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:00:07.488591  5306 raft_consensus.cc:2749] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:07.383140  4770 consensus_queue.cc:260] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:07.534127  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:07.534991  1651 raft_consensus.cc:1240] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:07.541177  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:07.512270  5201 raft_consensus.cc:2749] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:07.545854  1650 raft_consensus.cc:1275] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:07.545131  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:07.545203  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:07.549376  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:07.557152  1651 raft_consensus.cc:1275] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:00:07.569619  5325 log.cc:927] Time spent T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:00:07.538334  5200 raft_consensus.cc:2749] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:07.532631  5246 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
W20260709 13:00:07.581322  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 68312us
I20260709 13:00:07.539667  5295 raft_consensus.cc:697] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 6 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:07.540777  5115 raft_consensus.cc:493] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:07.552002  5278 leader_election.cc:290] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:07.518190  5298 raft_consensus.cc:515] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:07.615370  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 81941.7us
W20260709 13:00:07.616895  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 119850us
I20260709 13:00:07.604449  5115 raft_consensus.cc:515] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:07.611812  5201 raft_consensus.cc:2749] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:07.599215  5246 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:07.629689  5269 consensus_queue.cc:1048] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:00:07.640113  5115 leader_election.cc:290] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:07.642069  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:00:07.646203  5321 log.cc:927] Time spent T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 13:00:07.649173  5329 raft_consensus.cc:493] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:07.649974  5329 raft_consensus.cc:515] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:07.652592  5262 log.cc:927] Time spent T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 1.217s	user 0.000s	sys 0.009s
I20260709 13:00:07.655128  1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 1637) took 1622 ms. Trace:
W20260709 13:00:07.662392  5333 log.cc:927] Time spent T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:00:07.663146  5304 raft_consensus.cc:493] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:07.664011  5304 raft_consensus.cc:515] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:07.668958  5291 log.cc:927] Time spent T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.834s	user 0.004s	sys 0.000s
I20260709 13:00:07.643870  1651 raft_consensus.cc:1275] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:00:07.669890  5329 leader_election.cc:290] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:07.680075  1689 leader_election.cc:304] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:07.683820  1542 leader_election.cc:304] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:07.619097  5288 leader_election.cc:290] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:07.655612  1643 rpcz_store.cc:276] 0709 13:00:06.032202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.077585 (+ 45383us) service_pool.cc:224] Handling call
0709 13:00:06.077954 (+   369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:06.078455 (+   501us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:06.078743 (+   288us) log.cc:844] Serialized 14 byte log entry
0709 13:00:06.293567 (+214824us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:06.294037 (+   470us) log.cc:844] Serialized 26 byte log entry
0709 13:00:06.294205 (+   168us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:06.294411 (+   206us) log.cc:844] Serialized 14 byte log entry
0709 13:00:06.305937 (+ 11526us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:06.306044 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:06.409867 (+103823us) spinlock_profiling.cc:243] Waited 8.68 ms on lock 0x7b18003b61a0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef248c0a 00007fa9f8988219 00007fa9f628f58f 00007fa9ef2ce571 00007fa9ef2d07c1 00007fa9ef2d0779 00007fa9ef2d0709 00007fa9ef2d06d1 00007fa9ef2cf9cd
0709 13:00:06.493306 (+ 83439us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b18003b61a0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef2ce3f3 00007fa9ef2d07c1 00007fa9ef2d0779 00007fa9ef2d0709 00007fa9ef2d06d1 00007fa9ef2cf9cd 000000000038f354 000000000038f199 00007fa9ef2b183a
0709 13:00:07.350939 (+857633us) spinlock_profiling.cc:243] Waited 7.39 ms on lock 0x7b4400022b4c. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef1f4c85 00007fa9ef1f56a2 00007fa9f1f671db 00007fa9f1f62aaf 00007fa9f1f5686e 00007fa9f1f55bb6 00007fa9f1f557d8 00007fa9f1f5f221 00007fa9f1f5f1d9 00007fa9f1f5f169
0709 13:00:07.382491 (+ 31552us) spinlock_profiling.cc:243] Waited 6.66 ms on lock 0x7b18003b61a0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef2ce522 00007fa9ef2d07c1 00007fa9ef2d0779 00007fa9ef2d0709 00007fa9ef2d06d1 00007fa9ef2cf9cd 000000000038f354 000000000038f199 00007fa9ef2b183a
0709 13:00:07.654838 (+272347us) raft_consensus.cc:1685] finished
0709 13:00:07.654866 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:07.655033 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":82022,"prepare.queue_time_us":2146,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":68,"raft.queue_time_us":51669,"raft.run_cpu_time_us":313,"raft.run_wall_time_us":13125,"spinlock_wait_cycles":91638144,"thread_start_us":189475,"threads_started":1,"wal-append.queue_time_us":223098}
I20260709 13:00:07.721321  1689 leader_election.cc:304] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:07.722359  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:07.724195  1721 raft_consensus.cc:3060] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:07.725623  1542 leader_election.cc:304] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:07.727160  1542 leader_election.cc:304] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
W20260709 13:00:07.697873  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:07.628156  5302 raft_consensus.cc:2749] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:07.738996  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:00:07.751116  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 179517us
I20260709 13:00:07.673319  5337 raft_consensus.cc:493] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:07.667150  5304 leader_election.cc:290] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:07.673244  5298 leader_election.cc:290] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:07.738821  4890 raft_consensus.cc:2804] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:07.739085  5279 raft_consensus.cc:2749] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:07.732795  5269 raft_consensus.cc:3060] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:07.745019  5329 raft_consensus.cc:2749] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:07.776873  1721 raft_consensus.cc:2468] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 10.
I20260709 13:00:07.755892  5331 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:07.779825  4890 raft_consensus.cc:493] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:07.682030  5295 consensus_queue.cc:237] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:07.764597  5313 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:07.840655   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:07.791148  5175 leader_election.cc:290] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:07.840868  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 113789us
I20260709 13:00:07.841601  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 668) took 1536 ms. Trace:
I20260709 13:00:07.877902  1542 leader_election.cc:304] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 13:00:07.837241  4890 raft_consensus.cc:3060] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:07.855314  1644 rpcz_store.cc:276] 0709 13:00:06.305426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.305614 (+   188us) service_pool.cc:224] Handling call
0709 13:00:06.305979 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:06.334864 (+ 28885us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:06.462253 (+127389us) log.cc:844] Serialized 14 byte log entry
0709 13:00:06.791442 (+329189us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:06.823702 (+ 32260us) log.cc:844] Serialized 26 byte log entry
0709 13:00:06.823877 (+   175us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:06.823930 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:06.824027 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:07.647965 (+823938us) spinlock_profiling.cc:243] Waited 2.35 ms on lock 0x7b4400022b4c. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef1f4c85 00007fa9ef1f56a2 00007fa9f1f671db 00007fa9f1f62aaf 00007fa9f1f5686e 00007fa9f1f55bb6 00007fa9f1f557d8 00007fa9f1f5f221 00007fa9f1f5f1d9 00007fa9f1f5f169
0709 13:00:07.795975 (+148010us) raft_consensus.cc:1685] finished
0709 13:00:07.841306 (+ 45331us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:07.841521 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":165309,"prepare.queue_time_us":236634,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":166231,"raft.run_cpu_time_us":243,"raft.run_wall_time_us":11264,"spinlock_wait_cycles":5397248,"thread_start_us":389259,"threads_started":3,"wal-append.queue_time_us":255160}
I20260709 13:00:07.762722  5337 raft_consensus.cc:515] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:07.875823  5279 raft_consensus.cc:493] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:07.893819  5335 log.cc:927] Time spent T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
W20260709 13:00:07.895083  4923 consensus_meta.cc:287] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.542s	user 0.005s	sys 0.005s
W20260709 13:00:07.895848  5332 log.cc:927] Time spent T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:00:07.895582  4923 raft_consensus.cc:515] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:07.910307  5289 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:00:07.918197  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 63189.3us
I20260709 13:00:07.919811  1542 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:07.930061  1542 leader_election.cc:304] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:07.885128  5278 raft_consensus.cc:2804] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:07.794087  5331 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:07.943274  5115 consensus_queue.cc:1059] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:07.935485  4923 leader_election.cc:290] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:07.954558  5337 leader_election.cc:290] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:07.931044  5339 raft_consensus.cc:2804] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:07.854439  5313 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:07.917904  5279 raft_consensus.cc:515] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:07.934784  5278 raft_consensus.cc:493] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:07.926892  5301 raft_consensus.cc:515] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:07.985450  4920 raft_consensus.cc:493] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:07.986078  4920 raft_consensus.cc:515] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:07.986647  5290 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:07.987195  5290 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:07.988268  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:07.988941  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:07.989610  1643 raft_consensus.cc:2468] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 6.
I20260709 13:00:07.990185  5169 leader_election.cc:290] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:07.991611  5204 raft_consensus.cc:493] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:07.992106  5204 raft_consensus.cc:515] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:07.992641  1649 raft_consensus.cc:1275] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:00:07.994264  5204 leader_election.cc:290] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:07.993882  2332 raft_consensus.cc:2955] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 2 to 6, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:00:07.996382  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:07.997406  2323 raft_consensus.cc:2393] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 9: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 13:00:07.999954  5331 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:08.000027  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:08.005064  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:08.007323  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:08.010181  2294 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:07.969262  5278 raft_consensus.cc:3060] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:08.013827  1644 raft_consensus.cc:1240] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:07.974201  5269 raft_consensus.cc:2749] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:00:07.985482  5259 consensus_meta.cc:287] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.612s	user 0.011s	sys 0.000s
I20260709 13:00:08.061231  5352 raft_consensus.cc:493] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.061483  5331 consensus_queue.cc:1059] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:08.061875  5352 raft_consensus.cc:515] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:08.019620  5294 consensus_queue.cc:1059] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:00:08.017868  5252 consensus_queue.cc:1059] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:00:08.063683  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:08.064133  5352 leader_election.cc:290] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:00:08.067337  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 49046.3us
I20260709 13:00:08.064745  5340 raft_consensus.cc:2804] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:00:08.105115  1617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:08.125347  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 193844us
W20260709 13:00:08.130342  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 110238us
I20260709 13:00:08.136428  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 1640) took 1203 ms. Trace:
I20260709 13:00:08.137094  1647 rpcz_store.cc:276] 0709 13:00:06.933213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.933330 (+   117us) service_pool.cc:224] Handling call
0709 13:00:06.933634 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:07.064181 (+130547us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:08.136040 (+1071859us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b54001d9554. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:08.136327 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":290708352}
I20260709 13:00:08.140338  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:08.149525  2323 raft_consensus.cc:1240] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 13:00:08.065346  4981 raft_consensus.cc:2804] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:07.990229  4890 raft_consensus.cc:515] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:08.158757  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 90456.7us
I20260709 13:00:08.162743  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:08.184489  1646 raft_consensus.cc:2410] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:00:08.185678  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:08.189644  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:08.189745  5280 consensus_queue.cc:1048] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.173s
I20260709 13:00:08.191426  5342 consensus_queue.cc:1048] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.176s
I20260709 13:00:08.189925  5303 raft_consensus.cc:2955] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 7 LEADER]: Committing config change with OpId 7.6: config changed from index 2 to 6, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
W20260709 13:00:08.193346  5315 log.cc:927] Time spent T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:00:08.195042  5313 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:08.197674  5279 leader_election.cc:290] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:08.198526  5279 consensus_queue.cc:1048] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:08.200121  5082 raft_consensus.cc:3055] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:08.200670  5082 raft_consensus.cc:740] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:08.118403  5340 raft_consensus.cc:493] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:08.201751  5340 raft_consensus.cc:3060] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:08.205888  5290 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:08.206110  4890 leader_election.cc:290] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:00:08.207567  5310 consensus_meta.cc:287] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.721s	user 0.010s	sys 0.000s
I20260709 13:00:08.207983  5310 raft_consensus.cc:515] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:08.132740  5131 raft_consensus.cc:3055] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:00:08.211768  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:08.154109  4981 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:08.221076  5355 raft_consensus.cc:493] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:08.189585  5334 raft_consensus.cc:3055] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:08.188017  5269 raft_consensus.cc:3055] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:08.227178  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:08.231698  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:08.231662  1646 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 8.
I20260709 13:00:08.156428  4920 leader_election.cc:290] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:08.100493  5259 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:08.214301  5131 raft_consensus.cc:740] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:08.225868  4981 raft_consensus.cc:3060] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:08.233392  5269 raft_consensus.cc:740] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
W20260709 13:00:08.248497  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 122206us
I20260709 13:00:08.249501  2331 raft_consensus.cc:1240] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:08.252107  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:08.231148  5334 raft_consensus.cc:740] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:08.260291  1576 raft_consensus.cc:1240] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:08.262487  1571 raft_consensus.cc:1240] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:08.267105  1575 raft_consensus.cc:1240] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:08.201747  5082 consensus_queue.cc:260] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:08.273535  1574 raft_consensus.cc:1240] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:08.233317  5355 raft_consensus.cc:515] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:08.262840  5363 raft_consensus.cc:476] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 LEADER]: Not starting pre-election -- already a leader
I20260709 13:00:08.291200  1576 raft_consensus.cc:1240] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:08.294656  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:08.275926  5349 consensus_queue.cc:1048] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.088s
I20260709 13:00:08.247771  5011 raft_consensus.cc:493] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:08.295857  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:08.305609  1573 raft_consensus.cc:1275] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:08.327339  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:08.289438  5082 raft_consensus.cc:3060] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:08.310299  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:08.361528  2329 raft_consensus.cc:1275] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:00:08.363363  1576 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:08.282406  4890 raft_consensus.cc:493] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:08.360456  5352 raft_consensus.cc:493] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:08.301329  5310 leader_election.cc:290] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:08.364851  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:08.368579  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:08.307828  5259 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:08.314406  5216 leader_election.cc:290] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:08.316781  5301 leader_election.cc:290] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:08.290272  5173 consensus_queue.cc:1059] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 13:00:08.381250  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:08.366122  5364 consensus_queue.cc:1059] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 13:00:08.409070  5364 raft_consensus.cc:3055] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:08.409473  5364 raft_consensus.cc:740] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:08.409830  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:08.410080  5092 raft_consensus.cc:3055] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:08.410450  5092 raft_consensus.cc:740] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:08.410362  5364 consensus_queue.cc:260] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:08.411844  5364 raft_consensus.cc:3060] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:08.375941  5361 consensus_queue.cc:1048] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.110s
I20260709 13:00:08.377517  5355 leader_election.cc:290] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:08.412775  1721 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e"
dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:58782
I20260709 13:00:08.413298  1721 raft_consensus.cc:493] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:08.413702  1721 raft_consensus.cc:3060] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:08.383162  4770 raft_consensus.cc:3060] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:08.368453  5204 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:08.422168  5111 raft_consensus.cc:3060] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:08.421964  5204 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:08.371138  5352 raft_consensus.cc:515] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:08.425117  5352 leader_election.cc:290] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:08.426254  5246 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:08.429507  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:08.430964  5266 raft_consensus.cc:3060] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:08.438158  5137 raft_consensus.cc:493] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.438683  5137 raft_consensus.cc:515] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:08.441497  5340 raft_consensus.cc:515] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:08.442718  1570 raft_consensus.cc:1240] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:08.443327  1719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2201) took 1083 ms. Trace:
I20260709 13:00:08.444350  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:08.444629  1724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2195) took 1087 ms. Trace:
I20260709 13:00:08.445039  1724 rpcz_store.cc:276] 0709 13:00:07.357390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:07.357514 (+   124us) service_pool.cc:224] Handling call
0709 13:00:07.357761 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:07.362655 (+  4894us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:00:07.383157 (+ 20502us) log.cc:844] Serialized 14 byte log entry
0709 13:00:07.731588 (+348431us) log.cc:844] Serialized 14 byte log entry
0709 13:00:07.732032 (+   444us) log.cc:844] Serialized 14 byte log entry
0709 13:00:08.388842 (+656810us) spinlock_profiling.cc:243] Waited 4.11 ms on lock 0x7b180047b240. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef248c0a 00007fa9f8988219 00007fa9ef2d0a40 00007fa9ef2cb4e4 00007fa9ef2cb455 00007fa9f23b3060 00007fa9f23c5716 00007fa9f23d6287 00007fa9f23d6208
0709 13:00:08.389003 (+   161us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:08.389056 (+    53us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:08.389115 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:08.389200 (+    85us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:08.444569 (+ 55369us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":679502,"prepare.queue_time_us":54498,"prepare.run_cpu_time_us":158,"prepare.run_wall_time_us":2898,"raft.queue_time_us":759362,"raft.run_cpu_time_us":374,"raft.run_wall_time_us":12634,"spinlock_wait_cycles":9441536,"thread_start_us":347674,"threads_started":2,"wal-append.queue_time_us":234861}
I20260709 13:00:08.289671  5362 consensus_queue.cc:1048] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.088s
W20260709 13:00:08.389868  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 668608us
I20260709 13:00:08.449864  1689 leader_election.cc:304] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:08.391754  5357 raft_consensus.cc:493] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:08.391999  5200 raft_consensus.cc:2749] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:08.361202  5334 consensus_queue.cc:260] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:08.399447  1723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2194) took 1042 ms. Trace:
I20260709 13:00:08.400180  1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2202) took 1040 ms. Trace:
W20260709 13:00:08.400756  5359 log.cc:927] Time spent T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:00:08.401554  5337 raft_consensus.cc:493] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:08.402158  5201 raft_consensus.cc:493] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
W20260709 13:00:08.403100  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:08.403414  5329 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.404704  5203 raft_consensus.cc:493] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.478119  1689 leader_election.cc:304] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:08.478492  5203 raft_consensus.cc:515] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:08.406730  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:08.314869  5131 consensus_queue.cc:260] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:08.411454  5092 consensus_queue.cc:260] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:08.480477  1689 leader_election.cc:304] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:08.461227  1720 rpcz_store.cc:276] 0709 13:00:07.364857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:07.671728 (+306871us) service_pool.cc:224] Handling call
0709 13:00:07.672208 (+   480us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:07.672564 (+   356us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:07.672605 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:07.673241 (+   636us) log.cc:844] Serialized 26 byte log entry
0709 13:00:07.839834 (+166593us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:07.876255 (+ 36421us) log.cc:844] Serialized 14 byte log entry
0709 13:00:08.399908 (+523653us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:08.399973 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:08.400011 (+    38us) raft_consensus.cc:1685] finished
0709 13:00:08.400024 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:08.400131 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":523382,"prepare.queue_time_us":24786,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":526103,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":75,"thread_start_us":165693,"threads_started":1,"wal-append.queue_time_us":256390}
I20260709 13:00:08.443672  1719 rpcz_store.cc:276] 0709 13:00:07.359698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:07.533682 (+173984us) service_pool.cc:224] Handling call
0709 13:00:07.551171 (+ 17489us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:07.582696 (+ 31525us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:00:07.618421 (+ 35725us) log.cc:844] Serialized 14 byte log entry
0709 13:00:08.396986 (+778565us) log.cc:844] Serialized 14 byte log entry
0709 13:00:08.397205 (+   219us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:08.398366 (+  1161us) log.cc:844] Serialized 564 byte log entry
0709 13:00:08.441813 (+ 43447us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:08.441850 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:08.442970 (+  1120us) spinlock_profiling.cc:243] Waited 31.1 ms on lock 0x7b54000cdad4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:08.443010 (+    40us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:08.443136 (+   126us) raft_consensus.cc:1685] finished
0709 13:00:08.443149 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:08.443276 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":632486,"prepare.queue_time_us":37262,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":103,"raft.queue_time_us":606320,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":234,"spinlock_wait_cycles":71505792,"thread_start_us":172811,"threads_started":1,"wal-append.queue_time_us":269509}
I20260709 13:00:08.449015  2295 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:08.455960  1721 raft_consensus.cc:515] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:08.467854  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:08.459909  1723 rpcz_store.cc:276] 0709 13:00:07.356941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:07.357068 (+   127us) service_pool.cc:224] Handling call
0709 13:00:07.357461 (+   393us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:07.512035 (+154574us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:07.512077 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:07.512736 (+   659us) log.cc:844] Serialized 52 byte log entry
0709 13:00:07.785204 (+272468us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:07.830367 (+ 45163us) log.cc:844] Serialized 14 byte log entry
0709 13:00:08.398992 (+568625us) log.cc:844] Serialized 14 byte log entry
0709 13:00:08.399159 (+   167us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:08.399225 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:08.399260 (+    35us) raft_consensus.cc:1685] finished
0709 13:00:08.399271 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:08.399393 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":567565,"prepare.queue_time_us":35164,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":99,"raft.queue_time_us":579700,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":7059,"thread_start_us":361593,"threads_started":2,"wal-append.queue_time_us":348645}
I20260709 13:00:08.296315  5269 consensus_queue.cc:260] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:08.475430  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:08.474623  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:08.475391  5337 raft_consensus.cc:515] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:08.408238  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:08.368996  4890 raft_consensus.cc:515] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:08.365161  5011 raft_consensus.cc:515] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:08.379761  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:08.487088  1718 raft_consensus.cc:1240] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:08.490320  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:08.491946  1722 raft_consensus.cc:2410] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:00:08.480738  5203 leader_election.cc:290] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:08.493352  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:08.495707  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:08.510589  2295 leader_election.cc:304] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:08.511014  1725 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 8.
I20260709 13:00:08.501540  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:08.498710  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:08.498935  1646 raft_consensus.cc:1275] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:00:08.460976  5186 raft_consensus.cc:2749] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:08.509384  1649 raft_consensus.cc:2468] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 5.
I20260709 13:00:08.469193  5279 raft_consensus.cc:493] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:08.523532  1721 leader_election.cc:290] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:08.482051  5137 leader_election.cc:290] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:08.541893  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:08.481024  5302 raft_consensus.cc:2749] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:08.493165  5173 raft_consensus.cc:2749] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:08.526082  1648 raft_consensus.cc:1240] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:08.539600  1576 raft_consensus.cc:2468] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 10.
I20260709 13:00:08.482409  5334 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:08.493906  5200 raft_consensus.cc:2749] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:08.526578  5349 raft_consensus.cc:2749] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:08.562815  2297 leader_election.cc:304] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:08.471181  5278 raft_consensus.cc:515] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:08.469326  5357 raft_consensus.cc:515] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:08.490381  5361 consensus_queue.cc:1059] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
W20260709 13:00:08.580780  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 100405us
I20260709 13:00:08.581640  1689 leader_election.cc:304] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:08.546638  5092 raft_consensus.cc:3060] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:08.489583  5329 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:08.599100  1572 raft_consensus.cc:1240] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:08.588954  2295 leader_election.cc:304] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:08.508731  5201 raft_consensus.cc:515] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:08.601912  1717 raft_consensus.cc:3060] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:08.525758  5281 consensus_queue.cc:1059] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:00:08.605821  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:08.566931  5111 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:08.608654  1570 raft_consensus.cc:1275] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:00:08.546401  5280 consensus_queue.cc:1059] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260709 13:00:08.594120  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:08.606746  1567 raft_consensus.cc:2468] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 5.
W20260709 13:00:08.615924  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 75734.2us
I20260709 13:00:08.627993  1717 raft_consensus.cc:2468] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 9.
I20260709 13:00:08.582981  4882 raft_consensus.cc:2749] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:00:08.641625  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 60057us
I20260709 13:00:08.642830  1689 leader_election.cc:304] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:08.597458  5269 raft_consensus.cc:3060] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:08.563323  5279 raft_consensus.cc:515] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:08.604779  5286 raft_consensus.cc:3055] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:00:08.652320  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:08.649085  5280 consensus_queue.cc:1059] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:00:08.615459  5302 raft_consensus.cc:2749] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:08.629802  5186 raft_consensus.cc:493] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
W20260709 13:00:08.655957  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 45944.7us
W20260709 13:00:08.656436  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 67594.6us
I20260709 13:00:08.598007  4981 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:08.660729  2295 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:08.647421  5203 raft_consensus.cc:2749] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:08.651213  5286 raft_consensus.cc:740] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:08.652606  5295 raft_consensus.cc:3055] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:08.666040  2332 raft_consensus.cc:1240] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:08.645340  5330 consensus_queue.cc:1059] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 13:00:08.643035  5111 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:08.690129  5367 consensus_queue.cc:1048] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.177s
W20260709 13:00:08.671890  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:08.673039  1689 leader_election.cc:304] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:08.659984  5204 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:08.693724  1689 leader_election.cc:304] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:08.678048  5279 leader_election.cc:290] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:08.694837  1689 leader_election.cc:304] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:00:08.678758  5368 log.cc:927] Time spent T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
W20260709 13:00:08.679080  1617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:08.696039  5216 raft_consensus.cc:2749] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:08.696277  4981 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:08.696780  5216 raft_consensus.cc:2749] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:08.697609  5297 raft_consensus.cc:493] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.698182  5297 raft_consensus.cc:515] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:08.685452  5337 leader_election.cc:290] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:08.687613  2297 leader_election.cc:304] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:08.700244  2297 leader_election.cc:304] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:08.701027  5173 raft_consensus.cc:2749] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:08.701391  5353 raft_consensus.cc:2749] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:08.701761  2297 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:08.702169  5327 raft_consensus.cc:2749] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:08.702950  5313 raft_consensus.cc:2804] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:08.703351  5313 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:08.703770  5313 raft_consensus.cc:3060] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:08.706499  5280 raft_consensus.cc:3055] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:08.707005  5280 raft_consensus.cc:740] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:08.707158  1615 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:08.708055  5169 raft_consensus.cc:2749] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:08.708794  5169 raft_consensus.cc:3055] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:08.709177  5169 raft_consensus.cc:740] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:08.710004  1615 leader_election.cc:304] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:08.710021  5169 consensus_queue.cc:260] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:08.711575  5169 raft_consensus.cc:3060] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:08.712721  5298 raft_consensus.cc:2804] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:08.713172  5298 raft_consensus.cc:493] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:08.713559  5298 raft_consensus.cc:3060] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:08.712422  5303 consensus_queue.cc:1048] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:00:08.715675  1689 leader_election.cc:304] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:00:08.717494  1617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:08.690121  5201 leader_election.cc:290] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:08.707940  5280 consensus_queue.cc:260] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 13:00:08.718176  5279 consensus_queue.cc:1059] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:08.719087  5279 raft_consensus.cc:3055] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:08.719601  5279 raft_consensus.cc:740] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:08.669195  5267 raft_consensus.cc:2804] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:08.667343  5310 consensus_queue.cc:1048] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.068s
I20260709 13:00:08.720516  5279 consensus_queue.cc:260] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:08.663904  5209 consensus_queue.cc:1059] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:00:08.737918  5279 raft_consensus.cc:3060] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:08.738190  5209 raft_consensus.cc:3055] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:08.738864  5209 raft_consensus.cc:740] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:08.670317  5295 raft_consensus.cc:740] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:08.744002  5295 consensus_queue.cc:260] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:08.688952  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:08.695580  5296 raft_consensus.cc:2749] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:08.689328  5277 consensus_queue.cc:1059] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:00:08.749337  1688 leader_election.cc:304] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
W20260709 13:00:08.749605  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:08.751515  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:08.752144  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:08.752262  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:08.753331  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:08.754434  1650 raft_consensus.cc:1275] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:00:08.719139  5280 raft_consensus.cc:3060] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:08.754840  1650 pending_rounds.cc:85] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e: Aborting all ops after (but not including) 5
I20260709 13:00:08.757462  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:08.761190  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:08.771353  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:08.762696  1650 pending_rounds.cc:107] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:00:08.774061  1650 raft_consensus.cc:2889] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:08.730170  5286 consensus_queue.cc:260] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:08.778263  5286 raft_consensus.cc:3060] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:08.777593  1571 raft_consensus.cc:2955] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 2 to 6, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:00:08.779953  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:08.784788  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:08.793593  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:08.757242  5337 raft_consensus.cc:2804] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:08.796036  1647 raft_consensus.cc:2410] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:00:08.730839  5340 leader_election.cc:290] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:08.731304  5302 raft_consensus.cc:2749] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:08.795172  5337 raft_consensus.cc:493] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:08.754560  5204 raft_consensus.cc:493] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.740051  5209 consensus_queue.cc:260] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:08.802225  5337 raft_consensus.cc:3060] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:08.802985  5209 raft_consensus.cc:3060] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:08.723362  5111 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:08.801494  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:08.802141  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:08.757087  5267 raft_consensus.cc:697] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:08.666348  5186 raft_consensus.cc:515] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:08.797245  1646 raft_consensus.cc:2393] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 10: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:08.805895  1575 raft_consensus.cc:1240] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:00:08.811228  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:08.811455  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:08.813723  2294 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:08.725056  5375 consensus_queue.cc:1048] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 13:00:08.779112  4890 leader_election.cc:290] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:08.822924  1649 raft_consensus.cc:3060] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:08.827319  1724 raft_consensus.cc:1240] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:00:08.827544  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:08.827979  1723 raft_consensus.cc:1240] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:08.826309  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:08.828428  1722 raft_consensus.cc:2468] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 9.
I20260709 13:00:08.828680  1725 raft_consensus.cc:2468] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 10.
I20260709 13:00:08.829609  1723 raft_consensus.cc:1240] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:08.829873  5302 raft_consensus.cc:493] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:08.830515  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:08.830389  5302 raft_consensus.cc:515] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:08.831135  1720 raft_consensus.cc:2468] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6.
I20260709 13:00:08.834425  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:08.836633  1723 raft_consensus.cc:1240] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 9. Current term is 10. Ops: [7.4-9.5]
I20260709 13:00:08.838083  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:08.838500  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:08.839207  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:08.842406  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:08.842949  2329 raft_consensus.cc:3055] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:08.843293  2329 raft_consensus.cc:740] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:08.844492  2326 raft_consensus.cc:2468] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 10.
I20260709 13:00:08.845463  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:08.845943  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:08.846128  1720 raft_consensus.cc:3060] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:08.846256  1722 raft_consensus.cc:1275] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:00:08.847153  1718 raft_consensus.cc:1275] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:00:08.843961  2329 consensus_queue.cc:260] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:08.798776  5364 consensus_queue.cc:1048] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:00:08.855508  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:08.857160  2329 raft_consensus.cc:3060] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:08.858278  1689 leader_election.cc:304] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:08.860613  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:08.837044  4882 raft_consensus.cc:2749] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:08.836894  5216 raft_consensus.cc:493] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:08.864948  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:08.869787  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:08.862133  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:08.881767  1724 raft_consensus.cc:3060] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:08.845214  5357 leader_election.cc:290] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:08.884831  1617 leader_election.cc:304] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 13:00:08.886947  1722 raft_consensus.cc:1275] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:00:08.819695  5204 raft_consensus.cc:515] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:08.859486  5302 leader_election.cc:290] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:08.860716  5296 raft_consensus.cc:2749] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:08.898679  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:08.908495  1721 raft_consensus.cc:2468] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8.
I20260709 13:00:08.837181  4770 consensus_queue.cc:1048] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:00:08.900496  1617 leader_election.cc:304] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:08.860671  5329 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:00:08.904768  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 397297us
I20260709 13:00:08.910118  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:08.915406  1718 raft_consensus.cc:3060] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:08.918087  1542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:08.925014  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:08.928385  1542 leader_election.cc:304] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:08.938100  1617 leader_election.cc:304] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:08.947067  1724 raft_consensus.cc:2468] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8.
I20260709 13:00:08.948695  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:08.907300  5330 raft_consensus.cc:2804] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:08.945254  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:08.953944  1575 raft_consensus.cc:2410] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:00:08.954171  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:00:08.943040  5384 log.cc:927] Time spent T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.139s	user 0.000s	sys 0.002s
I20260709 13:00:08.958957  2329 raft_consensus.cc:2468] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 7.
I20260709 13:00:08.951284  1542 leader_election.cc:304] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:08.891202  5216 raft_consensus.cc:515] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:08.955657  1617 leader_election.cc:304] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:08.950596  1649 raft_consensus.cc:2468] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 7.
I20260709 13:00:08.949622  5082 raft_consensus.cc:2804] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:00:09.006677  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 51112.6us
I20260709 13:00:08.962114  5137 consensus_queue.cc:1048] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:00:08.962399  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:08.963121  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:08.954859  5330 raft_consensus.cc:493] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:08.974818  5342 consensus_queue.cc:1048] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:00:08.977609  5173 consensus_queue.cc:1059] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:08.982334  5298 raft_consensus.cc:515] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:08.987977  5204 leader_election.cc:290] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:08.988873  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:08.989136  5337 raft_consensus.cc:515] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:08.990566  1719 raft_consensus.cc:1240] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:08.976114  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:09.027231  1717 raft_consensus.cc:2393] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 9: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:08.950711  5249 raft_consensus.cc:2804] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:08.996491  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:08.997957  5313 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:08.946583  4890 raft_consensus.cc:2804] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:08.892571  5267 consensus_queue.cc:237] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:09.000681  1720 raft_consensus.cc:2468] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 8.
I20260709 13:00:09.021240  5330 raft_consensus.cc:3060] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:09.002074  1718 raft_consensus.cc:2468] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 9.
I20260709 13:00:09.039553  1725 raft_consensus.cc:2393] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 6: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:09.040129  1718 raft_consensus.cc:1275] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
W20260709 13:00:09.004781  5339 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.026s	user 0.014s	sys 0.018s
I20260709 13:00:09.006039  5082 raft_consensus.cc:493] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:09.012817  1723 raft_consensus.cc:3060] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:09.012848  5278 leader_election.cc:290] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:09.013115  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:09.014015  5216 leader_election.cc:290] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:09.015018  1575 raft_consensus.cc:2468] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 5.
I20260709 13:00:09.058601  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:09.014909  5169 raft_consensus.cc:493] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.009384  5286 raft_consensus.cc:2804] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:09.031965  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:09.015892  5280 raft_consensus.cc:2749] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:00:09.001396  1615 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:09.038030  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:00:09.003271  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 52066.3us
I20260709 13:00:09.042131  1718 raft_consensus.cc:1275] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:09.061877  1717 raft_consensus.cc:2955] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index 2 to 6, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:00:09.042464  1574 raft_consensus.cc:2468] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 5.
I20260709 13:00:09.043339  1720 raft_consensus.cc:1275] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:00:09.056221  5313 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:09.047870  1724 raft_consensus.cc:2468] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 9.
W20260709 13:00:09.044998  5339 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.067s	user 0.014s	sys 0.018s
I20260709 13:00:09.075060  5339 raft_consensus.cc:697] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:09.075807  5337 leader_election.cc:290] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:09.076510  1723 raft_consensus.cc:2468] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 10.
I20260709 13:00:09.046236  5082 raft_consensus.cc:3060] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:09.045589  5131 raft_consensus.cc:3060] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:09.030995  5249 raft_consensus.cc:493] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:09.073856  1542 leader_election.cc:304] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:09.044198  4890 raft_consensus.cc:697] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:09.094472  1542 leader_election.cc:304] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:09.106513  1542 leader_election.cc:304] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:09.067051  5286 raft_consensus.cc:697] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:09.109112  1542 leader_election.cc:304] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:09.076061  5339 consensus_queue.cc:237] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:09.060492  5169 raft_consensus.cc:515] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:09.096315  5249 raft_consensus.cc:3060] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:09.112149  5279 consensus_queue.cc:1048] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:00:09.120995  4890 consensus_queue.cc:237] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:09.115424  5357 raft_consensus.cc:2804] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:09.123029  5357 raft_consensus.cc:697] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:09.123901  5357 consensus_queue.cc:237] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:09.125664  5358 log.cc:927] Time spent T 00000000000000000000000000000000 P fcfaa17e55ae48e194c5d95ca24a659f: Append to log took a long time: real 1.151s	user 0.006s	sys 0.001s
I20260709 13:00:09.125584  5286 consensus_queue.cc:237] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:09.126324  5169 leader_election.cc:290] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:09.112361  5269 raft_consensus.cc:2804] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:09.113370  1542 leader_election.cc:304] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:09.102310  5278 raft_consensus.cc:2804] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:09.116310  1575 raft_consensus.cc:1240] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:09.128331  1717 raft_consensus.cc:1240] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:09.129145  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:09.132884  1724 raft_consensus.cc:2468] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 9.
I20260709 13:00:09.133185  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:09.133762  1721 raft_consensus.cc:2376] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8. Re-sending same reply.
I20260709 13:00:09.108577  5394 raft_consensus.cc:2749] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:09.133749  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:09.135679  1724 raft_consensus.cc:2376] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6. Re-sending same reply.
I20260709 13:00:09.136965  5115 raft_consensus.cc:2749] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:09.130293  5269 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:09.136898  5278 raft_consensus.cc:697] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:09.152936  5269 raft_consensus.cc:3060] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:09.157370  5278 consensus_queue.cc:237] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:09.152202  5281 consensus_queue.cc:1059] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:00:09.166503  5269 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:09.167061  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45148 (request call id 2195) took 1027 ms. Trace:
I20260709 13:00:09.167659  1647 rpcz_store.cc:276] 0709 13:00:08.139868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:08.140023 (+   155us) service_pool.cc:224] Handling call
0709 13:00:09.166764 (+1026741us) spinlock_profiling.cc:243] Waited 655 ms on lock 0x7b5400175cd4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:09.166953 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1505433472}
I20260709 13:00:09.173648  5269 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:09.181203  5355 raft_consensus.cc:3055] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:09.181730  5355 raft_consensus.cc:740] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:09.182876  5355 consensus_queue.cc:260] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:09.184335  5355 raft_consensus.cc:3060] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:09.195084  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:09.195942  1716 raft_consensus.cc:3060] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:09.241117  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:09.253829  1716 raft_consensus.cc:2468] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 9.
W20260709 13:00:09.268388  2295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:09.249022  5297 leader_election.cc:290] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:09.281718  5216 raft_consensus.cc:493] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:09.284170  5330 raft_consensus.cc:515] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:09.328979  5274 raft_consensus.cc:3055] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:09.329495  5274 raft_consensus.cc:740] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:09.329192  5082 raft_consensus.cc:515] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:09.330466  5274 consensus_queue.cc:260] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:09.333027  1645 raft_consensus.cc:1240] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:00:09.334091  2327 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67"
dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
mode: GRACEFUL
new_leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:39778
I20260709 13:00:09.334661  2327 raft_consensus.cc:606] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 LEADER]: Received request to transfer leadership to TS 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:09.335381  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:09.342497  2329 raft_consensus.cc:1275] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:09.347983  5011 leader_election.cc:290] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:09.349478  5204 raft_consensus.cc:3055] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:09.350004  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:09.350929  1725 raft_consensus.cc:2393] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 8: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:09.350011  5204 raft_consensus.cc:740] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:09.352319  5267 raft_consensus.cc:993] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66: : Instructing follower 89ac9d5e2fbc4536b03a1ff1dd3eb226 to start an election
I20260709 13:00:09.352921  5267 raft_consensus.cc:1081] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 LEADER]: Signalling peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 to start an election
I20260709 13:00:09.352415  5204 consensus_queue.cc:260] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:09.354972  1575 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67"
dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:37682
I20260709 13:00:09.355499  1575 raft_consensus.cc:493] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:09.355844  1575 raft_consensus.cc:3060] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:09.363983  5388 log.cc:927] Time spent T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.462s	user 0.008s	sys 0.008s
I20260709 13:00:09.364820  1615 leader_election.cc:304] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:09.365936  5297 raft_consensus.cc:2804] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:00:09.366185  2294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:09.365978  5249 raft_consensus.cc:515] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:09.366557  5297 raft_consensus.cc:697] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 10 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:09.366647  5186 leader_election.cc:290] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:09.367519  5297 consensus_queue.cc:237] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:09.368132  5249 leader_election.cc:290] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:09.373109  1542 leader_election.cc:304] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:09.374552  1542 leader_election.cc:304] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:09.375696  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:09.376297  1720 raft_consensus.cc:2468] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 7.
I20260709 13:00:09.378834  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:09.379367  1722 raft_consensus.cc:3060] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:09.314245  5216 raft_consensus.cc:515] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:09.383411  1689 leader_election.cc:304] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:09.376513  1542 leader_election.cc:304] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:09.384382  1646 raft_consensus.cc:1240] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:09.391896  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:09.392766  1646 raft_consensus.cc:2468] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8.
I20260709 13:00:09.396092  1539 leader_election.cc:304] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:09.386523  1689 leader_election.cc:304] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 13:00:09.399657  1722 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 9.
I20260709 13:00:09.395077  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:09.393025  5186 raft_consensus.cc:2749] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:09.402304  5082 leader_election.cc:290] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:09.405315  1542 leader_election.cc:304] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:09.380795  5362 raft_consensus.cc:3060] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:09.380797  5011 raft_consensus.cc:2804] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:09.409765  2297 leader_election.cc:304] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:09.408452  1575 raft_consensus.cc:515] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:09.387499  5266 raft_consensus.cc:493] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.421043  1542 leader_election.cc:304] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:09.423488  1575 leader_election.cc:290] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:09.425323  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:09.382930  5381 consensus_queue.cc:1048] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:00:09.402982  5115 raft_consensus.cc:2749] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:09.418905  5216 leader_election.cc:290] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:09.383097  5367 consensus_queue.cc:1048] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:00:09.406564  5296 raft_consensus.cc:493] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.449169  5296 raft_consensus.cc:515] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:09.451340  1617 leader_election.cc:304] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:09.452407  5137 raft_consensus.cc:2804] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:09.426539  5340 raft_consensus.cc:2804] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:09.452996  5137 raft_consensus.cc:697] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 8 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:09.438784  2332 raft_consensus.cc:2468] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 7.
I20260709 13:00:09.406844  5200 raft_consensus.cc:2804] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:09.456622  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:09.448010  5279 raft_consensus.cc:2804] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:09.455983  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:09.456159  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:09.461491  1723 raft_consensus.cc:2468] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 8.
I20260709 13:00:09.422454  5378 raft_consensus.cc:2804] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:09.426931  5330 leader_election.cc:290] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:09.460101  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:09.471010  1716 raft_consensus.cc:3060] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:09.408233  5269 consensus_queue.cc:1059] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 13:00:09.422559  5313 raft_consensus.cc:2804] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:09.425201  5011 raft_consensus.cc:697] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:09.442512  2297 leader_election.cc:304] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:09.472440  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:09.473326  1573 raft_consensus.cc:1240] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:09.474483  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:09.476052  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:09.453291  5340 raft_consensus.cc:493] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:09.417987  5375 consensus_queue.cc:1059] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:00:09.475546  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:09.460852  5298 leader_election.cc:290] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:09.469856  1617 leader_election.cc:304] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
W20260709 13:00:09.489447  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 47017.1us
I20260709 13:00:09.451334  5296 leader_election.cc:290] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:09.426476  5266 raft_consensus.cc:515] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:09.485855  1722 raft_consensus.cc:2468] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 9.
I20260709 13:00:09.470902  5200 raft_consensus.cc:697] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 7 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:09.478205  5279 raft_consensus.cc:697] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:09.471201  5378 raft_consensus.cc:493] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:09.503774  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:09.502463  5340 raft_consensus.cc:3060] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:09.504359  4920 raft_consensus.cc:2804] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:09.501343  5313 raft_consensus.cc:697] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:09.514168  1617 leader_election.cc:304] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:09.538914  1617 leader_election.cc:304] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:09.539858  1617 leader_election.cc:304] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:09.540748  1716 raft_consensus.cc:2468] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 11.
I20260709 13:00:09.543972  2329 raft_consensus.cc:1240] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
W20260709 13:00:09.544292  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 123297us
I20260709 13:00:09.543005  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:09.512827  5330 raft_consensus.cc:2804] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:09.546627  1617 leader_election.cc:304] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:09.547191  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:09.551779  1716 raft_consensus.cc:2393] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 6: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:09.501648  5381 consensus_queue.cc:1059] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 13:00:09.504024  5394 consensus_queue.cc:1048] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:00:09.531216  4920 raft_consensus.cc:493] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:09.528683  5378 raft_consensus.cc:3060] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:09.564124  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: true dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:09.566155  2329 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386"
dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
mode: GRACEFUL
new_leader_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:39778
I20260709 13:00:09.566967  2329 raft_consensus.cc:606] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 LEADER]: Received request to transfer leadership to TS 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:09.548378  5301 raft_consensus.cc:2804] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:09.549635  5298 raft_consensus.cc:2804] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:09.549985  5330 raft_consensus.cc:493] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:09.553115  5082 raft_consensus.cc:2804] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:00:09.574035  1615 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:09.574739  5406 log.cc:927] Time spent T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:00:09.574882  5279 consensus_queue.cc:237] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 13:00:09.577709  5274 raft_consensus.cc:3060] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:09.557041  5131 raft_consensus.cc:2804] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:09.581950  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
W20260709 13:00:09.591636  1615 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:09.592239  2329 raft_consensus.cc:2393] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 9: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 13:00:09.564505  1542 leader_election.cc:304] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:09.565841  4920 raft_consensus.cc:3060] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:09.550478  4890 consensus_queue.cc:1048] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:00:09.580241  5362 raft_consensus.cc:2749] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:09.528463  5137 consensus_queue.cc:237] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:09.570902  5298 raft_consensus.cc:493] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:09.629906  2329 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757"
dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
mode: GRACEFUL
new_leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:39778
W20260709 13:00:09.631186  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 66772.6us
I20260709 13:00:09.587684  5301 raft_consensus.cc:697] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 10 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:09.676890  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:09.642299  5357 raft_consensus.cc:2804] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:09.643805  1571 raft_consensus.cc:1240] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 LEADER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:09.647804  1688 leader_election.cc:304] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:09.651175  2294 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:09.616824  5131 raft_consensus.cc:697] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 11 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:09.673722  2329 raft_consensus.cc:606] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 LEADER]: Received request to transfer leadership to TS 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:09.653146  5295 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:09.654654  5375 raft_consensus.cc:3055] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:09.655612  5269 raft_consensus.cc:3055] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:09.698627  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:09.655500  1540 leader_election.cc:304] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:09.656477  2326 raft_consensus.cc:3055] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:09.700645  2326 raft_consensus.cc:740] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:09.676630  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:09.701900  1573 raft_consensus.cc:2468] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 10.
I20260709 13:00:09.677929  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:09.678706  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: true dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:09.703909  1718 raft_consensus.cc:3060] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:09.571257  5330 raft_consensus.cc:3060] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:09.682128  1716 raft_consensus.cc:1240] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:00:09.683696  1723 raft_consensus.cc:1240] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:00:09.688292  1688 leader_election.cc:304] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:09.691284  1572 raft_consensus.cc:2468] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 9.
I20260709 13:00:09.571141  5286 consensus_queue.cc:1059] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.100s
I20260709 13:00:09.697747  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:00:09.720671  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 65302.4us
I20260709 13:00:09.723172  5379 raft_consensus.cc:2804] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:09.723673  5379 raft_consensus.cc:697] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:09.724946  1689 leader_election.cc:304] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:09.698531  5269 raft_consensus.cc:740] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:09.727173  5269 consensus_queue.cc:260] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:09.589124  5200 consensus_queue.cc:237] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:09.728696  1688 leader_election.cc:304] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:09.713994  2326 consensus_queue.cc:260] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:09.694562  5216 raft_consensus.cc:2749] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:09.570564  5011 consensus_queue.cc:237] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:09.685871  5298 raft_consensus.cc:3060] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:09.697952  5281 raft_consensus.cc:2749] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:09.749642  1718 raft_consensus.cc:2468] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8.
I20260709 13:00:09.624955  5313 consensus_queue.cc:237] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:09.696940  5375 raft_consensus.cc:740] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:09.709044  5357 raft_consensus.cc:697] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:09.733848  5296 raft_consensus.cc:3060] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:09.733071  5337 raft_consensus.cc:2764] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:00:09.779999  5301 consensus_queue.cc:237] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:09.747344  5186 raft_consensus.cc:2749] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:09.789075  2326 raft_consensus.cc:3060] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:09.794912  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:09.804442  2326 raft_consensus.cc:2468] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8.
I20260709 13:00:09.806316  1540 leader_election.cc:304] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:09.808161  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:00:09.809090  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 215448us
I20260709 13:00:09.809860  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:09.810765  1646 raft_consensus.cc:2393] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 6: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:09.810286  1615 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:09.776857  5216 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:09.789224  5280 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:09.796453  5411 log.cc:927] Time spent T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.233s	user 0.001s	sys 0.000s
I20260709 13:00:09.828018  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:09.829170  1647 raft_consensus.cc:2393] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 5: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:09.732793  5379 consensus_queue.cc:237] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:09.815388  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:09.801362  5082 raft_consensus.cc:697] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 9 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:09.778218  5415 consensus_queue.cc:1059] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:00:09.859671  1568 raft_consensus.cc:3060] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:09.862977  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:09.839658  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:09.878127  5423 raft_consensus.cc:2749] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:09.879724  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:09.814556  5249 raft_consensus.cc:493] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
W20260709 13:00:09.853271  5414 log.cc:927] Time spent T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 13:00:09.850023  5413 log.cc:927] Time spent T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.221s	user 0.000s	sys 0.001s
W20260709 13:00:09.908730  5385 log.cc:927] Time spent T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:00:09.868801  5357 consensus_queue.cc:237] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:09.827294  5216 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:09.850638  5381 raft_consensus.cc:2804] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:09.913172  5381 raft_consensus.cc:697] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:09.914511  5381 consensus_queue.cc:237] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:09.917222  1574 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36640 (request call id 2139) took 1656 ms (client timeout 1979 ms). Trace:
W20260709 13:00:09.917812  1574 rpcz_store.cc:269] 0709 13:00:08.284029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:08.292810 (+  8781us) service_pool.cc:224] Handling call
0709 13:00:09.916954 (+1624144us) spinlock_profiling.cc:243] Waited 655 ms on lock 0x7b54000aafd4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:09.917111 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1507184384}
I20260709 13:00:09.782191  5131 consensus_queue.cc:237] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:09.872690  1642 raft_consensus.cc:2468] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 8.
W20260709 13:00:10.012346  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 78769.6us
I20260709 13:00:10.008140  5216 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:09.871071  5280 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:09.857105  4920 raft_consensus.cc:515] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:10.060788  1568 raft_consensus.cc:2468] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6.
W20260709 13:00:10.104290  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 282871us
I20260709 13:00:09.825539  5375 consensus_queue.cc:260] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:10.011657  5249 raft_consensus.cc:515] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:10.116695  2331 raft_consensus.cc:1240] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 13:00:10.125711  5417 log.cc:927] Time spent T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:00:10.127843  4920 leader_election.cc:290] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:10.133888  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:10.137333  5342 raft_consensus.cc:493] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.137910  5274 raft_consensus.cc:493] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.137832  5342 raft_consensus.cc:515] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:10.138409  5274 raft_consensus.cc:515] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:10.140094  5342 leader_election.cc:290] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:10.051815  5362 consensus_queue.cc:1059] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 13:00:10.148770  5375 raft_consensus.cc:3060] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:10.174392  5378 consensus_meta.cc:287] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.603s	user 0.002s	sys 0.009s
I20260709 13:00:10.174978  5378 raft_consensus.cc:515] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:10.175977  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 70467.1us
I20260709 13:00:10.177992  5269 raft_consensus.cc:3060] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:10.178777  5364 raft_consensus.cc:493] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:10.179272  5364 raft_consensus.cc:515] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:10.183158  2329 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c998894dcb744ba3825db19244f8207e"
dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
mode: GRACEFUL
new_leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:39778
I20260709 13:00:10.183966  2329 raft_consensus.cc:606] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 LEADER]: Received request to transfer leadership to TS 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:10.140483  5274 leader_election.cc:290] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:10.145660  5280 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:10.150910  5249 leader_election.cc:290] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:10.199680  1542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:10.200304  1542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:10.191183  5298 raft_consensus.cc:515] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:10.112691  5082 consensus_queue.cc:237] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:10.210289  5137 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:10.209000  1615 leader_election.cc:304] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:10.214087  2329 raft_consensus.cc:1240] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:00:10.218698  1615 leader_election.cc:304] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:10.203428  5415 raft_consensus.cc:493] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.228921  1615 leader_election.cc:304] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:10.236984  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:10.214864  5367 raft_consensus.cc:3055] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:10.213999  5378 leader_election.cc:290] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:10.247995  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:10.256415  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:10.255807  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:10.255059  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:10.255713  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:10.257097  1724 raft_consensus.cc:1240] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:10.275482  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:10.288583  1718 raft_consensus.cc:2468] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 8.
I20260709 13:00:10.223145  5420 raft_consensus.cc:2749] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:10.275651  1725 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 10.
I20260709 13:00:10.296777  5298 leader_election.cc:290] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:10.246037  5430 raft_consensus.cc:2804] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:10.297899  5430 raft_consensus.cc:697] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 5 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:10.299212  1646 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c"
dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
mode: GRACEFUL
new_leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:35470
I20260709 13:00:10.299055  5430 consensus_queue.cc:237] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:10.299824  1646 raft_consensus.cc:606] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 9 LEADER]: Received request to transfer leadership to TS 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:10.229522  5301 consensus_queue.cc:1059] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
W20260709 13:00:10.301539  5438 log.cc:927] Time spent T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:00:10.339174  1725 raft_consensus.cc:1240] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:00:10.287214  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:10.287752  1720 raft_consensus.cc:2468] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 9.
I20260709 13:00:10.233862  5415 raft_consensus.cc:515] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:10.279770  5364 leader_election.cc:290] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:10.302148  1718 raft_consensus.cc:1275] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:00:10.305637  5340 consensus_meta.cc:287] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.762s	user 0.011s	sys 0.000s
I20260709 13:00:10.279280  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:10.347929  1721 raft_consensus.cc:2393] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 8: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:10.281638  5200 raft_consensus.cc:493] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.301532  5279 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:10.216274  5137 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:10.308807  5330 consensus_meta.cc:287] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.579s	user 0.005s	sys 0.007s
I20260709 13:00:10.309791  4981 raft_consensus.cc:493] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:10.273298  5274 raft_consensus.cc:2804] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:00:10.313791  5296 consensus_meta.cc:287] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.530s	user 0.012s	sys 0.000s
I20260709 13:00:10.314400  5349 raft_consensus.cc:993] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66: : Instructing follower 0c7751452c4b46afa95251b9df7169d4 to start an election
I20260709 13:00:10.402318  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:10.403083  5349 raft_consensus.cc:1081] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 LEADER]: Signalling peer 0c7751452c4b46afa95251b9df7169d4 to start an election
I20260709 13:00:10.368278  5340 raft_consensus.cc:515] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:10.406500  5340 leader_election.cc:290] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:10.371452  5200 raft_consensus.cc:515] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 13:00:10.232348  5339 raft_consensus.cc:493] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.408842  5339 raft_consensus.cc:515] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:10.409970  5200 leader_election.cc:290] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373)
I20260709 13:00:10.410063  5415 leader_election.cc:290] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:10.376345  5279 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:10.411541  5298 consensus_queue.cc:1059] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:10.259405  5367 raft_consensus.cc:740] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:10.412820  5367 consensus_queue.cc:260] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:10.413750  5279 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:10.369688  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:00:10.320719  5295 consensus_meta.cc:287] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.622s	user 0.012s	sys 0.000s
I20260709 13:00:10.375633  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:10.378746  2331 raft_consensus.cc:1275] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:00:10.417052  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:10.411064  5339 leader_election.cc:290] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:00:10.432611  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 154849us
I20260709 13:00:10.413847  5367 raft_consensus.cc:3060] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:10.321849  1724 raft_consensus.cc:1275] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:00:10.286058  1719 raft_consensus.cc:2468] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 10.
I20260709 13:00:10.393602  4981 raft_consensus.cc:515] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:10.415601  5342 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.417922  1718 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386"
dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:58782
I20260709 13:00:10.441432  1718 raft_consensus.cc:493] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:10.441994  1718 raft_consensus.cc:3060] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:10.388924  2294 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:10.435531  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:00:10.443619  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 55172.1us
I20260709 13:00:10.444227  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:10.436712  1717 raft_consensus.cc:1275] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:00:10.446461  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:10.447228  1719 raft_consensus.cc:2468] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8.
I20260709 13:00:10.448997  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:10.449782  1724 raft_consensus.cc:2468] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 9.
I20260709 13:00:10.459616  1688 leader_election.cc:304] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:10.344791  5115 consensus_queue.cc:1059] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.088s
I20260709 13:00:10.460836  5299 raft_consensus.cc:2749] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:10.462057  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:10.463967  5342 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:10.464932  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:10.465838  1648 raft_consensus.cc:2410] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:00:10.466912  5131 raft_consensus.cc:493] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.467561  5131 raft_consensus.cc:515] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 13:00:10.468482  1644 raft_consensus.cc:1275] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:00:10.468950  1725 raft_consensus.cc:1275] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:00:10.469410  1649 raft_consensus.cc:1240] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:10.469689  1643 raft_consensus.cc:1275] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:00:10.472486  1688 leader_election.cc:304] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:10.473270  1645 raft_consensus.cc:1275] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:00:10.473806  1645 pending_rounds.cc:85] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e: Aborting all ops after (but not including) 8
I20260709 13:00:10.474129  1645 pending_rounds.cc:107] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:00:10.474292  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:10.474637  1645 raft_consensus.cc:2889] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:10.401842  5296 raft_consensus.cc:2749] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:10.494001  1688 leader_election.cc:304] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:00:10.495754  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:10.497412  1651 raft_consensus.cc:1275] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:00:10.480091  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:00:10.480187  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 183362us
I20260709 13:00:10.499212  1617 leader_election.cc:304] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:10.503564  1542 leader_election.cc:304] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:10.492879  5269 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:10.509050  5216 raft_consensus.cc:3060] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:10.509290  5269 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:10.509370  1567 raft_consensus.cc:1275] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:10.512351  1688 leader_election.cc:304] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:10.510937  5131 leader_election.cc:290] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373)
I20260709 13:00:10.514942  1723 raft_consensus.cc:1275] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:00:10.515193  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:10.518013  1647 raft_consensus.cc:2468] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 6.
I20260709 13:00:10.385421  5330 raft_consensus.cc:515] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:10.518778  1542 leader_election.cc:304] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 13:00:10.468715  5200 raft_consensus.cc:2749] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:10.530735  1617 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:10.525727  2329 raft_consensus.cc:1275] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:10.521581  1644 raft_consensus.cc:1275] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:00:10.462100  5169 raft_consensus.cc:493] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:10.522188  1718 raft_consensus.cc:515] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:10.532302  1617 leader_election.cc:304] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:10.538264  1721 raft_consensus.cc:1240] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:10.477386  5274 raft_consensus.cc:697] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 6 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:10.535549  1651 raft_consensus.cc:1275] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:00:10.535390  1688 leader_election.cc:304] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:00:10.539265  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 105460us
I20260709 13:00:10.553678  1718 leader_election.cc:290] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:10.515947  5375 raft_consensus.cc:493] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:10.541594  1720 raft_consensus.cc:1275] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:00:10.587193  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 68523us
I20260709 13:00:10.501508  5427 raft_consensus.cc:2749] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:00:10.589512  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 57319.4us
I20260709 13:00:10.600790  1617 leader_election.cc:304] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:10.591746  1615 leader_election.cc:304] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:10.593187  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:10.605697  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:10.606580  1725 raft_consensus.cc:2468] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6.
I20260709 13:00:10.608951  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:10.610035  1718 raft_consensus.cc:3060] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:10.612442  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:10.613094  2329 raft_consensus.cc:3055] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:10.613461  2329 raft_consensus.cc:740] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:10.614440  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:10.539824  5422 raft_consensus.cc:2804] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:10.539439  5357 raft_consensus.cc:2804] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:10.540284  5342 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:10.526396  5340 consensus_queue.cc:1048] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.085s
I20260709 13:00:10.539044  5364 raft_consensus.cc:493] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:10.639420  5364 raft_consensus.cc:515] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:10.529551  5378 consensus_queue.cc:1048] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.091s
I20260709 13:00:10.610472  5375 raft_consensus.cc:515] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:10.641896  5364 leader_election.cc:290] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:10.642614  5274 consensus_queue.cc:237] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:10.643410  5375 leader_election.cc:290] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:10.623210  5427 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:10.592605  5337 consensus_queue.cc:1048] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 13:00:10.644766  5427 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:10.646198  5448 raft_consensus.cc:2804] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:10.646719  5448 raft_consensus.cc:493] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.647125  5448 raft_consensus.cc:3060] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:10.620244  5449 raft_consensus.cc:2804] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:10.649065  5449 raft_consensus.cc:493] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.649420  5449 raft_consensus.cc:3060] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:10.616015  5200 raft_consensus.cc:493] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:10.542739  5169 raft_consensus.cc:515] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:10.652966  5200 raft_consensus.cc:515] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:10.654464  5169 leader_election.cc:290] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:10.655143  5200 leader_election.cc:290] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:10.623479  5357 raft_consensus.cc:493] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.655720  5169 raft_consensus.cc:2749] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:10.656026  5357 raft_consensus.cc:3060] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:10.657461  5330 leader_election.cc:290] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:10.609059  5280 raft_consensus.cc:2804] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:10.658221  5280 raft_consensus.cc:493] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.658634  5280 raft_consensus.cc:3060] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:10.660755  5297 raft_consensus.cc:493] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.661762  5137 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:10.539968  5423 raft_consensus.cc:2804] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:10.663051  5423 raft_consensus.cc:493] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.663508  5423 raft_consensus.cc:3060] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:10.535276  5249 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:10.627763  1542 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:10.535310  5379 consensus_queue.cc:1048] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.090s
I20260709 13:00:10.635108  5429 raft_consensus.cc:2749] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:10.635524  5266 leader_election.cc:290] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:10.636058  5286 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:10.636176  5443 log.cc:927] Time spent T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:00:10.637344  4981 leader_election.cc:290] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:10.638244  5445 raft_consensus.cc:493] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:10.638002  5394 consensus_queue.cc:1048] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:10.661441  5297 raft_consensus.cc:515] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:10.624596  1647 raft_consensus.cc:2368] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 8. Current term is 9.
I20260709 13:00:10.667973  1718 raft_consensus.cc:2468] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 9.
W20260709 13:00:10.676971  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 49344.3us
I20260709 13:00:10.676627  2329 consensus_queue.cc:260] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:10.678097  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:10.624387  5422 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.702589  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:10.719254  1723 raft_consensus.cc:1275] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:00:10.719895  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:10.678936  5115 raft_consensus.cc:2749] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:10.705902  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:10.638027  5420 raft_consensus.cc:3055] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:10.624055  5269 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:10.720813  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:10.672462  5427 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:10.722519  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:10.733945  2327 raft_consensus.cc:2393] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 7: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:10.725091  2329 raft_consensus.cc:3060] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:10.720695  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:10.732121  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:00:10.736177  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 200861us
I20260709 13:00:10.736967  1688 leader_election.cc:304] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:10.708945  5209 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:10.724239  5422 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:10.748615  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:10.753136  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:10.753835  1721 raft_consensus.cc:2468] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7.
I20260709 13:00:10.755515  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:10.756210  1717 raft_consensus.cc:3060] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:10.757493  1617 leader_election.cc:304] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:10.704450  5286 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:10.762255  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:10.728730  5420 raft_consensus.cc:740] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:10.729094  5340 raft_consensus.cc:493] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
W20260709 13:00:10.749019  1542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:10.783355  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:10.784036  1576 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 7.
I20260709 13:00:10.683772  5249 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:10.779868  1688 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:10.785100  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:10.709405  5445 raft_consensus.cc:515] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:10.789985  5340 raft_consensus.cc:515] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:10.793948  1575 raft_consensus.cc:1240] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:10.794539  1688 leader_election.cc:304] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:10.796734  5337 raft_consensus.cc:2749] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:10.796814  5445 leader_election.cc:290] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:10.797428  5445 raft_consensus.cc:493] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.797520  5337 raft_consensus.cc:2804] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:10.797995  5337 raft_consensus.cc:493] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.797909  5445 raft_consensus.cc:515] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:10.798466  5337 raft_consensus.cc:3060] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:10.799988  5445 leader_election.cc:290] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:10.806239  5200 raft_consensus.cc:493] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:10.806824  5200 raft_consensus.cc:515] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:10.735435  4981 consensus_queue.cc:1048] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:00:10.812979  2331 raft_consensus.cc:1240] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260709 13:00:10.820936  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 63521.3us
I20260709 13:00:10.823253  1542 leader_election.cc:304] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:10.788916  5427 raft_consensus.cc:2804] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:10.827273  1617 leader_election.cc:304] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:10.826620  1717 raft_consensus.cc:2468] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 10.
I20260709 13:00:10.830295  2329 raft_consensus.cc:2468] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 7.
I20260709 13:00:10.760151  5209 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:10.832278  1617 leader_election.cc:304] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:10.828392  5427 raft_consensus.cc:493] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:10.851423  1617 leader_election.cc:304] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:10.853430  1723 raft_consensus.cc:1275] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:00:10.825860  5115 raft_consensus.cc:493] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:10.852115  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:10.838544  5279 raft_consensus.cc:2749] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:10.826113  5459 raft_consensus.cc:2804] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:10.848240  5169 raft_consensus.cc:2804] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:10.840320  5432 raft_consensus.cc:2804] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:10.839956  5224 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:10.853442  5427 raft_consensus.cc:3060] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:10.881335  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 120780us
I20260709 13:00:10.830770  5131 consensus_queue.cc:1048] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:00:10.849946  5458 raft_consensus.cc:493] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:10.831604  5394 consensus_queue.cc:1048] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.042s
I20260709 13:00:10.824697  5448 raft_consensus.cc:515] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:10.917900  5448 leader_election.cc:290] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:10.918622  5216 raft_consensus.cc:2749] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:10.887549  5432 raft_consensus.cc:697] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 9 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:10.921083  5432 consensus_queue.cc:237] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:10.927131  5449 raft_consensus.cc:515] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:10.858896  5200 leader_election.cc:290] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:10.853250  5423 raft_consensus.cc:515] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:10.968384  5423 leader_election.cc:290] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:10.891319  5355 consensus_queue.cc:1048] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:10.894747  5281 raft_consensus.cc:993] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66: : Instructing follower 89ac9d5e2fbc4536b03a1ff1dd3eb226 to start an election
I20260709 13:00:10.897397  5297 leader_election.cc:290] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:10.905247  5429 raft_consensus.cc:493] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:10.969643  5429 raft_consensus.cc:515] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:10.972393  1689 leader_election.cc:304] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 13:00:10.871937  5457 raft_consensus.cc:493] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:10.867734  5115 raft_consensus.cc:515] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:10.973213  5457 raft_consensus.cc:515] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:10.973990  5449 leader_election.cc:290] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:10.974627  5216 raft_consensus.cc:2804] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:10.975111  5115 leader_election.cc:290] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:10.975535  5457 leader_election.cc:290] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:10.887948  5224 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:10.972114  5429 leader_election.cc:290] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:10.977726  5224 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:10.878177  5169 raft_consensus.cc:493] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:10.863858  5296 raft_consensus.cc:2749] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:10.978338  5169 raft_consensus.cc:3060] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:10.828327  5461 consensus_queue.cc:1059] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 13:00:10.981109  5281 raft_consensus.cc:993] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66: : Instructing follower 89ac9d5e2fbc4536b03a1ff1dd3eb226 to start an election
I20260709 13:00:10.981252  5355 raft_consensus.cc:1081] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 LEADER]: Signalling peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 to start an election
I20260709 13:00:10.981552  5281 raft_consensus.cc:1081] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 LEADER]: Signalling peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 to start an election
I20260709 13:00:10.982034  5461 raft_consensus.cc:493] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:10.982223  5286 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:10.982810  2294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:10.982689  5461 raft_consensus.cc:515] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:10.984936  5461 leader_election.cc:290] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:10.985523  5309 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:10.986083  5309 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:10.987636  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:10.988572  5204 raft_consensus.cc:3060] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:10.989598  5309 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:10.991792  5357 raft_consensus.cc:515] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:10.994556  5357 leader_election.cc:290] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:10.996003  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:10.997969  5246 raft_consensus.cc:3055] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:10.998394  5246 raft_consensus.cc:740] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:10.999473  5246 consensus_queue.cc:260] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:11.016736  5246 raft_consensus.cc:3060] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:10.937825  5458 raft_consensus.cc:515] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:10.873296  5459 raft_consensus.cc:493] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:11.017203  5269 raft_consensus.cc:3055] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:11.017541  5459 raft_consensus.cc:3060] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:11.017643  5269 raft_consensus.cc:740] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:11.019012  5269 consensus_queue.cc:260] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:11.019418  5458 leader_election.cc:290] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:11.020193  5269 raft_consensus.cc:3060] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:11.025872  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:10.962447  5427 raft_consensus.cc:515] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:10.980217  5420 consensus_queue.cc:260] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:10.957238  5422 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:10.937145  5249 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:10.880079  5137 raft_consensus.cc:2804] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:11.025221  5224 raft_consensus.cc:493] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:10.962000  5280 raft_consensus.cc:515] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:11.029563  5209 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:11.025429  2294 leader_election.cc:304] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:11.028661  5337 raft_consensus.cc:515] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 13:00:11.032773  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:00:11.289286  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 263924us
I20260709 13:00:11.048286  1644 raft_consensus.cc:1275] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:11.047219  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:11.289539  1643 raft_consensus.cc:2393] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 7: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:11.063601  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:11.293807  1647 raft_consensus.cc:3060] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:11.035830  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 201744us
W20260709 13:00:11.295137  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:11.295962  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:11.094676  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:11.205749  2324 raft_consensus.cc:2468] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8.
I20260709 13:00:11.094831  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:11.095970  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:00:11.372968  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:11.374004  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:11.082896  5295 raft_consensus.cc:493] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.277211  5469 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.323159  5281 raft_consensus.cc:493] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.324139  5457 raft_consensus.cc:493] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.355768  5204 raft_consensus.cc:2749] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:11.271091  5418 raft_consensus.cc:493] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:11.181326  5423 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:11.390004  1719 raft_consensus.cc:1240] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:00:11.354194  5458 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:11.393494  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 497915us
I20260709 13:00:11.364949  5137 raft_consensus.cc:697] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 10 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:11.083316  5431 raft_consensus.cc:493] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
W20260709 13:00:11.396363  1615 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.791s	user 0.010s	sys 0.005s
W20260709 13:00:11.405226  1615 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.800s	user 0.010s	sys 0.006s
W20260709 13:00:11.406906  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:11.400369  2295 leader_election.cc:304] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:00:11.410444  1541 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.012s	sys 0.003s
W20260709 13:00:11.412108  1541 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.012s	sys 0.003s
I20260709 13:00:11.127545  5169 raft_consensus.cc:515] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:11.152832  5459 raft_consensus.cc:515] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
W20260709 13:00:11.419663  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 827951us
I20260709 13:00:11.421746  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:11.391155  5295 raft_consensus.cc:515] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:11.365180  5299 consensus_queue.cc:1048] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
W20260709 13:00:11.432742  1617 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.002s	sys 0.010s
W20260709 13:00:11.433210  1617 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.002s	sys 0.010s
I20260709 13:00:11.358355  5224 raft_consensus.cc:515] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:11.413339  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:11.422333  1572 raft_consensus.cc:3060] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:11.439010  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:11.439288  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 13:00:11.411405  1542 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.003s	sys 0.012s
W20260709 13:00:11.441241  1542 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.003s	sys 0.012s
W20260709 13:00:11.441604  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 609051us
I20260709 13:00:11.442821  1689 leader_election.cc:304] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:11.444383  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:11.426730  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:00:11.433532  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 577354us
I20260709 13:00:11.412297  5313 raft_consensus.cc:2749] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:00:11.411710  5274 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.008s	sys 0.008s
I20260709 13:00:11.445937  1722 raft_consensus.cc:1275] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:00:11.446943  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:11.447500  1722 raft_consensus.cc:3060] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:11.448951  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:11.449540  1716 raft_consensus.cc:2468] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
I20260709 13:00:11.418488  5216 raft_consensus.cc:697] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 7 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:11.445152  1573 raft_consensus.cc:2468] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 10.
I20260709 13:00:11.397373  5281 raft_consensus.cc:515] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:11.451159  1721 raft_consensus.cc:1275] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:00:11.456610  1569 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c998894dcb744ba3825db19244f8207e"
dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:37682
I20260709 13:00:11.399711  5457 raft_consensus.cc:515] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:11.456640  1542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:11.401633  5423 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:11.404245  5458 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:11.400481  5418 raft_consensus.cc:515] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:11.395519  5469 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:11.463091  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:11.510144  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:11.708959  1721 raft_consensus.cc:3060] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:11.702111  1722 raft_consensus.cc:2468] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 11.
I20260709 13:00:11.709961  2295 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:11.710155  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:11.710395  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:11.493775  1572 raft_consensus.cc:2468] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 9.
W20260709 13:00:11.644879  2329 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.012s	sys 0.040s
I20260709 13:00:11.701200  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:11.408442  5431 raft_consensus.cc:515] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:11.424491  5432 consensus_queue.cc:1048] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.303s
I20260709 13:00:11.700503  1570 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757"
dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:37682
I20260709 13:00:11.756892  1570 raft_consensus.cc:493] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:11.757455  1570 raft_consensus.cc:3060] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:11.463462  1724 raft_consensus.cc:1240] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:00:11.756037  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:11.462886  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:11.760723  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:11.546705  1647 raft_consensus.cc:2468] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 7.
I20260709 13:00:11.763690  1722 raft_consensus.cc:2468] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8.
I20260709 13:00:11.764600  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:11.742919  1572 raft_consensus.cc:1240] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 8. Current term is 9. Ops: []
W20260709 13:00:11.714767  2329 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.016s	sys 0.047s
I20260709 13:00:11.710731  1575 raft_consensus.cc:3060] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:11.714366  1569 raft_consensus.cc:493] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:11.766707  1569 raft_consensus.cc:3060] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:11.513345  1539 leader_election.cc:304] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:11.768378  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:11.770471  1645 raft_consensus.cc:2468] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 9.
I20260709 13:00:11.765688  1716 raft_consensus.cc:2468] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 10.
W20260709 13:00:11.451303  5274 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.008s	sys 0.008s
I20260709 13:00:11.781742  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:11.782047  1721 raft_consensus.cc:2468] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 9.
I20260709 13:00:11.497900  5286 raft_consensus.cc:493] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:11.769905  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 267178us
I20260709 13:00:11.501767  5209 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:11.501422  5280 leader_election.cc:290] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:11.754630  5204 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:11.813171  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:11.814718  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:11.815485  1574 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 9.
I20260709 13:00:11.494799  5426 consensus_queue.cc:1048] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.291s
I20260709 13:00:11.777145  1716 raft_consensus.cc:1275] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:00:11.719818  5295 leader_election.cc:290] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:00:11.726660  5456 log.cc:927] Time spent T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.938s	user 0.008s	sys 0.001s
I20260709 13:00:11.773702  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:11.615199  5313 raft_consensus.cc:493] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.495366  5115 consensus_queue.cc:1048] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.315s
W20260709 13:00:11.786253  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 273109us
I20260709 13:00:11.772554  2297 leader_election.cc:304] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 13:00:11.787611  1647 raft_consensus.cc:1240] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:11.839718  1539 leader_election.cc:400] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 election: Vote denied by peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391) with higher term. Message: Invalid argument: T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 8. Current term is 9.
I20260709 13:00:11.492776  5475 consensus_queue.cc:1048] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.361s
I20260709 13:00:11.502252  5169 leader_election.cc:290] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:11.726413  5224 leader_election.cc:290] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:11.719158  5299 raft_consensus.cc:2749] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:11.433691  5296 raft_consensus.cc:493] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:11.659019  5337 leader_election.cc:290] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373)
I20260709 13:00:11.794092  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:11.793818  1569 raft_consensus.cc:515] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:11.836891  5428 raft_consensus.cc:493] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.502108  5131 raft_consensus.cc:493] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:11.463727  5429 raft_consensus.cc:3060] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:11.759311  5477 raft_consensus.cc:493] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:11.800256  1575 raft_consensus.cc:2468] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 10.
I20260709 13:00:11.801374  5340 leader_election.cc:290] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:11.803511  2324 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32870 (request call id 420) took 2272 ms (client timeout 2207 ms). Trace:
I20260709 13:00:11.806896  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:11.720853  5457 leader_election.cc:290] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:11.885293  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:11.503207  5249 consensus_queue.cc:1048] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.282s
I20260709 13:00:11.890756  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:11.891426  1644 raft_consensus.cc:2468] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 10.
I20260709 13:00:11.826072  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:11.578814  5246 consensus_queue.cc:1048] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.217s
I20260709 13:00:11.827152  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:11.909345  1574 raft_consensus.cc:1275] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:00:11.909660  1574 pending_rounds.cc:85] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting all ops after (but not including) 5
I20260709 13:00:11.909878  1574 pending_rounds.cc:107] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:00:11.910095  1574 raft_consensus.cc:2889] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:11.827827  1650 raft_consensus.cc:1240] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 11 LEADER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:00:11.462291  5415 consensus_queue.cc:1048] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.333s
W20260709 13:00:11.797801  5269 consensus_meta.cc:287] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.734s	user 0.011s	sys 0.000s
I20260709 13:00:11.838527  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:11.840889  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:11.917651  1572 raft_consensus.cc:2393] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 8: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:11.789088  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:11.793879  5422 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:11.798614  5339 raft_consensus.cc:2749] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:11.921154  1572 raft_consensus.cc:1240] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:11.840032  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:11.840030  1539 leader_election.cc:403] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:00:11.843983  1615 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 13:00:11.922868  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 83265.6us
W20260709 13:00:11.923357  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 79470.3us
I20260709 13:00:11.847203  1570 raft_consensus.cc:515] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:11.849983  1716 raft_consensus.cc:1275] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:00:11.500653  5137 consensus_queue.cc:237] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:11.831115  5427 leader_election.cc:290] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:11.784281  1542 leader_election.cc:304] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:11.929922  1576 raft_consensus.cc:1275] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:00:11.795710  5286 raft_consensus.cc:515] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:11.866875  2326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53306 (request call id 642) took 1487 ms. Trace:
I20260709 13:00:11.807657  5209 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:11.877682  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:11.941629  1568 raft_consensus.cc:2468] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7.
I20260709 13:00:11.878525  1569 leader_election.cc:290] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:11.886425  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:00:11.883721  2324 rpcz_store.cc:269] 0709 13:00:09.531221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:09.542667 (+ 11446us) service_pool.cc:224] Handling call
0709 13:00:11.803256 (+2260589us) spinlock_profiling.cc:243] Waited 1.61 s on lock 0x7b54006e1c54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:11.803396 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3695260544}
I20260709 13:00:11.942796  5209 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:11.826028  5204 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:11.829850  5474 consensus_queue.cc:1048] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 13:00:11.944711  5204 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:11.931641  2326 rpcz_store.cc:276] 0709 13:00:10.379724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.379883 (+   159us) service_pool.cc:224] Handling call
0709 13:00:10.380296 (+   413us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:10.475415 (+ 95119us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:10.475466 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:10.475532 (+    66us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:10.475618 (+    86us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:11.866546 (+1390928us) spinlock_profiling.cc:243] Waited 94.8 ms on lock 0x7b54006c66d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:11.866616 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:11.866794 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":218067200}
I20260709 13:00:11.947158  5423 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:11.889724  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:11.887115  5459 leader_election.cc:290] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373)
I20260709 13:00:11.880409  5131 raft_consensus.cc:515] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:11.867949  5299 raft_consensus.cc:2804] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:11.978883  1688 leader_election.cc:304] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:11.948055  1571 raft_consensus.cc:2468] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 7.
I20260709 13:00:11.843495  5313 raft_consensus.cc:515] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:11.877080  5428 raft_consensus.cc:515] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:11.902406  5431 leader_election.cc:290] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:11.905069  5485 raft_consensus.cc:493] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.905622  1722 raft_consensus.cc:1275] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 13:00:11.907354  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 134732us
I20260709 13:00:11.915681  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:11.919023  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:35470 (request call id 18) took 1654 ms. Trace:
I20260709 13:00:11.919201  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:11.920835  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:11.926826  1567 raft_consensus.cc:1240] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:11.708402  5216 consensus_queue.cc:237] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:11.885459  5488 raft_consensus.cc:493] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:12.041138  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:11.865523  5296 raft_consensus.cc:515] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:11.931025  5490 raft_consensus.cc:493] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:11.888067  5477 raft_consensus.cc:515] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:11.951133  1540 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.196:34423 timed out after 2.207s (SENT) [suppressed 21 similar messages]
I20260709 13:00:11.950210  1570 leader_election.cc:290] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:11.949349  1716 raft_consensus.cc:1240] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 10. Current term is 11. Ops: [7.4-10.6]
I20260709 13:00:11.977212  5337 raft_consensus.cc:493] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.974359  5266 raft_consensus.cc:493] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:11.981091  1688 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
W20260709 13:00:11.949738  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 165540us
I20260709 13:00:12.022228  1646 rpcz_store.cc:276] 0709 13:00:10.260088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.299058 (+ 38970us) service_pool.cc:224] Handling call
0709 13:00:11.913817 (+1614759us) spinlock_profiling.cc:243] Waited 63.6 ms on lock 0x7b540027c020. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f2338520 00007fa9f23b5652 00007fa9f738360a 00007fa9f09097d4 00007fa9f0909762 00007fa9f0909691 00007fa9f090960c 00007fa9f09088c2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:11.914133 (+   316us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":146211200}
I20260709 13:00:11.927165  5458 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:11.929313  5295 raft_consensus.cc:2804] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:12.091287  5295 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:12.091689  5295 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:12.091733  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:12.069327  5428 leader_election.cc:290] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:12.093127  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:12.093029  5337 raft_consensus.cc:515] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:12.095203  5337 leader_election.cc:290] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:11.979329  5423 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
W20260709 13:00:11.934856  5479 log.cc:927] Time spent T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:00:11.933072  5426 raft_consensus.cc:2749] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391) with higher term. Message: Invalid argument: T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 8. Current term is 9.
I20260709 13:00:11.931008  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:12.041440  2329 raft_consensus.cc:1240] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:00:11.978183  5299 raft_consensus.cc:493] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:12.025890  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:12.042716  1574 raft_consensus.cc:1275] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:00:12.032354  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:12.043632  1645 raft_consensus.cc:2393] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 7: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
W20260709 13:00:12.046482  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:12.101902  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:12.102012  1646 raft_consensus.cc:1240] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:12.076728  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:12.068444  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:11.935753  5469 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:11.975158  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 44783.8us
I20260709 13:00:11.934949  5286 leader_election.cc:290] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:11.986536  5340 raft_consensus.cc:2804] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:12.090484  1722 raft_consensus.cc:1240] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:12.121904  5340 raft_consensus.cc:493] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:12.122303  5340 raft_consensus.cc:3060] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:12.076730  5490 raft_consensus.cc:515] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:12.123812  5459 consensus_queue.cc:1048] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:00:12.096401  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 115936us
I20260709 13:00:12.125090  5490 leader_election.cc:290] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:12.124837  5484 consensus_queue.cc:1059] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:12.097157  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:11.975281  5422 consensus_queue.cc:1059] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.129s
I20260709 13:00:12.126149  5169 consensus_queue.cc:1048] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:12.126605  5422 raft_consensus.cc:3055] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:12.126987  5422 raft_consensus.cc:740] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:12.127477  5169 raft_consensus.cc:3055] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:12.127889  5169 raft_consensus.cc:740] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:12.127779  5422 consensus_queue.cc:260] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:12.027572  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 13:00:12.069201  5486 log.cc:927] Time spent T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 13:00:12.129082  5415 consensus_queue.cc:1059] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:12.130465  5415 raft_consensus.cc:3055] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:12.129143  5422 raft_consensus.cc:3060] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:12.130837  5415 raft_consensus.cc:740] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:12.131136  5169 consensus_queue.cc:260] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:12.131789  5415 consensus_queue.cc:260] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:12.104732  5491 raft_consensus.cc:2749] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:12.069274  5296 leader_election.cc:290] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:12.109704  1650 raft_consensus.cc:1240] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:12.109879  5477 leader_election.cc:290] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:12.097906  5449 consensus_queue.cc:1048] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:00:12.070561  5131 leader_election.cc:290] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:12.111321  5313 leader_election.cc:290] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:12.049489  5488 raft_consensus.cc:515] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:12.098361  5266 raft_consensus.cc:515] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:12.048372  5489 raft_consensus.cc:2749] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:12.049818  5457 raft_consensus.cc:493] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:12.205814  5472 raft_consensus.cc:493] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:12.112514  1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 835) took 1089 ms. Trace:
I20260709 13:00:12.206383  5472 raft_consensus.cc:515] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:12.206741  1718 rpcz_store.cc:276] 0709 13:00:11.022930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.023043 (+   113us) service_pool.cc:224] Handling call
0709 13:00:11.023361 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:11.023691 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:11.023719 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:11.024179 (+   460us) log.cc:844] Serialized 26 byte log entry
0709 13:00:11.508799 (+484620us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:11.508841 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:11.508914 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:12.112330 (+603416us) raft_consensus.cc:1685] finished
0709 13:00:12.112348 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:12.112462 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5152,"raft.run_cpu_time_us":69,"raft.run_wall_time_us":69,"thread_start_us":484249,"threads_started":1,"wal-append.queue_time_us":760644}
I20260709 13:00:12.112901  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:12.208670  2332 raft_consensus.cc:3055] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:12.209005  2332 raft_consensus.cc:740] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:12.113564  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:12.211154  2323 raft_consensus.cc:3055] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:12.211520  2323 raft_consensus.cc:740] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:12.115414  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:12.213343  2324 raft_consensus.cc:2468] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 7.
I20260709 13:00:12.115546  2327 raft_consensus.cc:1275] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:00:12.134042  1615 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:12.135396  5169 raft_consensus.cc:3060] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:12.043097  5485 raft_consensus.cc:515] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:11.992307  5427 consensus_queue.cc:1048] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.107s
I20260709 13:00:12.141085  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:12.103106  1716 raft_consensus.cc:1275] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:12.142081  2326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260"
dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
mode: GRACEFUL
new_leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:39778
I20260709 13:00:12.127506  5428 raft_consensus.cc:493] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:12.147657  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:12.304400  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:12.151711  5297 raft_consensus.cc:993] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e: : Instructing follower 89ac9d5e2fbc4536b03a1ff1dd3eb226 to start an election
I20260709 13:00:12.152724  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:12.156896  5429 raft_consensus.cc:2749] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:12.103523  5299 raft_consensus.cc:3060] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:12.160034  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:00:12.184819  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:12.205428  5457 raft_consensus.cc:515] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:12.100718  5423 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:12.214519  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 91967.1us
I20260709 13:00:12.212327  2323 consensus_queue.cc:260] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:12.209813  2332 consensus_queue.cc:260] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:12.255692  5131 raft_consensus.cc:2804] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:12.255800  5489 raft_consensus.cc:493] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:12.257179  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:12.257735  1649 raft_consensus.cc:3060] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:12.269604  2326 raft_consensus.cc:606] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 LEADER]: Received request to transfer leadership to TS 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:12.313686  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:12.391988  1722 raft_consensus.cc:2468] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 8.
I20260709 13:00:12.413084  1720 raft_consensus.cc:1275] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 13:00:12.464022  1542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:12.495764  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 201989us
I20260709 13:00:12.578598  2323 raft_consensus.cc:3060] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:12.580324  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:12.585129  1539 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:12.424846  1725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1642) took 1705 ms. Trace:
I20260709 13:00:12.228175  5418 leader_election.cc:290] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:12.596781   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:00:12.267355  5415 raft_consensus.cc:3060] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:12.600430  2332 raft_consensus.cc:3060] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:12.586784  1725 rpcz_store.cc:276] 0709 13:00:10.719278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.719392 (+   114us) service_pool.cc:224] Handling call
0709 13:00:10.719700 (+   308us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:00:10.720093 (+   393us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:10.720119 (+    26us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:00:10.728010 (+  7891us) log.cc:844] Serialized 78 byte log entry
0709 13:00:10.841594 (+113584us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:10.867273 (+ 25679us) log.cc:844] Serialized 14 byte log entry
0709 13:00:11.947346 (+1080073us) spinlock_profiling.cc:243] Waited 4.5 ms on lock 0x7b1800476260. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef248c0a 00007fa9f8988219 00007fa9ef2d0a40 00007fa9ef2cb4e4 00007fa9ef2cb455 00007fa9f5db33c7 00007fa9f23c59a7 00007fa9f23d50bf 00007fa9f23d5038
0709 13:00:11.947529 (+   183us) log.cc:844] Serialized 14 byte log entry
0709 13:00:12.326980 (+379451us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:12.327092 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:12.424493 (+ 97401us) raft_consensus.cc:1685] finished
0709 13:00:12.424562 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:12.424770 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1103142,"prepare.queue_time_us":1137078,"prepare.run_cpu_time_us":95,"prepare.run_wall_time_us":3423,"raft.queue_time_us":8711,"raft.run_cpu_time_us":366,"raft.run_wall_time_us":17160,"spinlock_wait_cycles":10340224,"thread_start_us":452933,"threads_started":3,"wal-append.queue_time_us":388628,"wal-append.run_cpu_time_us":2856,"wal-append.run_wall_time_us":1039735}
I20260709 13:00:12.374595  5436 raft_consensus.cc:1081] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 9 LEADER]: Signalling peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 to start an election
I20260709 13:00:12.268404  5011 raft_consensus.cc:493] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:12.610016  2323 raft_consensus.cc:2468] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
I20260709 13:00:12.392299  5296 raft_consensus.cc:493] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:12.446134  5490 raft_consensus.cc:493] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:12.266692  5295 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:12.580652  5131 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:12.374048  5491 raft_consensus.cc:493] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:12.501181  5266 leader_election.cc:290] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:12.564509  5472 leader_election.cc:290] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:12.616209  1649 raft_consensus.cc:2468] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 9.
I20260709 13:00:12.475647  5340 raft_consensus.cc:515] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:12.655361  5340 leader_election.cc:290] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:12.643169  5491 raft_consensus.cc:515] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:12.639976  5131 raft_consensus.cc:3060] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:12.445889  5458 raft_consensus.cc:493] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:12.374217  5477 raft_consensus.cc:493] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:12.619946  1539 leader_election.cc:304] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:12.512740  5485 leader_election.cc:290] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:12.638221  2332 raft_consensus.cc:2468] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6.
I20260709 13:00:12.526625  5427 raft_consensus.cc:493] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:12.647027  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:12.648761  5423 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:12.637681  5169 raft_consensus.cc:493] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:12.313920  5428 raft_consensus.cc:515] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:12.618680  5469 raft_consensus.cc:2804] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:00:12.669062  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:12.637542  5476 raft_consensus.cc:493] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:12.640910  5430 raft_consensus.cc:493] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.679875  5427 raft_consensus.cc:515] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:12.674515  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:12.722251  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:12.723119  1645 raft_consensus.cc:2410] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:00:12.619711  5011 raft_consensus.cc:515] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:12.638566  5490 raft_consensus.cc:515] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:12.704635  5449 raft_consensus.cc:2749] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:12.702385  5469 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:12.635030  5296 raft_consensus.cc:515] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:12.675134  5340 raft_consensus.cc:493] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:12.734529  5353 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:12.744010  5457 leader_election.cc:290] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:12.595834  5489 raft_consensus.cc:515] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:12.672307  5458 raft_consensus.cc:515] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:12.680632  5169 raft_consensus.cc:515] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:12.672488  5477 raft_consensus.cc:515] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:12.726505  5488 leader_election.cc:290] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:12.622334  5299 raft_consensus.cc:515] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:12.718873  5430 raft_consensus.cc:515] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:12.746390  5469 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:12.759884  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 140016us
I20260709 13:00:12.768357  1539 leader_election.cc:304] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:12.705430  5476 raft_consensus.cc:515] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:12.775048  1539 leader_election.cc:304] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:12.781733  5489 leader_election.cc:290] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:12.785713  5295 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:12.788224  5169 leader_election.cc:290] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:12.770320  5488 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.754343  5340 raft_consensus.cc:515] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:12.795341  5169 raft_consensus.cc:493] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:12.789518  5490 leader_election.cc:290] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:12.779654  5381 raft_consensus.cc:2749] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:12.757649  5353 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:12.804972  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:12.813149  5281 leader_election.cc:290] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:12.813886  5353 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:12.814328  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:12.814968  1651 raft_consensus.cc:2468] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 8.
I20260709 13:00:12.815392  1723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 841) took 1374 ms. Trace:
I20260709 13:00:12.815788  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:12.815747  1723 rpcz_store.cc:276] 0709 13:00:11.440813 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.814647 (+1373834us) service_pool.cc:224] Handling call
0709 13:00:12.814926 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:12.815085 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:12.815111 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:12.815158 (+    47us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:12.815187 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:12.815237 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:12.815342 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:12.817356  5296 leader_election.cc:290] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:12.817589  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:12.778367  5449 raft_consensus.cc:2749] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:12.779518  5297 raft_consensus.cc:493] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:12.808128  5477 leader_election.cc:290] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:12.808444  5458 leader_election.cc:290] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:12.810364  5011 leader_election.cc:290] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:12.818863  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:12.822600  1719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1646) took 2038 ms. Trace:
I20260709 13:00:12.825585  1719 rpcz_store.cc:276] 0709 13:00:10.784600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:10.784775 (+   175us) service_pool.cc:224] Handling call
0709 13:00:10.785177 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:11.397693 (+612516us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:12.822365 (+1424672us) spinlock_profiling.cc:243] Waited 604 ms on lock 0x7b540013bfd4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:12.822548 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1390168448}
W20260709 13:00:12.826254  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 103194us
I20260709 13:00:12.828575  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:12.829139  1719 raft_consensus.cc:2468] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 7.
W20260709 13:00:12.824904  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:12.822065  5297 raft_consensus.cc:515] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:12.834890  5340 leader_election.cc:290] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:12.837126  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:12.837955  1724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1652) took 1392 ms. Trace:
I20260709 13:00:12.848834  1647 raft_consensus.cc:2468] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 10.
I20260709 13:00:12.850060  1539 leader_election.cc:304] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:12.818689  5169 raft_consensus.cc:515] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:12.985831  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 148524us
I20260709 13:00:12.986600  2297 leader_election.cc:304] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 13:00:12.984018  5353 raft_consensus.cc:493] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:12.987676  5353 raft_consensus.cc:515] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:12.990381  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:12.991128  1647 raft_consensus.cc:2468] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 9.
W20260709 13:00:12.992194  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 150508us
I20260709 13:00:12.992162  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:12.804049  5488 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:12.993628  1647 raft_consensus.cc:2468] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 7.
I20260709 13:00:12.994921  1539 leader_election.cc:304] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:12.996497  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:13.021572  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:13.022327  1647 raft_consensus.cc:2468] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 7.
I20260709 13:00:13.023190  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:13.024205  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:13.024922  1647 raft_consensus.cc:2393] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 10: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:12.989787  5353 leader_election.cc:290] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:12.838341  1724 rpcz_store.cc:276] 0709 13:00:11.445542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.770930 (+325388us) service_pool.cc:224] Handling call
0709 13:00:11.771258 (+   328us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:11.842276 (+ 71018us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:11.842339 (+    63us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:11.854234 (+ 11895us) log.cc:844] Serialized 52 byte log entry
0709 13:00:12.153889 (+299655us) spinlock_profiling.cc:243] Waited 2.64 ms on lock 0x7b180036bf20. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef2b0e07 00007fa9f810bab9 00007fa9ef2cd69b 00007fa9ef2cb93f 00007fa9ef2cdc02 00007fa9f1f5520b 00007fa9f1f5ad23 00007fa9f1f5b0d1 00007fa9f2376a0f
0709 13:00:12.569913 (+416024us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:12.801564 (+231651us) log.cc:844] Serialized 14 byte log entry
0709 13:00:12.830301 (+ 28737us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:12.830371 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:12.830408 (+    37us) raft_consensus.cc:1685] finished
0709 13:00:12.837773 (+  7365us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:12.837903 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":84002,"prepare.queue_time_us":203879,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":2539,"raft.queue_time_us":133277,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":12398,"spinlock_wait_cycles":6082816,"thread_start_us":717240,"threads_started":3,"wal-append.queue_time_us":776626}
I20260709 13:00:13.028262  1539 leader_election.cc:304] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:13.022114  4981 raft_consensus.cc:2804] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:13.034121  5169 leader_election.cc:290] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:13.035617  5476 leader_election.cc:290] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:13.037223  5299 leader_election.cc:290] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:13.044639  4981 raft_consensus.cc:493] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:13.045115  4981 raft_consensus.cc:3060] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:13.045533  5297 leader_election.cc:290] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:13.047672  5488 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:13.049609  5428 leader_election.cc:290] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:13.051232  5469 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:12.984498  4890 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:13.052846  4890 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:12.985793  5489 raft_consensus.cc:493] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.057678  1647 raft_consensus.cc:1240] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:00:13.058890  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:12.992560  5340 raft_consensus.cc:2804] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:13.066702  1647 raft_consensus.cc:1240] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 13:00:13.068315  1647 raft_consensus.cc:1240] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:00:13.033016  5449 raft_consensus.cc:2804] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:13.060669  5509 consensus_queue.cc:1059] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:00:13.031934  5427 leader_election.cc:290] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:13.032128  5011 raft_consensus.cc:2804] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:13.054840  5313 raft_consensus.cc:493] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.092577  5506 consensus_queue.cc:1059] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:00:13.106832  5313 raft_consensus.cc:515] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:13.107241  5506 raft_consensus.cc:3055] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:13.107856  5506 raft_consensus.cc:740] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:13.109031  5313 leader_election.cc:290] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:13.108899  5506 consensus_queue.cc:260] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:13.096728  4890 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:13.110628  5506 raft_consensus.cc:3060] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:13.096639  5509 consensus_queue.cc:1243] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:00:13.097031  5378 consensus_queue.cc:1059] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:13.113152  5378 raft_consensus.cc:3055] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:13.113484  5378 raft_consensus.cc:740] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:13.114228  5378 consensus_queue.cc:260] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:13.115374  5507 raft_consensus.cc:3055] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:13.115329  5378 raft_consensus.cc:3060] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:13.116007  5507 raft_consensus.cc:740] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:13.075502  5430 leader_election.cc:290] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:13.098759  5469 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:13.119968  5507 consensus_queue.cc:260] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:13.121536  5507 raft_consensus.cc:3060] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:13.075788  5428 consensus_queue.cc:1059] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 13:00:13.140625  5428 raft_consensus.cc:3055] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:13.141120  5428 raft_consensus.cc:740] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:13.141932  5428 consensus_queue.cc:260] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:13.143208  5428 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:13.143590  5011 raft_consensus.cc:493] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:13.163808  5011 raft_consensus.cc:3060] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:13.075714  5340 raft_consensus.cc:697] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:13.065610  5489 raft_consensus.cc:515] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:13.091205  5449 raft_consensus.cc:493] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:13.040398  5131 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:13.155742  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 839) took 1774 ms. Trace:
I20260709 13:00:13.184116  1717 rpcz_store.cc:276] 0709 13:00:11.381144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.154555 (+1773411us) service_pool.cc:224] Handling call
0709 13:00:13.155015 (+   460us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:13.155254 (+   239us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:13.155294 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:13.155353 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:13.155411 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:13.155490 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:13.155663 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:13.184922  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:13.159547  1722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58782 (request call id 848) took 1016 ms. Trace:
I20260709 13:00:13.185772  1722 rpcz_store.cc:276] 0709 13:00:12.143160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.152438 (+  9278us) service_pool.cc:224] Handling call
0709 13:00:13.159358 (+1006920us) spinlock_profiling.cc:243] Waited 81.6 ms on lock 0x7b5400386dd4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:13.159482 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":187703168}
I20260709 13:00:13.170529  1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1659) took 1714 ms. Trace:
W20260709 13:00:13.161443  5415 consensus_meta.cc:287] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.557s	user 0.006s	sys 0.004s
I20260709 13:00:13.162762  4981 raft_consensus.cc:515] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:13.173085  1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 846) took 1148 ms. Trace:
W20260709 13:00:13.174623  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 150224us
I20260709 13:00:13.186724  1720 rpcz_store.cc:276] 0709 13:00:11.455786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.942767 (+486981us) service_pool.cc:224] Handling call
0709 13:00:11.943009 (+   242us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:12.576112 (+633103us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:13.170198 (+594086us) spinlock_profiling.cc:243] Waited 450 ms on lock 0x7b54002aa3d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:13.170453 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1034360192}
I20260709 13:00:13.191064  1721 rpcz_store.cc:276] 0709 13:00:12.025065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.121085 (+ 96020us) service_pool.cc:224] Handling call
0709 13:00:12.121359 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:12.206380 (+ 85021us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:12.206412 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:12.206453 (+    41us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:12.206485 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:13.172785 (+966300us) spinlock_profiling.cc:243] Waited 84.8 ms on lock 0x7b5400354154. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:13.172844 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:13.173014 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":195061120}
I20260709 13:00:13.194207  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:13.199903  5489 leader_election.cc:290] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:00:13.204345  1617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.207007  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:13.205991  1651 raft_consensus.cc:2468] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 7.
I20260709 13:00:13.188683  5449 raft_consensus.cc:3060] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:13.207973  2323 raft_consensus.cc:2393] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 9: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 13:00:13.218021  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:13.218840  2323 raft_consensus.cc:2393] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 7: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 13:00:13.223634  5011 raft_consensus.cc:515] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:13.224857  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:13.237756  2332 raft_consensus.cc:2410] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:00:13.165521  5340 consensus_queue.cc:237] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:13.228960  5131 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:13.241175  1688 leader_election.cc:304] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:13.233410  4981 leader_election.cc:290] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:13.237407  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:00:13.233063  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.259349  2323 raft_consensus.cc:1275] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:13.259480  1688 leader_election.cc:304] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:13.261253  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:13.260571  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:13.264325  1567 raft_consensus.cc:2468] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 8.
I20260709 13:00:13.262964  5489 raft_consensus.cc:2804] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:13.270166  5489 raft_consensus.cc:493] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:13.270622  5489 raft_consensus.cc:3060] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:13.272746  5427 raft_consensus.cc:2804] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:13.273342  5427 raft_consensus.cc:493] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:13.273813  5427 raft_consensus.cc:3060] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:13.276819  5378 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:13.277118  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:13.279253  2332 raft_consensus.cc:1240] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:00:13.277974  5378 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:13.258720  5313 raft_consensus.cc:493] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:13.284839  5313 raft_consensus.cc:515] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:13.298776  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:13.306317  1649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45148 (request call id 2220) took 1367 ms. Trace:
I20260709 13:00:13.306900  1649 rpcz_store.cc:276] 0709 13:00:11.938787 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.021632 (+ 82845us) service_pool.cc:224] Handling call
0709 13:00:13.306075 (+1284443us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b5400193a54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:13.306233 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":302281600}
I20260709 13:00:13.308936  1650 raft_consensus.cc:1240] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:00:13.309477  5313 leader_election.cc:290] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:13.310582  1570 raft_consensus.cc:1240] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:13.316157  1567 raft_consensus.cc:1240] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 10. Current term is 11. Ops: []
W20260709 13:00:13.313349  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 215844us
I20260709 13:00:13.317332  1688 leader_election.cc:304] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:13.317713  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:13.318420  2332 raft_consensus.cc:2468] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 8.
W20260709 13:00:13.319413  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:13.320055  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:13.318710  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 157607us
W20260709 13:00:13.321379  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.320297  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:13.322422  1567 raft_consensus.cc:2410] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:00:13.324295  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:13.331812  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:13.332600  1567 raft_consensus.cc:3060] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:13.321731  5488 raft_consensus.cc:2804] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:13.343374  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:13.341169  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:13.341996  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:13.345470  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:13.345688  1645 raft_consensus.cc:2393] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 11: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:13.346040  1644 raft_consensus.cc:3060] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:13.352816  1617 leader_election.cc:304] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:13.358219  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:13.358325  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:13.358692  1617 leader_election.cc:304] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:13.358855  1649 raft_consensus.cc:2468] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 11.
W20260709 13:00:13.359961  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.324743  5011 leader_election.cc:290] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:13.348832  5460 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.359s	user 0.015s	sys 0.031s
I20260709 13:00:13.367684  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:13.334878  5490 raft_consensus.cc:493] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:13.377764  1721 raft_consensus.cc:3060] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:13.374449  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:13.376156  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:13.379114  1722 raft_consensus.cc:2410] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:00:13.380504  5448 consensus_queue.cc:1048] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:13.383282  5429 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:13.383811  5429 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:13.365897  5496 consensus_queue.cc:1059] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
I20260709 13:00:13.385457  5496 raft_consensus.cc:3055] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:13.385818  5496 raft_consensus.cc:740] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:13.386664  5496 consensus_queue.cc:260] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:13.387914  5496 raft_consensus.cc:3060] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:13.378216  5460 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.400s	user 0.017s	sys 0.031s
I20260709 13:00:13.364769  5297 raft_consensus.cc:2749] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:13.365074  5422 raft_consensus.cc:2804] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:13.391050  1574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 2185) took 1663 ms. Trace:
I20260709 13:00:13.391170  5422 raft_consensus.cc:697] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 11 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:13.391568  1574 rpcz_store.cc:276] 0709 13:00:11.727812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.917964 (+190152us) service_pool.cc:224] Handling call
0709 13:00:11.918220 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:12.101142 (+182922us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:13.390833 (+1289691us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b54003f61d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:13.390995 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":285313792}
I20260709 13:00:13.392187  5422 consensus_queue.cc:237] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:13.394325  5491 leader_election.cc:290] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:13.394958  5491 raft_consensus.cc:493] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:13.395519  5491 raft_consensus.cc:515] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:13.397192  1542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.398375  1542 leader_election.cc:304] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:13.399262  5461 raft_consensus.cc:493] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.399755  5461 raft_consensus.cc:515] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:13.402024  5461 leader_election.cc:290] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:13.403087  5378 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:13.404207  5353 raft_consensus.cc:993] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66: : Instructing follower 89ac9d5e2fbc4536b03a1ff1dd3eb226 to start an election
I20260709 13:00:13.404714  5353 raft_consensus.cc:1081] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 LEADER]: Signalling peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 to start an election
I20260709 13:00:13.408509  5449 raft_consensus.cc:515] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:13.409657  5420 raft_consensus.cc:3060] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:13.410796  5449 leader_election.cc:290] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:13.375229  5511 consensus_queue.cc:1059] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:00:13.380825  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:13.417640  1574 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260"
dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:37682
I20260709 13:00:13.418205  1574 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:13.418563  1574 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:13.424786  5428 raft_consensus.cc:2804] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:13.423971  1542 leader_election.cc:304] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:13.423650  5464 raft_consensus.cc:493] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.432242  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:13.437603  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:13.433704  5378 raft_consensus.cc:2749] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:13.425244  5428 raft_consensus.cc:493] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:13.443236  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 1701) took 1649 ms. Trace:
I20260709 13:00:13.443589  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:13.443786  1646 rpcz_store.cc:276] 0709 13:00:11.794265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:12.094020 (+299755us) service_pool.cc:224] Handling call
0709 13:00:12.101785 (+  7765us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:12.107243 (+  5458us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:13.443020 (+1335777us) spinlock_profiling.cc:243] Waited 7.5 ms on lock 0x7b54003cdf50. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23ba8ad 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:13.443154 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17256320}
I20260709 13:00:13.444694  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:13.446321  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:13.447131  1571 raft_consensus.cc:2468] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 10.
I20260709 13:00:13.447240  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:13.448025  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:13.448132  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:13.447145  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:13.448819  1576 raft_consensus.cc:2468] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 8.
I20260709 13:00:13.446470  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:13.449867  1575 raft_consensus.cc:2468] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 9.
I20260709 13:00:13.451033  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:13.451349  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:13.451668  1569 raft_consensus.cc:2468] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 9.
I20260709 13:00:13.452692  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:13.453469  1575 raft_consensus.cc:2468] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 6.
I20260709 13:00:13.458535  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:13.462747  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:13.467274  1539 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:13.420589  5489 raft_consensus.cc:515] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:13.474553  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:13.423354  5490 raft_consensus.cc:515] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:13.471225  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:13.481474  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:13.485726  1572 raft_consensus.cc:2410] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:00:13.486896  1722 raft_consensus.cc:3060] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:00:13.482534  1721 raft_consensus.cc:2410] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:00:13.484275  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:13.489780  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:13.491240  1568 raft_consensus.cc:2468] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 6.
I20260709 13:00:13.491402  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:13.480052  1539 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 13:00:13.492733  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 1.5415e+06us
I20260709 13:00:13.485162  1574 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:13.441509  5428 raft_consensus.cc:3060] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:13.431337  5339 consensus_queue.cc:1048] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:00:13.501957  2297 leader_election.cc:304] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:13.435787  5449 consensus_queue.cc:1059] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 13:00:13.505275  1574 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:13.506045  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:13.537631  1651 raft_consensus.cc:3060] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:13.506733  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:13.438395  5461 consensus_queue.cc:1059] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:00:13.439782  5379 consensus_queue.cc:1048] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:00:13.489058  5378 raft_consensus.cc:2804] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:13.438726  5464 raft_consensus.cc:515] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:13.497241  5460 raft_consensus.cc:493] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.501155  5415 raft_consensus.cc:2804] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:13.528975  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:13.530426  1642 raft_consensus.cc:1240] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:00:13.532568  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:13.513177  5512 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.540688  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:13.515434  5491 leader_election.cc:290] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:13.550725   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:13.544838  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:13.556492  1650 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:13.555548  2331 raft_consensus.cc:2393] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 7: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 13:00:13.542569  5510 raft_consensus.cc:2749] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:13.560963  5461 raft_consensus.cc:3055] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:13.561408  5461 raft_consensus.cc:740] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:13.565452  5490 leader_election.cc:290] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:00:13.566840  2295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.569906  5461 consensus_queue.cc:260] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:13.571256  5461 raft_consensus.cc:3060] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:13.573841  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:13.575337  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:13.576025  1649 raft_consensus.cc:2468] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 11.
W20260709 13:00:13.573860  5516 log.cc:927] Time spent T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:00:13.582782  5489 leader_election.cc:290] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:13.543329  5470 raft_consensus.cc:493] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.587884  5470 raft_consensus.cc:515] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:13.590348  5470 leader_election.cc:290] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:13.591162  5429 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:13.592131  2332 raft_consensus.cc:2468] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 10.
I20260709 13:00:13.545083  5445 consensus_queue.cc:1059] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 13:00:13.545025  5427 raft_consensus.cc:515] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:13.593467  1468 catalog_manager.cc:5697] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 5 to 8, leader changed from 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 8 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:00:13.595450  5427 leader_election.cc:290] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:13.595050  1468 catalog_manager.cc:5697] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 2 to 7. New cstate: current_term: 7 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:00:13.596634  5514 log.cc:927] Time spent T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 13:00:13.541640  5297 consensus_queue.cc:1048] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:00:13.599673  5381 raft_consensus.cc:3055] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:13.600109  5381 raft_consensus.cc:740] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:13.597370  1468 catalog_manager.cc:5697] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:00:13.591720  5513 consensus_queue.cc:1175] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4dbe7d47a2374afca075d3a98583b49e" responder_term: 9 status { last_received { term: 7 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 8. Current term is 9. Ops: [8.6-8.6]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:00:13.610816  1650 raft_consensus.cc:2468] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 12.
I20260709 13:00:13.603701  1567 raft_consensus.cc:2468] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 9.
I20260709 13:00:13.616271  2295 leader_election.cc:304] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:13.618609  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:13.623355  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:13.624171  1647 raft_consensus.cc:2468] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 7.
I20260709 13:00:13.543865  5378 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:13.543474  5488 raft_consensus.cc:697] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 9 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:13.629164  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:13.630147  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:13.551908  5415 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:13.632867  1539 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:13.628141  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:13.639963  1615 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:13.642148  1644 raft_consensus.cc:2468] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 10.
I20260709 13:00:13.636255  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
W20260709 13:00:13.646543  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 285619us
I20260709 13:00:13.656180  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:13.671610  1646 raft_consensus.cc:1240] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:13.658272  1468 catalog_manager.cc:5697] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 4 to 6, leader changed from 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 6 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:00:13.671905  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:00:13.671454  2294 connection.cc:256] RPC call timeout handler was delayed by -1.047914263999985s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1654s for a response
I20260709 13:00:13.675450  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:13.676723  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:13.678169  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:13.679661  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:13.680375  2326 raft_consensus.cc:2393] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 8: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 13:00:13.680297  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:13.680217  1642 raft_consensus.cc:2393] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 11: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:13.683799  1645 raft_consensus.cc:2393] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 9: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
W20260709 13:00:13.670081  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 168192us
I20260709 13:00:13.678771  2323 raft_consensus.cc:2468] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 8.
I20260709 13:00:13.625442  5297 raft_consensus.cc:493] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:13.685153  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 45303.5us
W20260709 13:00:13.686040  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.692929  2294 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:13.696138  1576 raft_consensus.cc:1240] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:00:13.696512  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:13.697988  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:13.641090  5378 raft_consensus.cc:3060] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:13.616788  5510 raft_consensus.cc:493] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:13.690693  1722 raft_consensus.cc:2468] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 9.
W20260709 13:00:13.689332  1689 connection.cc:256] RPC call timeout handler was delayed by -1.111986484000056s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15880000000000002s for a response
I20260709 13:00:13.626092  5496 raft_consensus.cc:493] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:13.702688  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:13.640866  5429 raft_consensus.cc:493] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:13.732165  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:13.704044  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:13.690816  1468 catalog_manager.cc:5697] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:13.655635  5131 consensus_queue.cc:1059] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.076s
I20260709 13:00:13.736379  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:13.736406  1468 catalog_manager.cc:5697] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 3 to 9. New cstate: current_term: 9 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:13.696138  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:13.685178  4981 raft_consensus.cc:493] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:13.686477  5339 raft_consensus.cc:2804] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:13.656173  5299 raft_consensus.cc:493] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.751708  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:13.751760  5299 raft_consensus.cc:515] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:13.753101  5524 raft_consensus.cc:493] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:13.558458  5460 raft_consensus.cc:515] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:13.704698  5490 raft_consensus.cc:493] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.739338  5508 raft_consensus.cc:2804] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:13.762884  5508 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:13.763336  5508 raft_consensus.cc:3060] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:13.761569  5427 raft_consensus.cc:493] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:13.765300  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:13.766206  5527 raft_consensus.cc:493] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.766693  5527 raft_consensus.cc:515] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:13.749792  5491 raft_consensus.cc:493] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.767689  5491 raft_consensus.cc:515] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:13.769624  5491 leader_election.cc:290] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:13.754618  5525 raft_consensus.cc:493] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:13.772300  5525 raft_consensus.cc:515] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:13.774523  5525 leader_election.cc:290] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:13.750365  5429 raft_consensus.cc:515] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:13.765260  5427 raft_consensus.cc:515] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:13.776973  5429 leader_election.cc:290] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:13.777719  5527 leader_election.cc:290] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:13.731933  5297 raft_consensus.cc:515] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:13.780040  5297 leader_election.cc:290] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:13.702626  5522 consensus_queue.cc:1048] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 13:00:13.731575  5488 consensus_queue.cc:237] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:13.772425  1651 raft_consensus.cc:2468] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8.
I20260709 13:00:13.748607  1568 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c"
dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:36640
I20260709 13:00:13.785564  1568 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:13.785944  1568 raft_consensus.cc:3060] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:13.646373  5489 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:13.601027  5381 consensus_queue.cc:260] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 13:00:13.704903  2297 leader_election.cc:304] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:13.709808  1539 leader_election.cc:304] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 13:00:13.793778  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 84086.4us
W20260709 13:00:13.795274  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.685580  5507 raft_consensus.cc:493] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:13.685277  5415 raft_consensus.cc:3060] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:13.655968  5511 raft_consensus.cc:2804] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:13.754612  2332 raft_consensus.cc:2468] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 9.
I20260709 13:00:13.753712  5524 raft_consensus.cc:515] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:13.756021  5299 leader_election.cc:290] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:13.756629  5339 raft_consensus.cc:697] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:13.754674  4981 raft_consensus.cc:515] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:13.749375  5510 raft_consensus.cc:515] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:13.645391  5280 consensus_queue.cc:1048] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.100s
I20260709 13:00:13.759115  1648 raft_consensus.cc:1275] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:00:13.787696  1569 raft_consensus.cc:2410] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:00:13.838512  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:13.839604  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:13.841001  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:13.601763  5512 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:13.788241  1468 catalog_manager.cc:5697] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:13.843909  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:13.844214  1648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 1699) took 2055 ms. Trace:
I20260709 13:00:13.844774  1569 raft_consensus.cc:2393] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 8: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
W20260709 13:00:13.741894  1617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.745857  5224 consensus_queue.cc:1059] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
W20260709 13:00:13.796830  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 92256.2us
I20260709 13:00:13.797199  1539 leader_election.cc:304] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 13:00:13.797231  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 92411.7us
I20260709 13:00:13.705724  5082 raft_consensus.cc:2804] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:00:13.822204  1474 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55620 (request call id 275) took 23752 ms (client timeout 15000 ms). Trace:
I20260709 13:00:13.824416  1568 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:13.829129  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:13.829293  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:13.798545  5379 raft_consensus.cc:2804] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:13.832463  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:13.888190  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:13.832444  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:13.796605  5313 raft_consensus.cc:493] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.831755  5299 raft_consensus.cc:2804] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:13.834586  5339 consensus_queue.cc:237] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:13.844591  1648 rpcz_store.cc:276] 0709 13:00:11.789005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:11.789602 (+   597us) service_pool.cc:224] Handling call
0709 13:00:11.826803 (+ 37201us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:13.837312 (+2010509us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:13.844013 (+  6701us) spinlock_profiling.cc:243] Waited 1.93 s on lock 0x7b54001f9354. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:13.844164 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4443101440}
W20260709 13:00:13.853699  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 56587.1us
I20260709 13:00:13.915740  1571 raft_consensus.cc:1240] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:13.798122  5491 raft_consensus.cc:493] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.798817  5525 raft_consensus.cc:493] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.745872  5496 raft_consensus.cc:515] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:13.913244  2330 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 9.
I20260709 13:00:13.843812  1468 catalog_manager.cc:5697] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: config changed from index 4 to 6, term changed from 6 to 7, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to <none>, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 7 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
W20260709 13:00:13.912716  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 59116.4us
I20260709 13:00:13.800781  5475 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.837638  5511 raft_consensus.cc:697] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:13.907248  1569 raft_consensus.cc:1275] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:00:13.918710  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:13.789814  5490 raft_consensus.cc:515] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:13.800925  5521 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:13.837563  5430 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.920146  1646 raft_consensus.cc:2393] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 10: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:13.797451  5489 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:13.854710  5422 consensus_queue.cc:1048] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.093s
I20260709 13:00:13.915336  5082 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:13.967706  5082 raft_consensus.cc:3060] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:13.967975  5489 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:13.921993  5379 raft_consensus.cc:697] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:13.939110  5475 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:13.912257  5523 raft_consensus.cc:493] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:13.970652  5379 consensus_queue.cc:237] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:13.971544  5523 raft_consensus.cc:515] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:13.931089  1468 catalog_manager.cc:5697] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:13.973771  4981 leader_election.cc:290] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:13.974465  4981 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:13.975242  1468 catalog_manager.cc:5697] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } }
I20260709 13:00:13.911247  5340 raft_consensus.cc:2804] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:13.978947  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:00:13.940125  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.927577  1568 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:13.941315  1569 raft_consensus.cc:1275] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:00:13.978096  1468 catalog_manager.cc:5697] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:00:13.937088  5529 log.cc:927] Time spent T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:00:13.945088  2324 raft_consensus.cc:2468] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 6.
I20260709 13:00:13.856287  5427 leader_election.cc:290] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:13.948969  1689 leader_election.cc:304] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:00:13.950304  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:13.801064  5507 raft_consensus.cc:515] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:13.926324  5525 raft_consensus.cc:515] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:13.916507  1474 rpcz_store.cc:269] 0709 12:59:50.069749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:50.070003 (+   254us) service_pool.cc:224] Handling call
0709 13:00:13.822100 (+23752097us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:07.531429 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:07.670839 (+139410us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:07.670904 (+    65us) write_op.cc:435] Acquired schema lock
0709 13:00:07.670933 (+    29us) tablet.cc:662] Decoding operations
0709 13:00:07.950770 (+279837us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:07.950906 (+   136us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:07.950951 (+    45us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:00:07.953111 (+  2160us) tablet.cc:701] Row locks acquired
0709 13:00:07.953182 (+    71us) write_op.cc:260] PREPARE: finished
0709 13:00:07.953429 (+   247us) write_op.cc:270] Start()
0709 13:00:07.953679 (+   250us) write_op.cc:276] Timestamp: P: 1783602007953343 usec, L: 0
0709 13:00:07.953716 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 13:00:07.954737 (+  1021us) log.cc:844] Serialized 6784 byte log entry
0709 13:00:09.124104 (+1169367us) spinlock_profiling.cc:243] Waited 33.6 ms on lock 0x7b4400022b4c. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef1f4c85 00007fa9ef1f56a2 00007fa9f1f671db 00007fa9f1f62aaf 00007fa9f1f5686e 00007fa9f1f55bb6 00007fa9f1f557d8 00007fa9f1f5f221 00007fa9f1f5f1d9 00007fa9f1f5f169
0709 13:00:09.340979 (+216875us) op_driver.cc:464] REPLICATION: finished
0709 13:00:09.581781 (+240802us) write_op.cc:301] APPLY: starting
0709 13:00:09.589242 (+  7461us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:09.708466 (+119224us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:09.712684 (+  4218us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:09.850604 (+137920us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:09.850988 (+   384us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=17
0709 13:00:09.851068 (+    80us) write_op.cc:312] APPLY: finished
0709 13:00:09.851653 (+   585us) log.cc:844] Serialized 119 byte log entry
0709 13:00:09.857574 (+  5921us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:09.857816 (+   242us) write_op.cc:454] Released schema lock
0709 13:00:09.857908 (+    92us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:09.858472 (+   564us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:09.858516 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":83678,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":217170,"apply.run_cpu_time_us":6732,"apply.run_wall_time_us":292802,"num_ops":17,"prepare.queue_time_us":230473,"prepare.run_cpu_time_us":13083,"prepare.run_wall_time_us":455394,"raft.queue_time_us":213895,"raft.run_cpu_time_us":31891,"raft.run_wall_time_us":162712,"replication_time_us":1387123,"spinlock_wait_cycles":78070144,"thread_start_us":430663,"threads_started":4,"wal-append.queue_time_us":13628,"wal-append.run_cpu_time_us":20180,"wal-append.run_wall_time_us":2889507}]]}
I20260709 13:00:13.982484  1468 catalog_manager.cc:5697] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:13.941460  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:13.914520  5299 raft_consensus.cc:493] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:13.980407  1540 leader_election.cc:304] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:13.975066  4981 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:14.010596  5533 raft_consensus.cc:3055] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:14.011060  5533 raft_consensus.cc:740] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:14.010987  1540 leader_election.cc:304] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
W20260709 13:00:13.996163  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 47275.5us
I20260709 13:00:14.013070  1689 leader_election.cc:304] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:14.014168  1689 leader_election.cc:304] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:14.005816  1468 catalog_manager.cc:5697] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 8 to 9, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 9 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:14.017758  1468 catalog_manager.cc:5697] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 5 to 6, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 6 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:13.922137  5313 raft_consensus.cc:515] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:13.925180  5491 raft_consensus.cc:515] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:14.012254  4981 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:13.996019  5340 raft_consensus.cc:697] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:14.023006  1540 leader_election.cc:304] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:14.020202  1468 catalog_manager.cc:5697] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 4 to 7, leader changed from 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 7 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
W20260709 13:00:14.022202  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 168269us
I20260709 13:00:13.977816  5428 raft_consensus.cc:515] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:14.051265  2297 leader_election.cc:304] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:13.977170  5430 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:14.051260  1540 leader_election.cc:304] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:14.051970  1468 catalog_manager.cc:5697] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:14.016974  5469 raft_consensus.cc:2749] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:14.008817  5429 raft_consensus.cc:2749] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:14.022631  5286 raft_consensus.cc:2749] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:14.063925  1468 catalog_manager.cc:5697] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:14.026458  5427 raft_consensus.cc:2804] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:14.017858  5464 leader_election.cc:290] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:14.075748  1567 raft_consensus.cc:1240] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 LEADER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 10. Current term is 12. Ops: []
I20260709 13:00:14.013721  5299 raft_consensus.cc:3060] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:14.076993  1573 raft_consensus.cc:2393] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 9: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:14.022778  5532 raft_consensus.cc:2749] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:14.012147  5533 consensus_queue.cc:260] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:14.057240  5461 raft_consensus.cc:2804] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:14.025735  5449 consensus_queue.cc:1048] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:00:14.071570  4981 raft_consensus.cc:2749] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:00:14.080773  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 155887us
I20260709 13:00:13.981609  5521 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:14.069888  5115 raft_consensus.cc:2804] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:00:14.094206  2294 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:00:14.094625  2295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:14.078135  5427 raft_consensus.cc:493] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:14.097128  2297 leader_election.cc:304] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:14.068076  5378 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:14.094350  5533 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:14.108047  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:14.093039  5461 raft_consensus.cc:697] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:14.108877  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:14.110638  1720 raft_consensus.cc:2410] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:00:14.110921  1722 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 7.
I20260709 13:00:14.098210  5427 raft_consensus.cc:3060] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:14.100445  5115 raft_consensus.cc:697] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:14.063083  5511 consensus_queue.cc:237] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:14.141515  5115 consensus_queue.cc:237] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:14.142858  5534 log.cc:927] Time spent T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:00:14.113994  5537 raft_consensus.cc:2749] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:14.115743  5496 leader_election.cc:290] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:14.137863  5535 raft_consensus.cc:2804] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:14.136948  5523 leader_election.cc:290] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:14.097322  5340 consensus_queue.cc:237] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:14.164177  5535 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:14.168691  5535 raft_consensus.cc:3060] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:14.172003  5415 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:14.168040  5378 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:14.178084  5512 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:14.165585  5461 consensus_queue.cc:237] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:14.182426  5508 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:14.184046  5299 raft_consensus.cc:515] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:14.186015  5521 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:14.186388  5299 leader_election.cc:290] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:14.186777  5491 leader_election.cc:290] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:14.174429  5507 leader_election.cc:290] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:14.165084  5525 leader_election.cc:290] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:14.163632  5490 leader_election.cc:290] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:14.166325  5510 leader_election.cc:290] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:14.173413  5524 leader_election.cc:290] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:14.175253  5428 leader_election.cc:290] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:14.176965  5313 leader_election.cc:290] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:14.195665  5508 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:14.195878  5381 raft_consensus.cc:3060] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:14.201876  5535 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:14.178148  5475 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:14.204406  5535 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:14.205677  5415 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:14.206178  5542 log.cc:927] Time spent T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.064s	user 0.005s	sys 0.000s
I20260709 13:00:14.262223  1572 raft_consensus.cc:2368] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 7. Current term is 8.
I20260709 13:00:14.264837  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:14.269186  1570 raft_consensus.cc:1240] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:14.269721  1574 raft_consensus.cc:2410] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
W20260709 13:00:14.296581  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 202278us
W20260709 13:00:14.300146  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:14.302362  5381 consensus_queue.cc:1048] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:14.300467  5427 raft_consensus.cc:515] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:14.261688  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:00:14.326813  1617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:14.340891  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:14.346760  5422 raft_consensus.cc:493] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.346881  5432 raft_consensus.cc:3055] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:14.371881  5422 raft_consensus.cc:515] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:14.384280  1568 raft_consensus.cc:1275] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:00:14.384788  1568 pending_rounds.cc:85] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting all ops after (but not including) 5
I20260709 13:00:14.385147  1568 pending_rounds.cc:107] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:00:14.385610  1568 raft_consensus.cc:2889] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:14.367893  5432 raft_consensus.cc:740] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:14.395670  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:14.396816  1646 raft_consensus.cc:2410] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:00:14.389031  5432 consensus_queue.cc:260] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:14.398420  5432 raft_consensus.cc:3060] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:14.398909  5460 leader_election.cc:290] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:14.399104  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:14.400995  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:14.382150  5422 leader_election.cc:290] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:14.402583  5476 consensus_queue.cc:1059] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:14.403893  5476 raft_consensus.cc:3055] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:14.406670  5427 leader_election.cc:290] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:00:14.412068  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:14.388487  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 86972.8us
W20260709 13:00:14.412271  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:14.409210  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:14.404373  5476 raft_consensus.cc:740] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:14.428683  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:14.488154  5430 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:14.488291  2294 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:14.490235  2330 raft_consensus.cc:1275] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:14.498216  1463 maintenance_manager.cc:419] P fcfaa17e55ae48e194c5d95ca24a659f: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033357
I20260709 13:00:14.428933  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:14.433346  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:14.503074  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:14.503438  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:14.504081  2328 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 7.
I20260709 13:00:14.408960  5509 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.505882  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:14.506038  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
W20260709 13:00:14.478377  5082 consensus_meta.cc:287] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.510s	user 0.005s	sys 0.018s
I20260709 13:00:14.428138  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:14.508484  2294 leader_election.cc:304] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:14.434059  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:14.509280  5289 raft_consensus.cc:2749] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:00:14.510613  2295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:14.510488  5224 raft_consensus.cc:493] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.522923  5224 raft_consensus.cc:515] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:14.525710  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:14.511301  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:14.513847  2325 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 9.
W20260709 13:00:14.526582  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:14.515787  2328 raft_consensus.cc:1240] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
I20260709 13:00:14.431564  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:14.518908  5082 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:14.519939  1648 raft_consensus.cc:2468] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 11.
W20260709 13:00:14.521147  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 506862us
I20260709 13:00:14.514731  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:14.528465  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:14.425169  5531 raft_consensus.cc:3055] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:14.427734  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:14.429495  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:14.532050  1568 raft_consensus.cc:2410] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:00:14.528458  5309 raft_consensus.cc:2804] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:14.534745  5309 raft_consensus.cc:493] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:14.535336  5309 raft_consensus.cc:3060] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:14.536659  1688 leader_election.cc:304] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:14.537773  5427 raft_consensus.cc:2804] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:14.538235  5427 raft_consensus.cc:493] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:14.538645  5427 raft_consensus.cc:3060] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:14.538966  5340 raft_consensus.cc:493] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.543274  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:14.544252  1646 raft_consensus.cc:2368] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 7. Current term is 8.
I20260709 13:00:14.545559  1648 raft_consensus.cc:1275] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:00:14.546190  5082 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:14.539628  5340 raft_consensus.cc:515] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:14.548928  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:14.553138  1688 leader_election.cc:400] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 election: Vote denied by peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391) with higher term. Message: Invalid argument: T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 7. Current term is 8.
I20260709 13:00:14.553236  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:14.556464  2332 raft_consensus.cc:1240] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:14.556774  1615 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:14.557788   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:00:14.558609  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 53397.1us
I20260709 13:00:14.561923  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:14.562391  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:14.563293  1722 raft_consensus.cc:2468] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 6.
I20260709 13:00:14.553611  1688 leader_election.cc:403] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:00:14.565441  5460 raft_consensus.cc:3060] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:14.565622  5509 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:14.566438  1722 raft_consensus.cc:1240] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:14.566182  5476 consensus_queue.cc:260] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:14.567791  5476 raft_consensus.cc:3060] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:14.569186  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:14.570071  2325 raft_consensus.cc:3060] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:14.545639  2330 raft_consensus.cc:2468] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
I20260709 13:00:14.565445  2328 raft_consensus.cc:1240] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:14.569515  5550 consensus_queue.cc:1048] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:00:14.575259  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:14.575178  5224 leader_election.cc:290] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:14.530925  5531 raft_consensus.cc:740] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:14.576220  5430 raft_consensus.cc:2749] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:14.569031  5509 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:14.534560  5432 raft_consensus.cc:493] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.586421  2331 raft_consensus.cc:2468] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 10.
I20260709 13:00:14.589740  2326 raft_consensus.cc:2468] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 11.
I20260709 13:00:14.590492  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:14.582675  5340 leader_election.cc:290] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:14.592497  2329 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:14.602324  5432 raft_consensus.cc:515] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:14.604082  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:14.607544  1570 raft_consensus.cc:2393] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 8: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:14.611670  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:14.612643  1720 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 9.
I20260709 13:00:14.613523  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:14.578902  5531 consensus_queue.cc:260] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:14.618287  5115 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.619864  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:14.619488  4890 raft_consensus.cc:493] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.620929  1720 raft_consensus.cc:3060] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:14.621038  4890 raft_consensus.cc:515] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:14.623694  4890 leader_election.cc:290] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:14.620287  5115 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:14.627733  5115 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:14.632324  2329 raft_consensus.cc:1275] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:00:14.637470  5445 consensus_queue.cc:1048] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 13:00:14.648487  2325 raft_consensus.cc:2468] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8.
I20260709 13:00:14.641084  1689 leader_election.cc:304] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:14.653213  5550 raft_consensus.cc:493] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.654066  5550 raft_consensus.cc:515] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:14.652263  1720 raft_consensus.cc:2468] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 9.
I20260709 13:00:14.640856  5531 raft_consensus.cc:3060] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:14.643414  5432 leader_election.cc:290] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:14.663663  5524 raft_consensus.cc:2749] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:00:14.663890  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 54259.6us
I20260709 13:00:14.660418  5550 leader_election.cc:290] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:14.672992  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 71978.2us
I20260709 13:00:14.674307  1689 leader_election.cc:304] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:14.685287  1540 leader_election.cc:304] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:14.689280  5445 raft_consensus.cc:2749] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:14.689885  1615 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:14.692159  2297 leader_election.cc:304] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:14.698048  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:14.699991  5550 raft_consensus.cc:2804] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:00:14.730145  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 54760.8us
I20260709 13:00:14.731858  1689 leader_election.cc:304] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:14.730017  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:14.737214  1689 leader_election.cc:304] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:14.736661  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:14.741252  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:14.741443  5489 raft_consensus.cc:2749] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:14.743049  1689 leader_election.cc:304] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:14.743862  5489 raft_consensus.cc:2804] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:14.744228  5489 raft_consensus.cc:493] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:14.729241  5550 raft_consensus.cc:493] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:14.744585  5489 raft_consensus.cc:3060] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:14.697144  5427 raft_consensus.cc:515] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:14.747754  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 49256.1us
I20260709 13:00:14.755769  5427 leader_election.cc:290] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:14.753034  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 61105.1us
I20260709 13:00:14.738698  5432 raft_consensus.cc:2749] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:14.758284  5509 consensus_queue.cc:1059] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:14.759981  5289 raft_consensus.cc:3055] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:14.760352  5289 raft_consensus.cc:740] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:14.753336  5224 raft_consensus.cc:2804] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:14.753515  4890 consensus_queue.cc:1059] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:14.736791  5490 raft_consensus.cc:2804] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:14.754019  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:14.764626  5224 raft_consensus.cc:493] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:14.748180  5550 raft_consensus.cc:3060] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:14.767031  5490 raft_consensus.cc:493] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:14.771442  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:14.774248  1642 raft_consensus.cc:3060] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:14.770041  2297 leader_election.cc:304] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:14.769557  5224 raft_consensus.cc:3060] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:14.776309  5490 raft_consensus.cc:3060] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:14.783586  1689 leader_election.cc:304] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:14.786372  5011 raft_consensus.cc:3055] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:14.786795  5011 raft_consensus.cc:740] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:14.787767  5011 consensus_queue.cc:260] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:14.792919  5289 consensus_queue.cc:260] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:14.794305  5289 raft_consensus.cc:3060] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:14.796692  1646 raft_consensus.cc:2468] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 7.
I20260709 13:00:14.795377  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:14.798498  1647 raft_consensus.cc:2410] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 for term 10 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:00:14.798413  5011 raft_consensus.cc:3060] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:14.794181  5309 raft_consensus.cc:515] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:14.803313  5309 leader_election.cc:290] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:14.801043  5490 raft_consensus.cc:515] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:14.805675  5544 raft_consensus.cc:2804] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:14.808007  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:14.815769  1689 leader_election.cc:304] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:14.816005  1722 raft_consensus.cc:1275] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:14.816067  1720 raft_consensus.cc:2468] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 5.
I20260709 13:00:14.816835  5427 raft_consensus.cc:3060] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:14.812033  2325 raft_consensus.cc:1275] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:14.813329  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:14.813591  2331 raft_consensus.cc:1275] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:00:14.818883  1617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:14.810266  2329 raft_consensus.cc:1275] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:14.821451  5490 leader_election.cc:290] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:14.824968  1642 raft_consensus.cc:2468] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 12.
W20260709 13:00:14.825912  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 136229us
I20260709 13:00:14.827149  4890 raft_consensus.cc:493] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.827199  5544 raft_consensus.cc:697] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:14.827745  4890 raft_consensus.cc:515] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:14.829210  2295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:14.830061  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:14.828769  1688 leader_election.cc:304] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:14.828186  2297 leader_election.cc:304] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:14.824651  5445 consensus_queue.cc:1059] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.009s
I20260709 13:00:14.833149  5535 consensus_queue.cc:1048] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:00:14.833900  5445 raft_consensus.cc:3055] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:14.834236  5445 raft_consensus.cc:740] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:14.836459  1568 raft_consensus.cc:1275] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:00:14.848443  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:14.832760  5427 raft_consensus.cc:2749] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:14.848861  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:14.850179  5224 raft_consensus.cc:515] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:14.850380  5544 consensus_queue.cc:237] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:14.831103  5489 raft_consensus.cc:515] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:14.855788  5489 leader_election.cc:290] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:14.857663  5224 leader_election.cc:290] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:14.858553  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:14.859464  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:14.859710  1540 leader_election.cc:304] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:14.862426  5445 consensus_queue.cc:260] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:14.890820  1720 raft_consensus.cc:3060] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:14.840268  5490 raft_consensus.cc:493] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:14.837199  5309 raft_consensus.cc:2804] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:14.904129  1720 raft_consensus.cc:2468] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 7.
I20260709 13:00:14.856463  5489 raft_consensus.cc:2804] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:14.912827  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:14.899145  5460 raft_consensus.cc:2749] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391) with higher term. Message: Invalid argument: T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 7. Current term is 8.
I20260709 13:00:14.905591  2297 leader_election.cc:304] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
W20260709 13:00:14.916586  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 87885.1us
I20260709 13:00:14.905951  5309 raft_consensus.cc:493] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:14.914008  5427 raft_consensus.cc:2804] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:14.917562  5544 raft_consensus.cc:2804] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:14.905977  5509 consensus_queue.cc:1048] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:00:14.917248  5489 raft_consensus.cc:697] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 12 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:14.931505  5558 raft_consensus.cc:493] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:14.931986  5445 raft_consensus.cc:3060] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:14.930857  5309 raft_consensus.cc:3060] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:14.946786  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 131125us
I20260709 13:00:14.918037  5011 consensus_queue.cc:1059] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:00:14.937763  5427 raft_consensus.cc:493] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:14.923069  5490 raft_consensus.cc:515] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:14.961112  4890 leader_election.cc:290] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:14.962409  1615 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:00:14.963238  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:14.964716  5082 raft_consensus.cc:2749] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:14.967653  1540 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
W20260709 13:00:14.967142  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 47463.8us
I20260709 13:00:14.952013  5544 raft_consensus.cc:697] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:14.975881  5115 raft_consensus.cc:2764] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 LEADER]: Leader election decision vote started in defunct term 11: won
I20260709 13:00:14.966867  5558 raft_consensus.cc:515] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:14.977669  1568 raft_consensus.cc:1240] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:14.979024  5558 leader_election.cc:290] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:14.980659  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:14.981290  1615 leader_election.cc:304] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:14.967440  5427 raft_consensus.cc:3060] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:14.984695  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:14.984833  1689 leader_election.cc:304] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:14.987845  5490 leader_election.cc:290] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:14.989609  4890 raft_consensus.cc:3055] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:14.994148  1642 raft_consensus.cc:2410] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:00:14.972836  5544 consensus_queue.cc:237] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:15.002041  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:14.995020  4890 raft_consensus.cc:740] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:14.980100  5489 consensus_queue.cc:237] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:15.004732  1651 raft_consensus.cc:1240] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 7. Current term is 8. Ops: []
W20260709 13:00:15.006218  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 54421.2us
I20260709 13:00:15.007515  1540 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:15.007761  5011 consensus_queue.cc:1048] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:00:15.010459  5432 raft_consensus.cc:493] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
W20260709 13:00:15.010685  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.011200  5432 raft_consensus.cc:515] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:15.014430  5432 leader_election.cc:290] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:15.009840  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:15.008028  5490 raft_consensus.cc:2804] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:15.015703  5490 raft_consensus.cc:493] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:15.016268  5490 raft_consensus.cc:3060] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:15.017060  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 52545.9us
I20260709 13:00:15.018610  4890 consensus_queue.cc:260] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:15.018935  5082 consensus_queue.cc:1048] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:15.019989  4890 raft_consensus.cc:3060] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:14.999575  5476 raft_consensus.cc:2749] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:15.020560  5082 consensus_queue.cc:1048] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:15.023342  1689 leader_election.cc:304] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:15.024662  5460 raft_consensus.cc:2749] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:15.028344  1689 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:15.030195  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:15.038709  1651 raft_consensus.cc:2410] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:00:15.042459  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.044890  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:15.045724  2329 raft_consensus.cc:2393] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 9: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 13:00:14.991150  5531 consensus_queue.cc:1059] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 13:00:15.053294  5460 raft_consensus.cc:2749] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:15.057191  5340 consensus_queue.cc:1048] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:15.058743  1689 leader_election.cc:304] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:15.060398  1689 leader_election.cc:304] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:15.062281  5557 raft_consensus.cc:2804] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:15.062716  5557 raft_consensus.cc:493] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:15.063098  5557 raft_consensus.cc:3060] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:15.064821  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:15.065568  1615 leader_election.cc:400] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 election: Vote denied by peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373) with higher term. Message: Invalid argument: T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 7. Current term is 8.
I20260709 13:00:15.065800  2331 raft_consensus.cc:2410] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:00:15.065924  1615 leader_election.cc:403] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:00:15.076172  5550 raft_consensus.cc:515] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:15.078467  5550 leader_election.cc:290] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:15.079186  5557 raft_consensus.cc:515] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:15.080111  5082 raft_consensus.cc:3060] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:15.046741  5115 raft_consensus.cc:2804] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:15.093524  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:15.098368  5570 raft_consensus.cc:493] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.099220  5570 raft_consensus.cc:515] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:15.102415  5570 leader_election.cc:290] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:15.080614  5460 raft_consensus.cc:3060] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:15.104331  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:15.104579  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:15.105078  1724 raft_consensus.cc:3060] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:15.105176  2324 raft_consensus.cc:2368] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 7. Current term is 8.
I20260709 13:00:15.119660  2329 raft_consensus.cc:1240] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:00:15.119831  2331 raft_consensus.cc:2468] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7.
I20260709 13:00:15.121475  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:15.093494  5432 consensus_queue.cc:1059] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 13:00:15.066560  5309 raft_consensus.cc:515] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:15.122587  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:15.111496  5115 raft_consensus.cc:697] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:15.133260  5115 consensus_queue.cc:237] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:15.123570  5427 raft_consensus.cc:515] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:15.124471  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 77998.9us
I20260709 13:00:15.123976  5531 raft_consensus.cc:493] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.127357  2294 leader_election.cc:304] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:15.129102  5490 raft_consensus.cc:515] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:15.142963  1722 raft_consensus.cc:2393] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 10: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:15.144337  1724 raft_consensus.cc:2468] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6.
W20260709 13:00:15.144640  2295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.148159  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:15.149798  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 13:00:15.152104  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 54584.2us
I20260709 13:00:15.155759  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:15.136335  5427 leader_election.cc:290] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:15.159837  1720 raft_consensus.cc:3060] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:00:15.163348  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.166404  2294 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:15.167258  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:15.168656  1722 raft_consensus.cc:2468] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8.
W20260709 13:00:15.169793  5548 log.cc:927] Time spent T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
I20260709 13:00:15.170823  5563 raft_consensus.cc:2749] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:15.169438  5569 consensus_queue.cc:1048] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:00:15.179668  1542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.179834  5563 raft_consensus.cc:2749] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:15.181241  5490 leader_election.cc:290] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:15.153149  5445 consensus_queue.cc:1048] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
W20260709 13:00:15.182163  5564 log.cc:927] Time spent T 00000000000000000000000000000000 P fcfaa17e55ae48e194c5d95ca24a659f: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260709 13:00:15.203047  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:15.155929  5531 raft_consensus.cc:515] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:15.206103  1722 raft_consensus.cc:2393] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 11: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:15.182451  5557 leader_election.cc:290] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:15.219485  1721 raft_consensus.cc:1240] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 8. Current term is 9. Ops: [8.7-8.7]
W20260709 13:00:15.219936  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 53602.7us
W20260709 13:00:15.220824  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 175489us
I20260709 13:00:15.220813  2294 leader_election.cc:304] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:15.234735  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:15.237910  1651 raft_consensus.cc:1275] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:00:15.242983  1720 raft_consensus.cc:2468] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
I20260709 13:00:15.247686  1647 raft_consensus.cc:1240] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:15.249030  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:15.256623  1722 raft_consensus.cc:3060] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:15.217613  5476 consensus_queue.cc:1048] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
W20260709 13:00:15.271461  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.216727  5432 consensus_queue.cc:1059] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:00:15.269308  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:15.280715  5309 leader_election.cc:290] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:15.280979  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:15.283488  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
W20260709 13:00:15.289397  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 68676.3us
I20260709 13:00:15.301014  2294 leader_election.cc:304] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:15.292696  5565 raft_consensus.cc:2749] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:15.273387  5115 raft_consensus.cc:493] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:15.297001  5575 raft_consensus.cc:493] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.270998  5569 raft_consensus.cc:493] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.299368  5445 raft_consensus.cc:493] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:15.314966  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:15.331988  1647 raft_consensus.cc:2468] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 10.
I20260709 13:00:15.299948  5571 raft_consensus.cc:3055] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:15.343478  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:15.345029  1723 raft_consensus.cc:1240] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:15.344710  5115 raft_consensus.cc:515] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:15.345113  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:15.339926  5445 raft_consensus.cc:515] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:15.346004  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:15.379189  5445 leader_election.cc:290] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:15.315881  5224 raft_consensus.cc:3055] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:15.380880  5224 raft_consensus.cc:740] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:15.381711  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:15.382483  1721 raft_consensus.cc:2468] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 11.
I20260709 13:00:15.382102  5224 consensus_queue.cc:260] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:15.383678  5224 raft_consensus.cc:3060] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:15.383900  5531 leader_election.cc:290] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:15.384070  1719 raft_consensus.cc:1240] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 6. Current term is 7. Ops: []
W20260709 13:00:15.349587  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:15.388051  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 87158us
I20260709 13:00:15.389194  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:15.313084  5460 raft_consensus.cc:2749] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:00:15.391811  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.386441  1716 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 7.
I20260709 13:00:15.390470  1718 raft_consensus.cc:2468] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
I20260709 13:00:15.392899  2294 leader_election.cc:304] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:15.397451  1724 raft_consensus.cc:1240] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:15.398725  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:15.339107  5544 raft_consensus.cc:2749] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:00:15.395123  1542 leader_election.cc:336] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.518s (SENT)
I20260709 13:00:15.405400  5565 consensus_queue.cc:1059] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:15.406873  2329 raft_consensus.cc:1240] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:00:15.408263  5476 raft_consensus.cc:3055] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:15.408731  5476 raft_consensus.cc:740] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:15.409662  5476 consensus_queue.cc:260] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:15.411024  5476 raft_consensus.cc:3060] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:15.413908  2295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.413795  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:15.413810  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:15.419668  5082 raft_consensus.cc:2749] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373) with higher term. Message: Invalid argument: T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 7. Current term is 8.
I20260709 13:00:15.393509  1574 raft_consensus.cc:2468] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 10.
I20260709 13:00:15.396756  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:15.421339  1717 raft_consensus.cc:3060] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:15.421744  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:15.422434  1721 raft_consensus.cc:2468] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 9.
I20260709 13:00:15.423772  5289 raft_consensus.cc:2804] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:15.424270  5289 raft_consensus.cc:493] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:15.424691  5289 raft_consensus.cc:3060] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:15.424881  5565 raft_consensus.cc:3055] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:15.425344  5565 raft_consensus.cc:740] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:15.376845  5575 raft_consensus.cc:515] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:15.426414  5565 consensus_queue.cc:260] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:15.428948  5573 log.cc:927] Time spent T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.132s	user 0.005s	sys 0.000s
I20260709 13:00:15.428772  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:15.431372  1647 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8.
W20260709 13:00:15.422477  1542 leader_election.cc:336] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.574s (SENT)
I20260709 13:00:15.435554  2297 leader_election.cc:304] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 13:00:15.400812  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:15.442636  1725 raft_consensus.cc:2468] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8.
I20260709 13:00:15.432392  1542 leader_election.cc:304] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
W20260709 13:00:15.454381  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.390177  5571 raft_consensus.cc:740] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:15.457468  5309 raft_consensus.cc:2804] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:15.456230  1723 raft_consensus.cc:2376] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 9. Re-sending same reply.
W20260709 13:00:15.461236  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 72439.9us
I20260709 13:00:15.462073  2294 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:15.464632  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:15.466418  1574 raft_consensus.cc:1275] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 13:00:15.355178  5569 raft_consensus.cc:515] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 13:00:15.467083  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:15.474565  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:15.466812  1574 pending_rounds.cc:85] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting all ops after (but not including) 6
I20260709 13:00:15.475977  1574 pending_rounds.cc:107] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting uncommitted NO_OP operation due to leader change: 8.7
I20260709 13:00:15.476313  1574 raft_consensus.cc:2889] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:15.478529  1649 raft_consensus.cc:1275] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:15.481963  5544 raft_consensus.cc:2749] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:15.485832  5575 leader_election.cc:290] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:15.475383  1721 raft_consensus.cc:2376] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5. Re-sending same reply.
I20260709 13:00:15.487582  5115 leader_election.cc:290] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:15.487267  5289 raft_consensus.cc:515] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:15.488306  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:15.489133  1723 raft_consensus.cc:2393] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 11: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:15.490197  4890 raft_consensus.cc:2749] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:15.492830  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:15.492110  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:00:15.496495  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.504423  1643 raft_consensus.cc:2468] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8.
I20260709 13:00:15.461159  5309 raft_consensus.cc:493] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:15.514281  5309 raft_consensus.cc:3060] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:15.506094  1717 raft_consensus.cc:2468] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 7.
I20260709 13:00:15.517508  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:15.518095  1717 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 9.
I20260709 13:00:15.518193  5569 leader_election.cc:290] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:15.518953  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:00:15.518945  5576 log.cc:927] Time spent T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:00:15.519526  1717 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 10.
I20260709 13:00:15.507622  1722 raft_consensus.cc:2468] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6.
I20260709 13:00:15.521401  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:15.521926  1722 raft_consensus.cc:2376] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6. Re-sending same reply.
I20260709 13:00:15.522673  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:15.510787  2331 raft_consensus.cc:1240] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 LEADER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:15.511067  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:15.511909  1724 raft_consensus.cc:1275] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:00:15.524616  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:15.524751  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:15.525209  1721 raft_consensus.cc:2468] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 11.
I20260709 13:00:15.525554  1724 raft_consensus.cc:2393] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 10: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:15.525467  5115 consensus_queue.cc:1059] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:15.526070  5289 leader_election.cc:290] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:15.526314  1721 raft_consensus.cc:1275] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:00:15.526850  5582 raft_consensus.cc:493] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:15.512123  5571 consensus_queue.cc:260] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:15.527449  5582 raft_consensus.cc:515] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:15.528134  5571 raft_consensus.cc:3060] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:15.528721  2297 leader_election.cc:304] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:00:15.513880  1617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.507764  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:15.533110  5115 raft_consensus.cc:3055] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:15.533895  1722 raft_consensus.cc:2376] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8. Re-sending same reply.
I20260709 13:00:15.534150  5115 raft_consensus.cc:740] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:15.536979  5011 raft_consensus.cc:493] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
W20260709 13:00:15.510979  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 88538.7us
I20260709 13:00:15.537593  5011 raft_consensus.cc:515] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:15.538599  5580 consensus_queue.cc:1059] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:15.539422  5580 consensus_queue.cc:1243] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer 05476b84d8f84d76a9a1f51b620a3c66 log is divergent from this leader: its last log entry 7.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:00:15.539925  5580 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.540231  5011 leader_election.cc:290] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:15.540858  5011 raft_consensus.cc:3055] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:15.540504  5580 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:15.541217  5011 raft_consensus.cc:740] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:15.542177  1725 raft_consensus.cc:2468] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 9.
I20260709 13:00:15.542074  5011 consensus_queue.cc:260] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:15.542649  5580 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:15.520354  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:15.535193  5115 consensus_queue.cc:260] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:15.775494  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:15.615252  1725 raft_consensus.cc:1240] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:15.777426  1721 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 7.
W20260709 13:00:15.653921  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:15.540269  1542 leader_election.cc:336] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.671s (SENT)
I20260709 13:00:15.462831  5565 raft_consensus.cc:3060] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:15.622112  5584 log.cc:927] Time spent T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 13:00:15.602603  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:16.076669  1643 raft_consensus.cc:1275] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:00:16.087622  1720 raft_consensus.cc:3060] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:16.080879  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:16.088949  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:16.090080  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:16.088620  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:16.091197  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:16.091297  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:16.081528  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:16.092021  1643 raft_consensus.cc:2468] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 7.
W20260709 13:00:15.808987  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:16.005076  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:16.093227  1642 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 11.
I20260709 13:00:15.988739  5353 raft_consensus.cc:493] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:15.792709  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:15.782387  5011 raft_consensus.cc:3060] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:15.914085  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:16.095546  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:16.096105  1721 raft_consensus.cc:2468] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 11.
I20260709 13:00:16.097008  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 13:00:16.097280  5603 log.cc:927] Time spent T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 13:00:15.914099  1542 leader_election.cc:304] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:16.098057  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:16.098800  5580 raft_consensus.cc:2749] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:16.099258  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:16.099638  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:16.099923  1568 raft_consensus.cc:2468] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 9.
W20260709 13:00:15.545280  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:16.101251  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:16.101500  5476 raft_consensus.cc:493] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:15.818094  5578 log.cc:927] Time spent T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.519s	user 0.002s	sys 0.000s
I20260709 13:00:16.081399  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:16.102259  5476 raft_consensus.cc:515] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:15.901934  5587 log.cc:927] Time spent T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.485s	user 0.004s	sys 0.000s
I20260709 13:00:15.776760  1717 raft_consensus.cc:2468] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8.
I20260709 13:00:16.104102  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:16.104519  5476 leader_election.cc:290] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:16.105396  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:15.813957  5309 raft_consensus.cc:515] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:16.106879  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:00:15.716835  1617 leader_election.cc:336] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.718s (SENT)
I20260709 13:00:15.911744  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 13:00:16.101251  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:16.108949  1722 raft_consensus.cc:2368] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 6. Current term is 7.
W20260709 13:00:16.109354  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:16.107821  1617 leader_election.cc:304] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:16.109835  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:16.110560  5476 raft_consensus.cc:2749] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:15.765987  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:15.783193  1719 raft_consensus.cc:1275] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:00:16.110776  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 393946us
I20260709 13:00:16.113520  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:16.115067  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:16.115712  1719 raft_consensus.cc:2468] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 9.
I20260709 13:00:15.857924  1650 raft_consensus.cc:1275] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:00:15.687290  1649 raft_consensus.cc:1275] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 13:00:15.648655  2295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:16.121682  2295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:16.121390  5489 consensus_queue.cc:1048] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:00:16.123148  2295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:15.746286  1651 raft_consensus.cc:2468] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 10.
I20260709 13:00:15.911355  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:16.129524  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:16.098796  1721 raft_consensus.cc:2393] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 7: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:16.131021  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:16.131471  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 13:00:15.748447  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 52109.6us
W20260709 13:00:16.132817  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:16.134718  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:16.136461  5489 raft_consensus.cc:493] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:16.094451  5353 raft_consensus.cc:515] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:16.113639  1617 leader_election.cc:336] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.892s (SENT)
I20260709 13:00:16.137132  5489 raft_consensus.cc:515] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:16.137372  1617 leader_election.cc:304] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:16.138480  5476 raft_consensus.cc:2749] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:16.138782  5353 leader_election.cc:290] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:16.111963  1723 raft_consensus.cc:2468] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 10.
I20260709 13:00:16.140843  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 13:00:16.141080  1617 leader_election.cc:336] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.941s (SENT)
I20260709 13:00:15.928699  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:16.141497  1570 raft_consensus.cc:3060] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:16.141850  1646 raft_consensus.cc:2468] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 9.
I20260709 13:00:16.141690  1617 leader_election.cc:304] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:15.973783  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:16.146526  5476 raft_consensus.cc:2749] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:16.146934  1718 raft_consensus.cc:2393] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 10: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:16.147384  2325 raft_consensus.cc:1275] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:15.576011  1648 raft_consensus.cc:2468] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 9.
I20260709 13:00:16.118291  5115 raft_consensus.cc:3060] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:15.598964  1716 raft_consensus.cc:2468] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 9.
I20260709 13:00:15.809849  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 13:00:16.098889  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 558607us
I20260709 13:00:16.149881  1724 raft_consensus.cc:2376] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8. Re-sending same reply.
I20260709 13:00:16.151592  1720 raft_consensus.cc:2468] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 10.
I20260709 13:00:16.152599  1722 raft_consensus.cc:2468] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 7.
I20260709 13:00:16.153535  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:16.154260  1651 raft_consensus.cc:2393] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 8: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
W20260709 13:00:16.136493  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:16.107602  1717 raft_consensus.cc:2468] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
I20260709 13:00:16.160171  5489 leader_election.cc:290] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:15.530089  5340 raft_consensus.cc:493] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.160907  5600 consensus_queue.cc:1048] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:16.161010  5340 raft_consensus.cc:515] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:16.163244  5340 leader_election.cc:290] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:16.164749  1570 raft_consensus.cc:2468] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 11.
W20260709 13:00:16.166118  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 704073us
I20260709 13:00:16.166663  2294 leader_election.cc:304] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:16.171238  2295 leader_election.cc:304] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:15.529610  5582 leader_election.cc:290] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:16.107586  5309 leader_election.cc:290] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:15.599356  5289 raft_consensus.cc:2804] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:16.180874  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:00:16.180648  1542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:16.181504  1725 raft_consensus.cc:2468] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 7.
I20260709 13:00:15.967535  4890 raft_consensus.cc:493] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
W20260709 13:00:16.170007  5601 log.cc:927] Time spent T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.098s	user 0.003s	sys 0.000s
I20260709 13:00:16.186542  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:16.186626  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:16.189476  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:16.192003  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:00:16.175163  1615 connection.cc:256] RPC call timeout handler was delayed by -1.6310644750000165s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18460000000000001s for a response
I20260709 13:00:16.190697  2294 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:00:16.197021  1615 connection.cc:256] RPC call timeout handler was delayed by -1.0473245349999729s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2202s for a response
I20260709 13:00:16.197535  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:16.197656  1717 raft_consensus.cc:3060] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:00:16.202073  2325 raft_consensus.cc:2468] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8.
I20260709 13:00:16.202894  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:16.203748  1615 leader_election.cc:304] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:16.205073  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:16.205585  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:16.206185  1724 raft_consensus.cc:3060] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:16.200887  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:16.206419  1720 raft_consensus.cc:2468] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 10.
I20260709 13:00:16.206866  1718 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:16.208328  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:16.209733  5535 raft_consensus.cc:2749] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:16.211216  2297 leader_election.cc:304] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 13:00:16.210083  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:16.196158  5531 raft_consensus.cc:2749] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:00:16.217739  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 76717.8us
I20260709 13:00:16.218467  5476 raft_consensus.cc:2749] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:16.219306  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:16.190737  5445 consensus_queue.cc:1048] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 13:00:16.195942  5595 raft_consensus.cc:2804] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:16.197189  5581 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.191005  5289 raft_consensus.cc:697] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:16.224843  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:16.224948  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:16.231717  1722 raft_consensus.cc:2393] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 9: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:16.226236  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:00:16.226747  1617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:16.227295  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:16.223661  1720 raft_consensus.cc:2468] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8.
I20260709 13:00:16.228916  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:16.233551  1723 raft_consensus.cc:2393] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 8: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:16.230084  2294 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:16.223255  5575 consensus_queue.cc:1059] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:00:16.241730  5581 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:16.215045  4890 raft_consensus.cc:515] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:16.251780  4890 leader_election.cc:290] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:16.253268  1716 raft_consensus.cc:1240] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:16.255110  1716 raft_consensus.cc:1240] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 5. Current term is 6. Ops: []
W20260709 13:00:16.256403  1617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:16.268757  1719 raft_consensus.cc:2393] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 9: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:16.269358  1716 raft_consensus.cc:1275] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:00:16.273912  1717 raft_consensus.cc:2468] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 11.
I20260709 13:00:16.275358  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:00:16.275905  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 72229.8us
I20260709 13:00:16.276639  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:16.276755  5289 consensus_queue.cc:237] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:16.277410  1615 leader_election.cc:304] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:16.278060  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:16.279335  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:16.279974  1717 raft_consensus.cc:2468] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6.
I20260709 13:00:16.280936  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:16.281206  1720 raft_consensus.cc:1240] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:16.281986  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:16.282160  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:16.283830  1720 raft_consensus.cc:1275] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:00:16.222692  5309 raft_consensus.cc:2804] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:16.286799  1718 raft_consensus.cc:2410] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:00:16.288970  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:16.290079  1722 raft_consensus.cc:2410] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:00:16.291858  1723 raft_consensus.cc:1240] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:16.291886  1724 raft_consensus.cc:2468] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 8.
I20260709 13:00:16.293583  1723 raft_consensus.cc:1240] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 12 LEADER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 10. Current term is 12. Ops: []
I20260709 13:00:16.295925  1718 raft_consensus.cc:1240] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:00:16.299592  1718 raft_consensus.cc:1275] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:00:16.284438  1717 raft_consensus.cc:1240] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:16.312264  1725 raft_consensus.cc:1240] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:16.310642  1716 raft_consensus.cc:1240] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 13:00:16.284715  5476 raft_consensus.cc:2764] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:00:16.314831  1723 raft_consensus.cc:1275] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:00:16.318286  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 87412.5us
I20260709 13:00:16.319819  1719 raft_consensus.cc:1240] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:16.324767  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:16.325649  1575 raft_consensus.cc:2410] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:00:16.287822  5309 raft_consensus.cc:493] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:16.328869  5309 raft_consensus.cc:3060] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:16.332743  5581 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:16.268785  5595 raft_consensus.cc:697] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:16.345613  5595 consensus_queue.cc:237] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:16.350136  5309 raft_consensus.cc:515] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:16.354229  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:16.382483  1615 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:16.382968  1569 raft_consensus.cc:2468] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 9.
I20260709 13:00:16.383932  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:16.384106  1615 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:16.384938  5476 raft_consensus.cc:2749] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:00:16.361268  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 65500.4us
W20260709 13:00:16.388091  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 46756us
I20260709 13:00:16.410445  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:16.411303  1569 raft_consensus.cc:2468] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 5.
I20260709 13:00:16.455322  1568 raft_consensus.cc:1275] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:00:16.455204  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:16.453146  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:16.316159  5598 raft_consensus.cc:2749] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:16.460354  1572 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 11.
W20260709 13:00:16.465545  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 53392.8us
I20260709 13:00:16.466528  2294 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:00:16.467897  1542 leader_election.cc:336] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.668s (SENT)
I20260709 13:00:16.468487  1542 leader_election.cc:304] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:16.470557  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:16.449203  5476 raft_consensus.cc:3060] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:16.471184  2294 leader_election.cc:304] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
W20260709 13:00:16.457176  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 57481.3us
W20260709 13:00:16.487735  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 212415us
W20260709 13:00:16.490371  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 258986us
W20260709 13:00:16.498432  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:16.496225  5535 raft_consensus.cc:2749] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:16.504377  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:16.505259  1567 raft_consensus.cc:2393] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 10: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
W20260709 13:00:16.508358  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:16.508857  5604 log.cc:927] Time spent T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 13:00:16.490489  5531 raft_consensus.cc:2749] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:16.511737  1473 catalog_manager.cc:5697] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:16.504153  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:00:16.498732  1617 leader_election.cc:336] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.013s (SENT)
I20260709 13:00:16.518954  1617 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:16.517592  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:00:16.520991  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 49943us
I20260709 13:00:16.528414  5476 raft_consensus.cc:2749] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:16.529219  5476 raft_consensus.cc:2749] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:16.529525  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
W20260709 13:00:16.530164  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 146179us
I20260709 13:00:16.530185  1648 raft_consensus.cc:3060] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:16.497746  5605 raft_consensus.cc:2749] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:16.506646   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:16.537153  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:16.537981  1651 raft_consensus.cc:2468] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 8.
I20260709 13:00:16.497830  5598 consensus_queue.cc:1048] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:00:16.539604  1571 raft_consensus.cc:2410] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260709 13:00:16.541072  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 53435.5us
I20260709 13:00:16.545289  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:16.545869  2326 raft_consensus.cc:2468] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 10.
I20260709 13:00:16.510627  5563 consensus_queue.cc:1048] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:00:16.553203  1615 leader_election.cc:304] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:16.555770  1648 raft_consensus.cc:2468] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 8.
I20260709 13:00:16.558704  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:16.559957  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:16.560212  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:16.561378  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:16.564885  5565 raft_consensus.cc:493] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.565443  5565 raft_consensus.cc:515] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:16.567364  5565 leader_election.cc:290] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:16.575863  2326 raft_consensus.cc:2468] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 8.
W20260709 13:00:16.577248  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 109387us
I20260709 13:00:16.581902  2294 leader_election.cc:304] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:16.573459  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:16.586315  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:16.587689  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:16.588718  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:16.593779  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:16.594587  1648 raft_consensus.cc:3060] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:16.595780  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 48531.5us
I20260709 13:00:16.592482  5624 raft_consensus.cc:2749] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:16.580912  5531 raft_consensus.cc:493] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:16.605315  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 107727us
W20260709 13:00:16.609974  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:16.609001  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 110711us
I20260709 13:00:16.611671  1539 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:16.612743  5309 leader_election.cc:290] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:16.613278  5580 raft_consensus.cc:3055] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:16.613713  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:16.592780  5620 raft_consensus.cc:2804] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:16.622584  1540 leader_election.cc:304] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:16.627003  1615 leader_election.cc:400] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Vote denied by peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423) with higher term. Message: Invalid argument: T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 7. Current term is 8.
W20260709 13:00:16.626950  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 128378us
I20260709 13:00:16.624366  1719 raft_consensus.cc:3060] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:16.625882  2294 leader_election.cc:304] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:16.630513  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:16.630752  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:16.632354  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:16.632795  1648 raft_consensus.cc:2468] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 9.
I20260709 13:00:16.632980  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:16.637706  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:16.638487  2329 raft_consensus.cc:2393] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 8: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 13:00:16.624171  5580 raft_consensus.cc:740] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:16.612381  5531 raft_consensus.cc:515] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:16.644279  1539 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:16.641569  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:16.641079  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:16.642371  1540 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:16.641181  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:16.645028  1568 raft_consensus.cc:2468] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 9.
I20260709 13:00:16.621829  5011 consensus_queue.cc:1048] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 13:00:16.646893  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 13:00:16.650501  1617 leader_election.cc:336] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.207s (SENT)
I20260709 13:00:16.664884  1617 leader_election.cc:304] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:16.654412  2294 leader_election.cc:304] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:16.633325  5600 raft_consensus.cc:2749] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:00:16.659818  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:16.632447  5620 raft_consensus.cc:697] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:16.636457  5445 raft_consensus.cc:493] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:16.669368  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:16.632252  5615 raft_consensus.cc:2749] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:00:16.694797  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 54793.5us
I20260709 13:00:16.697253  5620 consensus_queue.cc:237] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:16.694692  4890 raft_consensus.cc:2804] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:16.669868  5624 raft_consensus.cc:2749] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:16.699294  4890 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:16.699712  4890 raft_consensus.cc:3060] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:16.699795  5445 raft_consensus.cc:515] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:16.700901  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:16.702050  5445 leader_election.cc:290] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:16.693987  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 83331.5us
I20260709 13:00:16.703518  1615 leader_election.cc:304] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:16.701164  5340 consensus_queue.cc:1048] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:00:16.695691  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
W20260709 13:00:16.705207  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:16.706139  5476 raft_consensus.cc:2764] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:00:16.672910  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:16.699841  2326 raft_consensus.cc:3060] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:16.695808  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:00:16.711021  1615 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:16.711872  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:16.639158  5581 raft_consensus.cc:2804] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:16.726219  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:16.695298  1473 catalog_manager.cc:5697] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } }
I20260709 13:00:16.728991  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:16.729884  1720 raft_consensus.cc:2468] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 8.
I20260709 13:00:16.694096  5563 raft_consensus.cc:2804] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:16.735440  2297 leader_election.cc:304] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 13:00:16.738721  1648 raft_consensus.cc:2468] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 7.
I20260709 13:00:16.744376  2326 raft_consensus.cc:2468] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 12.
I20260709 13:00:16.745620  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:16.753582  1568 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 7.
I20260709 13:00:16.670512  5605 raft_consensus.cc:2804] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:16.767334  1571 raft_consensus.cc:2468] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6.
I20260709 13:00:16.727866  5581 raft_consensus.cc:493] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:16.733773  5531 leader_election.cc:290] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:16.803138  1570 raft_consensus.cc:1275] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
W20260709 13:00:16.800752  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 151974us
I20260709 13:00:16.803118  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 13:00:16.809930  1689 connection.cc:256] RPC call timeout handler was delayed by -1.4397978699999499s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1653s for a response
I20260709 13:00:16.805135  1570 pending_rounds.cc:85] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting all ops after (but not including) 5
I20260709 13:00:16.811594  1570 pending_rounds.cc:107] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:00:16.811828  1570 raft_consensus.cc:2889] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:16.759814  5605 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:16.757041  5563 raft_consensus.cc:697] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
W20260709 13:00:16.810451  1689 connection.cc:256] RPC call timeout handler was delayed by -1.40469786999995s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16920000000000002s for a response
W20260709 13:00:16.823434  1689 connection.cc:256] RPC call timeout handler was delayed by -1.3686978699999486s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17320000000000002s for a response
W20260709 13:00:16.823871  1689 connection.cc:256] RPC call timeout handler was delayed by -1.347997869999972s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1755s for a response
I20260709 13:00:16.824908  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:16.695531  5580 consensus_queue.cc:260] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:16.820255  2330 raft_consensus.cc:2468] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 7.
W20260709 13:00:16.809430  5609 log.cc:927] Time spent T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:00:16.807286  5616 raft_consensus.cc:2804] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:16.773622  1473 catalog_manager.cc:5697] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: config changed from index 6 to 4, term changed from 7 to 6, leader changed from <none> to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from VOTER to NON_VOTER. New cstate: current_term: 6 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:16.804710  5581 raft_consensus.cc:3060] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:16.824249  1689 connection.cc:256] RPC call timeout handler was delayed by -1.3092978699999662s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17980000000000002s for a response
W20260709 13:00:16.835510  1617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:16.846638  1617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:16.822459  5604 log.cc:927] Time spent T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 13:00:16.850252  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 115886us
I20260709 13:00:16.856037  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:16.829718  5605 raft_consensus.cc:3060] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:16.844712  5616 raft_consensus.cc:493] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:16.892664  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:16.902449  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:16.903865  1651 raft_consensus.cc:2468] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 10.
I20260709 13:00:16.890542  1473 catalog_manager.cc:5697] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 4 to 9, leader changed from 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 9 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:16.894640  1615 leader_election.cc:304] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:16.907924  1615 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:16.909268  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:16.909854  1648 raft_consensus.cc:2376] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 10. Re-sending same reply.
I20260709 13:00:16.912936  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 13:00:16.853116  5575 consensus_queue.cc:1175] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "05476b84d8f84d76a9a1f51b620a3c66" responder_term: 8 status { last_received { term: 8 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 8 index: 8 } }
W20260709 13:00:16.913237  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 85554.8us
I20260709 13:00:16.898448  5616 raft_consensus.cc:3060] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:16.924683  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:16.930932  1576 raft_consensus.cc:2368] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 10. Current term is 11.
I20260709 13:00:16.931906  1570 raft_consensus.cc:3060] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:16.935246  1689 leader_election.cc:304] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:16.935449  1648 raft_consensus.cc:1240] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 7. Current term is 8. Ops: []
W20260709 13:00:16.935381  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 179218us
I20260709 13:00:16.906513  5476 consensus_queue.cc:1059] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:00:16.924005  5535 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.947846  1617 leader_election.cc:304] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:16.952459  1539 leader_election.cc:304] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:16.953510  1539 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:16.962332  1570 raft_consensus.cc:2468] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 10.
I20260709 13:00:16.968796  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:16.969846  1575 raft_consensus.cc:2393] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 6: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:16.948215  5624 raft_consensus.cc:2804] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:00:16.977952  5629 log.cc:927] Time spent T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
W20260709 13:00:16.978343  5628 log.cc:927] Time spent T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:00:16.953662  5445 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:16.956133  5623 raft_consensus.cc:2749] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:16.986534  1539 leader_election.cc:304] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:16.957448  5535 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:16.957109  5575 raft_consensus.cc:2804] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:16.994135  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:16.998275  1719 raft_consensus.cc:2468] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 9.
I20260709 13:00:16.966159  5011 raft_consensus.cc:2804] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:00:17.019400  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 111572us
I20260709 13:00:17.021451  1689 leader_election.cc:304] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:16.978350  1468 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48478 (request call id 175) took 10901 ms. Trace:
I20260709 13:00:17.022725  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:17.022274  5476 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:17.024703  5636 consensus_queue.cc:1048] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.042s
W20260709 13:00:17.026873  5115 consensus_meta.cc:287] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.862s	user 0.007s	sys 0.003s
I20260709 13:00:16.913594  5563 consensus_queue.cc:237] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:17.034049  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 47580.4us
W20260709 13:00:17.034354  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:17.039597  5011 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:17.041419  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:17.024300  5640 raft_consensus.cc:493] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:16.964262  5633 consensus_queue.cc:1048] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.083s
I20260709 13:00:16.973248  5624 raft_consensus.cc:493] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:17.048642  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:17.042110  5575 raft_consensus.cc:493] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:17.049675  5635 raft_consensus.cc:2804] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:17.050034  1615 leader_election.cc:304] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:17.050406  5634 raft_consensus.cc:2749] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:17.053007  1539 leader_election.cc:304] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:17.053429  1689 leader_election.cc:304] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:17.049000  5476 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:17.055084  5645 raft_consensus.cc:3055] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:17.055773  5648 raft_consensus.cc:2749] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:00:17.056653  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 111873us
I20260709 13:00:16.999591  5489 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
W20260709 13:00:17.097002  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:17.096611  1719 raft_consensus.cc:1275] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 13:00:17.107250  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 170195us
I20260709 13:00:17.148133  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:17.040666  5445 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:17.174563  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:17.222868  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 169936us
I20260709 13:00:17.062992  5011 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:00:17.220454  1542 leader_election.cc:336] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.507s (SENT)
I20260709 13:00:17.230634  1719 raft_consensus.cc:1275] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:00:17.247753  1542 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:17.186532  5476 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:17.185573  5535 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:17.094861  5575 raft_consensus.cc:3060] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:17.225116  5115 raft_consensus.cc:2804] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:17.226126  5634 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.152303  5645 raft_consensus.cc:740] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:17.226826  5623 raft_consensus.cc:2764] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 13:00:17.187418  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 137443us
I20260709 13:00:17.238502  1570 raft_consensus.cc:3060] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:17.248420  5637 raft_consensus.cc:476] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 LEADER]: Not starting pre-election -- already a leader
W20260709 13:00:17.305509  1617 leader_election.cc:336] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.553s (SENT)
I20260709 13:00:17.095080  5624 raft_consensus.cc:3060] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:17.173730  5639 consensus_queue.cc:1048] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.225s
I20260709 13:00:17.063482  4890 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:17.279170  5638 raft_consensus.cc:493] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.227066  5646 raft_consensus.cc:493] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.272909  5644 raft_consensus.cc:2749] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:17.182720  5605 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:17.101760  5635 raft_consensus.cc:493] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:17.178551  5616 raft_consensus.cc:515] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:17.095605  5640 raft_consensus.cc:515] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:17.282366  5650 raft_consensus.cc:2804] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:17.274560  5445 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:17.180503  5581 raft_consensus.cc:515] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:17.344659  5581 leader_election.cc:290] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:17.314342  5115 raft_consensus.cc:697] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:17.346169  5115 consensus_queue.cc:237] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:17.348799  1571 raft_consensus.cc:2368] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 8. Current term is 9.
I20260709 13:00:17.188560  5489 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:17.350603  5489 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:00:17.335757  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:17.326393  5646 raft_consensus.cc:515] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:17.340793  5636 raft_consensus.cc:2749] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:00:17.365630  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 46885.9us
W20260709 13:00:17.334875  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 103559us
I20260709 13:00:17.377153  5563 consensus_queue.cc:1048] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:17.380718  5656 consensus_queue.cc:1048] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:17.384400  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:17.385133  2328 raft_consensus.cc:2468] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 12.
I20260709 13:00:17.332818  5635 raft_consensus.cc:3060] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:17.298031  5634 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:17.335533  5650 raft_consensus.cc:493] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:17.040405  1468 rpcz_store.cc:276] 0709 13:00:06.055667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.055925 (+   258us) service_pool.cc:224] Handling call
0709 13:00:16.956715 (+10900790us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:14.536017 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:14.536785 (+   768us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:14.536852 (+    67us) write_op.cc:435] Acquired schema lock
0709 13:00:14.536910 (+    58us) tablet.cc:662] Decoding operations
0709 13:00:14.645671 (+108761us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:14.660036 (+ 14365us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:14.660646 (+   610us) tablet.cc:685] Acquiring locks for 17 operations
0709 13:00:14.889797 (+229151us) tablet.cc:701] Row locks acquired
0709 13:00:14.896456 (+  6659us) write_op.cc:260] PREPARE: finished
0709 13:00:14.899116 (+  2660us) write_op.cc:270] Start()
0709 13:00:14.915661 (+ 16545us) write_op.cc:276] Timestamp: P: 1783602014899048 usec, L: 0
0709 13:00:14.915703 (+    42us) op_driver.cc:348] REPLICATION: starting
0709 13:00:14.954586 (+ 38883us) log.cc:844] Serialized 6757 byte log entry
0709 13:00:15.389201 (+434615us) op_driver.cc:464] REPLICATION: finished
0709 13:00:15.989345 (+600144us) write_op.cc:301] APPLY: starting
0709 13:00:15.989446 (+   101us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:15.990731 (+  1285us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:15.990856 (+   125us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:16.218944 (+228088us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:16.219297 (+   353us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=34
0709 13:00:16.219345 (+    48us) write_op.cc:312] APPLY: finished
0709 13:00:16.219753 (+   408us) log.cc:844] Serialized 119 byte log entry
0709 13:00:16.219954 (+   201us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:16.220112 (+   158us) write_op.cc:454] Released schema lock
0709 13:00:16.220183 (+    71us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:16.225800 (+  5617us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:16.228444 (+  2644us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":91525,"reported_tablets":34,"child_traces":[["op",{"apply.queue_time_us":599797,"apply.run_cpu_time_us":5630,"apply.run_wall_time_us":231689,"num_ops":17,"prepare.queue_time_us":168671,"prepare.run_cpu_time_us":17836,"prepare.run_wall_time_us":461413,"raft.queue_time_us":85847,"raft.run_cpu_time_us":35249,"raft.run_wall_time_us":359817,"replication_time_us":473309,"thread_start_us":549840,"threads_started":4,"wal-append.queue_time_us":91611,"wal-append.run_cpu_time_us":17752,"wal-append.run_wall_time_us":2232253}]]}
I20260709 13:00:17.416954  1570 raft_consensus.cc:2468] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 7.
W20260709 13:00:17.417207  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 363826us
W20260709 13:00:17.460178  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:17.334529  5647 consensus_queue.cc:1059] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
W20260709 13:00:17.418965  5652 log.cc:927] Time spent T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
W20260709 13:00:17.419734  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:17.463219  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 54021.6us
I20260709 13:00:17.463888  1615 leader_election.cc:304] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 13:00:17.428946  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 208520us
W20260709 13:00:17.465369  1542 leader_election.cc:336] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.536s (SENT)
I20260709 13:00:17.324793  5638 raft_consensus.cc:515] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:17.459096  1617 leader_election.cc:336] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.921s (SENT)
I20260709 13:00:17.474656  1617 leader_election.cc:304] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:17.466785  1689 leader_election.cc:304] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:17.471439  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:17.475657  2326 raft_consensus.cc:3060] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:17.486119  2326 raft_consensus.cc:2468] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 9.
I20260709 13:00:17.472788  1540 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:17.490593  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:17.494606  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:17.495347  1575 raft_consensus.cc:2468] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 12.
I20260709 13:00:17.501456  1540 leader_election.cc:304] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:17.502498  1719 raft_consensus.cc:1275] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:00:17.518057  1648 raft_consensus.cc:2468] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 11.
I20260709 13:00:17.462471  5650 raft_consensus.cc:3060] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:17.519804  2294 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
W20260709 13:00:17.520670  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:17.471987  5476 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:17.520884  1573 raft_consensus.cc:1275] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:00:17.524837  1573 pending_rounds.cc:85] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting all ops after (but not including) 6
I20260709 13:00:17.525193  1573 pending_rounds.cc:107] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:00:17.525486  1573 raft_consensus.cc:2889] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:17.528463  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 208502us
I20260709 13:00:17.498274  5581 raft_consensus.cc:2804] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:17.549666  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:17.550420  1646 raft_consensus.cc:2468] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 9.
W20260709 13:00:17.562469  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 95770us
W20260709 13:00:17.568041  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 102689us
I20260709 13:00:17.415973  5645 consensus_queue.cc:260] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:17.573832  5640 leader_election.cc:290] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:00:17.587805  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:17.568799  1542 leader_election.cc:336] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.572s (SENT)
I20260709 13:00:17.591868  1542 leader_election.cc:304] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:17.548928  5581 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:17.595060  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 131240us
I20260709 13:00:17.572441  5645 raft_consensus.cc:3060] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:17.613297  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 44518.2us
I20260709 13:00:17.575196  5600 raft_consensus.cc:2804] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:17.567802  5648 raft_consensus.cc:2804] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:00:17.614007  1542 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.725s (SENT) [suppressed 43 similar messages]
I20260709 13:00:17.617306  5657 raft_consensus.cc:2804] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:17.618005  5671 raft_consensus.cc:2764] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:00:17.620293  5665 raft_consensus.cc:2749] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:17.620802  5616 leader_election.cc:290] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:17.621546  5605 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:17.562659  5476 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:17.622294  5011 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:17.623764  5476 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:17.624703  5011 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:17.624874  4890 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:17.626389  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 55744.1us
I20260709 13:00:17.627319  1689 leader_election.cc:304] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:17.601949  5581 raft_consensus.cc:3060] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:17.625741  1539 leader_election.cc:304] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 13:00:17.604810  5620 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.859s	user 0.010s	sys 0.027s
W20260709 13:00:17.625784  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 107879us
W20260709 13:00:17.646929  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 48313.5us
W20260709 13:00:17.647790  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 188715us
I20260709 13:00:17.648540  1539 leader_election.cc:304] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 13:00:17.649626  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:17.627142  5600 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:17.626830  5648 raft_consensus.cc:493] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:17.642764  5620 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.935s	user 0.014s	sys 0.032s
I20260709 13:00:17.651470  5605 raft_consensus.cc:2804] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:00:17.694128  1542 leader_election.cc:336] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.123s (SENT)
I20260709 13:00:17.652503  5638 leader_election.cc:290] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:17.659799  5654 raft_consensus.cc:2749] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:17.660753  5634 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:17.661273  5679 raft_consensus.cc:2749] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:17.660880  5666 consensus_queue.cc:1048] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:00:17.669140  5646 leader_election.cc:290] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:17.628710  5640 raft_consensus.cc:493] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:17.651115  1617 leader_election.cc:336] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.957s (SENT)
I20260709 13:00:17.723562  1617 leader_election.cc:304] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
W20260709 13:00:17.683169  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:17.693928  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 90530.3us
I20260709 13:00:17.725557  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:17.727448  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:17.728246  1651 raft_consensus.cc:2468] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 11.
W20260709 13:00:17.695386  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 68167.4us
I20260709 13:00:17.630718  5657 raft_consensus.cc:697] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:17.694020  5648 raft_consensus.cc:3060] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:17.703850  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 180099us
I20260709 13:00:17.692723  5615 raft_consensus.cc:493] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.693131  5600 raft_consensus.cc:3060] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:17.695989  5665 raft_consensus.cc:2804] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:00:17.713390  1542 leader_election.cc:336] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.014s (SENT)
I20260709 13:00:17.716061  5580 raft_consensus.cc:3060] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:17.696120  5605 raft_consensus.cc:493] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:17.749784  5581 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:17.750319  5657 consensus_queue.cc:237] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:17.753880  1542 leader_election.cc:304] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:17.788990  2325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53306 (request call id 671) took 1106 ms. Trace:
I20260709 13:00:17.791698  1689 leader_election.cc:304] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:17.789551  2325 rpcz_store.cc:276] 0709 13:00:16.672507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.672624 (+   117us) service_pool.cc:224] Handling call
0709 13:00:17.778774 (+1106150us) spinlock_profiling.cc:243] Waited 552 ms on lock 0x7b5400690354. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:17.778997 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1270604544}
W20260709 13:00:17.789161  5675 log.cc:927] Time spent T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 13:00:17.695875  5624 raft_consensus.cc:515] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:17.809365  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 158286us
W20260709 13:00:17.810190  1617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:17.810564  1617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:17.780567  5679 raft_consensus.cc:2749] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:00:17.812371  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 292619us
I20260709 13:00:17.790729  5605 raft_consensus.cc:3060] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:17.731410  5640 raft_consensus.cc:515] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:17.809054  5654 raft_consensus.cc:2804] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:17.822492  5654 raft_consensus.cc:697] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 8 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:17.832448  5581 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:17.831988  5654 consensus_queue.cc:237] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:17.836790  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 123436us
W20260709 13:00:17.837698  1542 leader_election.cc:336] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.240s (SENT)
I20260709 13:00:17.838145  1542 leader_election.cc:304] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:17.808629  5340 raft_consensus.cc:2749] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:17.751830  5595 consensus_queue.cc:1048] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:00:17.806648  5665 raft_consensus.cc:697] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
W20260709 13:00:17.840965  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 58285.8us
W20260709 13:00:17.840425  5575 consensus_meta.cc:287] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.537s	user 0.011s	sys 0.000s
I20260709 13:00:17.779232  5615 raft_consensus.cc:515] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:17.857703  1689 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
W20260709 13:00:17.864516  1617 leader_election.cc:336] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.070s (SENT)
I20260709 13:00:17.864984  1617 leader_election.cc:304] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:17.871754  5615 leader_election.cc:290] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:17.861785  5620 raft_consensus.cc:493] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:17.866614  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:17.874744  1689 leader_election.cc:304] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
W20260709 13:00:17.875200  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:17.875042  1648 raft_consensus.cc:2468] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 9.
I20260709 13:00:17.875663  1689 leader_election.cc:304] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:17.875932  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:17.876746  2328 raft_consensus.cc:2393] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 10: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 13:00:17.876663  5623 raft_consensus.cc:2749] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:17.878656  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:17.879418  5646 raft_consensus.cc:2749] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:17.880074  5460 raft_consensus.cc:2804] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:17.880513  5663 raft_consensus.cc:2749] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:17.880761  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:17.879431  1721 raft_consensus.cc:2468] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 10.
I20260709 13:00:17.882948  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:17.883507  1725 raft_consensus.cc:2468] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
I20260709 13:00:17.884296  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:17.884919  1716 raft_consensus.cc:2468] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6.
I20260709 13:00:17.885306  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
W20260709 13:00:17.885766  1617 leader_election.cc:336] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.247s (SENT)
I20260709 13:00:17.886638  1651 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:17.886740  1617 leader_election.cc:304] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:17.864236  5575 raft_consensus.cc:515] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 13:00:17.868963  5476 raft_consensus.cc:2749] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:17.889930  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:17.868352  5681 raft_consensus.cc:493] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.908946  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:17.909289  5659 raft_consensus.cc:2749] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:17.909772  1725 raft_consensus.cc:2393] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 7: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:17.904677  5665 consensus_queue.cc:237] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:17.909737  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:17.903041  1648 raft_consensus.cc:3060] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:17.912570  1716 raft_consensus.cc:2376] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 10. Re-sending same reply.
I20260709 13:00:17.908766  5681 raft_consensus.cc:515] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:17.913633  1651 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 12.
I20260709 13:00:17.913916  1718 raft_consensus.cc:1275] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:17.880594  5460 raft_consensus.cc:697] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 7 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:17.915540  5620 raft_consensus.cc:515] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:17.923097  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:17.923557  1724 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 9.
I20260709 13:00:17.924101  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:17.924455  1724 raft_consensus.cc:2468] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 9.
I20260709 13:00:17.925499  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:17.925623  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:17.856441  5600 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:17.926074  1717 raft_consensus.cc:2468] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8.
I20260709 13:00:17.943284  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:17.943858  1722 raft_consensus.cc:2376] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 9. Re-sending same reply.
I20260709 13:00:17.945720  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:17.946071  1689 leader_election.cc:304] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:17.946372  1724 raft_consensus.cc:2468] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 9.
I20260709 13:00:17.946969  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:17.947522  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:17.948210  1717 raft_consensus.cc:2410] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:00:17.948143  1724 raft_consensus.cc:2468] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8.
I20260709 13:00:17.948226  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:17.949090  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:17.949434  1725 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 11.
I20260709 13:00:17.882464  5635 raft_consensus.cc:515] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:17.949692  1724 raft_consensus.cc:2468] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 9.
I20260709 13:00:17.951803  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:17.952471  1722 raft_consensus.cc:2468] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 10.
I20260709 13:00:17.955734  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:17.956456  1717 raft_consensus.cc:2393] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 8: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:17.956393  1648 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 10.
I20260709 13:00:17.957379  5460 consensus_queue.cc:237] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:17.963601  1542 leader_election.cc:304] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:17.925169  2330 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c"
dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
mode: GRACEFUL
new_leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:39778
I20260709 13:00:17.966805  2330 raft_consensus.cc:606] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Received request to transfer leadership to TS 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:17.967229  2330 raft_consensus.cc:614] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:17.955114  5659 consensus_queue.cc:1048] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:00:17.969718  5648 raft_consensus.cc:515] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:17.970625  5650 raft_consensus.cc:515] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:17.971982  1689 leader_election.cc:304] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:17.953677  5646 raft_consensus.cc:2804] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:17.978475  5659 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:17.979031  5659 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:17.979473  5635 leader_election.cc:290] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:17.981487  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:17.982050  1649 raft_consensus.cc:3060] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:00:17.990039  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:17.990873  1648 raft_consensus.cc:3060] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:00:17.971982  5605 raft_consensus.cc:515] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:17.993134  5340 raft_consensus.cc:2804] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:00:17.999396  5688 log.cc:927] Time spent T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 13:00:17.999583  5340 raft_consensus.cc:493] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:18.000105  5340 raft_consensus.cc:3060] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:18.000257  5605 leader_election.cc:290] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:17.992583  5580 consensus_queue.cc:1048] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:00:17.951468  5615 consensus_queue.cc:1059] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:00:18.009908  5615 raft_consensus.cc:3055] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:18.010418  5615 raft_consensus.cc:740] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:18.024873  1649 raft_consensus.cc:2468] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 11.
I20260709 13:00:18.032060  5340 raft_consensus.cc:515] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:18.034297  5340 leader_election.cc:290] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:17.982477  5646 raft_consensus.cc:493] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:18.040838  5646 raft_consensus.cc:3060] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:18.045071  5575 leader_election.cc:290] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:18.047951  5600 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:18.050532  5620 leader_election.cc:290] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:18.053422  5681 leader_election.cc:290] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:17.994527  5623 raft_consensus.cc:2749] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:17.993040  5115 consensus_queue.cc:1048] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:00:18.064313  5620 raft_consensus.cc:493] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:18.077349  5620 raft_consensus.cc:515] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:18.080020  5620 leader_election.cc:290] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:18.016804  5640 leader_election.cc:290] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:18.082414  5687 consensus_queue.cc:1059] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:18.083530  5687 consensus_queue.cc:1048] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:18.083853  5680 raft_consensus.cc:3055] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:18.085175  5687 consensus_queue.cc:1059] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:18.085955  1617 leader_election.cc:304] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:18.086614  5649 raft_consensus.cc:3055] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:18.087054  5649 raft_consensus.cc:740] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
W20260709 13:00:18.087255  1615 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:18.088191  5662 raft_consensus.cc:2749] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:18.088099  5649 consensus_queue.cc:260] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:18.089578  1723 raft_consensus.cc:3055] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:18.090039  1723 raft_consensus.cc:740] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:18.084331  5680 raft_consensus.cc:740] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:18.090826  1723 consensus_queue.cc:260] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:18.091547  5634 consensus_queue.cc:1059] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:18.092010  1723 raft_consensus.cc:3060] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:18.089576  5649 raft_consensus.cc:3060] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:18.095367  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:18.100929  1722 raft_consensus.cc:2468] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 7.
I20260709 13:00:18.096093  5624 leader_election.cc:290] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:18.101765  1651 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0"
dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
mode: GRACEFUL
new_leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:35470
I20260709 13:00:18.102497  1651 raft_consensus.cc:606] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Received request to transfer leadership to TS 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:18.091857  5680 consensus_queue.cc:260] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:18.102918  1651 raft_consensus.cc:614] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:18.104117  5650 leader_election.cc:290] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:18.044395  5689 log.cc:927] Time spent T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 13:00:18.097393  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:18.105701  1542 leader_election.cc:304] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:18.106616  2330 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "608abea191d946228bed666c5560fd0a"
dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
mode: GRACEFUL
new_leader_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:39778
I20260709 13:00:18.107223  2330 raft_consensus.cc:606] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 LEADER]: Received request to transfer leadership to TS 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:18.011677  5615 consensus_queue.cc:260] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:18.110792  5582 raft_consensus.cc:2749] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:18.113656  5648 leader_election.cc:290] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:18.070461  1539 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 13:00:18.115037  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 44675.8us
W20260709 13:00:18.117285  5684 log.cc:927] Time spent T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.235s	user 0.002s	sys 0.000s
I20260709 13:00:18.117748  1643 raft_consensus.cc:1275] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:00:18.124171  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 152285us
I20260709 13:00:18.132669  1542 leader_election.cc:304] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:18.132930  5624 raft_consensus.cc:493] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:18.133260  5476 raft_consensus.cc:493] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:18.133436  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:18.133526  5624 raft_consensus.cc:515] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:18.134714  5681 raft_consensus.cc:493] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.135164  5681 raft_consensus.cc:515] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:18.135805  5624 leader_election.cc:290] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:18.136969  1646 raft_consensus.cc:1275] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:18.139004  5663 raft_consensus.cc:2804] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:18.139324  5563 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.139695  5663 raft_consensus.cc:493] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:18.140129  5663 raft_consensus.cc:3060] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:18.139889  5563 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:18.140960  5476 raft_consensus.cc:515] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 13:00:18.142807  5563 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:18.142946  5476 leader_election.cc:290] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373)
I20260709 13:00:18.143904  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:18.136875  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:18.144578  1720 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 9.
I20260709 13:00:18.144905  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:18.145454  1643 raft_consensus.cc:3060] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:18.144934  1649 raft_consensus.cc:3060] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:00:18.138827  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:18.151463  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:18.152180  1646 raft_consensus.cc:3060] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:00:18.149876  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:18.153800  1651 raft_consensus.cc:3060] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:18.155668  1689 leader_election.cc:304] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:18.152365  1539 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:18.152107  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:18.167960  1648 raft_consensus.cc:2468] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 13.
I20260709 13:00:18.122370  5580 raft_consensus.cc:2804] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:18.172089  1650 raft_consensus.cc:3060] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:18.180183  1539 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:18.186120  1651 raft_consensus.cc:2468] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 11.
I20260709 13:00:18.187597  1542 leader_election.cc:400] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: Vote denied by peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473) with higher term. Message: Invalid argument: T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 6. Current term is 7.
I20260709 13:00:18.189316  1542 leader_election.cc:304] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:18.191115  1542 leader_election.cc:304] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:18.137540  5680 raft_consensus.cc:3060] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:18.193908  1542 leader_election.cc:304] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:18.195190  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:18.196621  1539 leader_election.cc:304] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:18.201726  1649 raft_consensus.cc:2468] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 9.
I20260709 13:00:18.139204  5655 raft_consensus.cc:493] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:18.204761  2325 raft_consensus.cc:1275] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:00:18.205971  2330 raft_consensus.cc:1240] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 LEADER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:18.209601  1649 raft_consensus.cc:1275] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:00:18.176584  5615 raft_consensus.cc:3060] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:18.211154  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 82577.5us
I20260709 13:00:18.178339  5582 raft_consensus.cc:2804] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:18.195955  5605 raft_consensus.cc:2804] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:18.220903  1643 raft_consensus.cc:2468] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 10.
I20260709 13:00:18.229059  1689 leader_election.cc:304] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:18.228565  2325 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f"
dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
mode: GRACEFUL
new_leader_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:39778
I20260709 13:00:18.229993  2325 raft_consensus.cc:606] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Received request to transfer leadership to TS 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:18.206564  5640 raft_consensus.cc:2804] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:00:18.208763  5647 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 13:00:18.206008  5011 raft_consensus.cc:3060] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:18.195294  5340 consensus_queue.cc:1048] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:00:18.162171  5646 raft_consensus.cc:515] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:18.209685  5635 raft_consensus.cc:2804] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:18.223654  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:18.235179  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:18.230430  2325 raft_consensus.cc:614] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:18.252942  2328 raft_consensus.cc:2393] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 12: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
W20260709 13:00:18.241354  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 51226.1us
I20260709 13:00:18.227186  5575 raft_consensus.cc:2804] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:18.206102  5581 consensus_queue.cc:1048] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:00:18.230958  5582 raft_consensus.cc:697] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:18.238736  5654 raft_consensus.cc:2749] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:18.264922  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:18.235332  5640 raft_consensus.cc:493] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:18.242643  5681 leader_election.cc:290] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:18.212595  5655 raft_consensus.cc:515] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:18.253579  5635 raft_consensus.cc:493] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:18.285573  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:18.258791  5575 raft_consensus.cc:493] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:18.279881  5657 raft_consensus.cc:2804] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:18.280320  5640 raft_consensus.cc:3060] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:00:18.301318  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 81456.7us
I20260709 13:00:18.307536  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:18.308395  2330 raft_consensus.cc:2468] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 12.
I20260709 13:00:18.299042  5353 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:18.309993  1615 leader_election.cc:304] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:18.312116  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:18.297549  5635 raft_consensus.cc:3060] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:18.299273  5575 raft_consensus.cc:3060] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:18.367398  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 173560us
W20260709 13:00:18.301523  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 213879us
I20260709 13:00:18.295823  5620 raft_consensus.cc:493] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:18.325800  1689 leader_election.cc:304] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:18.378818  1542 leader_election.cc:304] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:18.386204  1542 leader_election.cc:304] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:18.392161  1571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36642 (request call id 2387) took 1537 ms. Trace:
I20260709 13:00:18.392769  1571 rpcz_store.cc:276] 0709 13:00:16.845731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.845883 (+   152us) service_pool.cc:224] Handling call
0709 13:00:18.383084 (+1537201us) spinlock_profiling.cc:243] Waited 491 ms on lock 0x7b5400314a54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:18.383272 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1128825600}
I20260709 13:00:18.314536  5657 raft_consensus.cc:697] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:18.404263  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:18.412822  1568 raft_consensus.cc:3060] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:18.320727  5681 raft_consensus.cc:2804] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:18.414309  5624 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.456063  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:18.377080  5565 raft_consensus.cc:493] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:18.456235  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:18.457666  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:18.384017  5580 raft_consensus.cc:697] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:18.438520  2294 leader_election.cc:304] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4
W20260709 13:00:18.458900  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 152579us
I20260709 13:00:18.458413  1648 raft_consensus.cc:2393] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 10: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:18.313584  5353 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:18.387429  5340 consensus_queue.cc:1048] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 13:00:18.456775  5683 consensus_queue.cc:1048] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:00:18.392423  5620 raft_consensus.cc:515] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:18.484078  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:18.476727  1689 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:18.478595  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:18.488406  1570 raft_consensus.cc:1275] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:00:18.486137  1650 raft_consensus.cc:2468] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8.
I20260709 13:00:18.491837  1576 raft_consensus.cc:2393] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 10: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
W20260709 13:00:18.462066  5668 log.cc:927] Time spent T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:00:18.494338  1688 leader_election.cc:304] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:18.458727  5681 raft_consensus.cc:493] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:18.532656  5666 raft_consensus.cc:2804] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:18.533377  5681 raft_consensus.cc:3060] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:18.533607  5666 raft_consensus.cc:697] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:18.534844  5666 consensus_queue.cc:237] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:18.411082  5654 raft_consensus.cc:2749] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:18.537251  5654 raft_consensus.cc:2764] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:00:18.523528  5646 leader_election.cc:290] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:18.477258  5624 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:18.381028  5582 consensus_queue.cc:237] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:18.541754  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 155635us
I20260709 13:00:18.516016  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:18.544759  1542 leader_election.cc:304] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
W20260709 13:00:18.532748  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 94306.6us
W20260709 13:00:18.543020  1617 leader_election.cc:336] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.619s (SENT)
I20260709 13:00:18.545567  1647 raft_consensus.cc:2468] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 9.
I20260709 13:00:18.545878  1617 leader_election.cc:304] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:00:18.552963  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 58689.8us
I20260709 13:00:18.472155  5709 raft_consensus.cc:493] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:18.486124  5565 raft_consensus.cc:515] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:18.557953  5655 leader_election.cc:290] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:18.558251  5565 leader_election.cc:290] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:18.555634  5709 raft_consensus.cc:515] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:18.560353  5709 leader_election.cc:290] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:18.491245  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 216953us
I20260709 13:00:18.564862  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:18.565992  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:18.566035  5676 raft_consensus.cc:3055] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:18.566561  5676 raft_consensus.cc:740] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:18.567380  5676 consensus_queue.cc:260] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:18.541651  5665 raft_consensus.cc:2804] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:18.568859  5665 raft_consensus.cc:493] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:18.569286  5665 raft_consensus.cc:3060] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:18.569396  1539 leader_election.cc:304] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:18.570289  1539 leader_election.cc:304] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:18.570499  1615 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:00:18.574622  1617 leader_election.cc:336] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.690s (SENT)
I20260709 13:00:18.576632  1568 raft_consensus.cc:2468] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 13.
I20260709 13:00:18.486909  5581 raft_consensus.cc:493] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:18.568296  5676 raft_consensus.cc:3060] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:18.585088  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:00:18.596000  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:18.568138  5663 raft_consensus.cc:515] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:18.604607  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 59971.7us
I20260709 13:00:18.572439  5620 leader_election.cc:290] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:18.571653  5687 raft_consensus.cc:2749] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:18.583017  5623 raft_consensus.cc:2804] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:18.609671  1570 raft_consensus.cc:1240] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:18.604812  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:18.621855  2323 raft_consensus.cc:2410] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:00:18.622452  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:18.586711  5649 raft_consensus.cc:2749] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:18.547425  5600 consensus_queue.cc:1048] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.066s
W20260709 13:00:18.687472  1646 consensus_meta.cc:287] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.525s	user 0.009s	sys 0.001s
I20260709 13:00:18.688217  1646 raft_consensus.cc:2468] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 13.
I20260709 13:00:18.694160  5353 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:18.532181  5580 consensus_queue.cc:237] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:18.695050  2323 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a"
dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
mode: GRACEFUL
new_leader_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:39778
I20260709 13:00:18.689596  5600 consensus_queue.cc:1243] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:00:18.694263  5620 raft_consensus.cc:493] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.697157  5713 raft_consensus.cc:2804] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:18.697373  5620 raft_consensus.cc:515] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:18.614076  5657 consensus_queue.cc:237] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:18.698529  5708 raft_consensus.cc:3060] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:18.699538  5620 leader_election.cc:290] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:18.606215  5581 raft_consensus.cc:515] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:18.730747  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:18.713420  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:18.738754  2331 raft_consensus.cc:3060] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:18.739151  2330 raft_consensus.cc:3060] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:18.739794  5575 raft_consensus.cc:515] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:18.741737  1574 raft_consensus.cc:1240] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:18.732585  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:18.721808  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:18.726140  5713 raft_consensus.cc:697] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:18.742722  5575 leader_election.cc:290] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:18.740036  5563 consensus_queue.cc:1048] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:18.743333  2297 leader_election.cc:304] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:18.743139  5713 consensus_queue.cc:237] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 13:00:18.744464  5563 raft_consensus.cc:2804] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:18.744417  2297 leader_election.cc:304] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:18.744952  5563 raft_consensus.cc:493] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:18.745343  5563 raft_consensus.cc:3060] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:18.745674  5620 raft_consensus.cc:2749] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:18.730046  5659 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:18.747891  2328 raft_consensus.cc:3060] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:18.709025  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:18.750569  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:18.751094  1569 raft_consensus.cc:3060] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:18.732142  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:18.754098  5581 leader_election.cc:290] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:18.627759  5623 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:18.758275  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:18.758665  2328 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 10.
I20260709 13:00:18.760557  2331 raft_consensus.cc:2468] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 13.
W20260709 13:00:18.709347  5696 log.cc:927] Time spent T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
W20260709 13:00:18.701356  5697 log.cc:927] Time spent T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.209s	user 0.001s	sys 0.000s
I20260709 13:00:18.720624  5011 raft_consensus.cc:2749] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:18.770710  5623 raft_consensus.cc:3060] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:18.775081  2330 raft_consensus.cc:2468] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 11.
W20260709 13:00:18.709363  1542 connection.cc:256] RPC call timeout handler was delayed by -1.0778957409999634s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1535s for a response
I20260709 13:00:18.804265  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:18.809574  1719 pending_rounds.cc:85] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4: Aborting all ops after (but not including) 7
I20260709 13:00:18.815989  1719 pending_rounds.cc:107] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:00:18.816241  1719 raft_consensus.cc:2889] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:18.816293  1718 raft_consensus.cc:2393] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 10: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
W20260709 13:00:18.785110  5695 log.cc:927] Time spent T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.369s	user 0.002s	sys 0.000s
W20260709 13:00:18.820559  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 344123us
W20260709 13:00:18.819239  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 249000us
I20260709 13:00:18.821321  1689 leader_election.cc:304] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:00:18.805706  5680 consensus_meta.cc:287] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.593s	user 0.011s	sys 0.000s
W20260709 13:00:18.807570  5605 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.003s	sys 0.008s
I20260709 13:00:18.789412  5624 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:18.783512  5708 raft_consensus.cc:2749] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:00:18.825762  1615 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:18.795475  5340 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:18.769349  5635 raft_consensus.cc:515] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:18.828282  5605 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.003s	sys 0.008s
I20260709 13:00:18.837003  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:18.838181  5605 raft_consensus.cc:697] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:18.837503  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:18.839063  5605 consensus_queue.cc:237] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:18.836620  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:18.842133  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:18.846570  1648 raft_consensus.cc:1275] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:00:18.845438  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 1776) took 1107 ms. Trace:
I20260709 13:00:18.785594  5563 raft_consensus.cc:515] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:18.851541  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:18.857750  1567 raft_consensus.cc:1240] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:18.855887  1644 raft_consensus.cc:2468] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 11.
I20260709 13:00:18.835180  5646 raft_consensus.cc:2749] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:18.863901  5681 raft_consensus.cc:515] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:18.861369  1689 leader_election.cc:304] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:18.862267  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:18.882356  5717 raft_consensus.cc:2749] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:18.884914  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:18.886200  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:18.887276  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:18.887841  1576 raft_consensus.cc:2468] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 7.
I20260709 13:00:18.888823  5722 consensus_queue.cc:1048] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:00:18.890254  5694 log.cc:927] Time spent T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.620s	user 0.008s	sys 0.005s
I20260709 13:00:18.892292  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:18.896047  5663 leader_election.cc:290] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:00:18.901314  5715 log.cc:927] Time spent T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:00:18.908895  1576 raft_consensus.cc:3060] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:18.912554  1617 leader_election.cc:336] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.760s (SENT)
I20260709 13:00:18.913126  1617 leader_election.cc:304] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:18.915241  5563 leader_election.cc:290] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:18.916394  5655 raft_consensus.cc:993] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66: : Instructing follower 0c7751452c4b46afa95251b9df7169d4 to start an election
I20260709 13:00:18.916862  5655 raft_consensus.cc:1081] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 LEADER]: Signalling peer 0c7751452c4b46afa95251b9df7169d4 to start an election
I20260709 13:00:18.920624  5712 raft_consensus.cc:2804] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:18.921249  5712 raft_consensus.cc:697] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:18.922084  5712 consensus_queue.cc:237] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:18.876022  5640 consensus_meta.cc:287] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.556s	user 0.009s	sys 0.000s
I20260709 13:00:18.843971  5340 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:18.881912  5615 consensus_meta.cc:287] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.666s	user 0.004s	sys 0.006s
W20260709 13:00:18.924016  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 62712.3us
I20260709 13:00:18.931880  1689 leader_election.cc:304] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:18.934862  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:18.926115  1723 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "608abea191d946228bed666c5560fd0a"
dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:58782
I20260709 13:00:18.935650  1723 raft_consensus.cc:493] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:18.936066  1723 raft_consensus.cc:3060] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:18.926278  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:18.934934  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:18.937119  1716 raft_consensus.cc:3060] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:18.932914  5646 raft_consensus.cc:3060] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:18.938971  1570 raft_consensus.cc:2468] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 9.
W20260709 13:00:18.924583  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 189862us
I20260709 13:00:18.954479  1540 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 13:00:18.955173  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 157379us
W20260709 13:00:18.955837  1542 leader_election.cc:336] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.578s (SENT)
I20260709 13:00:18.960687  2323 raft_consensus.cc:606] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Received request to transfer leadership to TS 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:18.963378  1569 raft_consensus.cc:2468] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 10.
W20260709 13:00:18.977988  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 46237us
W20260709 13:00:18.979717  1542 leader_election.cc:336] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.716s (SENT)
W20260709 13:00:18.980976  1542 leader_election.cc:336] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.775s (SENT)
W20260709 13:00:18.982424  1542 leader_election.cc:336] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.831s (SENT)
W20260709 13:00:18.983477  1542 leader_election.cc:336] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.853s (SENT)
I20260709 13:00:18.984449  1689 leader_election.cc:304] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:18.989081  1569 raft_consensus.cc:1240] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:18.990461  1723 raft_consensus.cc:515] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:19.004207  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:19.004907  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:19.005335  1615 leader_election.cc:304] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:19.005638  1575 raft_consensus.cc:2393] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 12: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:19.007158  1723 leader_election.cc:290] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:18.928781  5640 raft_consensus.cc:515] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:19.015168  1689 leader_election.cc:304] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:19.007040  5620 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:19.020699  1716 raft_consensus.cc:2468] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 8.
I20260709 13:00:19.028065  1689 leader_election.cc:304] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:19.042529  1575 raft_consensus.cc:1240] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:19.045379  5654 raft_consensus.cc:2749] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:19.016955  5717 raft_consensus.cc:2749] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:19.032068  5620 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:19.051559  1568 raft_consensus.cc:1240] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:19.053041  5620 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:00:19.054916  5736 log.cc:927] Time spent T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
W20260709 13:00:19.055224  5702 log.cc:927] Time spent T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.597s	user 0.007s	sys 0.000s
I20260709 13:00:19.057524  5340 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:19.017271  5531 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:19.061008  5531 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:19.063071  5531 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:19.025189  5535 raft_consensus.cc:493] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:19.064883  5535 raft_consensus.cc:515] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:19.065505  2295 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:19.066974  5535 leader_election.cc:290] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:19.067539  5535 raft_consensus.cc:2804] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:19.067967  5535 raft_consensus.cc:697] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:19.014118  5647 raft_consensus.cc:2804] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:00:19.076607  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:19.057535  1573 pending_rounds.cc:85] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting all ops after (but not including) 7
I20260709 13:00:19.077800  1573 pending_rounds.cc:107] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:00:19.078101  1573 raft_consensus.cc:2889] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:19.077826  1576 raft_consensus.cc:2468] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7.
W20260709 13:00:19.082409  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 54418.5us
I20260709 13:00:19.082409  1575 raft_consensus.cc:1240] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:19.083199  1689 leader_election.cc:304] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:19.085211  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 13:00:19.086670  5729 log.cc:927] Time spent T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:00:19.086174  5535 consensus_queue.cc:237] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:19.087636  5705 raft_consensus.cc:2804] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:19.073539  2295 leader_election.cc:304] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:19.088945  5635 leader_election.cc:290] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:19.089823  5655 raft_consensus.cc:2804] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:19.089964  5681 leader_election.cc:290] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:19.090238  5655 raft_consensus.cc:493] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:19.090659  5655 raft_consensus.cc:3060] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:19.075480  5647 raft_consensus.cc:493] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:19.091223  5647 raft_consensus.cc:3060] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:19.095302  5640 leader_election.cc:290] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:19.096727  5623 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:19.029302  5353 raft_consensus.cc:493] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
W20260709 13:00:19.089054  5728 log.cc:927] Time spent T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:00:19.100826  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:19.102388  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:19.108440  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:19.111480  1689 leader_election.cc:304] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:19.099472  5717 raft_consensus.cc:2749] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:19.126317  5654 raft_consensus.cc:2749] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:19.098893  5623 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:19.129207  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:19.098839  5655 raft_consensus.cc:515] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:19.133893  5665 consensus_meta.cc:287] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.564s	user 0.007s	sys 0.004s
I20260709 13:00:19.111402  5705 raft_consensus.cc:697] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:19.135990  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:19.136615  1571 raft_consensus.cc:3060] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:19.114838  5353 raft_consensus.cc:515] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:19.133930  5655 leader_election.cc:290] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:00:19.158641  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 47240.7us
I20260709 13:00:19.161224  5353 leader_election.cc:290] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:00:19.164706  5735 log.cc:927] Time spent T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.076s	user 0.003s	sys 0.000s
I20260709 13:00:19.165944  1571 raft_consensus.cc:2468] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 8.
I20260709 13:00:18.848230  1642 rpcz_store.cc:276] 0709 13:00:17.725969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:17.726075 (+   106us) service_pool.cc:224] Handling call
0709 13:00:18.143641 (+417566us) spinlock_profiling.cc:243] Waited 6.22 ms on lock 0x7b5800181898. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef296b71 00007fa9ef296a22 00007fa9f81afc09 00007fa9f7309ee0 00007fa9f73d30ab 00007fa9f73d3131 00007fa9f7394fc0 00007fa9f737f929 00007fa9f737f3d2 00007fa9f08f6bd4
0709 13:00:18.143812 (+   171us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:18.144161 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:18.144191 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:18.144705 (+   514us) log.cc:844] Serialized 26 byte log entry
0709 13:00:18.586638 (+441933us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:18.715405 (+128767us) log.cc:844] Serialized 14 byte log entry
0709 13:00:18.820972 (+105567us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:18.821045 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:18.821083 (+    38us) raft_consensus.cc:1685] finished
0709 13:00:18.833118 (+ 12035us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:18.833307 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":104974,"prepare.queue_time_us":237091,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":3775,"raft.queue_time_us":115682,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":7374,"spinlock_wait_cycles":19794048,"thread_start_us":543163,"threads_started":2,"wal-append.queue_time_us":592778}
I20260709 13:00:19.171916  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:19.174614  2295 leader_election.cc:304] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:19.136664  5665 raft_consensus.cc:515] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:19.182127  5598 raft_consensus.cc:2804] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:00:19.185114  5733 log.cc:927] Time spent T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.094s	user 0.002s	sys 0.000s
I20260709 13:00:19.194881  1689 leader_election.cc:304] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:19.199229  1689 leader_election.cc:400] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373) with higher term. Message: Invalid argument: T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 10. Current term is 11.
I20260709 13:00:19.199646  1689 leader_election.cc:403] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:19.193626  5353 raft_consensus.cc:493] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.202296  5598 raft_consensus.cc:697] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:19.203972  5353 raft_consensus.cc:515] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:19.204818  5598 consensus_queue.cc:237] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:19.206174  5353 leader_election.cc:290] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:19.202380  5743 raft_consensus.cc:2749] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:19.210008  1689 leader_election.cc:304] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:19.210546  1567 raft_consensus.cc:1240] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:19.215212  1689 leader_election.cc:304] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:19.216585  5717 raft_consensus.cc:2804] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:19.217229  5717 raft_consensus.cc:697] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 10 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:19.218214  5717 consensus_queue.cc:237] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:19.223237  5623 raft_consensus.cc:2749] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:19.224752  1689 leader_election.cc:304] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:19.202502  5654 consensus_queue.cc:1048] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:00:19.214982  5743 raft_consensus.cc:2749] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373) with higher term. Message: Invalid argument: T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 10. Current term is 11.
I20260709 13:00:19.231030  5654 raft_consensus.cc:2749] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:00:19.232651  5721 log.cc:927] Time spent T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.306s	user 0.002s	sys 0.000s
I20260709 13:00:19.232380  1689 leader_election.cc:304] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:19.239634  1689 leader_election.cc:304] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:19.245931  1689 leader_election.cc:400] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 election: Vote denied by peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373) with higher term. Message: Invalid argument: T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 8. Current term is 9.
I20260709 13:00:19.246480  1689 leader_election.cc:403] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:00:19.253875  1689 leader_election.cc:304] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:19.240638  5705 consensus_queue.cc:237] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:19.240398  5654 raft_consensus.cc:2749] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:19.244727  5743 raft_consensus.cc:2749] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:00:19.266099  5740 log.cc:927] Time spent T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:00:19.277935  1688 leader_election.cc:304] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:19.279224  2294 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:19.280936  5666 raft_consensus.cc:2749] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:19.284106  5646 raft_consensus.cc:2749] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:19.285600  5665 leader_election.cc:290] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:19.255362  5623 raft_consensus.cc:3060] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:19.293897  5647 raft_consensus.cc:515] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:19.299264  5623 raft_consensus.cc:2749] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373) with higher term. Message: Invalid argument: T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 8. Current term is 9.
I20260709 13:00:19.296247  5647 leader_election.cc:290] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:00:19.335024  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:19.335646  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:19.338689  5681 raft_consensus.cc:493] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.339406  5681 raft_consensus.cc:515] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:19.342180  5681 leader_election.cc:290] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:19.342659  5681 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.343107  5681 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:19.344691  5679 raft_consensus.cc:493] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:19.344823  5648 raft_consensus.cc:2749] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:19.345362  5679 raft_consensus.cc:515] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:19.347393  5676 raft_consensus.cc:2749] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:19.347607  5679 leader_election.cc:290] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:19.349769  2295 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:19.356863  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:19.358405  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:19.361681  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:19.362771  1642 raft_consensus.cc:2393] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 9: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:19.363632  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:19.365423  2297 leader_election.cc:304] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:19.377390  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:00:19.379333  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 101521us
I20260709 13:00:19.415552  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:19.434799  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:19.386229  5565 raft_consensus.cc:2804] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:19.385854  5654 raft_consensus.cc:2749] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:19.417590  5743 raft_consensus.cc:2804] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:19.386708  5531 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:19.417825  5353 raft_consensus.cc:2804] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:19.466352  5743 raft_consensus.cc:493] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:19.467803  5565 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:19.477375  5531 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:19.503229  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:19.530010  1719 raft_consensus.cc:2468] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 5.
I20260709 13:00:19.477632  5743 raft_consensus.cc:3060] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:19.504918  1718 raft_consensus.cc:1240] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 11. Current term is 12. Ops: []
W20260709 13:00:19.505122  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 499821us
W20260709 13:00:19.505901  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 252082us
W20260709 13:00:19.511719  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 130790us
I20260709 13:00:19.511860  5353 raft_consensus.cc:697] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
W20260709 13:00:19.520977  1473 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55606 (request call id 270) took 30103 ms (client timeout 15000 ms). Trace:
I20260709 13:00:19.522444  5531 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:00:19.524413  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:19.539089  1615 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:19.539786  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:19.542008  1642 raft_consensus.cc:1275] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:00:19.543593  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:19.544620  1651 raft_consensus.cc:2368] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 9. Current term is 10.
W20260709 13:00:19.504293  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 591743us
I20260709 13:00:19.490221  5565 raft_consensus.cc:3060] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:19.540655  1644 raft_consensus.cc:2468] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 7.
I20260709 13:00:19.535614  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:19.537947  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:19.539203  5649 consensus_queue.cc:1059] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:19.534371  1689 leader_election.cc:304] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:19.554951  1689 leader_election.cc:304] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:19.552664  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:19.557509  1615 leader_election.cc:304] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:19.531368  5681 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:19.578876  2297 leader_election.cc:304] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:19.582285  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:19.582875  1542 leader_election.cc:304] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:19.598219  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:19.548677  5665 raft_consensus.cc:493] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.584723  1617 leader_election.cc:304] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:19.549700  5624 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.553397  5639 raft_consensus.cc:493] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:19.602082  5656 consensus_queue.cc:1059] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:19.602526  5353 consensus_queue.cc:237] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:19.604314  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:19.600167  5616 raft_consensus.cc:2804] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:19.614880  5616 raft_consensus.cc:493] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
W20260709 13:00:19.614416  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 56963.9us
I20260709 13:00:19.615123  2323 raft_consensus.cc:1240] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:19.615379  5616 raft_consensus.cc:3060] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:19.585460  5717 raft_consensus.cc:3060] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:19.616825  1576 raft_consensus.cc:1240] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:19.616953  1615 leader_election.cc:304] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:19.617322  5644 consensus_queue.cc:1059] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:19.617884  5645 consensus_queue.cc:1059] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:19.618186  1615 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:19.618433  5644 raft_consensus.cc:2804] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:19.619007  5644 raft_consensus.cc:697] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 7 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:19.619279  5681 raft_consensus.cc:3055] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:19.619028  5645 consensus_queue.cc:1059] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:19.619900  5681 raft_consensus.cc:740] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:19.619274  5648 raft_consensus.cc:3055] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:19.620980  5648 raft_consensus.cc:740] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:19.620754  5681 consensus_queue.cc:260] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:19.621999  5681 raft_consensus.cc:3060] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:19.622540  5745 log.cc:927] Time spent T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 13:00:19.621915  5648 consensus_queue.cc:260] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:19.614935  5679 raft_consensus.cc:2804] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:19.623500  5648 raft_consensus.cc:3060] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:19.621129  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:19.553140  5687 raft_consensus.cc:493] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:19.628347  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:19.629828  1573 raft_consensus.cc:3060] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:19.628584  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:19.582305  5654 raft_consensus.cc:2749] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:19.630894  2323 raft_consensus.cc:3055] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 13:00:19.538550  1473 rpcz_store.cc:269] 0709 12:59:49.417951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:49.505464 (+ 87513us) service_pool.cc:224] Handling call
0709 13:00:19.520872 (+30015408us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:17.331305 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:17.433252 (+101947us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:17.433303 (+    51us) write_op.cc:435] Acquired schema lock
0709 13:00:17.433331 (+    28us) tablet.cc:662] Decoding operations
0709 13:00:17.472137 (+ 38806us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:17.495857 (+ 23720us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:17.501101 (+  5244us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:00:17.600642 (+ 99541us) tablet.cc:701] Row locks acquired
0709 13:00:17.606950 (+  6308us) write_op.cc:260] PREPARE: finished
0709 13:00:17.624784 (+ 17834us) write_op.cc:270] Start()
0709 13:00:17.624903 (+   119us) write_op.cc:276] Timestamp: P: 1783602017624730 usec, L: 0
0709 13:00:17.624928 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:00:17.698585 (+ 73657us) log.cc:844] Serialized 1755 byte log entry
0709 13:00:17.903788 (+205203us) op_driver.cc:464] REPLICATION: finished
0709 13:00:17.969990 (+ 66202us) write_op.cc:301] APPLY: starting
0709 13:00:17.970079 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:17.970645 (+   566us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:17.970747 (+   102us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:17.971229 (+   482us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:17.971527 (+   298us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 13:00:17.971576 (+    49us) write_op.cc:312] APPLY: finished
0709 13:00:18.065489 (+ 93913us) log.cc:844] Serialized 41 byte log entry
0709 13:00:18.112636 (+ 47147us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:18.112767 (+   131us) write_op.cc:454] Released schema lock
0709 13:00:18.112810 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:18.113216 (+   406us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:18.113247 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":378920,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":65945,"apply.run_cpu_time_us":3137,"apply.run_wall_time_us":143213,"num_ops":4,"prepare.queue_time_us":265777,"prepare.run_cpu_time_us":13214,"prepare.run_wall_time_us":528617,"raft.queue_time_us":23307,"raft.run_cpu_time_us":20219,"raft.run_wall_time_us":41553,"replication_time_us":278728,"thread_start_us":370370,"threads_started":4,"wal-append.queue_time_us":163858,"wal-append.run_cpu_time_us":19133,"wal-append.run_wall_time_us":1214719}]]}
I20260709 13:00:19.631346  2323 raft_consensus.cc:740] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:19.642976  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 13:00:19.650971  1689 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:19.651648  5679 raft_consensus.cc:697] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 10 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:19.652225  5758 raft_consensus.cc:2749] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:19.655668  5756 raft_consensus.cc:3055] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:19.656222  5756 raft_consensus.cc:740] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:19.657377  5756 consensus_queue.cc:260] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:19.658959  5756 raft_consensus.cc:3060] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:19.604350  1471 catalog_manager.cc:5697] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:19.665349  1576 raft_consensus.cc:2393] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 6: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:19.666914  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:19.667210  1471 catalog_manager.cc:5697] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: config changed from index 4 to 6, term changed from 6 to 8, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 8 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:00:19.607523  5665 raft_consensus.cc:515] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:19.669448  1471 catalog_manager.cc:5697] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 7 to 8, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 8 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } }
I20260709 13:00:19.670575  5665 leader_election.cc:290] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:19.624935  5639 raft_consensus.cc:515] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:19.670898  1471 catalog_manager.cc:5697] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 2 to 9, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 9 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:00:19.637442  2323 consensus_queue.cc:260] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:19.684024  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:19.686929  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:19.690099  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:19.625249  5340 raft_consensus.cc:2804] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:19.688071  1719 raft_consensus.cc:3060] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:19.688477  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:19.630232  5676 raft_consensus.cc:2749] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:19.690703  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:19.707664  1724 raft_consensus.cc:3060] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:19.700217  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:19.690810  1723 raft_consensus.cc:3060] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:19.709964  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:19.704202  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:19.710606  1717 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:19.713970  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:19.714851  1720 raft_consensus.cc:2468] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 10.
I20260709 13:00:19.722600  1722 raft_consensus.cc:2393] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 11: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
W20260709 13:00:19.709679  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 57837.9us
I20260709 13:00:19.620011  5644 consensus_queue.cc:237] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:19.723520  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 137097us
I20260709 13:00:19.731076  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:19.723572  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:19.731904  1722 raft_consensus.cc:3060] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:19.722668  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:19.725250  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:19.733120  1716 raft_consensus.cc:3060] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:19.726749  1471 catalog_manager.cc:5697] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:19.725250  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:19.674482  5460 raft_consensus.cc:493] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:19.613919  5624 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:19.744735  1716 raft_consensus.cc:2468] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 10.
I20260709 13:00:19.738250  1615 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:19.736094  1718 raft_consensus.cc:2468] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 9.
I20260709 13:00:19.744863  1567 raft_consensus.cc:2393] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 10: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:19.738809  2328 raft_consensus.cc:1275] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:00:19.744387  1723 raft_consensus.cc:2468] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 11.
I20260709 13:00:19.749228  1723 raft_consensus.cc:1240] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:19.749464  1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 1793) took 1179 ms. Trace:
I20260709 13:00:19.750409  2331 raft_consensus.cc:1275] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:19.751842  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:19.752341  1539 leader_election.cc:304] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:19.707005  5662 raft_consensus.cc:2749] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:00:19.764678  1615 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:19.755066  1650 raft_consensus.cc:1240] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:19.749910  1643 rpcz_store.cc:276] 0709 13:00:18.569689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.572148 (+  2459us) service_pool.cc:224] Handling call
0709 13:00:18.596204 (+ 24056us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:18.607428 (+ 11224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:18.607458 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:18.616854 (+  9396us) log.cc:844] Serialized 26 byte log entry
0709 13:00:19.302656 (+685802us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b1800343ba0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef2b0e07 00007fa9f810bab9 00007fa9ef2cd69b 00007fa9ef2cb93f 00007fa9ef2cdc02 00007fa9f1f5520b 00007fa9f1f5ad23 00007fa9f1f5b0d1 00007fa9f2376a0f
0709 13:00:19.550098 (+247442us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:19.594444 (+ 44346us) log.cc:844] Serialized 14 byte log entry
0709 13:00:19.704325 (+109881us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:19.704421 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:19.704473 (+    52us) raft_consensus.cc:1685] finished
0709 13:00:19.749268 (+ 44795us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:19.749403 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40101,"prepare.queue_time_us":47629,"prepare.run_wall_time_us":4687,"raft.queue_time_us":60752,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":4058,"spinlock_wait_cycles":33110272,"thread_start_us":326911,"threads_started":2,"wal-append.queue_time_us":992297}
I20260709 13:00:19.760438  1724 raft_consensus.cc:2468] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8.
I20260709 13:00:19.767206  1723 raft_consensus.cc:1240] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:19.767657  1724 raft_consensus.cc:1275] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:19.768486  1723 raft_consensus.cc:1275] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:00:19.763868  1471 catalog_manager.cc:5697] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 4 to 5, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 5 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:19.701576  5340 raft_consensus.cc:493] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:19.772421  1471 catalog_manager.cc:5697] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:00:19.775205  1719 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 10.
I20260709 13:00:19.722733  5756 raft_consensus.cc:493] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:19.776616  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:19.783555  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:19.786142  1719 raft_consensus.cc:3060] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:19.793020  1471 catalog_manager.cc:5697] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 2 to 6, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 6 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:19.796229  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:19.797116  1570 raft_consensus.cc:2468] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 9.
I20260709 13:00:19.671975  5687 raft_consensus.cc:515] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:19.804247  1688 leader_election.cc:400] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 election: Vote denied by peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391) with higher term. Message: Invalid argument: T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 9. Current term is 10.
I20260709 13:00:19.800112  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:19.806514  1688 leader_election.cc:403] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:00:19.807008  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:19.807792  1723 raft_consensus.cc:2376] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 9. Re-sending same reply.
I20260709 13:00:19.809428  2294 leader_election.cc:304] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:19.813375  1722 raft_consensus.cc:2468] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 9.
I20260709 13:00:19.814395  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:19.808598  1471 catalog_manager.cc:5697] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 9 to 10, leader changed from 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 10 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:19.771243  5757 raft_consensus.cc:2749] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:19.833331  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:19.784050  5340 raft_consensus.cc:3060] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:19.820257  1717 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 12.
I20260709 13:00:19.822080  1689 leader_election.cc:304] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:19.819613  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:19.837580  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:19.837944  1723 raft_consensus.cc:2393] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 6: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:19.825582  1719 raft_consensus.cc:2468] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 12.
I20260709 13:00:19.784870  5712 raft_consensus.cc:2804] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:19.833942  1722 raft_consensus.cc:3060] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:19.838165  1717 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 7.
I20260709 13:00:19.834497  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:19.844836  1724 raft_consensus.cc:2468] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 9.
W20260709 13:00:19.800303  5751 log.cc:927] Time spent T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:00:19.840011  1471 catalog_manager.cc:5697] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:19.839426  2331 raft_consensus.cc:1275] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:00:19.801003  5747 log.cc:927] Time spent T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:00:19.896445  1724 raft_consensus.cc:1275] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:00:19.722993  5679 consensus_queue.cc:237] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:19.763788  5676 consensus_queue.cc:1059] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.077s
W20260709 13:00:19.882035  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:19.754073  5460 raft_consensus.cc:515] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:19.800426  5759 raft_consensus.cc:493] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:19.893958  1722 raft_consensus.cc:2468] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 7.
I20260709 13:00:19.783015  5616 raft_consensus.cc:515] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:19.841091  5647 raft_consensus.cc:2749] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391) with higher term. Message: Invalid argument: T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 9. Current term is 10.
I20260709 13:00:19.906690  1717 raft_consensus.cc:1275] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:00:19.909512  1722 raft_consensus.cc:3055] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:19.914804  1722 raft_consensus.cc:740] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:19.910247  1471 catalog_manager.cc:5697] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 6 to 9, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 9 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:19.809273  5756 raft_consensus.cc:515] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:19.913957  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 143634us
I20260709 13:00:19.843509  5712 raft_consensus.cc:493] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:19.916982  1722 consensus_queue.cc:260] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:19.836159  5646 consensus_queue.cc:1048] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 13:00:19.931715  1471 catalog_manager.cc:5697] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:19.954792  1722 raft_consensus.cc:3060] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:19.907586  5761 raft_consensus.cc:493] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:19.931800  5752 log.cc:927] Time spent T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.168s	user 0.003s	sys 0.000s
I20260709 13:00:19.846735  5665 consensus_queue.cc:1048] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.103s
I20260709 13:00:19.959263  1724 raft_consensus.cc:1275] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:00:19.961133  2330 raft_consensus.cc:1240] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:19.964860  5460 leader_election.cc:290] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:19.895916  5705 consensus_queue.cc:1048] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 13:00:19.899876  5565 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:19.967461  5743 raft_consensus.cc:515] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:19.970430  1471 catalog_manager.cc:5697] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 5 to 6, leader changed from 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 6 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:00:19.979696  1722 raft_consensus.cc:1275] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:00:19.957764  5712 raft_consensus.cc:3060] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:19.984445  1722 pending_rounds.cc:85] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4: Aborting all ops after (but not including) 7
I20260709 13:00:19.986804  1722 pending_rounds.cc:107] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:00:19.987131  1722 raft_consensus.cc:2889] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:19.960374  5654 raft_consensus.cc:2749] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:19.968755  5624 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:19.994179  1720 raft_consensus.cc:1240] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:19.933183  5759 raft_consensus.cc:515] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:19.994402  1471 catalog_manager.cc:5697] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 5 to 9, leader changed from 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 9 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
W20260709 13:00:19.999990  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 160542us
I20260709 13:00:20.000171  1573 raft_consensus.cc:2468] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 12.
I20260709 13:00:19.972347  5639 leader_election.cc:290] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:20.003827  2329 raft_consensus.cc:2468] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 9.
W20260709 13:00:19.999433  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 217053us
I20260709 13:00:20.007513  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:20.008126  1646 raft_consensus.cc:2468] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 9.
I20260709 13:00:19.982625  5763 raft_consensus.cc:3060] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:20.014029  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:20.011217  1646 raft_consensus.cc:1275] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:00:20.012605  1650 raft_consensus.cc:1275] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:00:20.015568  2295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.012981  1573 raft_consensus.cc:1275] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:00:20.017184  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 195206us
I20260709 13:00:20.018972  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:20.024127  1648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 1804) took 1110 ms. Trace:
I20260709 13:00:20.028508  1471 catalog_manager.cc:5697] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: config changed from index 2 to 6, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New cstate: current_term: 7 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:20.029832  5531 consensus_queue.cc:1048] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:20.035763  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 13:00:20.036015  5755 log.cc:927] Time spent T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 13:00:20.037042  5765 log.cc:927] Time spent T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:00:20.041095  5759 leader_election.cc:290] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:20.042428  2331 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b"
dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
mode: GRACEFUL
new_leader_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:39778
I20260709 13:00:20.024726  1648 rpcz_store.cc:276] 0709 13:00:18.913583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:18.913728 (+   145us) service_pool.cc:224] Handling call
0709 13:00:18.915823 (+  2095us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:19.337320 (+421497us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:19.337373 (+    53us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:19.338030 (+   657us) log.cc:844] Serialized 26 byte log entry
0709 13:00:19.586854 (+248824us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:19.586902 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:19.586966 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:19.804249 (+217283us) spinlock_profiling.cc:243] Waited 7.08 ms on lock 0x7b4400022b4c. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef1f4c85 00007fa9ef1f56a2 00007fa9f1f671db 00007fa9f1f62aaf 00007fa9f1f5686e 00007fa9f1f55bb6 00007fa9f1f557d8 00007fa9f1f5f221 00007fa9f1f5f1d9 00007fa9f1f5f169
0709 13:00:20.013341 (+209092us) raft_consensus.cc:1685] finished
0709 13:00:20.013359 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:20.024045 (+ 10686us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":421082,"raft.queue_time_us":429557,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":108,"spinlock_wait_cycles":16274176,"thread_start_us":241104,"threads_started":1,"wal-append.queue_time_us":337338}
I20260709 13:00:20.031680  1471 catalog_manager.cc:5697] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 5 to 8, leader changed from 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 8 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:00:20.045436  1471 catalog_manager.cc:5697] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 8 to 11, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 11 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
W20260709 13:00:20.049711  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 240355us
I20260709 13:00:20.053462  1643 raft_consensus.cc:1275] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:00:20.052656  1471 catalog_manager.cc:5697] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 2 to 9, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 9 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:19.977210  5761 raft_consensus.cc:515] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:20.054680  1645 raft_consensus.cc:1275] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:00:20.054616  2294 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:20.041468  5743 leader_election.cc:290] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:20.057510  5531 consensus_queue.cc:1048] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:20.058885  1542 leader_election.cc:304] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:20.065613  1648 raft_consensus.cc:1275] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:00:20.071491  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:20.072297  1724 raft_consensus.cc:2393] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 10: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:20.072217  2294 leader_election.cc:304] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:20.077692  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:20.078512  1643 raft_consensus.cc:2468] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8.
I20260709 13:00:20.079437  5760 raft_consensus.cc:2749] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:20.079686  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:20.082708  1542 leader_election.cc:304] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:20.080358  1716 raft_consensus.cc:2468] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 10.
I20260709 13:00:20.084865  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:20.085243  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:20.086297  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:20.089674  5764 raft_consensus.cc:2749] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:20.091008  2323 raft_consensus.cc:3060] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:20.091066  2294 leader_election.cc:304] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:20.093278  5657 raft_consensus.cc:2749] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:20.094003  5657 raft_consensus.cc:2804] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:20.094368  5657 raft_consensus.cc:493] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:20.094725  5657 raft_consensus.cc:3060] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:20.086288  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:20.097630  5758 raft_consensus.cc:3055] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:20.098042  5758 raft_consensus.cc:740] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:20.098846  5758 consensus_queue.cc:260] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:20.099997  5758 raft_consensus.cc:3060] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:20.103197  5565 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:20.096447  5635 consensus_queue.cc:1059] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:00:20.105351  5582 raft_consensus.cc:3055] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:20.105782  5582 raft_consensus.cc:740] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:20.097640  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:20.107996  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:20.108587  1716 raft_consensus.cc:3060] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:20.106765  5582 consensus_queue.cc:260] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:20.110580  5616 leader_election.cc:290] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:20.114400  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:20.115422  1720 raft_consensus.cc:2393] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 8: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:20.123648  1648 raft_consensus.cc:1275] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:00:20.125563  1724 raft_consensus.cc:1240] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:20.130980  1648 raft_consensus.cc:1240] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 12. Current term is 13. Ops: []
W20260709 13:00:20.138827  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 205815us
I20260709 13:00:20.142004  1689 leader_election.cc:304] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:00:20.153298  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:20.153836  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.159041  1689 leader_election.cc:304] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:20.159881  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:20.159155  1716 raft_consensus.cc:2468] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7.
I20260709 13:00:20.161188  1645 raft_consensus.cc:3060] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:20.162881  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:20.164635  1689 leader_election.cc:304] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:20.115356  5756 leader_election.cc:290] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:20.070359  5687 leader_election.cc:290] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:20.166244  5717 consensus_meta.cc:287] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.550s	user 0.010s	sys 0.000s
I20260709 13:00:20.166636  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:20.166813  5772 consensus_queue.cc:1059] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 13:00:20.167603  5770 raft_consensus.cc:2749] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:20.167227  1471 catalog_manager.cc:5697] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
W20260709 13:00:20.141254  5768 log.cc:927] Time spent T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.074s	user 0.002s	sys 0.000s
I20260709 13:00:20.168654  5772 raft_consensus.cc:3055] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:20.169056  5772 raft_consensus.cc:740] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:20.168928  1471 catalog_manager.cc:5697] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } }
I20260709 13:00:20.170007  5772 consensus_queue.cc:260] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:20.170270  1471 catalog_manager.cc:5697] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 6 to 7, leader changed from 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 7 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:00:20.171358  5772 raft_consensus.cc:3060] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:20.160094  5774 log.cc:927] Time spent T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.076s	user 0.001s	sys 0.005s
W20260709 13:00:20.219169  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 86750.1us
I20260709 13:00:20.161782  5460 raft_consensus.cc:2749] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:00:20.164341  5648 consensus_meta.cc:287] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.540s	user 0.012s	sys 0.001s
W20260709 13:00:20.219827  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 55306.5us
I20260709 13:00:20.231415  1689 leader_election.cc:304] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 13:00:20.223073  1617 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.000s	sys 0.015s
W20260709 13:00:20.277688  1617 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.000s	sys 0.016s
W20260709 13:00:20.227548  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 406787us
I20260709 13:00:20.220716  5770 consensus_queue.cc:1048] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:00:20.220544  5646 raft_consensus.cc:2749] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:00:20.276695  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 187252us
I20260709 13:00:20.166656  5717 raft_consensus.cc:2749] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:20.288509  1645 raft_consensus.cc:2410] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:00:20.288699  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:20.289455  1723 raft_consensus.cc:2393] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 10: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
W20260709 13:00:20.288246  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 703524us
I20260709 13:00:20.290431  1723 raft_consensus.cc:1240] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:20.291496  1723 raft_consensus.cc:1240] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 11. Current term is 12. Ops: []
W20260709 13:00:20.291553  1617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.232455  1721 raft_consensus.cc:1240] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:00:20.292636  1723 raft_consensus.cc:1240] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:20.293898  1573 raft_consensus.cc:1275] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:00:20.295264  1720 raft_consensus.cc:1240] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:20.173979  5769 raft_consensus.cc:2749] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:20.222415  5761 leader_election.cc:290] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:00:20.307430  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 182657us
I20260709 13:00:20.312456  2325 raft_consensus.cc:1240] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 LEADER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:20.313189  2331 raft_consensus.cc:606] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 LEADER]: Received request to transfer leadership to TS 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:20.314503  2294 leader_election.cc:304] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4
W20260709 13:00:20.314896  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 226625us
I20260709 13:00:20.315511  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 13:00:20.353806  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.311808  5115 raft_consensus.cc:493] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.385720  1725 raft_consensus.cc:2468] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 12.
I20260709 13:00:20.309159  5647 raft_consensus.cc:2804] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:20.306581  5460 consensus_queue.cc:1059] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260709 13:00:20.309245  5777 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
W20260709 13:00:20.413443  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 97931.7us
I20260709 13:00:20.414462  1542 leader_election.cc:304] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:20.418098  1576 raft_consensus.cc:2468] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 9.
W20260709 13:00:20.433221  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 118773us
I20260709 13:00:20.434654  2294 leader_election.cc:304] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:20.442612  5353 raft_consensus.cc:2804] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:20.444300  5353 raft_consensus.cc:493] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:20.445752  5353 raft_consensus.cc:3060] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:20.486992  5778 raft_consensus.cc:493] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:20.376951  5761 raft_consensus.cc:493] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.491480  2323 raft_consensus.cc:2468] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 12.
W20260709 13:00:20.453361  5340 consensus_meta.cc:287] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.565s	user 0.011s	sys 0.003s
W20260709 13:00:20.495110  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 154288us
W20260709 13:00:20.498425  2295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.498405  2297 leader_election.cc:304] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:00:20.497015  1615 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.350173  5620 consensus_queue.cc:1048] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.103s
I20260709 13:00:20.501721  1643 raft_consensus.cc:1275] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:00:20.452908  5681 consensus_meta.cc:287] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.830s	user 0.010s	sys 0.002s
I20260709 13:00:20.449469  5647 raft_consensus.cc:697] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 12 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:20.433317  5654 raft_consensus.cc:3055] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 13:00:20.504460  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 69925.1us
I20260709 13:00:20.507627  2294 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:20.453547  5687 raft_consensus.cc:493] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
W20260709 13:00:20.502065  5655 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:00:20.511379  1645 raft_consensus.cc:1240] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:20.491950  5764 raft_consensus.cc:493] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:20.533759  1716 raft_consensus.cc:1275] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:00:20.534157  1716 pending_rounds.cc:85] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4: Aborting all ops after (but not including) 7
I20260709 13:00:20.534427  1716 pending_rounds.cc:107] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:00:20.534025  5764 raft_consensus.cc:515] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:20.534686  1716 raft_consensus.cc:2889] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:20.536171  5712 consensus_meta.cc:287] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.545s	user 0.008s	sys 0.001s
I20260709 13:00:20.545030  5647 consensus_queue.cc:237] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:20.495098  5759 raft_consensus.cc:493] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:20.603950  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 376646us
W20260709 13:00:20.544694  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 45267.9us
I20260709 13:00:20.540254  5582 raft_consensus.cc:3060] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:20.502866  5761 raft_consensus.cc:515] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:20.431933  5115 raft_consensus.cc:515] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:20.528613  5598 raft_consensus.cc:2749] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:20.548511  5775 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.510593  5654 raft_consensus.cc:740] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:20.548658  5687 raft_consensus.cc:515] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:20.533301  5784 consensus_queue.cc:1059] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:20.627228   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:00:20.506664  5705 raft_consensus.cc:2749] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:00:20.554556  5785 log.cc:927] Time spent T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 13:00:20.537829  5780 raft_consensus.cc:493] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.504153  5760 consensus_queue.cc:1048] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 13:00:20.487807  5778 raft_consensus.cc:515] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:20.450647  5777 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:20.584110  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:20.511775  5595 raft_consensus.cc:2749] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:00:20.588820  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 81256.6us
I20260709 13:00:20.649963  2294 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:20.594477  5616 raft_consensus.cc:2749] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:20.599094  1722 raft_consensus.cc:1240] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 11. Current term is 12. Ops: [7.4-11.6]
I20260709 13:00:20.601743  5649 raft_consensus.cc:3055] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:20.610147  2295 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:20.505115  5340 raft_consensus.cc:515] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:20.536227  5764 leader_election.cc:290] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:00:20.540706  5763 consensus_meta.cc:287] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.503s	user 0.006s	sys 0.003s
I20260709 13:00:20.634199   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:20.588256  5712 raft_consensus.cc:515] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:20.623443  5759 raft_consensus.cc:515] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:20.656178  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:20.659180  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:20.694628  2330 raft_consensus.cc:2468] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7.
W20260709 13:00:20.662088  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 216405us
I20260709 13:00:20.655359  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:20.696672  2331 raft_consensus.cc:3060] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:20.665658  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:20.667832  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:20.668848  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:20.651036  5780 raft_consensus.cc:515] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:20.705395  5115 leader_election.cc:290] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:20.706801  5780 leader_election.cc:290] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:20.694643  5535 consensus_queue.cc:1048] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:00:20.685284  5778 leader_election.cc:290] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:20.656399  5649 raft_consensus.cc:740] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:20.657379  5598 raft_consensus.cc:2749] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:20.713398  5649 consensus_queue.cc:260] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:20.714510  5649 raft_consensus.cc:3060] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:20.639030  5775 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:20.662951  5531 raft_consensus.cc:2804] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:00:20.718205  1462 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.421s	user 0.018s	sys 0.008s
I20260709 13:00:20.718076  5531 raft_consensus.cc:697] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:20.718976  5775 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:20.719692  5531 consensus_queue.cc:237] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:20.720943  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:20.688592  5761 leader_election.cc:290] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:20.718083  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 13:00:20.689108  5657 consensus_meta.cc:287] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.594s	user 0.005s	sys 0.009s
I20260709 13:00:20.722810  5759 leader_election.cc:290] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:20.722687  5657 raft_consensus.cc:515] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:20.693122  5654 consensus_queue.cc:260] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:20.664114  5763 raft_consensus.cc:2749] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:20.725112  2326 raft_consensus.cc:1240] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:20.725283  5657 leader_election.cc:290] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:20.726359  5340 leader_election.cc:290] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:20.721063  5712 leader_election.cc:290] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:20.728856  5777 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:20.734905  1615 leader_election.cc:304] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:20.745815  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:20.745167  5761 raft_consensus.cc:2804] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:00:20.756697  1689 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.055s	sys 0.055s
W20260709 13:00:20.761854  1689 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.055s	sys 0.055s
W20260709 13:00:20.762166  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 530818us
I20260709 13:00:20.748714  2331 raft_consensus.cc:2468] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 13.
I20260709 13:00:20.765334  1723 raft_consensus.cc:1275] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 13:00:20.765688  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:20.766119  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.766947  2328 raft_consensus.cc:1240] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 12. Current term is 13. Ops: [10.10-12.11]
I20260709 13:00:20.770745  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:20.771533  1646 raft_consensus.cc:2393] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 9: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:20.772964  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:20.773051  1617 leader_election.cc:304] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:20.766026  1722 raft_consensus.cc:1275] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:00:20.777207  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:20.777415  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:20.777998  1718 raft_consensus.cc:2410] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 13 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:00:20.778059  1725 raft_consensus.cc:2393] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 9: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:20.781291  1615 leader_election.cc:304] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:20.781301  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:20.785621  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:20.783486  1617 leader_election.cc:304] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:20.785764  1646 raft_consensus.cc:2468] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 13.
I20260709 13:00:20.783712  2325 raft_consensus.cc:1240] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 LEADER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 7. Current term is 8. Ops: []
W20260709 13:00:20.788398  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 355155us
I20260709 13:00:20.798542  1649 raft_consensus.cc:1275] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:00:20.800067  1540 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.006s	sys 0.011s
I20260709 13:00:20.800951  1723 raft_consensus.cc:1275] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:00:20.801136  1540 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.006s	sys 0.011s
I20260709 13:00:20.802590  5681 raft_consensus.cc:2804] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:20.803288  5681 raft_consensus.cc:697] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 13 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:20.804406  5681 consensus_queue.cc:237] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:20.760905  5761 raft_consensus.cc:493] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:20.779784  5644 raft_consensus.cc:2749] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:00:20.806262  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 527627us
I20260709 13:00:20.812175  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:20.812870  1719 raft_consensus.cc:2468] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 10.
I20260709 13:00:20.808303  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:00:20.809473  5758 consensus_meta.cc:287] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.709s	user 0.016s	sys 0.000s
I20260709 13:00:20.787917  5662 consensus_queue.cc:1059] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:00:20.832546  5662 raft_consensus.cc:3055] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:20.832403  5787 consensus_queue.cc:1048] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:20.833122  5662 raft_consensus.cc:740] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
W20260709 13:00:20.833841  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 44460.6us
I20260709 13:00:20.834117  5662 consensus_queue.cc:260] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:20.811097  5761 raft_consensus.cc:3060] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:20.837400  5648 raft_consensus.cc:493] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.837950  5648 raft_consensus.cc:515] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:20.839828  5712 consensus_queue.cc:1048] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:20.842610  1572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36642 (request call id 2405) took 1153 ms. Trace:
I20260709 13:00:20.843688  1542 leader_election.cc:304] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:20.840142  5648 leader_election.cc:290] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:20.843047  1572 rpcz_store.cc:276] 0709 13:00:19.689420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.689654 (+   234us) service_pool.cc:224] Handling call
0709 13:00:19.725506 (+ 35852us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:19.725841 (+   335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:19.725869 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:19.729904 (+  4035us) log.cc:844] Serialized 26 byte log entry
0709 13:00:20.448319 (+718415us) spinlock_profiling.cc:243] Waited 5.8 ms on lock 0x7b180000e260. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef2b0e07 00007fa9f810bab9 00007fa9ef2cd69b 00007fa9ef2cb93f 00007fa9ef2cdc02 00007fa9f1f5520b 00007fa9f1f5ad23 00007fa9f1f5b0d1 00007fa9f2376a0f
0709 13:00:20.649760 (+201441us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:20.653353 (+  3593us) log.cc:844] Serialized 14 byte log entry
0709 13:00:20.807290 (+153937us) spinlock_profiling.cc:243] Waited 3.77 ms on lock 0x7b180000e260. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef248c0a 00007fa9f8988219 00007fa9ef2d0a40 00007fa9ef2cb4e4 00007fa9ef2cb455 00007fa9f23b3060 00007fa9f23c5716 00007fa9f23d6287 00007fa9f23d6208
0709 13:00:20.807510 (+   220us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:20.807583 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:20.842369 (+ 34786us) raft_consensus.cc:1685] finished
0709 13:00:20.842395 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:20.842529 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20891,"prepare.queue_time_us":3390,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":169974,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":11008,"spinlock_wait_cycles":28335488,"thread_start_us":201277,"threads_started":1,"wal-append.queue_time_us":1048198}
I20260709 13:00:20.854653  1542 leader_election.cc:304] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:20.830598  1462 maintenance_manager.cc:643] P fcfaa17e55ae48e194c5d95ca24a659f: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 6.329s	user 0.226s	sys 0.138s Metrics: {"bytes_written":30504,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":221781,"dirs.run_cpu_time_us":410,"dirs.run_wall_time_us":6113,"drs_written":1,"lbm_read_time_us":443,"lbm_reads_lt_1ms":4,"lbm_write_time_us":110949,"lbm_writes_1-10_ms":5,"lbm_writes_10-100_ms":2,"lbm_writes_lt_1ms":27,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":493024,"threads_started":2,"update_count":21,"wal-append.queue_time_us":394939}
W20260709 13:00:20.854915  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 45843.7us
I20260709 13:00:20.863590  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:20.864586  1723 raft_consensus.cc:2468] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7.
I20260709 13:00:20.865722  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:20.867726  1542 leader_election.cc:304] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:20.853139  1539 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:20.872215  2294 leader_election.cc:304] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:20.875609  1542 leader_election.cc:304] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:20.875824  2294 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:20.828240  5353 raft_consensus.cc:515] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:20.881544  1617 leader_election.cc:304] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:20.883637  1617 leader_election.cc:304] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
W20260709 13:00:20.901057  1617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.847958  5644 consensus_queue.cc:1059] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:00:20.869309  5648 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.877391  5758 raft_consensus.cc:493] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.969188  1463 maintenance_manager.cc:419] P fcfaa17e55ae48e194c5d95ca24a659f: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 9807 bytes on disk
I20260709 13:00:20.869145  5780 raft_consensus.cc:2804] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:20.879423  5766 raft_consensus.cc:2749] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:20.967738  5656 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:20.971204  5353 leader_election.cc:290] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:20.901455  5645 raft_consensus.cc:2749] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:20.899485  5600 raft_consensus.cc:2749] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:20.958421  2323 raft_consensus.cc:1240] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 7. Current term is 9. Ops: []
I20260709 13:00:20.868976  5657 consensus_queue.cc:1048] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.093s
W20260709 13:00:20.979504  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 369396us
I20260709 13:00:20.961735  5777 raft_consensus.cc:2804] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:21.013994  5353 raft_consensus.cc:2804] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:21.014645  5353 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:21.015125  5353 raft_consensus.cc:3060] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:00:21.022994  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 147254us
I20260709 13:00:21.007845  1462 maintenance_manager.cc:643] P fcfaa17e55ae48e194c5d95ca24a659f: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.031s	user 0.002s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":358,"lbm_reads_lt_1ms":4}
I20260709 13:00:21.040480  5645 raft_consensus.cc:493] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.041726  5645 raft_consensus.cc:515] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:20.961898  5800 raft_consensus.cc:2804] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:20.992476  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:20.903453  5767 consensus_queue.cc:1048] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.075s
I20260709 13:00:21.045989  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:21.051599  1718 raft_consensus.cc:2393] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 10: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:20.960096  5756 raft_consensus.cc:2804] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:00:21.045938  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:20.978926  5787 raft_consensus.cc:2804] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:21.048676  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:21.061317  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:21.063041  1725 raft_consensus.cc:2468] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 9.
I20260709 13:00:20.993482  5780 raft_consensus.cc:697] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:20.974536  5648 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:21.066619  1719 raft_consensus.cc:1275] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:00:21.039250  5777 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:21.063402  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 186096us
I20260709 13:00:20.979140  5758 raft_consensus.cc:515] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:21.074194  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
W20260709 13:00:21.070295  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 194717us
I20260709 13:00:21.077566  1542 leader_election.cc:304] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:21.054687  5800 raft_consensus.cc:697] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:21.079591  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:21.062211  5756 raft_consensus.cc:493] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:21.080682  1539 leader_election.cc:304] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:21.083181  1725 raft_consensus.cc:2393] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 10: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:20.993827  5656 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:21.082368  2294 leader_election.cc:304] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:21.065585  5787 raft_consensus.cc:493] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:21.069121  5777 raft_consensus.cc:3060] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:21.080147  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 97603.5us
I20260709 13:00:21.088807  5756 raft_consensus.cc:3060] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:21.109081  5635 raft_consensus.cc:3055] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:21.109388  5758 leader_election.cc:290] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:21.093966  5787 raft_consensus.cc:3060] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:21.111043  5794 log.cc:927] Time spent T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 13:00:21.093425  5813 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.111907  5775 raft_consensus.cc:2749] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:00:21.115483  5798 log.cc:927] Time spent T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:00:21.115911  5780 consensus_queue.cc:237] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:21.117681  5648 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:21.117905  5797 raft_consensus.cc:2749] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:21.073453  5766 consensus_queue.cc:1048] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.029s
W20260709 13:00:21.183362  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:21.119539  5656 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:00:21.185967  5808 log.cc:927] Time spent T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:00:21.075769  5600 consensus_queue.cc:1048] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:00:21.080583  5810 consensus_queue.cc:1048] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:00:21.132216  5635 raft_consensus.cc:740] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:21.084476  5799 consensus_queue.cc:1048] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
W20260709 13:00:21.139066  1689 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:21.103825  5645 leader_election.cc:290] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:00:21.142922  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 70515.6us
W20260709 13:00:21.170022  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 90365.2us
W20260709 13:00:21.177975  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 95687.4us
I20260709 13:00:21.136551  5811 raft_consensus.cc:2804] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:21.195832  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:21.186600  5814 raft_consensus.cc:493] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.198151  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:21.196556  1642 raft_consensus.cc:2468] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 11.
I20260709 13:00:21.201377  1542 leader_election.cc:304] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:21.187741  5115 consensus_queue.cc:1048] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:00:21.197451  5645 raft_consensus.cc:493] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:21.199383  5811 raft_consensus.cc:697] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
W20260709 13:00:21.216228  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:21.198228  5797 consensus_queue.cc:1048] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:00:21.161895  5813 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:21.195379  5800 consensus_queue.cc:237] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:21.202724  5657 consensus_queue.cc:1059] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:00:21.270911  5777 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:21.269136  5811 consensus_queue.cc:237] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:21.276111  5582 consensus_meta.cc:287] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.651s	user 0.009s	sys 0.003s
I20260709 13:00:21.276954  1572 raft_consensus.cc:1275] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:00:21.253621  5353 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:21.277539  5810 consensus_queue.cc:1048] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:21.273762  5772 raft_consensus.cc:493] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:21.279243  5353 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 14 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:21.279284  5772 raft_consensus.cc:515] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:21.279922  1617 leader_election.cc:304] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:21.280601  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:21.280851  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:21.281261  1725 raft_consensus.cc:2376] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7. Re-sending same reply.
I20260709 13:00:21.281463  1717 raft_consensus.cc:2468] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 10.
I20260709 13:00:21.281814  5772 leader_election.cc:290] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:21.202360  5814 raft_consensus.cc:515] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:21.268558  5824 log.cc:927] Time spent T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:00:21.284047  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:21.284777  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:21.212847  5819 raft_consensus.cc:2804] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:21.315716  1719 raft_consensus.cc:2468] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 12.
W20260709 13:00:21.329056  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 248434us
I20260709 13:00:21.317070  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:21.329985  1650 raft_consensus.cc:2468] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 9.
I20260709 13:00:21.331545  1688 leader_election.cc:304] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:21.317353  1617 leader_election.cc:304] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:21.317726  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:21.333385  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:21.334079  2328 raft_consensus.cc:2468] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 11.
I20260709 13:00:21.333415  1718 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 10.
I20260709 13:00:21.336864  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:21.337697  1650 raft_consensus.cc:3060] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:21.339396  1615 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:21.341312  2294 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:21.335512  1617 leader_election.cc:304] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:21.385623  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:00:21.386627  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 51195.1us
I20260709 13:00:21.283959  5814 leader_election.cc:290] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:21.253110  5640 raft_consensus.cc:493] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:21.386638  1725 raft_consensus.cc:2410] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 12 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 13:00:21.387480  1617 leader_election.cc:304] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:21.397210  1617 leader_election.cc:304] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:21.315513  5681 raft_consensus.cc:2749] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:21.221886  5645 raft_consensus.cc:515] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:21.406510  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 206442us
I20260709 13:00:21.411885  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:21.412500  2329 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 10.
I20260709 13:00:21.271270  5813 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:21.315541  5772 raft_consensus.cc:493] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:21.239354  5761 raft_consensus.cc:515] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:21.396654  5798 log.cc:927] Time spent T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:00:21.410392  5816 raft_consensus.cc:2804] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:21.394003  5767 raft_consensus.cc:2804] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:21.394060  5649 raft_consensus.cc:2804] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:21.394089  5648 raft_consensus.cc:493] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:21.393824  5758 raft_consensus.cc:2749] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:21.386910  5819 raft_consensus.cc:697] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:21.226646  5635 consensus_queue.cc:260] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:21.410408  5647 raft_consensus.cc:2804] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:00:21.473704  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 142217us
I20260709 13:00:21.433357  5816 raft_consensus.cc:493] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:21.433043  5767 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:21.544323  5767 raft_consensus.cc:3060] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:21.553196  5767 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:21.410571  5640 raft_consensus.cc:515] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:21.445020  5649 raft_consensus.cc:493] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:21.559412  1724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2325) took 1522 ms. Trace:
I20260709 13:00:21.426450  5772 raft_consensus.cc:515] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:21.565138  1724 rpcz_store.cc:276] 0709 13:00:20.020308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.127705 (+107397us) service_pool.cc:224] Handling call
0709 13:00:20.128078 (+   373us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:20.155192 (+ 27114us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:20.155222 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:20.207784 (+ 52562us) log.cc:844] Serialized 52 byte log entry
0709 13:00:20.798057 (+590273us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:20.820028 (+ 21971us) log.cc:844] Serialized 14 byte log entry
0709 13:00:20.861552 (+ 41524us) log.cc:844] Serialized 14 byte log entry
0709 13:00:20.861779 (+   227us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:20.861881 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:21.118765 (+256884us) spinlock_profiling.cc:243] Waited 4.27 ms on lock 0x7b180019dec0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef2ce3f3 00007fa9ef2d07c1 00007fa9ef2d0779 00007fa9ef2d0709 00007fa9ef2d06d1 00007fa9ef2cf9cd 000000000038f354 000000000038f199 00007fa9ef2b183a
0709 13:00:21.542904 (+424139us) raft_consensus.cc:1685] finished
0709 13:00:21.542931 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:21.543068 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28066,"prepare.queue_time_us":25043,"prepare.run_cpu_time_us":221,"prepare.run_wall_time_us":6135,"raft.queue_time_us":28163,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":19998,"spinlock_wait_cycles":30279680,"thread_start_us":491601,"threads_started":1,"wal-append.queue_time_us":674373}
I20260709 13:00:21.567057  5772 leader_election.cc:290] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:21.461243  5460 raft_consensus.cc:493] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:21.420430  5815 consensus_queue.cc:1048] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.148s
I20260709 13:00:21.461319  5647 raft_consensus.cc:493] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:21.557346  5816 raft_consensus.cc:3060] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:21.558883  5777 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:21.558598  5832 raft_consensus.cc:2804] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:21.458367  5648 raft_consensus.cc:515] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:21.568254  5649 raft_consensus.cc:3060] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:21.574363  5833 raft_consensus.cc:493] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.577589  5835 raft_consensus.cc:493] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.577863  5645 leader_election.cc:290] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:21.585886  5772 raft_consensus.cc:493] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:21.585969  5834 raft_consensus.cc:493] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:21.574748  5647 raft_consensus.cc:3060] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:21.579667  5832 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:21.579409  5640 leader_election.cc:290] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:21.573101  5460 raft_consensus.cc:515] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:21.600660  5832 raft_consensus.cc:3060] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:21.604332  5460 leader_election.cc:290] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:21.598635  5834 raft_consensus.cc:515] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:21.612758  5825 log.cc:927] Time spent T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.327s	user 0.000s	sys 0.001s
I20260709 13:00:21.613019  5834 leader_election.cc:290] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:21.613512  5662 raft_consensus.cc:3060] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:21.593406  5835 raft_consensus.cc:515] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:21.616186  5835 leader_election.cc:290] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:21.601128  5787 raft_consensus.cc:515] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:21.617141  5842 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.646462  5835 raft_consensus.cc:493] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.592605  5833 raft_consensus.cc:515] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:21.647001  5835 raft_consensus.cc:515] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:21.648960  5835 leader_election.cc:290] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:21.618059  5791 log.cc:927] Time spent T 00000000000000000000000000000000 P fcfaa17e55ae48e194c5d95ca24a659f: Append to log took a long time: real 0.287s	user 0.001s	sys 0.000s
W20260709 13:00:21.618925  5831 log.cc:927] Time spent T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
I20260709 13:00:21.595969  5819 consensus_queue.cc:237] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:21.620507  5761 leader_election.cc:290] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:21.623380  5648 leader_election.cc:290] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:21.597957  5772 raft_consensus.cc:515] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:21.646462  5842 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:21.670783  5842 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:21.671103  5787 leader_election.cc:290] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:21.672201  5767 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:21.653973  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 72706.4us
W20260709 13:00:21.681145  1689 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:21.692677  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:21.672116  5687 leader_election.cc:290] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:21.648926  5833 leader_election.cc:290] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:21.714934  1650 raft_consensus.cc:2468] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 14.
I20260709 13:00:21.702497  5647 raft_consensus.cc:515] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:21.703506  5756 consensus_meta.cc:287] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.563s	user 0.016s	sys 0.000s
I20260709 13:00:21.669596  5832 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:21.722858  5772 leader_election.cc:290] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:00:21.726826  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 385593us
I20260709 13:00:21.736138  2323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53306 (request call id 678) took 1041 ms. Trace:
I20260709 13:00:21.721414  5756 raft_consensus.cc:515] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:21.736804  2323 rpcz_store.cc:276] 0709 13:00:20.694241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.701257 (+  7016us) service_pool.cc:224] Handling call
0709 13:00:20.701635 (+   378us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:20.992312 (+290677us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:21.735808 (+743496us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b54006c66d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:21.736056 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":590033792}
I20260709 13:00:21.727265  5772 raft_consensus.cc:493] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:21.746407  5851 raft_consensus.cc:493] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.747079  5851 raft_consensus.cc:515] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:21.749243  1648 raft_consensus.cc:1240] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:21.749449  5756 leader_election.cc:290] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:21.747092  5832 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:21.751307  5832 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:21.727700  5816 raft_consensus.cc:515] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:21.757838  5647 leader_election.cc:290] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:21.759686  5850 raft_consensus.cc:493] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.751842  5832 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:21.760314  5850 raft_consensus.cc:515] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:21.762416  5832 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:21.762498  5850 leader_election.cc:290] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:21.772230  5842 raft_consensus.cc:493] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:21.773330  5842 raft_consensus.cc:515] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:21.877606  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:21.878198  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:21.878756  2323 raft_consensus.cc:1275] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:00:21.880288  2329 raft_consensus.cc:2393] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 6: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 13:00:21.884441  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:21.885226  2323 raft_consensus.cc:2468] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 9.
I20260709 13:00:21.875432  5623 raft_consensus.cc:493] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:21.743747  5649 raft_consensus.cc:515] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:21.741695  5772 raft_consensus.cc:515] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:21.917923  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:21.895630  5851 leader_election.cc:290] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:21.957718  5833 raft_consensus.cc:493] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.109620  5833 raft_consensus.cc:515] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:21.906335  5623 raft_consensus.cc:515] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:22.142643  5816 leader_election.cc:290] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:22.150620  5623 leader_election.cc:290] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:22.151605  5772 leader_election.cc:290] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:22.148978  5649 leader_election.cc:290] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:22.153136  5833 leader_election.cc:290] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:00:22.159741  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:22.177991  5833 raft_consensus.cc:493] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.178776  5833 raft_consensus.cc:515] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:22.187156  5833 leader_election.cc:290] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:22.197264  5858 raft_consensus.cc:493] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:22.198127  5858 raft_consensus.cc:515] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:22.235121  5850 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:22.235970  5850 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:22.239737  5850 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:22.262483  5858 leader_election.cc:290] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:00:22.294524  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 437546us
I20260709 13:00:22.271910  5833 raft_consensus.cc:493] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.305946  5833 raft_consensus.cc:515] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 13:00:22.309474  5772 raft_consensus.cc:493] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.310058  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:22.310130  5772 raft_consensus.cc:515] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:22.310853  2328 raft_consensus.cc:2468] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 10.
I20260709 13:00:22.311862  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:22.356889  5623 raft_consensus.cc:493] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:22.357738  5623 raft_consensus.cc:515] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:22.448865  5833 leader_election.cc:290] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373)
I20260709 13:00:22.451478  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:22.479254  5842 leader_election.cc:290] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:22.479861  5842 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.480346  5842 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:22.482347  5842 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:00:22.484556  2297 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.742s	user 0.006s	sys 0.022s
I20260709 13:00:22.502836  5833 raft_consensus.cc:493] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:22.562588  2297 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.820s	user 0.006s	sys 0.022s
I20260709 13:00:22.565061  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:22.565888  1719 raft_consensus.cc:2410] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 for term 10 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:00:22.566449  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:22.525409  5858 raft_consensus.cc:493] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:22.569898  5563 raft_consensus.cc:493] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:22.570485  5563 raft_consensus.cc:515] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:22.569453  5858 raft_consensus.cc:515] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:22.572674  5563 leader_election.cc:290] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:22.556173  5862 raft_consensus.cc:493] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.574342  5862 raft_consensus.cc:515] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:22.576259  5862 leader_election.cc:290] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:22.557904  5620 raft_consensus.cc:493] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.577018  5620 raft_consensus.cc:515] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:22.573342  5858 leader_election.cc:290] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:22.579661  5620 leader_election.cc:290] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:22.581580  5620 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:22.582087  5620 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:22.584364  5620 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:22.562803  5833 raft_consensus.cc:515] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:22.554885  5861 raft_consensus.cc:493] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.598076  5833 leader_election.cc:290] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:22.600392  5861 raft_consensus.cc:515] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:22.601420  1689 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:22.602505  5861 leader_election.cc:290] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:22.603231  5861 raft_consensus.cc:493] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:22.603767  5861 raft_consensus.cc:515] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:22.604274  5862 consensus_queue.cc:1059] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:22.605352  5862 consensus_queue.cc:1048] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:00:22.606123  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:22.606189  5863 raft_consensus.cc:3055] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:22.606639  5861 leader_election.cc:290] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:22.606765  5863 raft_consensus.cc:740] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:22.607668  5863 consensus_queue.cc:260] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:22.608644  5863 raft_consensus.cc:3060] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Advancing to term 9
W20260709 13:00:22.609117  1615 connection.cc:256] RPC call timeout handler was delayed by -1.1252173919999677s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15700000000000003s for a response
I20260709 13:00:22.621989  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:22.626868  1689 leader_election.cc:304] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 13:00:22.627610  5833 raft_consensus.cc:2804] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:22.628381  5833 raft_consensus.cc:493] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:22.628731  5833 raft_consensus.cc:3060] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:22.631212  1689 leader_election.cc:304] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 13:00:22.631990  5861 raft_consensus.cc:2804] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:22.632445  5861 raft_consensus.cc:493] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:22.632925  5861 raft_consensus.cc:3060] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:22.636319  5833 raft_consensus.cc:515] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:22.638837  5833 leader_election.cc:290] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:22.653820  5861 raft_consensus.cc:515] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:22.658370  5861 leader_election.cc:290] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:22.659166  1689 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:34373 timed out after 2.333s (SENT) [suppressed 9 similar messages]
W20260709 13:00:22.662089  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:22.664911  5654 raft_consensus.cc:3060] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:22.665489  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:22.666410  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:22.667526  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:22.668064  2325 raft_consensus.cc:3060] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:22.668839  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:22.669452  2326 raft_consensus.cc:3060] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:22.669939  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:22.676040  5822 raft_consensus.cc:493] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.676703  5822 raft_consensus.cc:515] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:22.679072  5822 leader_election.cc:290] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:00:22.716406  1539 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.329s	user 0.005s	sys 0.021s
W20260709 13:00:22.716985  1539 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.330s	user 0.005s	sys 0.021s
W20260709 13:00:22.717272  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 1.38681e+06us
W20260709 13:00:22.725513  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 1.32829e+06us
W20260709 13:00:22.729008  1617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:22.736636  5875 consensus_queue.cc:1048] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:22.738188  5875 consensus_queue.cc:1048] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:22.751092  5871 consensus_queue.cc:1048] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:22.754004  5872 consensus_queue.cc:1059] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:22.754892  5872 raft_consensus.cc:493] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:22.755466  5872 raft_consensus.cc:515] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:22.739579  5875 consensus_queue.cc:1048] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 13:00:22.765856  2326 raft_consensus.cc:2468] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 11.
I20260709 13:00:22.769321  5872 leader_election.cc:290] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:22.783141  5635 raft_consensus.cc:3060] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:22.812666  5875 raft_consensus.cc:493] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.813216  5875 raft_consensus.cc:515] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:22.814209  5872 raft_consensus.cc:493] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:22.814754  5872 raft_consensus.cc:515] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:22.815340  5875 leader_election.cc:290] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:22.816978  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:22.818679  1576 raft_consensus.cc:1240] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:22.820297  5875 raft_consensus.cc:493] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.821211  5872 leader_election.cc:290] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:22.820853  5875 raft_consensus.cc:515] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:22.822821  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:22.830219  5875 leader_election.cc:290] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:22.825291  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:22.826687  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:22.826998  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:22.832834  1569 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 7.
I20260709 13:00:22.833689  5582 raft_consensus.cc:3055] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:22.834089  5582 raft_consensus.cc:740] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:22.834935  5582 consensus_queue.cc:260] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:22.836321  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:22.838161  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:22.838754  1576 raft_consensus.cc:2468] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 12.
I20260709 13:00:22.839730  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:22.841504  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:22.845114  5841 consensus_queue.cc:1059] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:22.846060  5841 raft_consensus.cc:3055] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:22.846427  5841 raft_consensus.cc:740] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:22.847312  5841 consensus_queue.cc:260] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:22.848783  5841 raft_consensus.cc:3060] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:22.835242  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:22.836294  5582 raft_consensus.cc:3060] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:22.874229  2295 leader_election.cc:304] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:22.876199  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:22.888983  2295 leader_election.cc:304] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:22.921078  1716 raft_consensus.cc:2468] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 13.
I20260709 13:00:22.921864  5842 raft_consensus.cc:493] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:22.922317  5842 raft_consensus.cc:515] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:22.926198  5842 leader_election.cc:290] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:22.936650  5842 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:22.937075  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:22.937214  5842 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:22.937762  1718 raft_consensus.cc:2468] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 11.
I20260709 13:00:22.938517  5861 raft_consensus.cc:493] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
W20260709 13:00:22.938650  1716 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2351) took 1658 ms (client timeout 2087 ms). Trace:
I20260709 13:00:22.939373  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:22.939615  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:22.939888  5842 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:22.940390  1717 raft_consensus.cc:2393] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 10: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:22.939069  5861 raft_consensus.cc:515] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:22.941038  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:22.941480  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:22.941998  1717 raft_consensus.cc:3060] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:22.942934  5861 leader_election.cc:290] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:22.944088  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:22.944664  1718 raft_consensus.cc:3060] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:22.945763  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:22.946318  1722 raft_consensus.cc:3060] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:22.948879  5623 leader_election.cc:290] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:22.939071  1716 rpcz_store.cc:269] 0709 13:00:21.279925 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:21.284487 (+  4562us) service_pool.cc:224] Handling call
0709 13:00:22.938477 (+1653990us) spinlock_profiling.cc:243] Waited 1.59 s on lock 0x7b540007dd54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:22.938579 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3657211776}
I20260709 13:00:22.951239  1718 raft_consensus.cc:2468] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 8.
I20260709 13:00:22.955300  1722 raft_consensus.cc:2468] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 10.
I20260709 13:00:22.955451  1717 raft_consensus.cc:2468] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 11.
I20260709 13:00:22.966403  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:22.990661  5595 raft_consensus.cc:2804] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:23.002352  1689 leader_election.cc:304] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 13:00:23.003122  5862 raft_consensus.cc:2804] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:23.003616  5862 raft_consensus.cc:697] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 11 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:23.003947  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:23.004585  2326 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 7.
I20260709 13:00:23.004437  5862 consensus_queue.cc:237] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:23.005980  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:23.006707  2331 raft_consensus.cc:2468] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 13.
I20260709 13:00:23.012710  1689 leader_election.cc:304] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 13:00:23.013345  5842 raft_consensus.cc:2804] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:23.013700  5842 raft_consensus.cc:493] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:23.013988  5842 raft_consensus.cc:3060] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:00:23.018584  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 2.16428e+06us
I20260709 13:00:23.019990  5665 consensus_queue.cc:1059] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:23.020923  5871 raft_consensus.cc:3055] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:23.021275  5871 raft_consensus.cc:740] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:23.022078  5871 consensus_queue.cc:260] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:23.023212  5871 raft_consensus.cc:3060] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:23.041987  5665 raft_consensus.cc:493] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:23.042583  5665 raft_consensus.cc:515] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:23.044688  5665 leader_election.cc:290] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:23.020133  5842 raft_consensus.cc:515] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:23.047072  5842 leader_election.cc:290] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:23.047174  1540 connection.cc:256] RPC call timeout handler was delayed by -2.9969839420000426s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:00:23.048504  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:23.048719  5871 raft_consensus.cc:493] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:23.049229  2331 raft_consensus.cc:3060] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:23.049365  5871 raft_consensus.cc:515] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:23.051391  5871 leader_election.cc:290] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:23.057108  1570 raft_consensus.cc:1240] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:23.056955  2331 raft_consensus.cc:2468] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 14.
I20260709 13:00:23.058264  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:23.059348  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:23.059643  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:23.060298  1574 raft_consensus.cc:2468] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 11.
I20260709 13:00:23.061252  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:23.061764  1689 leader_election.cc:304] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 13:00:23.060295  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:23.062975  1570 raft_consensus.cc:2468] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 10.
I20260709 13:00:23.063668  5862 raft_consensus.cc:2804] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:23.061777  1574 raft_consensus.cc:2468] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 10.
I20260709 13:00:23.064499  5862 raft_consensus.cc:697] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 14 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:23.065376  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:23.065421  5862 consensus_queue.cc:237] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:23.066848  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:23.067855  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:23.073297  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:23.074023  1570 raft_consensus.cc:2468] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7.
I20260709 13:00:23.074963  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:00:23.075491  1542 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.862s	user 0.013s	sys 0.056s
W20260709 13:00:23.076388  1542 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.865s	user 0.013s	sys 0.057s
W20260709 13:00:23.081898  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 1.87024e+06us
I20260709 13:00:23.076411  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:23.089007  5645 raft_consensus.cc:2804] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:23.089509  5645 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:23.089927  5645 raft_consensus.cc:3060] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:23.090757  1570 raft_consensus.cc:1240] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:23.092077  5649 raft_consensus.cc:493] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:23.092257  1570 raft_consensus.cc:1240] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 LEADER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:23.092694  5649 raft_consensus.cc:515] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:23.095060  5649 leader_election.cc:290] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:23.094661  1570 raft_consensus.cc:1275] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:00:23.098392  5645 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:23.100381  5645 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:23.104702  5871 consensus_queue.cc:1048] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:23.107720  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:23.108605  1725 raft_consensus.cc:2393] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 11: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:23.109037  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:23.109483  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:23.109977  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:23.110303  1724 raft_consensus.cc:2393] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 11: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:23.076615  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:23.109596  1718 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 7.
I20260709 13:00:23.111894  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:23.112279  1716 raft_consensus.cc:1240] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:00:23.112507  1722 raft_consensus.cc:3060] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:23.116614  1542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.116952  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:23.117533  1717 raft_consensus.cc:3060] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:23.119910  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:23.120640  1716 raft_consensus.cc:3060] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:23.130312  1716 raft_consensus.cc:2468] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 10.
I20260709 13:00:23.138530  1717 raft_consensus.cc:2468] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 10.
I20260709 13:00:23.139664  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:23.138621  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:00:23.140456  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:23.141719  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:23.141609  1716 raft_consensus.cc:2393] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 8: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:23.142719  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:23.142889  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:23.143181  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:23.145226  1722 raft_consensus.cc:2468] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 11.
I20260709 13:00:23.149646  5871 raft_consensus.cc:493] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:23.150314  5871 raft_consensus.cc:515] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:23.152052  2325 raft_consensus.cc:2468] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 10.
I20260709 13:00:23.152334  1717 raft_consensus.cc:2410] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:00:23.153992  5871 leader_election.cc:290] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:23.158500  1689 leader_election.cc:304] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 13:00:23.162170  5842 raft_consensus.cc:2804] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:23.162714  5842 raft_consensus.cc:697] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 10 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:23.163553  5842 consensus_queue.cc:237] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:23.160674  5850 raft_consensus.cc:2749] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:23.170019  1574 raft_consensus.cc:1275] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:00:23.171530  1570 raft_consensus.cc:1275] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:00:23.172510  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:23.173031  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:23.173632  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:23.174115  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:23.174469  1570 raft_consensus.cc:2410] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:00:23.169529  5784 raft_consensus.cc:493] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:23.174952  5784 raft_consensus.cc:515] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:23.175230  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:23.175257  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:23.177021  1574 raft_consensus.cc:2468] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 6.
I20260709 13:00:23.177115  5784 leader_election.cc:290] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:23.179001  5595 raft_consensus.cc:493] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:23.179455  5595 raft_consensus.cc:3060] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:23.190192  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:23.193300  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:23.194088  1574 raft_consensus.cc:2393] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 11: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:23.195182  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:23.198666  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:23.209726  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:23.199079  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:23.210973  1570 raft_consensus.cc:2393] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 10: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:23.211738  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:23.211854  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:23.212514  1570 raft_consensus.cc:2468] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 7.
I20260709 13:00:23.213238  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:23.213373  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:23.214236  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:23.203608  5772 leader_election.cc:290] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:23.206254  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:23.214780  1574 raft_consensus.cc:2468] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 6.
I20260709 13:00:23.215143  1576 raft_consensus.cc:2468] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 6.
I20260709 13:00:23.215564  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:23.207078  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:23.207608  5595 raft_consensus.cc:515] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:23.218722  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:23.215921  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:23.219482  1574 raft_consensus.cc:2410] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:00:23.219506  1576 raft_consensus.cc:2393] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 10: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:23.217633  1542 leader_election.cc:304] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:23.218366  1567 raft_consensus.cc:2368] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 9. Current term is 10.
I20260709 13:00:23.223683  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:23.224318  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:23.220721  1542 leader_election.cc:304] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:23.244975  5582 raft_consensus.cc:2804] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:23.245563  5582 raft_consensus.cc:697] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:23.245620  5712 raft_consensus.cc:2804] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:23.248175  1576 raft_consensus.cc:2410] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:00:23.243554  1542 leader_election.cc:304] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:23.250046  1570 raft_consensus.cc:2468] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 10.
I20260709 13:00:23.217375  5861 raft_consensus.cc:493] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:23.252388  1689 leader_election.cc:304] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:23.252673  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:23.254174  1689 leader_election.cc:304] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 13:00:23.254495  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:23.255178  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:23.255951  1574 raft_consensus.cc:2468] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 10.
I20260709 13:00:23.253013  5772 consensus_queue.cc:1048] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:00:23.257826  5635 raft_consensus.cc:2804] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:23.252004  5712 raft_consensus.cc:697] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:23.260648  5772 raft_consensus.cc:2804] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:23.261083  5772 raft_consensus.cc:493] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:23.260737  5712 consensus_queue.cc:237] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:23.261461  5772 raft_consensus.cc:3060] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:23.246553  5582 consensus_queue.cc:237] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:23.254868  5862 consensus_queue.cc:1048] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:00:23.257479  5654 raft_consensus.cc:2749] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:23.267320  5635 raft_consensus.cc:697] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:23.268252  5635 consensus_queue.cc:237] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:23.270576  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:23.273150  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:23.274036  1722 raft_consensus.cc:1275] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:00:23.274904  1717 raft_consensus.cc:1275] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:00:23.277521  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:23.258473  5861 raft_consensus.cc:515] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:23.220726  5665 consensus_queue.cc:1059] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:00:23.285116  5665 raft_consensus.cc:3055] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:23.285490  5665 raft_consensus.cc:740] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:23.286303  5665 consensus_queue.cc:260] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:23.287528  5665 raft_consensus.cc:3060] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:23.280454  5861 leader_election.cc:290] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:23.290997  1572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 1005) took 2094 ms. Trace:
I20260709 13:00:23.291361  1572 rpcz_store.cc:276] 0709 13:00:21.196217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:21.196414 (+   197us) service_pool.cc:224] Handling call
0709 13:00:21.202928 (+  6514us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:21.277359 (+ 74431us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:23.290767 (+2013408us) spinlock_profiling.cc:243] Waited 73.7 ms on lock 0x7b54002ea4d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:23.290944 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":169444736}
I20260709 13:00:23.293705  5595 leader_election.cc:290] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:23.301551  1723 raft_consensus.cc:1275] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:00:22.926144   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:23.308379  5563 consensus_queue.cc:1048] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:23.313163  2297 leader_election.cc:304] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:00:26.129920  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 2.81647e+06us
W20260709 13:00:25.620494  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:23.323575  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 64703.6us
W20260709 13:00:24.047705  1568 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.727s	user 0.005s	sys 0.009s
W20260709 13:00:26.136270  1568 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.816s	user 0.005s	sys 0.009s
I20260709 13:00:26.137652  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 1036) took 2819 ms. Trace:
I20260709 13:00:26.138074  1568 rpcz_store.cc:276] 0709 13:00:23.317987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.318997 (+  1010us) service_pool.cc:224] Handling call
0709 13:00:23.319268 (+   271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:23.319580 (+   312us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:23.319607 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:23.320017 (+   410us) log.cc:844] Serialized 26 byte log entry
0709 13:00:26.137032 (+2817015us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:26.137129 (+    97us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:26.137267 (+   138us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:26.137350 (+    83us) raft_consensus.cc:1685] finished
0709 13:00:26.137368 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:26.137580 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1217,"thread_start_us":2816507,"threads_started":1,"wal-append.queue_time_us":2774577}
I20260709 13:00:23.321805  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:23.486847  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 13:00:24.344282  1597 debug-util.cc:398] Leaking SignalData structure 0x7b080011abc0 after lost signal to thread 434
W20260709 13:00:25.298101  1689 connection.cc:256] RPC call timeout handler was delayed by -1.671442264999996s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2074s for a response
I20260709 13:00:26.141649  1572 raft_consensus.cc:3060] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:26.142454  1689 connection.cc:256] RPC call timeout handler was delayed by -1.5997118810000188s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1557s for a response
W20260709 13:00:26.142975  1689 connection.cc:256] RPC call timeout handler was delayed by -1.5502118809999956s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1612s for a response
W20260709 13:00:26.143615  1689 connection.cc:256] RPC call timeout handler was delayed by -1.3837118810000106s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1797s for a response
W20260709 13:00:26.144084  1689 connection.cc:256] RPC call timeout handler was delayed by -1.2046118810000053s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1996s for a response
I20260709 13:00:23.319199  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:25.712832  1573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 1009) took 2898 ms. Trace:
W20260709 13:00:25.206408  2294 connection.cc:256] RPC call timeout handler was delayed by -1.6787685850000571s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1829s for a response
I20260709 13:00:26.118161  5893 raft_consensus.cc:493] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
W20260709 13:00:24.787654  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 1.4666e+06us
I20260709 13:00:26.147668  1573 rpcz_store.cc:276] 0709 13:00:22.813783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.243898 (+430115us) service_pool.cc:224] Handling call
0709 13:00:23.244197 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:23.244385 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:00:23.244683 (+   298us) log.cc:844] Serialized 14 byte log entry
0709 13:00:25.656215 (+2411532us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:25.656367 (+   152us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:25.656511 (+   144us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:25.656676 (+   165us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:25.712537 (+ 55861us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2262560,"prepare.queue_time_us":150,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":2723098,"raft.run_cpu_time_us":411,"raft.run_wall_time_us":421,"thread_start_us":148047,"threads_started":2,"wal-append.queue_time_us":2859118}
W20260709 13:00:25.262197  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.149283  5893 raft_consensus.cc:515] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:25.277519  5665 consensus_meta.cc:287] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 1.990s	user 0.023s	sys 0.018s
W20260709 13:00:25.283205  5582 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.017s	user 0.012s	sys 0.020s
W20260709 13:00:25.265117  5772 consensus_meta.cc:287] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 2.003s	user 0.025s	sys 0.008s
I20260709 13:00:26.152997  5875 raft_consensus.cc:493] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
W20260709 13:00:26.153499  5582 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.887s	user 0.013s	sys 0.021s
I20260709 13:00:26.154114  5772 raft_consensus.cc:515] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:25.168491  5799 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.899s	user 0.015s	sys 0.022s
I20260709 13:00:26.156627  1570 raft_consensus.cc:2410] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 13:00:26.157029  5799 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.887s	user 0.017s	sys 0.022s
W20260709 13:00:26.157397  1720 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58782 (request call id 1029) took 2839 ms (client timeout 2110 ms). Trace:
I20260709 13:00:26.158553  5115 raft_consensus.cc:493] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.159300  5115 raft_consensus.cc:515] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:26.160794  5665 raft_consensus.cc:493] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:26.162021  5665 raft_consensus.cc:515] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:26.162633  5850 raft_consensus.cc:2749] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:25.863276  1651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 805) took 5085 ms. Trace:
W20260709 13:00:25.887821  1721 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.629s	user 0.008s	sys 0.051s
W20260709 13:00:25.302672  5842 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.988s	user 0.000s	sys 0.026s
W20260709 13:00:26.168645  1721 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.910s	user 0.008s	sys 0.053s
I20260709 13:00:26.154191  5875 raft_consensus.cc:515] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:26.170480  5842 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.855s	user 0.000s	sys 0.027s
I20260709 13:00:26.171792  5842 raft_consensus.cc:493] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.172880  5875 leader_election.cc:290] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:26.172640  5842 raft_consensus.cc:515] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:26.156307  1725 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.896s	user 0.006s	sys 0.031s
I20260709 13:00:25.859470  5759 raft_consensus.cc:2749] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:00:26.173668  1725 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.914s	user 0.007s	sys 0.031s
W20260709 13:00:25.291635  5871 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.024s	user 0.001s	sys 0.038s
I20260709 13:00:26.164695  1651 rpcz_store.cc:276] 0709 13:00:20.775841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:20.775993 (+   152us) service_pool.cc:224] Handling call
0709 13:00:20.776260 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:20.776451 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:00:21.007900 (+231449us) log.cc:844] Serialized 14 byte log entry
0709 13:00:22.841898 (+1833998us) spinlock_profiling.cc:243] Waited 1.45 ms on lock 0x7b1800395d40. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9f1f634bc 00007fa9ef2b148b 00007fa9f810bab9 00007fa9ef2cd69b 00007fa9ef2cb93f 00007fa9ef2cdc02 00007fa9f1f5520b 00007fa9f1f5ad23 00007fa9f1f5b23a
0709 13:00:25.852334 (+3010436us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:25.852594 (+   260us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:25.852790 (+   196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:25.859220 (+  6430us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:25.860986 (+  1766us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3009292,"prepare.queue_time_us":285688,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"spinlock_wait_cycles":3339008,"thread_start_us":256536,"threads_started":2,"wal-append.queue_time_us":137529,"wal-append.run_cpu_time_us":1472,"wal-append.run_wall_time_us":1001499}
W20260709 13:00:26.184262  5871 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.917s	user 0.002s	sys 0.040s
W20260709 13:00:26.144449  1689 connection.cc:256] RPC call timeout handler was delayed by -1.1476555239999584s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1685s for a response
W20260709 13:00:26.148370  2294 connection.cc:256] RPC call timeout handler was delayed by -1.6220685850000223s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1892s for a response
W20260709 13:00:26.157927  1720 rpcz_store.cc:269] 0709 13:00:23.318141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.318990 (+   849us) service_pool.cc:224] Handling call
0709 13:00:26.157040 (+2838050us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:26.159300  1570 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36642 (request call id 2434) took 2956 ms (client timeout 3253 ms). Trace:
I20260709 13:00:26.145279  5902 raft_consensus.cc:493] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:26.187394  2294 connection.cc:256] RPC call timeout handler was delayed by -1.5113268769999877s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2622s for a response
W20260709 13:00:26.205515  2294 connection.cc:256] RPC call timeout handler was delayed by -1.3613867730000493s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17070000000000002s for a response
W20260709 13:00:26.187628  1570 rpcz_store.cc:269] 0709 13:00:23.202943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.254413 (+ 51470us) service_pool.cc:224] Handling call
0709 13:00:26.158943 (+2904530us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b5400314a54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:26.159149 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":34133376}
W20260709 13:00:26.212865  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 80687.8us
I20260709 13:00:26.171108  1721 raft_consensus.cc:2955] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Committing config change with OpId 6.6: config changed from index 4 to 6, 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:00:26.223109  1572 raft_consensus.cc:2468] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 13.
I20260709 13:00:26.224045  5893 leader_election.cc:290] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:26.234259  1572 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37682 (request call id 1034) took 2928 ms (client timeout 2110 ms). Trace:
I20260709 13:00:26.231225  5892 raft_consensus.cc:493] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
W20260709 13:00:26.235176  1572 rpcz_store.cc:269] 0709 13:00:23.306010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.321274 (+ 15264us) service_pool.cc:224] Handling call
0709 13:00:26.231425 (+2910151us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:26.234001  5893 raft_consensus.cc:493] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:26.234905  5871 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:26.248987  1540 connection.cc:256] RPC call timeout handler was delayed by -1.1631455399999595s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15960000000000002s for a response
W20260709 13:00:26.249617  1540 connection.cc:256] RPC call timeout handler was delayed by -1.1325455399999669s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.163s for a response
I20260709 13:00:26.242102  5862 raft_consensus.cc:493] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:26.257299  5772 leader_election.cc:290] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:26.257411  5902 raft_consensus.cc:515] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:26.258581  5842 leader_election.cc:290] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:26.263450  5905 raft_consensus.cc:493] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.264708  5850 raft_consensus.cc:493] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.265219  5901 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:26.264770  5871 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:26.266139  5901 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:26.268765  5904 raft_consensus.cc:493] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.269145  5902 leader_election.cc:290] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:26.269892  5871 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:26.269794  5904 raft_consensus.cc:515] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:26.265600  5850 raft_consensus.cc:515] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:26.272677  5850 leader_election.cc:290] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:26.284819  5903 raft_consensus.cc:493] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:26.284983  5862 raft_consensus.cc:515] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:26.285780  5903 raft_consensus.cc:515] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:26.240962  5892 raft_consensus.cc:515] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:26.288599  5893 raft_consensus.cc:515] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:26.244800  5900 raft_consensus.cc:493] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:26.256419  5665 leader_election.cc:290] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:26.301242  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 110004us
W20260709 13:00:26.305083  1688 connection.cc:256] RPC call timeout handler was delayed by -2.9713804800000503s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1759s for a response
W20260709 13:00:26.305760  1688 connection.cc:256] RPC call timeout handler was delayed by -2.9641283530000351s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1796s for a response
I20260709 13:00:26.307147  5875 consensus_queue.cc:1048] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:26.308322  5799 consensus_queue.cc:1048] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:00:26.311317  5115 leader_election.cc:290] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:26.327808  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 63651.3us
W20260709 13:00:26.326762  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 96884.8us
I20260709 13:00:26.264461  5905 raft_consensus.cc:515] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:26.291067  5900 raft_consensus.cc:515] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:26.338243  5803 consensus_queue.cc:1048] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:00:26.339824  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:26.343079  1672 debug-util.cc:398] Leaking SignalData structure 0x7b0800081980 after lost signal to thread 434
W20260709 13:00:26.357815  1672 debug-util.cc:398] Leaking SignalData structure 0x7b0800198aa0 after lost signal to thread 1508
W20260709 13:00:26.314251  5910 log.cc:927] Time spent T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:00:26.360611  5654 raft_consensus.cc:493] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.361666  5654 raft_consensus.cc:515] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:26.362561  1725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1777) took 3104 ms. Trace:
I20260709 13:00:26.362893  5900 leader_election.cc:290] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:26.362975  1725 rpcz_store.cc:276] 0709 13:00:23.257964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.258817 (+   853us) service_pool.cc:224] Handling call
0709 13:00:23.259203 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:26.183954 (+2924751us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:26.184026 (+    72us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:26.185105 (+  1079us) log.cc:844] Serialized 26 byte log entry
0709 13:00:26.216717 (+ 31612us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:26.216762 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:26.225019 (+  8257us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:26.362327 (+137308us) raft_consensus.cc:1685] finished
0709 13:00:26.362344 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:26.362478 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6512,"raft.run_cpu_time_us":49,"raft.run_wall_time_us":49,"thread_start_us":2945550,"threads_started":2,"wal-append.queue_time_us":50349}
I20260709 13:00:26.365114  5902 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:26.365775  5902 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:26.367901  5902 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:26.368217  1651 raft_consensus.cc:1275] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:26.295740  5904 leader_election.cc:290] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:26.374081  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 115516us
W20260709 13:00:26.391891  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 55097.2us
W20260709 13:00:26.393311  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 60720.4us
I20260709 13:00:26.369391  5654 leader_election.cc:290] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:26.368402  5902 raft_consensus.cc:493] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:26.397946  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:26.373696  5901 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:26.398931  1688 connection.cc:256] RPC call timeout handler was delayed by -2.6785778569999934s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2074s for a response
W20260709 13:00:26.399830  1689 leader_election.cc:336] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Timed out: RequestConsensusVote RPC to 127.0.107.193:34373 timed out after 1.603s (SENT)
I20260709 13:00:26.368961  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:26.400478  5905 leader_election.cc:290] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:26.400833  5912 raft_consensus.cc:493] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.402083  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:26.409927  1649 raft_consensus.cc:2468] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 10.
I20260709 13:00:26.409739  5912 raft_consensus.cc:515] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:26.411258  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:26.412103  1649 raft_consensus.cc:2468] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 10.
I20260709 13:00:26.404493  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:26.413707  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:26.414680  1645 raft_consensus.cc:2468] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 12.
I20260709 13:00:26.412479  5912 leader_election.cc:290] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:26.417694  5842 raft_consensus.cc:493] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:26.407416  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:26.418462  5842 raft_consensus.cc:515] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:26.405433  1672 debug-util.cc:398] Leaking SignalData structure 0x7b0800345540 after lost signal to thread 1600
I20260709 13:00:26.405246  1648 raft_consensus.cc:2393] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 12: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
W20260709 13:00:26.418473  1688 connection.cc:256] RPC call timeout handler was delayed by -2.2579457649999881s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1612s for a response
W20260709 13:00:26.421046  1688 connection.cc:256] RPC call timeout handler was delayed by -1.8898457650000182s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2021s for a response
W20260709 13:00:26.421545  1688 connection.cc:256] RPC call timeout handler was delayed by -1.81642423400001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17190000000000003s for a response
W20260709 13:00:26.421916  1688 connection.cc:256] RPC call timeout handler was delayed by -1.7760141020000333s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1646s for a response
W20260709 13:00:26.422298  1688 connection.cc:256] RPC call timeout handler was delayed by -1.7242457649999778s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22050000000000003s for a response
W20260709 13:00:26.422680  1688 connection.cc:256] RPC call timeout handler was delayed by -1.698859796000022s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1867s for a response
W20260709 13:00:26.423048  1688 connection.cc:256] RPC call timeout handler was delayed by -1.6124463130000208s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15580000000000002s for a response
W20260709 13:00:26.423429  1688 connection.cc:256] RPC call timeout handler was delayed by -1.5831731190000369s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15900000000000003s for a response
W20260709 13:00:26.423800  1688 connection.cc:256] RPC call timeout handler was delayed by -1.54807143000005s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2014s for a response
W20260709 13:00:26.424175  1688 connection.cc:256] RPC call timeout handler was delayed by -1.5473652320000042s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1603s for a response
I20260709 13:00:26.419406  1647 raft_consensus.cc:2468] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 8.
I20260709 13:00:26.413725  1651 raft_consensus.cc:2468] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 8.
I20260709 13:00:26.405134  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:26.426932  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:26.427106  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:26.427450  1646 raft_consensus.cc:2468] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 7.
I20260709 13:00:26.427726  5842 leader_election.cc:290] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:26.428071  1648 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 12.
I20260709 13:00:26.428632  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:26.418569  5862 leader_election.cc:290] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:26.429740  1651 raft_consensus.cc:2410] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:00:26.432560  1719 raft_consensus.cc:1240] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 9. Current term is 10. Ops: []
W20260709 13:00:26.432804  1688 connection.cc:256] RPC call timeout handler was delayed by -1.5323065439999937s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16140000000000002s for a response
I20260709 13:00:26.433339  1719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1778) took 3175 ms. Trace:
W20260709 13:00:26.433537  1688 connection.cc:256] RPC call timeout handler was delayed by -1.3824264080000148s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19090000000000001s for a response
W20260709 13:00:26.433911  1688 connection.cc:256] RPC call timeout handler was delayed by -1.2880267020000247s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2682s for a response
W20260709 13:00:26.434410  1688 connection.cc:256] RPC call timeout handler was delayed by -1.2272628830000372s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1996s for a response
W20260709 13:00:26.401963  1689 leader_election.cc:336] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Timed out: RequestConsensusVote RPC to 127.0.107.193:34373 timed out after 1.797s (SENT)
W20260709 13:00:26.434775  1688 connection.cc:256] RPC call timeout handler was delayed by -1.0924457649999795s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2907s for a response
I20260709 13:00:26.434587  2295 leader_election.cc:304] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:26.435066  1689 leader_election.cc:304] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:26.436134  5862 raft_consensus.cc:2749] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:26.438423  5803 raft_consensus.cc:2804] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:26.439157  5803 raft_consensus.cc:697] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:26.418534  5654 raft_consensus.cc:493] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:26.433739  1719 rpcz_store.cc:276] 0709 13:00:23.258213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.431481 (+3173268us) service_pool.cc:224] Handling call
0709 13:00:26.431993 (+   512us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:26.433028 (+  1035us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:26.433246 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:26.451673  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 52311.1us
I20260709 13:00:26.430511  5912 raft_consensus.cc:493] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:26.454704  5915 raft_consensus.cc:493] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:26.456425  5915 raft_consensus.cc:515] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:26.442747  1689 leader_election.cc:336] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Timed out: RequestConsensusVote RPC to 127.0.107.193:34373 timed out after 2.333s (SENT)
W20260709 13:00:26.454298  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 55117.9us
I20260709 13:00:26.460680  5893 leader_election.cc:290] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:26.442444  5654 raft_consensus.cc:515] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:26.459410  5902 raft_consensus.cc:515] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:26.474520  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:26.475663  5654 leader_election.cc:290] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:26.476315  5902 leader_election.cc:290] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:26.477948  5915 leader_election.cc:290] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:26.440490  5803 consensus_queue.cc:237] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:26.496771  1688 connection.cc:256] RPC call timeout handler was delayed by -1.022216028999992s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2977s for a response
I20260709 13:00:26.454800  5912 raft_consensus.cc:515] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:27.121785  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:26.821091  2325 raft_consensus.cc:1240] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 9. Current term is 10. Ops: [7.8-9.9]
I20260709 13:00:28.500949  2325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32870 (request call id 527) took 1937 ms. Trace:
I20260709 13:00:28.501319  2325 rpcz_store.cc:276] 0709 13:00:26.563422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.819736 (+256314us) service_pool.cc:224] Handling call
0709 13:00:26.820395 (+   659us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:28.500643 (+1680248us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.500866 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:28.502626  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:26.826143  2326 raft_consensus.cc:1275] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:00:28.505949  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:28.506582  2326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32870 (request call id 529) took 1682 ms. Trace:
I20260709 13:00:28.506938  2326 rpcz_store.cc:276] 0709 13:00:26.824725 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.824909 (+   184us) service_pool.cc:224] Handling call
0709 13:00:26.825342 (+   433us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:28.506323 (+1680981us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.506529 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:28.509042  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:28.509809  1647 raft_consensus.cc:2468] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 11.
I20260709 13:00:28.510104  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:28.510881  1642 raft_consensus.cc:2468] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 10.
I20260709 13:00:28.511018  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:28.511812  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:26.830276  2329 raft_consensus.cc:1240] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:00:26.827803  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:26.565042  2331 raft_consensus.cc:1240] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
W20260709 13:00:27.147759  5919 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.007s	sys 0.000s
W20260709 13:00:27.153388  5803 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.004s	sys 0.017s
I20260709 13:00:26.501266  5784 raft_consensus.cc:493] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:27.190488  5903 leader_election.cc:290] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:27.962529  5892 leader_election.cc:290] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:27.982795  1672 debug-util.cc:398] Leaking SignalData structure 0x7b08003db360 after lost signal to thread 1675
W20260709 13:00:26.451927  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 52370us
W20260709 13:00:28.618470  1672 debug-util.cc:398] Leaking SignalData structure 0x7b0800398d00 after lost signal to thread 1676
I20260709 13:00:28.615916  5784 raft_consensus.cc:515] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:28.618759  1540 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.196:34423 timed out after 1.786s (SENT) [suppressed 27 similar messages]
W20260709 13:00:28.619956  1672 debug-util.cc:398] Leaking SignalData structure 0x7b080024a880 after lost signal to thread 1749
W20260709 13:00:28.620298  1672 debug-util.cc:398] Leaking SignalData structure 0x7b08002b0b60 after lost signal to thread 1750
I20260709 13:00:28.052852  5912 leader_election.cc:290] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:28.054409  2324 raft_consensus.cc:2410] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 13:00:28.054493  1688 leader_election.cc:336] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Timed out: RequestConsensusVote RPC to 127.0.107.194:37391 timed out after 1.558s (SENT)
W20260709 13:00:28.625375  2324 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32870 (request call id 534) took 1793 ms (client timeout 1630 ms). Trace:
W20260709 13:00:28.187369  1746 debug-util.cc:398] Leaking SignalData structure 0x7b08000b7320 after lost signal to thread 434
W20260709 13:00:28.625849  2324 rpcz_store.cc:269] 0709 13:00:26.831502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:27.119891 (+288389us) service_pool.cc:224] Handling call
0709 13:00:28.625278 (+1505387us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:28.626135  5908 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:28.626878  1746 debug-util.cc:398] Leaking SignalData structure 0x7b08001581a0 after lost signal to thread 1508
I20260709 13:00:28.626690  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:28.459022  1689 leader_election.cc:304] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:00:28.627419  1746 debug-util.cc:398] Leaking SignalData structure 0x7b08001e2be0 after lost signal to thread 1528
I20260709 13:00:28.472483  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:28.473692  5926 raft_consensus.cc:493] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:28.474112  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:28.474967  5712 raft_consensus.cc:493] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.475261  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:28.476725  5927 raft_consensus.cc:493] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.479245  5928 raft_consensus.cc:493] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:28.480480  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:28.481274  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:28.482147  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:28.482928  1573 raft_consensus.cc:1240] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:00:28.484593  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 13:00:28.488585  1650 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 2.082s	user 0.033s	sys 0.021s
I20260709 13:00:28.494125  5909 raft_consensus.cc:493] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:28.494570  2296 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.382s	user 0.007s	sys 0.013s
W20260709 13:00:28.634657  1650 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.228s	user 0.034s	sys 0.021s
I20260709 13:00:28.497094  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 15 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:28.498095  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:28.503582  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:28.504391  5935 raft_consensus.cc:493] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.512912  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:28.514088  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:00:28.514389  1651 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45148 (request call id 2318) took 2060 ms (client timeout 1796 ms). Trace:
W20260709 13:00:28.643257  2296 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.543s	user 0.007s	sys 0.013s
W20260709 13:00:28.643790  1651 rpcz_store.cc:269] 0709 13:00:26.458182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.514112 (+2055930us) service_pool.cc:211] Skipping call since client already timed out
0709 13:00:28.514275 (+   163us) inbound_call.cc:177] Queueing failure response
Metrics: {}
I20260709 13:00:28.516079  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:28.512418  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:28.508144  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 13:00:28.530490  1539 connection.cc:256] RPC call timeout handler was delayed by -2.3115593210000043s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1557s for a response
W20260709 13:00:28.645499  1539 connection.cc:256] RPC call timeout handler was delayed by -2.2499590329999251s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1539s for a response
I20260709 13:00:28.645569  5912 raft_consensus.cc:2749] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:28.531786  5931 raft_consensus.cc:493] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
W20260709 13:00:28.646003  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:28.646150  5926 raft_consensus.cc:515] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:28.647470  1569 raft_consensus.cc:2410] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:00:28.532285  5929 raft_consensus.cc:493] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:28.534788  1721 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.129s	user 0.015s	sys 0.028s
I20260709 13:00:28.642657  1568 raft_consensus.cc:2468] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 7.
I20260709 13:00:28.553454  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:28.562487  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:28.570693  2328 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 7.
I20260709 13:00:28.564337  2329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32870 (request call id 532) took 1735 ms. Trace:
I20260709 13:00:28.571870  2331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32870 (request call id 526) took 2009 ms. Trace:
W20260709 13:00:28.571870  5919 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 2.133s	user 0.008s	sys 0.000s
W20260709 13:00:28.581360  1597 debug-util.cc:398] Leaking SignalData structure 0x7b080011ab20 after lost signal to thread 1508
W20260709 13:00:28.608090  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 89249us
W20260709 13:00:28.613495  5803 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.048s	user 0.006s	sys 0.018s
I20260709 13:00:28.625434  1688 leader_election.cc:304] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
W20260709 13:00:28.649094  2328 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32870 (request call id 530) took 1822 ms (client timeout 1959 ms). Trace:
W20260709 13:00:28.629689  1746 debug-util.cc:398] Leaking SignalData structure 0x7b08001ed380 after lost signal to thread 1600
I20260709 13:00:28.494138  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:28.636718  5927 raft_consensus.cc:515] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:28.635535  1725 raft_consensus.cc:2468] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 9.
I20260709 13:00:28.637632  5928 raft_consensus.cc:515] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:28.640085  5909 raft_consensus.cc:515] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:28.640987  5712 raft_consensus.cc:515] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:28.641800  1648 raft_consensus.cc:2468] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 9.
W20260709 13:00:28.642644  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 2.19978e+06us
I20260709 13:00:28.646412  5931 raft_consensus.cc:515] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:28.557406  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:00:28.645884  1539 connection.cc:256] RPC call timeout handler was delayed by -2.2458593210000117s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.163s for a response
W20260709 13:00:28.702862  1539 connection.cc:256] RPC call timeout handler was delayed by -2.0757593210000209s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1819s for a response
W20260709 13:00:28.703389  1539 connection.cc:256] RPC call timeout handler was delayed by -1.9497593209999877s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19590000000000002s for a response
W20260709 13:00:28.703830  1539 connection.cc:256] RPC call timeout handler was delayed by -1.8862903029999529s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1533s for a response
W20260709 13:00:28.704254  1539 connection.cc:256] RPC call timeout handler was delayed by -1.8831593209999937s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2033s for a response
W20260709 13:00:28.704707  1539 connection.cc:256] RPC call timeout handler was delayed by -1.8718903029999865s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1549s for a response
W20260709 13:00:28.705125  1539 connection.cc:256] RPC call timeout handler was delayed by -1.7976593209999692s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21280000000000002s for a response
W20260709 13:00:28.705508  1539 connection.cc:256] RPC call timeout handler was delayed by -1.7553593210000145s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2175s for a response
W20260709 13:00:28.705905  1539 connection.cc:256] RPC call timeout handler was delayed by -1.6816871589999778s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1757s for a response
W20260709 13:00:28.706295  1539 connection.cc:256] RPC call timeout handler was delayed by -1.5379903029999582s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.192s for a response
W20260709 13:00:28.706616  1539 connection.cc:256] RPC call timeout handler was delayed by -1.4728871589999812s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19890000000000002s for a response
W20260709 13:00:28.707011  1539 connection.cc:256] RPC call timeout handler was delayed by -1.2324593210000216s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2756s for a response
I20260709 13:00:28.643236  1645 raft_consensus.cc:2468] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 8.
I20260709 13:00:28.649528  2331 rpcz_store.cc:276] 0709 13:00:26.562897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.563273 (+   376us) service_pool.cc:224] Handling call
0709 13:00:26.564448 (+  1175us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:28.571545 (+2007097us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.571800 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:28.649441  2329 rpcz_store.cc:276] 0709 13:00:26.829249 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.829433 (+   184us) service_pool.cc:224] Handling call
0709 13:00:26.829808 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:28.563904 (+1734096us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.564231 (+   327us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:28.645773  1642 raft_consensus.cc:2468] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 6.
W20260709 13:00:28.665159  1746 debug-util.cc:398] Leaking SignalData structure 0x7b080010f5e0 after lost signal to thread 1616
W20260709 13:00:28.708925  1746 debug-util.cc:398] Leaking SignalData structure 0x7b08003289a0 after lost signal to thread 1617
W20260709 13:00:28.710004  1746 debug-util.cc:398] Leaking SignalData structure 0x7b080037c680 after lost signal to thread 1675
W20260709 13:00:28.710322  1746 debug-util.cc:398] Leaking SignalData structure 0x7b08001331a0 after lost signal to thread 1676
W20260709 13:00:28.663793  2328 rpcz_store.cc:269] 0709 13:00:26.827061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.827279 (+   218us) service_pool.cc:224] Handling call
0709 13:00:28.649034 (+1821755us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:28.659339  1721 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.254s	user 0.015s	sys 0.028s
I20260709 13:00:28.711279  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:28.712651  2332 raft_consensus.cc:1240] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 LEADER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:28.714087  1644 raft_consensus.cc:3060] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:28.710773  1646 raft_consensus.cc:2468] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 8.
W20260709 13:00:28.714900  1746 debug-util.cc:398] Leaking SignalData structure 0x7b0800330980 after lost signal to thread 1749
W20260709 13:00:28.715279  1746 debug-util.cc:398] Leaking SignalData structure 0x7b08003d7960 after lost signal to thread 1750
I20260709 13:00:28.715323  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:28.716404  1646 raft_consensus.cc:2393] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 11: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:28.643463  5935 raft_consensus.cc:515] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:28.717572  1746 debug-util.cc:398] Leaking SignalData structure 0x7b0800358380 after lost signal to thread 2356
W20260709 13:00:28.718596  1746 debug-util.cc:398] Leaking SignalData structure 0x7b08003f3680 after lost signal to thread 2357
W20260709 13:00:28.719172  1746 debug-util.cc:398] Leaking SignalData structure 0x7b08003ef5a0 after lost signal to thread 5115
W20260709 13:00:28.719471  1746 debug-util.cc:398] Leaking SignalData structure 0x7b080035d540 after lost signal to thread 5582
I20260709 13:00:28.719573  5935 leader_election.cc:290] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:00:28.720181  1615 connection.cc:256] RPC call timeout handler was delayed by -6.0325908320000394s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2219s for a response
I20260709 13:00:28.720865  2324 raft_consensus.cc:1275] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:28.714457  5929 raft_consensus.cc:515] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:28.711894  1647 raft_consensus.cc:2468] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 8.
W20260709 13:00:28.732826  1597 debug-util.cc:398] Leaking SignalData structure 0x7b080011a4e0 after lost signal to thread 1542
I20260709 13:00:28.717284  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:00:28.719810  1746 debug-util.cc:398] Leaking SignalData structure 0x7b0800362bc0 after lost signal to thread 5635
W20260709 13:00:28.736379  1746 debug-util.cc:398] Leaking SignalData structure 0x7b08000b14c0 after lost signal to thread 5644
W20260709 13:00:28.736708  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 117971us
I20260709 13:00:28.738456  2330 raft_consensus.cc:1275] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:00:28.626761  5908 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:28.743521  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:28.744421  1651 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 12.
I20260709 13:00:28.745790  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:28.746627  1642 raft_consensus.cc:2468] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 8.
I20260709 13:00:28.741612  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:28.748245  1648 raft_consensus.cc:2410] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:00:28.737448  1643 raft_consensus.cc:2468] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 8.
I20260709 13:00:28.750216  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:00:28.736833  1746 debug-util.cc:398] Leaking SignalData structure 0x7b08003e0a40 after lost signal to thread 5645
W20260709 13:00:28.753775  1746 debug-util.cc:398] Leaking SignalData structure 0x7b08003f82e0 after lost signal to thread 5648
I20260709 13:00:28.753298  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:00:28.754179  1746 debug-util.cc:398] Leaking SignalData structure 0x7b080034dc80 after lost signal to thread 5662
W20260709 13:00:28.754971  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 88909.2us
W20260709 13:00:28.755354  1746 debug-util.cc:398] Leaking SignalData structure 0x7b080022d9e0 after lost signal to thread 5665
W20260709 13:00:28.750945  1643 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57912 (request call id 823) took 2349 ms (client timeout 2422 ms). Trace:
W20260709 13:00:28.755847  1746 debug-util.cc:398] Leaking SignalData structure 0x7b0800098720 after lost signal to thread 5679
W20260709 13:00:28.757189  1746 debug-util.cc:398] Leaking SignalData structure 0x7b0800097b80 after lost signal to thread 5681
W20260709 13:00:28.758628  1746 debug-util.cc:398] Leaking SignalData structure 0x7b08003695e0 after lost signal to thread 5759
W20260709 13:00:28.759994  1746 debug-util.cc:398] Leaking SignalData structure 0x7b080025daa0 after lost signal to thread 5761
W20260709 13:00:28.755924  1643 rpcz_store.cc:269] 0709 13:00:26.401930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:28.557027 (+2155097us) service_pool.cc:224] Handling call
0709 13:00:28.750869 (+193842us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:28.761158  1746 debug-util.cc:398] Leaking SignalData structure 0x7b0800359d00 after lost signal to thread 5767
W20260709 13:00:28.763197  1746 debug-util.cc:398] Leaking SignalData structure 0x7b080039b3a0 after lost signal to thread 5772
W20260709 13:00:28.764581  1746 debug-util.cc:398] Leaking SignalData structure 0x7b08003bbe80 after lost signal to thread 5778
W20260709 13:00:28.766320  1746 debug-util.cc:398] Leaking SignalData structure 0x7b080035ff00 after lost signal to thread 5811
W20260709 13:00:28.767997  1746 debug-util.cc:398] Leaking SignalData structure 0x7b0800347500 after lost signal to thread 5812
W20260709 13:00:28.769726  1746 debug-util.cc:398] Leaking SignalData structure 0x7b080031b4c0 after lost signal to thread 5813
W20260709 13:00:28.776611  1746 debug-util.cc:398] Leaking SignalData structure 0x7b08003649c0 after lost signal to thread 5815
W20260709 13:00:28.780694  1746 debug-util.cc:398] Leaking SignalData structure 0x7b0800385360 after lost signal to thread 5816
I20260709 13:00:28.782074  5929 leader_election.cc:290] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:00:28.782936  1597 debug-util.cc:398] Leaking SignalData structure 0x7b08003f2b40 after lost signal to thread 1600
W20260709 13:00:28.790174  1597 debug-util.cc:398] Leaking SignalData structure 0x7b08003a26c0 after lost signal to thread 1601
I20260709 13:00:28.783594  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:28.738013  5892 raft_consensus.cc:2749] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:00:28.785210  1746 debug-util.cc:398] Leaking SignalData structure 0x7b08001a31c0 after lost signal to thread 5873
W20260709 13:00:28.791433  1746 debug-util.cc:398] Leaking SignalData structure 0x7b08002ae780 after lost signal to thread 5874
I20260709 13:00:28.754869  1642 raft_consensus.cc:2468] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 9.
I20260709 13:00:28.791872  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:28.809031  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:28.816234  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:00:28.816841  1597 debug-util.cc:398] Leaking SignalData structure 0x7b0800306d80 after lost signal to thread 1675
I20260709 13:00:28.818508  1645 raft_consensus.cc:2468] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 12.
I20260709 13:00:28.818850  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:28.819574  1643 raft_consensus.cc:2468] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 10.
I20260709 13:00:28.819782  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:28.820479  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:28.821240  1643 raft_consensus.cc:2468] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 7.
I20260709 13:00:28.821322  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:28.822130  1645 raft_consensus.cc:3060] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:28.822365  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:28.823041  1642 raft_consensus.cc:2468] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 10.
I20260709 13:00:28.823786  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:28.826788  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:28.827520  5644 raft_consensus.cc:493] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.829396  1574 raft_consensus.cc:1275] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:00:28.835834  1651 raft_consensus.cc:2468] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 11.
W20260709 13:00:28.837759  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 783243us
W20260709 13:00:28.838769  1688 leader_election.cc:336] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Timed out: RequestConsensusVote RPC to 127.0.107.194:37391 timed out after 1.590s (SENT)
W20260709 13:00:28.839479  1688 leader_election.cc:336] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Timed out: RequestConsensusVote RPC to 127.0.107.194:37391 timed out after 1.603s (SENT)
I20260709 13:00:28.839957  1688 leader_election.cc:304] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:28.841377  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:28.847272  1642 raft_consensus.cc:2410] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:00:28.844949  5909 leader_election.cc:290] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:28.845832  5928 leader_election.cc:290] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:28.846693  1597 debug-util.cc:398] Leaking SignalData structure 0x7b0800249720 after lost signal to thread 1676
W20260709 13:00:28.851120  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 96194.5us
I20260709 13:00:28.848371  1646 raft_consensus.cc:2468] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 6.
I20260709 13:00:28.754626  5784 leader_election.cc:290] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:28.865832  1597 debug-util.cc:398] Leaking SignalData structure 0x7b0800335a00 after lost signal to thread 1749
W20260709 13:00:28.866297  1597 debug-util.cc:398] Leaking SignalData structure 0x7b08003d58a0 after lost signal to thread 1750
W20260709 13:00:28.867305  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 82781.4us
I20260709 13:00:28.828137  5644 raft_consensus.cc:515] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:28.869422  1643 raft_consensus.cc:2468] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 10.
W20260709 13:00:28.870697  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 121183us
I20260709 13:00:28.870787  1644 raft_consensus.cc:2468] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 10.
W20260709 13:00:28.862780  2294 leader_election.cc:336] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Timed out: RequestConsensusVote RPC to 127.0.107.194:37391 timed out after 1.707s (SENT)
W20260709 13:00:28.870976  1672 debug-util.cc:398] Leaking SignalData structure 0x7b08002c9520 after lost signal to thread 2356
W20260709 13:00:28.871613  1672 debug-util.cc:398] Leaking SignalData structure 0x7b08003c5d80 after lost signal to thread 2357
I20260709 13:00:28.874449  1576 raft_consensus.cc:2468] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 6.
I20260709 13:00:28.875445  2294 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:28.875819  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:28.878175  1648 raft_consensus.cc:2468] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 9.
W20260709 13:00:28.881314  1597 debug-util.cc:398] Leaking SignalData structure 0x7b08003b6640 after lost signal to thread 2356
W20260709 13:00:28.881762  1597 debug-util.cc:398] Leaking SignalData structure 0x7b08002989c0 after lost signal to thread 2357
I20260709 13:00:28.901175  1646 raft_consensus.cc:3055] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:28.901844  1646 raft_consensus.cc:740] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:28.877676  5926 leader_election.cc:290] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:28.905545  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:28.906862  1646 consensus_queue.cc:260] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:28.910142  1647 raft_consensus.cc:2468] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 4.
I20260709 13:00:28.922324  1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1776) took 5664 ms. Trace:
W20260709 13:00:28.922592  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 185501us
W20260709 13:00:28.918118  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 78660.6us
W20260709 13:00:28.922541  1597 debug-util.cc:398] Leaking SignalData structure 0x7b08003fc7c0 after lost signal to thread 5648
W20260709 13:00:28.923825  1597 debug-util.cc:398] Leaking SignalData structure 0x7b0800201fa0 after lost signal to thread 5662
W20260709 13:00:28.924134  1597 debug-util.cc:398] Leaking SignalData structure 0x7b080031a640 after lost signal to thread 5679
W20260709 13:00:28.925037  1597 debug-util.cc:398] Leaking SignalData structure 0x7b0800348a80 after lost signal to thread 5681
I20260709 13:00:28.901522  5892 raft_consensus.cc:2749] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:28.890662  5934 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
W20260709 13:00:28.925432  1597 debug-util.cc:398] Leaking SignalData structure 0x7b0800373980 after lost signal to thread 5760
W20260709 13:00:28.932126  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:28.933678  1597 debug-util.cc:398] Leaking SignalData structure 0x7b0800368ea0 after lost signal to thread 5761
W20260709 13:00:28.933981  1597 debug-util.cc:398] Leaking SignalData structure 0x7b08003dc1a0 after lost signal to thread 5763
W20260709 13:00:28.934201  1597 debug-util.cc:398] Leaking SignalData structure 0x7b080034eda0 after lost signal to thread 5764
I20260709 13:00:28.922780  1721 rpcz_store.cc:276] 0709 13:00:23.257676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:23.257816 (+   140us) service_pool.cc:224] Handling call
0709 13:00:23.258106 (+   290us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:26.170763 (+2912657us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:26.392431 (+221668us) log.cc:844] Serialized 14 byte log entry
0709 13:00:28.734851 (+2342420us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:28.752431 (+ 17580us) log.cc:844] Serialized 52 byte log entry
0709 13:00:28.877945 (+125514us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:28.878002 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:28.878123 (+   121us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:28.909689 (+ 31566us) raft_consensus.cc:1685] finished
0709 13:00:28.909716 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:28.922243 (+ 12527us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23613,"raft.queue_time_us":31851,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":26360,"thread_start_us":5342610,"threads_started":3,"wal-append.queue_time_us":932627,"wal-append.run_cpu_time_us":1354,"wal-append.run_wall_time_us":1005520}
I20260709 13:00:28.934599  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 15 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:28.937327  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:28.939146  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:28.939152  1646 raft_consensus.cc:3060] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:28.939993  1642 raft_consensus.cc:2393] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 12: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:28.940784  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:00:28.942935  1597 debug-util.cc:398] Leaking SignalData structure 0x7b08003e8140 after lost signal to thread 5767
I20260709 13:00:28.908972  5949 raft_consensus.cc:2749] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:28.944319  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:28.926208  5644 leader_election.cc:290] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:28.942651  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:28.946341  1644 raft_consensus.cc:2393] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 8: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:28.903842  5942 consensus_queue.cc:1048] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.036s
W20260709 13:00:28.947908  1597 debug-util.cc:398] Leaking SignalData structure 0x7b0800146aa0 after lost signal to thread 5778
I20260709 13:00:28.947901  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:28.953431  1647 raft_consensus.cc:2410] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 13 because replica has last-logged OpId of term: 11 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:00:28.953954  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:28.946530  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:28.945948  1642 raft_consensus.cc:2468] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 12.
I20260709 13:00:28.949527  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:28.955884  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:00:28.956156  1597 debug-util.cc:398] Leaking SignalData structure 0x7b0800304580 after lost signal to thread 5812
I20260709 13:00:28.954800  1648 raft_consensus.cc:2468] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 7.
I20260709 13:00:28.958340  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:28.959010  1644 raft_consensus.cc:2468] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 7.
I20260709 13:00:28.959815  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:28.960321  1644 raft_consensus.cc:2468] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 10.
W20260709 13:00:28.961041  5950 log.cc:927] Time spent T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:00:28.961601  5648 raft_consensus.cc:493] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:28.962272  5648 raft_consensus.cc:515] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:28.965018  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:28.946990  5934 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:28.965901  1540 connection.cc:256] RPC call timeout handler was delayed by -1.1262737639999614s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16590000000000002s for a response
I20260709 13:00:28.967252  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:00:28.968168  1597 debug-util.cc:398] Leaking SignalData structure 0x7b08003cc9c0 after lost signal to thread 5813
W20260709 13:00:28.968545  1597 debug-util.cc:398] Leaking SignalData structure 0x7b0800096a20 after lost signal to thread 5815
W20260709 13:00:28.968822  1597 debug-util.cc:398] Leaking SignalData structure 0x7b08003bd660 after lost signal to thread 5816
I20260709 13:00:28.969012  1568 raft_consensus.cc:2410] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 13:00:28.969237  1597 debug-util.cc:398] Leaking SignalData structure 0x7b0800392100 after lost signal to thread 5858
W20260709 13:00:28.969563  1597 debug-util.cc:398] Leaking SignalData structure 0x7b08002e8060 after lost signal to thread 5860
W20260709 13:00:28.969972  1597 debug-util.cc:398] Leaking SignalData structure 0x7b0800310a20 after lost signal to thread 5873
W20260709 13:00:28.970206  1597 debug-util.cc:398] Leaking SignalData structure 0x7b080037d920 after lost signal to thread 5874
I20260709 13:00:28.973410  5931 leader_election.cc:290] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:28.976703  1672 debug-util.cc:398] Leaking SignalData structure 0x7b08001f0520 after lost signal to thread 5662
I20260709 13:00:28.976996  5927 leader_election.cc:290] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:28.977795  5662 raft_consensus.cc:493] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:28.973062  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:28.978605  1642 raft_consensus.cc:2468] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 8.
I20260709 13:00:28.978372  5662 raft_consensus.cc:515] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:28.979593  1688 leader_election.cc:336] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Timed out: RequestConsensusVote RPC to 127.0.107.194:37391 timed out after 1.614s (SENT)
I20260709 13:00:28.979712  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:28.981003  1572 raft_consensus.cc:2468] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 10.
I20260709 13:00:28.981429  5681 raft_consensus.cc:493] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:28.981030  5679 raft_consensus.cc:493] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:28.981945  5681 raft_consensus.cc:515] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:28.982398  5679 raft_consensus.cc:515] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:28.977164  1672 debug-util.cc:398] Leaking SignalData structure 0x7b08003cac20 after lost signal to thread 5681
I20260709 13:00:28.980165  1688 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:28.998487  1645 raft_consensus.cc:2468] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 11.
W20260709 13:00:28.999058  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 58379us
W20260709 13:00:28.977842  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 115090us
I20260709 13:00:29.016597  1651 raft_consensus.cc:1275] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:00:28.985039  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:28.993098  1573 raft_consensus.cc:1275] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:00:28.993520  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:28.998785  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:28.987033  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 13:00:29.017287  2294 leader_election.cc:336] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Timed out: RequestConsensusVote RPC to 127.0.107.194:37391 timed out after 1.829s (SENT)
I20260709 13:00:29.019681  1568 raft_consensus.cc:3060] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:29.020222  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:29.017525  1643 raft_consensus.cc:2468] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 8.
I20260709 13:00:28.986590  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:28.993985  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:28.993366  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:29.022657  1576 raft_consensus.cc:2393] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 10: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:29.025552  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:29.026715  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:00:29.027706  1689 connection.cc:256] RPC call timeout handler was delayed by -2.1846924340000555s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15900000000000003s for a response
W20260709 13:00:29.028175  1689 connection.cc:256] RPC call timeout handler was delayed by -1.8192924340000332s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1996s for a response
I20260709 13:00:29.029222  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:29.029371  2294 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:29.030169  1648 raft_consensus.cc:2376] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 14. Re-sending same reply.
I20260709 13:00:29.030579  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:29.003101  5929 consensus_queue.cc:1059] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:00:29.031908  5926 raft_consensus.cc:3055] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:29.032341  5926 raft_consensus.cc:740] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:29.032603  5662 leader_election.cc:290] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:28.984459  5681 leader_election.cc:290] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:28.984753  5759 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:29.033435  5926 consensus_queue.cc:260] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:29.033924  5759 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:29.034976  5926 raft_consensus.cc:3060] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:29.037073  5648 leader_election.cc:290] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:29.023134  1570 raft_consensus.cc:2468] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 6.
W20260709 13:00:29.041121  1689 connection.cc:256] RPC call timeout handler was delayed by -1.240410326000017s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16100000000000003s for a response
W20260709 13:00:29.041718  1689 connection.cc:256] RPC call timeout handler was delayed by -1.1927103260000536s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1663s for a response
W20260709 13:00:29.042160  1689 connection.cc:256] RPC call timeout handler was delayed by -1.1927103260000536s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1663s for a response
I20260709 13:00:29.056017  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:29.060869  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:29.062517  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 13:00:29.048509  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 292807us
I20260709 13:00:29.063174  1572 raft_consensus.cc:3060] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:29.053726  5955 log.cc:927] Time spent T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 13:00:29.064002  2297 leader_election.cc:304] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 13:00:29.063297  1567 raft_consensus.cc:2468] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 10.
I20260709 13:00:28.996630  5784 consensus_queue.cc:1048] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 13:00:28.995560  5908 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:29.036375  5759 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:29.087580  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 131171us
W20260709 13:00:29.077070  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 59830.1us
I20260709 13:00:29.078625  5937 raft_consensus.cc:2749] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:29.059665  5892 raft_consensus.cc:2749] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:00:29.080320  1615 connection.cc:256] RPC call timeout handler was delayed by -5.7888616790000356s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1824s for a response
W20260709 13:00:29.104625  1615 connection.cc:256] RPC call timeout handler was delayed by -5.7321470790000149s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2088s for a response
I20260709 13:00:29.083074  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:29.076910  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:29.089291  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:29.106050  1567 raft_consensus.cc:2468] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 6.
I20260709 13:00:29.106873  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:29.048913  5934 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:29.040984  5679 leader_election.cc:290] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:00:29.109290  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.114908  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:00:29.105062  1615 connection.cc:256] RPC call timeout handler was delayed by -5.7260829749999971s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32430000000000003s for a response
W20260709 13:00:29.118216  1615 connection.cc:256] RPC call timeout handler was delayed by -5.7062829750000219s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3265s for a response
W20260709 13:00:29.118546  1615 connection.cc:256] RPC call timeout handler was delayed by -5.6079470790000414s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22260000000000002s for a response
W20260709 13:00:29.118824  1615 connection.cc:256] RPC call timeout handler was delayed by -5.1199587300000076s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2582s for a response
W20260709 13:00:29.119110  1615 connection.cc:256] RPC call timeout handler was delayed by -5.1199587300000076s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2582s for a response
W20260709 13:00:29.119377  1615 connection.cc:256] RPC call timeout handler was delayed by -4.9572470790000125s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2949s for a response
W20260709 13:00:29.119643  1615 connection.cc:256] RPC call timeout handler was delayed by -1.6920579190000353s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
W20260709 13:00:29.121150  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 57249.5us
I20260709 13:00:29.129034  5874 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
W20260709 13:00:29.107753  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 52529.4us
I20260709 13:00:29.133328  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:29.142032  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:29.142716  1567 raft_consensus.cc:2468] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 10.
I20260709 13:00:29.143092  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:29.145284  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:29.146334  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:29.154417  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:29.147293  2295 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:29.158509  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:29.162176  1571 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 7.
I20260709 13:00:29.162925  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:29.163117  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:29.163816  2329 raft_consensus.cc:2410] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:00:29.163786  2330 raft_consensus.cc:2468] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 10.
I20260709 13:00:29.164956  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:29.166224  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:29.169682  5873 raft_consensus.cc:493] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:29.170854  1650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 816) took 2804 ms. Trace:
I20260709 13:00:29.171468  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:29.173838  1716 raft_consensus.cc:1275] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:00:29.174990  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:29.175171  5649 raft_consensus.cc:493] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:29.175711  5649 raft_consensus.cc:515] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:29.180874  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 13:00:29.184631  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 49285.7us
I20260709 13:00:29.129729  5874 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:29.142035  5932 consensus_queue.cc:1059] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:00:29.194187  5874 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:29.194869  5932 raft_consensus.cc:3055] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:29.195302  5932 raft_consensus.cc:740] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:29.176052  5946 raft_consensus.cc:2804] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:29.164894  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:29.174069  5938 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:29.199748  1471 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55620 (request call id 276) took 15626 ms (client timeout 15000 ms). Trace:
I20260709 13:00:29.170733  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:29.200953  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:29.197996  1615 leader_election.cc:304] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:29.205953  1649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 826) took 2802 ms. Trace:
I20260709 13:00:29.196342  5949 raft_consensus.cc:2804] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:29.225153  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 13:00:29.226866  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 138454us
I20260709 13:00:29.213896  5946 raft_consensus.cc:493] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.216104  1649 rpcz_store.cc:276] 0709 13:00:26.403032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.414035 (+ 11003us) service_pool.cc:224] Handling call
0709 13:00:26.414344 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:28.680905 (+2266561us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:28.680955 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:28.712363 (+ 31408us) log.cc:844] Serialized 26 byte log entry
0709 13:00:28.807198 (+ 94835us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:28.935941 (+128743us) log.cc:844] Serialized 14 byte log entry
0709 13:00:29.201187 (+265246us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:29.201294 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:29.201349 (+    55us) raft_consensus.cc:1685] finished
0709 13:00:29.201361 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:29.205852 (+  4491us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2462353,"prepare.queue_time_us":185416,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":42,"raft.queue_time_us":2868311,"raft.run_cpu_time_us":283,"raft.run_wall_time_us":44449,"thread_start_us":186246,"threads_started":3,"wal-append.queue_time_us":68734}
I20260709 13:00:29.228044  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:29.226715  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:29.230837  1568 raft_consensus.cc:2468] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 8.
I20260709 13:00:29.171312  1650 rpcz_store.cc:276] 0709 13:00:26.366046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:26.396914 (+ 30868us) service_pool.cc:224] Handling call
0709 13:00:26.405891 (+  8977us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:26.406361 (+   470us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:00:28.636747 (+2230386us) log.cc:844] Serialized 14 byte log entry
0709 13:00:29.170461 (+533714us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:29.170522 (+    61us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:29.170580 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:29.170644 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:29.170773 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":433898,"prepare.queue_time_us":765882,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":1014,"raft.queue_time_us":441662,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":103,"thread_start_us":2316052,"threads_started":2,"wal-append.queue_time_us":197218}
I20260709 13:00:29.158046  5927 consensus_queue.cc:1059] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.079s
I20260709 13:00:29.236882  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:29.237596  5927 raft_consensus.cc:3055] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:29.238000  5927 raft_consensus.cc:740] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:29.238241  2328 raft_consensus.cc:2468] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6.
I20260709 13:00:29.238914  5927 consensus_queue.cc:260] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:29.240259  5927 raft_consensus.cc:3060] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:29.230468  2327 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 7.
W20260709 13:00:29.214182  1471 rpcz_store.cc:269] 0709 13:00:13.573096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:13.576665 (+  3569us) service_pool.cc:224] Handling call
0709 13:00:29.199481 (+15622816us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:21.073308 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:21.120013 (+ 46705us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:21.120045 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:00:21.120066 (+    21us) tablet.cc:662] Decoding operations
0709 13:00:21.132763 (+ 12697us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:21.132825 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:21.132856 (+    31us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:00:21.134499 (+  1643us) tablet.cc:701] Row locks acquired
0709 13:00:21.134520 (+    21us) write_op.cc:260] PREPARE: finished
0709 13:00:21.137721 (+  3201us) write_op.cc:270] Start()
0709 13:00:21.142779 (+  5058us) write_op.cc:276] Timestamp: P: 1783602021134620 usec, L: 0
0709 13:00:21.159833 (+ 17054us) op_driver.cc:348] REPLICATION: starting
0709 13:00:21.274421 (+114588us) log.cc:844] Serialized 8378 byte log entry
0709 13:00:21.747374 (+472953us) op_driver.cc:464] REPLICATION: finished
0709 13:00:22.475423 (+728049us) write_op.cc:301] APPLY: starting
0709 13:00:22.475507 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:22.573864 (+ 98357us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:22.573955 (+    91us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:22.585996 (+ 12041us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:22.586321 (+   325us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=42,key_file_lookups=42,delta_file_lookups=42,mrs_lookups=0
0709 13:00:22.586368 (+    47us) write_op.cc:312] APPLY: finished
0709 13:00:22.587660 (+  1292us) log.cc:844] Serialized 188 byte log entry
0709 13:00:22.587833 (+   173us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:22.588025 (+   192us) write_op.cc:454] Released schema lock
0709 13:00:22.588084 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:22.588430 (+   346us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:22.588463 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":40270,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":727761,"apply.run_cpu_time_us":26417,"apply.run_wall_time_us":112997,"cfile_cache_hit":82,"cfile_cache_hit_bytes":85690,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6217,"cfile_init":2,"lbm_read_time_us":3399,"lbm_reads_1-10_ms":1,"lbm_reads_lt_1ms":11,"num_ops":21,"prepare.queue_time_us":399806,"prepare.run_cpu_time_us":15472,"prepare.run_wall_time_us":272588,"replication_time_us":587349,"thread_start_us":451232,"threads_started":2}]]}
I20260709 13:00:29.247102  1572 raft_consensus.cc:2468] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 11.
I20260709 13:00:29.196408  5932 consensus_queue.cc:260] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:29.224643  5949 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.232231  5946 raft_consensus.cc:3060] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:29.229856  5644 raft_consensus.cc:2804] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:29.265472  5644 raft_consensus.cc:493] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.265851  5644 raft_consensus.cc:3060] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:29.230383  5938 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:29.270550  5938 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:29.271358  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:29.271965  2331 raft_consensus.cc:3060] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:29.276175  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.276877  5645 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:29.277074  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:29.277679  5645 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:29.278602  1724 raft_consensus.cc:1240] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:29.280179  1724 raft_consensus.cc:1275] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:00:29.283268  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:29.284963  1722 raft_consensus.cc:1275] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:00:29.249089  5943 consensus_queue.cc:1059] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:00:29.289002  5943 raft_consensus.cc:3055] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:29.289397  5943 raft_consensus.cc:740] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:29.290341  5943 consensus_queue.cc:260] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:29.291344  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:29.291664  5943 raft_consensus.cc:3060] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:29.292065  1716 raft_consensus.cc:2468] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 10.
I20260709 13:00:29.249869  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:29.251932  1617 leader_election.cc:304] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
W20260709 13:00:29.293463  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 120915us
I20260709 13:00:29.294036  5949 raft_consensus.cc:3060] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:29.295573  5939 raft_consensus.cc:2804] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:29.296012  5939 raft_consensus.cc:493] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.296370  5939 raft_consensus.cc:3060] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:29.297187  5932 raft_consensus.cc:3060] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:00:29.304481  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 46588.1us
I20260709 13:00:29.203706  5649 leader_election.cc:290] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:29.256345  1646 raft_consensus.cc:1275] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 12. (term mismatch)
I20260709 13:00:29.310932  1646 pending_rounds.cc:85] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e: Aborting all ops after (but not including) 11
I20260709 13:00:29.258471  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:29.262101  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:29.262351  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:29.207022  5873 raft_consensus.cc:515] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:29.305152  1540 leader_election.cc:304] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:29.317962  5784 raft_consensus.cc:2804] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:29.252859  5712 leader_election.cc:290] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:29.333953  1540 leader_election.cc:304] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:29.311184  1646 pending_rounds.cc:107] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260709 13:00:29.319029  2331 raft_consensus.cc:2468] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 8.
I20260709 13:00:29.338328  1646 raft_consensus.cc:2889] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:29.339926  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.318616  2297 leader_election.cc:304] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:29.343076  1716 raft_consensus.cc:3055] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:29.344761  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:29.345671  2325 raft_consensus.cc:2468] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 10.
I20260709 13:00:29.325150  1688 leader_election.cc:304] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:29.343467  1716 raft_consensus.cc:740] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:29.347769  1688 leader_election.cc:304] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:29.354773  1688 leader_election.cc:304] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:00:29.376573  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:29.377082  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 136078us
I20260709 13:00:29.382974  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:29.383296  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:29.383992  1648 raft_consensus.cc:2393] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 8: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:29.385623  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:29.330657  5873 leader_election.cc:290] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:29.351734  5847 raft_consensus.cc:2749] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:29.319505  5784 raft_consensus.cc:493] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:29.372184  5892 raft_consensus.cc:2804] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:29.392396  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:29.397207  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
W20260709 13:00:29.388080  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 54757.2us
I20260709 13:00:29.373024  5712 raft_consensus.cc:2749] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:29.320751  5934 consensus_queue.cc:1059] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
W20260709 13:00:29.401017  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 46383.7us
I20260709 13:00:29.404024  2325 raft_consensus.cc:2393] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 12: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 13:00:29.398777  1716 consensus_queue.cc:260] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:29.351653  5644 raft_consensus.cc:515] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:29.397677  1650 raft_consensus.cc:2468] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 9.
I20260709 13:00:29.401880  1688 leader_election.cc:304] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:29.406627  1716 raft_consensus.cc:3060] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:29.406745  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:29.409920  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:29.397578  5784 raft_consensus.cc:3060] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:29.405069  1615 leader_election.cc:304] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:29.391728  5969 raft_consensus.cc:2804] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:00:29.415299  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 99605.7us
I20260709 13:00:29.397476  5892 raft_consensus.cc:493] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:29.419974  1724 raft_consensus.cc:2468] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 10.
I20260709 13:00:29.423447  1540 leader_election.cc:304] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
W20260709 13:00:29.429906  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 48160.9us
I20260709 13:00:29.418565  5969 raft_consensus.cc:493] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:29.423139  5892 raft_consensus.cc:3060] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:29.440718  5969 raft_consensus.cc:3060] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:29.431507  5712 raft_consensus.cc:2749] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:29.453087  5973 raft_consensus.cc:3055] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:29.453606  5973 raft_consensus.cc:740] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:29.432395  5873 raft_consensus.cc:2749] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:00:29.459061  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.464648  1617 leader_election.cc:304] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:29.468824  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:29.487524  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:29.537483  1724 raft_consensus.cc:2468] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 10.
I20260709 13:00:29.487823  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:29.487250  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:00:29.490911  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 71834.8us
I20260709 13:00:29.478029  1716 raft_consensus.cc:1275] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:00:29.517123  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 52622.5us
I20260709 13:00:29.497186  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:00:29.507874  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 51425.8us
W20260709 13:00:29.546126  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.469770  5644 leader_election.cc:290] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:29.551908  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:29.552310  1718 raft_consensus.cc:2468] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6.
I20260709 13:00:29.513175  5645 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:29.553943  1724 raft_consensus.cc:2468] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6.
I20260709 13:00:29.490190  1689 leader_election.cc:304] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:00:29.497589  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 102689us
I20260709 13:00:29.559285  1617 leader_election.cc:304] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:29.557791  1540 leader_election.cc:304] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:29.534255  1576 raft_consensus.cc:2468] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 10.
I20260709 13:00:29.497372  5946 raft_consensus.cc:515] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:29.517906  5816 raft_consensus.cc:2804] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:29.511445  5934 raft_consensus.cc:2804] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:00:29.579707  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 177924us
I20260709 13:00:29.581947  1688 leader_election.cc:304] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:29.468736  1474 catalog_manager.cc:5697] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:00:29.579236  5712 raft_consensus.cc:2749] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:29.580358  5645 raft_consensus.cc:2804] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:29.468487  5939 raft_consensus.cc:515] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:29.580263  5934 raft_consensus.cc:493] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.557241  5935 consensus_queue.cc:1048] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:00:29.619796  1615 leader_election.cc:304] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:29.472625  5949 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:29.605510  5816 raft_consensus.cc:697] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 8 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:29.556298  5969 raft_consensus.cc:515] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:29.626991  5816 consensus_queue.cc:237] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:29.622301  5934 raft_consensus.cc:3060] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:29.628723  1617 leader_election.cc:304] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:29.630586  5874 consensus_queue.cc:1059] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:29.631843  1615 leader_election.cc:400] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Vote denied by peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373) with higher term. Message: Invalid argument: T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 9. Current term is 10.
I20260709 13:00:29.660391  1615 leader_election.cc:403] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:29.632366  5644 raft_consensus.cc:2749] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:29.633277  1474 catalog_manager.cc:5697] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 6 to 7, leader changed from 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 7 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:00:29.635731  5784 raft_consensus.cc:515] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:29.636133  5943 consensus_queue.cc:1048] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:29.615566  5973 consensus_queue.cc:260] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:29.640887  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.642645  5946 leader_election.cc:290] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:00:29.652657  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 98201.1us
I20260709 13:00:29.654291  5980 raft_consensus.cc:2749] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:29.654717  5645 raft_consensus.cc:697] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 11 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
W20260709 13:00:29.665051  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 83210.4us
I20260709 13:00:29.669762  1540 leader_election.cc:304] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:29.669761  1688 leader_election.cc:304] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
W20260709 13:00:29.672923  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 67853.9us
I20260709 13:00:29.696271  1540 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:29.692505  1688 leader_election.cc:304] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:29.699615  5980 raft_consensus.cc:2804] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:29.700129  5980 raft_consensus.cc:493] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:29.700222  5977 log.cc:927] Time spent T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:00:29.700598  5980 raft_consensus.cc:3060] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:29.703719  5976 raft_consensus.cc:2804] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:00:29.711261  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.704263  5976 raft_consensus.cc:493] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
W20260709 13:00:29.715451  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 44315.1us
I20260709 13:00:29.677228  5927 raft_consensus.cc:2804] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:29.676106  5938 raft_consensus.cc:3055] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:29.737376  5938 raft_consensus.cc:740] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:29.738348  5938 consensus_queue.cc:260] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:29.739822  5938 raft_consensus.cc:3060] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:29.741322  5645 consensus_queue.cc:237] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:29.743499  5949 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:29.725189  1474 catalog_manager.cc:5697] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 5 to 8, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 8 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } }
I20260709 13:00:29.744814  5973 raft_consensus.cc:3060] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:29.662376  5892 raft_consensus.cc:515] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:29.745231  1474 catalog_manager.cc:5697] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 10 to 12, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 12 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:29.746826  5784 leader_election.cc:290] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:29.747360  5892 leader_election.cc:290] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:29.727396  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:29.749176  1721 raft_consensus.cc:3060] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:29.722925  5976 raft_consensus.cc:3060] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:29.753445  5983 raft_consensus.cc:2804] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:29.753916  5983 raft_consensus.cc:493] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:29.754283  5983 raft_consensus.cc:3060] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:29.756799  5988 consensus_queue.cc:1048] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:29.758008  5939 leader_election.cc:290] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:29.724926  5927 raft_consensus.cc:493] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:29.762507  5927 raft_consensus.cc:3060] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:29.727962  5947 raft_consensus.cc:2804] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:29.765466  5947 raft_consensus.cc:697] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 10 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:29.766711  5947 consensus_queue.cc:237] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:29.747653  1474 catalog_manager.cc:5697] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 5 to 9, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 9 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 13:00:29.721932  5712 raft_consensus.cc:2804] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:29.768731  5712 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:29.769313  5712 raft_consensus.cc:3060] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:29.772369  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:29.772995  1575 raft_consensus.cc:3060] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:29.778380  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:29.778972  2331 raft_consensus.cc:3060] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:29.745227  5969 leader_election.cc:290] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:00:29.782148  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.768870  1474 catalog_manager.cc:5697] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 6 to 7, leader changed from 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 7 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:29.729562  2294 leader_election.cc:304] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
W20260709 13:00:29.729744  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 98158.8us
I20260709 13:00:29.730270  5644 raft_consensus.cc:3060] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:00:29.733434  5980 raft_consensus.cc:515] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:29.736806   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:00:29.783931  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 54467.6us
I20260709 13:00:29.788136  1721 raft_consensus.cc:2468] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 10.
I20260709 13:00:29.797417  2294 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:00:29.801162  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 311033us
I20260709 13:00:29.806592  2297 leader_election.cc:304] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 13:00:29.803692  1689 leader_election.cc:304] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:29.816460  5949 raft_consensus.cc:2804] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:29.819804  5983 raft_consensus.cc:515] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:29.824149  2331 raft_consensus.cc:2468] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 11.
I20260709 13:00:29.815575  2294 leader_election.cc:304] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:29.860397  1721 raft_consensus.cc:1240] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:29.861065  1540 leader_election.cc:304] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:29.860421  5980 leader_election.cc:290] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:29.861663  5949 raft_consensus.cc:697] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:29.862078  5926 raft_consensus.cc:2804] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:29.862702  5926 raft_consensus.cc:697] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:29.798784  5850 raft_consensus.cc:2749] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:29.863926  5926 consensus_queue.cc:237] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:29.862668  5949 consensus_queue.cc:237] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:29.866945  5978 log.cc:927] Time spent T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 13:00:29.814152  1615 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:29.805395  5912 raft_consensus.cc:2804] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:00:29.875624  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 60118.2us
W20260709 13:00:29.881042  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 66963.8us
W20260709 13:00:29.883980  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 80360.2us
I20260709 13:00:29.885556  2294 leader_election.cc:304] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:29.815884  5942 raft_consensus.cc:2804] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:29.885196  5850 raft_consensus.cc:2749] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:29.888101  1474 catalog_manager.cc:5697] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:00:29.885716  5938 raft_consensus.cc:2749] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:29.900113  5939 consensus_queue.cc:1048] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 13:00:29.904240  1689 leader_election.cc:304] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:29.907179  1615 leader_election.cc:304] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 13:00:29.908102  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 209131us
I20260709 13:00:29.898478  5980 raft_consensus.cc:2804] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:29.893245  5942 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:29.917027  1615 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:29.903997  5948 raft_consensus.cc:2804] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:29.923990  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:29.926841  1650 raft_consensus.cc:2468] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 7.
W20260709 13:00:29.928001  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:29.929791  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 53403.8us
I20260709 13:00:29.931082  1689 leader_election.cc:304] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:29.932914  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:29.913792  5980 raft_consensus.cc:493] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:29.908782  5985 raft_consensus.cc:2749] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:29.943804  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:29.934563  2294 leader_election.cc:304] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:29.937419  1689 leader_election.cc:304] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:29.942673  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:29.945125  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:29.943284  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:29.918426  5942 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:29.925863  5938 raft_consensus.cc:2804] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:29.950075  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:29.946414  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:29.947016  1649 raft_consensus.cc:2468] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 11.
I20260709 13:00:29.948093  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:29.926115  5948 raft_consensus.cc:493] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:29.953186  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:29.952191  1643 raft_consensus.cc:2376] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 11. Re-sending same reply.
I20260709 13:00:29.954048  1650 raft_consensus.cc:2468] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 11.
I20260709 13:00:29.955880  5948 raft_consensus.cc:3060] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:29.959206  5989 log.cc:927] Time spent T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:00:29.960067  2294 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:29.960760  1646 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 10.
I20260709 13:00:29.961588  2294 leader_election.cc:304] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:29.962229  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:29.962932  2294 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:29.920773  5959 consensus_queue.cc:1059] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 13:00:29.968832  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:29.969558  1644 raft_consensus.cc:2468] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 10.
I20260709 13:00:29.970511  1575 raft_consensus.cc:2468] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 11.
I20260709 13:00:29.934307  5987 consensus_queue.cc:1048] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 13:00:29.979723  5983 leader_election.cc:290] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:29.980336  5850 raft_consensus.cc:2804] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:29.980824  5850 raft_consensus.cc:493] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:29.981213  5850 raft_consensus.cc:3060] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:29.983006  2295 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:29.940768  5943 raft_consensus.cc:3060] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:29.972160  5912 raft_consensus.cc:493] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:29.943951  5980 raft_consensus.cc:3060] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:29.941908  5969 raft_consensus.cc:2804] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:00:29.996026  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:29.950480  5938 raft_consensus.cc:493] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:30.003934  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:30.005822  1721 raft_consensus.cc:1240] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:30.007241  1648 raft_consensus.cc:2468] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 14.
I20260709 13:00:30.009630  1649 raft_consensus.cc:2376] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 10. Re-sending same reply.
I20260709 13:00:29.996503  5912 raft_consensus.cc:3060] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:30.017287  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:30.018108  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:30.018695  1649 raft_consensus.cc:2376] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 11. Re-sending same reply.
W20260709 13:00:30.019097  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 102152us
I20260709 13:00:30.021656  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:30.022727  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:29.993057  5946 raft_consensus.cc:2804] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:30.023663  1648 raft_consensus.cc:2468] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 8.
I20260709 13:00:30.017926  1650 raft_consensus.cc:2468] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 9.
I20260709 13:00:30.026580  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:30.027621  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:30.028438  1644 raft_consensus.cc:2468] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 7.
I20260709 13:00:30.033318  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:30.033936  1649 raft_consensus.cc:2468] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 10.
I20260709 13:00:30.073243  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:30.073400  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:30.077766  1648 raft_consensus.cc:3060] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:30.073678  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:30.076287  5644 raft_consensus.cc:2749] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373) with higher term. Message: Invalid argument: T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 9. Current term is 10.
I20260709 13:00:30.081003  1646 raft_consensus.cc:3060] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:30.081267  1651 raft_consensus.cc:2468] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 10.
W20260709 13:00:30.072983  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 110122us
I20260709 13:00:30.085804  2294 leader_election.cc:304] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:30.094369  1646 raft_consensus.cc:2468] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 10.
I20260709 13:00:30.094723  5942 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:30.095697  1648 raft_consensus.cc:2468] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 11.
I20260709 13:00:30.033740  1474 catalog_manager.cc:5697] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 5 to 9, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 9 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } }
W20260709 13:00:30.047739  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:30.098009  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 160638us
I20260709 13:00:30.013125  5938 raft_consensus.cc:3060] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:30.013674  5952 raft_consensus.cc:2804] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:29.995227  5976 raft_consensus.cc:515] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:30.117479  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:30.118040  1647 raft_consensus.cc:3060] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:30.032819  5969 raft_consensus.cc:697] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 6 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:30.029582  5909 raft_consensus.cc:2804] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:30.099896  1689 leader_election.cc:304] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:30.009346  5970 raft_consensus.cc:2804] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:30.119079  1474 catalog_manager.cc:5697] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 7 to 10, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 10 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } }
I20260709 13:00:30.128270  1719 raft_consensus.cc:1240] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 6. Current term is 7. Ops: []
W20260709 13:00:30.129236  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 86708.3us
I20260709 13:00:30.026603  5946 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:30.108770  1688 leader_election.cc:304] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:30.130934  5985 raft_consensus.cc:2764] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:00:30.133140  1688 leader_election.cc:304] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:30.134541  5985 raft_consensus.cc:2749] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:30.115448  5973 raft_consensus.cc:2749] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:30.113183  5927 raft_consensus.cc:515] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:30.138068  1647 raft_consensus.cc:2468] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 5.
I20260709 13:00:30.148087  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:30.091015  5712 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:30.147370  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:30.147536  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 108678us
I20260709 13:00:30.148277  1689 leader_election.cc:304] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:00:30.122521  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 101300us
I20260709 13:00:30.136647  5986 raft_consensus.cc:3060] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:30.127898  5970 raft_consensus.cc:493] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:30.136212  5850 raft_consensus.cc:515] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:30.160269  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 74541.3us
I20260709 13:00:30.125845  5934 raft_consensus.cc:515] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:30.138693  5909 raft_consensus.cc:697] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:30.190604  5912 raft_consensus.cc:515] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:30.166172  5850 leader_election.cc:290] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:30.169596  5976 leader_election.cc:290] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:30.171195  5942 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:30.171412  5712 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:30.171631  5969 consensus_queue.cc:237] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:30.172583  2331 raft_consensus.cc:1240] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:30.179608  5943 raft_consensus.cc:2749] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:00:30.180585  5995 log.cc:927] Time spent T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:00:30.153256  5935 raft_consensus.cc:2749] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:00:30.181149  5992 log.cc:927] Time spent T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 13:00:30.182843  5934 leader_election.cc:290] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:30.185873  5949 consensus_queue.cc:1059] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:30.164006  5973 raft_consensus.cc:2749] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:30.164304  5970 raft_consensus.cc:3060] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:30.188367  1688 leader_election.cc:304] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:00:30.188874  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 61376.4us
I20260709 13:00:30.218767  1689 leader_election.cc:304] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:30.218235  1474 catalog_manager.cc:5697] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 6 to 7, leader changed from 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 7 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:30.193655  5803 raft_consensus.cc:3055] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:30.137342  5946 raft_consensus.cc:3060] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:30.206656  1649 raft_consensus.cc:1240] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:30.206423  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:30.210470  1647 raft_consensus.cc:1275] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:00:30.191470  5909 consensus_queue.cc:237] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:30.200169  5952 raft_consensus.cc:697] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
W20260709 13:00:30.234489  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 46210.6us
I20260709 13:00:30.235541  1688 leader_election.cc:304] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:30.220690  5803 raft_consensus.cc:740] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:30.235993  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:30.237250  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:30.236884  5803 consensus_queue.cc:260] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:30.238234  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.238615  5803 raft_consensus.cc:3060] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:30.239766  5912 leader_election.cc:290] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:30.239987  2331 raft_consensus.cc:1240] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:30.241019  1689 leader_election.cc:304] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:30.240859  5712 consensus_queue.cc:1059] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:30.242470  1689 leader_election.cc:304] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:30.243847  1689 leader_election.cc:304] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:30.244596  5892 raft_consensus.cc:2764] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:00:30.244709  5985 raft_consensus.cc:2804] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:30.244964  5934 raft_consensus.cc:2749] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:00:30.234745  5993 log.cc:927] Time spent T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
I20260709 13:00:30.245287  5892 raft_consensus.cc:2749] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:30.245801  5983 raft_consensus.cc:2749] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:30.250381  5952 consensus_queue.cc:237] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:30.252707  5938 raft_consensus.cc:515] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:30.253928  1642 raft_consensus.cc:2393] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 7: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:30.254832  5938 leader_election.cc:290] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:30.257398  5980 raft_consensus.cc:515] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:30.258916  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:30.271590  2325 raft_consensus.cc:3060] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:30.236896  1649 raft_consensus.cc:2410] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:00:30.282918  1689 leader_election.cc:304] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:30.245255  5985 raft_consensus.cc:493] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:30.288467  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
W20260709 13:00:30.288744  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 53284us
I20260709 13:00:30.210598  5948 raft_consensus.cc:515] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:30.291625  2328 raft_consensus.cc:1240] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:30.292680  5948 leader_election.cc:290] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:30.292570  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:30.293569  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:30.295466  5980 leader_election.cc:290] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:00:30.293556  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.296994  1649 raft_consensus.cc:2368] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 11. Current term is 12.
W20260709 13:00:30.297159  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 134512us
I20260709 13:00:30.289690  1688 leader_election.cc:304] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:30.305519  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:30.304319  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:30.307181  2331 raft_consensus.cc:2393] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 6: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 13:00:30.307840  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:30.309474  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:30.312250  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:30.312445  1643 raft_consensus.cc:1240] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:30.296552  5912 raft_consensus.cc:2764] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:00:30.297369  5985 raft_consensus.cc:3060] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:30.300135  5934 raft_consensus.cc:2749] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:30.320565  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:30.302922  5938 raft_consensus.cc:493] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:30.321249  6003 consensus_queue.cc:1059] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:00:30.321873  5938 raft_consensus.cc:515] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:30.302717  5973 raft_consensus.cc:2804] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:30.324997  1689 leader_election.cc:304] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:30.328509  5986 raft_consensus.cc:2749] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:30.329427  5986 raft_consensus.cc:2804] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:30.329798  5986 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:30.330155  5986 raft_consensus.cc:3060] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:30.311822  5947 raft_consensus.cc:493] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:30.333446  5947 raft_consensus.cc:515] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:30.335966  5947 leader_election.cc:290] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:30.340327  5973 raft_consensus.cc:493] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:30.340840  5973 raft_consensus.cc:3060] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:30.356088  1650 raft_consensus.cc:2468] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 10.
I20260709 13:00:30.357844  1647 raft_consensus.cc:2468] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 10.
I20260709 13:00:30.326005  1689 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:30.360357  1642 raft_consensus.cc:2468] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 11.
W20260709 13:00:30.362347  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 59881.1us
I20260709 13:00:30.362493  5928 consensus_queue.cc:1059] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:30.363103  1688 leader_election.cc:304] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:30.324313  5938 leader_election.cc:290] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:30.363754  5928 raft_consensus.cc:3055] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:30.364213  5928 raft_consensus.cc:740] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:30.306308  5926 consensus_queue.cc:1059] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 13:00:30.365175  5926 raft_consensus.cc:3055] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:30.365553  5926 raft_consensus.cc:740] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:30.365267  5928 consensus_queue.cc:260] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:30.366454  5926 consensus_queue.cc:260] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:30.367633  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:30.370113  5784 raft_consensus.cc:3055] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:30.370635  5784 raft_consensus.cc:740] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:30.371563  5784 consensus_queue.cc:260] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:30.377172  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:30.366843  5928 raft_consensus.cc:3060] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:30.382153  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:30.385835  1645 raft_consensus.cc:1240] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:00:30.389182  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:30.390039  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:30.361815  2325 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8.
I20260709 13:00:30.392273  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:30.400276  1572 raft_consensus.cc:2468] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 10.
I20260709 13:00:30.392480  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:30.392705  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:30.393268  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:30.394141  2323 raft_consensus.cc:1240] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:30.413214  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 13:00:30.414115  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 51077.9us
I20260709 13:00:30.413470  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:30.419184  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:30.419853  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:30.420567  1572 raft_consensus.cc:3060] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:30.421456  1725 raft_consensus.cc:1240] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:30.420379  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:30.339679  5970 raft_consensus.cc:515] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:30.367688  5926 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:30.424644  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:30.428750  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:30.413646  5980 raft_consensus.cc:2804] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:30.436771  1645 raft_consensus.cc:1240] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:30.436798  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:30.434062  2328 raft_consensus.cc:1275] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:00:30.414294  5912 raft_consensus.cc:2804] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:00:30.437392  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.431169  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:30.438439  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:30.439349  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:30.440059  1716 raft_consensus.cc:2468] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 12.
I20260709 13:00:30.441632  1722 raft_consensus.cc:1240] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:30.442595  1569 raft_consensus.cc:1240] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 LEADER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
W20260709 13:00:30.445163  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.445924  1725 raft_consensus.cc:3060] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:30.447096  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:30.447096  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:30.423527  5927 leader_election.cc:290] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:30.449193  2331 raft_consensus.cc:1240] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:30.425235  5784 raft_consensus.cc:3060] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:30.453792  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:30.454393  2325 raft_consensus.cc:3060] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:30.457432  1688 leader_election.cc:304] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:30.461328  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:30.470208  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:30.473568  1719 raft_consensus.cc:1240] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 14 LEADER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:30.474998  1724 raft_consensus.cc:1275] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:00:30.478899  1722 raft_consensus.cc:1240] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:30.479287  2329 raft_consensus.cc:1275] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:00:30.479950  1647 raft_consensus.cc:1240] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:00:30.442303  5980 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:30.481805  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:30.484476  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:30.491350  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:30.491623  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:30.492600  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:30.494166  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:30.487308  1572 raft_consensus.cc:2468] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 8.
I20260709 13:00:30.494814  1568 raft_consensus.cc:3060] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:30.497612  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:30.499055  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:30.500916  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:30.500322  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:30.469584  5912 raft_consensus.cc:697] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 10 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:30.504317  6002 raft_consensus.cc:3055] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:30.504135  5912 consensus_queue.cc:237] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:30.504807  6002 raft_consensus.cc:740] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:30.505772  6002 consensus_queue.cc:260] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:30.511191  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:30.491528  1688 leader_election.cc:304] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:30.511727  1650 raft_consensus.cc:3060] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:30.510924  1539 leader_election.cc:336] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Timed out: RequestConsensusVote RPC to 127.0.107.194:37391 timed out after 1.533s (SENT)
I20260709 13:00:30.513491  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:30.513618  1719 raft_consensus.cc:1240] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:30.514156  1647 raft_consensus.cc:3060] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Advancing to term 10
W20260709 13:00:30.512363  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 88515.5us
I20260709 13:00:30.479059  5969 raft_consensus.cc:2804] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:00:30.514634  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.540597  1725 raft_consensus.cc:2468] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 12.
I20260709 13:00:30.541965  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:30.557648  1648 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:30.543380  1688 leader_election.cc:304] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:30.492664  5934 consensus_queue.cc:1048] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:00:30.513646  1539 leader_election.cc:304] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:30.485788  5980 raft_consensus.cc:3060] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:30.566036  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:30.568864  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:30.573882  1643 raft_consensus.cc:1240] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:30.563333  5892 raft_consensus.cc:2804] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:30.507023  5973 raft_consensus.cc:515] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:30.576411  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:30.578816  1617 leader_election.cc:304] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:30.579144  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 13:00:30.580063  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.590909  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:30.549000  5959 raft_consensus.cc:3055] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:30.550745  5976 raft_consensus.cc:2804] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:30.569425  5969 raft_consensus.cc:493] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
W20260709 13:00:30.597810  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 125043us
I20260709 13:00:30.485771  5927 consensus_queue.cc:1048] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.103s
I20260709 13:00:30.492828  5983 consensus_queue.cc:1048] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.096s
I20260709 13:00:30.591109  5938 consensus_queue.cc:1059] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 13:00:30.578125  5892 raft_consensus.cc:493] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:30.610496  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:30.639279  1723 raft_consensus.cc:2368] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 8. Current term is 10.
I20260709 13:00:30.639211  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:30.597245  5959 raft_consensus.cc:740] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
W20260709 13:00:30.666761  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 214718us
I20260709 13:00:30.616024  5969 raft_consensus.cc:3060] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:30.600656  5976 raft_consensus.cc:493] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:30.597622  5947 raft_consensus.cc:2804] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:30.675083  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 13:00:30.667514  6007 log.cc:927] Time spent T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260709 13:00:30.700628  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:30.701186  2325 raft_consensus.cc:2468] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 7.
I20260709 13:00:30.701239  1643 raft_consensus.cc:3060] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:30.698292  1648 raft_consensus.cc:2468] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 13.
I20260709 13:00:30.703365  2294 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:30.693854  5947 raft_consensus.cc:493] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:30.710628  1650 raft_consensus.cc:2468] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 11.
I20260709 13:00:30.721285  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:30.723327  1648 raft_consensus.cc:3060] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:30.732897  1648 raft_consensus.cc:2468] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 8.
I20260709 13:00:30.654759  5892 raft_consensus.cc:3060] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:30.745182  6014 raft_consensus.cc:2749] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:30.746975  5973 leader_election.cc:290] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:30.614441  5909 consensus_queue.cc:1059] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.089s
I20260709 13:00:30.628909  5644 consensus_queue.cc:1059] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 13:00:30.676266  2328 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67"
dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
mode: GRACEFUL
new_leader_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:39778
I20260709 13:00:30.757861  2328 raft_consensus.cc:606] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Received request to transfer leadership to TS 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:30.726846  5947 raft_consensus.cc:3060] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:30.741417  5970 leader_election.cc:290] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:00:30.767134  6012 log.cc:927] Time spent T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:00:30.769537  1717 raft_consensus.cc:2468] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 11.
I20260709 13:00:30.742214  2294 leader_election.cc:304] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
W20260709 13:00:30.742950  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 57026us
I20260709 13:00:30.743646  6016 raft_consensus.cc:2804] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:30.697007  5712 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:30.773751  5712 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:30.776051  5712 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:30.681469  5976 raft_consensus.cc:3060] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:30.626783  5943 consensus_queue.cc:1048] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.089s
I20260709 13:00:30.783130  5712 consensus_queue.cc:1059] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:30.751703  1647 raft_consensus.cc:2468] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 10.
I20260709 13:00:30.752902  1568 raft_consensus.cc:2468] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 12.
I20260709 13:00:30.760907  5931 consensus_queue.cc:1048] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:30.763259  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:00:30.789201  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 208883us
I20260709 13:00:30.806499  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:00:30.807979  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 245387us
I20260709 13:00:30.808713  1688 leader_election.cc:304] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
W20260709 13:00:30.809237  2295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.809749  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:30.810967  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:30.811616  1650 raft_consensus.cc:2468] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 13.
I20260709 13:00:30.812608  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:30.813460  1650 raft_consensus.cc:1275] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:30.815546  1650 raft_consensus.cc:1240] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:30.817116  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:00:30.810475  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 168953us
I20260709 13:00:30.809710  1688 leader_election.cc:304] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:30.820263  1688 leader_election.cc:304] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:30.818194  1651 raft_consensus.cc:2468] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 9.
W20260709 13:00:30.828486  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 86352.2us
I20260709 13:00:30.833843  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:30.836102  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:30.817389  5934 raft_consensus.cc:2804] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:30.853283  1651 raft_consensus.cc:1275] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 13:00:30.847863  1649 consensus_meta.cc:287] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.539s	user 0.012s	sys 0.023s
W20260709 13:00:30.848645  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 299002us
I20260709 13:00:30.853747  1688 leader_election.cc:304] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:30.854012  1649 raft_consensus.cc:2468] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 10.
I20260709 13:00:30.855269  1650 raft_consensus.cc:1240] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:30.831734  5983 raft_consensus.cc:2804] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:00:30.846408  5803 consensus_meta.cc:287] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.607s	user 0.007s	sys 0.004s
I20260709 13:00:30.855027  1617 leader_election.cc:304] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:30.831182  6016 raft_consensus.cc:697] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:30.886154  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:30.889786  1651 raft_consensus.cc:1240] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:30.844866  5937 raft_consensus.cc:2804] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:30.890242  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:30.853677  6021 raft_consensus.cc:3055] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:30.883380  5973 raft_consensus.cc:2764] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:00:30.881160  5934 raft_consensus.cc:697] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 10 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:30.957614  1647 raft_consensus.cc:2468] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 10.
I20260709 13:00:30.839555  5927 consensus_queue.cc:1059] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.096s
I20260709 13:00:30.959476  1689 leader_election.cc:304] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:00:30.968686  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 457742us
W20260709 13:00:30.962677  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 145766us
W20260709 13:00:30.971951  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:30.979449  1542 leader_election.cc:304] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:30.931332  5938 raft_consensus.cc:3055] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:30.983202  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:00:30.981087  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:30.992844  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 139199us
I20260709 13:00:30.997807  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:30.948179  6021 raft_consensus.cc:740] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:30.950008  5937 raft_consensus.cc:697] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:30.998644  1650 raft_consensus.cc:2376] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 10. Re-sending same reply.
I20260709 13:00:30.999797  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:00:30.982919  6013 log.cc:927] Time spent T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.377s	user 0.001s	sys 0.000s
I20260709 13:00:31.040742  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:31.041584  1650 raft_consensus.cc:2468] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 9.
W20260709 13:00:31.040809  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 45210.5us
I20260709 13:00:30.938123  5644 consensus_queue.cc:1059] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
W20260709 13:00:31.041613  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 82976.9us
I20260709 13:00:30.889698  6024 consensus_queue.cc:1048] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.108s
I20260709 13:00:31.046409  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
W20260709 13:00:31.045816  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 190772us
I20260709 13:00:31.048121  1651 raft_consensus.cc:2368] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 10. Current term is 11.
I20260709 13:00:30.983251  5938 raft_consensus.cc:740] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:30.974169  5931 consensus_queue.cc:1048] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 13:00:31.068233  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:31.071403  1647 raft_consensus.cc:2393] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 7: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
W20260709 13:00:31.054608  5784 consensus_meta.cc:287] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.585s	user 0.014s	sys 0.013s
I20260709 13:00:31.083413  6029 raft_consensus.cc:493] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
W20260709 13:00:31.094946  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.096334  1617 leader_election.cc:400] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Vote denied by peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473) with higher term. Message: Invalid argument: T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 8. Current term is 10.
I20260709 13:00:31.096773  1617 leader_election.cc:403] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:31.098129  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:00:31.093441  1539 leader_election.cc:336] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Timed out: RequestConsensusVote RPC to 127.0.107.194:37391 timed out after 1.539s (SENT)
I20260709 13:00:31.106504  1539 leader_election.cc:304] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:31.133229  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:31.047464  6026 raft_consensus.cc:2804] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:31.134166  1651 raft_consensus.cc:2410] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
W20260709 13:00:31.136127  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 156773us
I20260709 13:00:31.137305  1542 leader_election.cc:304] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
W20260709 13:00:31.141047  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 65384.9us
W20260709 13:00:31.139096  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 83139.3us
I20260709 13:00:31.151458  1689 leader_election.cc:304] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:31.078761  5952 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.152120  1617 leader_election.cc:304] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:00:31.134451  6020 log.cc:927] Time spent T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.251s	user 0.001s	sys 0.000s
I20260709 13:00:31.155350  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:00:31.152051  6011 log.cc:927] Time spent T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.367s	user 0.000s	sys 0.001s
I20260709 13:00:31.174738  1542 leader_election.cc:304] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:31.132995  5983 raft_consensus.cc:697] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 11 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:31.177109  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:31.177976  1647 raft_consensus.cc:2376] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 10. Re-sending same reply.
I20260709 13:00:31.145170  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:31.179694  1651 raft_consensus.cc:2468] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 13.
I20260709 13:00:31.182924  1572 raft_consensus.cc:1275] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:00:31.183318  1572 pending_rounds.cc:85] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting all ops after (but not including) 10
I20260709 13:00:31.183529  1572 pending_rounds.cc:107] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 13:00:31.183751  1572 raft_consensus.cc:2889] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:31.194381  1569 raft_consensus.cc:1275] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:00:31.201507  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
W20260709 13:00:31.198226  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 155386us
I20260709 13:00:31.202612  1646 raft_consensus.cc:2368] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 11. Current term is 12.
W20260709 13:00:31.206545  6027 log.cc:927] Time spent T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
W20260709 13:00:31.208621  6017 log.cc:927] Time spent T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.309s	user 0.001s	sys 0.000s
I20260709 13:00:31.164541  5934 consensus_queue.cc:237] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:31.213101  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:31.213500  5931 raft_consensus.cc:2749] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:31.213747  1646 raft_consensus.cc:2376] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 11. Re-sending same reply.
I20260709 13:00:31.214233  5931 raft_consensus.cc:2749] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:31.214762  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:31.215045  5931 raft_consensus.cc:2804] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:31.215366  1646 raft_consensus.cc:3060] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:31.215504  5931 raft_consensus.cc:493] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:31.208709  6023 log.cc:927] Time spent T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 13:00:31.225463  2324 raft_consensus.cc:2468] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 5.
W20260709 13:00:31.226960  1643 consensus_meta.cc:287] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.521s	user 0.009s	sys 0.000s
I20260709 13:00:31.215979  5931 raft_consensus.cc:3060] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:31.232748  1643 raft_consensus.cc:2468] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 11.
I20260709 13:00:31.234675  1648 raft_consensus.cc:1240] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 10. Current term is 11. Ops: []
W20260709 13:00:31.237171  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 62516.4us
I20260709 13:00:31.238149  1542 leader_election.cc:304] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:31.241525  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:31.133896  6029 raft_consensus.cc:515] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:31.247625  1542 leader_election.cc:304] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:31.251454  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:31.255551  1642 raft_consensus.cc:2393] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 13: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
W20260709 13:00:31.256582  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 104535us
W20260709 13:00:31.257280  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 163862us
W20260709 13:00:31.257978  1539 leader_election.cc:336] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Timed out: RequestConsensusVote RPC to 127.0.107.194:37391 timed out after 1.549s (SENT)
I20260709 13:00:31.258004  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:31.258612  1539 leader_election.cc:304] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:31.153676  5938 consensus_queue.cc:260] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:31.242909  5985 consensus_meta.cc:287] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.877s	user 0.006s	sys 0.005s
I20260709 13:00:31.260872  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:31.163946  5952 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:31.267370  1542 leader_election.cc:304] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:31.267388  1540 leader_election.cc:304] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:31.271507  1646 raft_consensus.cc:2468] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 7.
I20260709 13:00:31.100171  6016 consensus_queue.cc:237] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:31.310415  1542 leader_election.cc:304] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:31.310599  1615 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:31.310679  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:31.141602  6021 consensus_queue.cc:260] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:31.312227  1542 leader_election.cc:304] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:31.313884  6038 raft_consensus.cc:493] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.314497  6038 raft_consensus.cc:515] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:31.315279  5926 consensus_meta.cc:287] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.885s	user 0.019s	sys 0.010s
I20260709 13:00:31.315909  5926 raft_consensus.cc:2749] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:31.320779  6021 raft_consensus.cc:3060] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:31.323660  2294 leader_election.cc:304] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:31.321557  1650 raft_consensus.cc:1240] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 10 LEADER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 9. Current term is 10. Ops: []
W20260709 13:00:31.325456  5928 consensus_meta.cc:287] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.912s	user 0.022s	sys 0.002s
I20260709 13:00:31.162346  5937 consensus_queue.cc:237] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:31.326143  5959 consensus_queue.cc:260] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:31.327913  5803 consensus_queue.cc:1048] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:31.328992  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:31.329377  6003 raft_consensus.cc:2749] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:31.329698  5644 raft_consensus.cc:3055] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:31.330195  5644 raft_consensus.cc:740] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:31.330443  5983 consensus_queue.cc:237] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:31.331128  5644 consensus_queue.cc:260] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:31.309554  5932 raft_consensus.cc:2749] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:31.332518  5644 raft_consensus.cc:3060] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:31.337170  6028 raft_consensus.cc:2804] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:31.339270  2294 leader_election.cc:304] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:31.336457  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:31.341625  1575 raft_consensus.cc:2468] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 8.
I20260709 13:00:31.335978  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:31.342643  1643 raft_consensus.cc:2468] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 14.
I20260709 13:00:31.359155  1542 leader_election.cc:304] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
W20260709 13:00:31.361408  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 210059us
I20260709 13:00:31.362424  1689 leader_election.cc:304] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:00:31.376665  1542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:31.360396  5986 consensus_meta.cc:287] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 1.030s	user 0.010s	sys 0.004s
I20260709 13:00:31.320058  6051 raft_consensus.cc:2749] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473) with higher term. Message: Invalid argument: T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 8. Current term is 10.
I20260709 13:00:31.337232  6002 raft_consensus.cc:3060] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:31.357861  5938 raft_consensus.cc:3060] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:31.429369  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:31.432827  1643 raft_consensus.cc:1275] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:00:31.320425  6044 raft_consensus.cc:2749] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:31.435025  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 1834) took 1117 ms. Trace:
I20260709 13:00:31.360240  6024 raft_consensus.cc:2749] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:00:31.363739  5892 consensus_meta.cc:287] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.618s	user 0.002s	sys 0.008s
W20260709 13:00:31.388512  5947 consensus_meta.cc:287] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.628s	user 0.009s	sys 0.001s
I20260709 13:00:31.379798  5926 raft_consensus.cc:2749] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:31.396209  6003 raft_consensus.cc:2804] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:00:31.395538  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 137580us
I20260709 13:00:31.464540  6042 raft_consensus.cc:2749] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:00:31.469539  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.469359  6051 raft_consensus.cc:2804] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:31.470201  6054 raft_consensus.cc:2804] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:31.470631  5952 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:31.273300  5985 raft_consensus.cc:515] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:31.434551  5946 consensus_meta.cc:287] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 1.174s	user 0.013s	sys 0.000s
W20260709 13:00:31.443336  5976 consensus_meta.cc:287] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.666s	user 0.006s	sys 0.004s
I20260709 13:00:31.545153  2323 raft_consensus.cc:1240] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 10. Current term is 11. Ops: [7.8-10.9]
I20260709 13:00:31.546480  1643 raft_consensus.cc:1275] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:00:31.521411  6014 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:31.489709  1539 leader_election.cc:336] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Timed out: RequestConsensusVote RPC to 127.0.107.194:37391 timed out after 1.557s (SENT)
I20260709 13:00:31.443254  6025 raft_consensus.cc:2749] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:31.464058  1644 rpcz_store.cc:276] 0709 13:00:30.314079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.314253 (+   174us) service_pool.cc:224] Handling call
0709 13:00:30.337456 (+ 23203us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:30.337929 (+   473us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:30.337964 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:30.338658 (+   694us) log.cc:844] Serialized 52 byte log entry
0709 13:00:30.443142 (+104484us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:00:30.443183 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:30.443263 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:31.430948 (+987685us) raft_consensus.cc:1685] finished
0709 13:00:31.430977 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:31.431166 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8076,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":97,"thread_start_us":104096,"threads_started":1,"wal-append.queue_time_us":287291}
I20260709 13:00:31.502301  6026 raft_consensus.cc:697] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 5 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
W20260709 13:00:31.587045  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 323793us
I20260709 13:00:31.588088  1721 raft_consensus.cc:2393] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 7: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:31.534169  6051 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:31.395095  6048 consensus_queue.cc:1048] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.158s
I20260709 13:00:31.544128  6038 leader_election.cc:290] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:31.597819  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 235475us
I20260709 13:00:31.483722  5934 raft_consensus.cc:493] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:31.485049  5892 raft_consensus.cc:515] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:31.552449  5946 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:31.442329  5986 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:31.534228  5942 consensus_queue.cc:1048] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.059s
I20260709 13:00:31.522590  5947 raft_consensus.cc:515] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:31.610450  6014 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:31.614684  6045 raft_consensus.cc:2804] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:31.618666  6062 raft_consensus.cc:2749] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:31.614215  6051 raft_consensus.cc:3060] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:31.586187  6022 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:31.553534  6054 raft_consensus.cc:697] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 11 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:31.615067  1615 leader_election.cc:304] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
W20260709 13:00:31.623118  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 133460us
W20260709 13:00:31.672217  1539 leader_election.cc:336] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Timed out: RequestConsensusVote RPC to 127.0.107.194:37391 timed out after 1.630s (SENT)
I20260709 13:00:31.672802  1539 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
W20260709 13:00:31.628612  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.622151  1689 leader_election.cc:304] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:00:31.675846  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 53771.4us
I20260709 13:00:31.644295  1650 raft_consensus.cc:2368] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 11. Current term is 12.
I20260709 13:00:31.645835  1647 raft_consensus.cc:2410] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:00:31.638903  1649 raft_consensus.cc:1240] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:31.558418  5952 consensus_queue.cc:1048] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:00:31.641238  2327 raft_consensus.cc:1240] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:31.554227  5976 raft_consensus.cc:515] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:31.591671  6050 raft_consensus.cc:2804] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:00:31.739668  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 67499us
I20260709 13:00:31.658888  5985 leader_election.cc:290] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:00:31.745744  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:31.746212  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:31.746141  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 131177us
W20260709 13:00:31.746769  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.626082  6033 raft_consensus.cc:2804] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:31.643469  5892 leader_election.cc:290] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:00:31.660960  6040 log.cc:927] Time spent T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.301s	user 0.001s	sys 0.000s
I20260709 13:00:31.638686  6014 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:31.747043  1615 leader_election.cc:304] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4
W20260709 13:00:31.749752  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:31.747114  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.659868  6045 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:31.628731  6035 raft_consensus.cc:493] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:31.741919  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 208121us
I20260709 13:00:31.645499  5986 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:31.645298  5938 raft_consensus.cc:493] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.802129  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:31.802403  5938 raft_consensus.cc:515] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:31.802239  6059 raft_consensus.cc:2749] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:00:31.814487  6061 log.cc:927] Time spent T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:00:31.640975  5946 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:00:31.740895  5969 consensus_meta.cc:287] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 1.043s	user 0.013s	sys 0.000s
W20260709 13:00:31.818362  6058 log.cc:927] Time spent T 00000000000000000000000000000000 P fcfaa17e55ae48e194c5d95ca24a659f: Append to log took a long time: real 0.216s	user 0.002s	sys 0.000s
I20260709 13:00:31.818037  5969 raft_consensus.cc:515] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 13:00:31.659287  6047 raft_consensus.cc:2749] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:31.737041  5928 raft_consensus.cc:2749] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:00:31.778069  1539 leader_election.cc:336] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Timed out: RequestConsensusVote RPC to 127.0.107.194:37391 timed out after 1.757s (SENT)
W20260709 13:00:31.829952  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 51919.8us
W20260709 13:00:31.830809  1539 leader_election.cc:336] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Timed out: RequestConsensusVote RPC to 127.0.107.194:37391 timed out after 1.819s (SENT)
I20260709 13:00:31.766574  6033 raft_consensus.cc:493] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:31.792181  1689 leader_election.cc:304] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:31.738991  6041 raft_consensus.cc:493] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.798607  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:31.798596  2329 raft_consensus.cc:1240] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:31.797169  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:31.790067  6045 raft_consensus.cc:3060] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:31.803102  1569 raft_consensus.cc:2410] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:00:31.774855  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:31.820191  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:31.759637  6048 raft_consensus.cc:2749] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:31.831295  1539 leader_election.cc:304] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:31.790036  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:31.828756  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:31.769644  6038 raft_consensus.cc:493] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:31.641584  5934 raft_consensus.cc:515] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:31.854292  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 107346us
I20260709 13:00:31.865379  2323 raft_consensus.cc:2368] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 6. Current term is 7.
I20260709 13:00:31.865556  1615 leader_election.cc:304] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:00:31.820258  5927 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.774s	user 0.008s	sys 0.045s
I20260709 13:00:31.857055  2326 raft_consensus.cc:2468] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 8.
W20260709 13:00:31.860970  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 68897.6us
I20260709 13:00:31.791018  6050 raft_consensus.cc:697] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
W20260709 13:00:31.869632  5927 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.827s	user 0.008s	sys 0.045s
I20260709 13:00:31.872610  6050 consensus_queue.cc:237] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:31.871445  1539 leader_election.cc:336] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Timed out: RequestConsensusVote RPC to 127.0.107.194:37391 timed out after 1.920s (SENT)
I20260709 13:00:31.870056  6053 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:31.875563  1539 leader_election.cc:304] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:31.870079  6047 raft_consensus.cc:493] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:31.871407  1689 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:31.777243  5985 consensus_queue.cc:1059] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
W20260709 13:00:31.879418  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.851475  6033 raft_consensus.cc:3060] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:00:31.885356  1539 leader_election.cc:336] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Timed out: RequestConsensusVote RPC to 127.0.107.194:37391 timed out after 1.959s (SENT)
I20260709 13:00:31.854878  6029 leader_election.cc:290] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:31.661587  6026 consensus_queue.cc:237] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:31.865985  5986 raft_consensus.cc:2804] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:31.891515  1689 leader_election.cc:304] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:31.895874  1720 raft_consensus.cc:1240] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:31.897239  1615 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:31.759505  6022 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:31.886930  5927 raft_consensus.cc:2749] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:31.923977  1689 leader_election.cc:304] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:31.926743  1689 leader_election.cc:304] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:31.827613  6035 raft_consensus.cc:515] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:31.893287  5938 leader_election.cc:290] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:31.902292  5986 raft_consensus.cc:493] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:31.887368  6038 raft_consensus.cc:515] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:31.908013  6028 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.010s	sys 0.040s
W20260709 13:00:31.940062  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 54737.5us
I20260709 13:00:31.940956  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:00:31.945818  1539 leader_election.cc:336] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Timed out: RequestConsensusVote RPC to 127.0.107.194:37391 timed out after 1.989s (SENT)
I20260709 13:00:31.902671  6003 raft_consensus.cc:697] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:31.946465  1539 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:31.920410  6062 raft_consensus.cc:2749] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:31.929647  6029 raft_consensus.cc:2749] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:31.941382  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:31.864035  6041 raft_consensus.cc:515] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:31.952550  1724 raft_consensus.cc:1240] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 11 LEADER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:31.930267  5969 leader_election.cc:290] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373)
I20260709 13:00:31.934396  5892 raft_consensus.cc:2804] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:31.943127  5986 raft_consensus.cc:3060] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:31.961992  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:31.938480  6065 raft_consensus.cc:2804] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:31.977002  6065 raft_consensus.cc:697] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 12 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:31.977873  6063 raft_consensus.cc:2804] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:31.978581  6063 raft_consensus.cc:697] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 8 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:31.978878  1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2366) took 1591 ms. Trace:
I20260709 13:00:31.978118  6065 consensus_queue.cc:237] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:31.979278  1721 rpcz_store.cc:276] 0709 13:00:30.415423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.417919 (+  2496us) service_pool.cc:224] Handling call
0709 13:00:31.978617 (+1560698us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b540007f654. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:31.978778 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2663802112}
I20260709 13:00:31.979598  6063 consensus_queue.cc:237] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:31.944432  6002 consensus_meta.cc:287] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.510s	user 0.010s	sys 0.000s
I20260709 13:00:31.888681  6053 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:31.959345  1539 leader_election.cc:336] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Timed out: RequestConsensusVote RPC to 127.0.107.194:37391 timed out after 2.033s (SENT)
I20260709 13:00:31.973153  6031 raft_consensus.cc:2749] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:31.973388  6064 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
W20260709 13:00:31.945528  6028 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.011s	sys 0.040s
I20260709 13:00:31.980822  6039 raft_consensus.cc:2764] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:00:31.981057  1721 raft_consensus.cc:1240] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:31.981798  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:31.982543  6035 leader_election.cc:290] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:31.983140  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:31.991772  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:31.992375  5938 raft_consensus.cc:493] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:31.993111  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:31.894348  6047 raft_consensus.cc:515] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:32.032418  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:00:32.003340  1542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:31.938637  6049 consensus_queue.cc:1059] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
W20260709 13:00:32.038362  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 84346.3us
I20260709 13:00:31.957644  5928 raft_consensus.cc:2749] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:32.018187  1573 raft_consensus.cc:2468] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 9.
W20260709 13:00:32.042676  1539 leader_election.cc:336] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Timed out: RequestConsensusVote RPC to 127.0.107.194:37391 timed out after 2.128s (SENT)
I20260709 13:00:32.042922  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:32.043292  1539 leader_election.cc:304] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:32.019469  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 13:00:31.998932  5980 consensus_meta.cc:287] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 1.372s	user 0.013s	sys 0.000s
I20260709 13:00:32.027871  1645 raft_consensus.cc:1275] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:00:32.028483  1643 raft_consensus.cc:1240] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:32.036705  1574 raft_consensus.cc:2368] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 11. Current term is 12.
I20260709 13:00:31.882622  6054 consensus_queue.cc:237] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:32.011931  5892 raft_consensus.cc:697] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 8 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:32.019613  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:32.043548  1573 raft_consensus.cc:2376] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 8. Re-sending same reply.
I20260709 13:00:32.052352  5892 consensus_queue.cc:237] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:32.053186  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:32.053911  1573 raft_consensus.cc:2393] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 10: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:32.054685  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:32.010596  1689 leader_election.cc:304] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 13:00:32.055823  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:32.017134  6028 raft_consensus.cc:697] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 12 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:32.058341  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:32.060797  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:32.063031  1574 raft_consensus.cc:2468] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 13.
I20260709 13:00:32.063809  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:32.063753  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:32.064898  1721 raft_consensus.cc:1240] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 8. Current term is 9. Ops: []
W20260709 13:00:32.068807  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 58308.3us
I20260709 13:00:32.070694  1571 raft_consensus.cc:2410] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 13:00:32.012971  5952 consensus_queue.cc:1048] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:00:32.071790  1689 leader_election.cc:400] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 6 election: Vote denied by peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423) with higher term. Message: Invalid argument: T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 6. Current term is 7.
I20260709 13:00:32.077031  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:32.072405  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:32.079659  1721 raft_consensus.cc:1240] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 7. Current term is 8. Ops: []
W20260709 13:00:32.081382  1539 leader_election.cc:336] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Timed out: RequestConsensusVote RPC to 127.0.107.194:37391 timed out after 2.175s (SENT)
W20260709 13:00:32.062707  6021 consensus_meta.cc:287] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.740s	user 0.011s	sys 0.000s
I20260709 13:00:32.082198  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:32.059517  6048 raft_consensus.cc:2749] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:32.074955  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:32.075070  5973 raft_consensus.cc:2804] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:32.037822  5976 leader_election.cc:290] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:32.075809  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:32.062278  6049 consensus_queue.cc:1243] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 13:00:32.075388  6075 log.cc:927] Time spent T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:00:32.019505  5969 consensus_queue.cc:1059] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 13:00:32.091475  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:32.072405  1542 leader_election.cc:304] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:32.095243  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:32.096441  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:31.947057  6003 consensus_queue.cc:237] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:32.083895  1721 raft_consensus.cc:1240] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:32.037386  5938 raft_consensus.cc:515] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:32.124722  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:32.121219  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:32.129828  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 48478us
W20260709 13:00:32.130519  1539 leader_election.cc:336] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Timed out: RequestConsensusVote RPC to 127.0.107.194:37391 timed out after 2.620s (SENT)
I20260709 13:00:32.130899  1539 leader_election.cc:304] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:32.133240  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:32.133759  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:32.137079  5969 raft_consensus.cc:3055] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:32.137648  5969 raft_consensus.cc:740] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:32.140106  5784 raft_consensus.cc:3055] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:32.140556  5784 raft_consensus.cc:740] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:32.141422  5784 consensus_queue.cc:260] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:32.096540  5973 raft_consensus.cc:493] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:32.143555  5973 raft_consensus.cc:3060] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:32.144150  1649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 1851) took 1404 ms. Trace:
I20260709 13:00:32.144610  1649 rpcz_store.cc:276] 0709 13:00:30.740080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.884189 (+144109us) service_pool.cc:224] Handling call
0709 13:00:30.884572 (+   383us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:31.736993 (+852421us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.143833 (+406840us) spinlock_profiling.cc:243] Waited 754 ms on lock 0x7b540030e654. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:32.144082 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1734161664}
I20260709 13:00:32.145843  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:32.149897  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:32.152061  1723 raft_consensus.cc:1240] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 8 LEADER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 7. Current term is 8. Ops: []
W20260709 13:00:32.153179  6073 log.cc:927] Time spent T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
I20260709 13:00:32.062338  5980 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:32.155732  1722 raft_consensus.cc:2393] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 8: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:32.091823  6031 raft_consensus.cc:2749] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:32.160647  6060 raft_consensus.cc:493] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:32.161247  6060 raft_consensus.cc:515] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:32.163321  6060 leader_election.cc:290] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:32.165174  6051 consensus_meta.cc:287] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.500s	user 0.006s	sys 0.006s
I20260709 13:00:32.166811  1574 raft_consensus.cc:3060] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:32.167263  1648 raft_consensus.cc:2468] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 12.
I20260709 13:00:32.167764  1615 leader_election.cc:304] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:32.165679  6051 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:32.179052  6051 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:32.180042  5966 negotiation.cc:336] Failed RPC negotiation. Trace:
0709 13:00:29.170532 (+     0us) reactor.cc:730] Submitting negotiation task for client connection to 127.0.107.194:37391 (local address 127.0.0.1:48560)
0709 13:00:29.413844 (+243312us) negotiation.cc:107] Waiting for socket to connect
0709 13:00:29.413978 (+   134us) client_negotiation.cc:175] Beginning negotiation
0709 13:00:29.414616 (+   638us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
0709 13:00:32.178291 (+2763675us) negotiation.cc:326] Negotiation complete: Timed out: Client connection negotiation failed: client connection to 127.0.107.194:37391: received 0 of 25 requested bytes
Metrics: {"client-negotiator.queue_time_us":242057,"thread_start_us":170238,"threads_started":1}
W20260709 13:00:32.180998  6080 log.cc:927] Time spent T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:00:32.181042  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:32.182929  1648 raft_consensus.cc:2468] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 10.
I20260709 13:00:32.182024  6028 consensus_queue.cc:237] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:32.151517  5784 raft_consensus.cc:3060] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:32.184974  6081 log.cc:927] Time spent T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:00:32.031466  6064 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:32.190161  6064 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:32.190503  1648 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd"
dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
mode: GRACEFUL
new_leader_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:35470
I20260709 13:00:32.191077  1648 raft_consensus.cc:606] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Received request to transfer leadership to TS 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:32.191411  1648 raft_consensus.cc:614] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:32.193620  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:32.183470  6053 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:32.194231  1649 raft_consensus.cc:2468] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 12.
I20260709 13:00:32.197695  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:32.198185  1615 leader_election.cc:304] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:32.204699  6005 raft_consensus.cc:493] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.205363  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:32.206727  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:32.207814  6022 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:32.208607  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:32.209282  2323 raft_consensus.cc:2468] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 12.
I20260709 13:00:32.210518  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:32.205474  6031 raft_consensus.cc:2749] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:32.212270  1540 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 13:00:32.213492  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 141149us
W20260709 13:00:32.180066  6082 log.cc:927] Time spent T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:00:32.218775  2323 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad"
dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
mode: GRACEFUL
new_leader_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:39778
I20260709 13:00:32.214756  1570 raft_consensus.cc:1240] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 7. Current term is 8. Ops: [5.4-7.5]
I20260709 13:00:32.217456  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:00:32.220701  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 90212.2us
I20260709 13:00:32.223584  1615 leader_election.cc:304] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:32.227027  1570 raft_consensus.cc:1240] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:32.214275  6021 raft_consensus.cc:2749] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:32.216013  6053 raft_consensus.cc:2804] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:32.214143  6063 raft_consensus.cc:2749] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:32.215463  6051 raft_consensus.cc:2749] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:00:32.232445  1539 leader_election.cc:336] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Timed out: RequestConsensusVote RPC to 127.0.107.194:37391 timed out after 2.756s (SENT)
I20260709 13:00:32.235144  1539 leader_election.cc:304] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:32.232476  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:32.208407  5973 raft_consensus.cc:515] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:32.239436  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:32.239537  1721 raft_consensus.cc:1240] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:32.225929  6039 raft_consensus.cc:2749] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:32.240869  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:32.246860  1721 raft_consensus.cc:1275] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:32.249357  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:32.251611  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:32.257903  6002 consensus_queue.cc:1048] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:00:32.258517  6074 log.cc:927] Time spent T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.132s	user 0.003s	sys 0.000s
W20260709 13:00:32.313421  6085 negotiation.cc:336] Failed RPC negotiation. Trace:
0709 13:00:31.961618 (+     0us) reactor.cc:730] Submitting negotiation task for server connection from 127.0.0.1:48560 (local address 127.0.107.194:37391)
0709 13:00:32.165525 (+203907us) server_negotiation.cc:207] Beginning negotiation
0709 13:00:32.165579 (+    54us) server_negotiation.cc:400] Waiting for connection header
0709 13:00:32.165666 (+    87us) server_negotiation.cc:408] Connection header received
0709 13:00:32.165907 (+   241us) server_negotiation.cc:366] Received NEGOTIATE NegotiatePB request
0709 13:00:32.165952 (+    45us) server_negotiation.cc:462] Received NEGOTIATE request from client
0709 13:00:32.177074 (+ 11122us) server_negotiation.cc:378] Sending NEGOTIATE NegotiatePB response
0709 13:00:32.177390 (+   316us) server_negotiation.cc:227] Negotiated authn=CERTIFICATE
0709 13:00:32.240666 (+ 63276us) negotiation.cc:326] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48560: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"server-negotiator.queue_time_us":123710,"thread_start_us":56367,"threads_started":1}
I20260709 13:00:32.259287  5947 leader_election.cc:290] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:32.315757  5973 leader_election.cc:290] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:32.205356  6005 raft_consensus.cc:515] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:32.274030  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:32.237021  5926 consensus_queue.cc:1059] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:00:32.233692  5928 consensus_queue.cc:1059] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:00:32.238569  5943 raft_consensus.cc:3055] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:32.305661  1568 raft_consensus.cc:1240] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 LEADER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:32.229768  5932 consensus_queue.cc:1059] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:00:32.231654  6031 consensus_queue.cc:1059] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
W20260709 13:00:32.306273  2324 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53306 (request call id 720) took 1807 ms (client timeout 1653 ms). Trace:
I20260709 13:00:32.339870  1720 raft_consensus.cc:1240] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 10 LEADER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:32.307792  1574 raft_consensus.cc:2468] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 12.
W20260709 13:00:32.340267  2324 rpcz_store.cc:269] 0709 13:00:30.498749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.500067 (+  1318us) service_pool.cc:224] Handling call
0709 13:00:32.270566 (+1770499us) spinlock_profiling.cc:243] Waited 431 ms on lock 0x7b540062e154. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:32.306203 (+ 35637us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":991853824}
W20260709 13:00:32.309923  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:32.311100  1615 leader_election.cc:304] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:32.309736  6016 raft_consensus.cc:493] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.233860  6053 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:32.329687  6094 log.cc:927] Time spent T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.078s	user 0.002s	sys 0.004s
I20260709 13:00:32.308678  6035 raft_consensus.cc:2749] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:00:32.325882  5931 consensus_meta.cc:287] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 1.068s	user 0.010s	sys 0.006s
W20260709 13:00:32.342139  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 87886.9us
I20260709 13:00:32.342640  6070 raft_consensus.cc:3055] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:32.356010  6070 raft_consensus.cc:740] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:32.360494  1615 leader_election.cc:304] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:32.365152  5947 raft_consensus.cc:2749] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:32.347488  6053 raft_consensus.cc:3060] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:32.366449  1615 leader_election.cc:304] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:32.367435  5947 raft_consensus.cc:2749] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:32.368866  1615 leader_election.cc:400] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Vote denied by peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373) with higher term. Message: Invalid argument: T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 11. Current term is 12.
W20260709 13:00:32.345136  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 116158us
W20260709 13:00:32.371397  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:32.338124  6078 log.cc:927] Time spent T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.256s	user 0.000s	sys 0.005s
I20260709 13:00:32.372143  5712 raft_consensus.cc:493] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.372853  5712 raft_consensus.cc:515] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:32.374796  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:32.375147  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:32.375671  5712 leader_election.cc:290] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:32.362926  5931 raft_consensus.cc:515] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:32.370960  6045 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:32.375865  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:32.338259  5943 raft_consensus.cc:740] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
W20260709 13:00:32.385675  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:32.380553  6095 log.cc:927] Time spent T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 13:00:32.339831  6050 raft_consensus.cc:3055] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:00:32.377084  1722 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1812) took 1886 ms (client timeout 1619 ms). Trace:
I20260709 13:00:32.343721  5969 consensus_queue.cc:260] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:32.348122  6039 raft_consensus.cc:2804] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:00:32.389309  1722 rpcz_store.cc:269] 0709 13:00:30.490900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.491055 (+   155us) service_pool.cc:224] Handling call
0709 13:00:32.376851 (+1885796us) spinlock_profiling.cc:243] Waited 1.66 s on lock 0x7b54000cdad4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:32.377015 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3822378880}
I20260709 13:00:32.378623  1615 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:32.347965  6016 raft_consensus.cc:515] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:32.380760  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:32.381821  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 13:00:32.382975  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 287047us
I20260709 13:00:32.343416  6005 leader_election.cc:290] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:32.397535  1576 raft_consensus.cc:2393] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 11: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:32.364274  6033 raft_consensus.cc:515] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:32.401369  1458 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 160894us
I20260709 13:00:32.403096  5943 consensus_queue.cc:260] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:32.404138  5943 raft_consensus.cc:3060] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:32.404196  6033 leader_election.cc:290] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:32.406227  5927 consensus_queue.cc:1059] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:32.407249  5927 consensus_queue.cc:1059] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:32.408802  6024 raft_consensus.cc:3055] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:32.409193  6024 raft_consensus.cc:740] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:32.391907  6035 consensus_queue.cc:1048] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 13:00:32.412004  1571 raft_consensus.cc:2393] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 7: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:32.410043  6024 consensus_queue.cc:260] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:32.413393  6024 raft_consensus.cc:3060] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:32.413666  5931 leader_election.cc:290] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:32.414398  5969 raft_consensus.cc:3060] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:32.415392  6045 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:32.356981  6070 consensus_queue.cc:260] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 13:00:32.389158  6050 raft_consensus.cc:740] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:32.427408  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:32.429800  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:32.427738  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:32.392383  6039 raft_consensus.cc:493] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:32.398849  6038 leader_election.cc:290] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:00:32.431304  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 52766.4us
I20260709 13:00:32.402119  5949 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.435216  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:32.435097  1615 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:32.436712  1570 raft_consensus.cc:2393] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 8: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:32.437307  1615 leader_election.cc:304] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:32.430624  5932 consensus_queue.cc:1059] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:00:32.439018  6031 raft_consensus.cc:3055] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:32.438697  5986 raft_consensus.cc:515] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:32.439448  6031 raft_consensus.cc:740] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
W20260709 13:00:32.445691  6097 log.cc:927] Time spent T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:00:32.447145  6031 consensus_queue.cc:260] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:32.451241  1615 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:32.452631  6051 raft_consensus.cc:2749] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:00:32.453262  6090 log.cc:927] Time spent T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.265s	user 0.003s	sys 0.000s
I20260709 13:00:32.453384  6051 raft_consensus.cc:2749] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:32.454108  6051 raft_consensus.cc:493] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:32.454586  6051 raft_consensus.cc:515] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 13:00:32.457084  1615 leader_election.cc:304] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:32.436340  6070 raft_consensus.cc:3060] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:32.458841  6063 raft_consensus.cc:2749] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:32.451942  6016 leader_election.cc:290] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:32.462308  2324 raft_consensus.cc:1275] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:32.433288  5947 raft_consensus.cc:2749] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:32.467633  1723 raft_consensus.cc:1240] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 9. Current term is 11. Ops: [9.6-9.6]
I20260709 13:00:32.432741  6039 raft_consensus.cc:3060] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:32.463246  5986 leader_election.cc:290] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:32.472726  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:32.476923  1722 raft_consensus.cc:2393] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 7: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:32.475711  1723 raft_consensus.cc:1240] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:32.478946  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:32.443233  5644 raft_consensus.cc:2764] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 13:00:32.482612  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:32.432406  5931 consensus_queue.cc:1048] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:00:32.482913  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:32.483551  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:32.491573  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:32.486800  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:32.482683  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:32.495733  1722 raft_consensus.cc:3060] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:32.487567  1717 raft_consensus.cc:2393] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 8: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:32.496861  1570 raft_consensus.cc:1240] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:32.495864  1651 raft_consensus.cc:2468] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 10.
I20260709 13:00:32.433319  5784 consensus_queue.cc:1059] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:00:32.502202  1723 raft_consensus.cc:2393] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 11: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:32.443602  5949 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:32.511307  5949 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:32.515538  5938 leader_election.cc:290] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:32.483592  6035 consensus_queue.cc:1048] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
W20260709 13:00:32.519627  6100 log.cc:927] Time spent T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 13:00:32.521148  1575 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37682 (request call id 1087) took 2157 ms (client timeout 2000 ms). Trace:
W20260709 13:00:32.521624  1575 rpcz_store.cc:269] 0709 13:00:30.363611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.367329 (+  3718us) service_pool.cc:224] Handling call
0709 13:00:32.520961 (+2153632us) spinlock_profiling.cc:243] Waited 958 ms on lock 0x7b54002ec2d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:32.521071 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2202647424}
I20260709 13:00:32.523207  1646 raft_consensus.cc:2468] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 13.
I20260709 13:00:32.495055  6031 raft_consensus.cc:3060] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:32.547628  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 63092.8us
W20260709 13:00:32.521144  6098 log.cc:927] Time spent T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.188s	user 0.003s	sys 0.000s
I20260709 13:00:32.488946  6051 leader_election.cc:290] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373)
I20260709 13:00:32.552930  6056 consensus_queue.cc:1059] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:00:32.551822  1722 raft_consensus.cc:2468] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 11.
I20260709 13:00:32.570477  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:32.559435  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:32.573017  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:32.560674  5644 raft_consensus.cc:493] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:32.561090  6063 raft_consensus.cc:493] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:32.567147  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36642 (request call id 2481) took 1188 ms. Trace:
I20260709 13:00:32.570219  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:32.578560  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:32.548590  6035 raft_consensus.cc:3055] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:32.580883  2323 raft_consensus.cc:606] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Received request to transfer leadership to TS 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:32.581470  2323 raft_consensus.cc:614] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:32.560220  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:32.574945  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:32.578860  1724 raft_consensus.cc:2393] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 9: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:32.574079  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:32.573045  1539 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 13:00:32.578517  1568 rpcz_store.cc:276] 0709 13:00:31.378659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.378787 (+   128us) service_pool.cc:224] Handling call
0709 13:00:31.430153 (+ 51366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:32.338675 (+908522us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.566880 (+228205us) spinlock_profiling.cc:243] Waited 846 ms on lock 0x7b540017dc54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:32.567056 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1946696576}
I20260709 13:00:32.587323  1575 raft_consensus.cc:1275] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:00:32.590970  1723 raft_consensus.cc:1240] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:32.595892  1570 raft_consensus.cc:1275] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:00:32.589449  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:00:32.601810  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:32.675053  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:00:32.676555  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 103926us
I20260709 13:00:32.677670  1575 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 8.
I20260709 13:00:32.580982  6035 raft_consensus.cc:740] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:32.711843  1650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 1874) took 1511 ms. Trace:
I20260709 13:00:32.715058  1650 rpcz_store.cc:276] 0709 13:00:31.200067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.328726 (+128659us) service_pool.cc:224] Handling call
0709 13:00:32.711592 (+1382866us) spinlock_profiling.cc:243] Waited 314 ms on lock 0x7b54002b2d54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:32.711757 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":723243392}
W20260709 13:00:32.735613  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:32.672379  5931 raft_consensus.cc:493] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:32.797305  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:32.801702  1643 raft_consensus.cc:2393] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 11: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:32.802134  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:32.802929  2324 raft_consensus.cc:3060] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:32.789737  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45148 (request call id 2381) took 1570 ms. Trace:
I20260709 13:00:32.713112  5932 raft_consensus.cc:2804] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:32.584959  6063 raft_consensus.cc:515] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:32.804911  1647 rpcz_store.cc:276] 0709 13:00:31.219067 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.336165 (+117098us) service_pool.cc:224] Handling call
0709 13:00:32.789325 (+1453160us) spinlock_profiling.cc:243] Waited 303 ms on lock 0x7b54002b2354. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:32.789549 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":697773312}
W20260709 13:00:32.811893  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 50042.6us
I20260709 13:00:32.796698  5928 raft_consensus.cc:3055] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:00:32.806267  6081 log.cc:927] Time spent T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 13:00:32.813992  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:32.815237  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:32.593731  5644 raft_consensus.cc:515] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:32.588639  6111 consensus_queue.cc:1059] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.221s
I20260709 13:00:32.818571  2324 raft_consensus.cc:2468] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 9.
I20260709 13:00:32.754909  6054 raft_consensus.cc:493] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:32.821002  2332 raft_consensus.cc:1217] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Deduplicated request from leader. Original: 6.7->[7.8-10.9]   Dedup: 7.8->[10.9-10.9]
I20260709 13:00:32.821909  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:32.828572  2332 raft_consensus.cc:1240] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 10. Current term is 11. Ops: [7.8-10.9]
I20260709 13:00:32.762957  5986 raft_consensus.cc:493] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:32.828953  2328 raft_consensus.cc:2376] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 5. Re-sending same reply.
I20260709 13:00:32.816069  5932 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:32.833199  6054 raft_consensus.cc:515] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:32.820345  5928 raft_consensus.cc:740] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:32.812489  5931 raft_consensus.cc:515] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:32.842631  5932 raft_consensus.cc:3060] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:32.869504  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:32.838073  5986 raft_consensus.cc:515] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:32.922603  6105 log.cc:927] Time spent T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
W20260709 13:00:32.923756  6114 log.cc:927] Time spent T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:00:32.827957  6035 consensus_queue.cc:260] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:32.843729  6053 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:33.070166  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 252665us
W20260709 13:00:33.076501  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 497034us
I20260709 13:00:32.722826  6045 consensus_queue.cc:1048] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.133s
W20260709 13:00:33.140233  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.156688  1650 raft_consensus.cc:2468] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 7.
I20260709 13:00:33.160785  1725 raft_consensus.cc:3055] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:00:33.177570  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.205273  1572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 2309) took 1109 ms. Trace:
W20260709 13:00:33.205468  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:32.935197  5928 consensus_queue.cc:260] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:33.199867  2327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32870 (request call id 569) took 2963 ms. Trace:
I20260709 13:00:33.192788  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45148 (request call id 2388) took 1199 ms. Trace:
I20260709 13:00:33.193221  1720 raft_consensus.cc:1275] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:00:33.206626  1725 raft_consensus.cc:740] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:33.181056  5934 leader_election.cc:290] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:33.205710  1572 rpcz_store.cc:276] 0709 13:00:32.095721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.207505 (+111784us) service_pool.cc:224] Handling call
0709 13:00:32.207812 (+   307us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:32.228973 (+ 21161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:32.229004 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:32.229627 (+   623us) log.cc:844] Serialized 52 byte log entry
0709 13:00:32.338319 (+108692us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:32.338368 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.883891 (+545523us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b54003679d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:33.185219 (+301328us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:33.185296 (+    77us) raft_consensus.cc:1685] finished
0709 13:00:33.185331 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:33.205211 (+ 19880us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4511,"raft.queue_time_us":4895,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":2047,"spinlock_wait_cycles":37407616,"thread_start_us":84663,"threads_started":1,"wal-append.queue_time_us":162921}
I20260709 13:00:33.211251  2327 rpcz_store.cc:276] 0709 13:00:30.221298 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:30.221462 (+   164us) service_pool.cc:224] Handling call
0709 13:00:30.246737 (+ 25275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:31.739125 (+1492388us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.884146 (+1145021us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b54004f1fd4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:33.185072 (+300926us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3206393216}
I20260709 13:00:33.214802  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:00:33.178448  6109 log.cc:927] Time spent T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.602s	user 0.000s	sys 0.008s
W20260709 13:00:33.181788  6112 log.cc:927] Time spent T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.348s	user 0.006s	sys 0.000s
I20260709 13:00:33.212178  1720 pending_rounds.cc:85] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4: Aborting all ops after (but not including) 7
I20260709 13:00:33.235787  1720 pending_rounds.cc:107] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:00:33.236186  1720 raft_consensus.cc:2889] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:33.184433  5938 raft_consensus.cc:493] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.211357  1644 rpcz_store.cc:276] 0709 13:00:31.993817 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.993947 (+   130us) service_pool.cc:224] Handling call
0709 13:00:32.019499 (+ 25552us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:32.167824 (+148325us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:00:32.309154 (+141330us) log.cc:844] Serialized 14 byte log entry
0709 13:00:32.429232 (+120078us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:32.429280 (+    48us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:32.429329 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:32.933930 (+504601us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b540030d754. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:33.192620 (+258690us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:33.192732 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":228353,"prepare.run_wall_time_us":50,"raft.queue_time_us":14163,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":1529,"spinlock_wait_cycles":347487104,"thread_start_us":181138,"threads_started":2,"wal-append.queue_time_us":189073}
I20260709 13:00:33.224879  2295 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:33.221424  1719 raft_consensus.cc:2468] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 7.
I20260709 13:00:33.243402  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:33.243772  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:33.222877  1725 consensus_queue.cc:260] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:33.244115  1721 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 8.
W20260709 13:00:33.255364  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.182475  5931 leader_election.cc:290] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:33.258060  1725 raft_consensus.cc:3060] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:33.254861  5949 raft_consensus.cc:2749] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:33.224067  5927 raft_consensus.cc:493] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:33.227075  6025 raft_consensus.cc:493] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:33.228313  6115 raft_consensus.cc:493] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:33.362902  6115 raft_consensus.cc:515] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:33.365962  6115 leader_election.cc:290] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:33.367062  6025 raft_consensus.cc:515] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:33.255246  5938 raft_consensus.cc:515] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:33.368625  1691 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.368705  5927 raft_consensus.cc:515] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:33.390110  6117 raft_consensus.cc:493] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:33.391036  6117 raft_consensus.cc:515] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:33.357213  5644 leader_election.cc:290] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:33.400517  5644 raft_consensus.cc:493] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.401228  5644 raft_consensus.cc:515] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:33.404058  5644 leader_election.cc:290] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:33.411329  6121 raft_consensus.cc:493] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.413136  5986 leader_election.cc:290] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:33.414230  5712 raft_consensus.cc:493] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.248245  6120 raft_consensus.cc:493] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
W20260709 13:00:33.515033  1576 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36642 (request call id 2483) took 1252 ms (client timeout 1639 ms). Trace:
I20260709 13:00:33.516673  1725 raft_consensus.cc:1275] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:00:33.520836  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 193201us
W20260709 13:00:33.524207  1576 rpcz_store.cc:269] 0709 13:00:32.232445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.240338 (+  7893us) service_pool.cc:224] Handling call
0709 13:00:33.485048 (+1244710us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b54003296d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:33.485199 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":342541696}
I20260709 13:00:33.532155  1539 leader_election.cc:304] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:33.534984  1725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1817) took 1759 ms. Trace:
I20260709 13:00:33.535449  1725 rpcz_store.cc:276] 0709 13:00:31.766497 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.766648 (+   151us) service_pool.cc:224] Handling call
0709 13:00:31.767063 (+   415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:32.934868 (+1167805us) spinlock_profiling.cc:243] Waited 87.9 ms on lock 0x7b5400370b20. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f2332dc0 00007fa9f23bd1c0 00007fa9f23be231 00007fa9f23bad8f 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c
0709 13:00:33.525537 (+590669us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.525820 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":202283776}
I20260709 13:00:33.372311  6025 leader_election.cc:290] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:33.254977  6015 consensus_queue.cc:1048] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.266s
W20260709 13:00:33.550405  2294 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.747s	user 0.064s	sys 0.068s
W20260709 13:00:33.524480  5932 consensus_meta.cc:287] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.608s	user 0.009s	sys 0.008s
W20260709 13:00:33.560038  2294 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.064s	sys 0.068s
W20260709 13:00:33.560695  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 757185us
W20260709 13:00:33.542608  6036 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:00:33.521155  6119 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:33.573766  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.549968  5931 consensus_queue.cc:1059] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:00:33.533422  5712 raft_consensus.cc:515] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:33.572973  5937 consensus_queue.cc:1048] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:00:33.586879  6117 leader_election.cc:290] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:33.533628  6120 raft_consensus.cc:515] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:33.589983  2294 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:33.586834  6025 raft_consensus.cc:2804] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:33.524677  6121 raft_consensus.cc:515] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:33.580348  5938 leader_election.cc:290] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:00:33.598872  6123 log.cc:927] Time spent T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:00:33.591984  2294 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:33.564869  5932 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:33.584303  6054 leader_election.cc:290] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:33.590840  6063 leader_election.cc:290] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:33.590865  5644 raft_consensus.cc:493] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:33.592375  6034 raft_consensus.cc:2749] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:00:33.598140  6039 consensus_meta.cc:287] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 1.098s	user 0.014s	sys 0.002s
I20260709 13:00:33.596632  5931 raft_consensus.cc:3055] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:33.578789  6119 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:33.596745  6025 raft_consensus.cc:493] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:33.614434  1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1837) took 1141 ms. Trace:
I20260709 13:00:33.614655  6002 raft_consensus.cc:2804] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:33.615281  5712 leader_election.cc:290] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:33.615578  6002 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:33.614902  1720 rpcz_store.cc:276] 0709 13:00:32.472788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.473320 (+   532us) service_pool.cc:224] Handling call
0709 13:00:32.499580 (+ 26260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:33.236815 (+737235us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.614195 (+377380us) spinlock_profiling.cc:243] Waited 378 ms on lock 0x7b5400100c54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:33.614368 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":869923072}
I20260709 13:00:33.621080  1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1819) took 1853 ms. Trace:
I20260709 13:00:33.608436  6054 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:33.610037  6128 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:33.610739  5927 leader_election.cc:290] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:33.625876  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 377100us
I20260709 13:00:33.611873  5931 raft_consensus.cc:740] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:33.617610  6002 raft_consensus.cc:3060] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:33.617424  6025 raft_consensus.cc:3060] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:33.617064  6039 raft_consensus.cc:515] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:33.636085  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 231318us
I20260709 13:00:33.623440  1718 rpcz_store.cc:276] 0709 13:00:31.767901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.768053 (+   152us) service_pool.cc:224] Handling call
0709 13:00:31.768595 (+   542us) raft_consensus.cc:1471] Updating replica for 4 ops
0709 13:00:31.769173 (+   578us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:31.769226 (+    53us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 13:00:32.883583 (+1114357us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b2c0001ccc8. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f0cb4a11 00007fa9f0cc4372 00007fa9f23f6a01 00007fa9f23bb43a 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2
0709 13:00:33.180122 (+296539us) log.cc:844] Serialized 104 byte log entry
0709 13:00:33.211090 (+ 30968us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:33.584243 (+373153us) log.cc:844] Serialized 14 byte log entry
0709 13:00:33.588291 (+  4048us) log.cc:844] Serialized 14 byte log entry
0709 13:00:33.588947 (+   656us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:33.589027 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:33.620739 (+ 31712us) raft_consensus.cc:1685] finished
0709 13:00:33.620788 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:33.621006 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31962,"raft.queue_time_us":1124,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":17900,"spinlock_wait_cycles":40353280,"thread_start_us":351159,"threads_started":2,"wal-append.queue_time_us":353727}
I20260709 13:00:33.618098  5644 raft_consensus.cc:515] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:33.649266  5937 consensus_queue.cc:1048] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:00:33.657878  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:33.658629  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:33.627251  6054 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:33.659443  1643 raft_consensus.cc:3060] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:33.659911  1650 raft_consensus.cc:2393] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 7: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:33.661165  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:33.662569  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:33.665171  1642 raft_consensus.cc:3060] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:33.665411  1649 raft_consensus.cc:2410] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:00:33.666534  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:33.669118  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:33.669708  1647 raft_consensus.cc:3060] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:33.670538  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:33.673244  1645 raft_consensus.cc:1275] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:00:33.674809  5926 raft_consensus.cc:3055] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:33.675293  5926 raft_consensus.cc:740] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:33.676170  5926 consensus_queue.cc:260] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:33.677568  5926 raft_consensus.cc:3060] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:33.681087  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:33.681756  1649 raft_consensus.cc:2468] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 8.
W20260709 13:00:33.685484  6083 log.cc:927] Time spent T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 1.506s	user 0.010s	sys 0.001s
I20260709 13:00:33.685866  6039 leader_election.cc:290] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:33.688439  6050 consensus_queue.cc:260] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:33.689801  1647 raft_consensus.cc:2468] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 9.
I20260709 13:00:33.693077  1643 raft_consensus.cc:2468] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 8.
I20260709 13:00:33.693976  6120 leader_election.cc:290] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:33.694562  5931 consensus_queue.cc:260] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:33.695904  5931 raft_consensus.cc:3060] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:33.699489  6033 raft_consensus.cc:493] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.700040  6033 raft_consensus.cc:515] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:33.701270  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.701411  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:33.673084  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:33.631624  6128 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:33.714638  1648 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 12.
I20260709 13:00:33.742293  1642 raft_consensus.cc:2468] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 11.
I20260709 13:00:33.689792  6050 raft_consensus.cc:3060] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:33.693086  5932 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 15 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:33.749749  1644 raft_consensus.cc:3060] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:00:33.757313  6047 leader_election.cc:290] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:33.758106  6041 leader_election.cc:290] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:33.760769  6126 log.cc:927] Time spent T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.130s	user 0.002s	sys 0.000s
I20260709 13:00:33.763063  5644 leader_election.cc:290] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:33.770506  6033 leader_election.cc:290] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:33.716802  6132 raft_consensus.cc:493] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:33.771656  6132 raft_consensus.cc:515] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:33.717351  6039 consensus_queue.cc:1059] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
W20260709 13:00:33.763077  6084 log.cc:927] Time spent T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 1.575s	user 0.021s	sys 0.030s
I20260709 13:00:33.788098  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 1881) took 1316 ms. Trace:
I20260709 13:00:33.788682  1646 rpcz_store.cc:276] 0709 13:00:32.472003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.472143 (+   140us) service_pool.cc:224] Handling call
0709 13:00:33.787928 (+1315785us) spinlock_profiling.cc:243] Waited 32.8 ms on lock 0x7b540030f554. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:33.788038 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":75355392}
I20260709 13:00:33.779754  6132 leader_election.cc:290] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:33.745078  1617 leader_election.cc:304] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:00:33.806282  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 61282.8us
I20260709 13:00:33.797739  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:33.801023  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:33.832180  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
W20260709 13:00:33.846737  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 246108us
I20260709 13:00:33.848841  2294 leader_election.cc:304] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:33.850342  1644 raft_consensus.cc:2468] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 11.
I20260709 13:00:33.851231  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:33.852078  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:33.792481  5932 raft_consensus.cc:493] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.864626  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:33.851413  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:33.793004  6121 leader_election.cc:290] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:33.841890  5909 raft_consensus.cc:493] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
W20260709 13:00:33.867822  1539 leader_election.cc:336] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Timed out: RequestConsensusVote RPC to 127.0.107.194:37391 timed out after 1.619s (SENT)
I20260709 13:00:33.869442  1539 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:33.869352  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:33.873129  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:33.842031  6063 raft_consensus.cc:493] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.841756  6134 raft_consensus.cc:2749] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:33.876874  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:33.869760  6136 raft_consensus.cc:493] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.843988  6033 consensus_queue.cc:1059] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:00:33.918953  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:33.914793  6136 raft_consensus.cc:515] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:33.875218  6121 raft_consensus.cc:2804] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:33.916891  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:33.926924  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 13:00:33.917621  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:33.927738  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:33.912547  6039 raft_consensus.cc:493] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:33.921070  2328 raft_consensus.cc:3060] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:33.933059  2327 raft_consensus.cc:1240] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:33.871300  5932 raft_consensus.cc:515] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:33.869926  6002 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:33.912020  5948 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.001s	sys 0.029s
I20260709 13:00:33.930092  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:33.874419  5909 raft_consensus.cc:515] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:33.927821  2332 raft_consensus.cc:2468] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 11.
I20260709 13:00:33.910753  6045 raft_consensus.cc:2749] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:33.909999  6119 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:33.955471  2325 raft_consensus.cc:2468] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 9.
I20260709 13:00:33.878383  6063 raft_consensus.cc:515] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:33.952384  5948 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.001s	sys 0.029s
I20260709 13:00:33.926698  6121 raft_consensus.cc:493] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:33.934355  6134 raft_consensus.cc:493] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:33.963301  2324 raft_consensus.cc:2468] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 14.
I20260709 13:00:33.964239  2331 raft_consensus.cc:2393] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 13: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 13:00:33.953784  6054 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:00:33.967872  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 87257.4us
I20260709 13:00:33.963057  6121 raft_consensus.cc:3060] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:33.947700  6039 raft_consensus.cc:515] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:33.972810  2297 leader_election.cc:304] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:33.975349  6063 leader_election.cc:290] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:33.980337  1688 leader_election.cc:304] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:00:33.982250  6142 log.cc:927] Time spent T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:00:33.989419  1688 leader_election.cc:304] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 13:00:33.999706  2328 raft_consensus.cc:2410] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:00:34.005196  5909 leader_election.cc:290] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:00:34.005863  1691 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.006881  6038 raft_consensus.cc:493] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:34.015995  5909 raft_consensus.cc:2749] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:34.004180  6131 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:34.016804  6042 raft_consensus.cc:493] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:34.017006  6131 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:34.017408  6042 raft_consensus.cc:515] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:34.019634  6042 leader_election.cc:290] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:33.973131  6128 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:34.004257  5976 raft_consensus.cc:2749] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:34.021531  5932 leader_election.cc:290] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:34.022168  1688 leader_election.cc:304] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:34.022760  6036 raft_consensus.cc:2804] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:34.023152  6039 leader_election.cc:290] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:34.014532  6046 raft_consensus.cc:493] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:33.965610  6134 raft_consensus.cc:515] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:34.024192  6093 log.cc:927] Time spent T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 1.687s	user 0.000s	sys 0.010s
I20260709 13:00:34.025189  6136 leader_election.cc:290] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:33.985575  6117 raft_consensus.cc:493] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:34.026332  6055 raft_consensus.cc:493] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:34.027333  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:34.027392  1689 leader_election.cc:304] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
W20260709 13:00:34.065956  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 72133.1us
I20260709 13:00:34.066349  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:34.067209  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:34.067541  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:34.068266  1725 raft_consensus.cc:2393] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 7: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:34.028090  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:34.014254  5934 raft_consensus.cc:493] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:34.028857  6042 raft_consensus.cc:493] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:34.028678  6119 raft_consensus.cc:493] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:34.030637  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:34.071233  6042 raft_consensus.cc:515] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:34.071355  6119 raft_consensus.cc:515] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:34.073341  6042 leader_election.cc:290] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:34.031522  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:34.073727  6119 leader_election.cc:290] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:34.074047  1576 raft_consensus.cc:2468] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 9.
I20260709 13:00:34.075040  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:34.075577  1576 raft_consensus.cc:2468] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 8.
W20260709 13:00:34.031983  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.007493  6038 raft_consensus.cc:515] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:34.068151  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:34.077347  1717 raft_consensus.cc:2393] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 12: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:34.078111  6038 leader_election.cc:290] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:34.062395  6138 raft_consensus.cc:493] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:34.079488  6138 raft_consensus.cc:515] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:34.032927  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:34.034492  1539 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 13:00:34.032240  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:34.081620  1574 raft_consensus.cc:2468] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 9.
I20260709 13:00:34.081554  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:34.082161  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:34.081763  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:34.082640  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:34.082880  1725 raft_consensus.cc:2368] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 10. Current term is 11.
I20260709 13:00:34.083259  1574 raft_consensus.cc:2468] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 8.
I20260709 13:00:34.083408  1721 raft_consensus.cc:2393] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 11: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:34.038511  6022 raft_consensus.cc:2749] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:34.076306  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:34.083961  1617 leader_election.cc:304] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:34.084327  1576 raft_consensus.cc:2368] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 10. Current term is 11.
I20260709 13:00:34.039258  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:34.040802  1572 raft_consensus.cc:1275] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:00:34.084820  1569 raft_consensus.cc:2468] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 11.
I20260709 13:00:34.086416  6138 leader_election.cc:290] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:34.087085  1570 raft_consensus.cc:1240] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:34.087219  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:34.041133  2295 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
W20260709 13:00:34.042910  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.045132  1688 leader_election.cc:304] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:34.088878  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:34.019984  6131 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:34.049875  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 13:00:34.058204  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.028028  5986 raft_consensus.cc:493] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:34.070363  5934 raft_consensus.cc:515] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:34.071466  1575 raft_consensus.cc:2468] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 10.
I20260709 13:00:34.031277  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:34.094717  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:34.095199  1568 raft_consensus.cc:2468] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 12.
W20260709 13:00:34.089123  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.089644  1573 raft_consensus.cc:3060] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:34.089699  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:34.081985  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:34.096886  1717 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 12.
W20260709 13:00:34.091411  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 46373.5us
I20260709 13:00:34.056829  6036 raft_consensus.cc:697] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 7 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:34.097756  1688 leader_election.cc:304] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:34.063653  6127 raft_consensus.cc:493] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:34.098791  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 57739.4us
I20260709 13:00:34.099710  1724 raft_consensus.cc:2468] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 11.
I20260709 13:00:34.105422  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:34.106148  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:34.107342  1688 leader_election.cc:304] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:34.108503  1688 leader_election.cc:304] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:34.106285  1722 raft_consensus.cc:2410] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:00:34.111195  1688 leader_election.cc:304] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:00:34.114320  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 79935.5us
I20260709 13:00:34.090090  6041 raft_consensus.cc:2804] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:34.092499  6033 raft_consensus.cc:493] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:34.119438  1688 leader_election.cc:304] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:34.087714  5932 raft_consensus.cc:493] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:34.092901  6038 raft_consensus.cc:2749] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:34.100334  6138 raft_consensus.cc:2749] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:34.100910  6115 raft_consensus.cc:493] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:34.092581  6111 raft_consensus.cc:493] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:34.102026  5926 raft_consensus.cc:493] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:34.101255  6021 raft_consensus.cc:493] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:34.164036  1575 raft_consensus.cc:1275] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:00:34.110352  6022 raft_consensus.cc:2749] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:34.065362  6117 raft_consensus.cc:515] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:34.106681  5931 raft_consensus.cc:493] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:34.168898  1689 leader_election.cc:304] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:00:34.195734  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.115187  6042 raft_consensus.cc:2804] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:34.106086  6147 raft_consensus.cc:2804] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:34.058971  6046 raft_consensus.cc:515] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:34.226013  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 57220.3us
I20260709 13:00:34.117663  6128 raft_consensus.cc:493] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:34.101783  5986 raft_consensus.cc:515] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:34.118009  6047 raft_consensus.cc:2804] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:00:34.245648  1689 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:34373 timed out after 1.529s (SENT) [suppressed 65 similar messages]
I20260709 13:00:34.164857  6131 raft_consensus.cc:2804] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:00:34.243798  6070 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.444s	user 0.034s	sys 0.062s
I20260709 13:00:34.130932  5712 raft_consensus.cc:493] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:34.131191  5983 raft_consensus.cc:2804] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:34.229889  6021 raft_consensus.cc:515] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:34.081207  6055 raft_consensus.cc:515] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:34.228456  5926 raft_consensus.cc:515] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:34.252810  6022 raft_consensus.cc:2749] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:34.114569  5976 consensus_queue.cc:1048] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.123s
I20260709 13:00:34.260555  1720 raft_consensus.cc:2410] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260709 13:00:34.264932  6070 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.462s	user 0.034s	sys 0.062s
I20260709 13:00:34.237720  6147 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:34.273154  2323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:39778 (request call id 21) took 2054 ms. Trace:
W20260709 13:00:34.274163  1571 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36640 (request call id 2312) took 2174 ms (client timeout 1827 ms). Trace:
I20260709 13:00:34.246124  6039 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:34.302776  2323 rpcz_store.cc:276] 0709 13:00:32.218488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.218648 (+   160us) service_pool.cc:224] Handling call
0709 13:00:34.272985 (+2054337us) spinlock_profiling.cc:243] Waited 361 ms on lock 0x7b54002fc1d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23b5853 00007fa9f738360a 00007fa9f09097d4 00007fa9f0909762 00007fa9f0909691 00007fa9f090960c 00007fa9f09088c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:34.273093 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":831169792}
W20260709 13:00:34.303499  1571 rpcz_store.cc:269] 0709 13:00:32.099391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.133523 (+ 34132us) service_pool.cc:224] Handling call
0709 13:00:34.272403 (+2138880us) spinlock_profiling.cc:243] Waited 277 ms on lock 0x7b54003b9054. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:34.274082 (+  1679us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":637911424}
I20260709 13:00:34.164096  5932 raft_consensus.cc:515] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:34.170032  6120 consensus_queue.cc:1059] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.090s
I20260709 13:00:34.258961  6047 raft_consensus.cc:493] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:34.106935  6127 raft_consensus.cc:515] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:34.132014  6033 raft_consensus.cc:515] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:34.272248  5850 consensus_queue.cc:1048] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:00:34.272472  6131 raft_consensus.cc:697] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 11 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:34.289928  6021 leader_election.cc:290] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:34.278038  6119 raft_consensus.cc:493] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:34.274885  5712 raft_consensus.cc:515] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:34.306846  1573 raft_consensus.cc:2468] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 10.
I20260709 13:00:34.245522  5931 raft_consensus.cc:515] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:34.386993  1571 raft_consensus.cc:1240] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 LEADER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
W20260709 13:00:34.290004  6146 log.cc:927] Time spent T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 13:00:34.277179  6041 raft_consensus.cc:697] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 9 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:34.393760  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:34.394917  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:34.265859  6128 raft_consensus.cc:515] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:34.378994  6147 raft_consensus.cc:3060] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:34.244037  6115 raft_consensus.cc:515] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:34.237924  6111 raft_consensus.cc:515] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:34.390913  6047 raft_consensus.cc:3060] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:34.403429  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:34.420812  1573 raft_consensus.cc:2468] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 8.
W20260709 13:00:34.421448  1691 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.406100  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 13:00:34.418509  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 179991us
I20260709 13:00:34.422164  1571 raft_consensus.cc:2393] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 11: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:34.384994  6039 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:34.409051  2323 raft_consensus.cc:2410] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 13:00:34.403790  1575 raft_consensus.cc:1240] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:34.408428  1576 raft_consensus.cc:3060] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:34.396858  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 284040us
I20260709 13:00:34.422994  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:34.426891  1617 leader_election.cc:400] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Vote denied by peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473) with higher term. Message: Invalid argument: T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 10. Current term is 11.
I20260709 13:00:34.426788  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:34.427321  1617 leader_election.cc:403] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:34.428201  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:34.429304  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:00:34.401523  6025 consensus_meta.cc:287] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.760s	user 0.008s	sys 0.004s
I20260709 13:00:34.436856  1573 raft_consensus.cc:1275] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:00:34.431545  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:34.441084  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:34.442306  1689 leader_election.cc:304] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:34.445922  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:34.446995  1571 raft_consensus.cc:1275] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:00:34.407920  6022 raft_consensus.cc:493] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:34.401705  5983 raft_consensus.cc:697] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 8 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:34.423476  5927 raft_consensus.cc:2804] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:34.278651  6036 consensus_queue.cc:237] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:34.453814  6151 raft_consensus.cc:493] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:34.525246  6151 raft_consensus.cc:515] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:34.456085  6160 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:34.529922  5986 leader_election.cc:290] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:34.530211  6157 raft_consensus.cc:493] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:34.424146  6134 leader_election.cc:290] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:34.459862  6033 leader_election.cc:290] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:34.460775  6131 consensus_queue.cc:237] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:34.423804  6070 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:34.421265  5784 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:34.540468  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:00:34.541102  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.541610  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:00:34.542001  1542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.501181  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:34.511278  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:34.509104  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:00:34.501235  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.524199  6042 raft_consensus.cc:697] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 9 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:34.528326  1576 raft_consensus.cc:2468] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 11.
I20260709 13:00:34.458061  6039 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:34.452088  5976 raft_consensus.cc:2749] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:34.405858  6119 raft_consensus.cc:515] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:34.540230  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:34.455523  6127 leader_election.cc:290] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:34.542109  1725 raft_consensus.cc:2468] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 4.
I20260709 13:00:34.543285  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:34.443954  6025 raft_consensus.cc:515] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:34.549772  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:34.551932  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:34.529850  6160 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:34.532889  5986 raft_consensus.cc:493] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:34.555150  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:34.555480  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:34.558017  1573 raft_consensus.cc:1240] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:34.555176  1571 raft_consensus.cc:2376] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 11. Re-sending same reply.
I20260709 13:00:34.559768  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:34.562335  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:00:34.563232  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.563366  1721 raft_consensus.cc:1240] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:34.529981  6151 leader_election.cc:290] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:34.560233  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:34.520881  6022 raft_consensus.cc:515] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:34.564565  1716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 1079) took 3332 ms. Trace:
I20260709 13:00:34.564720  1689 leader_election.cc:304] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:34.551544  6134 raft_consensus.cc:2749] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473) with higher term. Message: Invalid argument: T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 10. Current term is 11.
I20260709 13:00:34.569751  1716 rpcz_store.cc:276] 0709 13:00:31.232685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:31.232908 (+   223us) service_pool.cc:224] Handling call
0709 13:00:31.233245 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:32.514126 (+1280881us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:32.514170 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:32.514227 (+    57us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:32.514279 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:34.564217 (+2049938us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54002aa3d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:34.564277 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:34.564439 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2945085824}
I20260709 13:00:34.571120  1689 leader_election.cc:304] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:34.560658  5926 leader_election.cc:290] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:34.553542  6039 raft_consensus.cc:493] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:34.538838  6157 raft_consensus.cc:515] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:34.550640  5784 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:34.527959  6041 consensus_queue.cc:237] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:34.566244  5986 raft_consensus.cc:515] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:34.576829  6150 log.cc:927] Time spent T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:00:34.553532  6070 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:34.569427  6163 raft_consensus.cc:493] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:34.575927  6121 consensus_meta.cc:287] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.602s	user 0.007s	sys 0.003s
I20260709 13:00:34.574713  5976 raft_consensus.cc:2804] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:34.578018  6151 raft_consensus.cc:2749] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:34.575001  5932 leader_election.cc:290] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:34.596336  6157 leader_election.cc:290] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:34.583160  6039 raft_consensus.cc:515] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:34.639891  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 214723us
W20260709 13:00:34.641300  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:34.593959  5976 raft_consensus.cc:493] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:34.600591  6128 leader_election.cc:290] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:34.642248  1617 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:34.587551  6165 consensus_queue.cc:1048] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260709 13:00:34.642385  1648 consensus_queue.cc:237] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:34.629558  6025 leader_election.cc:290] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:34.629344  6111 leader_election.cc:290] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:34.594451  6121 raft_consensus.cc:515] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:34.574577  5983 consensus_queue.cc:237] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:34.588160  6152 consensus_queue.cc:1048] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:00:34.659122  1716 raft_consensus.cc:1240] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:34.663826  1649 raft_consensus.cc:1240] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:00:34.647783  5976 raft_consensus.cc:3060] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:34.646059  6115 leader_election.cc:290] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:34.593428  6042 consensus_queue.cc:237] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 13:00:34.671095  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:34.663092  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:34.656152  6157 raft_consensus.cc:2804] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:34.664906  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:34.674341  1649 raft_consensus.cc:2468] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8.
I20260709 13:00:34.674718  1646 raft_consensus.cc:1240] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 13:00:34.675143  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:34.675640  1649 raft_consensus.cc:3060] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:34.667274  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:34.676774  1650 raft_consensus.cc:2393] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 11: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:34.661543  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:34.677304  1644 raft_consensus.cc:2468] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 11.
I20260709 13:00:34.678203  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:34.678745  1644 raft_consensus.cc:2468] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8.
I20260709 13:00:34.661710  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:34.665096  1725 raft_consensus.cc:1240] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:34.679358  1615 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:34.680202  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:34.680466  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:34.681687  1651 raft_consensus.cc:2393] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 7: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:34.682968  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:34.603157  6163 raft_consensus.cc:515] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:34.685098  6160 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:34.686110  1642 raft_consensus.cc:3060] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:34.663595  6028 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:34.691075  1615 leader_election.cc:304] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:34.692067  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:34.692675  1646 raft_consensus.cc:3060] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:34.668392  6025 raft_consensus.cc:493] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:34.693512  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:34.695500  1615 leader_election.cc:304] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:34.695916  1650 raft_consensus.cc:3060] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:34.694003  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:00:34.688150  6158 log.cc:927] Time spent T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 13:00:34.701646  1615 leader_election.cc:304] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:34.702729  1615 leader_election.cc:304] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:34.706209  1642 raft_consensus.cc:2468] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 11.
I20260709 13:00:34.712147  1649 raft_consensus.cc:2468] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 13.
I20260709 13:00:34.713761  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:34.714962  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:34.715865  1649 raft_consensus.cc:2410] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:00:34.716593  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:34.718869  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:34.719280  1651 raft_consensus.cc:2468] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 9.
I20260709 13:00:34.717927  1650 raft_consensus.cc:2468] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 11.
I20260709 13:00:34.727288  1725 raft_consensus.cc:1275] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:00:34.729802  1615 leader_election.cc:304] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:34.732600  1646 raft_consensus.cc:2468] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 15.
I20260709 13:00:34.732721  1615 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:34.736848  6022 leader_election.cc:290] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:34.737754  1615 leader_election.cc:304] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:34.710397  6119 leader_election.cc:290] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:34.710052  6134 raft_consensus.cc:2749] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:34.707453  6171 raft_consensus.cc:2749] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:00:34.734550  6128 raft_consensus.cc:2804] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:34.740053  6128 raft_consensus.cc:493] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:34.740764  6128 raft_consensus.cc:3060] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:34.718413  6127 raft_consensus.cc:2749] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:34.702354  6025 raft_consensus.cc:515] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:34.701776  6028 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:34.731330  6001 raft_consensus.cc:3055] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:00:34.734222  6160 raft_consensus.cc:2749] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:34.739207  5986 leader_election.cc:290] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:34.750543  6167 raft_consensus.cc:2749] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:34.759570  5928 raft_consensus.cc:3060] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:34.761461  6070 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:34.761905  6039 leader_election.cc:290] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:34.763077  6171 raft_consensus.cc:2749] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:34.763512  6025 leader_election.cc:290] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:34.783469  6121 leader_election.cc:290] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:34.748246  6134 raft_consensus.cc:2749] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:34.763257  6147 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:34.747773  6001 raft_consensus.cc:740] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:34.788470  1542 leader_election.cc:304] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:34.789831  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 13:00:34.792435  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 54751.8us
I20260709 13:00:34.794574  2323 raft_consensus.cc:2368] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 8. Current term is 9.
I20260709 13:00:34.798425  1615 leader_election.cc:304] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:34.800619  6001 consensus_queue.cc:260] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:34.801924  6001 raft_consensus.cc:3060] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:34.805498  6031 consensus_queue.cc:1048] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:34.806143  6031 consensus_queue.cc:1243] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer 0c7751452c4b46afa95251b9df7169d4 log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:00:34.808043  6028 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:34.808862  6031 consensus_queue.cc:1048] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:34.792143  6025 raft_consensus.cc:2804] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:34.809952  6025 raft_consensus.cc:697] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:34.810572  5927 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:34.811048  5927 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:34.810889  6025 consensus_queue.cc:237] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:34.815193  6055 leader_election.cc:290] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:34.822836  5959 raft_consensus.cc:3060] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:34.883328  5980 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:34.869652  6077 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:34.867959  5644 raft_consensus.cc:3055] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:34.890273  1689 leader_election.cc:304] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:00:34.892983  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 94599.8us
I20260709 13:00:34.894171  1615 leader_election.cc:304] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:34.869814  6003 raft_consensus.cc:493] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:34.897867  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:34.904832  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:34.905678  1725 raft_consensus.cc:2393] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 11: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
W20260709 13:00:34.893705  6174 log.cc:927] Time spent T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.108s	user 0.000s	sys 0.001s
I20260709 13:00:34.909708  1615 leader_election.cc:304] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 13:00:34.872550  6046 leader_election.cc:290] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:34.893095  6039 raft_consensus.cc:2764] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:00:34.893515  5644 raft_consensus.cc:740] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:34.898489  5980 raft_consensus.cc:2749] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:34.952934  1722 raft_consensus.cc:1240] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 9 LEADER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:34.950546  1615 leader_election.cc:304] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 13:00:34.954423  1615 leader_election.cc:400] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Vote denied by peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373) with higher term. Message: Invalid argument: T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 10. Current term is 11.
I20260709 13:00:34.955650  1615 leader_election.cc:304] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:34.963501  1539 leader_election.cc:304] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:34.964664  1539 leader_election.cc:304] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 13:00:34.966777  1689 leader_election.cc:304] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:34.946497  6063 raft_consensus.cc:2804] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:34.885196  6077 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:34.951170  6028 raft_consensus.cc:2804] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:34.969928  1723 raft_consensus.cc:2468] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 9.
I20260709 13:00:34.969529  1539 leader_election.cc:304] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 13:00:34.962266  6177 raft_consensus.cc:2764] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:00:34.975772  1539 leader_election.cc:304] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:34.977669  1539 leader_election.cc:304] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:34.962081  5938 raft_consensus.cc:2804] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:34.909575  6003 raft_consensus.cc:515] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:34.976483  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:34.970742  6041 raft_consensus.cc:2804] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:34.969568  6070 raft_consensus.cc:2804] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:35.003230  6070 raft_consensus.cc:493] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:35.003774  6070 raft_consensus.cc:3060] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:34.962546  6127 consensus_queue.cc:1048] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:00:34.980831  1539 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:34.970392  6063 raft_consensus.cc:493] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:35.012439  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:35.013129  2328 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 11.
W20260709 13:00:35.013902  6185 log.cc:927] Time spent T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
W20260709 13:00:34.994033  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.014132  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:34.973794  6115 raft_consensus.cc:2804] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:35.014744  6115 raft_consensus.cc:493] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:34.971689  6031 consensus_queue.cc:1059] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:00:35.015072  5926 raft_consensus.cc:2804] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:35.015288  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:35.015726  6031 raft_consensus.cc:3055] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:35.015820  5926 raft_consensus.cc:697] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:35.016144  2328 raft_consensus.cc:2393] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 9: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 13:00:35.000483  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:35.022337  1643 raft_consensus.cc:2468] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 13.
I20260709 13:00:35.001784  2324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53290 (request call id 1041) took 1072 ms. Trace:
I20260709 13:00:35.016230  6031 raft_consensus.cc:740] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:34.988114  6033 raft_consensus.cc:2749] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:35.026958  6147 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:00:35.024803  6047 consensus_meta.cc:287] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.586s	user 0.011s	sys 0.011s
I20260709 13:00:34.980693  5938 raft_consensus.cc:493] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:35.012907  6063 raft_consensus.cc:3060] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:35.015148  6115 raft_consensus.cc:3060] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:35.012986  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:35.031023  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:35.031597  1648 raft_consensus.cc:2468] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8.
I20260709 13:00:35.031704  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:35.032330  1716 raft_consensus.cc:3060] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:35.020828  6041 raft_consensus.cc:697] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 11 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:34.973946  6028 raft_consensus.cc:493] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:35.011116  1539 leader_election.cc:304] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:34.992383  6045 raft_consensus.cc:2749] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:35.023795  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:34.979353  5932 raft_consensus.cc:2804] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:35.024299  2324 rpcz_store.cc:276] 0709 13:00:33.929607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.929783 (+   176us) service_pool.cc:224] Handling call
0709 13:00:35.001616 (+1071833us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b54008476d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:35.001724 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29940608}
I20260709 13:00:35.077509  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:35.078497  2324 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a"
dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
mode: GRACEFUL
new_leader_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:39778
I20260709 13:00:35.033635  6028 raft_consensus.cc:3060] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:35.026187  5926 consensus_queue.cc:237] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:35.028877  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:35.029996  5938 raft_consensus.cc:3060] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:35.029762  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.076215  1539 leader_election.cc:304] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:35.092357  1615 leader_election.cc:304] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:35.094082  2328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53306 (request call id 734) took 1006 ms. Trace:
W20260709 13:00:35.095708  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.095634  2328 rpcz_store.cc:276] 0709 13:00:34.088141 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.079966 (+991825us) service_pool.cc:224] Handling call
0709 13:00:35.092522 (+ 12556us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:35.093715 (+  1193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:35.093758 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:35.093803 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:35.093841 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:35.093906 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:35.094026 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1121}
I20260709 13:00:35.091092  2324 raft_consensus.cc:606] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Received request to transfer leadership to TS 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:35.027598  6047 raft_consensus.cc:515] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:35.099287  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 65722.4us
I20260709 13:00:35.100593  6041 consensus_queue.cc:237] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:35.118335  6181 log.cc:927] Time spent T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 13:00:35.101754  1721 raft_consensus.cc:1240] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:35.122195  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:35.122890  1725 raft_consensus.cc:2468] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 11.
I20260709 13:00:35.123548  5938 raft_consensus.cc:515] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:35.124003  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:35.125355  2297 leader_election.cc:304] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
W20260709 13:00:35.102039  6179 log.cc:927] Time spent T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:00:35.102248  6047 leader_election.cc:290] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:35.093393  6171 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.092761  6157 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:35.129684  1539 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 13:00:35.094923  6003 leader_election.cc:290] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:35.098693  6039 raft_consensus.cc:2804] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:35.095019  6033 raft_consensus.cc:2804] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:35.144922  2324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53306 (request call id 737) took 1037 ms. Trace:
I20260709 13:00:35.148710  6039 raft_consensus.cc:493] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:35.148929  6033 raft_consensus.cc:493] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:35.149361  6039 raft_consensus.cc:3060] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:35.149706  6033 raft_consensus.cc:3060] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:35.148968  2324 rpcz_store.cc:276] 0709 13:00:34.107278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.143541 (+1036263us) service_pool.cc:224] Handling call
0709 13:00:35.144057 (+   516us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:35.144354 (+   297us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:35.144401 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:35.144472 (+    71us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:35.144556 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:35.144650 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:35.144837 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:35.151157  2324 raft_consensus.cc:1240] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:35.151770  2324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32870 (request call id 590) took 1042 ms. Trace:
I20260709 13:00:35.152159  2324 rpcz_store.cc:276] 0709 13:00:34.109498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.150694 (+1041196us) service_pool.cc:224] Handling call
0709 13:00:35.150999 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:35.151552 (+   553us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:35.151711 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:35.131650  6171 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:35.117663  6045 raft_consensus.cc:2804] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:35.094910  5932 raft_consensus.cc:493] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
W20260709 13:00:35.187518  1542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.105839  6077 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:35.129663  6147 raft_consensus.cc:2804] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:00:35.196965  6184 log.cc:927] Time spent T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
I20260709 13:00:35.198624  1725 pending_rounds.cc:85] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4: Aborting all ops after (but not including) 8
I20260709 13:00:35.199045  1725 pending_rounds.cc:107] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:00:35.199301  1725 raft_consensus.cc:2889] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:35.200004  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.132671  6157 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:35.205515  1716 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 9.
I20260709 13:00:35.163375  5932 raft_consensus.cc:3060] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:35.213660  6171 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:35.116773  6031 consensus_queue.cc:260] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:35.215854  6031 raft_consensus.cc:3060] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:35.133049  5927 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:35.201593  6147 raft_consensus.cc:493] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:35.161965  6033 raft_consensus.cc:515] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:35.206924  6041 raft_consensus.cc:493] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:35.225033  2328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53306 (request call id 736) took 1133 ms. Trace:
I20260709 13:00:35.208806  6131 raft_consensus.cc:493] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:35.219790  6147 raft_consensus.cc:3060] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:35.229604  2328 rpcz_store.cc:276] 0709 13:00:34.091165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.098018 (+1006853us) service_pool.cc:224] Handling call
0709 13:00:35.098321 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:35.098539 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:00:35.101762 (+  3223us) log.cc:844] Serialized 14 byte log entry
0709 13:00:35.224544 (+122782us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:35.224623 (+    79us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:35.224685 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:35.224775 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:35.224942 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2718,"prepare.queue_time_us":2703,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":2833,"thread_start_us":119508,"threads_started":1}
I20260709 13:00:35.224391  6077 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.216456  6039 raft_consensus.cc:515] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:35.253378  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 118362us
W20260709 13:00:35.246883  6128 consensus_meta.cc:287] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.506s	user 0.011s	sys 0.011s
I20260709 13:00:35.256642  2328 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260"
dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
mode: GRACEFUL
new_leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:39778
I20260709 13:00:35.257560  2328 raft_consensus.cc:606] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 LEADER]: Received request to transfer leadership to TS 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:35.255457  1539 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:35.259452  1539 leader_election.cc:304] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:35.234711  6131 raft_consensus.cc:515] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:35.232611  6041 raft_consensus.cc:515] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:35.280596  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.234543  6070 raft_consensus.cc:515] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:35.287156  2326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f964296f18474862b1eee102af9116f4"
dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
mode: GRACEFUL
new_leader_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:39778
W20260709 13:00:35.290095  6190 log.cc:927] Time spent T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:00:35.293731  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 1103) took 1189 ms. Trace:
W20260709 13:00:35.294471  2331 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32870 (request call id 586) took 1462 ms (client timeout 1835 ms). Trace:
I20260709 13:00:35.297308  5946 raft_consensus.cc:493] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.297973  1723 raft_consensus.cc:1240] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 7. Current term is 9. Ops: []
I20260709 13:00:35.302191  5934 leader_election.cc:290] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:35.306110  6056 raft_consensus.cc:2804] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:00:35.309171  6189 log.cc:927] Time spent T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:00:35.309815  6197 raft_consensus.cc:2804] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:35.314062  6117 leader_election.cc:290] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:35.315202  1724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2397) took 1248 ms. Trace:
W20260709 13:00:35.317986  6169 log.cc:927] Time spent T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.623s	user 0.002s	sys 0.000s
W20260709 13:00:35.331279  2331 rpcz_store.cc:269] 0709 13:00:33.831677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.831938 (+   261us) service_pool.cc:224] Handling call
0709 13:00:35.294279 (+1462341us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b540069c154. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:35.294415 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":300718336}
W20260709 13:00:35.332021  1615 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.334416  1643 raft_consensus.cc:1240] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:35.325832  2326 raft_consensus.cc:606] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Received request to transfer leadership to TS 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:35.255975  6077 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:35.330003  1717 rpcz_store.cc:276] 0709 13:00:34.104587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.104720 (+   133us) service_pool.cc:224] Handling call
0709 13:00:34.105018 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:34.279128 (+174110us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:34.279161 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:34.279205 (+    44us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:34.279245 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:35.293483 (+1014238us) spinlock_profiling.cc:243] Waited 174 ms on lock 0x7b540012f2d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:35.293529 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:35.293661 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":399929728}
I20260709 13:00:35.370839  1649 raft_consensus.cc:1275] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:00:35.362527  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 103222us
W20260709 13:00:35.405833  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.390901  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:35.407164  1648 raft_consensus.cc:2468] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 8.
I20260709 13:00:35.391400  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:35.260478  6128 raft_consensus.cc:515] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:35.393277  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:35.388309  1724 rpcz_store.cc:276] 0709 13:00:34.066302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.066986 (+   684us) service_pool.cc:224] Handling call
0709 13:00:35.315017 (+1248031us) spinlock_profiling.cc:243] Waited 31.9 ms on lock 0x7b540007f154. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:35.315135 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":73268608}
I20260709 13:00:35.409026  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:35.395521  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:35.409060  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:35.412022  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:35.413285  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:35.414816  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:35.387957  6037 raft_consensus.cc:493] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.416903  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:35.410169  1617 leader_election.cc:304] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:35.417861  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:35.418902  1649 raft_consensus.cc:2393] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 11: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:35.420073  1649 raft_consensus.cc:1240] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:35.423681  1649 raft_consensus.cc:1275] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:00:35.424095  1649 pending_rounds.cc:85] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e: Aborting all ops after (but not including) 7
I20260709 13:00:35.424366  1649 pending_rounds.cc:107] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:00:35.277077  6159 raft_consensus.cc:2804] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:35.338565  5973 raft_consensus.cc:493] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:35.437599  6159 raft_consensus.cc:697] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:35.437685  5973 raft_consensus.cc:515] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:35.438573  6159 consensus_queue.cc:237] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:35.438946  6028 raft_consensus.cc:515] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:35.439859  5973 leader_election.cc:290] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:35.441417  6124 raft_consensus.cc:3055] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:35.441843  6124 raft_consensus.cc:740] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:35.442746  6124 consensus_queue.cc:260] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:35.355530  5946 raft_consensus.cc:515] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:35.460347  2328 raft_consensus.cc:1240] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:35.461429  2329 raft_consensus.cc:1275] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:00:35.466125  6028 leader_election.cc:290] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:35.425453  1649 raft_consensus.cc:2889] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:35.342056  6171 raft_consensus.cc:493] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:35.424657  6037 raft_consensus.cc:515] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:35.430660  5948 raft_consensus.cc:993] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66: : Instructing follower 0c7751452c4b46afa95251b9df7169d4 to start an election
W20260709 13:00:35.435607  5928 consensus_meta.cc:287] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.655s	user 0.016s	sys 0.006s
I20260709 13:00:35.361814  6056 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:35.385869  6186 consensus_queue.cc:1059] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.100s
I20260709 13:00:35.319896  5644 consensus_queue.cc:260] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:35.547885  5644 raft_consensus.cc:3060] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:35.549046  6128 leader_election.cc:290] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:35.550216  6070 leader_election.cc:290] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:35.550983  6186 raft_consensus.cc:3055] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:00:35.446957  5976 consensus_meta.cc:287] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.768s	user 0.012s	sys 0.000s
W20260709 13:00:35.550925  6134 consensus_queue.cc:1175] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0c7751452c4b46afa95251b9df7169d4" responder_term: 9 status { last_received { term: 7 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 7. Current term is 9. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:00:35.551955  5976 raft_consensus.cc:515] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:35.554718  5976 leader_election.cc:290] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:35.556160  5784 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:35.557236  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:35.561829  1650 raft_consensus.cc:2376] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 11. Re-sending same reply.
I20260709 13:00:35.445209  1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2398) took 1378 ms. Trace:
I20260709 13:00:35.562530  1720 rpcz_store.cc:276] 0709 13:00:34.066605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.066717 (+   112us) service_pool.cc:224] Handling call
0709 13:00:35.445021 (+1378304us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b54000e2254. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:35.445158 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":389392640}
I20260709 13:00:35.447886  5931 leader_election.cc:290] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:35.565582  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:35.567101  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:35.567867  1650 raft_consensus.cc:2393] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 13: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:35.452929  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:35.568809  1648 raft_consensus.cc:2468] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 9.
I20260709 13:00:35.568632  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:35.571152  1648 raft_consensus.cc:1240] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:35.453315  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:35.573582  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:35.338848  6127 raft_consensus.cc:493] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:35.450870  6194 log.cc:927] Time spent T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
I20260709 13:00:35.445650  6039 leader_election.cc:290] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 15 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:35.420892  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 13:00:35.455834  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 52773.5us
I20260709 13:00:35.464926  6115 raft_consensus.cc:515] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:35.581001  1571 raft_consensus.cc:1240] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:00:35.582024  6115 leader_election.cc:290] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:35.582986   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:00:35.387727  6197 raft_consensus.cc:493] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:35.585063  6197 raft_consensus.cc:3060] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:35.420840  5938 leader_election.cc:290] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:35.472637  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:35.589143  1649 raft_consensus.cc:2468] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 9.
I20260709 13:00:35.589988  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:35.590668  1649 raft_consensus.cc:2393] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 12: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:35.591385  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:35.591229  6157 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:35.436910  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:35.473719  6171 raft_consensus.cc:515] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:35.530830  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:35.593240  1568 raft_consensus.cc:2393] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 10: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:35.593303  1649 raft_consensus.cc:1275] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:00:35.594228  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:35.594823  1568 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 11.
I20260709 13:00:35.532356  6002 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:35.596330  1649 raft_consensus.cc:1275] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:00:35.526886  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 13:00:35.533334  6192 log.cc:927] Time spent T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:00:35.536595  6056 raft_consensus.cc:3060] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:35.599087  6127 raft_consensus.cc:515] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:35.601408  6127 leader_election.cc:290] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:35.538111  6024 raft_consensus.cc:493] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:35.601873  1648 raft_consensus.cc:3055] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:35.602334  1648 raft_consensus.cc:740] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:35.602174  6024 raft_consensus.cc:515] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:35.538702  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:35.540127  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:35.602777  1650 raft_consensus.cc:2468] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 13.
W20260709 13:00:35.541697  2325 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32870 (request call id 582) took 1742 ms (client timeout 1719 ms). Trace:
I20260709 13:00:35.603276  1572 raft_consensus.cc:3060] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:35.603157  1648 consensus_queue.cc:260] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:35.603619  2325 rpcz_store.cc:269] 0709 13:00:33.799667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:33.799792 (+   125us) service_pool.cc:224] Handling call
0709 13:00:35.540304 (+1740512us) spinlock_profiling.cc:243] Waited 90 ms on lock 0x7b54006202d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:35.541627 (+  1323us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":206912896}
I20260709 13:00:35.604247  1648 raft_consensus.cc:3060] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:35.605176  5927 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:35.542508  6053 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:35.542605  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:35.608786  1645 raft_consensus.cc:1275] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:00:35.609134  6024 leader_election.cc:290] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:35.470854  6028 raft_consensus.cc:2804] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:35.610031  6028 raft_consensus.cc:493] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:35.610149  6131 leader_election.cc:290] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:35.610464  6028 raft_consensus.cc:3060] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:00:35.543213  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.613692  6037 leader_election.cc:290] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:35.543367  1722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2408) took 1430 ms. Trace:
I20260709 13:00:35.615641  1722 rpcz_store.cc:276] 0709 13:00:34.113299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.113436 (+   137us) service_pool.cc:224] Handling call
0709 13:00:34.113689 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:34.953361 (+839672us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:35.543166 (+589805us) spinlock_profiling.cc:243] Waited 839 ms on lock 0x7b54002346d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:35.543316 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1929609600}
W20260709 13:00:35.543529  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 133485us
I20260709 13:00:35.543675  6129 raft_consensus.cc:1081] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Signalling peer 0c7751452c4b46afa95251b9df7169d4 to start an election
I20260709 13:00:35.544435  6154 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:35.389459  6177 consensus_queue.cc:1048] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.082s
I20260709 13:00:35.551483  6186 raft_consensus.cc:740] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
W20260709 13:00:35.560178  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.629050  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:35.449694  6033 leader_election.cc:290] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:35.560676  1723 raft_consensus.cc:1240] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 8. Current term is 9. Ops: []
W20260709 13:00:35.491379  6187 log.cc:927] Time spent T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.414s	user 0.003s	sys 0.000s
I20260709 13:00:35.521313  6124 raft_consensus.cc:3060] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:35.602836  2328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32870 (request call id 592) took 1492 ms. Trace:
I20260709 13:00:35.601897  6002 raft_consensus.cc:993] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66: : Instructing follower 0c7751452c4b46afa95251b9df7169d4 to start an election
I20260709 13:00:35.615106  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:35.632681  2328 rpcz_store.cc:276] 0709 13:00:34.110641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.278825 (+1168184us) service_pool.cc:224] Handling call
0709 13:00:35.279737 (+   912us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:35.460834 (+181097us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:35.602598 (+141764us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b54004f1fd4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:35.602783 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":414760192}
I20260709 13:00:35.640424  1648 raft_consensus.cc:1275] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:00:35.640656  2328 raft_consensus.cc:1240] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:35.542104  6077 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:35.623574  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:35.624109  1617 leader_election.cc:304] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:35.650872  1724 raft_consensus.cc:2468] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 12.
I20260709 13:00:35.651749  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:35.652753  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:35.653373  1724 raft_consensus.cc:2410] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:00:35.608786  5712 leader_election.cc:290] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:35.626473  1568 raft_consensus.cc:1240] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:35.624867  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 13:00:35.629398  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.636384  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:35.640861  1648 pending_rounds.cc:85] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e: Aborting all ops after (but not including) 8
I20260709 13:00:35.621371  1572 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 9.
W20260709 13:00:35.649335  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.624960  6045 raft_consensus.cc:697] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:35.618631  1542 leader_election.cc:304] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:35.625635  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:00:35.629884  6063 consensus_meta.cc:287] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.554s	user 0.007s	sys 0.003s
I20260709 13:00:35.655836  6038 raft_consensus.cc:493] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.656195  5959 raft_consensus.cc:1081] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Signalling peer 0c7751452c4b46afa95251b9df7169d4 to start an election
I20260709 13:00:35.655980  6186 consensus_queue.cc:260] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:35.659051  1719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1847) took 1117 ms. Trace:
I20260709 13:00:35.660220  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:35.653697  5983 consensus_queue.cc:1059] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 13:00:35.663020  6171 leader_election.cc:290] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:35.633028  6131 consensus_queue.cc:1059] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:00:35.665827  2329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53306 (request call id 729) took 3663 ms. Trace:
I20260709 13:00:35.668973  2328 raft_consensus.cc:1275] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:00:35.670019  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.690408  2329 rpcz_store.cc:276] 0709 13:00:32.002918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:32.003092 (+   174us) service_pool.cc:224] Handling call
0709 13:00:32.020751 (+ 17659us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:35.461833 (+3441082us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:35.665612 (+203779us) spinlock_profiling.cc:243] Waited 3.44 s on lock 0x7b54005aaad4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:35.665769 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7911980800}
I20260709 13:00:35.670673  1717 raft_consensus.cc:2468] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 7.
I20260709 13:00:35.669109  1648 pending_rounds.cc:107] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:00:35.666340  6160 raft_consensus.cc:2749] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:35.672890  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:00:35.683648  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 98471.1us
I20260709 13:00:35.684548  1576 raft_consensus.cc:1240] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 LEADER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:35.674036  1722 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a"
dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:58782
I20260709 13:00:35.696345  1722 raft_consensus.cc:493] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:35.696744  1722 raft_consensus.cc:3060] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:35.661907  6197 raft_consensus.cc:515] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:35.692191  1648 raft_consensus.cc:2889] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:35.672303  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 53757us
I20260709 13:00:35.700667  1542 leader_election.cc:304] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 13:00:35.666260  6041 leader_election.cc:290] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:35.688290  1719 rpcz_store.cc:276] 0709 13:00:34.541281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.568182 (+ 26901us) service_pool.cc:224] Handling call
0709 13:00:34.568362 (+   180us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:34.568500 (+   138us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:00:34.577268 (+  8768us) log.cc:844] Serialized 14 byte log entry
0709 13:00:35.317478 (+740210us) spinlock_profiling.cc:243] Waited 6.75 ms on lock 0x7b4400022b4c. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef1f4c85 00007fa9ef1f56a2 00007fa9f1f671db 00007fa9f1f62aaf 00007fa9f1f5686e 00007fa9f1f55bb6 00007fa9f1f557d8 00007fa9f1f5f221 00007fa9f1f5f1d9 00007fa9f1f5f169
0709 13:00:35.658517 (+341039us) spinlock_profiling.cc:243] Waited 4.44 ms on lock 0x7b18003c6b80. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9f1f634bc 00007fa9ef2b148b 00007fa9f810bab9 00007fa9ef2cd69b 00007fa9ef2cb93f 00007fa9ef2cb455 00007fa9f23b3060 00007fa9f23c5716 00007fa9f23d6287
0709 13:00:35.658700 (+   183us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:35.658752 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:35.658805 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:35.658882 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:35.658995 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":5624,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":47150,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":5457,"spinlock_wait_cycles":25742976,"thread_start_us":69935,"threads_started":2,"wal-append.queue_time_us":86399}
I20260709 13:00:35.571066  5932 raft_consensus.cc:515] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:35.682127  5712 raft_consensus.cc:2749] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:35.629421  6154 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:35.703629  1542 leader_election.cc:304] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:35.733624  1651 raft_consensus.cc:2410] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:00:35.734201  5712 raft_consensus.cc:2749] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:35.734288  1542 leader_election.cc:304] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:35.687412  6038 raft_consensus.cc:515] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:35.735518  1542 leader_election.cc:304] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
W20260709 13:00:35.736371  6156 log.cc:927] Time spent T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 1.311s	user 0.000s	sys 0.008s
I20260709 13:00:35.736938  6038 leader_election.cc:290] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:35.737061  1573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36642 (request call id 2500) took 1333 ms. Trace:
I20260709 13:00:35.705713  6131 consensus_queue.cc:1048] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:35.737499  1573 rpcz_store.cc:276] 0709 13:00:34.403765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.439594 (+ 35829us) service_pool.cc:224] Handling call
0709 13:00:34.439855 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:34.562075 (+122220us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:35.736818 (+1174743us) spinlock_profiling.cc:243] Waited 118 ms on lock 0x7b54002eccd4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:35.737003 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":271325056}
I20260709 13:00:35.740057  6024 raft_consensus.cc:3060] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:35.742566  1542 leader_election.cc:304] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:35.742703  6028 raft_consensus.cc:515] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:35.743383  6033 raft_consensus.cc:2749] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:35.744158  6033 raft_consensus.cc:493] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.706370  6162 raft_consensus.cc:3055] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:35.744699  6162 raft_consensus.cc:740] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:35.744604  6033 raft_consensus.cc:515] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:35.727778  6056 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:35.745898  1570 raft_consensus.cc:1240] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:35.745679  6162 consensus_queue.cc:260] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:35.746774  6033 leader_election.cc:290] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:35.746935  6162 raft_consensus.cc:3060] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:35.685523  6063 raft_consensus.cc:515] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:35.748656  6033 raft_consensus.cc:493] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.748971  6063 leader_election.cc:290] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:35.711009  2294 leader_election.cc:304] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:35.749105  6033 raft_consensus.cc:515] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:35.707326  6047 consensus_queue.cc:1048] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:35.751230  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:35.751461  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:35.752125  2330 raft_consensus.cc:2393] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 9: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 13:00:35.752357  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:35.752605  1646 raft_consensus.cc:1240] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:35.711431  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:00:35.714484  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.753473  1647 raft_consensus.cc:2393] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 15: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:35.718170  1644 raft_consensus.cc:2468] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 11.
I20260709 13:00:35.718580  1574 raft_consensus.cc:1240] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:35.754462  5959 raft_consensus.cc:3060] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:00:35.754842  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:35.712539  6147 raft_consensus.cc:515] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:35.731243  6045 consensus_queue.cc:237] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:35.758715  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:35.732064  6186 raft_consensus.cc:3060] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:35.759485  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 1885) took 1097 ms. Trace:
I20260709 13:00:35.759848  1642 rpcz_store.cc:276] 0709 13:00:34.661898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.662005 (+   107us) service_pool.cc:224] Handling call
0709 13:00:35.759344 (+1097339us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b54001d9054. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:35.759433 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32877952}
I20260709 13:00:35.704676  5948 raft_consensus.cc:493] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.760655  2295 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:35.760825  5948 raft_consensus.cc:515] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:35.761953  1719 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f964296f18474862b1eee102af9116f4"
dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:58782
I20260709 13:00:35.762395  6147 leader_election.cc:290] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:35.762722  2324 raft_consensus.cc:1240] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:35.762836  5948 leader_election.cc:290] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:35.744987  6132 raft_consensus.cc:2749] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:35.764748  6129 consensus_queue.cc:1059] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:00:35.765638  6129 raft_consensus.cc:2804] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:35.766103  5803 consensus_queue.cc:1059] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:00:35.766254  6066 consensus_queue.cc:1059] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:35.767094  5803 raft_consensus.cc:3055] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:35.767455  5803 raft_consensus.cc:740] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:35.768003  6066 raft_consensus.cc:3055] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:35.768375  6066 raft_consensus.cc:740] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:35.768676  6002 raft_consensus.cc:3055] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:35.769057  6002 raft_consensus.cc:740] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:35.769202  1724 raft_consensus.cc:1275] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:00:35.766098  6129 raft_consensus.cc:697] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:35.769829  6002 consensus_queue.cc:260] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:35.771600  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:35.772277  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:35.719671  5932 leader_election.cc:290] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:35.773602  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:35.752161  2294 leader_election.cc:304] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:35.774222  2330 raft_consensus.cc:1240] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:35.762459  1719 raft_consensus.cc:493] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:35.775204  1719 raft_consensus.cc:3060] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:35.773550  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:35.770979  6002 raft_consensus.cc:3060] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:35.777148  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:35.777236  1542 leader_election.cc:304] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:35.778213  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:35.752604  1722 raft_consensus.cc:515] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:35.780452  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:35.781785  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:35.759867  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:35.785985  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:35.786859  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:35.789754  1615 leader_election.cc:304] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:35.790261  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:35.791158  1615 leader_election.cc:304] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:35.787820  1542 leader_election.cc:304] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:35.799098  2297 leader_election.cc:304] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:35.772992  6035 raft_consensus.cc:3060] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:35.818477  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:35.819087  2329 raft_consensus.cc:3060] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:35.819392  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:35.820688  5926 consensus_queue.cc:1059] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:35.822232  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:35.770404  6129 consensus_queue.cc:237] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:35.771492  6159 raft_consensus.cc:2804] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:00:35.826215  1719 raft_consensus.cc:515] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:35.813301  6079 consensus_queue.cc:1059] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:35.814558  5932 raft_consensus.cc:2804] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:35.815332  5937 raft_consensus.cc:2749] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:35.796762  6132 raft_consensus.cc:2749] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:35.797199  6063 raft_consensus.cc:493] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.797422  6138 raft_consensus.cc:2749] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:00:35.798251  5948 raft_consensus.cc:2749] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:35.828073  1569 raft_consensus.cc:2468] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 9.
I20260709 13:00:35.828842  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:35.751049  6033 leader_election.cc:290] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:35.828603  1542 leader_election.cc:304] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:35.827329  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:35.850194  1571 raft_consensus.cc:2468] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 12.
I20260709 13:00:35.768204  5803 consensus_queue.cc:260] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:35.821775  5926 raft_consensus.cc:3055] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:35.779721  6180 consensus_queue.cc:1048] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:00:35.838549  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:00:35.845510  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 54408.6us
I20260709 13:00:35.845777  1725 raft_consensus.cc:1240] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:35.834272  6159 raft_consensus.cc:493] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:35.850461  1542 leader_election.cc:304] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:35.836380  6028 leader_election.cc:290] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:35.856492  1542 leader_election.cc:304] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:35.857928  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:35.858762  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:35.769227  6066 consensus_queue.cc:260] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:35.861768  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:35.865011  1573 raft_consensus.cc:2468] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 8.
I20260709 13:00:35.835825  5932 raft_consensus.cc:493] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:35.855116  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:35.871587  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:35.871840  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:35.872962  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:35.846854  5644 raft_consensus.cc:2749] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:35.854280  6132 raft_consensus.cc:2804] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:35.861459  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:35.844805  6063 raft_consensus.cc:515] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:35.862740  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:35.862880  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:35.861194  6159 raft_consensus.cc:3060] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:35.874621  6044 raft_consensus.cc:2804] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:35.851408  5926 raft_consensus.cc:740] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:35.859288  1719 leader_election.cc:290] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:35.884092  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:35.895915  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:35.853428  1615 leader_election.cc:304] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:35.873819  5932 raft_consensus.cc:3060] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:35.868650  6025 raft_consensus.cc:2749] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:35.886992  1568 raft_consensus.cc:2468] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 13.
I20260709 13:00:35.899158  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:35.900087  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:35.883105  6132 raft_consensus.cc:493] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:35.880756  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:35.878451  5803 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:35.893373  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
W20260709 13:00:35.896649  2295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:35.900839  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 47477.7us
I20260709 13:00:35.902201  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 2319) took 1872 ms. Trace:
I20260709 13:00:35.888163  1645 raft_consensus.cc:1275] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:00:35.877966  6147 consensus_queue.cc:1059] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 13:00:35.914265  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:35.910122  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:35.914793  1575 raft_consensus.cc:3060] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:35.885149  6036 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.358s	user 0.021s	sys 0.038s
I20260709 13:00:35.887204  6066 raft_consensus.cc:3060] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:35.905170  5644 raft_consensus.cc:2749] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:35.890147  6044 raft_consensus.cc:493] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:35.940841  6063 leader_election.cc:290] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:35.918848  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:35.940860  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:35.941850  1570 raft_consensus.cc:2393] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 10: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:35.942615  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:35.943624  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:35.944173  1570 raft_consensus.cc:2468] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 12.
I20260709 13:00:35.912564  1567 rpcz_store.cc:276] 0709 13:00:34.029792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.029894 (+   102us) service_pool.cc:224] Handling call
0709 13:00:34.030148 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:35.541653 (+1511505us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:35.541683 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:35.541720 (+    37us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:35.541753 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:35.900654 (+358901us) spinlock_profiling.cc:243] Waited 1.51 s on lock 0x7b5400244d54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:35.902053 (+  1399us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:35.902161 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1636,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":92,"spinlock_wait_cycles":3475439360}
I20260709 13:00:35.944821  2324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32870 (request call id 591) took 1834 ms. Trace:
W20260709 13:00:35.933763  6211 log.cc:927] Time spent T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
W20260709 13:00:35.937131  6206 log.cc:927] Time spent T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:00:35.939011  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:35.939307  5946 leader_election.cc:290] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:35.945385  1567 raft_consensus.cc:1275] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:00:35.963675  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:35.945214  2324 rpcz_store.cc:276] 0709 13:00:34.110386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.152952 (+1042566us) service_pool.cc:224] Handling call
0709 13:00:35.153216 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:35.763190 (+609974us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:35.931656 (+168466us) spinlock_profiling.cc:243] Waited 609 ms on lock 0x7b54002fc1d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:35.944759 (+ 13103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1401310464}
W20260709 13:00:35.919507  6036 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.392s	user 0.021s	sys 0.038s
I20260709 13:00:35.912233  6132 raft_consensus.cc:3060] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:35.952243  1575 raft_consensus.cc:2468] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 9.
I20260709 13:00:35.967235  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:35.968499  1575 raft_consensus.cc:1275] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:00:35.967118  1567 raft_consensus.cc:2393] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 14: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:35.956983  5926 consensus_queue.cc:260] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:35.970261  6215 log.cc:927] Time spent T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:00:35.970304  5926 raft_consensus.cc:3060] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:35.961792  2329 raft_consensus.cc:2468] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 10.
I20260709 13:00:35.980734  6163 leader_election.cc:290] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:35.982090  1575 raft_consensus.cc:1275] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:00:35.923893  6056 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:35.924886  6033 raft_consensus.cc:493] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:35.989315  1575 raft_consensus.cc:1240] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:35.958443  6044 raft_consensus.cc:3060] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:35.991393  6033 raft_consensus.cc:515] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 13:00:35.963073  6197 leader_election.cc:290] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:00:36.004772  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.011032  5959 raft_consensus.cc:2749] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:36.016577  1615 leader_election.cc:304] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:00:36.017910  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.018508  1615 leader_election.cc:304] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:36.029043  1615 leader_election.cc:304] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:36.024700  1540 leader_election.cc:304] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:36.031036  2332 raft_consensus.cc:2468] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 14.
I20260709 13:00:36.034330  1615 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:36.037400  1615 leader_election.cc:304] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:35.995231  6024 raft_consensus.cc:2749] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:36.047660  1567 raft_consensus.cc:1275] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:00:36.050158  6197 raft_consensus.cc:2749] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:36.051102  1540 leader_election.cc:304] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:36.056407  6031 raft_consensus.cc:2749] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:00:36.058447  2323 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53306 (request call id 744) took 1796 ms (client timeout 2039 ms). Trace:
W20260709 13:00:36.059005  2323 rpcz_store.cc:269] 0709 13:00:34.262259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.560066 (+297807us) service_pool.cc:224] Handling call
0709 13:00:36.058186 (+1498120us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b5400867754. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:36.058372 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":520691584}
I20260709 13:00:36.064812  6159 raft_consensus.cc:515] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:36.067027  6159 leader_election.cc:290] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:36.033170  6163 raft_consensus.cc:2749] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:36.041338  5644 raft_consensus.cc:2749] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:36.073711  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:36.061828  1615 leader_election.cc:304] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:36.045652  6180 raft_consensus.cc:2804] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:36.075112  1615 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:36.046958  6063 raft_consensus.cc:3060] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:36.070470  1571 raft_consensus.cc:2393] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 5: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:36.080036  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:36.076517  1615 leader_election.cc:304] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:36.074342  1649 raft_consensus.cc:2468] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 13.
I20260709 13:00:36.081924  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:36.082494  1649 raft_consensus.cc:2376] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 11. Re-sending same reply.
I20260709 13:00:36.083143  1615 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:36.083490  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:36.056349  5932 raft_consensus.cc:515] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:36.085632  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:36.076152  1688 leader_election.cc:304] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 13:00:36.089952  1573 raft_consensus.cc:2376] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 10. Re-sending same reply.
I20260709 13:00:36.090865  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:36.091790  1573 raft_consensus.cc:2393] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 14: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:36.090730  1688 leader_election.cc:304] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:36.097708  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:36.097996  6063 raft_consensus.cc:2749] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:36.098301  1576 raft_consensus.cc:3060] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:36.101775  5976 raft_consensus.cc:3055] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:36.102223  5976 raft_consensus.cc:740] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:36.107146  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:36.107969  1567 raft_consensus.cc:2368] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 9. Current term is 10.
I20260709 13:00:36.120141  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:36.120956  1642 raft_consensus.cc:3060] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:36.129488  5942 raft_consensus.cc:3055] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:36.129972  5942 raft_consensus.cc:740] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:36.132208  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:36.133500  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:36.135066  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:36.135596  1650 raft_consensus.cc:3060] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:36.137269  5949 raft_consensus.cc:3055] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:36.137701  5949 raft_consensus.cc:740] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:36.138974  5949 consensus_queue.cc:260] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:36.145128  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:36.155961  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:36.079193  6186 raft_consensus.cc:2749] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:36.157261  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 1899) took 1484 ms. Trace:
I20260709 13:00:36.169158  1569 raft_consensus.cc:2410] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:00:36.169274  1644 rpcz_store.cc:276] 0709 13:00:34.673243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.697833 (+ 24590us) service_pool.cc:224] Handling call
0709 13:00:36.157096 (+1459263us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b5400098dd4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:36.157205 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2308505344}
I20260709 13:00:36.151671  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:36.170508  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:36.170711  1648 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:36.171298  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:36.172454  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:36.170933  6024 raft_consensus.cc:493] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.173401  1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1842) took 1633 ms. Trace:
I20260709 13:00:36.173331  6024 raft_consensus.cc:515] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:36.161237  1722 leader_election.cc:290] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:36.177297  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:36.177945  1645 raft_consensus.cc:3060] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:36.186586  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:36.187449   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:36.086473  1649 raft_consensus.cc:3060] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:36.193567  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:36.195015  1567 raft_consensus.cc:2393] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 9: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:36.201129  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:36.201869  1573 raft_consensus.cc:3060] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:36.103055  5976 consensus_queue.cc:260] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:36.206772  5976 raft_consensus.cc:3060] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:36.222466  1644 raft_consensus.cc:2393] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 9: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:36.248150  5942 consensus_queue.cc:260] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:36.249867  5942 raft_consensus.cc:3060] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:36.250999  6024 leader_election.cc:290] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:36.254279  1570 raft_consensus.cc:1240] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:36.260070  6154 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:36.258630  1569 raft_consensus.cc:1240] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 13:00:36.268301  5949 raft_consensus.cc:3060] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:36.173898  1718 rpcz_store.cc:276] 0709 13:00:34.539539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.539674 (+   135us) service_pool.cc:224] Handling call
0709 13:00:35.448288 (+908614us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:35.448499 (+   211us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:35.670398 (+221899us) log.cc:844] Serialized 14 byte log entry
0709 13:00:35.851556 (+181158us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:35.851603 (+    47us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:35.851648 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:35.851706 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:36.173220 (+321514us) spinlock_profiling.cc:243] Waited 908 ms on lock 0x7b54000e2250. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23ba8ad 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:36.173345 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":369506,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":24,"raft.queue_time_us":2422,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":10016,"spinlock_wait_cycles":2088932736,"thread_start_us":402065,"threads_started":2,"wal-append.queue_time_us":249373}
I20260709 13:00:36.275578  1648 raft_consensus.cc:2468] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 14.
W20260709 13:00:36.277325  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.278415  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:36.147694  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:36.280130  1648 raft_consensus.cc:2468] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 9.
I20260709 13:00:36.282215  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:36.283967  1648 raft_consensus.cc:2393] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 15: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:36.286247  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:36.287742  1648 raft_consensus.cc:2468] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 10.
I20260709 13:00:36.290122  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:00:36.292395  1691 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.280164  1651 raft_consensus.cc:3060] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:36.225591  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:36.317646  1642 raft_consensus.cc:2468] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 10.
I20260709 13:00:36.318586  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:36.406703  1644 raft_consensus.cc:2468] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 11.
W20260709 13:00:36.357597  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 274469us
I20260709 13:00:36.408833  2326 raft_consensus.cc:1240] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 7. Current term is 9. Ops: []
W20260709 13:00:36.397469  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 306799us
I20260709 13:00:36.411760  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:36.414320  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:36.395215  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:36.412261  1688 leader_election.cc:304] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:36.419803  1645 raft_consensus.cc:2410] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 13:00:36.420389  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:36.420409  1648 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 11.
I20260709 13:00:36.421244  1642 raft_consensus.cc:3060] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:36.408207  1539 leader_election.cc:304] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:36.424543  1539 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:36.425428  1539 leader_election.cc:304] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:36.425963  6154 raft_consensus.cc:2804] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:36.426426  6154 raft_consensus.cc:493] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:36.426995  6154 raft_consensus.cc:3060] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:36.427122  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:36.428006  1569 raft_consensus.cc:2393] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 7: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:36.428905  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:36.397339  5934 raft_consensus.cc:2749] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:36.430492  5934 raft_consensus.cc:2749] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:36.431219  6045 raft_consensus.cc:2804] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:36.431799  6045 raft_consensus.cc:697] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:36.432740  6197 raft_consensus.cc:2804] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:00:36.433051  6214 log.cc:927] Time spent T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.436s	user 0.000s	sys 0.000s
I20260709 13:00:36.433344  6197 raft_consensus.cc:697] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
W20260709 13:00:36.434130  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 468303us
I20260709 13:00:36.434383  6197 consensus_queue.cc:237] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:36.079661  6180 raft_consensus.cc:493] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:36.436745  6180 raft_consensus.cc:3060] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:36.432773  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.069021  6205 raft_consensus.cc:2749] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:00:36.439005  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.086043  6134 raft_consensus.cc:2749] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:36.426326  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:36.458498  1570 raft_consensus.cc:2468] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 12.
W20260709 13:00:36.398162  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 134029us
I20260709 13:00:36.444585  1576 raft_consensus.cc:2468] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 12.
I20260709 13:00:36.446789  1649 raft_consensus.cc:2468] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 12.
W20260709 13:00:36.398025  6218 log.cc:927] Time spent T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.411s	user 0.000s	sys 0.001s
I20260709 13:00:36.087342  6038 consensus_queue.cc:1059] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.379s
I20260709 13:00:36.467208  6038 raft_consensus.cc:3055] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:36.467593  6038 raft_consensus.cc:740] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:36.468381  6038 consensus_queue.cc:260] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:36.469653  6038 raft_consensus.cc:3060] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:36.469906  6001 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.470427  6001 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:36.473664  6002 consensus_meta.cc:287] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.694s	user 0.009s	sys 0.000s
I20260709 13:00:36.396663  6162 raft_consensus.cc:2804] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:36.474403  6162 raft_consensus.cc:493] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:36.474440  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
W20260709 13:00:36.475106  6066 consensus_meta.cc:287] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.533s	user 0.005s	sys 0.005s
I20260709 13:00:36.475173  2330 raft_consensus.cc:3055] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:36.475699  2330 raft_consensus.cc:740] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:36.476054  2331 raft_consensus.cc:2468] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 14.
W20260709 13:00:36.409957  6035 consensus_meta.cc:287] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.591s	user 0.009s	sys 0.000s
I20260709 13:00:36.477173  1572 raft_consensus.cc:2468] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 13.
I20260709 13:00:36.459203  5926 consensus_queue.cc:1059] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:00:36.478204  5926 raft_consensus.cc:3055] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:36.478593  5926 raft_consensus.cc:740] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:36.479732  6111 raft_consensus.cc:493] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.479671  5926 consensus_queue.cc:260] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:36.489934  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:36.490535  1649 raft_consensus.cc:3060] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:36.451273  1573 raft_consensus.cc:2468] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 9.
I20260709 13:00:36.395607  1651 raft_consensus.cc:2468] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 9.
W20260709 13:00:36.455610  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.459915  1689 leader_election.cc:400] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 election: Vote denied by peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423) with higher term. Message: Invalid argument: T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 8. Current term is 9.
I20260709 13:00:36.478452  1646 raft_consensus.cc:2468] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 11.
I20260709 13:00:36.491552  1689 leader_election.cc:403] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 13:00:36.458571  6033 leader_election.cc:290] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:36.480311  6111 raft_consensus.cc:515] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:36.503062  2297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:36.503647  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:36.503697  2297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.504236  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:36.505838  1651 raft_consensus.cc:2393] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 13: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:36.474992  6162 raft_consensus.cc:3060] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:36.486730  2324 raft_consensus.cc:1240] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:36.510083  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:36.510495  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:36.486960  2332 raft_consensus.cc:1240] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:00:36.519308  1642 raft_consensus.cc:2468] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 10.
I20260709 13:00:36.522125  2326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53290 (request call id 1049) took 1550 ms. Trace:
I20260709 13:00:36.522650  2326 rpcz_store.cc:276] 0709 13:00:34.972114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.577731 (+605617us) service_pool.cc:224] Handling call
0709 13:00:36.061026 (+483295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:36.441058 (+380032us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:36.497799 (+ 56741us) spinlock_profiling.cc:243] Waited 347 ms on lock 0x7b5400867754. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:36.521899 (+ 24100us) spinlock_profiling.cc:243] Waited 483 ms on lock 0x7b5400867750. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23ba8ad 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:36.522058 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1909771904}
I20260709 13:00:36.472383  6001 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:36.526528  2326 raft_consensus.cc:1275] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:00:36.487635  2294 leader_election.cc:304] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:36.085577  6138 raft_consensus.cc:3060] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:36.497581  1615 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.528713  1615 leader_election.cc:304] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:36.530130  1615 leader_election.cc:304] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:36.476387  2330 consensus_queue.cc:260] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:36.499905  1689 leader_election.cc:304] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 13:00:36.532333  2330 raft_consensus.cc:3060] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:36.507509  1721 raft_consensus.cc:1240] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:36.532951  1689 leader_election.cc:304] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:36.386843  1650 raft_consensus.cc:2468] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 14.
I20260709 13:00:36.535039  1642 raft_consensus.cc:1240] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:36.537894  1650 raft_consensus.cc:1240] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
W20260709 13:00:36.721567  1691 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.722652  1650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 869) took 1138 ms. Trace:
I20260709 13:00:36.723337  1650 rpcz_store.cc:276] 0709 13:00:35.584013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.534391 (+950378us) service_pool.cc:224] Handling call
0709 13:00:36.537613 (+  3222us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:36.721719 (+184106us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:36.722344 (+   625us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:36.575986  1651 raft_consensus.cc:1240] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:36.725746  1651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 866) took 1142 ms. Trace:
I20260709 13:00:36.726267  1651 rpcz_store.cc:276] 0709 13:00:35.583173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.511359 (+928186us) service_pool.cc:224] Handling call
0709 13:00:36.575730 (+ 64371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:36.725054 (+149324us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:36.725533 (+   479us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:36.580757  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 93202.6us
W20260709 13:00:36.729853  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:36.545799  2295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:36.579658  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 73135.8us
I20260709 13:00:36.734331  2295 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:36.546785  1572 raft_consensus.cc:1240] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:36.576265  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
W20260709 13:00:36.715328  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 303018us
I20260709 13:00:36.544489  1567 raft_consensus.cc:1240] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:36.739784  1688 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:36.548077  1576 raft_consensus.cc:1240] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:00:36.541258  1689 leader_election.cc:304] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:36.541833  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:36.567176  1645 raft_consensus.cc:1240] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:36.565436  1648 raft_consensus.cc:1240] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:36.744127  1688 leader_election.cc:304] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:36.744715  1648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 874) took 1089 ms. Trace:
I20260709 13:00:36.744597  1645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 872) took 1093 ms. Trace:
I20260709 13:00:36.745349  1648 rpcz_store.cc:276] 0709 13:00:35.655292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.564972 (+909680us) service_pool.cc:224] Handling call
0709 13:00:36.565252 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:36.744223 (+178971us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:36.744571 (+   348us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:36.745538  1645 rpcz_store.cc:276] 0709 13:00:35.651550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.566626 (+915076us) service_pool.cc:224] Handling call
0709 13:00:36.566951 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:36.743778 (+176827us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:36.744335 (+   557us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:36.551941  5934 raft_consensus.cc:2804] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:36.577318  1646 raft_consensus.cc:1240] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:00:36.707494  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:36.769599  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 868) took 1185 ms. Trace:
I20260709 13:00:36.584159  5946 raft_consensus.cc:2749] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:36.770090  1646 rpcz_store.cc:276] 0709 13:00:35.583710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.521342 (+937632us) service_pool.cc:224] Handling call
0709 13:00:36.577082 (+ 55740us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:36.768989 (+191907us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:36.769395 (+   406us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:36.508224  5976 raft_consensus.cc:2749] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423) with higher term. Message: Invalid argument: T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 8. Current term is 9.
I20260709 13:00:36.502053  6028 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.628985  6038 raft_consensus.cc:2749] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:36.773362  6028 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:36.774564  6038 raft_consensus.cc:2749] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:36.562909  1649 raft_consensus.cc:2468] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 10.
I20260709 13:00:36.772002  5976 raft_consensus.cc:2749] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:36.540216  5644 raft_consensus.cc:493] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:36.569512  5926 raft_consensus.cc:3060] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:36.450300  6036 consensus_queue.cc:1048] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.091s
I20260709 13:00:36.611555  6045 consensus_queue.cc:237] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:36.550993  6025 raft_consensus.cc:493] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.548754  1573 raft_consensus.cc:1240] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 4. Current term is 5. Ops: []
I20260709 13:00:36.508999  6047 raft_consensus.cc:493] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.845932  6226 raft_consensus.cc:3060] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:36.848904  6047 raft_consensus.cc:515] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:36.551528  6063 raft_consensus.cc:2749] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:00:36.608707  6132 consensus_meta.cc:287] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.639s	user 0.010s	sys 0.000s
I20260709 13:00:36.853856  6132 raft_consensus.cc:515] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:36.855716  6044 consensus_meta.cc:287] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.863s	user 0.005s	sys 0.005s
I20260709 13:00:36.619076  6154 raft_consensus.cc:515] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:36.651029  6157 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:36.510979  6163 consensus_queue.cc:1059] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 13:00:36.858947  6163 raft_consensus.cc:3055] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:36.859117  2328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32870 (request call id 593) took 1101 ms. Trace:
I20260709 13:00:36.859441  6163 raft_consensus.cc:740] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:36.863334  6197 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.540581  6205 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:36.864727  6163 consensus_queue.cc:260] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:36.865584  6205 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:36.867660  6163 raft_consensus.cc:3060] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:36.654259  6221 log.cc:927] Time spent T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:00:36.868661  5934 raft_consensus.cc:493] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:36.869498  5934 raft_consensus.cc:3060] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:36.715868  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:36.710903  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.872637  6003 raft_consensus.cc:2804] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:36.873172  6003 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:36.873662  6003 raft_consensus.cc:3060] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:36.874089  1568 raft_consensus.cc:2393] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 13: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:36.732235  2294 leader_election.cc:304] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4
W20260709 13:00:36.875727  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 144093us
I20260709 13:00:36.780280  6028 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:36.750897  1645 raft_consensus.cc:1240] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:36.859493  6154 leader_election.cc:290] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:36.799858  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 867) took 1216 ms. Trace:
W20260709 13:00:36.837134  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 93278.4us
W20260709 13:00:36.878495  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.872273  1574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36642 (request call id 2516) took 1005 ms. Trace:
I20260709 13:00:36.677199  6233 raft_consensus.cc:2804] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:36.860697  6132 leader_election.cc:290] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:36.880570  6233 raft_consensus.cc:697] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 10 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:36.864290  6197 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:36.882108  6233 consensus_queue.cc:237] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:36.883469  6197 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:36.884786  6047 leader_election.cc:290] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:36.885284  6236 consensus_queue.cc:1048] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:00:36.879323  1574 rpcz_store.cc:276] 0709 13:00:35.866293 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.915249 (+ 48956us) service_pool.cc:224] Handling call
0709 13:00:35.915569 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:35.915960 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:35.915987 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:35.916410 (+   423us) log.cc:844] Serialized 26 byte log entry
0709 13:00:36.069805 (+153395us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:36.069885 (+    80us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:36.069975 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:36.871718 (+801743us) raft_consensus.cc:1685] finished
0709 13:00:36.871764 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:36.872048 (+   284us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":83,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":81,"thread_start_us":150477,"threads_started":1,"wal-append.queue_time_us":648858}
I20260709 13:00:36.540830  6186 raft_consensus.cc:2749] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:36.888156  2294 leader_election.cc:304] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:36.878229  1642 rpcz_store.cc:276] 0709 13:00:35.583453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.520514 (+937061us) service_pool.cc:224] Handling call
0709 13:00:36.534814 (+ 14300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:36.537316 (+  2502us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:36.799224 (+261908us) spinlock_profiling.cc:243] Waited 13.9 ms on lock 0x7b54002b3750. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23ba8ad 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:36.799597 (+   373us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":31863040}
I20260709 13:00:36.877413  1645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 878) took 1182 ms. Trace:
I20260709 13:00:36.889506  6025 raft_consensus.cc:515] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:36.890105  2294 leader_election.cc:304] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:36.890347  1645 rpcz_store.cc:276] 0709 13:00:35.694640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.747293 (+1052653us) service_pool.cc:224] Handling call
0709 13:00:36.748117 (+   824us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:36.876975 (+128858us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:36.877306 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:36.791505  5644 raft_consensus.cc:515] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:36.892340  6025 leader_election.cc:290] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:36.889927  1650 raft_consensus.cc:1240] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:36.892869  6220 raft_consensus.cc:2804] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:36.893416  6220 raft_consensus.cc:493] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:36.893482  1650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 880) took 1188 ms. Trace:
I20260709 13:00:36.893958  6220 raft_consensus.cc:3060] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:36.894034  1650 rpcz_store.cc:276] 0709 13:00:35.705460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.831084 (+1125624us) service_pool.cc:224] Handling call
0709 13:00:36.889562 (+ 58478us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:36.893173 (+  3611us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:36.893404 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:36.894701  5644 leader_election.cc:290] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:36.896075  5959 consensus_queue.cc:1059] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:36.896893  6006 raft_consensus.cc:3060] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:36.896644  6129 consensus_queue.cc:1059] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:36.897518  5959 raft_consensus.cc:3055] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:36.897980  5959 raft_consensus.cc:740] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:36.892282  1645 raft_consensus.cc:1240] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 13:00:36.879783  1688 leader_election.cc:304] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:36.896351  1650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 1910) took 1165 ms. Trace:
I20260709 13:00:36.902938  1650 rpcz_store.cc:276] 0709 13:00:35.730876 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.895177 (+1164301us) service_pool.cc:224] Handling call
0709 13:00:36.895690 (+   513us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:36.895937 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:36.895967 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:36.896045 (+    78us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:36.896084 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:36.896139 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:36.896269 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:36.904623  2323 raft_consensus.cc:2468] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 10.
I20260709 13:00:36.877452  5949 raft_consensus.cc:2804] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:36.905283  5959 consensus_queue.cc:260] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:36.905989  5949 raft_consensus.cc:493] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:36.906451  5949 raft_consensus.cc:3060] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:36.906970  5959 raft_consensus.cc:3060] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:36.909425  2294 leader_election.cc:304] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:36.913903  6129 raft_consensus.cc:2749] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:00:36.914803  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 384574us
I20260709 13:00:36.916002  1615 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:36.916543  6069 raft_consensus.cc:3055] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:36.911614  2294 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:36.917024  6069 raft_consensus.cc:740] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:36.918516  6225 raft_consensus.cc:2804] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:36.918197  6069 consensus_queue.cc:260] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:36.918951  6225 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:36.919369  6225 raft_consensus.cc:3060] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:36.919864  6069 raft_consensus.cc:3060] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:36.923385  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.923883  6197 consensus_queue.cc:1048] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:00:36.935081  5942 consensus_meta.cc:287] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.629s	user 0.013s	sys 0.007s
W20260709 13:00:36.936661  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 57075.3us
I20260709 13:00:36.936848  6131 raft_consensus.cc:2804] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:36.937649  6131 raft_consensus.cc:697] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 11 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:36.938482  1688 leader_election.cc:304] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 13:00:36.939116  2294 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:36.939821  6047 raft_consensus.cc:2764] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:00:36.945379  6220 raft_consensus.cc:515] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:36.939210  6131 consensus_queue.cc:237] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:36.952991  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 411667us
I20260709 13:00:36.954209  1689 leader_election.cc:304] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:00:36.955025  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.955526  6047 raft_consensus.cc:2749] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:36.955835  1689 leader_election.cc:304] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:36.956166  5932 leader_election.cc:290] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:36.957444  1689 leader_election.cc:304] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:36.959007  6047 raft_consensus.cc:2749] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:36.959340  6036 raft_consensus.cc:2804] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:36.959870  6036 raft_consensus.cc:493] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
W20260709 13:00:36.960964  2295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.962695  6036 raft_consensus.cc:3060] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:36.963423  2295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:36.964243  2295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.966550  2327 raft_consensus.cc:2468] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 9.
W20260709 13:00:36.967619  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:36.968609  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36642 (request call id 2524) took 1087 ms. Trace:
I20260709 13:00:36.968982  1649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 1916) took 1184 ms. Trace:
I20260709 13:00:36.969441  1649 rpcz_store.cc:276] 0709 13:00:35.784160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.967669 (+1183509us) service_pool.cc:224] Handling call
0709 13:00:36.968137 (+   468us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:36.968467 (+   330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:36.968496 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:36.968579 (+    83us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:36.968613 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:36.968682 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:36.968812 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:36.970667  1574 raft_consensus.cc:1275] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:00:36.969465  1575 raft_consensus.cc:1240] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:00:36.972007  2325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53306 (request call id 758) took 1188 ms. Trace:
I20260709 13:00:36.968979  1568 rpcz_store.cc:276] 0709 13:00:35.881397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.898937 (+ 17540us) service_pool.cc:224] Handling call
0709 13:00:36.968351 (+1069414us) spinlock_profiling.cc:243] Waited 961 ms on lock 0x7b54003f61d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:36.968517 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2209549056}
I20260709 13:00:36.859669  2328 rpcz_store.cc:276] 0709 13:00:35.757252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.774720 (+ 17468us) service_pool.cc:224] Handling call
0709 13:00:35.774984 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:35.775200 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:00:35.854132 (+ 78932us) log.cc:844] Serialized 14 byte log entry
0709 13:00:36.053336 (+199204us) spinlock_profiling.cc:243] Waited 1.92 ms on lock 0x7b180029e8a0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef2ce3f3 00007fa9ef2d07c1 00007fa9ef2d0779 00007fa9ef2d0709 00007fa9ef2d06d1 00007fa9ef2cf9cd 000000000038f354 000000000038f199 00007fa9ef2b183a
0709 13:00:36.413673 (+360337us) spinlock_profiling.cc:243] Waited 29.5 ms on lock 0x7b180029e8a0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef248c0a 00007fa9f8988219 00007fa9ef2d0a40 00007fa9ef2cb4e4 00007fa9ef2cb455 00007fa9f23b3060 00007fa9f23c5716 00007fa9f23d6287 00007fa9f23d6208
0709 13:00:36.841845 (+428172us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:36.858506 (+ 16661us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:36.858603 (+    97us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:36.858717 (+   114us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:36.858943 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21542,"prepare.queue_time_us":143013,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":512760,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"spinlock_wait_cycles":72177280,"thread_start_us":461097,"threads_started":3,"wal-append.queue_time_us":62801}
I20260709 13:00:36.946370  5942 raft_consensus.cc:2749] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:36.941984  6235 consensus_queue.cc:1059] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260709 13:00:36.941298  1688 leader_election.cc:304] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 13:00:36.947854  1615 leader_election.cc:400] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 election: Vote denied by peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373) with higher term. Message: Invalid argument: T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 9. Current term is 10.
I20260709 13:00:36.976662  1615 leader_election.cc:403] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:00:36.977756  6186 raft_consensus.cc:2749] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373) with higher term. Message: Invalid argument: T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 9. Current term is 10.
I20260709 13:00:36.978816  1615 leader_election.cc:304] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:00:36.942130  6237 log.cc:927] Time spent T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.105s	user 0.000s	sys 0.002s
I20260709 13:00:36.949551  5644 raft_consensus.cc:2749] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:36.972477  2325 rpcz_store.cc:276] 0709 13:00:35.783335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.970457 (+187122us) service_pool.cc:224] Handling call
0709 13:00:36.116623 (+146166us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:36.476786 (+360163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:36.476832 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:36.477501 (+   669us) log.cc:844] Serialized 26 byte log entry
0709 13:00:36.737589 (+260088us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:36.737727 (+   138us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:36.737948 (+   221us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:36.738089 (+   141us) raft_consensus.cc:1685] finished
0709 13:00:36.738121 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:36.971542 (+233421us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b54003886d0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23ba8ad 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:36.971796 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":359695,"raft.queue_time_us":361138,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":100,"spinlock_wait_cycles":335395200,"thread_start_us":259175,"threads_started":1,"wal-append.queue_time_us":194758}
I20260709 13:00:36.943118  1646 raft_consensus.cc:1275] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:00:37.044134  6180 consensus_meta.cc:287] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.607s	user 0.011s	sys 0.006s
I20260709 13:00:37.044296  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 1911) took 1313 ms. Trace:
I20260709 13:00:37.045058  1646 rpcz_store.cc:276] 0709 13:00:35.731095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.941994 (+1210899us) service_pool.cc:224] Handling call
0709 13:00:36.942528 (+   534us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:37.043976 (+101448us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:37.044233 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:37.043685  2327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:32870 (request call id 606) took 1271 ms. Trace:
I20260709 13:00:37.034996  1650 raft_consensus.cc:1275] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:00:37.039012  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 97868us
I20260709 13:00:36.978950  6111 leader_election.cc:290] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:36.931864  1645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 1907) took 1169 ms. Trace:
I20260709 13:00:36.856321  6044 raft_consensus.cc:515] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:37.031046  6186 raft_consensus.cc:2749] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:37.036074  6047 raft_consensus.cc:3055] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 13:00:37.048389  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 79972.9us
I20260709 13:00:37.048048  1645 rpcz_store.cc:276] 0709 13:00:35.730118 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.891365 (+1161247us) service_pool.cc:224] Handling call
0709 13:00:36.891964 (+   599us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:36.899515 (+  7551us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:36.899863 (+   348us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:37.053104  1651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 875) took 1397 ms. Trace:
I20260709 13:00:37.053283  1689 leader_election.cc:304] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:37.050393  1650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 1917) took 1266 ms. Trace:
I20260709 13:00:37.054140  1650 rpcz_store.cc:276] 0709 13:00:35.784431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.991210 (+1206779us) service_pool.cc:224] Handling call
0709 13:00:37.034371 (+ 43161us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:37.047415 (+ 13044us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:37.050324 (+  2909us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:37.047269  2327 rpcz_store.cc:276] 0709 13:00:35.770314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.884070 (+113756us) service_pool.cc:224] Handling call
0709 13:00:37.022037 (+1137967us) spinlock_profiling.cc:243] Waited 567 ms on lock 0x7b5400494b54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:37.041501 (+ 19464us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1304632064}
I20260709 13:00:37.046118  6036 raft_consensus.cc:515] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:37.040167  6220 leader_election.cc:290] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:37.042968  6235 raft_consensus.cc:2764] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:00:37.092968  6236 raft_consensus.cc:2749] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:00:37.094339  2330 consensus_meta.cc:287] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.554s	user 0.008s	sys 0.010s
I20260709 13:00:37.094972  2330 raft_consensus.cc:2468] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 10.
I20260709 13:00:37.095999  2325 raft_consensus.cc:1275] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:00:37.096565  1721 raft_consensus.cc:1275] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 13:00:37.094020  6236 consensus_queue.cc:1048] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:00:37.098721  6186 raft_consensus.cc:493] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:37.099721  1573 raft_consensus.cc:1240] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:37.099529  6186 raft_consensus.cc:515] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:37.100029  5976 consensus_queue.cc:1048] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:00:37.101578  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:37.102156  6186 leader_election.cc:290] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:37.102231  6066 consensus_queue.cc:1059] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:00:37.102896  6186 raft_consensus.cc:493] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:37.053555  1651 rpcz_store.cc:276] 0709 13:00:35.667611 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.749546 (+1081935us) service_pool.cc:224] Handling call
0709 13:00:36.760240 (+ 10694us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:36.760814 (+   574us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:00:36.836722 (+ 75908us) log.cc:844] Serialized 14 byte log entry
0709 13:00:37.052716 (+215994us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:37.052789 (+    73us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:37.052847 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:37.052926 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:37.053051 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19654,"prepare.queue_time_us":76292,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":55,"raft.queue_time_us":5420,"thread_start_us":265652,"threads_started":2}
I20260709 13:00:37.103597  6186 raft_consensus.cc:515] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:37.106178  6036 leader_election.cc:290] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:37.052915  6047 raft_consensus.cc:740] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:37.107193  1650 raft_consensus.cc:1240] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:37.094129  1688 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:37.108320  6047 consensus_queue.cc:260] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:37.109027  5934 raft_consensus.cc:515] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:37.110041  6047 raft_consensus.cc:3060] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:37.110523  6236 raft_consensus.cc:2749] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:37.111361  6236 consensus_queue.cc:1048] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:00:37.112963  6236 consensus_queue.cc:1048] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:00:37.114253  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 48927.6us
W20260709 13:00:37.114782  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 73085.1us
I20260709 13:00:37.067518  6180 raft_consensus.cc:515] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:37.121628  6038 consensus_queue.cc:1059] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:37.122411  1644 raft_consensus.cc:2393] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 13: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
W20260709 13:00:37.114280  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.074496  1615 leader_election.cc:304] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:37.093885  1540 leader_election.cc:304] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
W20260709 13:00:37.093789  6138 consensus_meta.cc:287] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.542s	user 0.007s	sys 0.013s
W20260709 13:00:37.140267  6232 log.cc:927] Time spent T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.094s	user 0.001s	sys 0.001s
W20260709 13:00:37.150300  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.160884  6063 raft_consensus.cc:2749] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:00:37.161051  6186 leader_election.cc:290] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:37.153008  6028 raft_consensus.cc:493] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:37.160169  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 107137us
I20260709 13:00:37.179653  1615 leader_election.cc:304] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:37.177551  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:00:37.173055  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 53120.8us
I20260709 13:00:37.167795  6220 consensus_queue.cc:1059] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:00:37.187213  6180 leader_election.cc:290] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:37.148921  5934 leader_election.cc:290] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:37.140316  6038 raft_consensus.cc:3055] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:37.116896  5970 consensus_queue.cc:1048] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 13:00:37.162650  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 13:00:37.193137  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.161298  6044 leader_election.cc:290] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:37.162520  6138 raft_consensus.cc:2749] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:37.162358  6028 raft_consensus.cc:515] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:37.193068  6038 raft_consensus.cc:740] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:37.209683  1688 leader_election.cc:304] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:37.211968  1688 leader_election.cc:304] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
W20260709 13:00:37.212869  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 119246us
I20260709 13:00:37.216802  5926 consensus_queue.cc:1048] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:00:37.217624  6147 consensus_queue.cc:1048] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:37.151211  6225 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:37.207239  1649 raft_consensus.cc:2468] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 15.
W20260709 13:00:37.232648  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 273616us
I20260709 13:00:37.239138  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:37.226034  6163 raft_consensus.cc:2804] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:37.229178  6111 raft_consensus.cc:2804] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:00:37.231349  6162 consensus_meta.cc:287] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.523s	user 0.010s	sys 0.009s
I20260709 13:00:37.245244  1689 leader_election.cc:304] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:37.230953  6006 raft_consensus.cc:2749] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:37.252362  1688 leader_election.cc:304] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:37.254616  1648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 876) took 1584 ms. Trace:
I20260709 13:00:37.252980  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 1920) took 1462 ms. Trace:
W20260709 13:00:37.258948  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 79410.6us
I20260709 13:00:37.257761  1644 rpcz_store.cc:276] 0709 13:00:35.785569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.497571 (+712002us) service_pool.cc:224] Handling call
0709 13:00:37.241877 (+744306us) spinlock_profiling.cc:243] Waited 379 ms on lock 0x7b54002b2d54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:37.247897 (+  6020us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":871245184}
I20260709 13:00:37.244721  5976 raft_consensus.cc:2804] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:37.244638  6163 raft_consensus.cc:493] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
W20260709 13:00:37.264251  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.263216  5934 raft_consensus.cc:2804] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:37.266824  5934 raft_consensus.cc:493] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:37.267184  5934 raft_consensus.cc:3060] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:37.267997  6225 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:37.243204  5949 raft_consensus.cc:515] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:37.252504  6044 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.246199  1468 catalog_manager.cc:5697] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:37.260867  6111 raft_consensus.cc:697] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:37.270227  1615 leader_election.cc:304] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:37.273959  1688 leader_election.cc:304] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:37.255260  1648 rpcz_store.cc:276] 0709 13:00:35.670386 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.746763 (+1076377us) service_pool.cc:224] Handling call
0709 13:00:36.747587 (+   824us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:36.748171 (+   584us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:00:36.841528 (+ 93357us) log.cc:844] Serialized 14 byte log entry
0709 13:00:37.254094 (+412566us) log.cc:844] Serialized 14 byte log entry
0709 13:00:37.254280 (+   186us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:37.254326 (+    46us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:37.254378 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:37.254459 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:37.254566 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":91059,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":72,"raft.queue_time_us":4801,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":109,"thread_start_us":244670,"threads_started":2}
I20260709 13:00:37.264030  5976 raft_consensus.cc:493] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:37.244915  6131 consensus_queue.cc:1048] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:00:37.268978  6163 raft_consensus.cc:3060] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:37.281096  1689 leader_election.cc:304] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:37.276785  6235 raft_consensus.cc:2804] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:37.288224  6233 raft_consensus.cc:2804] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:37.288800  6233 raft_consensus.cc:697] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 12 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:37.288381  6111 consensus_queue.cc:237] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:37.289816  6233 consensus_queue.cc:237] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:37.291970  5949 leader_election.cc:290] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:37.270292  6003 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:37.293982  6038 consensus_queue.cc:260] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:37.299280  1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45148 (request call id 2415) took 1901 ms. Trace:
I20260709 13:00:37.279717  6226 raft_consensus.cc:2749] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:37.256770  6162 raft_consensus.cc:515] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:37.303392  1649 raft_consensus.cc:1275] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 7. (term mismatch)
I20260709 13:00:37.282775  5976 raft_consensus.cc:3060] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:37.303897  1649 pending_rounds.cc:85] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e: Aborting all ops after (but not including) 6
I20260709 13:00:37.285266  6036 raft_consensus.cc:2749] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:00:37.333842  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.299737  1643 rpcz_store.cc:276] 0709 13:00:35.397312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:35.424184 (+ 26872us) service_pool.cc:224] Handling call
0709 13:00:36.159134 (+734950us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:36.159573 (+   439us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:36.159603 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:36.441969 (+282366us) spinlock_profiling.cc:243] Waited 221 ms on lock 0x7b2c0005c228. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f0cb4a11 00007fa9f0cc4372 00007fa9f23f6a01 00007fa9f23bb43a 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2
0709 13:00:36.460610 (+ 18641us) log.cc:844] Serialized 26 byte log entry
0709 13:00:36.912893 (+452283us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:36.912986 (+    93us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:36.913095 (+   109us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:36.944506 (+ 31411us) spinlock_profiling.cc:243] Waited 1.83 ms on lock 0x7b180045df00. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef2ce3f3 00007fa9ef2d07c1 00007fa9ef2d0779 00007fa9ef2d0709 00007fa9ef2d06d1 00007fa9ef2cf9cd 000000000038f354 000000000038f199 00007fa9ef2b183a
0709 13:00:37.162307 (+217801us) raft_consensus.cc:1685] finished
0709 13:00:37.162337 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:37.298916 (+136579us) spinlock_profiling.cc:243] Waited 734 ms on lock 0x7b5400098dd0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23ba8ad 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:37.299076 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1303,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"spinlock_wait_cycles":2201002240,"thread_start_us":291542,"threads_started":1,"wal-append.queue_time_us":392035}
I20260709 13:00:37.346133  1718 raft_consensus.cc:1240] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:37.347198  2294 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:37.347352  6038 raft_consensus.cc:3060] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:37.352365  6162 leader_election.cc:290] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:37.353417  6162 raft_consensus.cc:2749] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:37.333961  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:37.355648  1568 raft_consensus.cc:3060] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:37.355854  6205 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:37.357884  6069 raft_consensus.cc:3055] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:37.358441  6069 raft_consensus.cc:740] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:37.287729   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:37.372419  1615 leader_election.cc:304] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
W20260709 13:00:37.374480  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.363802  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:37.333802  6226 raft_consensus.cc:2804] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:37.381599  6252 raft_consensus.cc:493] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.383579  2327 raft_consensus.cc:2468] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 10.
I20260709 13:00:37.306520  1649 pending_rounds.cc:107] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 7.7
I20260709 13:00:37.359714  6069 consensus_queue.cc:260] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:37.389454  1649 raft_consensus.cc:2917] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Aborting config change with OpId 7.7: Aborted: Op aborted by new leader
I20260709 13:00:37.390357  1649 raft_consensus.cc:2889] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:37.385897  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 104908us
W20260709 13:00:37.386929  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 122469us
I20260709 13:00:37.401875  6028 leader_election.cc:290] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:37.403180  6226 raft_consensus.cc:697] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 10 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:37.382741  6235 raft_consensus.cc:697] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 10 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:37.404871  5926 raft_consensus.cc:493] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.405526  5926 raft_consensus.cc:515] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:37.407759  5926 leader_election.cc:290] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:37.385099  5949 raft_consensus.cc:2804] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:37.386771  6003 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:37.413771  2328 raft_consensus.cc:1275] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:00:37.368847  6044 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:37.419718  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 113783us
I20260709 13:00:37.422701  6231 consensus_queue.cc:1059] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:00:37.412185  6180 raft_consensus.cc:2804] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:00:37.427702  6246 log.cc:927] Time spent T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.063s	user 0.001s	sys 0.001s
I20260709 13:00:37.426424  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:37.430159  1576 raft_consensus.cc:3060] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:37.430449  6131 consensus_queue.cc:1059] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260709 13:00:37.430740  1539 leader_election.cc:304] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 13:00:37.432596  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:37.435460  1575 raft_consensus.cc:2468] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 11.
I20260709 13:00:37.404366  6226 consensus_queue.cc:237] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:37.431433  6252 raft_consensus.cc:515] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:37.438284  1574 raft_consensus.cc:2468] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 9.
I20260709 13:00:37.440114  6252 leader_election.cc:290] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:37.440603  1649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:50436 (request call id 0) took 3378 ms. Trace:
I20260709 13:00:37.440682  6236 raft_consensus.cc:493] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:37.442538  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.432802  6180 raft_consensus.cc:697] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 9 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:37.443511  1568 raft_consensus.cc:2468] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 10.
I20260709 13:00:37.445147  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:37.443341  1647 raft_consensus.cc:2468] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 10.
I20260709 13:00:37.446152  6045 raft_consensus.cc:2804] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:37.444154  6236 raft_consensus.cc:515] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:37.452706  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:37.454025  6129 raft_consensus.cc:3055] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:00:37.453496  1468 catalog_manager.cc:5697] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 6 to 12, leader changed from 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 12 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:00:37.405583  6235 consensus_queue.cc:237] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:37.455794  1689 leader_election.cc:304] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:37.455296  5934 raft_consensus.cc:515] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:37.447876  6069 raft_consensus.cc:3060] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:37.463578  1648 raft_consensus.cc:1240] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:00:37.463835  2330 raft_consensus.cc:1275] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:00:37.470738  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 45686.9us
I20260709 13:00:37.470662  5949 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:37.477384  6045 raft_consensus.cc:697] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:37.477407  5949 raft_consensus.cc:3060] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:37.478514  6045 consensus_queue.cc:237] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:37.462109  6129 raft_consensus.cc:740] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:37.481139  6180 consensus_queue.cc:237] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:37.481510  6129 consensus_queue.cc:260] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:37.483057  6129 raft_consensus.cc:3060] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:37.442121  1649 rpcz_store.cc:276] 0709 13:00:34.058198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:34.058445 (+   247us) service_pool.cc:224] Handling call
0709 13:00:34.604661 (+546216us) spinlock_profiling.cc:243] Waited 9.51 ms on lock 0x7b58005fc6d0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23170aa 00007fa9f2399447 00007fa9f23b670a 00007fa9f23b776a 00007fa9f23b691b 00007fa9f23c203c 00007fa9f23c16b3 00007fa9f23b99fa 00007fa9f73814c9 00007fa9f08fdc54
0709 13:00:34.686594 (+ 81933us) log.cc:844] Serialized 501 byte log entry
0709 13:00:37.425411 (+2738817us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57243,"raft.queue_time_us":57788,"raft.run_cpu_time_us":1631,"raft.run_wall_time_us":1631,"spinlock_wait_cycles":21914112,"thread_start_us":134770,"threads_started":1,"wal-append.queue_time_us":260814,"wal-append.run_cpu_time_us":6118,"wal-append.run_wall_time_us":1259380}
I20260709 13:00:37.484891  1568 raft_consensus.cc:1240] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 4. Current term is 5. Ops: []
W20260709 13:00:37.489275  1458 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 8e94ee9035214526808abfaab11799fe with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391) due to error UNKNOWN_ERROR; will retry: Aborted: Op aborted by new leader
I20260709 13:00:37.491305  1539 leader_election.cc:304] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:37.492408  1539 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 13:00:37.493716  1539 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 13:00:37.494885  5932 raft_consensus.cc:2804] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:37.499694  6003 raft_consensus.cc:493] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:37.500692  5926 raft_consensus.cc:2804] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:37.501111  5926 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:37.501842  6251 raft_consensus.cc:3055] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:37.502264  6251 raft_consensus.cc:740] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:37.501523  5926 raft_consensus.cc:3060] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:37.502957  6236 leader_election.cc:290] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:37.503846  6028 raft_consensus.cc:3055] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:37.504251  6028 raft_consensus.cc:740] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:37.505226  6028 consensus_queue.cc:260] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:37.506511  6028 raft_consensus.cc:3060] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:37.500191  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:37.500250  6003 raft_consensus.cc:515] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:37.529745  1576 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 12.
I20260709 13:00:37.533392  1644 raft_consensus.cc:2393] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 13: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:37.542141  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:37.542901  1573 raft_consensus.cc:3060] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:37.543542  1647 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 1908) took 1813 ms (client timeout 2164 ms). Trace:
I20260709 13:00:37.543642  1642 raft_consensus.cc:1240] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:37.545295  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 881) took 1839 ms. Trace:
I20260709 13:00:37.545581  6254 raft_consensus.cc:2804] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:37.545795  1642 rpcz_store.cc:276] 0709 13:00:35.705764 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.889605 (+1183841us) service_pool.cc:224] Handling call
0709 13:00:37.543431 (+653826us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:37.544333 (+   902us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:37.545097 (+   764us) spinlock_profiling.cc:243] Waited 653 ms on lock 0x7b54001f8450. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23ba8ad 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:37.545222 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1502398720}
I20260709 13:00:37.546406  5976 raft_consensus.cc:515] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:37.548039  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 90891.6us
I20260709 13:00:37.549070  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:37.550441  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:37.551817  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:37.552946  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:37.553258  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:37.554193  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:37.554217  1646 raft_consensus.cc:2410] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:00:37.545044  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 13:00:37.548262  6250 log.cc:927] Time spent T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:00:37.555147  1718 raft_consensus.cc:3060] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:37.556743  2330 raft_consensus.cc:2468] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 5.
W20260709 13:00:37.544049  1647 rpcz_store.cc:269] 0709 13:00:35.730403 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:36.172179 (+441776us) service_pool.cc:224] Handling call
0709 13:00:37.543281 (+1371102us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54001f8454. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:37.543457 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2379129216}
I20260709 13:00:37.555238  2295 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 13:00:37.557793  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 102087us
I20260709 13:00:37.559428  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:37.562412  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:00:37.571224  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.583635  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:37.583971  1649 raft_consensus.cc:1240] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 8. Current term is 9. Ops: [7.5-8.6]
I20260709 13:00:37.582677  1647 raft_consensus.cc:2468] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 11.
I20260709 13:00:37.541572  6262 raft_consensus.cc:2804] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:37.587139  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:37.587510  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:00:37.584641  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 63420.9us
I20260709 13:00:37.586036  2328 raft_consensus.cc:2393] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 8: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
W20260709 13:00:37.541661  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 48024.8us
W20260709 13:00:37.598762  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 144681us
I20260709 13:00:37.560226  6254 raft_consensus.cc:697] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 9 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:37.503238  6251 consensus_queue.cc:260] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:37.582824  6006 consensus_queue.cc:1059] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:00:37.603402  1647 raft_consensus.cc:1275] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:00:37.604342  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:37.539204  6163 raft_consensus.cc:515] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:37.608281  1568 raft_consensus.cc:2468] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 11.
I20260709 13:00:37.613354  1646 raft_consensus.cc:1240] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:37.592221  5976 leader_election.cc:290] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:37.627290  6251 raft_consensus.cc:3060] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:37.585466  6047 consensus_queue.cc:1048] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 13:00:37.627789  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:37.631922  1649 raft_consensus.cc:1275] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:00:37.594336  5932 raft_consensus.cc:697] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:37.627511  6001 raft_consensus.cc:493] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.656025  1649 raft_consensus.cc:1275] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:00:37.653370  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:37.657876  1651 raft_consensus.cc:2410] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 12 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:00:37.658521  1645 raft_consensus.cc:1275] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:00:37.658843  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:37.658953  1689 leader_election.cc:304] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:37.659420  1651 raft_consensus.cc:2468] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 7.
W20260709 13:00:37.660313  6265 log.cc:927] Time spent T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:00:37.661021  1721 raft_consensus.cc:1240] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:37.660756  5976 consensus_queue.cc:1059] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:37.661712  6226 consensus_queue.cc:1048] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:37.660256  5948 raft_consensus.cc:493] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.663529  6047 raft_consensus.cc:3060] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:00:37.651094  6005 raft_consensus.cc:2804] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:37.671433  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:37.673049  1468 catalog_manager.cc:5697] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 3 to 9, leader changed from 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 9 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:00:37.720814  1649 raft_consensus.cc:1275] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:00:37.679322  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.654773  5934 leader_election.cc:290] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:00:37.723618  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 63228.3us
I20260709 13:00:37.720873  1648 raft_consensus.cc:2468] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 13.
I20260709 13:00:37.670255  6262 raft_consensus.cc:697] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:37.747738  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
W20260709 13:00:37.750164  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 43565.5us
I20260709 13:00:37.750914  1651 raft_consensus.cc:3060] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:37.757500  6249 consensus_queue.cc:1048] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.151s
I20260709 13:00:37.758728  6044 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:37.749828  6131 raft_consensus.cc:3055] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:37.667237  6001 raft_consensus.cc:515] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:37.787878  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:37.789669  1645 raft_consensus.cc:3060] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:00:37.802834  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.760821  5932 consensus_queue.cc:237] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:37.738212  6111 consensus_queue.cc:1048] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 13:00:37.765749  5926 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:37.720201  5948 raft_consensus.cc:515] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:37.808920  1689 leader_election.cc:304] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:37.804181  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:37.784125  6003 leader_election.cc:290] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:00:37.812381  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 222918us
I20260709 13:00:37.761889  5949 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:37.789274  6131 raft_consensus.cc:740] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:37.768117  6044 consensus_queue.cc:1048] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:00:37.818295  1576 raft_consensus.cc:1240] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:37.816423  6005 raft_consensus.cc:697] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
W20260709 13:00:37.828605  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:37.844892  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:37.849990  1615 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:37.850759  1615 leader_election.cc:304] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:37.859019  1615 leader_election.cc:304] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:37.868911  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:37.848762  6249 raft_consensus.cc:3060] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:37.849377  6138 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:37.828251  6045 consensus_queue.cc:1048] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:00:37.800458  6254 consensus_queue.cc:237] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:37.860864  6129 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:37.890954  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 65995.6us
I20260709 13:00:37.862284  5644 raft_consensus.cc:2804] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:37.891745  1540 leader_election.cc:304] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:37.875804  6205 raft_consensus.cc:2804] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:37.893198  1573 raft_consensus.cc:2410] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 13:00:37.897202  1648 raft_consensus.cc:3060] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:37.880115  6138 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:37.895360  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:37.874812  6163 leader_election.cc:290] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:37.900077  1721 raft_consensus.cc:1275] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:00:37.914614  6138 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:37.898185  6205 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:37.915750  6205 raft_consensus.cc:3060] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:37.916318  6001 leader_election.cc:290] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:37.918457  5948 leader_election.cc:290] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:37.919456  5926 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:37.920241  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:37.904608  6131 consensus_queue.cc:260] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:37.921708  6131 raft_consensus.cc:3060] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:37.921836  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:37.894097  5644 raft_consensus.cc:493] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:37.924877  5644 raft_consensus.cc:3060] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:37.920899  1575 raft_consensus.cc:2468] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 12.
I20260709 13:00:37.915196  1539 leader_election.cc:304] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 13:00:37.937325  1645 raft_consensus.cc:2468] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 14.
W20260709 13:00:37.900003  6259 log.cc:927] Time spent T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 13:00:37.950778  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:37.902527  6267 raft_consensus.cc:2804] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:37.953603  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:37.952083  2295 leader_election.cc:304] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:37.955960  1645 raft_consensus.cc:3060] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:37.948660  5926 raft_consensus.cc:493] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:37.861428  6262 consensus_queue.cc:237] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:37.959344  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 44264.6us
I20260709 13:00:37.957091  5926 raft_consensus.cc:515] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:37.961820  6274 log.cc:927] Time spent T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 13:00:37.962366  6261 log.cc:927] Time spent T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 13:00:37.962237  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:37.976852  1721 raft_consensus.cc:2468] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 13.
I20260709 13:00:37.968997  6279 raft_consensus.cc:2804] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:37.961386  6270 consensus_queue.cc:1048] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260709 13:00:37.906359  6129 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:37.987938  1539 leader_election.cc:304] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:37.973213  6205 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:37.994995  1688 leader_election.cc:304] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:37.959002  5948 raft_consensus.cc:2804] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:37.996134  5948 raft_consensus.cc:493] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:37.996613  5948 raft_consensus.cc:3060] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:37.997228  6036 raft_consensus.cc:2804] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:37.997648  6036 raft_consensus.cc:493] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:37.997987  6036 raft_consensus.cc:3060] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:37.961534  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:38.004932  1718 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 12.
I20260709 13:00:38.018337  1648 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 12.
I20260709 13:00:37.996809  6038 consensus_queue.cc:1048] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:00:38.035660  2294 leader_election.cc:304] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
W20260709 13:00:38.036518  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 144862us
I20260709 13:00:38.034607  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:38.039485  2294 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:38.037513  1615 leader_election.cc:304] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:38.007246  6047 raft_consensus.cc:2749] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:00:38.051864  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:38.051847  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 55480.1us
I20260709 13:00:38.056037  5949 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 16 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:38.050505  6044 raft_consensus.cc:2804] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:38.057035  6163 raft_consensus.cc:493] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.057624  6028 raft_consensus.cc:2804] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:38.057760  6163 raft_consensus.cc:515] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:38.058106  5644 raft_consensus.cc:515] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:38.062040  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:37.946259  6005 consensus_queue.cc:237] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:37.964883  6226 consensus_queue.cc:1059] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 13:00:38.003858  6279 raft_consensus.cc:697] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:38.057108  6044 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.067380  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:38.055346  1688 leader_election.cc:304] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:38.067545  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:38.013540  6267 raft_consensus.cc:697] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:38.051003  6275 raft_consensus.cc:2749] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:38.074811  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:38.050940  6006 raft_consensus.cc:2804] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:38.065893  5926 leader_election.cc:290] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:38.086300  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:38.071367  6044 raft_consensus.cc:3060] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:38.089207  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:38.091161  2323 raft_consensus.cc:2468] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 15.
I20260709 13:00:38.091321  1645 raft_consensus.cc:2468] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 10.
I20260709 13:00:38.061236  6036 raft_consensus.cc:515] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:38.083308  5644 leader_election.cc:290] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:38.093366  6006 raft_consensus.cc:697] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:38.090387  6226 raft_consensus.cc:2804] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:38.091059  6163 leader_election.cc:290] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:38.112205  1648 raft_consensus.cc:1240] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:00:38.098296  5926 raft_consensus.cc:493] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.117867  6205 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:38.117625  6279 consensus_queue.cc:237] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:38.113543  6038 raft_consensus.cc:493] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:38.121677  6038 raft_consensus.cc:515] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:38.122625  6267 consensus_queue.cc:237] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:38.123813  6038 leader_election.cc:290] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:38.120158  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 105630us
I20260709 13:00:38.137933  1651 raft_consensus.cc:2468] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 13.
I20260709 13:00:38.142155  1688 leader_election.cc:304] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:38.154484  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:38.133409  5644 raft_consensus.cc:493] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:38.173609  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.175637  1651 raft_consensus.cc:1275] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:00:38.154752  5934 consensus_queue.cc:1059] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:00:38.177827  5644 raft_consensus.cc:515] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:38.178081  6129 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:00:38.173585  6251 consensus_meta.cc:287] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.518s	user 0.007s	sys 0.004s
I20260709 13:00:38.181125  1722 raft_consensus.cc:2410] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 13:00:38.147893  6226 raft_consensus.cc:697] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 14 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
W20260709 13:00:38.325462  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 183359us
I20260709 13:00:38.176703  6220 consensus_queue.cc:1048] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:38.126533  5926 raft_consensus.cc:515] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:38.352963  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:38.354846  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.328972  6275 raft_consensus.cc:493] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.342439  6252 raft_consensus.cc:2804] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:38.346935  6069 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:38.395130  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 334483us
I20260709 13:00:38.404740  1723 raft_consensus.cc:2468] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5.
I20260709 13:00:38.406677  1721 raft_consensus.cc:1275] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:00:38.406782  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:38.407189  1721 pending_rounds.cc:85] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4: Aborting all ops after (but not including) 5
I20260709 13:00:38.409605  1721 pending_rounds.cc:107] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:00:38.409883  1721 raft_consensus.cc:2889] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:38.412154  1568 raft_consensus.cc:1275] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:00:38.419032  1573 raft_consensus.cc:1275] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:00:38.396293  6267 raft_consensus.cc:493] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.401000  6252 raft_consensus.cc:697] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 13 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:38.410604  6047 raft_consensus.cc:493] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.426400  1539 leader_election.cc:304] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
W20260709 13:00:38.434340  6281 log.cc:927] Time spent T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.195s	user 0.006s	sys 0.000s
I20260709 13:00:38.417562  6286 raft_consensus.cc:3055] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:38.435060  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:38.402381  6069 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:38.444177  1569 raft_consensus.cc:2393] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 10: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
W20260709 13:00:38.446439  6280 log.cc:927] Time spent T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.253s	user 0.010s	sys 0.000s
I20260709 13:00:38.446722  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 13:00:38.447196  6283 log.cc:927] Time spent T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.234s	user 0.004s	sys 0.006s
I20260709 13:00:38.438558  6036 leader_election.cc:290] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:00:38.448959  6287 log.cc:927] Time spent T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 13:00:38.438512  6205 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.449911  6205 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:38.450611  6292 log.cc:927] Time spent T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:00:38.452809  6226 consensus_queue.cc:237] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:38.454090  6205 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:38.455138  5926 leader_election.cc:290] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:38.456233  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:38.456895  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:38.462488  6066 raft_consensus.cc:3055] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:38.463120  6066 raft_consensus.cc:740] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
W20260709 13:00:38.464442  1615 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.442190  6254 raft_consensus.cc:493] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:38.405879  6275 raft_consensus.cc:515] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:38.486830  2323 raft_consensus.cc:1240] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:38.487043  1573 raft_consensus.cc:2468] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 9.
I20260709 13:00:38.487936  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:38.488616  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:38.489157  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:38.489681  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:38.464219  6066 consensus_queue.cc:260] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:38.494105  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:38.494549  6163 consensus_queue.cc:1048] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:38.495340  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:38.551326  1468 catalog_manager.cc:5697] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 6 to 7, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 7 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:38.496476  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:38.497371  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:38.498032  6252 consensus_queue.cc:237] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:38.504655  6280 log.cc:927] Time spent T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:00:38.443629  6286 raft_consensus.cc:740] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:38.464938  6028 raft_consensus.cc:493] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:38.506172  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:00:38.506541  6131 consensus_meta.cc:287] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.584s	user 0.009s	sys 0.002s
I20260709 13:00:38.509012  6254 raft_consensus.cc:515] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:38.511767  5644 leader_election.cc:290] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:38.512167  2329 raft_consensus.cc:1275] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:00:38.513763  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:38.445355  6047 raft_consensus.cc:515] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:38.463198  5948 raft_consensus.cc:515] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:38.464111  6069 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:00:38.529114  6290 log.cc:927] Time spent T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260709 13:00:38.530568  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:38.537130  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:38.539521  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:38.542413  6044 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:38.562362  1719 raft_consensus.cc:3060] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:38.356284  6006 consensus_queue.cc:237] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:38.563031  1724 raft_consensus.cc:3060] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:38.574446  1615 leader_election.cc:304] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:38.588929  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:38.592584  6028 raft_consensus.cc:3060] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:38.604554  1718 raft_consensus.cc:2410] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 13:00:38.615418  1716 raft_consensus.cc:2393] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 12: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 13:00:38.593340  2329 pending_rounds.cc:85] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66: Aborting all ops after (but not including) 9
I20260709 13:00:38.605427  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:38.464740  6267 raft_consensus.cc:515] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:38.591295  1725 raft_consensus.cc:2468] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 10.
I20260709 13:00:38.572774  6163 consensus_queue.cc:1243] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:00:38.573014  6231 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
W20260709 13:00:38.609722  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 195871us
I20260709 13:00:38.586464  6005 raft_consensus.cc:493] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.614192  1721 raft_consensus.cc:3060] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:38.576882  6249 consensus_meta.cc:287] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.700s	user 0.018s	sys 0.001s
I20260709 13:00:38.574234  6205 consensus_queue.cc:1048] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:00:38.615835  2329 pending_rounds.cc:107] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:00:38.617542  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 13:00:38.672919  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.690356  2329 raft_consensus.cc:2889] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:38.686589  1569 raft_consensus.cc:2393] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 12: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:38.607220  6038 raft_consensus.cc:493] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:38.689826  1468 catalog_manager.cc:5697] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:38.685145  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:38.617174  5644 raft_consensus.cc:2804] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:38.616572  5946 raft_consensus.cc:493] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.694644  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:38.698408  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:38.700178  2297 leader_election.cc:304] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:38.700775  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 13:00:38.701670  1474 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55626 (request call id 258) took 21873 ms (client timeout 15000 ms). Trace:
I20260709 13:00:38.701922  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:38.702715  1720 raft_consensus.cc:2393] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 11: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:38.703466  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:38.704175  6288 raft_consensus.cc:493] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.699839  1468 catalog_manager.cc:5697] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:38.704483  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:38.704226  6267 leader_election.cc:290] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:38.699002  1716 raft_consensus.cc:2468] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 11.
I20260709 13:00:38.687717  6066 raft_consensus.cc:3060] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:38.709628  1468 catalog_manager.cc:5697] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 7 to 8, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 8 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:38.710950  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:38.691493  6295 raft_consensus.cc:2749] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:38.732818  6262 consensus_queue.cc:1048] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:00:38.733763  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:38.735170  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:38.704931  6288 raft_consensus.cc:515] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:38.736339  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:00:38.742255  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.742508  1721 raft_consensus.cc:2468] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 10.
I20260709 13:00:38.712870  1724 raft_consensus.cc:2468] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8.
I20260709 13:00:38.696913  6038 raft_consensus.cc:515] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:38.696713  6249 raft_consensus.cc:2749] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:38.717697  6044 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:38.719024  6275 leader_election.cc:290] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:38.721949  6047 leader_election.cc:290] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:38.722179  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:38.758173  1718 raft_consensus.cc:2468] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 15.
I20260709 13:00:38.688378  6180 raft_consensus.cc:493] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:38.723214  5946 raft_consensus.cc:515] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:38.689095  6005 raft_consensus.cc:515] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:38.724575  6254 leader_election.cc:290] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:38.774134  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:38.725116  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:38.775101  1724 raft_consensus.cc:2393] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 9: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:38.776297  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:38.777315  1717 raft_consensus.cc:2393] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 11: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:38.778301  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:38.779613  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:38.780232  1717 raft_consensus.cc:3060] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:38.785593  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 13:00:38.726380  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 161727us
I20260709 13:00:38.726954  6225 raft_consensus.cc:2749] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:38.751293  1574 raft_consensus.cc:2468] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 12.
I20260709 13:00:38.788450  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:38.788969  6180 raft_consensus.cc:515] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:38.790505  5946 leader_election.cc:290] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:38.791083  6180 leader_election.cc:290] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:38.791601  6028 raft_consensus.cc:515] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:38.792737  6288 leader_election.cc:290] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:38.750428  1719 raft_consensus.cc:2468] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 14.
I20260709 13:00:38.793006  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:38.793763  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:38.794427  1719 raft_consensus.cc:2393] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 14: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:38.795127  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:38.795244  6005 leader_election.cc:290] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:38.795737  1719 raft_consensus.cc:2393] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 14: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:38.796396  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:38.796741  2332 raft_consensus.cc:2468] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 12.
I20260709 13:00:38.796918  1719 raft_consensus.cc:2468] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 12.
I20260709 13:00:38.759724  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:38.765225  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:38.798528  1718 raft_consensus.cc:2393] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 9: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:38.781445  2329 raft_consensus.cc:1275] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:38.782258  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:38.799630  2323 raft_consensus.cc:2468] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 8.
I20260709 13:00:38.688922  6231 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:38.784466  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:38.801920  1725 raft_consensus.cc:2410] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:00:38.784695  2330 raft_consensus.cc:1240] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:38.762774  1468 catalog_manager.cc:5697] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
W20260709 13:00:38.799311  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 114874us
I20260709 13:00:38.809568  1615 leader_election.cc:304] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:38.810711  1615 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:38.815562  1468 catalog_manager.cc:5697] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 4 to 5, leader changed from 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 5 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:00:38.821847  1722 raft_consensus.cc:2468] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 13.
I20260709 13:00:38.822417  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:38.818034  1575 pending_rounds.cc:85] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting all ops after (but not including) 5
I20260709 13:00:38.825294  1575 pending_rounds.cc:107] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:00:38.825059  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:38.825690  1575 raft_consensus.cc:2889] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:38.828765  6163 raft_consensus.cc:2749] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:38.831068  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:38.831970  1567 raft_consensus.cc:2368] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 13. Current term is 14.
I20260709 13:00:38.826493  1572 raft_consensus.cc:2468] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 10.
I20260709 13:00:38.826803  1615 leader_election.cc:304] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:38.836294  1615 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:38.842464  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:38.813212  6262 raft_consensus.cc:493] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.807113  6275 consensus_queue.cc:1059] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:00:38.846928  6028 leader_election.cc:290] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:00:38.702103  1474 rpcz_store.cc:269] 0709 13:00:16.828241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:16.828867 (+   626us) service_pool.cc:224] Handling call
0709 13:00:38.701446 (+21872579us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:30.945065 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:31.212587 (+267522us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:31.212649 (+    62us) write_op.cc:435] Acquired schema lock
0709 13:00:31.212666 (+    17us) tablet.cc:662] Decoding operations
0709 13:00:31.213716 (+  1050us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:31.213820 (+   104us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:31.213845 (+    25us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:00:31.214715 (+   870us) tablet.cc:701] Row locks acquired
0709 13:00:31.214774 (+    59us) write_op.cc:260] PREPARE: finished
0709 13:00:31.214945 (+   171us) write_op.cc:270] Start()
0709 13:00:31.215107 (+   162us) write_op.cc:276] Timestamp: P: 1783602031214877 usec, L: 0
0709 13:00:31.215149 (+    42us) op_driver.cc:348] REPLICATION: starting
0709 13:00:31.215785 (+   636us) log.cc:844] Serialized 4000 byte log entry
0709 13:00:32.184287 (+968502us) op_driver.cc:464] REPLICATION: finished
0709 13:00:32.407159 (+222872us) spinlock_profiling.cc:243] Waited 17.6 ms on lock 0x7b4400022b4c. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef1f4c85 00007fa9ef1f56a2 00007fa9f1f671db 00007fa9f1f62aaf 00007fa9ef2b10ac 00007fa9f810bab9 00007fa9ef2cd69b 00007fa9ef2cb93f 00007fa9ef2cdc02 00007fa9f5df1ef0
0709 13:00:32.538836 (+131677us) write_op.cc:301] APPLY: starting
0709 13:00:32.538950 (+   114us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:32.834367 (+295417us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:32.841601 (+  7234us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:34.043347 (+1201746us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:34.043719 (+   372us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=20,mrs_lookups=0
0709 13:00:34.043777 (+    58us) write_op.cc:312] APPLY: finished
0709 13:00:34.044159 (+   382us) log.cc:844] Serialized 97 byte log entry
0709 13:00:34.439438 (+395279us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:34.448051 (+  8613us) write_op.cc:454] Released schema lock
0709 13:00:34.508041 (+ 59990us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:34.552201 (+ 44160us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:34.553997 (+  1796us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":19450,"reported_tablets":49,"spinlock_wait_cycles":47872,"child_traces":[["op",{"apply.queue_time_us":354230,"apply.run_cpu_time_us":38826,"apply.run_wall_time_us":1996154,"cfile_cache_hit":42,"cfile_cache_hit_bytes":45927,"num_ops":10,"prepare.queue_time_us":335420,"prepare.run_cpu_time_us":12230,"prepare.run_wall_time_us":499437,"raft.queue_time_us":364423,"raft.run_cpu_time_us":21563,"raft.run_wall_time_us":323918,"replication_time_us":968965,"spinlock_wait_cycles":40483712,"thread_start_us":1134181,"threads_started":5,"wal-append.queue_time_us":740980,"wal-append.run_cpu_time_us":35053,"wal-append.run_wall_time_us":2761665}]]}
I20260709 13:00:38.840181  6163 raft_consensus.cc:2804] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:38.851300  6231 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:38.851476  6286 consensus_queue.cc:260] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:38.844687  1468 catalog_manager.cc:5697] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 9 to 10, leader changed from 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 10 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:00:38.813685  6180 raft_consensus.cc:2804] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:38.862238  6038 leader_election.cc:290] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:38.863250  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:38.875934  6286 raft_consensus.cc:3060] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:38.876011  6289 consensus_queue.cc:1048] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.004s
W20260709 13:00:38.876606  6303 log.cc:927] Time spent T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:00:38.877213  6311 raft_consensus.cc:2749] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:38.817371  6279 consensus_queue.cc:1048] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:00:38.825166  6295 consensus_queue.cc:1059] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.050s
I20260709 13:00:38.878955  6279 raft_consensus.cc:3055] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:00:38.879312  6279 raft_consensus.cc:740] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:38.865343  1720 raft_consensus.cc:1275] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:00:38.880640  6291 log.cc:927] Time spent T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.533s	user 0.001s	sys 0.006s
I20260709 13:00:38.869460  1717 raft_consensus.cc:2468] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 12.
I20260709 13:00:38.870507  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:38.874871  6180 raft_consensus.cc:493] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:38.873580  1539 leader_election.cc:304] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:38.881534  6180 raft_consensus.cc:3060] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:38.873554  1468 catalog_manager.cc:5697] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:38.884747  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:38.885495  5976 raft_consensus.cc:3055] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:38.885987  5976 raft_consensus.cc:740] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:38.886574  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:38.887246  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:38.886943  5976 consensus_queue.cc:260] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:38.887894  1571 raft_consensus.cc:3060] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:38.888058  5976 raft_consensus.cc:3060] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:38.880191  6279 consensus_queue.cc:260] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:38.888895  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:38.889143  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:38.825026  6263 consensus_queue.cc:1048] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:00:38.892036  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:38.892412  1568 raft_consensus.cc:2468] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 7.
I20260709 13:00:38.895277  6028 raft_consensus.cc:493] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.870476  6163 raft_consensus.cc:493] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:38.806692  6044 consensus_queue.cc:1059] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:00:38.868263  6270 consensus_queue.cc:1048] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:00:38.901895  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:38.924917  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:38.867419  6205 raft_consensus.cc:493] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.903472  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:38.868850  5948 leader_election.cc:290] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:38.865898  5644 raft_consensus.cc:697] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 9 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:38.905350  1719 raft_consensus.cc:1240] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 12. Current term is 13. Ops: [10.7-12.8]
W20260709 13:00:38.864656  6296 log.cc:927] Time spent T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.452s	user 0.009s	sys 0.000s
I20260709 13:00:38.907085  1721 raft_consensus.cc:1275] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:00:38.914389  1645 raft_consensus.cc:2468] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 12.
I20260709 13:00:38.913247  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:38.915083  1723 raft_consensus.cc:1275] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:00:38.916230  6267 raft_consensus.cc:493] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.934419  1723 pending_rounds.cc:85] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4: Aborting all ops after (but not including) 5
I20260709 13:00:38.934443  1650 raft_consensus.cc:3060] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:38.917716  1571 raft_consensus.cc:2468] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 14.
I20260709 13:00:38.919835  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:38.920010  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:00:38.920141  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.936028  1647 raft_consensus.cc:2468] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 10.
I20260709 13:00:38.922473  1572 raft_consensus.cc:1240] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:38.872437  6262 raft_consensus.cc:515] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:38.939270  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:38.940052  1648 raft_consensus.cc:2393] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 12: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:38.930605  1646 raft_consensus.cc:2393] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 12: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 13:00:38.940874  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:38.923643  6163 raft_consensus.cc:3060] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:38.941516  1648 raft_consensus.cc:2468] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 10.
I20260709 13:00:38.941752  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:38.942389  1646 raft_consensus.cc:2468] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 12.
I20260709 13:00:38.944753  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:38.930583  1568 raft_consensus.cc:1240] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:38.945498  1645 raft_consensus.cc:2393] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 13: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:38.946482  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:38.947252  1568 raft_consensus.cc:2393] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 8: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:38.921636  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:38.917352  6249 raft_consensus.cc:493] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:38.932644  6205 raft_consensus.cc:515] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:38.947690  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:38.962175  1644 raft_consensus.cc:2468] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 10.
I20260709 13:00:38.947932  1651 raft_consensus.cc:2468] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 14.
I20260709 13:00:38.943559  1646 raft_consensus.cc:1275] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 13:00:38.936358  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:38.949640  1723 pending_rounds.cc:107] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4: Aborting uncommitted NO_OP operation due to leader change: 8.6
W20260709 13:00:38.950855  1458 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 8e94ee9035214526808abfaab11799fe with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 4dbe7d47a2374afca075d3a98583b49e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:00:38.965577  1723 raft_consensus.cc:2889] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:38.951537  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:38.948001  6066 raft_consensus.cc:493] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:38.924237  6028 raft_consensus.cc:515] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:38.967818  1644 raft_consensus.cc:1275] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:00:38.963171  1649 raft_consensus.cc:2468] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 14.
I20260709 13:00:38.973085  1539 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:38.937134  6289 raft_consensus.cc:2764] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:00:38.980077  1651 raft_consensus.cc:1275] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:00:38.978356  1539 leader_election.cc:304] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:38.979682  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:38.993144  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:38.993664  1651 raft_consensus.cc:3060] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:38.967854  6249 raft_consensus.cc:515] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:38.977414  6066 raft_consensus.cc:515] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:38.998652  6066 leader_election.cc:290] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:38.979478  6045 raft_consensus.cc:2749] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:38.958600  6267 raft_consensus.cc:515] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:39.011248  1574 raft_consensus.cc:1275] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:00:38.976336  6288 consensus_queue.cc:1048] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 13:00:39.077455  6163 raft_consensus.cc:515] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:39.084756  1542 leader_election.cc:304] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:39.085680  6044 raft_consensus.cc:2749] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:39.086313  6320 raft_consensus.cc:2804] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:39.086822  6320 raft_consensus.cc:493] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:39.087160  6320 raft_consensus.cc:3060] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:39.095475  1568 raft_consensus.cc:3060] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:39.103166  1651 raft_consensus.cc:2468] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 8.
I20260709 13:00:39.011426  6263 consensus_queue.cc:1048] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.095s
I20260709 13:00:39.092849  5644 consensus_queue.cc:237] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:39.106314  6252 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:39.135262  6254 raft_consensus.cc:493] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:39.135914  6254 raft_consensus.cc:515] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:39.128484  6316 log.cc:927] Time spent T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.205s	user 0.000s	sys 0.002s
W20260709 13:00:39.151295  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.139905  6252 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:39.166426  1716 raft_consensus.cc:2410] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:00:39.155289  6252 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:39.163107  6180 raft_consensus.cc:515] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:39.168226  6005 raft_consensus.cc:3055] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:39.168869  6005 raft_consensus.cc:740] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:39.169842  6005 consensus_queue.cc:260] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:39.171409  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:39.172789  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:39.171545  6005 raft_consensus.cc:3060] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:39.183725  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:00:39.189808  2297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:39.192818  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 106629us
I20260709 13:00:39.234846  1643 raft_consensus.cc:1240] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:00:39.178890  6325 raft_consensus.cc:493] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:39.242288  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:39.246950  1721 raft_consensus.cc:2468] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 12.
I20260709 13:00:39.181021  6003 raft_consensus.cc:493] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.244921  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:39.248988  2327 raft_consensus.cc:1275] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:00:39.252085  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:39.256089  1650 raft_consensus.cc:2468] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 16.
W20260709 13:00:39.257078  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:39.287168  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.214507  6249 leader_election.cc:290] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:39.267985  1723 raft_consensus.cc:2410] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:00:39.271032  1647 raft_consensus.cc:1240] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:00:39.271442  6286 raft_consensus.cc:493] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:39.271932  6262 leader_election.cc:290] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:39.275745  2325 raft_consensus.cc:2468] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 9.
I20260709 13:00:39.276580  6302 raft_consensus.cc:493] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.278303  6028 leader_election.cc:290] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:39.282651  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:00:39.284722  1691 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.239359  6297 raft_consensus.cc:493] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.235579  5959 raft_consensus.cc:493] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
W20260709 13:00:39.267102  1689 connection.cc:256] RPC call timeout handler was delayed by -1.4358079079999584s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1634s for a response
W20260709 13:00:39.313293  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.313407  1649 raft_consensus.cc:1240] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 15. Current term is 16. Ops: [14.11-15.12]
I20260709 13:00:39.317581  1568 raft_consensus.cc:2468] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 8.
I20260709 13:00:39.268450  6069 raft_consensus.cc:493] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:39.346330  1689 connection.cc:256] RPC call timeout handler was delayed by -1.2108079079999357s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1884s for a response
I20260709 13:00:39.350198  1650 raft_consensus.cc:1275] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:39.268571  6003 raft_consensus.cc:515] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:39.350948  6302 raft_consensus.cc:515] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:39.353978  6069 raft_consensus.cc:515] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:39.358712  6326 log.cc:927] Time spent T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 13:00:39.318738  6252 raft_consensus.cc:493] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.364027  6069 leader_election.cc:290] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:39.366428  1650 raft_consensus.cc:1275] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:00:39.283418  6325 raft_consensus.cc:515] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:39.369802  6302 leader_election.cc:290] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:39.370141  6325 leader_election.cc:290] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:39.355767  6254 leader_election.cc:290] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:39.347131  6286 raft_consensus.cc:515] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:39.352411  5959 raft_consensus.cc:515] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:39.390005  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 111732us
W20260709 13:00:39.396684  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.355913  6297 raft_consensus.cc:515] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:39.399438  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:39.405741  1723 raft_consensus.cc:2468] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 10.
I20260709 13:00:39.406452  1650 raft_consensus.cc:1275] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:00:39.408951  1716 raft_consensus.cc:1275] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:00:39.412569  2297 leader_election.cc:304] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 13:00:39.417464  1689 leader_election.cc:304] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 13:00:39.421382  1646 raft_consensus.cc:1240] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:39.426503  1688 leader_election.cc:304] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:39.427907  6254 raft_consensus.cc:2804] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:39.428953  1643 raft_consensus.cc:1275] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:00:39.429219  6254 raft_consensus.cc:697] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 8 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:39.430707  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:39.373103  6252 raft_consensus.cc:515] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:39.434803  2294 leader_election.cc:304] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:39.438673  2294 leader_election.cc:304] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:39.439935  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:39.441771  2294 leader_election.cc:304] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:39.442600  2294 leader_election.cc:304] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:39.448746  2297 leader_election.cc:304] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 13:00:39.450892  1646 raft_consensus.cc:1275] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:00:39.452324  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:39.453629  1650 raft_consensus.cc:2468] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 7.
I20260709 13:00:39.436708  5976 raft_consensus.cc:2764] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:00:39.440958  6069 raft_consensus.cc:2804] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:39.457523  5959 leader_election.cc:290] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:39.445880  6225 raft_consensus.cc:2804] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:39.436095  6180 leader_election.cc:290] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:39.443845  5949 raft_consensus.cc:2749] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:00:39.467842  6297 leader_election.cc:290] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:00:39.497502  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 54960.7us
I20260709 13:00:39.503841  2294 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
W20260709 13:00:39.498958  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 50251.9us
I20260709 13:00:39.444173  6028 raft_consensus.cc:493] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:39.447305  5946 raft_consensus.cc:2804] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:39.467842  6320 raft_consensus.cc:515] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:39.524343  2294 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:39.531243  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:39.487423  6069 raft_consensus.cc:493] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.497117  6225 raft_consensus.cc:493] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.440280  6038 consensus_queue.cc:1048] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:00:39.539495  6003 leader_election.cc:290] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:39.536360  2294 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:39.504900  6001 raft_consensus.cc:2804] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:39.544796  6001 raft_consensus.cc:493] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.545181  6001 raft_consensus.cc:3060] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:39.546630  6005 raft_consensus.cc:2804] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:00:39.547253  6005 raft_consensus.cc:697] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:39.445227  6254 consensus_queue.cc:237] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:39.536799  5948 consensus_queue.cc:1048] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:00:39.550741  6302 consensus_queue.cc:1048] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:39.527912  6028 raft_consensus.cc:515] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:39.523290  5959 raft_consensus.cc:2804] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:39.553356  6320 leader_election.cc:290] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:39.529136  6297 raft_consensus.cc:2804] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:39.553813  6286 leader_election.cc:290] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:39.554191  6069 raft_consensus.cc:3060] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:39.554322  6180 raft_consensus.cc:493] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.535704  5949 raft_consensus.cc:2804] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:00:39.556509  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.522955  5946 raft_consensus.cc:493] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.567840  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:39.544796  6225 raft_consensus.cc:3060] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:39.570834  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 117534us
I20260709 13:00:39.575368  1719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2427) took 1083 ms. Trace:
W20260709 13:00:39.591213  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 141345us
I20260709 13:00:39.548360  6005 consensus_queue.cc:237] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:39.579468  6318 log.cc:927] Time spent T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.566s	user 0.002s	sys 0.000s
I20260709 13:00:39.570020  6231 raft_consensus.cc:493] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.564679  5959 raft_consensus.cc:493] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:39.582597  6330 log.cc:927] Time spent T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.244s	user 0.000s	sys 0.002s
I20260709 13:00:39.583101  1645 raft_consensus.cc:2468] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 9.
I20260709 13:00:39.602099  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:39.570586  6297 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:39.581432  5949 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.622184  5948 consensus_queue.cc:1048] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:39.622713  5949 raft_consensus.cc:3060] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:39.608155  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:39.596873  1615 leader_election.cc:304] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:39.624212  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:39.625464  6301 raft_consensus.cc:3055] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:39.625859  6301 raft_consensus.cc:740] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:39.598032  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:39.626659  6301 consensus_queue.cc:260] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:39.598374  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:39.628254  1722 raft_consensus.cc:2410] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:00:39.589874  1719 rpcz_store.cc:276] 0709 13:00:38.492241 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:38.797526 (+305285us) service_pool.cc:224] Handling call
0709 13:00:38.905088 (+107562us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:38.931959 (+ 26871us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:39.575101 (+643142us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b540009bfd0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23ba8ad 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:39.575287 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":246552960}
I20260709 13:00:39.603015  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:39.603148  1723 raft_consensus.cc:1275] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:00:39.630518  1723 pending_rounds.cc:85] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4: Aborting all ops after (but not including) 5
I20260709 13:00:39.630774  1723 pending_rounds.cc:107] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:00:39.631007  1723 raft_consensus.cc:2889] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:39.589515  5946 raft_consensus.cc:3060] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:39.604866  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:39.608875  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:39.612844  6231 raft_consensus.cc:515] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:39.615824  6297 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:39.583415  6180 raft_consensus.cc:515] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:39.620325  1617 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.464s (SENT) [suppressed 27 similar messages]
I20260709 13:00:39.654881  1724 raft_consensus.cc:2410] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:00:39.583648  5926 raft_consensus.cc:493] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:39.653092  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
W20260709 13:00:39.643014  1615 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:39.627745  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 97647.8us
I20260709 13:00:39.654176  1720 raft_consensus.cc:2376] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 13. Re-sending same reply.
I20260709 13:00:39.630062  1716 raft_consensus.cc:2376] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 5. Re-sending same reply.
I20260709 13:00:39.602767  5959 raft_consensus.cc:3060] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:39.622725  6319 log.cc:927] Time spent T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.626s	user 0.003s	sys 0.000s
W20260709 13:00:39.666195  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.661386  1617 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:39.637704  5644 raft_consensus.cc:2804] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:39.633695  6301 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:39.657210  6315 raft_consensus.cc:493] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
W20260709 13:00:39.670647  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 86143.5us
I20260709 13:00:39.673333  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:39.675372  1540 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:39.632959  5976 consensus_queue.cc:1048] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:00:39.679032  1720 raft_consensus.cc:2468] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 5.
I20260709 13:00:39.670802  5644 raft_consensus.cc:493] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.666291  6320 consensus_queue.cc:1048] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 13:00:39.671057  6351 consensus_queue.cc:1048] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:00:39.666373  6045 consensus_queue.cc:1048] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:00:39.664395  6343 consensus_queue.cc:1048] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:00:39.667161  5926 raft_consensus.cc:515] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:39.703624  5644 raft_consensus.cc:3060] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:39.702756  6028 leader_election.cc:290] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:39.671339  6350 consensus_queue.cc:1048] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:00:39.680395  6315 raft_consensus.cc:515] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:39.674644  6352 consensus_queue.cc:1059] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 13:00:39.719224  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:39.714655  1615 leader_election.cc:304] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:39.707903  6264 raft_consensus.cc:2749] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:39.732483  6359 raft_consensus.cc:2749] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:39.732599  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:39.738689  1573 raft_consensus.cc:2393] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 12: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:39.741024  1571 raft_consensus.cc:1275] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:00:39.741020  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:39.740166  1615 leader_election.cc:304] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:39.747759  2330 raft_consensus.cc:1275] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260709 13:00:39.748725  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 87467.5us
I20260709 13:00:39.729686  6028 raft_consensus.cc:493] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.750824  1617 leader_election.cc:304] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:00:39.756640  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 469406us
I20260709 13:00:39.756883  6361 raft_consensus.cc:2764] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader election decision vote started in defunct term 12: won
W20260709 13:00:39.758715  6345 log.cc:927] Time spent T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:00:39.750504  6359 raft_consensus.cc:2804] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:39.760798  6359 raft_consensus.cc:493] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:39.761255  6359 raft_consensus.cc:3060] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:39.760967  5959 raft_consensus.cc:515] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:39.763801  5959 leader_election.cc:290] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:39.766177  5926 leader_election.cc:290] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:39.766919  1691 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:39.766709  1617 leader_election.cc:304] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:39.769660  1617 leader_election.cc:304] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:39.769248  2297 leader_election.cc:304] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 13:00:39.774190  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:39.774785  1724 raft_consensus.cc:3060] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:39.747795  6363 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.790699  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:39.776474  1542 leader_election.cc:304] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:39.792955  6231 leader_election.cc:290] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:39.793614  6231 raft_consensus.cc:3060] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:39.793967  6315 leader_election.cc:290] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:39.794548  6315 raft_consensus.cc:2749] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:39.799242  6267 leader_election.cc:290] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:39.800621  6001 raft_consensus.cc:515] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:39.805289  1570 raft_consensus.cc:2468] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 9.
I20260709 13:00:39.805339  1724 raft_consensus.cc:2468] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 11.
W20260709 13:00:39.802513  6333 log.cc:927] Time spent T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.441s	user 0.001s	sys 0.000s
I20260709 13:00:39.799996  5949 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:39.812425  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:39.813140  1723 raft_consensus.cc:3060] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:39.813069  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:39.813951  1719 raft_consensus.cc:2393] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 9: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:39.809216  1542 leader_election.cc:304] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:39.745285  6358 consensus_queue.cc:1059] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.065s
I20260709 13:00:39.832064  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:39.832383  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:39.825809  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:39.834051  1718 raft_consensus.cc:2468] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 13.
I20260709 13:00:39.802814  6351 raft_consensus.cc:493] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:39.770417  6028 raft_consensus.cc:515] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:39.826433  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:39.828289  6336 consensus_queue.cc:1048] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:00:39.752470  6360 consensus_queue.cc:1048] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 13:00:39.804952  6363 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:39.810848  6343 raft_consensus.cc:2749] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:39.885761  1723 raft_consensus.cc:2468] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 16.
I20260709 13:00:39.836755  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:39.882378  1571 raft_consensus.cc:2468] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 13.
I20260709 13:00:39.837674  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 13:00:39.839094  6321 log.cc:927] Time spent T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.690s	user 0.002s	sys 0.000s
I20260709 13:00:39.839795  6205 leader_election.cc:290] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:39.817998  6001 leader_election.cc:290] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:39.841153  6180 leader_election.cc:290] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:39.842729  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:39.840437  6225 raft_consensus.cc:515] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:39.849552  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:39.833983  5926 raft_consensus.cc:2804] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:39.851161  6288 raft_consensus.cc:493] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:39.810084  6069 raft_consensus.cc:515] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:39.854560  2328 raft_consensus.cc:1240] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:39.855544  5949 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 15 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:39.859210  2325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53306 (request call id 767) took 1091 ms. Trace:
I20260709 13:00:39.903198  2325 rpcz_store.cc:276] 0709 13:00:38.767492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:38.767685 (+   193us) service_pool.cc:224] Handling call
0709 13:00:39.859052 (+1091367us) spinlock_profiling.cc:243] Waited 83.7 ms on lock 0x7b540059a1d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:39.859154 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":192472960}
I20260709 13:00:39.865437  5946 raft_consensus.cc:515] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:39.887377  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 44730.3us
I20260709 13:00:39.836853  6338 raft_consensus.cc:2804] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:00:39.816468  6320 consensus_queue.cc:1048] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 13:00:39.912281  6028 leader_election.cc:290] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:39.914685  6364 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:39.915319  6364 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:39.922457  6038 raft_consensus.cc:493] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:39.922914  6038 raft_consensus.cc:515] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:39.929597  6225 leader_election.cc:290] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:39.933022  6163 leader_election.cc:290] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:39.899075  5926 raft_consensus.cc:493] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:39.935433  5926 raft_consensus.cc:3060] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:39.939874  2327 raft_consensus.cc:1240] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:00:39.943213  6069 leader_election.cc:290] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:39.922914  1647 raft_consensus.cc:1240] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:39.906373  2297 leader_election.cc:304] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 13:00:39.956990  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:39.957803  1719 raft_consensus.cc:3060] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:39.904927  6288 raft_consensus.cc:515] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:39.963201  6363 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:39.910197  6338 raft_consensus.cc:493] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:39.964890  1575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 2371) took 1156 ms. Trace:
I20260709 13:00:39.972074  1572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36642 (request call id 2535) took 1086 ms. Trace:
I20260709 13:00:39.965540  6338 raft_consensus.cc:3060] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:39.975880  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:39.972465  1572 rpcz_store.cc:276] 0709 13:00:38.885860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:38.885974 (+   114us) service_pool.cc:224] Handling call
0709 13:00:38.922241 (+ 36267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:38.938684 (+ 16443us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:39.971897 (+1033213us) spinlock_profiling.cc:243] Waited 36 ms on lock 0x7b54003296d0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23ba8ad 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:39.972020 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":82691328}
W20260709 13:00:39.980222  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 154484us
I20260709 13:00:39.885239  6351 raft_consensus.cc:515] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:39.966032  1575 rpcz_store.cc:276] 0709 13:00:38.808602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:38.813143 (+  4541us) service_pool.cc:224] Handling call
0709 13:00:38.817856 (+  4713us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:38.870847 (+ 52991us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:38.870887 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:38.873754 (+  2867us) log.cc:844] Serialized 52 byte log entry
0709 13:00:39.094801 (+221047us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:39.094860 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:39.094949 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:39.838491 (+743542us) spinlock_profiling.cc:243] Waited 7.57 ms on lock 0x7b4400022b4c. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef1f4c85 00007fa9ef1f56a2 00007fa9f1f671db 00007fa9f1f62aaf 00007fa9f1f5686e 00007fa9f1f55bb6 00007fa9f1f557d8 00007fa9f1f5f221 00007fa9f1f5f1d9 00007fa9f1f5f169
0709 13:00:39.964586 (+126095us) raft_consensus.cc:1685] finished
0709 13:00:39.964608 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:39.964816 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24224,"raft.queue_time_us":25205,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":8374,"spinlock_wait_cycles":17405312,"thread_start_us":169248,"threads_started":1,"wal-append.queue_time_us":232336}
I20260709 13:00:39.992295  1719 raft_consensus.cc:2468] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 13.
I20260709 13:00:39.965886  5949 raft_consensus.cc:2804] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:00:39.997049  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 227438us
I20260709 13:00:39.999584  1542 leader_election.cc:304] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:40.001394  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:40.001969  1650 raft_consensus.cc:2468] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 7.
I20260709 13:00:40.012039  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:40.012705  1647 raft_consensus.cc:2468] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 11.
I20260709 13:00:40.014202  1542 leader_election.cc:304] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
W20260709 13:00:39.999835  1458 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 8e94ee9035214526808abfaab11799fe with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 4dbe7d47a2374afca075d3a98583b49e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:00:39.969515  6263 consensus_queue.cc:1059] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:00:40.029258  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:40.016438  2297 leader_election.cc:304] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 13:00:40.034957  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:40.036252  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:40.036886  1571 raft_consensus.cc:3060] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:40.044848  1643 raft_consensus.cc:2393] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 13: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:40.045254  1542 leader_election.cc:304] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:40.046640  1569 raft_consensus.cc:1275] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:00:40.052049  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:40.011752  5949 raft_consensus.cc:697] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:40.020622  6363 raft_consensus.cc:2804] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:40.058950  1542 leader_election.cc:304] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:40.059563  6267 raft_consensus.cc:493] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:40.060166  6336 raft_consensus.cc:2804] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:40.060324  6295 raft_consensus.cc:493] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:40.064956  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:40.019140  6361 raft_consensus.cc:2749] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:00:40.073720  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:40.030808  6320 raft_consensus.cc:2804] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:40.081952  1542 leader_election.cc:304] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:40.044148  6225 raft_consensus.cc:2804] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:40.087364  1571 raft_consensus.cc:2468] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 13.
I20260709 13:00:40.021530  6180 consensus_queue.cc:1048] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 13:00:40.051015  6231 raft_consensus.cc:2749] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:40.075592  6366 raft_consensus.cc:493] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:40.044219  6311 consensus_queue.cc:1048] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 13:00:40.049683  6315 consensus_queue.cc:1048] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:00:40.124125  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:00:40.129119  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:40.107262  1617 leader_election.cc:304] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:40.078799  6363 raft_consensus.cc:493] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:40.088630  6038 leader_election.cc:290] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:40.120157   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:40.123521  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:40.134694  1617 leader_election.cc:304] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:40.137626  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:40.138448  1721 raft_consensus.cc:2468] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 11.
I20260709 13:00:40.149219  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:40.150175  1721 raft_consensus.cc:2468] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 10.
I20260709 13:00:40.152207  1571 raft_consensus.cc:2468] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 5.
I20260709 13:00:40.154099  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:00:40.167358  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 85477.9us
I20260709 13:00:40.167804  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:40.169232  1719 raft_consensus.cc:2410] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:00:40.169230  1542 leader_election.cc:304] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:40.114755  6225 raft_consensus.cc:697] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:40.091982  6267 raft_consensus.cc:515] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:40.233770  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:40.206187  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:40.208910  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 1942) took 1304 ms. Trace:
I20260709 13:00:40.197799  1617 leader_election.cc:304] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:40.218639  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:40.233784  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:40.232333  5946 leader_election.cc:290] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:40.118909  6336 raft_consensus.cc:697] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:40.105340  6295 raft_consensus.cc:515] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:40.132895  6363 raft_consensus.cc:3060] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:40.118777  6367 raft_consensus.cc:493] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.235252  1723 raft_consensus.cc:2410] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
W20260709 13:00:40.236937  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 67797.5us
I20260709 13:00:40.236383  1617 leader_election.cc:304] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:40.242105  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:40.120010  6368 raft_consensus.cc:3060] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:40.259523  1617 leader_election.cc:304] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:40.198026  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:40.127626  6320 raft_consensus.cc:697] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:40.194881  6371 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.152258  6044 raft_consensus.cc:2749] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:40.172343  6163 raft_consensus.cc:2804] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:00:40.172173  6028 raft_consensus.cc:2804] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:40.253225  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 13:00:40.252313  5644 consensus_meta.cc:287] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.514s	user 0.010s	sys 0.000s
I20260709 13:00:40.258191  1719 raft_consensus.cc:2410] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 10 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
W20260709 13:00:40.251381  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 245297us
I20260709 13:00:40.198493  6360 raft_consensus.cc:2749] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:40.235381  1642 rpcz_store.cc:276] 0709 13:00:38.905683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:38.905830 (+   147us) service_pool.cc:224] Handling call
0709 13:00:38.923963 (+ 18133us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:38.933789 (+  9826us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:39.718325 (+784536us) spinlock_profiling.cc:243] Waited 1.57 ms on lock 0x7b1800336520. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef2b0e07 00007fa9f810bab9 00007fa9ef2cd69b 00007fa9ef2cb93f 00007fa9ef2cb455 00007fa9f5db33c7 00007fa9f23c59a7 00007fa9f23d50bf 00007fa9f23d5038
0709 13:00:39.746706 (+ 28381us) log.cc:844] Serialized 14 byte log entry
0709 13:00:40.000624 (+253918us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:40.015855 (+ 15231us) log.cc:844] Serialized 26 byte log entry
0709 13:00:40.016055 (+   200us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:40.016102 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:40.016189 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:40.208593 (+192404us) raft_consensus.cc:1685] finished
0709 13:00:40.208695 (+   102us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:40.208846 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":242664,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":8374,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":20744,"spinlock_wait_cycles":3609984,"thread_start_us":240783,"threads_started":2,"wal-append.queue_time_us":356106}
I20260709 13:00:40.257391  1542 leader_election.cc:304] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
W20260709 13:00:40.271219  1615 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.008s	sys 0.000s
I20260709 13:00:40.260748  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:40.128163  6366 raft_consensus.cc:515] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:40.283350  1615 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.539s	user 0.008s	sys 0.000s
W20260709 13:00:40.284298  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 544176us
I20260709 13:00:40.286549  1647 raft_consensus.cc:1275] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:00:40.287379  6267 leader_election.cc:290] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:40.288501  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:40.291989  1647 raft_consensus.cc:1240] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:40.196800  5949 consensus_queue.cc:237] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:40.293934  6359 consensus_meta.cc:287] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.532s	user 0.008s	sys 0.002s
I20260709 13:00:40.294378  6359 raft_consensus.cc:515] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:40.296605  6369 log.cc:927] Time spent T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
W20260709 13:00:40.300194  6297 consensus_meta.cc:287] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.633s	user 0.009s	sys 0.000s
I20260709 13:00:40.276144  5644 raft_consensus.cc:515] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:40.300906  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:40.273102  6180 raft_consensus.cc:2804] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:40.301424  1571 raft_consensus.cc:1240] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:40.270196  6371 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:40.268007  6028 raft_consensus.cc:493] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:40.302631  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:40.328130  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:40.302088  1644 raft_consensus.cc:1240] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 10. Current term is 11. Ops: []
W20260709 13:00:40.313627  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 56311.4us
I20260709 13:00:40.314399  6336 consensus_queue.cc:237] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:40.281998  6311 raft_consensus.cc:2804] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:40.315706  6225 consensus_queue.cc:237] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:40.325187  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 65730.7us
I20260709 13:00:40.272949  6163 raft_consensus.cc:697] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 16 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:40.332569  1542 leader_election.cc:304] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:40.335620  1542 leader_election.cc:304] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:40.311300  6044 raft_consensus.cc:2749] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:40.331014  6028 raft_consensus.cc:3060] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:40.320753  6047 consensus_queue.cc:1059] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:00:40.260839  6367 raft_consensus.cc:515] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:40.311655  6038 raft_consensus.cc:493] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.356976  6038 raft_consensus.cc:515] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:40.357757  2325 raft_consensus.cc:1240] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:40.359318  1645 raft_consensus.cc:1275] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:40.336463  1617 leader_election.cc:304] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:40.336939  6360 raft_consensus.cc:2749] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:40.364815  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:40.338605  1649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 1953) took 1410 ms. Trace:
I20260709 13:00:40.366573  1649 rpcz_store.cc:276] 0709 13:00:38.927794 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:38.977154 (+ 49360us) service_pool.cc:224] Handling call
0709 13:00:39.290602 (+313448us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:39.351542 (+ 60940us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:40.338391 (+986849us) spinlock_profiling.cc:243] Waited 305 ms on lock 0x7b54002b4650. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23ba8ad 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:40.338537 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":702024448}
I20260709 13:00:40.339188  6163 consensus_queue.cc:237] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:40.331502  6384 raft_consensus.cc:3060] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:40.344789  6320 consensus_queue.cc:237] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:40.346927  6295 leader_election.cc:290] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:40.335944  2295 leader_election.cc:304] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:40.376253  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:40.377345  2295 leader_election.cc:304] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:40.353590  1542 leader_election.cc:304] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 13:00:40.354799  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:40.356442  1722 raft_consensus.cc:2410] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:00:40.319723  6180 raft_consensus.cc:493] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:40.289963  5926 raft_consensus.cc:515] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:40.363180  6302 raft_consensus.cc:3055] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:40.385102  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:40.372247  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:40.380319  1642 raft_consensus.cc:2393] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 8: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:40.334318  6311 raft_consensus.cc:493] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
W20260709 13:00:40.380671  1691 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:40.359382  6038 leader_election.cc:290] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:40.381039  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:40.397801  6252 leader_election.cc:290] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:40.387580  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:40.398986  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 13:00:40.389314  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 52877.4us
I20260709 13:00:40.399726  1569 raft_consensus.cc:2393] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 11: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:40.400156  1617 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:40.401096  6231 raft_consensus.cc:2749] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:40.391369  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:40.403671  2323 raft_consensus.cc:2468] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 9.
W20260709 13:00:40.378219  6377 log.cc:927] Time spent T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 13:00:40.391142  6302 raft_consensus.cc:740] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:40.384907  6275 raft_consensus.cc:2749] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:40.393918  6079 raft_consensus.cc:2804] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:40.385071  6044 consensus_queue.cc:1048] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:00:40.384907  6180 raft_consensus.cc:3060] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:40.405959  6302 consensus_queue.cc:260] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:40.360956  6359 leader_election.cc:290] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:40.328104  6297 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:40.396734  6311 raft_consensus.cc:3060] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:40.351212  6005 consensus_queue.cc:1048] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 13:00:40.395431  6385 raft_consensus.cc:2749] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:40.412369  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:40.365953  6289 raft_consensus.cc:2804] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:40.416278  1649 raft_consensus.cc:2468] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 10.
I20260709 13:00:40.375473  6338 raft_consensus.cc:515] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:40.413602  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 60115.7us
W20260709 13:00:40.422686  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 141080us
I20260709 13:00:40.364465  6367 leader_election.cc:290] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:40.423832  1576 raft_consensus.cc:1275] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 13:00:40.427349  1689 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:40.423897  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 121279us
I20260709 13:00:40.433219  1688 leader_election.cc:304] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:40.408852  6295 raft_consensus.cc:2804] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:00:40.439105  2326 raft_consensus.cc:1240] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:40.441468  2329 raft_consensus.cc:1240] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 LEADER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:00:40.443635  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:40.444495  1718 raft_consensus.cc:2410] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 10 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:00:40.444594  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:40.445969  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:40.447466  1688 leader_election.cc:304] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:40.452049  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:00:40.450596  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 67338.6us
I20260709 13:00:40.452740  1723 raft_consensus.cc:1240] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:40.413587  6360 consensus_queue.cc:1048] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
W20260709 13:00:40.456347  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 71222.3us
I20260709 13:00:40.458621  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:40.452387  1689 leader_election.cc:304] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:40.423832  6079 raft_consensus.cc:697] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:40.429694  6352 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:40.475018  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:40.485251  2323 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb"
dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
mode: GRACEFUL
new_leader_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:39778
I20260709 13:00:40.498663  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:40.499780  1723 raft_consensus.cc:2393] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 9: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:40.504623  1540 leader_election.cc:304] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:40.505038  6289 raft_consensus.cc:697] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:40.506681  6301 raft_consensus.cc:2804] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:40.507141  6301 raft_consensus.cc:493] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:40.506449  6289 consensus_queue.cc:237] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:40.507553  6301 raft_consensus.cc:3060] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:40.450151  6252 raft_consensus.cc:493] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:40.513338  2323 raft_consensus.cc:606] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 LEADER]: Received request to transfer leadership to TS 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:40.452020  6038 raft_consensus.cc:2804] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:40.457463  6249 raft_consensus.cc:2804] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:40.459786  6361 raft_consensus.cc:493] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
W20260709 13:00:40.512650  6380 log.cc:927] Time spent T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 13:00:40.457659  6295 raft_consensus.cc:697] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:40.503985  6335 raft_consensus.cc:493] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:40.515934  6231 raft_consensus.cc:493] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:40.496919  6045 consensus_queue.cc:1059] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.078s
I20260709 13:00:40.525882  6038 raft_consensus.cc:493] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:40.500926  6358 consensus_queue.cc:1059] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 13:00:40.513007  6352 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:40.571357  6383 raft_consensus.cc:493] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:40.547070  6249 raft_consensus.cc:493] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:40.576597  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:40.578392  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:40.551620  6367 raft_consensus.cc:493] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.591150  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:00:40.591689  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:40.593184  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:40.593685  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:40.593827  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:40.594153  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:40.595212  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:40.595767  1573 raft_consensus.cc:2468] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 9.
I20260709 13:00:40.522630  6356 consensus_queue.cc:1048] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.235s
I20260709 13:00:40.597678  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:40.598228  1568 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 13.
I20260709 13:00:40.598268  1570 raft_consensus.cc:1275] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:00:40.598851  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:00:40.602272  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:40.586215  6038 raft_consensus.cc:3060] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:40.573784  5644 leader_election.cc:290] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:40.606032  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 153711us
I20260709 13:00:40.629613  1689 leader_election.cc:400] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 election: Vote denied by peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373) with higher term. Message: Invalid argument: T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 13. Current term is 14.
I20260709 13:00:40.630023  1689 leader_election.cc:403] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 13:00:40.549316  6252 raft_consensus.cc:515] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:40.607316  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:40.642122  1574 raft_consensus.cc:2468] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 9.
I20260709 13:00:40.568331  6335 raft_consensus.cc:515] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:40.612625  1575 raft_consensus.cc:1275] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:00:40.617250  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:40.618132  1573 raft_consensus.cc:1240] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:40.590076  6249 raft_consensus.cc:3060] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:40.631831  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:40.637302  6359 raft_consensus.cc:493] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.554411  6361 raft_consensus.cc:515] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:40.573699  6231 raft_consensus.cc:515] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:40.597474  6383 raft_consensus.cc:515] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:40.714354  6297 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 15 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:40.603096  6367 raft_consensus.cc:515] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:40.715920  6366 leader_election.cc:290] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:40.721910  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 92444.7us
I20260709 13:00:40.593212  6079 consensus_queue.cc:237] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:40.705418  6388 raft_consensus.cc:2749] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:40.709363  6295 consensus_queue.cc:237] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:40.725898  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:40.744611  1689 leader_election.cc:304] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:40.752969  2323 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb"
dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
mode: GRACEFUL
new_leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:39778
I20260709 13:00:40.622083  6371 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:40.764797  2323 raft_consensus.cc:606] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Received request to transfer leadership to TS 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:40.765444  2323 raft_consensus.cc:614] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:40.754185  2328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32870 (request call id 632) took 1015 ms. Trace:
I20260709 13:00:40.766903  2328 rpcz_store.cc:276] 0709 13:00:39.741535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.745412 (+  3877us) service_pool.cc:224] Handling call
0709 13:00:39.745706 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:39.902462 (+156756us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:40.753863 (+851401us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b54005d84d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:40.754120 (+   257us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":249835904}
I20260709 13:00:40.779569  1689 leader_election.cc:304] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:40.755422  5644 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:40.777650  6366 raft_consensus.cc:2749] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373) with higher term. Message: Invalid argument: T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 13. Current term is 14.
I20260709 13:00:40.734318  6359 raft_consensus.cc:515] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:40.833738  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:40.834729  1645 raft_consensus.cc:2468] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 12.
I20260709 13:00:40.845135  6388 raft_consensus.cc:2749] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:40.847067  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:00:40.848628  6389 log.cc:927] Time spent T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:00:40.849769  6391 raft_consensus.cc:493] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:40.850412  6391 raft_consensus.cc:515] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:40.851086  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:00:40.831374  6368 consensus_meta.cc:287] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.562s	user 0.009s	sys 0.002s
I20260709 13:00:40.852381  1645 raft_consensus.cc:2468] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 13.
W20260709 13:00:40.864182  6393 log.cc:927] Time spent T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
I20260709 13:00:40.865124  6279 raft_consensus.cc:3060] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:00:40.869627  6028 consensus_meta.cc:287] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.520s	user 0.005s	sys 0.005s
I20260709 13:00:40.870076  6028 raft_consensus.cc:515] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:40.874001  6363 consensus_meta.cc:287] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.612s	user 0.009s	sys 0.000s
I20260709 13:00:40.874473  6363 raft_consensus.cc:515] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:40.877503  6231 leader_election.cc:290] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:40.881146  6288 leader_election.cc:290] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:40.882064  6180 raft_consensus.cc:515] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:40.882766  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:40.883397  1642 raft_consensus.cc:3060] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:40.884711  1649 raft_consensus.cc:1240] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:40.884874  1576 raft_consensus.cc:1275] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:00:40.886747  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:40.887945  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:40.888470  1649 raft_consensus.cc:3060] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:40.819160  5644 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:40.872076  6038 raft_consensus.cc:515] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:40.860198  6368 raft_consensus.cc:2749] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:40.862035  6252 leader_election.cc:290] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:40.937361  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 13:00:40.897608  6399 log.cc:927] Time spent T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:00:40.884455  6180 leader_election.cc:290] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:40.872406  6028 leader_election.cc:290] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:00:40.934680  6386 log.cc:927] Time spent T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 13:00:40.933985  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:40.929733  6249 raft_consensus.cc:515] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:40.962713  1568 raft_consensus.cc:1275] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:00:40.942322  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:40.942399  6354 raft_consensus.cc:3055] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:40.943864  6378 raft_consensus.cc:2749] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:00:40.944434  6384 consensus_meta.cc:287] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.559s	user 0.009s	sys 0.000s
I20260709 13:00:40.944358  6402 consensus_queue.cc:1048] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.089s
I20260709 13:00:40.932080  6297 raft_consensus.cc:493] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:40.947117  6311 consensus_meta.cc:287] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.523s	user 0.009s	sys 0.000s
I20260709 13:00:40.948472  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:40.950016  6335 leader_election.cc:290] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:40.965413  6354 raft_consensus.cc:740] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:40.982409  6354 consensus_queue.cc:260] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:40.983054  6301 raft_consensus.cc:515] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:40.983723  6354 raft_consensus.cc:3060] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:40.990512  6038 leader_election.cc:290] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:41.004215  6361 leader_election.cc:290] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:41.006827  6391 leader_election.cc:290] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:41.011137  6249 leader_election.cc:290] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:41.012070  6311 raft_consensus.cc:515] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:41.015019  6311 leader_election.cc:290] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:41.015930  1647 raft_consensus.cc:1240] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:40.959723  6363 leader_election.cc:290] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:41.020996  6359 leader_election.cc:290] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:40.954859  2294 leader_election.cc:304] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:40.942345  5644 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:40.956328  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:40.956183  1649 raft_consensus.cc:2468] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 11.
W20260709 13:00:40.956369  1691 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:40.964411  2330 raft_consensus.cc:3060] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:40.946695  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:41.027596  1643 raft_consensus.cc:2468] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 10.
I20260709 13:00:40.977437  1650 raft_consensus.cc:3060] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:40.980672  6383 leader_election.cc:290] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:41.028716  1645 raft_consensus.cc:2393] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 13: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
W20260709 13:00:41.064443  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:41.094058  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 139286us
I20260709 13:00:41.095131  2294 leader_election.cc:304] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:41.097769  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:41.098456  1649 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:40.970630  6384 raft_consensus.cc:2749] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:41.103502  6302 raft_consensus.cc:3060] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:41.105851  2294 leader_election.cc:304] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:41.106765  2329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32870 (request call id 637) took 1127 ms. Trace:
I20260709 13:00:41.107093  2294 leader_election.cc:304] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:41.108392  5926 leader_election.cc:290] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:41.107141  2329 rpcz_store.cc:276] 0709 13:00:39.978976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.979097 (+   121us) service_pool.cc:224] Handling call
0709 13:00:39.979412 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:40.442054 (+462642us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:41.106534 (+664480us) spinlock_profiling.cc:243] Waited 462 ms on lock 0x7b54006e1c54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:41.106712 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1061840256}
I20260709 13:00:41.109892  6415 raft_consensus.cc:2804] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:41.110298  6415 raft_consensus.cc:493] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:41.110643  6415 raft_consensus.cc:3060] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:41.112855  6367 leader_election.cc:290] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:41.113030  6006 raft_consensus.cc:2749] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:41.113061  6301 leader_election.cc:290] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:41.113517  6367 raft_consensus.cc:2804] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:41.114077  6367 raft_consensus.cc:697] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:41.115042  6367 consensus_queue.cc:237] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:41.125844  1642 raft_consensus.cc:2468] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 15.
I20260709 13:00:41.139153  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:41.139868  1725 raft_consensus.cc:3060] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:41.151358  1642 raft_consensus.cc:1240] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:41.049173  6297 raft_consensus.cc:515] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:41.097124  6383 raft_consensus.cc:493] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:41.154719  2327 raft_consensus.cc:2468] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 10.
I20260709 13:00:41.121604  6275 raft_consensus.cc:2804] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:41.160385  6275 raft_consensus.cc:493] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:41.160913  6275 raft_consensus.cc:3060] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:41.172828  6275 raft_consensus.cc:515] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:41.175634  6275 leader_election.cc:290] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:41.144937  1649 raft_consensus.cc:2468] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 15.
I20260709 13:00:41.172819  6383 raft_consensus.cc:515] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:41.182044  1650 raft_consensus.cc:2410] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:00:41.195212  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45148 (request call id 2482) took 1285 ms. Trace:
I20260709 13:00:41.182422  6352 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:41.159802  2330 raft_consensus.cc:2468] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 16.
I20260709 13:00:41.160805  2323 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f"
dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
mode: GRACEFUL
new_leader_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:39778
I20260709 13:00:41.200462  2323 raft_consensus.cc:606] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Received request to transfer leadership to TS 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:41.200860  2323 raft_consensus.cc:614] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:00:41.188371  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:41.195683  1644 rpcz_store.cc:276] 0709 13:00:39.909951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.910114 (+   163us) service_pool.cc:224] Handling call
0709 13:00:39.910408 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:40.335748 (+425340us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:41.194915 (+859167us) spinlock_profiling.cc:243] Waited 391 ms on lock 0x7b54001f8e54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:41.195140 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":900315008}
I20260709 13:00:41.190074  1725 raft_consensus.cc:2468] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 6.
W20260709 13:00:41.198580  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:41.200668  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:41.204572  1650 raft_consensus.cc:3060] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:41.202466  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 95449us
I20260709 13:00:41.205420  2294 leader_election.cc:304] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:41.198231  1719 raft_consensus.cc:1275] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:00:41.199069  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 387997us
I20260709 13:00:41.210446  1689 leader_election.cc:304] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:41.208444  1688 leader_election.cc:304] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:41.214231  1689 leader_election.cc:304] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:41.193477  6301 raft_consensus.cc:493] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.217093  1644 raft_consensus.cc:1275] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:00:41.217063  2294 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:41.225449  1688 leader_election.cc:304] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:41.227110  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:41.230665  1642 raft_consensus.cc:2393] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 12: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:41.231890  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:41.235721  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:41.238327  1650 raft_consensus.cc:2468] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 9.
I20260709 13:00:41.215581  6275 raft_consensus.cc:2804] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:41.239862  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:41.237676  1689 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:41.244350  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:41.240769  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:41.226588  6147 raft_consensus.cc:2804] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:41.246306  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:41.269032  1689 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:41.229471  6396 raft_consensus.cc:2804] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:41.242839  1719 raft_consensus.cc:2468] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 8.
I20260709 13:00:41.249495  6383 leader_election.cc:290] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:41.250113  6297 leader_election.cc:290] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:41.221452  6411 raft_consensus.cc:2749] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:41.253572  6422 raft_consensus.cc:2804] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:41.254041  6288 consensus_queue.cc:1048] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:41.255164  6415 raft_consensus.cc:515] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:41.257972  1644 raft_consensus.cc:1275] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:41.279191  2297 leader_election.cc:304] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 13:00:41.234272  6038 raft_consensus.cc:2804] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:41.229895  6301 raft_consensus.cc:515] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:41.286739  6038 raft_consensus.cc:493] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:41.287179  6038 raft_consensus.cc:3060] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:41.239593  6295 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.288489  6301 leader_election.cc:290] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:41.288857  6295 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:41.270339  1650 raft_consensus.cc:1275] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:00:41.270944  1689 leader_election.cc:304] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:41.272948  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:41.289897  2329 raft_consensus.cc:1240] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:41.270077  5644 raft_consensus.cc:493] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:41.242647  6275 raft_consensus.cc:493] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:41.283288  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:41.278724  6147 raft_consensus.cc:697] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:41.292596  6295 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:41.300396  1725 raft_consensus.cc:2393] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 9: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:41.277243  6396 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:41.339152  2297 leader_election.cc:304] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 13:00:41.302066  1689 leader_election.cc:304] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:41.278524  6302 raft_consensus.cc:2749] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:41.278719  6378 raft_consensus.cc:2804] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:41.326819  1646 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c"
dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
mode: GRACEFUL
new_leader_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:35470
I20260709 13:00:41.284747  6422 raft_consensus.cc:493] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:41.358736  1646 raft_consensus.cc:606] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 11 LEADER]: Received request to transfer leadership to TS 0c7751452c4b46afa95251b9df7169d4
W20260709 13:00:41.359858  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 57857.2us
I20260709 13:00:41.356982  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:41.360798  1689 leader_election.cc:304] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:41.302809  6275 raft_consensus.cc:3060] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:41.302666  6297 raft_consensus.cc:2804] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:00:41.375784  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:41.376952  6425 log.cc:927] Time spent T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:00:41.354697  6396 raft_consensus.cc:3060] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:41.355455  6426 raft_consensus.cc:2804] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:00:41.386571  1458 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 8e94ee9035214526808abfaab11799fe with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 4dbe7d47a2374afca075d3a98583b49e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:00:41.358320  6378 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:41.387990  2329 raft_consensus.cc:1240] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:41.388947  1644 raft_consensus.cc:1240] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:41.358093  6411 raft_consensus.cc:2749] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:41.301479  5644 raft_consensus.cc:515] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:41.303954  6420 consensus_queue.cc:1048] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.083s
I20260709 13:00:41.369261  6422 raft_consensus.cc:3060] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:41.381156  6302 raft_consensus.cc:2804] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:41.417956  2326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32870 (request call id 641) took 1062 ms. Trace:
I20260709 13:00:41.388728  6426 raft_consensus.cc:493] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:41.391762  6378 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:41.387720  6297 raft_consensus.cc:697] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:41.418394  2326 rpcz_store.cc:276] 0709 13:00:40.355382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.355523 (+   141us) service_pool.cc:224] Handling call
0709 13:00:40.377366 (+ 21843us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:40.444213 (+ 66847us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:41.417716 (+973503us) spinlock_profiling.cc:243] Waited 61.5 ms on lock 0x7b54006ad454. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:41.417881 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":141415168}
I20260709 13:00:41.445290  6374 raft_consensus.cc:493] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.445904  6374 raft_consensus.cc:515] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:41.410342  6302 raft_consensus.cc:493] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:41.380914  6147 consensus_queue.cc:237] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:41.423668  6411 raft_consensus.cc:2749] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:41.424257  6426 raft_consensus.cc:3060] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:41.456911  6427 log.cc:927] Time spent T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
W20260709 13:00:41.559180  6424 log.cc:927] Time spent T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
I20260709 13:00:41.454680  6302 raft_consensus.cc:3060] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:41.571645  6364 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:41.566555  1615 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:00:41.455716  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 95037.5us
I20260709 13:00:41.454941  6297 consensus_queue.cc:237] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:41.594936  6415 leader_election.cc:290] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:41.595709  6374 leader_election.cc:290] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:41.596294  6374 consensus_queue.cc:1059] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:41.617224  2294 leader_election.cc:304] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:41.618794  2294 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:41.620985  5959 raft_consensus.cc:2749] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:41.621677  5959 raft_consensus.cc:2804] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:41.622169  5959 raft_consensus.cc:697] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:41.623189  5959 consensus_queue.cc:237] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:41.629627  6343 raft_consensus.cc:3055] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:41.630159  6343 raft_consensus.cc:740] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:41.631114  6343 consensus_queue.cc:260] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:41.634146  6003 consensus_queue.cc:1048] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:00:41.634979  6378 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:41.643003  6351 leader_election.cc:290] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:41.632398  6343 raft_consensus.cc:3060] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:41.646802  6005 consensus_queue.cc:1048] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:00:41.653756  1721 raft_consensus.cc:1275] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:00:41.653421  6038 raft_consensus.cc:515] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:41.655548  1720 raft_consensus.cc:1240] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:00:41.660799  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:41.672415  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:41.658618  2328 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260"
dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
mode: GRACEFUL
new_leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:39778
I20260709 13:00:41.602814  6344 raft_consensus.cc:493] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.575730  6301 raft_consensus.cc:493] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:41.597371  6374 consensus_queue.cc:1048] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 13:00:41.686532  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:41.687590  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:41.691828  1721 raft_consensus.cc:2468] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 10.
I20260709 13:00:41.693141  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:41.693813  1721 raft_consensus.cc:3060] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:41.701720  1721 raft_consensus.cc:2468] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 11.
I20260709 13:00:41.702682  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:41.705974  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:41.707918  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:41.718768  1722 raft_consensus.cc:3060] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:41.719297  2332 raft_consensus.cc:2393] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 9: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 13:00:41.707818  1542 leader_election.cc:304] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:41.708998  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:41.720548  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:41.709661  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:41.712082  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:41.602571  6364 consensus_queue.cc:1048] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.082s
I20260709 13:00:41.690479  6028 raft_consensus.cc:493] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.678473  6351 raft_consensus.cc:3055] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:41.673200  6410 raft_consensus.cc:493] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:41.717054  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:41.724974  1542 leader_election.cc:304] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
W20260709 13:00:41.769480  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 44601us
I20260709 13:00:41.724514  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:41.770934  1568 raft_consensus.cc:2468] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 12.
I20260709 13:00:41.666505  6163 raft_consensus.cc:3060] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:41.762005  1718 raft_consensus.cc:2393] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 9: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:41.763300  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:41.766990  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:41.767163  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:41.767271  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:41.767895  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:41.767952  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:00:41.775977  1689 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:41.779008  1617 leader_election.cc:304] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:41.780927  1569 raft_consensus.cc:2368] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 12. Current term is 13.
I20260709 13:00:41.781960  1689 leader_election.cc:304] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:41.783120  1573 raft_consensus.cc:2468] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 11.
I20260709 13:00:41.691058  6344 raft_consensus.cc:515] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:41.801471  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:41.802234  2325 raft_consensus.cc:2376] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 9. Re-sending same reply.
I20260709 13:00:41.800078  1689 leader_election.cc:304] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:41.714573  6005 consensus_queue.cc:1048] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
W20260709 13:00:41.767557  6428 log.cc:927] Time spent T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.345s	user 0.000s	sys 0.001s
W20260709 13:00:41.800513  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 234053us
I20260709 13:00:41.806336  1689 leader_election.cc:304] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:41.815521  1722 raft_consensus.cc:2468] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 14.
I20260709 13:00:41.817504  1615 leader_election.cc:304] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:41.818948  1567 raft_consensus.cc:2468] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 13.
I20260709 13:00:41.718094  6301 raft_consensus.cc:515] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:41.765138  6351 raft_consensus.cc:740] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:41.807758  6429 raft_consensus.cc:2749] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:41.809037  6402 raft_consensus.cc:2749] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:41.810091  6406 raft_consensus.cc:2749] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:41.818609  5644 leader_election.cc:290] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:41.818624  6263 raft_consensus.cc:493] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:41.854121  5976 raft_consensus.cc:3055] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:41.766654  6028 raft_consensus.cc:515] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:41.832454  6374 raft_consensus.cc:2749] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:00:41.880849  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:41.784189  6410 raft_consensus.cc:515] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:41.858182  5976 raft_consensus.cc:740] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
W20260709 13:00:41.860138  6430 log.cc:927] Time spent T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:00:41.868721  6038 leader_election.cc:290] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:41.869179  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:41.870988  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 1961) took 1578 ms. Trace:
I20260709 13:00:41.922070  1647 rpcz_store.cc:276] 0709 13:00:40.293068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.293188 (+   120us) service_pool.cc:224] Handling call
0709 13:00:40.293475 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:41.016492 (+723017us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:41.870645 (+854153us) spinlock_profiling.cc:243] Waited 722 ms on lock 0x7b54001d9a54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:41.870917 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1660949760}
I20260709 13:00:41.925232  6442 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
W20260709 13:00:41.925619  6366 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.081s	user 0.010s	sys 0.055s
W20260709 13:00:41.925985  6366 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.081s	user 0.010s	sys 0.055s
I20260709 13:00:41.925918  6442 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:41.927682  6372 raft_consensus.cc:2804] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:41.928278  6372 raft_consensus.cc:493] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:41.928750  6372 raft_consensus.cc:3060] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:41.929998  2324 raft_consensus.cc:2393] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 9: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 13:00:41.878922  6295 consensus_queue.cc:1059] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:00:41.941232  6147 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:41.942093  6147 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:41.882311  6388 consensus_queue.cc:1059] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.089s
I20260709 13:00:41.971935  6374 raft_consensus.cc:3055] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:41.972450  6374 raft_consensus.cc:740] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:41.973536  6374 consensus_queue.cc:260] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:41.974817  6374 raft_consensus.cc:3060] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:41.856901  6406 raft_consensus.cc:2749] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:00:41.949875  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 355996us
I20260709 13:00:41.882756  5926 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.857303  5644 raft_consensus.cc:493] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.852686  1689 leader_election.cc:304] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:00:41.987053  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 169643us
I20260709 13:00:42.008641  1615 leader_election.cc:304] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:41.886473  6397 raft_consensus.cc:493] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.878266  6263 raft_consensus.cc:515] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:42.012496  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 241988us
W20260709 13:00:42.013065  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 161413us
I20260709 13:00:42.040318  1542 leader_election.cc:304] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:42.041834  1542 leader_election.cc:304] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:42.007467  6388 raft_consensus.cc:493] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:41.946369  6351 consensus_queue.cc:260] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:42.043166  1542 leader_election.cc:304] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:42.011221  6438 raft_consensus.cc:2749] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:42.095423  1689 leader_election.cc:304] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:42.021210  6433 raft_consensus.cc:2749] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:00:42.099304  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 56229us
I20260709 13:00:42.013510  5644 raft_consensus.cc:515] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:42.101754  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 224835us
I20260709 13:00:42.010792  6262 consensus_queue.cc:1059] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 13:00:42.006553  6437 consensus_queue.cc:1048] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.105s
I20260709 13:00:41.985304  5976 consensus_queue.cc:260] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:42.089017  6275 consensus_meta.cc:287] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.706s	user 0.008s	sys 0.004s
I20260709 13:00:42.191591  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:42.013474  5926 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:42.020108  6397 raft_consensus.cc:515] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:42.191359  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:42.191830  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:42.286919  1649 raft_consensus.cc:2410] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
W20260709 13:00:42.195410  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 96396.9us
I20260709 13:00:42.092801  6384 raft_consensus.cc:493] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:42.013517  6267 consensus_queue.cc:1059] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.080s
I20260709 13:00:42.216136  1645 raft_consensus.cc:2393] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 9: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:42.094904  6352 raft_consensus.cc:493] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:42.098455  6406 raft_consensus.cc:2749] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:42.287118  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
W20260709 13:00:42.290566  1719 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.004s	sys 0.019s
W20260709 13:00:42.292323  1541 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.008s	sys 0.016s
I20260709 13:00:42.106815  6443 raft_consensus.cc:2749] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:42.298223  1646 raft_consensus.cc:1275] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260709 13:00:42.249320  6445 log.cc:927] Time spent T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 13:00:42.305912  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:00:42.302256  1719 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.004s	sys 0.019s
W20260709 13:00:42.302415  1541 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.008s	sys 0.016s
I20260709 13:00:42.302201  1643 raft_consensus.cc:3060] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:42.321048  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:42.313866  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 305340us
I20260709 13:00:42.090704  6436 consensus_queue.cc:1059] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.204s
I20260709 13:00:42.217458  6452 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.288806  6438 raft_consensus.cc:2804] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:42.288188  6344 leader_election.cc:290] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:42.256704  6448 raft_consensus.cc:993] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e: : Instructing follower 0c7751452c4b46afa95251b9df7169d4 to start an election
I20260709 13:00:42.320007  1644 raft_consensus.cc:2468] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 13.
I20260709 13:00:42.398882  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:00:42.296877  5959 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.006s	sys 0.011s
I20260709 13:00:42.259269  6441 raft_consensus.cc:2804] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:42.097410  6388 raft_consensus.cc:515] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:42.391017  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:42.392621  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:42.289422  6028 leader_election.cc:290] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:42.402086  1644 raft_consensus.cc:2393] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 11: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
W20260709 13:00:42.301015  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.213744  6364 consensus_queue.cc:1059] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.101s
I20260709 13:00:42.253863  6147 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:42.291906  5970 raft_consensus.cc:493] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:42.292649  6460 raft_consensus.cc:493] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.292752  6301 leader_election.cc:290] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:42.300820  6262 raft_consensus.cc:2749] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:42.306354  6267 consensus_queue.cc:1243] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer 05476b84d8f84d76a9a1f51b620a3c66 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260709 13:00:42.422886  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 132475us
I20260709 13:00:42.506306  1688 leader_election.cc:304] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:42.305286  6352 raft_consensus.cc:515] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:42.217370  6275 raft_consensus.cc:515] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:42.483983  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 182912us
I20260709 13:00:42.489625  1646 raft_consensus.cc:2393] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 14: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
W20260709 13:00:42.408182  5959 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.006s	sys 0.012s
W20260709 13:00:42.494350  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 189454us
W20260709 13:00:42.501626  6435 log.cc:927] Time spent T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.406s	user 0.000s	sys 0.001s
I20260709 13:00:42.502180  6397 leader_election.cc:290] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:42.400955  6438 raft_consensus.cc:493] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:42.510645  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 913) took 1632 ms. Trace:
W20260709 13:00:42.537824  1542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:42.401324  6422 consensus_meta.cc:287] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.979s	user 0.012s	sys 0.000s
I20260709 13:00:42.402609  6366 raft_consensus.cc:3055] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:42.402932  6442 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:42.469568  6344 raft_consensus.cc:493] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:42.536391  1642 rpcz_store.cc:276] 0709 13:00:40.878385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.231463 (+353078us) service_pool.cc:224] Handling call
0709 13:00:41.244698 (+ 13235us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:41.256067 (+ 11369us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:41.293944 (+ 37877us) log.cc:844] Serialized 14 byte log entry
0709 13:00:41.783941 (+489997us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:41.830797 (+ 46856us) log.cc:844] Serialized 52 byte log entry
0709 13:00:41.830952 (+   155us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:41.831242 (+   290us) log.cc:844] Serialized 14 byte log entry
0709 13:00:42.008324 (+177082us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.008392 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:42.510432 (+502040us) raft_consensus.cc:1685] finished
0709 13:00:42.510453 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:42.510589 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45990,"prepare.queue_time_us":38289,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":2296,"raft.queue_time_us":312588,"raft.run_cpu_time_us":413,"raft.run_wall_time_us":50311,"thread_start_us":572983,"threads_started":3,"wal-append.queue_time_us":396171}
I20260709 13:00:42.310225  6433 consensus_queue.cc:1048] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.186s
I20260709 13:00:42.548951  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:42.564463  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:42.551615  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:42.387612  6384 raft_consensus.cc:515] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:42.553416  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 47203.4us
I20260709 13:00:42.493141  5926 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:42.558703  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
W20260709 13:00:42.562414  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 467173us
I20260709 13:00:42.567734  2330 raft_consensus.cc:1240] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 10. Current term is 12. Ops: []
I20260709 13:00:42.534828  6301 raft_consensus.cc:493] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:42.581426  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:42.583112  2324 raft_consensus.cc:1240] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:00:42.583396  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:42.583940  2326 raft_consensus.cc:2468] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 12.
I20260709 13:00:42.544683  6410 leader_election.cc:290] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:42.409363  6452 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:42.544028  6438 raft_consensus.cc:3060] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:42.591220  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
W20260709 13:00:42.588418  1689 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:42.588109  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:42.559257  6262 raft_consensus.cc:493] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.553221  6441 raft_consensus.cc:697] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 9 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:42.631009  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:42.618821  1689 leader_election.cc:304] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:42.554922  6366 raft_consensus.cc:740] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:42.630326  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:42.565167  6028 raft_consensus.cc:1081] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 11 LEADER]: Signalling peer 0c7751452c4b46afa95251b9df7169d4 to start an election
I20260709 13:00:42.630810  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:42.632555  1573 raft_consensus.cc:3060] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:42.559613  6397 raft_consensus.cc:2804] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:42.639038  1724 raft_consensus.cc:2393] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 9: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:42.641307  1689 leader_election.cc:304] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:42.643018  6446 raft_consensus.cc:3055] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:00:42.643426  6446 raft_consensus.cc:740] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:42.646744  1574 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 13.
I20260709 13:00:42.647280  1689 leader_election.cc:400] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373) with higher term. Message: Invalid argument: T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 12. Current term is 13.
I20260709 13:00:42.647676  1689 leader_election.cc:403] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:42.505246  5970 raft_consensus.cc:515] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:42.652727  1689 leader_election.cc:304] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:42.655812  1642 raft_consensus.cc:2393] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 13: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:42.553965  6422 raft_consensus.cc:515] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:42.673184  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:42.576627  6344 raft_consensus.cc:515] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:42.683162  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:42.582737  6436 consensus_queue.cc:1059] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 13:00:42.689440  1724 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 9.
I20260709 13:00:42.688665  2326 raft_consensus.cc:1240] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 LEADER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 5. Current term is 6. Ops: []
I20260709 13:00:42.693923  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:42.699071  2327 raft_consensus.cc:2468] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 9.
I20260709 13:00:42.511330  6460 raft_consensus.cc:515] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:42.704802  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:42.650213  6402 raft_consensus.cc:2749] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:42.589886  6301 raft_consensus.cc:515] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:42.708847  6465 raft_consensus.cc:3060] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:00:42.672379  6047 raft_consensus.cc:2749] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:42.644224  6263 leader_election.cc:290] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:42.655014  6364 raft_consensus.cc:2804] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:42.750982  6364 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:42.751427  6364 raft_consensus.cc:3060] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:42.661237  6397 raft_consensus.cc:697] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 9 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:42.721171  6460 leader_election.cc:290] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:42.720263  6459 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.640431  6262 raft_consensus.cc:515] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:42.258790  6429 consensus_queue.cc:1175] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4dbe7d47a2374afca075d3a98583b49e" responder_term: 12 status { last_received { term: 11 index: 8 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 11. Current term is 12. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:00:42.759452  6461 raft_consensus.cc:493] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:42.759196  6459 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:42.759980  6461 raft_consensus.cc:515] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:42.760720  6262 leader_election.cc:290] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:42.761495  6459 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:42.721154  6469 consensus_queue.cc:1048] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.139s
I20260709 13:00:42.721946  6471 raft_consensus.cc:493] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:42.703318  1574 raft_consensus.cc:1240] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:42.727808  1643 raft_consensus.cc:2468] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 10.
I20260709 13:00:42.687784  6384 leader_election.cc:290] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:42.706569  6443 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:42.691251  6286 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:42.737876  2326 raft_consensus.cc:1240] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 LEADER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 13:00:42.741159  1573 raft_consensus.cc:2468] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 10.
I20260709 13:00:42.721181  6275 leader_election.cc:290] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:00:42.719348  6163 consensus_meta.cc:287] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.934s	user 0.004s	sys 0.004s
I20260709 13:00:42.712044  5644 leader_election.cc:290] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:42.797644  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:42.654594  6446 consensus_queue.cc:260] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:42.766937  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 13:00:42.773244  6419 log.cc:927] Time spent T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 1.649s	user 0.065s	sys 0.077s
I20260709 13:00:42.773730  6471 raft_consensus.cc:515] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:42.780676  6461 leader_election.cc:290] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:42.809736  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:42.808576  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:42.800967  6163 raft_consensus.cc:2749] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:42.823134  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:42.832249  1725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2466) took 1229 ms. Trace:
I20260709 13:00:42.832764  1725 rpcz_store.cc:276] 0709 13:00:41.590224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.590725 (+   501us) service_pool.cc:224] Handling call
0709 13:00:41.591097 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:41.807541 (+216444us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:41.807573 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:41.811606 (+  4033us) log.cc:844] Serialized 26 byte log entry
0709 13:00:42.091197 (+279591us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:42.091253 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.091347 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:42.818519 (+727172us) raft_consensus.cc:1685] finished
0709 13:00:42.818549 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:42.818683 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":63600,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":25239,"thread_start_us":422689,"threads_started":2,"wal-append.queue_time_us":893026}
I20260709 13:00:42.834626  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:42.835270  2328 raft_consensus.cc:606] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 LEADER]: Received request to transfer leadership to TS 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:42.840965  1643 raft_consensus.cc:2468] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 6.
I20260709 13:00:42.816735  6446 raft_consensus.cc:3060] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:42.801184  6286 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:42.835871  6455 log.cc:927] Time spent T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:00:42.864684  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:42.815326  6397 consensus_queue.cc:237] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:42.870688  1573 raft_consensus.cc:3055] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:42.871062  1573 raft_consensus.cc:740] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:42.757061  6441 consensus_queue.cc:237] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:42.801285  6443 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:42.867251  6468 log.cc:927] Time spent T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:00:42.871763  1573 consensus_queue.cc:260] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:42.921922  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
W20260709 13:00:42.922876  6407 log.cc:927] Time spent T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 1.931s	user 0.000s	sys 0.014s
W20260709 13:00:42.925632  6419 log.cc:927] Time spent T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:00:42.925062  1719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2468) took 1327 ms. Trace:
W20260709 13:00:42.879837  6374 consensus_meta.cc:287] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.905s	user 0.015s	sys 0.000s
I20260709 13:00:42.941617  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:42.872640  6452 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:00:42.880059  6450 log.cc:927] Time spent T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.340s	user 0.000s	sys 0.001s
I20260709 13:00:42.949445  1719 rpcz_store.cc:276] 0709 13:00:41.598076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.598322 (+   246us) service_pool.cc:224] Handling call
0709 13:00:41.601994 (+  3672us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:41.661758 (+ 59764us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:41.661807 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:41.662371 (+   564us) log.cc:844] Serialized 52 byte log entry
0709 13:00:42.321305 (+658934us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:42.321345 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.321502 (+   157us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:42.924798 (+603296us) raft_consensus.cc:1685] finished
0709 13:00:42.924821 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:42.924998 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53160,"raft.queue_time_us":74663,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":6914,"thread_start_us":602748,"threads_started":1,"wal-append.queue_time_us":911708}
I20260709 13:00:42.913093  6338 leader_election.cc:290] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:42.960132  1724 raft_consensus.cc:2393] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 14: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:42.969216  1719 raft_consensus.cc:1240] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:42.925774  6344 leader_election.cc:290] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:42.924721  6443 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:42.974221  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1910) took 2523 ms. Trace:
I20260709 13:00:42.963613  6301 leader_election.cc:290] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:42.976030  1717 rpcz_store.cc:276] 0709 13:00:40.450419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.450530 (+   111us) service_pool.cc:224] Handling call
0709 13:00:40.474524 (+ 23994us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:40.783336 (+308812us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:40.783383 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:40.824631 (+ 41248us) log.cc:844] Serialized 26 byte log entry
0709 13:00:40.964456 (+139825us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:41.048570 (+ 84114us) log.cc:844] Serialized 14 byte log entry
0709 13:00:41.048910 (+   340us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:41.049027 (+   117us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:42.630968 (+1581941us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b4400022b4c. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef1f4c85 00007fa9ef1f56a2 00007fa9f1f671db 00007fa9f1f62aaf 00007fa9f1f5686e 00007fa9f1f55bb6 00007fa9f1f557d8 00007fa9f1f5f221 00007fa9f1f5f1d9 00007fa9f1f5f169
0709 13:00:42.973478 (+342510us) raft_consensus.cc:1685] finished
0709 13:00:42.973970 (+   492us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:42.974130 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1577,"prepare.queue_time_us":69349,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":137490,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":77,"spinlock_wait_cycles":40486016,"thread_start_us":420413,"threads_started":2,"wal-append.queue_time_us":294654}
W20260709 13:00:42.984338  6444 log.cc:927] Time spent T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:00:42.984540  6378 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:42.984653  6400 raft_consensus.cc:3055] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:42.986979  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:42.996811  1648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 1967) took 2662 ms. Trace:
I20260709 13:00:42.997807  6388 leader_election.cc:290] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:42.997951  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:42.998576  1574 raft_consensus.cc:2468] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 12.
I20260709 13:00:42.999187  6465 raft_consensus.cc:2749] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373) with higher term. Message: Invalid argument: T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 12. Current term is 13.
I20260709 13:00:42.970976  6374 raft_consensus.cc:493] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
W20260709 13:00:42.991418  6413 log.cc:927] Time spent T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 2.136s	user 0.020s	sys 0.025s
W20260709 13:00:42.992034  6302 consensus_meta.cc:287] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 1.418s	user 0.011s	sys 0.001s
I20260709 13:00:43.000864  6302 raft_consensus.cc:515] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:43.002549  2323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53306 (request call id 776) took 1718 ms. Trace:
I20260709 13:00:43.003705  1721 raft_consensus.cc:1240] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:43.002916  2323 rpcz_store.cc:276] 0709 13:00:41.283689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.283814 (+   125us) service_pool.cc:224] Handling call
0709 13:00:41.877270 (+593456us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:42.101325 (+224055us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:42.101373 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:42.111535 (+ 10162us) log.cc:844] Serialized 26 byte log entry
0709 13:00:42.484878 (+373343us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:42.484912 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:42.484975 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:42.919038 (+434063us) raft_consensus.cc:1685] finished
0709 13:00:42.919059 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:43.002299 (+ 83240us) spinlock_profiling.cc:243] Waited 590 ms on lock 0x7b54006ac7d0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23ba8ad 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:43.002491 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3555,"raft.queue_time_us":136181,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":62669,"spinlock_wait_cycles":1357777664,"thread_start_us":385008,"threads_started":2,"wal-append.queue_time_us":257653}
I20260709 13:00:43.004779  1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2480) took 1298 ms. Trace:
I20260709 13:00:43.004729  2295 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:43.005385  6471 leader_election.cc:290] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:43.005591  6297 raft_consensus.cc:2804] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:43.006047  6297 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:43.006381  6297 raft_consensus.cc:3060] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:42.997228  1648 rpcz_store.cc:276] 0709 13:00:40.334009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:40.414736 (+ 80727us) service_pool.cc:224] Handling call
0709 13:00:40.430583 (+ 15847us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:40.502018 (+ 71435us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:40.502057 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:40.548381 (+ 46324us) log.cc:844] Serialized 26 byte log entry
0709 13:00:40.784767 (+236386us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:40.784851 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:40.784929 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:42.871209 (+2086280us) spinlock_profiling.cc:243] Waited 11 ms on lock 0x7b4400022b4c. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef1f4c85 00007fa9ef1f56a2 00007fa9f1f671db 00007fa9f1f62aaf 00007fa9f1f5686e 00007fa9f1f55bb6 00007fa9f1f557d8 00007fa9f1f5f221 00007fa9f1f5f1d9 00007fa9f1f5f169
0709 13:00:42.996495 (+125286us) raft_consensus.cc:1685] finished
0709 13:00:42.996516 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:42.996738 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16443,"raft.queue_time_us":32255,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":15606,"spinlock_wait_cycles":25379584,"thread_start_us":186928,"threads_started":1,"wal-append.queue_time_us":363157}
I20260709 13:00:43.005787  1722 raft_consensus.cc:1275] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:00:42.992971  6426 consensus_meta.cc:287] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 1.428s	user 0.012s	sys 0.000s
W20260709 13:00:42.973170  6396 consensus_meta.cc:287] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 1.581s	user 0.013s	sys 0.000s
I20260709 13:00:42.993429  1716 raft_consensus.cc:1240] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:43.005223  1721 rpcz_store.cc:276] 0709 13:00:41.706133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.721349 (+ 15216us) service_pool.cc:224] Handling call
0709 13:00:41.780861 (+ 59512us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:43.004103 (+1223242us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:43.004593 (+   490us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54002ab7d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:43.004730 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2811868928}
I20260709 13:00:43.075258  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:43.076193  1648 raft_consensus.cc:2468] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 8.
I20260709 13:00:43.086651  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:43.087509  1648 raft_consensus.cc:2468] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 12.
W20260709 13:00:43.088649  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:43.089777  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:43.000051  6374 raft_consensus.cc:515] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:43.091029  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 69822.8us
I20260709 13:00:42.972991  6364 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:43.206209  6364 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:43.097477  1651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45148 (request call id 2484) took 3099 ms. Trace:
I20260709 13:00:43.208138  1651 rpcz_store.cc:276] 0709 13:00:39.998317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.998696 (+   379us) service_pool.cc:224] Handling call
0709 13:00:40.019630 (+ 20934us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:40.020053 (+   423us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:40.020092 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:40.889140 (+869048us) spinlock_profiling.cc:243] Waited 9.59 ms on lock 0x7b4800043d58. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f72e4aa1 00007fa9f72dbb37 00007fa9f72db9ca 00007fa9f73d326f 00007fa9f73d2f37 00007fa9f73e755c 00007fa9f73e7508 00007fa9f73e7488 00007fa9f73e7443 00007fa9f73e66ec 00007fa9f6310a96
0709 13:00:41.765521 (+876381us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b2c0005c228. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f0cb4a11 00007fa9f0cc4372 00007fa9f23f6a01 00007fa9f23bb43a 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2
0709 13:00:41.782926 (+ 17405us) log.cc:844] Serialized 26 byte log entry
0709 13:00:41.988372 (+205446us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:41.988438 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:41.991715 (+  3277us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:43.097247 (+1105532us) raft_consensus.cc:1685] finished
0709 13:00:43.097271 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:43.097411 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1925,"raft.run_cpu_time_us":1574,"raft.run_wall_time_us":863612,"spinlock_wait_cycles":48177792,"thread_start_us":159185,"threads_started":1,"wal-append.queue_time_us":395707}
I20260709 13:00:43.211241  1651 raft_consensus.cc:1275] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:00:43.000432  6351 raft_consensus.cc:3060] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:43.133137  1648 raft_consensus.cc:3060] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Advancing to term 12
W20260709 13:00:43.236089  1647 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.003s	sys 0.038s
W20260709 13:00:43.236699  1647 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.003s	sys 0.038s
W20260709 13:00:43.215272  1723 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.957s	user 0.018s	sys 0.034s
I20260709 13:00:43.101811  6286 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:43.002868  6302 leader_election.cc:290] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:42.996850  6400 raft_consensus.cc:740] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
W20260709 13:00:43.238233  1570 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.029s	sys 0.029s
W20260709 13:00:43.257537  1570 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.029s	sys 0.029s
W20260709 13:00:43.237947  1723 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.980s	user 0.018s	sys 0.036s
W20260709 13:00:43.100376  6372 consensus_meta.cc:287] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 1.171s	user 0.012s	sys 0.000s
W20260709 13:00:43.253326  2296 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.671s	user 0.027s	sys 0.027s
W20260709 13:00:43.261772  2296 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.027s	sys 0.027s
W20260709 13:00:43.262933  1645 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.013s	sys 0.026s
W20260709 13:00:43.263401  1645 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.013s	sys 0.026s
W20260709 13:00:43.260048  1576 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.011s	sys 0.027s
I20260709 13:00:43.215611  6465 raft_consensus.cc:493] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
W20260709 13:00:43.264991  1576 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.608s	user 0.011s	sys 0.027s
I20260709 13:00:43.266546  1651 raft_consensus.cc:1275] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:00:43.282941  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:43.283823  1576 raft_consensus.cc:2468] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 9.
I20260709 13:00:43.284724  6465 raft_consensus.cc:515] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:43.285560  6374 leader_election.cc:290] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:43.287230  6465 leader_election.cc:290] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:43.262681  6372 raft_consensus.cc:515] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:43.289608  6372 leader_election.cc:290] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:00:43.290482  1567 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36642 (request call id 2564) took 1583 ms (client timeout 2061 ms). Trace:
W20260709 13:00:43.290889  1567 rpcz_store.cc:269] 0709 13:00:41.707421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.707536 (+   115us) service_pool.cc:224] Handling call
0709 13:00:43.290298 (+1582762us) spinlock_profiling.cc:243] Waited 49.8 ms on lock 0x7b54002eb8d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:43.290431 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":114543360}
I20260709 13:00:43.291611  2295 leader_election.cc:304] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:43.292663  6005 raft_consensus.cc:2804] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:43.293087  6005 raft_consensus.cc:493] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:43.293464  6005 raft_consensus.cc:3060] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:43.075065  6396 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:43.075294  6426 raft_consensus.cc:515] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:43.330243  1567 raft_consensus.cc:3055] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:00:43.336926  5949 raft_consensus.cc:493] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:43.346298  1615 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.940s	user 0.009s	sys 0.007s
W20260709 13:00:43.297282  6448 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.749s	user 0.018s	sys 0.064s
I20260709 13:00:43.342490  2326 raft_consensus.cc:1240] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 8. Current term is 9. Ops: []
W20260709 13:00:43.346871  1615 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.941s	user 0.009s	sys 0.008s
I20260709 13:00:43.337128  1576 raft_consensus.cc:1275] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:43.346086  1567 raft_consensus.cc:740] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:43.364612  1567 consensus_queue.cc:260] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:43.365298  6426 leader_election.cc:290] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:00:43.356211  1575 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.032s	sys 0.058s
I20260709 13:00:43.365753  1567 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:00:43.366019  1575 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.033s	sys 0.059s
I20260709 13:00:43.380488  1648 raft_consensus.cc:2468] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 12.
I20260709 13:00:43.368815  2330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53306 (request call id 774) took 2099 ms. Trace:
W20260709 13:00:43.377904  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:43.390596  1689 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:43.370580  2294 leader_election.cc:304] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
W20260709 13:00:43.373780  1539 connection.cc:256] RPC call timeout handler was delayed by -1.0317815719999999s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1946s for a response
W20260709 13:00:43.430019  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:43.390177  1542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:43.430713  1542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:43.361446  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 1.0379e+06us
I20260709 13:00:43.435115  1615 leader_election.cc:304] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:00:43.435580  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 65040.3us
I20260709 13:00:43.436509  2294 leader_election.cc:304] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:43.427820  2330 rpcz_store.cc:276] 0709 13:00:41.276485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.276628 (+   143us) service_pool.cc:224] Handling call
0709 13:00:41.283310 (+  6682us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:42.578565 (+1295255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:43.368560 (+789995us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54005aaad4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:43.368745 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2953426688}
W20260709 13:00:43.437631  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 47117.7us
W20260709 13:00:43.348783  6448 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.839s	user 0.019s	sys 0.064s
I20260709 13:00:43.441560  1689 leader_election.cc:304] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 13:00:43.347937  6456 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.024s	sys 0.056s
I20260709 13:00:43.463617  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:43.446468  6418 raft_consensus.cc:2749] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:43.464411  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:43.465785  6396 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:43.469131  6352 leader_election.cc:290] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:43.473583  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:43.474234  1721 raft_consensus.cc:2468] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 13.
I20260709 13:00:43.434717  6288 raft_consensus.cc:493] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.440621  6289 raft_consensus.cc:493] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:43.483839  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 48786.4us
I20260709 13:00:43.485500  1615 leader_election.cc:304] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:43.374580  6471 raft_consensus.cc:493] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:43.446275  6465 raft_consensus.cc:2804] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:43.440433  6249 raft_consensus.cc:493] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.461266  6350 raft_consensus.cc:2804] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:43.462076  6069 raft_consensus.cc:2749] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:00:43.493798  1458 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 8e94ee9035214526808abfaab11799fe with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 4dbe7d47a2374afca075d3a98583b49e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
W20260709 13:00:43.496006  1646 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.943s	user 0.013s	sys 0.051s
I20260709 13:00:43.490924  6372 raft_consensus.cc:2749] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:00:43.496488  1646 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.944s	user 0.013s	sys 0.051s
W20260709 13:00:43.376072  6438 consensus_meta.cc:287] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.736s	user 0.008s	sys 0.000s
I20260709 13:00:43.487442  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:43.459820  6446 raft_consensus.cc:493] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.479982  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:43.507234  1721 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 12.
W20260709 13:00:43.475358  6456 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.024s	sys 0.056s
I20260709 13:00:43.459213  6374 raft_consensus.cc:493] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:43.502418  2294 leader_election.cc:304] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:43.490123  6452 raft_consensus.cc:2749] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:43.514063  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:00:43.509554  1540 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.594s	user 0.010s	sys 0.101s
W20260709 13:00:43.514753  1540 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.599s	user 0.011s	sys 0.102s
I20260709 13:00:43.515435  1721 raft_consensus.cc:1275] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
W20260709 13:00:43.505702  1569 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.753s	user 0.016s	sys 0.034s
W20260709 13:00:43.515938  1569 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.016s	sys 0.034s
W20260709 13:00:43.515223  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 1.63265e+06us
I20260709 13:00:43.518442  1540 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:43.349954  5949 raft_consensus.cc:515] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:43.488252  6288 raft_consensus.cc:515] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:43.522853  1723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 1213) took 1340 ms. Trace:
I20260709 13:00:43.525995  1723 rpcz_store.cc:276] 0709 13:00:42.182029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.182149 (+   120us) service_pool.cc:224] Handling call
0709 13:00:42.257114 (+ 74965us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:42.257522 (+   408us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:42.257561 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:42.258126 (+   565us) log.cc:844] Serialized 26 byte log entry
0709 13:00:43.258860 (+1000734us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:43.258916 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:43.259018 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:43.522583 (+263565us) raft_consensus.cc:1685] finished
0709 13:00:43.522613 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:43.522779 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":32296,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":4960,"thread_start_us":1000314,"threads_started":1,"wal-append.queue_time_us":1262071}
I20260709 13:00:43.527405  6288 leader_election.cc:290] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:43.529701  5949 leader_election.cc:290] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:43.531806  6356 raft_consensus.cc:2804] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:43.532269  6356 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:43.532709  6356 raft_consensus.cc:3060] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:43.494477  6465 raft_consensus.cc:697] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 13 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
W20260709 13:00:43.537617  6297 consensus_meta.cc:287] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.531s	user 0.009s	sys 0.000s
I20260709 13:00:43.537564  6465 consensus_queue.cc:237] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:43.538098  6297 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:43.518517  6446 raft_consensus.cc:515] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:43.540519  6006 raft_consensus.cc:993] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66: : Instructing follower 0c7751452c4b46afa95251b9df7169d4 to start an election
I20260709 13:00:43.545202  6422 leader_election.cc:290] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:43.540132  6297 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:43.547672  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 929) took 1254 ms. Trace:
I20260709 13:00:43.548457  1647 rpcz_store.cc:276] 0709 13:00:42.293473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.293599 (+   126us) service_pool.cc:224] Handling call
0709 13:00:42.294070 (+   471us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:00:42.492886 (+198816us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:42.492916 (+    30us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:00:42.549536 (+ 56620us) log.cc:844] Serialized 78 byte log entry
0709 13:00:43.237263 (+687727us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:43.255909 (+ 18646us) log.cc:844] Serialized 14 byte log entry
0709 13:00:43.295267 (+ 39358us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:43.295348 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:43.472821 (+177473us) spinlock_profiling.cc:243] Waited 22.1 ms on lock 0x7b1800376780. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef248c0a 00007fa9f8988219 00007fa9f628f58f 00007fa9ef2ce571 00007fa9ef2d07c1 00007fa9ef2d0779 00007fa9ef2d0709 00007fa9ef2d06d1 00007fa9ef2cf9cd
0709 13:00:43.547405 (+ 74584us) raft_consensus.cc:1685] finished
0709 13:00:43.547484 (+    79us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:43.547618 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2597,"prepare.queue_time_us":23575,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":57,"raft.queue_time_us":278941,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":9456,"spinlock_wait_cycles":50926464,"thread_start_us":769144,"threads_started":2,"wal-append.queue_time_us":932046}
I20260709 13:00:43.542605  6446 leader_election.cc:290] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:43.551445  5970 leader_election.cc:290] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:43.491142  6289 raft_consensus.cc:515] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:43.556905  6289 leader_election.cc:290] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:43.495824  6350 raft_consensus.cc:697] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 10 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:43.492241  6249 raft_consensus.cc:515] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:43.561954  1650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45148 (request call id 2496) took 2375 ms. Trace:
I20260709 13:00:43.544839  1539 leader_election.cc:304] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:43.561643  6350 consensus_queue.cc:237] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:43.562536  1650 rpcz_store.cc:276] 0709 13:00:41.186828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.294046 (+107218us) service_pool.cc:224] Handling call
0709 13:00:41.294317 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:41.421870 (+127553us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:41.421890 (+    20us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:41.421916 (+    26us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:41.421948 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:43.561645 (+2139697us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b5400098dd4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:43.561714 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:43.561881 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":292956032}
I20260709 13:00:43.547789  1540 leader_election.cc:304] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:43.557463  2328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:39778 (request call id 28) took 1899 ms. Trace:
I20260709 13:00:43.565636  2328 rpcz_store.cc:276] 0709 13:00:41.658389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.658505 (+   116us) service_pool.cc:224] Handling call
0709 13:00:43.557226 (+1898721us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54006ad454. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23b5853 00007fa9f738360a 00007fa9f09097d4 00007fa9f0909762 00007fa9f0909691 00007fa9f090960c 00007fa9f09088c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:43.557349 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2667918592}
I20260709 13:00:43.572005  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:43.575306  1576 raft_consensus.cc:3060] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:43.576496  1567 raft_consensus.cc:1275] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260709 13:00:43.577231  1567 pending_rounds.cc:85] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting all ops after (but not including) 10
I20260709 13:00:43.577512  1567 pending_rounds.cc:107] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260709 13:00:43.577719  1567 raft_consensus.cc:2889] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:43.579672  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 64421.4us
I20260709 13:00:43.579799  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:43.580567  1723 raft_consensus.cc:2393] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 10: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:43.580472  2294 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:43.495034  6471 raft_consensus.cc:515] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:43.585892  1617 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.004s	user 0.018s	sys 0.025s
W20260709 13:00:43.587893  1617 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.006s	user 0.018s	sys 0.025s
W20260709 13:00:43.588194  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 1.00652e+06us
I20260709 13:00:43.560170  6486 raft_consensus.cc:2749] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:00:43.519376  6448 consensus_queue.cc:1048] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:00:43.580932  6297 raft_consensus.cc:1081] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 LEADER]: Signalling peer 0c7751452c4b46afa95251b9df7169d4 to start an election
I20260709 13:00:43.557399  6374 raft_consensus.cc:515] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:43.593199  1575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36642 (request call id 2571) took 1044 ms. Trace:
I20260709 13:00:43.593858  6301 raft_consensus.cc:2804] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:43.593868  6392 raft_consensus.cc:2804] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:43.346385  6400 consensus_queue.cc:260] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:43.510535  6438 raft_consensus.cc:515] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:43.595772  2294 leader_election.cc:304] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:43.604596  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:43.571138  6069 consensus_queue.cc:1048] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:00:43.593932  6249 leader_election.cc:290] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:43.606357  1723 raft_consensus.cc:1275] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:00:43.609462  1572 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.804s	user 0.005s	sys 0.025s
W20260709 13:00:43.610575  1688 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.940s	user 0.018s	sys 0.053s
I20260709 13:00:43.613854  2328 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def"
dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
mode: GRACEFUL
new_leader_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:39778
I20260709 13:00:43.602466  1575 rpcz_store.cc:276] 0709 13:00:42.548504 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.549835 (+  1331us) service_pool.cc:224] Handling call
0709 13:00:42.566853 (+ 17018us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:42.653130 (+ 86277us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:42.653163 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:42.664395 (+ 11232us) log.cc:844] Serialized 52 byte log entry
0709 13:00:43.427575 (+763180us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:43.441684 (+ 14109us) log.cc:844] Serialized 14 byte log entry
0709 13:00:43.449870 (+  8186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:43.449984 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:43.592979 (+142995us) raft_consensus.cc:1685] finished
0709 13:00:43.593003 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:43.593139 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13807,"prepare.queue_time_us":45509,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":2528,"raft.queue_time_us":72402,"raft.run_cpu_time_us":296,"raft.run_wall_time_us":36319,"thread_start_us":692881,"threads_started":1,"wal-append.queue_time_us":883606}
I20260709 13:00:43.543865  6356 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:43.581643  6289 consensus_queue.cc:1059] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:00:43.644562  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:43.653627  1644 raft_consensus.cc:1240] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:43.642827  1722 raft_consensus.cc:2468] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 6.
I20260709 13:00:43.685632  6366 consensus_queue.cc:260] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:43.686771  6366 raft_consensus.cc:3060] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:43.622689  1576 raft_consensus.cc:2468] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 14.
W20260709 13:00:43.643009  1688 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.973s	user 0.021s	sys 0.053s
I20260709 13:00:43.689410  1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2467) took 2096 ms. Trace:
I20260709 13:00:43.664904  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:43.642616  2328 raft_consensus.cc:606] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Received request to transfer leadership to TS 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:43.691219  1689 leader_election.cc:304] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:43.689845  1720 rpcz_store.cc:276] 0709 13:00:41.593792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:41.594201 (+   409us) service_pool.cc:224] Handling call
0709 13:00:41.594533 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:41.657269 (+ 62736us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:43.689162 (+2031893us) spinlock_profiling.cc:243] Waited 60.7 ms on lock 0x7b5400354654. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:43.689352 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":139579136}
I20260709 13:00:43.712198  2328 raft_consensus.cc:614] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:43.707417  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:43.693241  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:00:43.682228  1572 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.877s	user 0.005s	sys 0.027s
W20260709 13:00:43.609225  6441 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.035s	sys 0.074s
I20260709 13:00:43.712565  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:43.624758  2294 leader_election.cc:304] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:43.643172  6338 raft_consensus.cc:493] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:43.718529  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 93881.4us
W20260709 13:00:43.666770  1571 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.957s	user 0.000s	sys 0.017s
W20260709 13:00:43.736974  1571 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.028s	user 0.000s	sys 0.017s
I20260709 13:00:43.737125  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:43.641716  6486 raft_consensus.cc:2804] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:00:43.717847  6441 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.036s	sys 0.074s
I20260709 13:00:43.651373  6471 leader_election.cc:290] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:43.716022  6452 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.718807  6489 raft_consensus.cc:493] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.727622  6438 leader_election.cc:290] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:43.728366  6374 leader_election.cc:290] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:43.728482  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36642 (request call id 2577) took 1141 ms. Trace:
I20260709 13:00:43.643376  6400 raft_consensus.cc:3060] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:43.616037  6005 raft_consensus.cc:515] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:43.731725  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:00:43.804462  1643 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.810s	user 0.013s	sys 0.030s
W20260709 13:00:43.804910  1643 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.810s	user 0.013s	sys 0.030s
I20260709 13:00:43.663582  6446 raft_consensus.cc:493] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.732381  6249 raft_consensus.cc:493] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.719514  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:43.648851  6356 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:43.720645  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:43.734472  1720 raft_consensus.cc:2410] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 15 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:00:43.608978  6392 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:43.726670  6353 raft_consensus.cc:2804] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:43.739318  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:43.616355  6301 raft_consensus.cc:697] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:43.726176  6437 raft_consensus.cc:493] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
W20260709 13:00:43.722831  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:43.741699  1651 raft_consensus.cc:1240] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:43.725872  6488 raft_consensus.cc:493] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.726045   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:00:43.743678  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:43.726132  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
W20260709 13:00:43.724490  1615 connection.cc:256] RPC call timeout handler was delayed by -2.222280501s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18460000000000001s for a response
I20260709 13:00:43.832615  6437 raft_consensus.cc:515] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:43.833554  1615 leader_election.cc:304] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:43.724746  1617 leader_election.cc:304] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
W20260709 13:00:43.834439  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 109817us
I20260709 13:00:43.834676  1615 leader_election.cc:304] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:43.834931  6437 leader_election.cc:290] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:43.835597  6437 raft_consensus.cc:2749] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:00:43.835721  1617 leader_election.cc:304] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:43.836120  1615 leader_election.cc:304] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:43.838246  6448 raft_consensus.cc:2804] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:43.838516  1642 raft_consensus.cc:1240] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 13:00:43.838613  1688 leader_election.cc:304] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:43.839598  6405 raft_consensus.cc:493] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:43.839871  1688 leader_election.cc:304] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:43.841435  1720 raft_consensus.cc:1240] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:43.842237  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:43.842521  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:43.742520  2294 leader_election.cc:304] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:43.737867  6395 raft_consensus.cc:2749] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:43.843577  6371 raft_consensus.cc:493] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.801476  1569 rpcz_store.cc:276] 0709 13:00:42.586984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.588494 (+  1510us) service_pool.cc:224] Handling call
0709 13:00:42.588829 (+   335us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:42.697786 (+108957us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:42.697831 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:42.706573 (+  8742us) log.cc:844] Serialized 26 byte log entry
0709 13:00:43.516454 (+809881us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:43.516555 (+   101us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:43.516650 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:43.728190 (+211540us) raft_consensus.cc:1685] finished
0709 13:00:43.728222 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:43.728397 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":94530,"raft.queue_time_us":82106,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":9865,"thread_start_us":763694,"threads_started":1,"wal-append.queue_time_us":948586}
I20260709 13:00:43.844213  6371 raft_consensus.cc:515] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:43.844842  6471 raft_consensus.cc:2804] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:43.845427  6471 raft_consensus.cc:697] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:43.845279  6301 consensus_queue.cc:237] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:43.846624  6371 leader_election.cc:290] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:43.846467  6471 consensus_queue.cc:237] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:43.847190  6371 raft_consensus.cc:2749] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:43.718341  6038 raft_consensus.cc:2804] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:43.848290  6426 raft_consensus.cc:493] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:43.848619  6038 raft_consensus.cc:697] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 14 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:43.848887  6426 raft_consensus.cc:515] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:43.849772  6038 consensus_queue.cc:237] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:43.823369  6392 raft_consensus.cc:3060] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:43.851119  6426 leader_election.cc:290] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:43.726291  6481 raft_consensus.cc:3055] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:43.852118  6481 raft_consensus.cc:740] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
W20260709 13:00:43.848183  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 105714us
I20260709 13:00:43.853097  6481 consensus_queue.cc:260] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:43.854751  6481 raft_consensus.cc:3060] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:43.857882  6484 raft_consensus.cc:493] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:43.820299  1648 raft_consensus.cc:2468] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 11.
I20260709 13:00:43.822448  1645 raft_consensus.cc:2468] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 14.
I20260709 13:00:43.740830  6486 raft_consensus.cc:697] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:43.824555  6353 raft_consensus.cc:493] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:43.742506  6001 consensus_queue.cc:1048] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.074s
I20260709 13:00:43.743194  6391 consensus_queue.cc:1048] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.080s
I20260709 13:00:43.828322  6005 leader_election.cc:290] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:43.802512  6452 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:43.832307  6488 raft_consensus.cc:515] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:43.836678  6438 raft_consensus.cc:2749] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:43.814045  6446 raft_consensus.cc:515] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:43.735348  1721 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c"
dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:50010
I20260709 13:00:43.906625  1721 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:43.907068  1721 raft_consensus.cc:3060] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:43.821116  6249 raft_consensus.cc:515] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:43.739257  6338 raft_consensus.cc:515] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:43.812379  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:43.861996  1688 leader_election.cc:304] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66
W20260709 13:00:43.911142  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 49245.8us
W20260709 13:00:43.913820  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:43.920683  1688 leader_election.cc:304] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
W20260709 13:00:43.800699  1570 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.017s	sys 0.024s
W20260709 13:00:43.879949  6467 log.cc:927] Time spent T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 1.327s	user 0.012s	sys 0.000s
I20260709 13:00:43.879851  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:43.882035  6254 consensus_queue.cc:1059] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:00:43.930377  1570 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.017s	sys 0.025s
I20260709 13:00:43.836287  6437 raft_consensus.cc:2804] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:43.875591  6353 raft_consensus.cc:3060] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:43.931293  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36642 (request call id 2580) took 1343 ms. Trace:
I20260709 13:00:43.886998  6484 raft_consensus.cc:515] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:43.891631  1649 raft_consensus.cc:3060] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:43.893513  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:43.896363  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:43.922251  1688 leader_election.cc:304] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:43.889986  6452 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:43.902287  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:43.902961  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:43.840150  6405 raft_consensus.cc:515] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:43.921937  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:43.938215  1651 raft_consensus.cc:3060] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:43.847896  6371 raft_consensus.cc:2749] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:43.897836  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:43.941427  2325 raft_consensus.cc:2468] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 11.
I20260709 13:00:43.943115  2323 raft_consensus.cc:1275] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:00:43.936208  2330 raft_consensus.cc:2393] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 10: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 13:00:43.938678  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:43.947983  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:43.948601  1723 raft_consensus.cc:3060] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:43.921782  6441 raft_consensus.cc:2804] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:43.802325  6489 raft_consensus.cc:515] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:43.931686  1570 rpcz_store.cc:276] 0709 13:00:42.587930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.630052 (+ 42122us) service_pool.cc:224] Handling call
0709 13:00:42.643567 (+ 13515us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:42.643780 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:43.258058 (+614278us) log.cc:844] Serialized 14 byte log entry
0709 13:00:43.930981 (+672923us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:43.931030 (+    49us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:43.931076 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:43.931136 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:43.931242 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":165775,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"thread_start_us":1286265,"threads_started":2}
I20260709 13:00:43.958632  1725 raft_consensus.cc:2468] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 11.
I20260709 13:00:43.940873  1721 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:43.976131  1649 raft_consensus.cc:2468] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 13.
I20260709 13:00:43.941598  6438 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
W20260709 13:00:43.992643  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:43.994455  1651 raft_consensus.cc:2468] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 13.
W20260709 13:00:44.005513  1542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:44.020085  1646 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.039s	sys 0.028s
W20260709 13:00:44.021533  1646 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.039s	sys 0.028s
I20260709 13:00:44.025250  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45148 (request call id 2505) took 1479 ms. Trace:
I20260709 13:00:43.947960  6437 raft_consensus.cc:697] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 11 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:44.040390  1721 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:44.041846  1647 raft_consensus.cc:3060] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:44.019268  2294 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:43.958607  6441 raft_consensus.cc:493] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:44.027621  1646 rpcz_store.cc:276] 0709 13:00:42.545750 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.545900 (+   150us) service_pool.cc:224] Handling call
0709 13:00:42.546203 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:42.546526 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:00:43.500054 (+953528us) log.cc:844] Serialized 14 byte log entry
0709 13:00:44.023128 (+523074us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:44.023203 (+    75us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:44.023269 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:44.025011 (+  1742us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:44.025179 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":211265,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"thread_start_us":1469754,"threads_started":2}
I20260709 13:00:44.087827  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:44.089284  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:44.046749  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:44.090826  1651 raft_consensus.cc:2410] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:00:43.954298  6486 consensus_queue.cc:237] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:44.048609  6066 raft_consensus.cc:2804] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:44.018177  6452 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:44.051030  1571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36642 (request call id 2579) took 1463 ms. Trace:
I20260709 13:00:44.043015  6163 raft_consensus.cc:2804] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:44.044448  6352 raft_consensus.cc:493] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:44.101372  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:44.102202  1646 raft_consensus.cc:2468] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 10.
I20260709 13:00:44.053462  6249 leader_election.cc:290] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:44.053346  6392 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:44.061872  6446 leader_election.cc:290] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:44.063165  1723 raft_consensus.cc:2468] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 9.
I20260709 13:00:44.064054  6353 raft_consensus.cc:515] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:43.978077  6374 raft_consensus.cc:2804] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:44.070642  5976 raft_consensus.cc:3060] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:44.150565  2327 raft_consensus.cc:2368] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 9. Current term is 10.
I20260709 13:00:44.075557  1573 raft_consensus.cc:3060] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:44.080273  6484 leader_election.cc:290] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:44.081413  6338 leader_election.cc:290] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:44.081921  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:44.097417  6441 raft_consensus.cc:3060] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:44.099730  1571 rpcz_store.cc:276] 0709 13:00:42.587636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.624321 (+ 36685us) service_pool.cc:224] Handling call
0709 13:00:42.626410 (+  2089us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:42.650715 (+ 24305us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:42.650746 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:42.662644 (+ 11898us) log.cc:844] Serialized 26 byte log entry
0709 13:00:43.737322 (+1074678us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:43.737353 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:43.737400 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:44.050810 (+313410us) raft_consensus.cc:1685] finished
0709 13:00:44.050828 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:44.050976 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29447,"raft.queue_time_us":55872,"raft.run_cpu_time_us":401,"raft.run_wall_time_us":40376,"spinlock_wait_cycles":1931520,"thread_start_us":1027803,"threads_started":1,"wal-append.queue_time_us":1280162}
I20260709 13:00:44.105252  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:44.017225  6356 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.107357  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:44.121652  2326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32870 (request call id 652) took 1324 ms. Trace:
I20260709 13:00:44.179312  2326 rpcz_store.cc:276] 0709 13:00:42.797643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.802706 (+  5063us) service_pool.cc:224] Handling call
0709 13:00:42.803009 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:43.351015 (+548006us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:44.121390 (+770375us) spinlock_profiling.cc:243] Waited 539 ms on lock 0x7b54004bfd54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:44.121597 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1240206080}
I20260709 13:00:44.123791  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45148 (request call id 2507) took 1539 ms. Trace:
I20260709 13:00:44.180979  1644 rpcz_store.cc:276] 0709 13:00:42.584582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.584803 (+   221us) service_pool.cc:224] Handling call
0709 13:00:42.585078 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:43.699080 (+1114002us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:44.123534 (+424454us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54000d8ed4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:44.123721 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2456858496}
I20260709 13:00:44.105089  6452 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:44.141583  6352 raft_consensus.cc:515] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:44.142030  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:44.205168  2330 raft_consensus.cc:2468] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 16.
I20260709 13:00:44.151599  1725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2482) took 1507 ms. Trace:
I20260709 13:00:44.205941  1725 rpcz_store.cc:276] 0709 13:00:42.617681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.834356 (+216675us) service_pool.cc:224] Handling call
0709 13:00:44.124831 (+1290475us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b540007e254. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:44.124954 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2583547776}
I20260709 13:00:44.149976  6374 raft_consensus.cc:493] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:44.157157  1648 raft_consensus.cc:2393] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 12: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:44.213539  6374 raft_consensus.cc:3060] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:44.214576  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:44.086433  6489 leader_election.cc:290] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:44.157303  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:44.173504  6069 consensus_queue.cc:1048] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:44.175156  1645 raft_consensus.cc:2468] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 11.
I20260709 13:00:44.089088  6438 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:44.250826  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:44.276661  1645 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 12.
I20260709 13:00:44.185120  6484 raft_consensus.cc:493] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:44.277765  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:44.278431  6484 raft_consensus.cc:515] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:44.280182  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:44.281338  1644 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 9.
I20260709 13:00:44.184008  1573 raft_consensus.cc:1275] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
W20260709 13:00:44.203492  1540 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.002s	sys 0.023s
I20260709 13:00:44.177888  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:44.144893  6249 raft_consensus.cc:493] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.211804  1647 raft_consensus.cc:2468] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 14.
I20260709 13:00:44.143208  6066 raft_consensus.cc:697] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
W20260709 13:00:44.150171  6465 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.010s	sys 0.022s
W20260709 13:00:44.106020  6252 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.019s	sys 0.043s
I20260709 13:00:44.243717  1649 raft_consensus.cc:2393] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 6: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:44.176146  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:44.274395  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:44.300464  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:44.303653  1646 raft_consensus.cc:2410] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:00:44.319001  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:44.319123  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:44.319970  1725 raft_consensus.cc:3060] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:44.320761  2324 raft_consensus.cc:1240] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
W20260709 13:00:44.301699  6465 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.013s	sys 0.022s
W20260709 13:00:44.184408  6270 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.005s	sys 0.021s
I20260709 13:00:44.204600  6356 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:44.265437  6489 raft_consensus.cc:493] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:44.281502  6484 leader_election.cc:290] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:44.282047  1573 pending_rounds.cc:85] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting all ops after (but not including) 9
I20260709 13:00:44.335861   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:00:44.282408  1540 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.002s	sys 0.023s
W20260709 13:00:44.183696  1539 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.000s	sys 0.032s
W20260709 13:00:44.183316  1719 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.011s	sys 0.021s
W20260709 13:00:44.322698  6456 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.738s	user 0.020s	sys 0.017s
I20260709 13:00:44.351683  1573 pending_rounds.cc:107] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:00:44.353744  1573 raft_consensus.cc:2889] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:44.354476  1573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 1224) took 1651 ms. Trace:
I20260709 13:00:44.354818  1573 rpcz_store.cc:276] 0709 13:00:42.703099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.866524 (+163425us) service_pool.cc:224] Handling call
0709 13:00:42.870579 (+  4055us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:44.075028 (+1204449us) spinlock_profiling.cc:243] Waited 602 ms on lock 0x7b58005bd3d0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23170aa 00007fa9f2399447 00007fa9f23b1fe7 00007fa9f23b37de 00007fa9f23bdb49 00007fa9f23be416 00007fa9f23bad8f 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4
0709 13:00:44.354217 (+279189us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:44.354419 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1384471808}
W20260709 13:00:44.352213  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 804435us
W20260709 13:00:44.352584  1719 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.792s	user 0.012s	sys 0.021s
I20260709 13:00:44.285686  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:44.285651  1615 leader_election.cc:304] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:44.288800  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:44.358911  1648 raft_consensus.cc:2410] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:00:44.290289  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:44.294121  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:44.278889  1645 raft_consensus.cc:2393] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 13: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 13:00:44.327836  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:00:44.303228  6252 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.020s	sys 0.044s
I20260709 13:00:44.330487  2329 raft_consensus.cc:2393] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 9: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 13:00:44.331284  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:44.365479  1649 raft_consensus.cc:2410] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
W20260709 13:00:44.342355  6270 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.747s	user 0.005s	sys 0.022s
I20260709 13:00:44.360232  2323 raft_consensus.cc:2393] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 10: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 13:00:44.297236  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 13:00:44.352427  1539 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.000s	sys 0.032s
W20260709 13:00:44.389302  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 810972us
I20260709 13:00:44.389701  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 13:00:44.348681  1689 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:44.391034  1568 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.849s	user 0.033s	sys 0.086s
W20260709 13:00:44.391507  1568 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.849s	user 0.033s	sys 0.086s
W20260709 13:00:44.347671  6350 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.701s	user 0.025s	sys 0.030s
W20260709 13:00:44.347785  1567 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.769s	user 0.004s	sys 0.052s
I20260709 13:00:44.366966  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 13:00:44.347726  6398 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.001s	sys 0.026s
I20260709 13:00:44.371491  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:44.373188  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:44.356642  1646 raft_consensus.cc:1240] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:44.394115  1571 raft_consensus.cc:2410] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:00:44.394253  1573 raft_consensus.cc:2393] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 13: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
W20260709 13:00:44.394979  6398 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.728s	user 0.002s	sys 0.026s
I20260709 13:00:44.284720  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:44.397629  1644 raft_consensus.cc:2468] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 11.
W20260709 13:00:44.399132  6498 log.cc:927] Time spent T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.192s	user 0.000s	sys 0.000s
I20260709 13:00:44.400031  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:44.401266  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:00:44.393136  1567 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.814s	user 0.005s	sys 0.052s
I20260709 13:00:44.332808  6429 raft_consensus.cc:493] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
W20260709 13:00:44.357192  6456 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.778s	user 0.020s	sys 0.017s
W20260709 13:00:44.409825  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:44.317399  6006 consensus_queue.cc:1048] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.070s
W20260709 13:00:44.416570  1572 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.012s	sys 0.020s
W20260709 13:00:44.417032  1572 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.013s	sys 0.020s
I20260709 13:00:44.410979  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:44.305469  6249 raft_consensus.cc:515] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:44.391144  6343 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 13:00:44.351311  6396 raft_consensus.cc:493] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
W20260709 13:00:44.401959  6350 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.757s	user 0.025s	sys 0.031s
I20260709 13:00:44.425768  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:44.437348  1722 raft_consensus.cc:2468] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 16.
I20260709 13:00:44.387235  6392 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 14 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:44.405162  6069 raft_consensus.cc:493] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:44.308038  6437 consensus_queue.cc:237] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:44.411629  6488 leader_election.cc:290] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:44.438938  1718 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.015s	sys 0.007s
I20260709 13:00:44.355801  6489 raft_consensus.cc:515] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:44.452118  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:44.404189  6446 consensus_queue.cc:1059] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
W20260709 13:00:44.454537  1718 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.016s	sys 0.007s
I20260709 13:00:44.457939  1724 raft_consensus.cc:2393] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 13: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:44.383924  1725 raft_consensus.cc:2468] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 10.
I20260709 13:00:44.411701  6429 raft_consensus.cc:515] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:44.440107  6448 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.003s	sys 0.022s
W20260709 13:00:44.447036  5970 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.001s	sys 0.019s
I20260709 13:00:44.453141  6069 raft_consensus.cc:515] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:44.497102  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:44.498027  1722 raft_consensus.cc:2410] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:00:44.498744  6069 leader_election.cc:290] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:44.500264  6249 leader_election.cc:290] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:44.504806  6438 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:44.505452  6438 raft_consensus.cc:493] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.505962  6438 raft_consensus.cc:515] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:44.507922  6438 leader_election.cc:290] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:44.439426  6396 raft_consensus.cc:515] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:44.510639  6396 leader_election.cc:290] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:44.480376  6488 raft_consensus.cc:493] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.512089  6488 raft_consensus.cc:515] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:44.514155  6488 leader_election.cc:290] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:44.514765  1717 raft_consensus.cc:2468] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 12.
I20260709 13:00:44.514757  6488 consensus_queue.cc:1059] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:44.515956  6446 consensus_queue.cc:1243] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer 05476b84d8f84d76a9a1f51b620a3c66 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:00:44.516361  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1929) took 1061 ms. Trace:
I20260709 13:00:44.516697  6446 consensus_queue.cc:1059] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:44.516939  1717 rpcz_store.cc:276] 0709 13:00:43.454888 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.455063 (+   175us) service_pool.cc:224] Handling call
0709 13:00:44.516191 (+1061128us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540009c9d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:44.516304 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2415659392}
I20260709 13:00:44.517722  6411 raft_consensus.cc:493] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.416793  6066 consensus_queue.cc:237] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:44.518504  1570 raft_consensus.cc:3055] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:00:44.519043  6352 leader_election.cc:290] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:44.519068  1570 raft_consensus.cc:740] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:44.518559  1717 raft_consensus.cc:1275] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:00:44.520916  1688 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.007s	sys 0.014s
W20260709 13:00:44.521271  1688 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.008s	sys 0.014s
I20260709 13:00:44.518205  6411 raft_consensus.cc:515] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:44.449546  6383 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.014s	sys 0.011s
W20260709 13:00:44.521762  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 599528us
I20260709 13:00:44.523090  1722 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb"
dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:58782
W20260709 13:00:44.533500  6501 log.cc:927] Time spent T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 13:00:44.534315  6499 log.cc:927] Time spent T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
I20260709 13:00:44.542619  6489 leader_election.cc:290] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:00:44.542972  6400 consensus_meta.cc:287] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.736s	user 0.005s	sys 0.005s
I20260709 13:00:44.543232  6452 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:44.458420  6270 consensus_queue.cc:1059] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.087s
W20260709 13:00:44.554437  6481 consensus_meta.cc:287] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.699s	user 0.011s	sys 0.000s
I20260709 13:00:44.555823  6163 raft_consensus.cc:493] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:44.562088  6429 leader_election.cc:290] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:44.570353  1722 raft_consensus.cc:493] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:44.520455  1570 consensus_queue.cc:260] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:44.610283  1722 raft_consensus.cc:3060] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:44.611035  1570 raft_consensus.cc:3060] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:00:44.508365  6438 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:44.479245  6448 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.003s	sys 0.023s
W20260709 13:00:44.486135  5970 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.001s	sys 0.019s
W20260709 13:00:44.575160  6383 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.014s	sys 0.011s
I20260709 13:00:44.598423  1574 raft_consensus.cc:1275] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 13:00:44.624097  1574 pending_rounds.cc:85] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting all ops after (but not including) 8
I20260709 13:00:44.624413  1574 pending_rounds.cc:107] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 13:00:44.624723  1574 raft_consensus.cc:2889] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:44.598578  1716 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.000s	sys 0.024s
W20260709 13:00:44.625433  1716 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.000s	sys 0.024s
I20260709 13:00:44.626346  1716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1930) took 1171 ms. Trace:
W20260709 13:00:44.606490  6422 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.006s	sys 0.015s
W20260709 13:00:44.606343  6038 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.747s	user 0.004s	sys 0.021s
I20260709 13:00:44.606141  6267 raft_consensus.cc:493] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.605938  5976 raft_consensus.cc:493] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:44.609730  6163 raft_consensus.cc:3060] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:44.627403  6270 raft_consensus.cc:3055] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:00:44.658699  6301 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.754s	user 0.014s	sys 0.021s
W20260709 13:00:44.632680  6422 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.750s	user 0.006s	sys 0.016s
I20260709 13:00:44.473981  1725 raft_consensus.cc:1275] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:00:44.632062  6288 raft_consensus.cc:2804] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:44.626899  6448 raft_consensus.cc:697] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 14 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
W20260709 13:00:44.633992  6038 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.775s	user 0.005s	sys 0.021s
W20260709 13:00:44.676389  1650 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.014s	sys 0.024s
I20260709 13:00:44.681094  1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 932) took 1991 ms. Trace:
I20260709 13:00:44.626776  1716 rpcz_store.cc:276] 0709 13:00:43.455264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.455398 (+   134us) service_pool.cc:224] Handling call
0709 13:00:43.455769 (+   371us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:43.456040 (+   271us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:43.945779 (+489739us) log.cc:844] Serialized 14 byte log entry
0709 13:00:44.625987 (+680208us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:44.626039 (+    52us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:44.626085 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:44.626162 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:44.626290 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":967255,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":2179,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":8337,"thread_start_us":1169205,"threads_started":2}
I20260709 13:00:44.659152  6356 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:44.699077  1643 rpcz_store.cc:276] 0709 13:00:42.689831 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.972386 (+282555us) service_pool.cc:224] Handling call
0709 13:00:42.993710 (+ 21324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:42.994080 (+   370us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:42.994112 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:42.994573 (+   461us) log.cc:844] Serialized 26 byte log entry
0709 13:00:43.805316 (+810743us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:43.805363 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:43.805443 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:44.680847 (+875404us) raft_consensus.cc:1685] finished
0709 13:00:44.680869 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:44.681017 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3783,"raft.queue_time_us":14104,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":56743,"thread_start_us":810331,"threads_started":1,"wal-append.queue_time_us":1249843}
W20260709 13:00:44.665289  1616 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.010s	sys 0.010s
W20260709 13:00:44.701450  1650 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.014s	sys 0.024s
I20260709 13:00:44.665274  6506 raft_consensus.cc:3055] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:44.659708  6489 raft_consensus.cc:3055] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:44.679425  6270 raft_consensus.cc:740] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
W20260709 13:00:44.657507  6426 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.009s	sys 0.026s
I20260709 13:00:44.630653  6438 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:44.683815  6471 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.010s	sys 0.029s
W20260709 13:00:44.701714  1616 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.010s	sys 0.010s
I20260709 13:00:44.660041  6267 raft_consensus.cc:515] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:44.677753  6374 raft_consensus.cc:515] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:44.737147  1642 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.863s	user 0.012s	sys 0.038s
W20260709 13:00:44.737699  1642 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.863s	user 0.012s	sys 0.038s
I20260709 13:00:44.678579  5976 raft_consensus.cc:515] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:44.734014  6426 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.009s	sys 0.026s
W20260709 13:00:44.734226  6471 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.010s	sys 0.030s
I20260709 13:00:44.704828  6506 raft_consensus.cc:740] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:44.706957  6489 raft_consensus.cc:740] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:44.690718  1722 raft_consensus.cc:515] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:44.776993  1722 leader_election.cc:290] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:44.776677  6506 consensus_queue.cc:260] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:44.778129  6506 raft_consensus.cc:3060] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:44.783217  6270 consensus_queue.cc:260] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:44.787477  6489 consensus_queue.cc:260] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:44.819056  6448 consensus_queue.cc:237] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:44.770813  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 485240us
W20260709 13:00:44.683565  6301 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.779s	user 0.014s	sys 0.021s
W20260709 13:00:44.861975  2295 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.016s	sys 0.008s
W20260709 13:00:45.175498  2295 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.826s	user 0.016s	sys 0.009s
W20260709 13:00:45.175765  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 870519us
W20260709 13:00:44.868206  2296 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.014s	sys 0.018s
W20260709 13:00:45.178273  2296 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.853s	user 0.014s	sys 0.018s
W20260709 13:00:44.938366  1645 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.008s	sys 0.020s
W20260709 13:00:45.180393  1645 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.819s	user 0.008s	sys 0.020s
W20260709 13:00:45.082837  1719 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.013s	sys 0.040s
W20260709 13:00:45.181763  1719 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.783s	user 0.013s	sys 0.040s
W20260709 13:00:45.142011  1539 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.726s	user 0.020s	sys 0.041s
W20260709 13:00:45.182668  1539 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.767s	user 0.020s	sys 0.041s
W20260709 13:00:45.154343  1570 consensus_meta.cc:287] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.543s	user 0.011s	sys 0.000s
I20260709 13:00:45.186856  1570 raft_consensus.cc:1275] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
W20260709 13:00:44.857712  1617 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.022s	sys 0.014s
W20260709 13:00:45.188019  1617 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.889s	user 0.022s	sys 0.014s
W20260709 13:00:45.188395  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 889841us
I20260709 13:00:45.145961  1615 leader_election.cc:304] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
W20260709 13:00:44.938419  1646 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.004s	sys 0.025s
W20260709 13:00:45.187337  1573 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.762s	user 0.057s	sys 0.148s
W20260709 13:00:45.212088  1646 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.817s	user 0.004s	sys 0.033s
W20260709 13:00:45.212400  1541 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.785s	user 0.005s	sys 0.008s
W20260709 13:00:45.213304  1541 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.786s	user 0.006s	sys 0.008s
I20260709 13:00:44.827901  2297 leader_election.cc:304] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:00:45.195912  1718 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.728s	user 0.004s	sys 0.009s
W20260709 13:00:45.215322  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 387517us
I20260709 13:00:45.187507  1570 pending_rounds.cc:85] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting all ops after (but not including) 6
I20260709 13:00:45.216114  1570 pending_rounds.cc:107] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting uncommitted NO_OP operation due to leader change: 5.7
W20260709 13:00:44.828003  6486 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.017s	sys 0.030s
I20260709 13:00:45.216434  1570 raft_consensus.cc:2889] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:45.189289  1539 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.194:37391 timed out after 2.605s (SENT) [suppressed 9 similar messages]
W20260709 13:00:45.213500  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 67665.2us
I20260709 13:00:45.225777  1615 leader_election.cc:304] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
W20260709 13:00:45.169775  1572 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.750s	user 0.004s	sys 0.008s
W20260709 13:00:45.226686  1572 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.809s	user 0.004s	sys 0.012s
W20260709 13:00:45.215658  1718 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.004s	sys 0.009s
W20260709 13:00:45.093151  6505 log.cc:927] Time spent T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.413s	user 0.000s	sys 0.006s
W20260709 13:00:45.231086  1573 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.806s	user 0.057s	sys 0.148s
I20260709 13:00:45.242147  1615 leader_election.cc:304] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:45.217757  2297 leader_election.cc:304] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 13:00:45.248996  2297 leader_election.cc:304] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
W20260709 13:00:45.223996  6066 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.019s	sys 0.047s
I20260709 13:00:45.160384  6521 raft_consensus.cc:493] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:45.192782  6356 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
W20260709 13:00:45.239285  6456 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.800s	user 0.002s	sys 0.012s
I20260709 13:00:45.235772  6524 raft_consensus.cc:2804] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:45.217357  6438 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:45.317097  1644 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.915s	user 0.027s	sys 0.055s
W20260709 13:00:45.305881  1617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:45.443964  1644 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.042s	user 0.028s	sys 0.055s
W20260709 13:00:45.286233  6437 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.737s	user 0.011s	sys 0.039s
I20260709 13:00:45.328490  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 13:00:45.329366  1567 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.914s	user 0.007s	sys 0.015s
W20260709 13:00:45.222385  6486 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.934s	user 0.017s	sys 0.037s
W20260709 13:00:45.336776  1540 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.930s	user 0.040s	sys 0.020s
I20260709 13:00:45.372579  6525 raft_consensus.cc:2749] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:00:45.457897  1540 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.051s	user 0.040s	sys 0.020s
I20260709 13:00:45.452272  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 13:00:45.307495  6066 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.020s	sys 0.047s
I20260709 13:00:45.260922  6383 raft_consensus.cc:3060] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:45.261121  6463 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.031s	user 0.002s	sys 0.014s
I20260709 13:00:45.287217  5976 leader_election.cc:290] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:45.354071  1614 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.826s	user 0.024s	sys 0.034s
W20260709 13:00:45.360083  1651 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.924s	user 0.017s	sys 0.047s
W20260709 13:00:45.362141  1542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:45.479387  1651 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.043s	user 0.018s	sys 0.047s
W20260709 13:00:45.479928  1542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:45.479300  1614 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.418s	user 0.025s	sys 0.035s
I20260709 13:00:45.481837  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:45.328449  6267 leader_election.cc:290] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:45.338563  6038 raft_consensus.cc:493] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.297763  6515 consensus_queue.cc:1059] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.104s
W20260709 13:00:45.376981  1717 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.723s	user 0.008s	sys 0.016s
W20260709 13:00:45.496742  1717 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.843s	user 0.010s	sys 0.019s
I20260709 13:00:44.859063  6371 raft_consensus.cc:3055] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:45.297955  6514 consensus_queue.cc:1048] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.128s
W20260709 13:00:45.399639  5970 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.721s	user 0.011s	sys 0.015s
I20260709 13:00:45.433725  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 13:00:45.400586  6513 log.cc:927] Time spent T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.546s	user 0.001s	sys 0.000s
I20260709 13:00:45.263252  6374 leader_election.cc:290] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:45.369405  6354 raft_consensus.cc:2804] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:45.592571  6354 raft_consensus.cc:493] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:45.593056  6354 raft_consensus.cc:3060] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:00:45.324220  6252 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.898s	user 0.006s	sys 0.015s
I20260709 13:00:45.442976  6524 raft_consensus.cc:493] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:45.596727  6252 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.177s	user 0.007s	sys 0.016s
I20260709 13:00:45.596920  6524 raft_consensus.cc:3060] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:45.598721  6353 leader_election.cc:290] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:00:45.447868  6526 log.cc:927] Time spent T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
W20260709 13:00:45.449875  1567 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.034s	user 0.007s	sys 0.015s
I20260709 13:00:45.364749  6471 raft_consensus.cc:2804] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:00:45.601300  2327 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53290 (request call id 1073) took 1706 ms (client timeout 1613 ms). Trace:
I20260709 13:00:45.601445  6471 raft_consensus.cc:697] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
W20260709 13:00:45.420643  6422 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.011s	sys 0.016s
W20260709 13:00:45.458232  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 1.05164e+06us
I20260709 13:00:45.458935  2325 raft_consensus.cc:2468] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 9.
W20260709 13:00:45.296720  6441 consensus_meta.cc:287] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 1.091s	user 0.010s	sys 0.003s
I20260709 13:00:45.602339  2328 raft_consensus.cc:1240] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 9. Current term is 10. Ops: []
W20260709 13:00:45.601779  2327 rpcz_store.cc:269] 0709 13:00:43.895323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.895448 (+   125us) service_pool.cc:224] Handling call
0709 13:00:45.601072 (+1705624us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b540059a1d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:45.601226 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":493110528}
W20260709 13:00:45.461452  1568 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.036s	user 0.025s	sys 0.030s
I20260709 13:00:45.602859  6441 raft_consensus.cc:515] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:45.603538  1568 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.178s	user 0.025s	sys 0.031s
I20260709 13:00:45.327312  6521 raft_consensus.cc:515] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:45.605806  6521 leader_election.cc:290] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:45.605965  6441 leader_election.cc:290] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:45.606600  1723 raft_consensus.cc:2368] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 6. Current term is 7.
I20260709 13:00:45.606871  1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 1216) took 1749 ms. Trace:
I20260709 13:00:45.607261  1720 rpcz_store.cc:276] 0709 13:00:43.857485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.877371 (+ 19886us) service_pool.cc:224] Handling call
0709 13:00:44.336406 (+459035us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:44.336602 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:44.336625 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:44.336662 (+    37us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:44.336699 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:44.336753 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:45.606714 (+1269961us) spinlock_profiling.cc:243] Waited 459 ms on lock 0x7b54003872d0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23ba8ad 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:45.606818 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1054812928}
W20260709 13:00:45.608451  1723 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58782 (request call id 1226) took 1732 ms (client timeout 1901 ms). Trace:
W20260709 13:00:45.609017  1723 rpcz_store.cc:269] 0709 13:00:43.876015 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.274063 (+398048us) service_pool.cc:224] Handling call
0709 13:00:45.608234 (+1334171us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54002ac1d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:45.608389 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3008147328}
I20260709 13:00:45.482694  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 13:00:45.449239  6437 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.900s	user 0.012s	sys 0.041s
I20260709 13:00:45.483354  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:00:45.610231  1647 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45148 (request call id 2520) took 1865 ms (client timeout 1973 ms). Trace:
I20260709 13:00:45.488586  1688 leader_election.cc:304] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:45.610620  1575 raft_consensus.cc:2468] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 13.
W20260709 13:00:45.611042  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 122605us
I20260709 13:00:45.611716  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:00:45.436017  6456 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.999s	user 0.008s	sys 0.014s
I20260709 13:00:45.612493  1575 raft_consensus.cc:2393] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 11: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:45.613150  6456 raft_consensus.cc:493] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:45.613337  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:45.613713  6456 raft_consensus.cc:515] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:45.614482  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:45.438804  6533 raft_consensus.cc:2804] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:00:45.496994  6426 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.022s	sys 0.040s
W20260709 13:00:45.616884  6426 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.797s	user 0.037s	sys 0.051s
I20260709 13:00:45.617000  6533 raft_consensus.cc:697] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:45.528183  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:45.553078  6442 raft_consensus.cc:493] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:45.618036  6533 consensus_queue.cc:237] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:45.618677  6442 raft_consensus.cc:515] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:45.552098  6301 raft_consensus.cc:493] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:45.549260  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:45.621172  6442 leader_election.cc:290] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:45.621492  6301 raft_consensus.cc:515] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:45.623351  6405 leader_election.cc:290] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:45.623781  6301 leader_election.cc:290] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:45.549376  2294 leader_election.cc:304] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:00:45.475287  6463 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.261s	user 0.003s	sys 0.014s
I20260709 13:00:45.495007  6356 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:45.625862  6524 raft_consensus.cc:515] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:45.626606  6356 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:00:45.548316  6163 consensus_meta.cc:287] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.850s	user 0.010s	sys 0.000s
I20260709 13:00:45.627276  6163 raft_consensus.cc:515] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:45.492777  1725 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.784s	user 0.056s	sys 0.108s
I20260709 13:00:45.544831  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:45.540997  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:45.581207  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:45.629468  6163 leader_election.cc:290] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:45.629760  1571 raft_consensus.cc:3060] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:45.630645  1569 raft_consensus.cc:3060] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:45.590351  6531 raft_consensus.cc:493] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.632427  6531 raft_consensus.cc:515] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:45.634677  6531 leader_election.cc:290] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:45.638772  6252 consensus_queue.cc:1059] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:45.639719  6252 raft_consensus.cc:3055] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:00:45.640262  1725 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.932s	user 0.057s	sys 0.108s
I20260709 13:00:45.641227  1725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 1233) took 1294 ms. Trace:
I20260709 13:00:45.629518  1570 raft_consensus.cc:3060] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:45.641723  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:45.642411  1721 raft_consensus.cc:2376] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 10. Re-sending same reply.
I20260709 13:00:45.641618  1725 rpcz_store.cc:276] 0709 13:00:44.346730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.690762 (+344032us) service_pool.cc:224] Handling call
0709 13:00:44.691170 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:44.691502 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:00:44.708248 (+ 16746us) log.cc:844] Serialized 14 byte log entry
0709 13:00:45.640832 (+932584us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:45.640895 (+    63us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:45.640969 (+    74us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.641037 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:45.641167 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6022,"prepare.queue_time_us":16473,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":63,"thread_start_us":932238,"threads_started":1}
W20260709 13:00:45.642870  1721 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58782 (request call id 1223) took 1783 ms (client timeout 1941 ms). Trace:
W20260709 13:00:45.643229  1721 rpcz_store.cc:269] 0709 13:00:43.859165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.641486 (+1782321us) service_pool.cc:224] Handling call
0709 13:00:45.642818 (+  1332us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:45.572033  6489 raft_consensus.cc:3060] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:45.602031  1650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45148 (request call id 2510) took 1911 ms. Trace:
W20260709 13:00:45.602655  6422 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.894s	user 0.012s	sys 0.017s
W20260709 13:00:45.437894  6079 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.731s	user 0.003s	sys 0.064s
W20260709 13:00:45.552377  6518 log.cc:927] Time spent T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.376s	user 0.001s	sys 0.000s
I20260709 13:00:45.621843  6288 raft_consensus.cc:493] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:45.623996  6405 raft_consensus.cc:2804] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:45.590974  6540 raft_consensus.cc:493] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:45.565196  6395 raft_consensus.cc:493] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:45.640148  6252 raft_consensus.cc:740] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
W20260709 13:00:45.529434  6523 log.cc:927] Time spent T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.387s	user 0.002s	sys 0.000s
W20260709 13:00:45.545996  6539 log.cc:927] Time spent T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 13:00:45.677747  1569 raft_consensus.cc:2468] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 12.
I20260709 13:00:45.653616  1570 raft_consensus.cc:2468] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 10.
W20260709 13:00:45.671815  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 122566us
W20260709 13:00:45.545405  6529 log.cc:927] Time spent T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.194s	user 0.000s	sys 0.000s
I20260709 13:00:45.602356  6471 consensus_queue.cc:237] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:45.610737  1647 rpcz_store.cc:269] 0709 13:00:43.745196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.812038 (+ 66842us) service_pool.cc:224] Handling call
0709 13:00:45.610087 (+1798049us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b54002b2d54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:45.610179 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":302058752}
I20260709 13:00:45.604473  2328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53306 (request call id 792) took 1299 ms. Trace:
I20260709 13:00:45.530546  6267 raft_consensus.cc:493] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:45.689780  1540 connection.cc:256] RPC call timeout handler was delayed by -2.3417280639999944s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:00:45.671103  6456 leader_election.cc:290] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:45.579808  6038 raft_consensus.cc:515] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:45.692122  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:45.699280  6288 raft_consensus.cc:3060] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:45.584844  6536 consensus_queue.cc:1059] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.191s
W20260709 13:00:45.663420  5970 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.923s	user 0.012s	sys 0.015s
W20260709 13:00:45.688807  6079 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.984s	user 0.003s	sys 0.065s
I20260709 13:00:45.628249  6524 leader_election.cc:290] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:45.586658  6525 raft_consensus.cc:493] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
W20260709 13:00:46.345129  1645 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.022s	user 0.032s	sys 0.025s
W20260709 13:00:46.389832  1645 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.067s	user 0.033s	sys 0.026s
W20260709 13:00:46.018409  1573 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.773s	user 0.001s	sys 0.009s
I20260709 13:00:45.640158  1571 raft_consensus.cc:2468] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 13.
W20260709 13:00:46.344063  1717 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.847s	user 0.013s	sys 0.025s
W20260709 13:00:46.392223  1717 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.895s	user 0.013s	sys 0.026s
I20260709 13:00:46.393038  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 1232) took 2061 ms. Trace:
I20260709 13:00:45.680385  1650 rpcz_store.cc:276] 0709 13:00:43.690742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.690917 (+   175us) service_pool.cc:224] Handling call
0709 13:00:43.691313 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:43.691720 (+   407us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:43.691766 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:43.717086 (+ 25320us) log.cc:844] Serialized 26 byte log entry
0709 13:00:44.073528 (+356442us) spinlock_profiling.cc:243] Waited 2.97 ms on lock 0x7b1800401c20. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef2b0e07 00007fa9f810bab9 00007fa9ef2cd69b 00007fa9ef2cb93f 00007fa9ef2cdc02 00007fa9f1f5520b 00007fa9f1f5ad23 00007fa9f1f5b0d1 00007fa9f2376a0f
0709 13:00:44.702453 (+628925us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:00:44.702505 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:44.702584 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:45.601666 (+899082us) raft_consensus.cc:1685] finished
0709 13:00:45.601694 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:45.601962 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":511,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":11530,"spinlock_wait_cycles":6837632,"thread_start_us":628569,"threads_started":1,"wal-append.queue_time_us":1411404}
W20260709 13:00:46.021530  1718 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.778s	user 0.037s	sys 0.048s
W20260709 13:00:46.018690  1539 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.781s	user 0.005s	sys 0.005s
W20260709 13:00:46.398761  1539 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.161s	user 0.007s	sys 0.011s
W20260709 13:00:46.399456  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 1.21009e+06us
W20260709 13:00:45.960781  2332 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.116s	user 0.004s	sys 0.037s
I20260709 13:00:46.395249  1576 raft_consensus.cc:2468] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 6.
W20260709 13:00:46.402323  2332 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.557s	user 0.007s	sys 0.041s
W20260709 13:00:46.033267  2296 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.846s	user 0.005s	sys 0.005s
I20260709 13:00:46.403234  2332 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53306 (request call id 793) took 2094 ms. Trace:
W20260709 13:00:46.118968  1646 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.888s	user 0.020s	sys 0.030s
W20260709 13:00:46.391731  1573 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.146s	user 0.001s	sys 0.014s
I20260709 13:00:46.392838  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:00:46.395119  1718 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.155s	user 0.045s	sys 0.060s
W20260709 13:00:46.018746  2295 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.841s	user 0.000s	sys 0.011s
W20260709 13:00:46.403502  2296 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.224s	user 0.007s	sys 0.011s
W20260709 13:00:46.409888  1689 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.413015  2328 rpcz_store.cc:276] 0709 13:00:44.304653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.304787 (+   134us) service_pool.cc:224] Handling call
0709 13:00:45.602159 (+1297372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:45.602950 (+   791us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.604303 (+  1353us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b540059a1d0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23ba8ad 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:45.604421 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2982780672}
W20260709 13:00:45.846354  1617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:45.672063  6531 raft_consensus.cc:493] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.393570  1717 rpcz_store.cc:276] 0709 13:00:44.332082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.580997 (+248915us) service_pool.cc:224] Handling call
0709 13:00:44.626339 (+ 45342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:44.626559 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:00:44.653383 (+ 26824us) log.cc:844] Serialized 14 byte log entry
0709 13:00:46.392735 (+1739352us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:46.392782 (+    47us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:46.392820 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.392894 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:46.392990 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":30514,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":95004,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":100,"thread_start_us":1738889,"threads_started":2,"wal-append.queue_time_us":1069458}
W20260709 13:00:46.438616  1617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.439654  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
W20260709 13:00:46.441468  1646 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.229s	user 0.026s	sys 0.033s
W20260709 13:00:46.436754  2295 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.259s	user 0.008s	sys 0.015s
I20260709 13:00:46.442242  1571 raft_consensus.cc:2468] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 11.
W20260709 13:00:46.442498  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 1.26483e+06us
I20260709 13:00:46.443513  1573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 1251) took 2047 ms. Trace:
I20260709 13:00:46.448623  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 13:00:46.470338  1541 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.983s	user 0.000s	sys 0.029s
I20260709 13:00:46.451632  1572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36642 (request call id 2581) took 3863 ms. Trace:
W20260709 13:00:46.470707  1541 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.984s	user 0.000s	sys 0.029s
I20260709 13:00:46.455773  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 1972) took 2616 ms. Trace:
I20260709 13:00:46.470708  1569 raft_consensus.cc:3060] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:46.458508  6270 raft_consensus.cc:3060] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:45.497507   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:00:46.465293  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36642 (request call id 2574) took 3887 ms. Trace:
I20260709 13:00:46.473551  1568 rpcz_store.cc:276] 0709 13:00:42.550572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.550668 (+    96us) service_pool.cc:224] Handling call
0709 13:00:42.550987 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:42.551201 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:42.551216 (+    15us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:42.555733 (+  4517us) log.cc:844] Serialized 26 byte log entry
0709 13:00:43.542321 (+986588us) spinlock_profiling.cc:243] Waited 1.4 ms on lock 0x7b1800354ca0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef2b0e07 00007fa9f810bab9 00007fa9ef2cd69b 00007fa9ef2cb93f 00007fa9ef2cdc02 00007fa9f1f5520b 00007fa9f1f5ad23 00007fa9f1f5b0d1 00007fa9f2376a0f
0709 13:00:44.391916 (+849595us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:45.603968 (+1212052us) log.cc:844] Serialized 14 byte log entry
0709 13:00:45.689548 (+ 85580us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.395682 (+706134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:46.395761 (+    79us) raft_consensus.cc:1685] finished
0709 13:00:46.437565 (+ 41804us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:46.437814 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":177275,"prepare.queue_time_us":1248650,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":117604,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":29702,"spinlock_wait_cycles":3216128,"thread_start_us":2028046,"threads_started":2,"wal-append.queue_time_us":2102306}
W20260709 13:00:46.079843  6506 consensus_meta.cc:287] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 1.301s	user 0.006s	sys 0.006s
W20260709 13:00:46.122272  6527 log.cc:927] Time spent T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.758s	user 0.002s	sys 0.000s
I20260709 13:00:46.478344  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:45.688478  6353 raft_consensus.cc:2804] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:00:46.382730  6562 log.cc:927] Time spent T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:00:46.480288  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:46.494789  1647 raft_consensus.cc:2410] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:00:46.481160  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:46.496088  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:46.496647  1570 raft_consensus.cc:2468] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 11.
I20260709 13:00:46.022584  6405 raft_consensus.cc:697] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 13 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:46.484270  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:46.486523  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:46.470876  1572 rpcz_store.cc:276] 0709 13:00:42.588198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.630115 (+ 41917us) service_pool.cc:224] Handling call
0709 13:00:42.643279 (+ 13164us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:42.771546 (+128267us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:00:43.716778 (+945232us) log.cc:844] Serialized 14 byte log entry
0709 13:00:45.227107 (+1510329us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:45.227170 (+    63us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:45.227363 (+   193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.451327 (+1223964us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b54000ac3d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:46.451394 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:46.451540 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42218,"prepare.queue_time_us":73612,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":4357,"raft.queue_time_us":162190,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":22534,"spinlock_wait_cycles":294482816,"thread_start_us":2418950,"threads_started":3,"wal-append.queue_time_us":1108051}
I20260709 13:00:46.437011  6456 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.438078  2332 rpcz_store.cc:276] 0709 13:00:44.309214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.309385 (+   171us) service_pool.cc:224] Handling call
0709 13:00:44.309725 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:44.309972 (+   247us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:00:44.844761 (+534789us) log.cc:844] Serialized 14 byte log entry
0709 13:00:46.402803 (+1558042us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:46.402868 (+    65us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:46.402932 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.403019 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:46.403172 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":602956,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":50,"thread_start_us":2050822,"threads_started":2}
W20260709 13:00:46.483397  1539 leader_election.cc:336] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Timed out: RequestConsensusVote RPC to 127.0.107.194:37391 timed out after 1.626s (SENT)
I20260709 13:00:46.471639  1642 rpcz_store.cc:276] 0709 13:00:43.839628 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.840389 (+   761us) service_pool.cc:224] Handling call
0709 13:00:43.873649 (+ 33260us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:43.873893 (+   244us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:43.874230 (+   337us) log.cc:844] Serialized 14 byte log entry
0709 13:00:44.747515 (+873285us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:44.747569 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:44.747612 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:44.747680 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:46.455566 (+1707886us) spinlock_profiling.cc:243] Waited 32.9 ms on lock 0x7b54001d9050. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23ba8ad 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:46.455707 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":2675,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":9235,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":1657,"spinlock_wait_cycles":75749248,"thread_start_us":863604,"threads_started":1,"wal-append.queue_time_us":1676279}
I20260709 13:00:46.013193  6374 raft_consensus.cc:493] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:46.498459  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 1992) took 1066 ms. Trace:
I20260709 13:00:45.703061  6545 raft_consensus.cc:493] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:45.709491  6371 raft_consensus.cc:740] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:46.035043  6552 raft_consensus.cc:493] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:45.784685  6438 consensus_queue.cc:1048] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.775s
I20260709 13:00:46.501101  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 13:00:46.511925  2297 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.218s	user 0.003s	sys 0.023s
W20260709 13:00:46.538914  2297 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.245s	user 0.003s	sys 0.027s
W20260709 13:00:46.539347  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 1.24652e+06us
W20260709 13:00:46.540620  1651 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.851s	user 0.015s	sys 0.017s
I20260709 13:00:46.498472  1569 raft_consensus.cc:2468] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 13.
W20260709 13:00:46.541101  1651 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.851s	user 0.015s	sys 0.017s
I20260709 13:00:46.542172  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:46.543146  1569 raft_consensus.cc:2410] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 9 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:00:46.544042  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:46.516959  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:46.529237  1539 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:46.490190  6353 raft_consensus.cc:493] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
W20260709 13:00:46.503556  6397 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.080s	user 0.030s	sys 0.031s
I20260709 13:00:46.485489  6343 raft_consensus.cc:493] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:46.545830  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 62449us
W20260709 13:00:46.596971  1539 connection.cc:256] RPC call timeout handler was delayed by -1.051349412000036s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19820000000000002s for a response
W20260709 13:00:46.598186  1539 connection.cc:256] RPC call timeout handler was delayed by -1.006640793000031s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22480000000000003s for a response
W20260709 13:00:46.599007  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:46.599468  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.541028  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:46.530612  1576 raft_consensus.cc:2468] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 11.
I20260709 13:00:46.602198  1576 raft_consensus.cc:1240] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:46.524917  1647 rpcz_store.cc:276] 0709 13:00:45.431930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.479995 (+1048065us) service_pool.cc:224] Handling call
0709 13:00:46.498401 (+ 18406us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:46.604396  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:46.605167  1647 raft_consensus.cc:2468] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 11.
I20260709 13:00:46.556779  1569 raft_consensus.cc:1275] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:00:46.605756  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45148 (request call id 2523) took 1104 ms. Trace:
I20260709 13:00:46.607295  1647 rpcz_store.cc:276] 0709 13:00:45.501868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.604097 (+1102229us) service_pool.cc:224] Handling call
0709 13:00:46.605692 (+  1595us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:46.608544  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:45.790050  6395 raft_consensus.cc:515] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:46.609500  1576 raft_consensus.cc:1240] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 9. Current term is 10. Ops: [5.4-9.6]
I20260709 13:00:46.612838  1539 leader_election.cc:304] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:46.615104  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:00:46.528015  6372 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.945s	user 0.013s	sys 0.018s
I20260709 13:00:46.617003  1642 raft_consensus.cc:2468] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 10.
I20260709 13:00:46.623147  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45148 (request call id 2533) took 1063 ms. Trace:
I20260709 13:00:46.618443  1569 raft_consensus.cc:1240] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 11. Current term is 13. Ops: []
I20260709 13:00:46.624672  1642 rpcz_store.cc:276] 0709 13:00:45.559986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.527516 (+967530us) service_pool.cc:224] Handling call
0709 13:00:46.623069 (+ 95553us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:46.625403  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:46.626377  1568 raft_consensus.cc:2468] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 9.
I20260709 13:00:46.436681  6267 raft_consensus.cc:515] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:46.616268  6397 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.238s	user 0.033s	sys 0.031s
I20260709 13:00:46.592231  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:46.478137  6531 raft_consensus.cc:515] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:46.634390  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:46.636909  6397 raft_consensus.cc:493] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:46.434170  6525 raft_consensus.cc:515] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:45.722723  6252 consensus_queue.cc:260] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:46.629032  6557 log.cc:927] Time spent T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:00:46.663106  1647 raft_consensus.cc:3060] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:46.664323  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:46.535676  6456 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:45.785735  6540 raft_consensus.cc:515] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:46.616369  6506 raft_consensus.cc:2749] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:46.594228  6452 raft_consensus.cc:2749] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:46.619951  6353 raft_consensus.cc:3060] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:46.633502  6372 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.046s	user 0.013s	sys 0.019s
I20260709 13:00:46.534572  6374 raft_consensus.cc:515] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:46.670900  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:46.673041  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:46.537174  6545 raft_consensus.cc:515] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:46.663264  6383 consensus_meta.cc:287] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 1.188s	user 0.009s	sys 0.002s
W20260709 13:00:46.654601  1615 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.084s	user 0.002s	sys 0.039s
W20260709 13:00:46.706521  1615 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.136s	user 0.002s	sys 0.040s
W20260709 13:00:46.677507  6548 log.cc:927] Time spent T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
W20260709 13:00:46.680915  1644 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.236s	user 0.070s	sys 0.058s
W20260709 13:00:46.710107  1644 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.265s	user 0.071s	sys 0.058s
I20260709 13:00:46.711061  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 949) took 2800 ms. Trace:
I20260709 13:00:46.675482  6252 raft_consensus.cc:3060] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:46.633162  5970 consensus_queue.cc:1048] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 13:00:46.643285  6397 raft_consensus.cc:515] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:46.667058  6546 raft_consensus.cc:2804] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:46.629326  6343 raft_consensus.cc:515] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:46.541296  6552 raft_consensus.cc:515] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:46.696923  1650 raft_consensus.cc:2393] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 13: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
W20260709 13:00:46.677167  6463 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.052s	user 0.021s	sys 0.021s
W20260709 13:00:46.706874  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 1.13619e+06us
I20260709 13:00:46.711259  6383 raft_consensus.cc:2749] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:46.690338  1642 raft_consensus.cc:2468] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 11.
I20260709 13:00:46.729290  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 1993) took 1297 ms. Trace:
I20260709 13:00:46.729817  1642 rpcz_store.cc:276] 0709 13:00:45.432283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.625683 (+1193400us) service_pool.cc:224] Handling call
0709 13:00:46.729206 (+103523us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:46.711481  1644 rpcz_store.cc:276] 0709 13:00:43.911156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.400864 (+489708us) service_pool.cc:224] Handling call
0709 13:00:44.401237 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:44.401489 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:00:45.444438 (+1042949us) log.cc:844] Serialized 14 byte log entry
0709 13:00:46.710612 (+1266174us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:46.710684 (+    72us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:46.710750 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.710865 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:46.711000 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1134425,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"thread_start_us":2308393,"threads_started":2}
I20260709 13:00:46.731892  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:46.680306  1647 raft_consensus.cc:2468] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 7.
I20260709 13:00:46.711619  6506 raft_consensus.cc:493] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
W20260709 13:00:46.722345  6553 log.cc:927] Time spent T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.378s	user 0.001s	sys 0.000s
I20260709 13:00:46.743378  1571 raft_consensus.cc:2468] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 12.
I20260709 13:00:46.754031  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 1996) took 1317 ms. Trace:
I20260709 13:00:46.757372  1644 rpcz_store.cc:276] 0709 13:00:45.436852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.731581 (+1294729us) service_pool.cc:224] Handling call
0709 13:00:46.753954 (+ 22373us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:46.758790  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:46.759846  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45148 (request call id 2532) took 1200 ms. Trace:
W20260709 13:00:46.724841  6463 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.100s	user 0.021s	sys 0.021s
I20260709 13:00:46.671351  6405 consensus_queue.cc:237] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:46.719825  6546 raft_consensus.cc:493] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:46.716487  6568 raft_consensus.cc:493] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.754688  1569 raft_consensus.cc:2468] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 6.
I20260709 13:00:46.760290  1644 rpcz_store.cc:276] 0709 13:00:45.559662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.758422 (+1198760us) service_pool.cc:224] Handling call
0709 13:00:46.759768 (+  1346us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:46.763772  1542 leader_election.cc:304] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:46.764626  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 1237) took 3797 ms. Trace:
I20260709 13:00:46.765995  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:46.676425  6371 consensus_queue.cc:260] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:46.769248  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
W20260709 13:00:46.754117  6559 log.cc:927] Time spent T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.317s	user 0.000s	sys 0.001s
I20260709 13:00:46.767060  1567 rpcz_store.cc:276] 0709 13:00:42.967520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.578471 (+610951us) service_pool.cc:224] Handling call
0709 13:00:43.578754 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:44.402456 (+823702us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:44.402492 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:44.403071 (+   579us) log.cc:844] Serialized 26 byte log entry
0709 13:00:45.600984 (+1197913us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:45.601026 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.601090 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:46.764403 (+1163313us) raft_consensus.cc:1685] finished
0709 13:00:46.764424 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:46.764573 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15797,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":85,"thread_start_us":2008485,"threads_started":2,"wal-append.queue_time_us":1970393}
I20260709 13:00:46.793875  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: true dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:46.769122  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 1995) took 1332 ms. Trace:
I20260709 13:00:46.794585  1642 rpcz_store.cc:276] 0709 13:00:45.436549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.730735 (+1294186us) service_pool.cc:224] Handling call
0709 13:00:46.769056 (+ 38321us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:46.781355  1648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 944) took 2922 ms. Trace:
I20260709 13:00:46.795759  1648 rpcz_store.cc:276] 0709 13:00:43.858674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.362606 (+503932us) service_pool.cc:224] Handling call
0709 13:00:44.395241 (+ 32635us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:44.395494 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:44.395542 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:44.396116 (+   574us) log.cc:844] Serialized 26 byte log entry
0709 13:00:44.866679 (+470563us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:44.866738 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:44.866837 (+    99us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:46.524149 (+1657312us) raft_consensus.cc:1685] finished
0709 13:00:46.524182 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:46.780967 (+256785us) spinlock_profiling.cc:243] Waited 7.6 ms on lock 0x7b540030f550. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23ba8ad 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:46.781263 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17490176,"thread_start_us":470178,"threads_started":1,"wal-append.queue_time_us":957834}
W20260709 13:00:46.786058  1468 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48478 (request call id 176) took 27270 ms (client timeout 15000 ms). Trace:
W20260709 13:00:46.790895  6560 log.cc:927] Time spent T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.459s	user 0.004s	sys 0.005s
I20260709 13:00:46.791676  1574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 1229) took 4087 ms. Trace:
W20260709 13:00:46.773785  1615 connection.cc:256] RPC call timeout handler was delayed by -1.1244973099999811s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17370000000000002s for a response
I20260709 13:00:46.800297  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:46.798069  1574 rpcz_store.cc:276] 0709 13:00:42.704259 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.003257 (+298998us) service_pool.cc:224] Handling call
0709 13:00:43.003529 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:44.625238 (+1621709us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.791385 (+2166147us) spinlock_profiling.cc:243] Waited 1.59 s on lock 0x7b54003291d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:46.791605 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3666925312}
I20260709 13:00:46.764082  6038 leader_election.cc:290] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:46.765126  6574 raft_consensus.cc:493] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:46.808977  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:46.809608  1642 raft_consensus.cc:3060] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:46.808245  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:46.801156  1648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57912 (request call id 952) took 1239 ms. Trace:
I20260709 13:00:46.811599  1648 rpcz_store.cc:276] 0709 13:00:45.561649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.797405 (+1235756us) service_pool.cc:224] Handling call
0709 13:00:46.801093 (+  3688us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:46.794107  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:46.813133  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:46.765501  6546 raft_consensus.cc:3060] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:46.803375  1567 raft_consensus.cc:3060] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:46.811082  1574 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 13.
W20260709 13:00:46.816711  1614 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.802s	user 0.041s	sys 0.095s
W20260709 13:00:46.818857  1614 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.804s	user 0.041s	sys 0.095s
I20260709 13:00:46.775286  6383 raft_consensus.cc:3055] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:46.821249  6383 raft_consensus.cc:740] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
W20260709 13:00:46.822263  6579 log.cc:927] Time spent T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 13:00:46.822106  6383 consensus_queue.cc:260] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:46.823447  6383 raft_consensus.cc:3060] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:00:46.823498  6566 log.cc:927] Time spent T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:00:46.824992  1688 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.160s	user 0.016s	sys 0.067s
I20260709 13:00:46.825471  1649 raft_consensus.cc:1240] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
W20260709 13:00:46.826753  1688 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.162s	user 0.016s	sys 0.067s
W20260709 13:00:46.827045  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 1.16253e+06us
I20260709 13:00:46.825254  1645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 943) took 2967 ms. Trace:
W20260709 13:00:46.825686  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.828718  1645 rpcz_store.cc:276] 0709 13:00:43.858149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.360631 (+502482us) service_pool.cc:224] Handling call
0709 13:00:44.360984 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:45.180765 (+819781us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:45.180808 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:45.192589 (+ 11781us) log.cc:844] Serialized 26 byte log entry
0709 13:00:46.390288 (+1197699us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:46.390348 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.390454 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:46.825007 (+434553us) raft_consensus.cc:1685] finished
0709 13:00:46.825031 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:46.825191 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":238348,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":2307,"thread_start_us":1886223,"threads_started":2,"wal-append.queue_time_us":1536082}
I20260709 13:00:46.838059  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:46.764916  6506 raft_consensus.cc:515] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:46.803911  6371 raft_consensus.cc:3060] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:00:46.830654  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:46.856559  1648 raft_consensus.cc:2393] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 11: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:46.857102  1648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45148 (request call id 2528) took 1353 ms. Trace:
I20260709 13:00:46.857453  1648 rpcz_store.cc:276] 0709 13:00:45.503481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.836771 (+1333290us) service_pool.cc:224] Handling call
0709 13:00:46.857023 (+ 20252us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:46.775604  6568 raft_consensus.cc:515] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:47.027755  1718 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.024s	sys 0.037s
W20260709 13:00:46.797818  1468 rpcz_store.cc:269] 0709 13:00:19.515580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:19.515793 (+   213us) service_pool.cc:224] Handling call
0709 13:00:46.785934 (+27270141us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:39.149120 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:39.149990 (+   870us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:39.150051 (+    61us) write_op.cc:435] Acquired schema lock
0709 13:00:39.150079 (+    28us) tablet.cc:662] Decoding operations
0709 13:00:39.276945 (+126866us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:39.277079 (+   134us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:39.277107 (+    28us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:00:39.278245 (+  1138us) tablet.cc:701] Row locks acquired
0709 13:00:39.278304 (+    59us) write_op.cc:260] PREPARE: finished
0709 13:00:39.278479 (+   175us) write_op.cc:270] Start()
0709 13:00:39.278629 (+   150us) write_op.cc:276] Timestamp: P: 1783602039278419 usec, L: 0
0709 13:00:39.278667 (+    38us) op_driver.cc:348] REPLICATION: starting
0709 13:00:39.279429 (+   762us) log.cc:844] Serialized 4367 byte log entry
0709 13:00:39.605187 (+325758us) op_driver.cc:464] REPLICATION: finished
0709 13:00:39.747912 (+142725us) write_op.cc:301] APPLY: starting
0709 13:00:39.770233 (+ 22321us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:40.566196 (+795963us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:40.590368 (+ 24172us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:40.971512 (+381144us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:40.978877 (+  7365us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 13:00:40.978936 (+    59us) write_op.cc:312] APPLY: finished
0709 13:00:40.979428 (+   492us) log.cc:844] Serialized 105 byte log entry
0709 13:00:41.228301 (+248873us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:41.240126 (+ 11825us) write_op.cc:454] Released schema lock
0709 13:00:41.246199 (+  6073us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:41.321617 (+ 75418us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:41.352233 (+ 30616us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1789533,"reported_tablets":24,"child_traces":[["op",{"apply.queue_time_us":112668,"apply.run_cpu_time_us":58008,"apply.run_wall_time_us":1546951,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50107,"num_ops":11,"prepare.queue_time_us":217200,"prepare.run_cpu_time_us":20257,"prepare.run_wall_time_us":242242,"raft.queue_time_us":130150,"raft.run_cpu_time_us":17800,"raft.run_wall_time_us":94299,"replication_time_us":326374,"thread_start_us":592453,"threads_started":5,"wal-append.queue_time_us":420787,"wal-append.run_cpu_time_us":33201,"wal-append.run_wall_time_us":2143409}]]}
W20260709 13:00:46.852959  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:47.011722  1689 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.011s	sys 0.063s
I20260709 13:00:47.068813  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:00:47.005553  1616 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.011s	sys 0.033s
W20260709 13:00:47.089452  1689 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.018s	sys 0.073s
I20260709 13:00:46.856022  1645 raft_consensus.cc:2468] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 10.
I20260709 13:00:47.089792  1648 raft_consensus.cc:2468] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 11.
W20260709 13:00:46.887545  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.090392  1645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45148 (request call id 2536) took 1529 ms. Trace:
I20260709 13:00:46.843920  1567 raft_consensus.cc:2468] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 7.
I20260709 13:00:47.090962  1645 rpcz_store.cc:276] 0709 13:00:45.560954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.830402 (+1269448us) service_pool.cc:224] Handling call
0709 13:00:47.090331 (+259929us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:47.091751  1718 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.024s	sys 0.046s
I20260709 13:00:46.865896  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:47.092489  1574 raft_consensus.cc:2468] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 9.
W20260709 13:00:47.095371  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:46.848152  1642 raft_consensus.cc:2468] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 15.
W20260709 13:00:47.101708  1642 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45148 (request call id 2537) took 1540 ms (client timeout 2019 ms). Trace:
W20260709 13:00:47.102159  1642 rpcz_store.cc:269] 0709 13:00:45.561282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.795452 (+1234170us) service_pool.cc:224] Handling call
0709 13:00:47.101650 (+306198us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:47.089814  1616 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.014s	sys 0.036s
I20260709 13:00:46.837214  6038 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:47.114764  6552 leader_election.cc:290] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:47.114921  6569 log.cc:927] Time spent T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.196s	user 0.000s	sys 0.000s
I20260709 13:00:47.114653  6038 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:47.116267  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:47.116885  1645 raft_consensus.cc:2468] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 11.
I20260709 13:00:47.117429  1645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 1999) took 1666 ms. Trace:
I20260709 13:00:47.117980  1645 rpcz_store.cc:276] 0709 13:00:45.450681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.115996 (+1665315us) service_pool.cc:224] Handling call
0709 13:00:47.117341 (+  1345us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:47.118376  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:47.090474  1648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45148 (request call id 2534) took 1530 ms. Trace:
I20260709 13:00:47.120265  1648 rpcz_store.cc:276] 0709 13:00:45.560297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.858169 (+1297872us) service_pool.cc:224] Handling call
0709 13:00:47.090364 (+232195us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:47.131620  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:47.132449  1642 raft_consensus.cc:2393] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 13: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
W20260709 13:00:46.919225  6530 log.cc:927] Time spent T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.752s	user 0.003s	sys 0.011s
W20260709 13:00:46.834142  6515 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.268s	user 0.008s	sys 0.049s
W20260709 13:00:46.994156  6448 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.783s	user 0.003s	sys 0.044s
I20260709 13:00:47.027699  6374 leader_election.cc:290] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:47.148036  2294 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.006s	sys 0.007s
I20260709 13:00:47.115489  6581 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:47.047072  6456 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:46.907006  6343 leader_election.cc:290] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:47.147382  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:46.852273  6521 raft_consensus.cc:493] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
W20260709 13:00:47.150620  1617 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.002s	sys 0.011s
I20260709 13:00:47.151469  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 2001) took 1700 ms. Trace:
I20260709 13:00:47.152431  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:46.896215  6525 leader_election.cc:290] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:46.907863  6578 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:47.201232  1574 raft_consensus.cc:2468] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 11.
I20260709 13:00:47.150283  1648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 1981) took 3102 ms. Trace:
I20260709 13:00:46.908648  6395 leader_election.cc:290] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:47.058130  6545 leader_election.cc:290] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:00:47.213116  1575 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.803s	user 0.004s	sys 0.017s
W20260709 13:00:47.152793  6448 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.947s	user 0.003s	sys 0.060s
W20260709 13:00:47.184293  1646 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.006s	sys 0.006s
W20260709 13:00:47.213927  1646 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.006s	sys 0.007s
W20260709 13:00:47.157748  6354 consensus_meta.cc:287] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 1.564s	user 0.009s	sys 0.005s
W20260709 13:00:47.155491  2297 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.006s	sys 0.006s
W20260709 13:00:47.215410  2297 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.007s	sys 0.007s
W20260709 13:00:47.215752  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 675641us
I20260709 13:00:47.216647  2297 leader_election.cc:304] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:47.184127  6581 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:47.152218  6540 leader_election.cc:290] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:47.203485  6533 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.005s	sys 0.011s
W20260709 13:00:47.185425  2294 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.006s	sys 0.007s
W20260709 13:00:47.240408  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 776438us
W20260709 13:00:47.152331  6563 log.cc:927] Time spent T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.376s	user 0.001s	sys 0.000s
I20260709 13:00:46.826406  6574 raft_consensus.cc:515] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:47.129220  6397 leader_election.cc:290] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:46.930119  6267 leader_election.cc:290] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:47.145613  6552 raft_consensus.cc:493] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:47.150012  6515 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.584s	user 0.008s	sys 0.050s
W20260709 13:00:47.150580  6079 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.000s	sys 0.012s
I20260709 13:00:47.196578  6343 raft_consensus.cc:493] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:47.196154  6456 raft_consensus.cc:493] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:47.226666  6395 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:47.244724  6533 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.006s	sys 0.011s
I20260709 13:00:47.198992  6521 raft_consensus.cc:515] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:47.276221  6572 log.cc:927] Time spent T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 13:00:47.239687  6463 raft_consensus.cc:2749] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:00:47.277041  6580 log.cc:927] Time spent T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
W20260709 13:00:47.277786  6571 log.cc:927] Time spent T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
I20260709 13:00:47.273895  6552 raft_consensus.cc:515] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:47.271729  6079 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.783s	user 0.000s	sys 0.013s
I20260709 13:00:47.278252  6456 raft_consensus.cc:515] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 13:00:47.279302  6343 raft_consensus.cc:515] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
W20260709 13:00:47.286798  6489 consensus_meta.cc:287] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 1.591s	user 0.009s	sys 0.004s
I20260709 13:00:47.213230  6578 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:47.288224  6574 leader_election.cc:290] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:47.216385  6585 raft_consensus.cc:493] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.339732  6437 raft_consensus.cc:3055] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:47.340140  6585 raft_consensus.cc:515] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:47.237870  6506 leader_election.cc:290] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:47.241498  6545 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:47.325326  6552 leader_election.cc:290] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:47.325328  6343 leader_election.cc:290] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:47.326964  6411 leader_election.cc:290] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:47.236958  6354 raft_consensus.cc:515] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:47.329260  6602 log.cc:927] Time spent T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.316s	user 0.002s	sys 0.001s
W20260709 13:00:47.330806  6353 consensus_meta.cc:287] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.624s	user 0.007s	sys 0.003s
I20260709 13:00:47.332603  6521 leader_election.cc:290] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:47.333673  6583 log.cc:927] Time spent T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 13:00:47.335711  6456 leader_election.cc:290] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373)
I20260709 13:00:47.291024  6395 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:47.339270  6568 leader_election.cc:290] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:00:47.343806  6541 log.cc:927] Time spent T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.840s	user 0.000s	sys 0.002s
I20260709 13:00:47.342295  6531 leader_election.cc:290] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:47.322357  6372 raft_consensus.cc:493] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.340417  6437 raft_consensus.cc:740] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:47.368674  6372 raft_consensus.cc:515] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:47.344702  6581 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:47.369131  6437 consensus_queue.cc:260] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:47.370457  6437 raft_consensus.cc:3060] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:47.357349  6545 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:47.373028  6372 leader_election.cc:290] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:00:47.362824  6546 consensus_meta.cc:287] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.533s	user 0.011s	sys 0.000s
I20260709 13:00:47.363310  6354 leader_election.cc:290] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 17 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:47.366164  6395 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:47.346966  6578 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:47.375211  6545 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:47.375033  6546 raft_consensus.cc:515] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:47.369361  6585 leader_election.cc:290] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:47.357637  6353 raft_consensus.cc:515] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:47.514863  6351 raft_consensus.cc:493] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:47.515654  6351 raft_consensus.cc:515] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:47.517197  6353 leader_election.cc:290] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:00:47.519652  6371 consensus_meta.cc:287] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.651s	user 0.011s	sys 0.000s
W20260709 13:00:47.155383  1539 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.005s	sys 0.008s
I20260709 13:00:47.522094  6351 leader_election.cc:290] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:00:47.522512  1539 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.908s	user 0.005s	sys 0.009s
W20260709 13:00:47.425388  1542 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.023s	sys 0.053s
W20260709 13:00:47.524828  1542 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.754s	user 0.023s	sys 0.053s
W20260709 13:00:47.524983  6383 consensus_meta.cc:287] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.701s	user 0.015s	sys 0.002s
W20260709 13:00:47.525256  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 754598us
I20260709 13:00:47.526062  1644 raft_consensus.cc:3060] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:47.192687  1567 raft_consensus.cc:2468] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 14.
I20260709 13:00:47.529021  6395 consensus_queue.cc:1048] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:47.434576  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 13:00:47.436219  1575 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.046s	user 0.005s	sys 0.017s
I20260709 13:00:47.529947  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:47.530982  1567 raft_consensus.cc:2468] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 15.
I20260709 13:00:47.531210  1575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36642 (request call id 2593) took 1847 ms. Trace:
I20260709 13:00:47.436725  1571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36640 (request call id 2387) took 1039 ms. Trace:
I20260709 13:00:47.437532  1576 raft_consensus.cc:2393] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 12: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:47.522100  6372 consensus_queue.cc:1059] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 13:00:47.534291  6372 raft_consensus.cc:3055] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:47.534822  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:47.532696  1571 rpcz_store.cc:276] 0709 13:00:46.397197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.478175 (+ 80978us) service_pool.cc:224] Handling call
0709 13:00:47.436283 (+958108us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b5400128754. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:47.436511 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":425163520}
I20260709 13:00:47.438629  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:47.536492  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:47.537549  1571 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 9.
I20260709 13:00:47.537968  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:46.444029  1573 rpcz_store.cc:276] 0709 13:00:44.396606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.396760 (+   154us) service_pool.cc:224] Handling call
0709 13:00:44.397194 (+   434us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:44.397424 (+   230us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:00:45.245094 (+847670us) log.cc:844] Serialized 14 byte log entry
0709 13:00:46.443175 (+1198081us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:46.443227 (+    52us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:46.443279 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.443349 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:46.443459 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27200,"prepare.queue_time_us":1243519,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":105,"thread_start_us":2016993,"threads_started":2}
I20260709 13:00:47.461658  1643 raft_consensus.cc:1240] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 14 LEADER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 13. Current term is 14. Ops: []
W20260709 13:00:47.462749  1614 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.002s	sys 0.009s
W20260709 13:00:47.462837  1647 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45148 (request call id 2538) took 1778 ms (client timeout 1656 ms). Trace:
W20260709 13:00:47.197732  1617 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.716s	user 0.002s	sys 0.011s
I20260709 13:00:47.207578  1642 rpcz_store.cc:276] 0709 13:00:45.451344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.128801 (+1677457us) service_pool.cc:224] Handling call
0709 13:00:47.151414 (+ 22613us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:47.205555  1648 rpcz_store.cc:276] 0709 13:00:44.047716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.147930 (+3100214us) service_pool.cc:224] Handling call
0709 13:00:47.149624 (+  1694us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:47.149947 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:47.149973 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:47.150010 (+    37us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:47.150055 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:47.150112 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:47.150228 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:47.645556  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:47.646538  1648 raft_consensus.cc:2393] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 10: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
W20260709 13:00:47.647281  6270 consensus_meta.cc:287] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 1.159s	user 0.010s	sys 0.010s
W20260709 13:00:47.647518  1617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.647835  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:00:47.464753  1650 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45142 (request call id 1997) took 2027 ms (client timeout 1564 ms). Trace:
W20260709 13:00:47.648705  1650 rpcz_store.cc:269] 0709 13:00:45.437131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.439296 (+1002165us) service_pool.cc:224] Handling call
0709 13:00:47.464174 (+1024878us) spinlock_profiling.cc:243] Waited 255 ms on lock 0x7b54001752d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:47.464445 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":587537664}
I20260709 13:00:47.651136  1650 raft_consensus.cc:1240] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:47.466156  1651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 950) took 3542 ms. Trace:
I20260709 13:00:47.534730  6372 raft_consensus.cc:740] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:47.466616  1719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1917) took 4886 ms. Trace:
I20260709 13:00:47.467154  1649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 1977) took 3561 ms. Trace:
W20260709 13:00:47.467041  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 314682us
W20260709 13:00:47.194595  2295 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.751s	user 0.023s	sys 0.043s
I20260709 13:00:47.470192  1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2493) took 3628 ms. Trace:
I20260709 13:00:47.477278  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:47.478693  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:47.479535  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:47.480772  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:00:47.481595  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.491196  6038 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:47.505394  6343 raft_consensus.cc:493] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:47.655180  1723 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 9.
I20260709 13:00:47.655879  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:47.655725  6343 raft_consensus.cc:515] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:47.495704  6079 consensus_queue.cc:1048] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:00:47.656298  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:47.656504  1721 raft_consensus.cc:3060] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:47.509891  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:47.511101  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:47.658548  1725 raft_consensus.cc:2410] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:00:47.659165  1720 raft_consensus.cc:2468] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 12.
I20260709 13:00:47.512238  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:47.505432  6275 consensus_queue.cc:1048] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:00:47.529119  6506 consensus_queue.cc:1059] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:47.667801  6506 raft_consensus.cc:3055] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:00:47.191329  1570 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.003s	sys 0.011s
I20260709 13:00:47.652853  1649 rpcz_store.cc:276] 0709 13:00:43.906162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.388017 (+481855us) service_pool.cc:224] Handling call
0709 13:00:46.825157 (+2437140us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:46.826849 (+  1692us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:47.466758 (+639909us) spinlock_profiling.cc:243] Waited 2.41 s on lock 0x7b54001f8450. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23ba8ad 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:47.466972 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5539188096}
W20260709 13:00:47.668933  1570 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.001s	user 0.003s	sys 0.011s
I20260709 13:00:47.670029  1649 raft_consensus.cc:1240] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:47.670766  1649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 1998) took 2233 ms. Trace:
I20260709 13:00:47.670909  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36642 (request call id 2596) took 1254 ms. Trace:
I20260709 13:00:47.671142  1649 rpcz_store.cc:276] 0709 13:00:45.450042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.669114 (+2219072us) service_pool.cc:224] Handling call
0709 13:00:47.669701 (+   587us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:47.670476 (+   775us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:47.670685 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:47.387672  6546 leader_election.cc:290] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:47.536304  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:47.674530  1576 raft_consensus.cc:2468] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 13.
I20260709 13:00:47.675580  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:47.538697  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:47.677474  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:47.678258  1571 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 13.
I20260709 13:00:47.679565  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:47.668275  6506 raft_consensus.cc:740] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:47.681929  6506 consensus_queue.cc:260] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:47.683713  6506 raft_consensus.cc:3060] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:47.685094  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:47.685364  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:47.686206  2332 raft_consensus.cc:3060] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:47.686676  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:47.687763  1576 raft_consensus.cc:2393] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 13: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:47.688688  1650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 1982) took 3606 ms. Trace:
I20260709 13:00:47.689864  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:47.691715  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:47.692683  1571 raft_consensus.cc:2468] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 11.
I20260709 13:00:47.631814  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 13:00:47.700138  1601 heartbeater.cc:646] Failed to heartbeat to 127.0.107.254:42827 (3 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.0.107.254:42827 timed out after 15.000s (SENT)
I20260709 13:00:47.698880  1721 raft_consensus.cc:2468] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 12.
I20260709 13:00:47.541961  1644 raft_consensus.cc:2468] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 13.
W20260709 13:00:47.629675  1647 rpcz_store.cc:269] 0709 13:00:45.683956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.608220 (+924264us) service_pool.cc:224] Handling call
0709 13:00:47.462286 (+854066us) spinlock_profiling.cc:243] Waited 53 ms on lock 0x7b54002b4154. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:47.462496 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":121955200}
I20260709 13:00:47.633296  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:47.488219  2297 leader_election.cc:400] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473) with higher term. Message: Invalid argument: T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 6. Current term is 7.
W20260709 13:00:47.524456  1539 leader_election.cc:336] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Timed out: RequestConsensusVote RPC to 127.0.107.194:37391 timed out after 1.627s (SENT)
I20260709 13:00:47.639313  1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 1978) took 3706 ms. Trace:
I20260709 13:00:47.641369  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:47.648427  1572 raft_consensus.cc:2410] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 9 because replica has last-logged OpId of term: 8 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 9.
I20260709 13:00:47.540122  1542 leader_election.cc:304] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 13:00:47.654654  2295 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.210s	user 0.023s	sys 0.044s
I20260709 13:00:47.702200  2297 leader_election.cc:403] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:47.663813  1615 leader_election.cc:304] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:47.651885  1651 rpcz_store.cc:276] 0709 13:00:43.923607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.414271 (+490664us) service_pool.cc:224] Handling call
0709 13:00:44.435568 (+ 21297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:45.479906 (+1044338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:45.479956 (+    50us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:45.506207 (+ 26251us) log.cc:844] Serialized 26 byte log entry
0709 13:00:46.541931 (+1035724us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:46.541998 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:46.542112 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:47.465464 (+923352us) raft_consensus.cc:1685] finished
0709 13:00:47.465528 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:47.465888 (+   360us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":189803,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":3811,"thread_start_us":1895774,"threads_started":2,"wal-append.queue_time_us":1365078}
W20260709 13:00:47.665146  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:47.666908  6343 leader_election.cc:290] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:47.653620  1718 rpcz_store.cc:276] 0709 13:00:43.841840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:43.842722 (+   882us) service_pool.cc:224] Handling call
0709 13:00:43.842992 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:43.843180 (+   188us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:44.467417 (+624237us) log.cc:844] Serialized 14 byte log entry
0709 13:00:47.092284 (+2624867us) log.cc:844] Serialized 14 byte log entry
0709 13:00:47.469181 (+376897us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:47.469322 (+   141us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:47.469533 (+   211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:47.469728 (+   195us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:47.469946 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12524,"prepare.queue_time_us":1468183,"prepare.run_cpu_time_us":100,"prepare.run_wall_time_us":5337,"raft.queue_time_us":64019,"raft.run_cpu_time_us":388,"raft.run_wall_time_us":13312,"thread_start_us":3602096,"threads_started":5,"wal-append.queue_time_us":1346496,"wal-append.run_cpu_time_us":1065,"wal-append.run_wall_time_us":1024015}
I20260709 13:00:47.706679  1569 raft_consensus.cc:1240] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 9. Current term is 10. Ops: [9.7-9.7]
W20260709 13:00:47.707646  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 1.26409e+06us
I20260709 13:00:47.707782  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:47.708799  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:47.707480  6437 raft_consensus.cc:2749] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:47.709707  2328 raft_consensus.cc:3060] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:47.709837  2295 leader_election.cc:304] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:47.710762  6301 raft_consensus.cc:493] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.711299  6301 raft_consensus.cc:515] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:47.712462  6275 raft_consensus.cc:2749] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:47.692863  1649 raft_consensus.cc:1240] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:47.671362  1570 rpcz_store.cc:276] 0709 13:00:46.416757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.616967 (+200210us) service_pool.cc:224] Handling call
0709 13:00:46.617427 (+   460us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:46.652965 (+ 35538us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:00:46.667779 (+ 14814us) log.cc:844] Serialized 14 byte log entry
0709 13:00:47.669657 (+1001878us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:47.669778 (+   121us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:47.669919 (+   141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:47.670625 (+   706us) spinlock_profiling.cc:243] Waited 35.3 ms on lock 0x7b5400313654. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:47.670669 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:47.670849 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":14653,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"spinlock_wait_cycles":81149696,"thread_start_us":1001310,"threads_started":1,"wal-append.queue_time_us":617950}
I20260709 13:00:47.689284  1650 rpcz_store.cc:276] 0709 13:00:44.048060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.650153 (+3602093us) service_pool.cc:224] Handling call
0709 13:00:47.650744 (+   591us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:47.651631 (+   887us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:47.654032 (+  2401us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:47.700562  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:47.657665  1717 raft_consensus.cc:2468] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 11.
I20260709 13:00:47.532297  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:47.714845  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:47.652772  1719 rpcz_store.cc:276] 0709 13:00:42.580488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:42.995908 (+415420us) service_pool.cc:224] Handling call
0709 13:00:43.202797 (+206889us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:43.238335 (+ 35538us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:00:43.559976 (+321641us) spinlock_profiling.cc:243] Waited 1.48 ms on lock 0x7b180042b560. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef2b0e07 00007fa9f810bab9 00007fa9ef2cd69b 00007fa9ef2cb93f 00007fa9ef2cb455 00007fa9f5db33c7 00007fa9f23c59a7 00007fa9f23d50bf 00007fa9f23d5038
0709 13:00:44.361472 (+801496us) log.cc:844] Serialized 14 byte log entry
0709 13:00:45.214234 (+852762us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:45.605751 (+391517us) spinlock_profiling.cc:243] Waited 2.41 ms on lock 0x7b2c0001ccc8. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f0cb4a11 00007fa9f0cc4372 00007fa9f23f6a01 00007fa9f23bb43a 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2
0709 13:00:45.606161 (+   410us) log.cc:844] Serialized 26 byte log entry
0709 13:00:45.606284 (+   123us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:45.606315 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:45.606391 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:47.343164 (+1736773us) spinlock_profiling.cc:243] Waited 7.05 ms on lock 0x7b4400022b4c. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef1f4c85 00007fa9ef1f56a2 00007fa9f1f671db 00007fa9f1f62aaf 00007fa9f1f5686e 00007fa9f1f55bb6 00007fa9f1f557d8 00007fa9f1f5f221 00007fa9f1f5f1d9 00007fa9f1f5f169
0709 13:00:47.466057 (+122893us) raft_consensus.cc:1685] finished
0709 13:00:47.466092 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:47.466343 (+   251us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32029,"prepare.queue_time_us":1113610,"prepare.run_cpu_time_us":116,"prepare.run_wall_time_us":4411,"raft.queue_time_us":67746,"raft.run_cpu_time_us":275,"raft.run_wall_time_us":34330,"spinlock_wait_cycles":25172224,"thread_start_us":1580688,"threads_started":2,"wal-append.queue_time_us":1977499}
W20260709 13:00:47.760883  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 232593us
W20260709 13:00:47.761194  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 97674.3us
I20260709 13:00:47.761885  1542 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:47.762840  6301 leader_election.cc:290] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:47.762943  6343 raft_consensus.cc:2804] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:47.763610  6343 raft_consensus.cc:493] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:47.763742  6301 raft_consensus.cc:2804] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:47.764024  6343 raft_consensus.cc:3060] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:47.755199  6372 consensus_queue.cc:260] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:47.755362  1539 leader_election.cc:304] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:47.531747  1575 rpcz_store.cc:276] 0709 13:00:45.683820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:45.684093 (+   273us) service_pool.cc:224] Handling call
0709 13:00:45.684465 (+   372us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:46.389467 (+705002us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:46.389799 (+   332us) log.cc:844] Serialized 14 byte log entry
0709 13:00:47.530678 (+1140879us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:47.530772 (+    94us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:47.530907 (+   135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:47.530995 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:47.531121 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":19598,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":1035,"raft.queue_time_us":1808,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":167,"thread_start_us":1140323,"threads_started":1,"wal-append.queue_time_us":965843}
W20260709 13:00:47.764688  1646 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.003s	sys 0.011s
I20260709 13:00:47.774003  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 948) took 3864 ms. Trace:
I20260709 13:00:47.774346  1646 rpcz_store.cc:276] 0709 13:00:43.909860 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.394622 (+484762us) service_pool.cc:224] Handling call
0709 13:00:44.394960 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:44.395175 (+   215us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 13:00:45.212711 (+817536us) log.cc:844] Serialized 14 byte log entry
0709 13:00:47.773162 (+2560451us) log.cc:844] Serialized 14 byte log entry
0709 13:00:47.773520 (+   358us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:47.773607 (+    87us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:00:47.773699 (+    92us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:47.773776 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:47.773951 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39955,"prepare.queue_time_us":1569234,"prepare.run_cpu_time_us":123,"prepare.run_wall_time_us":125,"raft.queue_time_us":436513,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":15052,"thread_start_us":3336787,"threads_started":4,"wal-append.queue_time_us":1503841}
I20260709 13:00:47.765255  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:47.778697  2323 raft_consensus.cc:2393] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 13: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 13:00:47.779057  2328 raft_consensus.cc:2468] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 11.
W20260709 13:00:47.765672  1568 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.002s	sys 0.010s
I20260709 13:00:47.780686  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36642 (request call id 2603) took 1123 ms. Trace:
W20260709 13:00:47.781216  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 71617.6us
I20260709 13:00:47.781122  1568 rpcz_store.cc:276] 0709 13:00:46.656975 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.657188 (+   213us) service_pool.cc:224] Handling call
0709 13:00:46.657672 (+   484us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:46.662796 (+  5124us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:00:47.147831 (+485035us) log.cc:844] Serialized 14 byte log entry
0709 13:00:47.780060 (+632229us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:47.780161 (+   101us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:47.780238 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:47.780342 (+   104us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:47.780604 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":665,"prepare.queue_time_us":42436,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":125998,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"thread_start_us":1035438,"threads_started":2,"wal-append.queue_time_us":564570}
I20260709 13:00:47.764266  6301 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:47.784111  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45148 (request call id 2524) took 2256 ms. Trace:
I20260709 13:00:47.784559  1647 rpcz_store.cc:276] 0709 13:00:45.502202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.717397 (+2215195us) service_pool.cc:224] Handling call
0709 13:00:47.751648 (+ 34251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:47.752137 (+   489us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:47.752181 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:47.752230 (+    49us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:47.752281 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:47.752356 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:47.758588 (+  6232us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:47.785378  1645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 951) took 3845 ms. Trace:
I20260709 13:00:47.786072  6079 consensus_queue.cc:1048] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:47.785789  1645 rpcz_store.cc:276] 0709 13:00:43.939706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.146428 (+3206722us) service_pool.cc:224] Handling call
0709 13:00:47.146796 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:47.147161 (+   365us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:47.147186 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:47.147647 (+   461us) log.cc:844] Serialized 26 byte log entry
0709 13:00:47.784816 (+637169us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:47.784879 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:47.784981 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:47.785027 (+    46us) raft_consensus.cc:1685] finished
0709 13:00:47.785038 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:47.785183 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":79462,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":28687,"thread_start_us":448067,"threads_started":1,"wal-append.queue_time_us":549343}
I20260709 13:00:47.770380  6267 raft_consensus.cc:2749] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:47.769428  1572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36642 (request call id 2598) took 1330 ms. Trace:
I20260709 13:00:47.790447  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:47.790719  1572 rpcz_store.cc:276] 0709 13:00:46.438822 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.527720 (+ 88898us) service_pool.cc:224] Handling call
0709 13:00:47.769182 (+1241462us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540040c4d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:47.769352 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2341867776}
I20260709 13:00:47.792461  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:47.793020  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:47.704708  1574 raft_consensus.cc:2468] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 13.
I20260709 13:00:47.793926  2332 raft_consensus.cc:2468] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 12.
I20260709 13:00:47.780716  6446 raft_consensus.cc:2749] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:47.794531  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:47.795363  2331 raft_consensus.cc:2468] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 10.
I20260709 13:00:47.796204  1650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45148 (request call id 2530) took 2237 ms. Trace:
I20260709 13:00:47.792717  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: true dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:47.771461  1648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 2002) took 2319 ms. Trace:
W20260709 13:00:47.796857  1644 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45148 (request call id 2525) took 2294 ms (client timeout 2056 ms). Trace:
I20260709 13:00:47.714195  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:47.797274  1649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 2000) took 2346 ms. Trace:
I20260709 13:00:47.798779  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:47.766566  6372 raft_consensus.cc:3060] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:47.800906  1615 leader_election.cc:304] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 13:00:47.637954  1614 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.800s	user 0.007s	sys 0.026s
W20260709 13:00:47.767077  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 242749us
I20260709 13:00:47.804289  2327 raft_consensus.cc:2393] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 11: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 13:00:47.753964  1571 raft_consensus.cc:1240] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:47.705534  1651 raft_consensus.cc:1240] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 10. Current term is 12. Ops: []
I20260709 13:00:47.788305  1645 raft_consensus.cc:3060] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:47.803056  1649 rpcz_store.cc:276] 0709 13:00:45.451028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.672117 (+2221089us) service_pool.cc:224] Handling call
0709 13:00:47.692569 (+ 20452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:47.797006 (+104437us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:47.797212 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:47.802209  1644 rpcz_store.cc:269] 0709 13:00:45.502527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:46.768923 (+1266396us) service_pool.cc:224] Handling call
0709 13:00:47.796649 (+1027726us) spinlock_profiling.cc:243] Waited 750 ms on lock 0x7b54001739d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:47.796795 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1724693760}
I20260709 13:00:47.801312  1650 rpcz_store.cc:276] 0709 13:00:45.558959 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.795136 (+2236177us) service_pool.cc:224] Handling call
0709 13:00:47.795545 (+   409us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:47.795872 (+   327us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:47.795908 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:47.795963 (+    55us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:47.795990 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:47.796049 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:47.796154 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:47.805310  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 2401) took 1088 ms. Trace:
I20260709 13:00:47.801770  1648 rpcz_store.cc:276] 0709 13:00:45.451689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.758676 (+2306987us) service_pool.cc:224] Handling call
0709 13:00:47.770777 (+ 12101us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:47.771056 (+   279us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:47.771089 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:47.771162 (+    73us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:47.771209 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:47.771262 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:47.771383 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:47.702556  1643 rpcz_store.cc:276] 0709 13:00:43.933419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:44.704148 (+770729us) service_pool.cc:224] Handling call
0709 13:00:44.706908 (+  2760us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:47.630704 (+2923796us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:47.632378 (+  1674us) spinlock_profiling.cc:243] Waited 2.75 s on lock 0x7b54002b3254. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:47.639256 (+  6878us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6333569280}
I20260709 13:00:47.783862  6301 raft_consensus.cc:3060] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:47.809618  1651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45148 (request call id 2522) took 2308 ms. Trace:
I20260709 13:00:47.810042  1651 rpcz_store.cc:276] 0709 13:00:45.501468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.704743 (+2203275us) service_pool.cc:224] Handling call
0709 13:00:47.705268 (+   525us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:47.809347 (+104079us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:47.809561 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:47.810920  1571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 2400) took 1104 ms. Trace:
I20260709 13:00:47.811192  1571 rpcz_store.cc:276] 0709 13:00:46.706655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.701253 (+994598us) service_pool.cc:224] Handling call
0709 13:00:47.753618 (+ 52365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:47.810746 (+ 57128us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:47.810880 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:47.806438  1569 rpcz_store.cc:276] 0709 13:00:46.713429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.705756 (+992327us) service_pool.cc:224] Handling call
0709 13:00:47.706288 (+   532us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:47.707175 (+   887us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:47.801985 (+ 94810us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:47.807853  1542 leader_election.cc:304] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:47.713264  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:47.815819  2325 raft_consensus.cc:2468] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 5.
I20260709 13:00:47.815871  1647 raft_consensus.cc:1275] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:00:47.816712  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45148 (request call id 2527) took 2313 ms. Trace:
I20260709 13:00:47.817101  1647 rpcz_store.cc:276] 0709 13:00:45.503158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.785589 (+2282431us) service_pool.cc:224] Handling call
0709 13:00:47.801680 (+ 16091us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:47.816422 (+ 14742us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:47.816644 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:47.819880  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:47.820813  2330 raft_consensus.cc:2368] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 9. Current term is 10.
W20260709 13:00:47.813452  1539 leader_election.cc:336] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Timed out: RequestConsensusVote RPC to 127.0.107.194:37391 timed out after 1.921s (SENT)
W20260709 13:00:47.821559  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 59367.6us
W20260709 13:00:47.755183  6252 consensus_meta.cc:287] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 1.038s	user 0.009s	sys 0.010s
I20260709 13:00:47.828563  1539 leader_election.cc:304] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:47.833559  2328 raft_consensus.cc:3055] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:47.834043  2328 raft_consensus.cc:740] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:47.835767  6593 consensus_queue.cc:1048] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260709 13:00:47.836025  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:47.837802  6343 raft_consensus.cc:515] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:47.830268  6446 raft_consensus.cc:2749] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:47.839277  1615 leader_election.cc:304] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:47.840402  1615 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:47.841356  6343 leader_election.cc:290] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:47.841416  1615 leader_election.cc:304] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:47.842448  6383 raft_consensus.cc:2804] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:47.842870  6383 raft_consensus.cc:493] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:47.843076  6524 raft_consensus.cc:2804] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:47.843302  6383 raft_consensus.cc:3060] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:47.843506  1615 leader_election.cc:304] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:47.843633  6524 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:47.844205  6524 raft_consensus.cc:3060] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:47.844342  6525 raft_consensus.cc:2749] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:00:47.850193  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 85659us
I20260709 13:00:47.851173  1542 leader_election.cc:304] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:47.827979  6600 raft_consensus.cc:2804] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:00:47.854821  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 367050us
I20260709 13:00:47.855237  1542 leader_election.cc:304] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:47.855355  6275 raft_consensus.cc:3060] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:00:47.862450  6578 raft_consensus.cc:2749] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:47.855762  6446 raft_consensus.cc:2764] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:00:47.864054  6446 raft_consensus.cc:2804] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:00:47.866154  6288 consensus_meta.cc:287] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 1.400s	user 0.010s	sys 0.007s
I20260709 13:00:47.866676  6288 raft_consensus.cc:515] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:47.868841  2330 raft_consensus.cc:1240] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 LEADER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 10. Current term is 12. Ops: []
I20260709 13:00:47.864477  6446 raft_consensus.cc:493] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:47.870646  6446 raft_consensus.cc:3060] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:47.872797  5976 raft_consensus.cc:493] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.873528  5976 raft_consensus.cc:515] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:47.855718  1469 catalog_manager.cc:5697] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } }
I20260709 13:00:47.887985  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:47.857146  6267 raft_consensus.cc:2749] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:47.890290  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:47.894430  1576 raft_consensus.cc:2393] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 14: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:47.857755  6600 raft_consensus.cc:493] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:47.860934  2328 consensus_queue.cc:260] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:47.902868  1650 raft_consensus.cc:1275] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:00:47.903285  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
W20260709 13:00:47.903396  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 49970us
I20260709 13:00:47.908314  1645 raft_consensus.cc:1275] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 13:00:47.911502  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 104294us
W20260709 13:00:47.912401  1539 leader_election.cc:336] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Timed out: RequestConsensusVote RPC to 127.0.107.194:37391 timed out after 1.946s (SENT)
I20260709 13:00:47.912933  1539 leader_election.cc:304] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:47.913918  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:47.906865  1650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45148 (request call id 2531) took 2347 ms. Trace:
I20260709 13:00:47.915838  1650 rpcz_store.cc:276] 0709 13:00:45.559321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.815272 (+2255951us) service_pool.cc:224] Handling call
0709 13:00:47.857703 (+ 42431us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:47.906620 (+ 48917us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:47.906798 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:47.909235  1645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45148 (request call id 2529) took 2381 ms. Trace:
I20260709 13:00:47.919570  1645 rpcz_store.cc:276] 0709 13:00:45.527675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.787546 (+2259871us) service_pool.cc:224] Handling call
0709 13:00:47.788034 (+   488us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:47.908915 (+120881us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:47.909170 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:47.921274  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:47.922248  1570 raft_consensus.cc:2468] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 8.
I20260709 13:00:47.926973  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:47.928993  1576 raft_consensus.cc:1275] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:00:47.934820  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:47.935043  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:47.935832  1572 raft_consensus.cc:2468] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 7.
I20260709 13:00:47.935930  6275 raft_consensus.cc:2749] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473) with higher term. Message: Invalid argument: T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 6. Current term is 7.
I20260709 13:00:47.937561  6343 raft_consensus.cc:2749] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:47.938956  1575 raft_consensus.cc:1275] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:00:47.939575  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:47.940145  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:47.940222  1568 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 9.
I20260709 13:00:47.909533  6600 raft_consensus.cc:3060] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:47.916657  1469 catalog_manager.cc:5697] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 3 to 8, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 8 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } }
I20260709 13:00:47.950625  2328 raft_consensus.cc:3060] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:47.950902  2330 raft_consensus.cc:2468] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 7.
I20260709 13:00:47.951215  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:47.954041  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:47.954751  1575 raft_consensus.cc:2393] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 13: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
W20260709 13:00:47.955542  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 112127us
I20260709 13:00:47.967013  6524 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:47.969516  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:47.972402  1469 catalog_manager.cc:5697] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 5 to 6, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 6 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:47.944307  6252 raft_consensus.cc:493] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:47.984684  1567 raft_consensus.cc:1240] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:47.990485  1615 leader_election.cc:304] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:47.997203  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:47.997488  1469 catalog_manager.cc:5697] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 4 to 7, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 7 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:00:47.998243  2323 raft_consensus.cc:2468] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 7.
I20260709 13:00:47.999969  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 1994) took 2471 ms. Trace:
W20260709 13:00:48.003727  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 85545.8us
I20260709 13:00:48.009999  6524 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:48.013357  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:48.014091  1725 raft_consensus.cc:3060] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:48.014178  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:48.018819  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:48.019586  1718 raft_consensus.cc:2468] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 7.
I20260709 13:00:48.020701  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:47.991684  6252 raft_consensus.cc:515] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:48.022332  1458 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 8e94ee9035214526808abfaab11799fe with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 4dbe7d47a2374afca075d3a98583b49e is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:00:48.023900  1725 raft_consensus.cc:2468] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 17.
I20260709 13:00:48.023820  6252 leader_election.cc:290] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:48.010013  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:48.021401  2325 raft_consensus.cc:2393] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 12: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:48.030409  2328 raft_consensus.cc:2468] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 7.
I20260709 13:00:48.000316  1469 catalog_manager.cc:5697] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } }
W20260709 13:00:48.042536  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.040009  1572 raft_consensus.cc:2468] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 12.
W20260709 13:00:48.048776  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.053344  1570 raft_consensus.cc:2468] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 11.
W20260709 13:00:48.054733  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 91593.8us
W20260709 13:00:47.956543  1689 connection.cc:256] RPC call timeout handler was delayed by -1.8207322320000117s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17450000000000002s for a response
W20260709 13:00:48.056775  1689 connection.cc:256] RPC call timeout handler was delayed by -1.7622322319999739s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18100000000000002s for a response
I20260709 13:00:48.066395  1615 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:48.067437  6578 raft_consensus.cc:2804] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:48.067812  6578 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.068148  6578 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:48.070941  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:48.080050  6578 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:48.082727  6578 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:48.087563  6252 consensus_queue.cc:1048] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:48.088048  1615 leader_election.cc:304] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:48.092741  6524 raft_consensus.cc:2804] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:48.093256  6288 leader_election.cc:290] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:00:48.093770  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 49523.9us
W20260709 13:00:48.057410  1689 connection.cc:256] RPC call timeout handler was delayed by -1.7478322320000075s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1826s for a response
W20260709 13:00:48.103453  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.108337  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:48.113092  1572 raft_consensus.cc:1240] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:48.102623  6524 raft_consensus.cc:493] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
W20260709 13:00:48.123023  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 210680us
I20260709 13:00:48.127403  6446 raft_consensus.cc:515] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:48.129891  6446 leader_election.cc:290] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:48.130858  2323 raft_consensus.cc:1240] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 LEADER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 9. Current term is 10. Ops: []
W20260709 13:00:48.133731  1689 connection.cc:256] RPC call timeout handler was delayed by -1.680332232000012s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19010000000000002s for a response
W20260709 13:00:48.160328  1689 connection.cc:256] RPC call timeout handler was delayed by -1.5714322320000065s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2022s for a response
W20260709 13:00:48.160778  1689 connection.cc:256] RPC call timeout handler was delayed by -1.5408322320000138s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2056s for a response
I20260709 13:00:48.134133  6565 consensus_queue.cc:1059] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 13:00:48.134989  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:48.135097  1571 raft_consensus.cc:2468] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 12.
W20260709 13:00:48.141789  1617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.148680  6524 raft_consensus.cc:3060] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:48.148871  5976 leader_election.cc:290] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:00:48.149395  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.000597  1642 rpcz_store.cc:276] 0709 13:00:45.436188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.660925 (+2224737us) service_pool.cc:224] Handling call
0709 13:00:47.661421 (+   496us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:47.661871 (+   450us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:00:47.662234 (+   363us) log.cc:844] Serialized 14 byte log entry
0709 13:00:47.902096 (+239862us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:47.902143 (+    47us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:00:47.902183 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:47.902241 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:47.904126 (+  1885us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":53289,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":2251,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":24083,"thread_start_us":232956,"threads_started":1,"wal-append.queue_time_us":329512}
I20260709 13:00:48.156948  6601 raft_consensus.cc:493] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:48.159145  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 71200.1us
I20260709 13:00:48.167312  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45148 (request call id 2526) took 2608 ms. Trace:
I20260709 13:00:48.184677  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:48.171634  1646 rpcz_store.cc:276] 0709 13:00:45.502844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.776147 (+2273303us) service_pool.cc:224] Handling call
0709 13:00:47.801764 (+ 25617us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:47.816504 (+ 14740us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:00:47.816882 (+   378us) log.cc:844] Serialized 14 byte log entry
0709 13:00:48.102859 (+285977us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:48.102922 (+    63us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:48.110744 (+  7822us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:48.110810 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:48.110927 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3679,"prepare.queue_time_us":123,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":4719,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":12669,"thread_start_us":280882,"threads_started":1}
I20260709 13:00:48.194056  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:48.196657  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:48.192471  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:48.208918  1649 raft_consensus.cc:2468] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 12.
I20260709 13:00:48.208326  1643 raft_consensus.cc:2376] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 14. Re-sending same reply.
W20260709 13:00:48.213078  1689 connection.cc:256] RPC call timeout handler was delayed by -1.4886322319999863s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2114s for a response
W20260709 13:00:48.213629  1689 connection.cc:256] RPC call timeout handler was delayed by -1.4787322319999703s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21250000000000002s for a response
W20260709 13:00:48.214022  1689 connection.cc:256] RPC call timeout handler was delayed by -1.4787322319999703s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21250000000000002s for a response
W20260709 13:00:48.214445  1689 connection.cc:256] RPC call timeout handler was delayed by -1.4670322320000082s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2138s for a response
W20260709 13:00:48.214810  1689 connection.cc:256] RPC call timeout handler was delayed by -1.4670322320000082s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2138s for a response
W20260709 13:00:48.215170  1689 connection.cc:256] RPC call timeout handler was delayed by -1.312526417000015s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21070000000000003s for a response
W20260709 13:00:48.215546  1689 connection.cc:256] RPC call timeout handler was delayed by -1.2317792610000424s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20990000000000003s for a response
W20260709 13:00:48.243227  1539 leader_election.cc:336] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Timed out: RequestConsensusVote RPC to 127.0.107.194:37391 timed out after 1.965s (SENT)
I20260709 13:00:48.175585  6601 raft_consensus.cc:515] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:48.208446  1615 leader_election.cc:304] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:48.209601  1645 raft_consensus.cc:1240] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:48.248909  1567 raft_consensus.cc:3055] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:48.191529  6343 raft_consensus.cc:493] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.251791  1539 leader_election.cc:304] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:48.249485  1567 raft_consensus.cc:740] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
W20260709 13:00:48.255668  1542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.195325  6578 raft_consensus.cc:2749] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:48.168797  6301 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:48.265153  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:48.266949  1689 leader_election.cc:304] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:48.266743  1567 consensus_queue.cc:260] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:48.267895  1567 raft_consensus.cc:3060] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:48.269107  1689 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:48.286161  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:48.287542  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:48.288396  2325 raft_consensus.cc:2393] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 7: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:48.288964  6038 raft_consensus.cc:493] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:48.289436  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:48.289561  6038 raft_consensus.cc:515] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:48.290208  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 13:00:48.290896  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 91858.9us
I20260709 13:00:48.292618  6038 leader_election.cc:290] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:48.289297  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:48.294250  2331 raft_consensus.cc:1240] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:48.295675  2330 raft_consensus.cc:1240] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:48.296810  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:48.289707  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:48.300951  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:48.305538  2332 raft_consensus.cc:1240] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 LEADER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:48.276036  6343 raft_consensus.cc:515] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:48.308650  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:48.309732  6343 leader_election.cc:290] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:48.310498  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 13:00:48.317940  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.209992  6600 raft_consensus.cc:515] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:48.314248  2324 raft_consensus.cc:2468] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 13.
W20260709 13:00:48.329578  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.336805  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:48.337018  1689 leader_election.cc:304] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 13:00:48.275460  6252 raft_consensus.cc:2764] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 13:00:48.275754  6525 raft_consensus.cc:2749] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:48.338316  6252 consensus_queue.cc:1059] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:48.339675  5970 raft_consensus.cc:3055] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:48.339979  6252 raft_consensus.cc:2804] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:48.340103  5970 raft_consensus.cc:740] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:48.341149  5970 consensus_queue.cc:260] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:48.342460  5970 raft_consensus.cc:3060] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:48.344274  6038 raft_consensus.cc:3055] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:48.344693  6038 raft_consensus.cc:740] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:48.345614  6038 consensus_queue.cc:260] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:48.346705  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:48.346908  6038 raft_consensus.cc:3060] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:48.347441  1646 raft_consensus.cc:2468] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 10.
I20260709 13:00:48.349435  1642 raft_consensus.cc:1240] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:48.312642  6446 raft_consensus.cc:2749] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:48.357909  1567 raft_consensus.cc:1275] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:00:48.340441  6252 raft_consensus.cc:493] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:48.370388  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 182251us
I20260709 13:00:48.373169  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:48.373909  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:48.374621  1571 raft_consensus.cc:1240] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 12. Current term is 13. Ops: []
W20260709 13:00:48.378217  1539 connection.cc:256] RPC call timeout handler was delayed by -1.2380407229999832s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2941s for a response
I20260709 13:00:48.329244  6383 raft_consensus.cc:515] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:48.367760  6252 raft_consensus.cc:3060] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:48.384155  1567 raft_consensus.cc:3055] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:48.387243  1567 raft_consensus.cc:740] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:48.393424  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:48.389564  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:48.395532  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:48.400321  1646 raft_consensus.cc:1275] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:00:48.394198  1650 raft_consensus.cc:2376] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 13. Re-sending same reply.
I20260709 13:00:48.403841  1642 raft_consensus.cc:2468] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 12.
I20260709 13:00:48.407404  1615 leader_election.cc:304] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:48.400851  1646 pending_rounds.cc:85] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e: Aborting all ops after (but not including) 5
I20260709 13:00:48.411862  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:48.415692  1648 raft_consensus.cc:1240] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:48.417402  1649 raft_consensus.cc:2468] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 11.
I20260709 13:00:48.419066  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:48.409343  1646 pending_rounds.cc:107] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:00:48.396837  6288 raft_consensus.cc:2749] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:48.421824  1649 raft_consensus.cc:2393] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 11: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:48.413688  1539 leader_election.cc:304] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:48.420153  1646 raft_consensus.cc:2889] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:48.427224  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:48.431983  1567 consensus_queue.cc:260] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:48.427130  1615 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:48.435078  6593 consensus_queue.cc:1048] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:00:48.435276  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:48.436677  6383 leader_election.cc:290] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 15 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:48.436975  1645 raft_consensus.cc:2393] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 12: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:48.448670  6573 raft_consensus.cc:2804] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:48.449201  6573 raft_consensus.cc:493] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.449574  6573 raft_consensus.cc:3060] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:48.423316  6525 raft_consensus.cc:2804] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:48.459157  6593 consensus_queue.cc:1059] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:00:48.504863  6589 raft_consensus.cc:3055] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:48.505337  6589 raft_consensus.cc:740] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:48.506623  6589 consensus_queue.cc:260] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:48.508793  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:48.463035  6383 raft_consensus.cc:2749] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:48.464715  6600 leader_election.cc:290] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:48.465005  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:48.509744  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:48.466697  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:48.468879  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:48.469492  6301 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:48.522518  1650 raft_consensus.cc:2376] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 15. Re-sending same reply.
I20260709 13:00:48.522898  1651 raft_consensus.cc:3060] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:48.523600  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:48.524247  1650 raft_consensus.cc:2468] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 10.
I20260709 13:00:48.522518  1646 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 9.
I20260709 13:00:48.525120  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:48.525520  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:48.525703  1650 raft_consensus.cc:3060] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:48.471722  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:48.526404  2332 raft_consensus.cc:2468] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 13.
I20260709 13:00:48.526628  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:48.472492  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
W20260709 13:00:48.527350  2295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.473692  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:48.474092  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:48.474844  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:48.475704  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 13:00:48.480306  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.485957  6524 raft_consensus.cc:515] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:48.487136  1567 raft_consensus.cc:3060] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:48.494306  1691 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.496635  1648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45148 (request call id 2535) took 2936 ms. Trace:
I20260709 13:00:48.496901  6601 leader_election.cc:290] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:48.498827  1571 raft_consensus.cc:1275] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 10. (term mismatch)
W20260709 13:00:48.499676  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 78914.6us
I20260709 13:00:48.461037  6525 raft_consensus.cc:493] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.475664  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:48.509949  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:48.465821  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:48.471330  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:48.533106  1648 rpcz_store.cc:276] 0709 13:00:45.560637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.814853 (+2254216us) service_pool.cc:224] Handling call
0709 13:00:47.854209 (+ 39356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:48.416090 (+561881us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:48.496295 (+ 80205us) spinlock_profiling.cc:243] Waited 561 ms on lock 0x7b540030e154. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:48.496563 (+   268us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1290828032}
I20260709 13:00:48.473367  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:48.530736  6267 consensus_queue.cc:1059] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:00:48.538056  1615 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:48.538991  2329 raft_consensus.cc:2393] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 7: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:48.533309  1571 pending_rounds.cc:85] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting all ops after (but not including) 9
I20260709 13:00:48.539633  1571 pending_rounds.cc:107] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting uncommitted NO_OP operation due to leader change: 8.10
I20260709 13:00:48.539955  1571 raft_consensus.cc:2889] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:48.564010  1617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.568324  1718 raft_consensus.cc:1275] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:00:48.571571  1642 raft_consensus.cc:2468] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 10.
I20260709 13:00:48.529806  6589 raft_consensus.cc:3060] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:48.585410  1540 leader_election.cc:304] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:48.587638  6524 leader_election.cc:290] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:48.586970  6343 raft_consensus.cc:2749] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:48.590659  2327 raft_consensus.cc:2410] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:00:48.591816  6252 raft_consensus.cc:515] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:48.597687  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:48.597841  6383 consensus_queue.cc:1059] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:00:48.598766  6301 raft_consensus.cc:3055] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:48.537614  6525 raft_consensus.cc:3060] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:48.601562  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:48.608817  1650 raft_consensus.cc:2468] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 10.
I20260709 13:00:48.609457  1651 raft_consensus.cc:2468] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 12.
I20260709 13:00:48.605463  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:00:48.612098  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.621654  1644 raft_consensus.cc:2468] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 12.
I20260709 13:00:48.529317  6446 consensus_queue.cc:1059] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.082s
I20260709 13:00:48.622313  6275 consensus_queue.cc:1048] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:00:48.624596  6573 raft_consensus.cc:515] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:48.601167  6600 raft_consensus.cc:2804] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:48.629729  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:48.627624  1647 raft_consensus.cc:2376] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 7. Re-sending same reply.
I20260709 13:00:48.610811  6301 raft_consensus.cc:740] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:48.644124  1571 raft_consensus.cc:2468] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 11.
I20260709 13:00:48.629827  6600 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:48.665185  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 328249us
I20260709 13:00:48.665649  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:48.669585  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:48.656250  6600 raft_consensus.cc:3060] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:00:48.707031  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 379401us
I20260709 13:00:48.709635  1567 raft_consensus.cc:1275] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:00:48.712368  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:48.716810  6038 consensus_queue.cc:1048] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:48.720399  1571 raft_consensus.cc:2468] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 9.
I20260709 13:00:48.711247  1567 pending_rounds.cc:85] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting all ops after (but not including) 8
I20260709 13:00:48.803186  1567 pending_rounds.cc:107] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:00:48.803701  1567 raft_consensus.cc:2889] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:48.784878  6301 consensus_queue.cc:260] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:48.804435  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:48.804889  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:48.758580  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:48.805850  1572 raft_consensus.cc:2410] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 13:00:48.805958  1574 raft_consensus.cc:2393] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 13: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:48.805094  1651 raft_consensus.cc:3060] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:48.745553  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:48.774827  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 13:00:48.725278  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.730435  1689 leader_election.cc:304] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
W20260709 13:00:48.809911  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.807356  1571 raft_consensus.cc:2376] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 12. Re-sending same reply.
I20260709 13:00:48.808382  1575 raft_consensus.cc:2376] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 11. Re-sending same reply.
W20260709 13:00:48.838927  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 118525us
I20260709 13:00:48.717703  6524 raft_consensus.cc:493] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:48.759101  6573 leader_election.cc:290] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:48.732894  6252 leader_election.cc:290] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:48.865532  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 147624us
W20260709 13:00:48.869295  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.805109  6301 raft_consensus.cc:3060] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:48.880123  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 132445us
I20260709 13:00:48.889429  6524 raft_consensus.cc:515] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:48.893743  2294 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:48.899909  1688 leader_election.cc:304] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
W20260709 13:00:48.903836  2295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.904641  1572 raft_consensus.cc:1275] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
W20260709 13:00:48.917551  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.905162  1572 pending_rounds.cc:85] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting all ops after (but not including) 7
I20260709 13:00:48.924374  1572 pending_rounds.cc:107] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:00:48.924765  1572 raft_consensus.cc:2889] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:48.928100  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:48.908867  1688 leader_election.cc:304] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 13:00:48.900913  6383 raft_consensus.cc:493] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:48.933341  6626 log.cc:927] Time spent T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 13:00:48.947034  1651 raft_consensus.cc:2468] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 11.
I20260709 13:00:48.931902  6038 raft_consensus.cc:2804] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:48.907675  6252 consensus_queue.cc:1059] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
W20260709 13:00:48.961416  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 72118.3us
W20260709 13:00:48.962945  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 65715us
I20260709 13:00:48.951586  6038 raft_consensus.cc:493] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:48.969713  6038 raft_consensus.cc:3060] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:48.970013  6637 log.cc:927] Time spent T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:00:48.967084  6631 consensus_queue.cc:1048] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.080s
I20260709 13:00:48.967696  1573 raft_consensus.cc:1275] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:00:48.974795  6600 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:48.968088  6629 log.cc:927] Time spent T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.206s	user 0.000s	sys 0.001s
W20260709 13:00:48.968739  6634 log.cc:927] Time spent T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 13:00:48.969018  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:00:48.978808  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:48.983243  1570 raft_consensus.cc:2468] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 10.
I20260709 13:00:48.939450  6383 raft_consensus.cc:515] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:48.960983  6593 raft_consensus.cc:2749] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:00:48.957993  6633 raft_consensus.cc:2804] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:00:48.978468  6628 log.cc:927] Time spent T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.228s	user 0.000s	sys 0.001s
I20260709 13:00:48.991808  2297 leader_election.cc:304] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:48.989480  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 1256) took 1041 ms. Trace:
I20260709 13:00:49.001408  6524 leader_election.cc:290] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:49.010036  6383 leader_election.cc:290] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:48.977766  6288 raft_consensus.cc:2804] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:49.010743  6288 raft_consensus.cc:493] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:49.011155  6288 raft_consensus.cc:3060] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:48.996376  1568 rpcz_store.cc:276] 0709 13:00:47.948074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.948581 (+   507us) service_pool.cc:224] Handling call
0709 13:00:47.958689 (+ 10108us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:47.982022 (+ 23333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:47.982053 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:48.027891 (+ 45838us) spinlock_profiling.cc:243] Waited 1.43 ms on lock 0x7b2c00027f88. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f0cb4a11 00007fa9f0cc4372 00007fa9f23f6a01 00007fa9f23bb43a 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2
0709 13:00:48.036815 (+  8924us) log.cc:844] Serialized 26 byte log entry
0709 13:00:48.393211 (+356396us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:48.393267 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:48.393355 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:48.984842 (+591487us) raft_consensus.cc:1685] finished
0709 13:00:48.984869 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:48.989390 (+  4521us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28585,"raft.queue_time_us":30372,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":5037,"spinlock_wait_cycles":3284224,"thread_start_us":281307,"threads_started":1,"wal-append.queue_time_us":610885}
W20260709 13:00:49.033721  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.035607  1573 raft_consensus.cc:1275] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:00:49.043002  6600 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:49.044884  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 1253) took 1188 ms. Trace:
I20260709 13:00:49.045296  1569 rpcz_store.cc:276] 0709 13:00:47.856773 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.900641 (+ 43868us) service_pool.cc:224] Handling call
0709 13:00:47.926365 (+ 25724us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:47.951671 (+ 25306us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:47.951706 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:48.037545 (+ 85839us) log.cc:844] Serialized 26 byte log entry
0709 13:00:48.398934 (+361389us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:48.398989 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:48.399082 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:49.044653 (+645571us) raft_consensus.cc:1685] finished
0709 13:00:49.044675 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:49.044817 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18444,"raft.queue_time_us":3972,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":9995,"thread_start_us":304465,"threads_started":1,"wal-append.queue_time_us":628324}
I20260709 13:00:48.995846  6633 raft_consensus.cc:493] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:49.048868  6633 raft_consensus.cc:3060] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:49.067692  6038 raft_consensus.cc:515] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:49.068904  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 180206us
I20260709 13:00:49.068965  6391 raft_consensus.cc:2804] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:00:49.072549  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 84871.5us
W20260709 13:00:49.086706  1542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.098457  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:49.103320  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:49.103653  1568 raft_consensus.cc:2393] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 12: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:49.103343  2297 leader_election.cc:304] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 13:00:49.081007  6391 raft_consensus.cc:493] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
W20260709 13:00:49.111375  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 202584us
I20260709 13:00:49.107897  2294 leader_election.cc:304] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:49.113708  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:49.118222  1575 raft_consensus.cc:2376] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 7. Re-sending same reply.
W20260709 13:00:49.118273  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 122644us
I20260709 13:00:49.119338  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:49.117467  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:49.122042  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:49.123047  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:49.104288  6578 raft_consensus.cc:3055] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:49.117887  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:49.124938  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:49.125736  1571 raft_consensus.cc:2468] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 9.
I20260709 13:00:49.127869  1575 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:49.130793  6573 consensus_queue.cc:1059] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:49.132041  6645 consensus_queue.cc:1059] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:00:49.112098  6267 raft_consensus.cc:3055] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:49.141196  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:49.138346  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:49.145354  1570 raft_consensus.cc:3060] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:49.110899  6391 raft_consensus.cc:3060] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:49.156955  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:49.158370  1688 leader_election.cc:304] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:49.166832  1573 raft_consensus.cc:2368] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 12. Current term is 13.
I20260709 13:00:49.126843  6578 raft_consensus.cc:740] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
W20260709 13:00:49.172597  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 58534.6us
W20260709 13:00:49.184067  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 52855.9us
W20260709 13:00:49.219664  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.221369  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:49.144862  6267 raft_consensus.cc:740] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:49.152287  6654 raft_consensus.cc:2804] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:49.227519  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:49.224162  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:00:49.228494  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 61300.8us
W20260709 13:00:49.224963  1615 connection.cc:256] RPC call timeout handler was delayed by -1.0068761770000378s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.26070000000000004s for a response
I20260709 13:00:49.229250  1574 raft_consensus.cc:2410] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 15 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:00:49.142030  6288 raft_consensus.cc:515] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:49.231223  1573 raft_consensus.cc:3060] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:49.233502  6573 raft_consensus.cc:3055] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:49.225972  6652 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.166497  6079 consensus_queue.cc:1048] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 13:00:49.245276  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:49.248822  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:49.246640  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:49.245692  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:49.247646  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:49.263549  1651 raft_consensus.cc:2468] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 12.
I20260709 13:00:49.247290  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:49.245999  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:49.264465  1649 raft_consensus.cc:2410] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
I20260709 13:00:49.246269  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:49.248000  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:49.265295  1646 raft_consensus.cc:2468] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 13.
I20260709 13:00:49.262998  1645 raft_consensus.cc:2368] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 13. Current term is 14.
I20260709 13:00:49.264897  1644 raft_consensus.cc:2393] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 12: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:49.265846  1650 raft_consensus.cc:2393] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 16: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:49.269063  1570 raft_consensus.cc:2468] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 10.
I20260709 13:00:49.237125  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 15 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:49.246902  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:49.272408  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:49.273363  1651 raft_consensus.cc:2368] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 13. Current term is 14.
I20260709 13:00:49.273736  1571 raft_consensus.cc:2468] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 13.
W20260709 13:00:49.233901  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 84593.9us
I20260709 13:00:49.280274  1688 leader_election.cc:304] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:49.280920  6655 raft_consensus.cc:3055] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:49.282341  6655 raft_consensus.cc:740] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:49.282505  1717 raft_consensus.cc:1240] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:49.258160  6641 consensus_queue.cc:1048] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 13:00:49.283421  6655 consensus_queue.cc:260] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:49.250170  6647 log.cc:927] Time spent T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
W20260709 13:00:49.245191  6589 consensus_meta.cc:287] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.636s	user 0.014s	sys 0.000s
I20260709 13:00:49.250341  6575 raft_consensus.cc:2804] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:00:49.295735  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:49.287756  1573 raft_consensus.cc:2468] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 15.
I20260709 13:00:49.297569  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:49.298238  1717 raft_consensus.cc:2468] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8.
I20260709 13:00:49.235498  6573 raft_consensus.cc:740] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:49.299589  6633 raft_consensus.cc:515] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:49.299671  6573 consensus_queue.cc:260] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:49.303814  6288 leader_election.cc:290] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:49.307160  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:49.307850  1725 raft_consensus.cc:2468] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 10.
I20260709 13:00:49.310446  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:49.288416  6655 raft_consensus.cc:3060] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:49.322032  6646 raft_consensus.cc:3055] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:00:49.322739  6646 raft_consensus.cc:740] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:49.327831  6668 raft_consensus.cc:2804] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:49.231562  6252 consensus_queue.cc:1059] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 13:00:49.330062  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:00:49.336226  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 106137us
I20260709 13:00:49.337877  2294 leader_election.cc:304] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:00:49.333895  1617 leader_election.cc:336] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.534s (SENT)
I20260709 13:00:49.348591  1575 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 14.
I20260709 13:00:49.328879  6391 raft_consensus.cc:515] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:49.357091  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:49.328622  6668 raft_consensus.cc:493] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.294221  6038 leader_election.cc:290] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:49.358062  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:49.366134  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:00:49.366977  6657 log.cc:927] Time spent T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 13:00:49.371024  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:49.344830  6288 raft_consensus.cc:493] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
W20260709 13:00:49.369354  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 225180us
I20260709 13:00:49.367897  6578 consensus_queue.cc:260] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:49.379392  6578 raft_consensus.cc:3060] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:49.388832  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:49.390053  1643 raft_consensus.cc:2410] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 11 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:00:49.393666  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:49.361346  6668 raft_consensus.cc:3060] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:49.395080  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:49.395143  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:49.273716  6652 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:49.396903  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:49.388480  6575 raft_consensus.cc:697] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:49.399309  6575 consensus_queue.cc:237] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:49.374215  6252 raft_consensus.cc:3055] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:49.405313  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:00:49.405499  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 125289us
I20260709 13:00:49.394485  6589 raft_consensus.cc:2749] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:49.402556  1718 raft_consensus.cc:1240] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:00:49.406306  1688 leader_election.cc:304] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:49.409266  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 13:00:49.411880  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 193977us
I20260709 13:00:49.392699  6654 raft_consensus.cc:697] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:49.413904  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:49.414650  6654 consensus_queue.cc:237] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:49.415346  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:49.393713  6391 leader_election.cc:290] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:49.417025  6658 raft_consensus.cc:2804] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:49.419297  2324 raft_consensus.cc:1240] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:49.421069  2326 raft_consensus.cc:1240] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:49.420928  6646 consensus_queue.cc:260] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:49.422786  6634 log.cc:927] Time spent T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.390s	user 0.003s	sys 0.002s
I20260709 13:00:49.423846  1576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 1258) took 1430 ms. Trace:
I20260709 13:00:49.424232  1576 rpcz_store.cc:276] 0709 13:00:47.993197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:47.993372 (+   175us) service_pool.cc:224] Handling call
0709 13:00:48.056894 (+ 63522us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:48.163618 (+106724us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:48.163648 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:48.201773 (+ 38125us) log.cc:844] Serialized 26 byte log entry
0709 13:00:48.666745 (+464972us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:48.675066 (+  8321us) log.cc:844] Serialized 14 byte log entry
0709 13:00:48.675343 (+   277us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:48.675418 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:49.422525 (+747107us) spinlock_profiling.cc:243] Waited 18.9 ms on lock 0x7b2400120878. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef1549c4 00007fa9ef152acb 00007fa9ef30ddc9 00007fa9ef30da55 00007fa9ef30d09d 00007fa9f1f3f10e 00007fa9f1f5688c 00007fa9f1f55bb6 00007fa9f1f557d8 00007fa9f1f5f221
0709 13:00:49.423571 (+  1046us) raft_consensus.cc:1685] finished
0709 13:00:49.423669 (+    98us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:49.423789 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1577,"prepare.queue_time_us":8059,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":46044,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":8862,"spinlock_wait_cycles":43553152,"thread_start_us":395863,"threads_started":1,"wal-append.queue_time_us":578464}
I20260709 13:00:49.425824  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:49.427198  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:49.430369  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:49.430534  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:49.430714  1615 leader_election.cc:304] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:49.431231  1643 raft_consensus.cc:3060] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:49.431775  1615 leader_election.cc:304] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:49.432952  1645 raft_consensus.cc:1240] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:49.434440  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:49.435215  1649 raft_consensus.cc:1240] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:49.435432  1720 raft_consensus.cc:1275] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:00:49.436393  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:49.436861  6656 raft_consensus.cc:2749] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:49.436297  6660 raft_consensus.cc:2804] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:49.437561  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:49.437820  6660 raft_consensus.cc:493] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.438179  6660 raft_consensus.cc:3060] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:49.438340  1650 raft_consensus.cc:1240] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:49.439549  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:49.390960  6288 raft_consensus.cc:515] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:49.440757  6633 leader_election.cc:290] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:49.441042  1644 raft_consensus.cc:1240] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 13. Current term is 14. Ops: []
W20260709 13:00:49.441588  6525 consensus_meta.cc:287] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.807s	user 0.003s	sys 0.011s
I20260709 13:00:49.444001  6288 leader_election.cc:290] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:49.444375  6525 raft_consensus.cc:515] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:49.445792  1648 raft_consensus.cc:2368] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 12. Current term is 13.
I20260709 13:00:49.441723  1651 raft_consensus.cc:1275] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:00:49.445613  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:49.435209  1724 raft_consensus.cc:2368] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 12. Current term is 13.
I20260709 13:00:49.432898  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:49.411068  6252 raft_consensus.cc:740] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:49.450325  2329 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 13.
I20260709 13:00:49.438179  1720 raft_consensus.cc:2468] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 11.
I20260709 13:00:49.453770  1718 raft_consensus.cc:1240] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:49.451673  1646 raft_consensus.cc:2393] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 13: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:49.455006  1651 raft_consensus.cc:1240] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:49.452050  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:49.458112  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:49.459134  1643 raft_consensus.cc:2468] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 12.
I20260709 13:00:49.459368  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:49.461163  1649 raft_consensus.cc:1275] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:00:49.462218  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:49.463423  1647 raft_consensus.cc:2393] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 10: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:49.464815  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:49.468724  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:49.469094  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:49.462885  2325 raft_consensus.cc:2376] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 7. Re-sending same reply.
W20260709 13:00:49.470036  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.469549  1615 leader_election.cc:304] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:49.472402  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:49.473598  2330 raft_consensus.cc:1275] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:00:49.473789  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:49.475220  2331 raft_consensus.cc:1240] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:49.476177  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:49.477010  2323 raft_consensus.cc:2393] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 13: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:49.477808  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:49.452739  6658 raft_consensus.cc:697] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 13 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:49.478458  2328 raft_consensus.cc:3060] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:49.478690  6573 raft_consensus.cc:3060] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:49.479007  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:49.479161  6658 consensus_queue.cc:237] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:49.480703  1721 raft_consensus.cc:2468] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 9.
I20260709 13:00:49.482483  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 13:00:49.484037  6664 log.cc:927] Time spent T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:00:49.484815  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:49.484979  1717 raft_consensus.cc:1240] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:49.413239  6652 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:49.492666  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:49.495460  1720 raft_consensus.cc:3060] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:49.499042  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
W20260709 13:00:49.501706  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 95467.8us
I20260709 13:00:49.503006   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:00:49.503060  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.469760  6288 raft_consensus.cc:2749] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:49.502503  1688 leader_election.cc:304] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:49.507092  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:49.501040  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:49.509097  2323 raft_consensus.cc:2393] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 13: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 13:00:49.512504  2328 raft_consensus.cc:2468] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 11.
I20260709 13:00:49.513517  1615 leader_election.cc:304] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
W20260709 13:00:49.515789  1540 leader_election.cc:336] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423): Timed out: RequestConsensusVote RPC to 127.0.107.196:34423 timed out after 1.564s (SENT)
W20260709 13:00:49.516453  1540 leader_election.cc:336] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423): Timed out: RequestConsensusVote RPC to 127.0.107.196:34423 timed out after 1.617s (SENT)
I20260709 13:00:49.478703  6525 leader_election.cc:290] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:49.494908  6656 raft_consensus.cc:2804] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:49.524309  1540 leader_election.cc:304] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:49.525715  6651 consensus_queue.cc:1059] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:00:49.526275  6663 log.cc:927] Time spent T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 13:00:49.532709  6641 consensus_queue.cc:1048] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 13:00:49.537088  6651 raft_consensus.cc:3055] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:49.537508  6651 raft_consensus.cc:740] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:49.538599  1689 leader_election.cc:304] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 13:00:49.538410  6651 consensus_queue.cc:260] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:49.539752  6651 raft_consensus.cc:3060] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:49.541601  6633 consensus_queue.cc:1048] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:00:49.548082  1615 leader_election.cc:304] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:49.556031  1689 leader_election.cc:304] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:49.556949  6671 raft_consensus.cc:3060] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:49.557065  1689 leader_election.cc:304] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 13:00:49.471588  6252 consensus_queue.cc:260] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:49.561071  1688 leader_election.cc:304] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:49.473636  6267 consensus_queue.cc:260] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:49.548308  6525 raft_consensus.cc:2804] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:49.575053  6660 raft_consensus.cc:515] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:49.576673  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 52408.4us
I20260709 13:00:49.560817  6038 consensus_queue.cc:1048] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 13:00:49.549876  6656 raft_consensus.cc:697] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 11 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:49.552412  6665 raft_consensus.cc:2749] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:49.588608  2297 leader_election.cc:304] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:49.571127  1689 leader_election.cc:304] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:49.552654  6446 raft_consensus.cc:493] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.533656  6631 consensus_queue.cc:1048] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:00:49.561301  6652 raft_consensus.cc:3060] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:49.598272  6525 raft_consensus.cc:697] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 12 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:49.593981  1642 raft_consensus.cc:2393] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 10: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:49.601341  1615 leader_election.cc:304] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:49.586544  6267 raft_consensus.cc:3060] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:00:49.604351  6661 log.cc:927] Time spent T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.162s	user 0.003s	sys 0.000s
I20260709 13:00:49.562755  6669 consensus_queue.cc:1048] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:00:49.593149  6252 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:49.604938  6672 consensus_queue.cc:1059] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.079s
I20260709 13:00:49.605551  2294 leader_election.cc:304] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
W20260709 13:00:49.627013  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:49.628548  1617 leader_election.cc:336] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.693s (SENT)
I20260709 13:00:49.594312  5970 raft_consensus.cc:2749] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:00:49.643013  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 51476.5us
I20260709 13:00:49.561154  6079 consensus_queue.cc:1059] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.038s
W20260709 13:00:49.656414  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.604950  6038 raft_consensus.cc:2804] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:00:49.659222  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 53765.4us
W20260709 13:00:49.654496  6675 log.cc:927] Time spent T 00000000000000000000000000000000 P fcfaa17e55ae48e194c5d95ca24a659f: Append to log took a long time: real 0.251s	user 0.002s	sys 0.000s
I20260709 13:00:49.671705  1615 leader_election.cc:400] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Vote denied by peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423) with higher term. Message: Invalid argument: T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 9. Current term is 10.
I20260709 13:00:49.672061  1615 leader_election.cc:403] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:00:49.654457  6578 raft_consensus.cc:2764] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:00:49.601392  6446 raft_consensus.cc:515] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:49.681878  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 74114.5us
I20260709 13:00:49.647773  6665 consensus_queue.cc:1059] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:00:49.691825  1720 raft_consensus.cc:2468] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 12.
I20260709 13:00:49.662958  6038 raft_consensus.cc:697] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 15 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:49.662177  6631 raft_consensus.cc:3060] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:49.669867  6655 raft_consensus.cc:2804] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:00:49.679800  6646 raft_consensus.cc:3060] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:49.722121  6678 raft_consensus.cc:2764] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:00:49.721310  6038 consensus_queue.cc:237] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:49.655969  6525 consensus_queue.cc:237] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:49.721688  6670 raft_consensus.cc:3055] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:49.721169  6684 raft_consensus.cc:2804] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:49.712285  6383 raft_consensus.cc:2749] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423) with higher term. Message: Invalid argument: T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 9. Current term is 10.
I20260709 13:00:49.761273  6684 raft_consensus.cc:493] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:49.733168  6686 raft_consensus.cc:2804] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:49.761917  6684 raft_consensus.cc:3060] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:49.762173  6686 raft_consensus.cc:493] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:49.762636  6686 raft_consensus.cc:3060] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:49.741199  6676 raft_consensus.cc:493] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.702827  1642 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc"
dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
mode: GRACEFUL
new_leader_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:35470
I20260709 13:00:49.765101  1642 raft_consensus.cc:606] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Received request to transfer leadership to TS 0c7751452c4b46afa95251b9df7169d4
W20260709 13:00:49.745496  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 84272us
I20260709 13:00:49.765530  1642 raft_consensus.cc:614] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:49.749264  6660 leader_election.cc:290] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:49.758157  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.761183  6446 leader_election.cc:290] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:49.764807  6676 raft_consensus.cc:515] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:49.736418  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 181155us
I20260709 13:00:49.732942  6631 raft_consensus.cc:2749] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:49.754408  6671 raft_consensus.cc:2749] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:49.796368  1688 leader_election.cc:304] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:49.755254  6670 raft_consensus.cc:740] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
W20260709 13:00:49.817999  1539 leader_election.cc:336] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Timed out: RequestConsensusVote RPC to 127.0.107.194:37391 timed out after 1.521s (SENT)
I20260709 13:00:49.822109  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:49.824837  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:49.825438  1573 raft_consensus.cc:2468] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 10.
I20260709 13:00:49.834474  1688 leader_election.cc:304] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:49.836495  6301 raft_consensus.cc:3055] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:49.836999  6301 raft_consensus.cc:740] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:49.837538  6671 consensus_queue.cc:1059] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:49.838414  6671 raft_consensus.cc:2749] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:49.837986  6301 consensus_queue.cc:260] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:49.839104  6671 raft_consensus.cc:3055] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:00:49.839547  6301 raft_consensus.cc:3060] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:49.840830  1617 leader_election.cc:336] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.698s (SENT)
I20260709 13:00:49.841365  6676 leader_election.cc:290] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:49.843770  6275 raft_consensus.cc:3055] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:00:49.844166  6275 raft_consensus.cc:740] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:49.839596  6671 raft_consensus.cc:740] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:49.845013  6275 consensus_queue.cc:260] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:49.846469  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:49.836215  1688 leader_election.cc:304] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:49.852468  6671 consensus_queue.cc:260] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:49.853895  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:49.854557  1719 raft_consensus.cc:2468] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 11.
I20260709 13:00:49.856112  6573 raft_consensus.cc:493] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.856688  6573 raft_consensus.cc:515] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:49.858901  1539 leader_election.cc:336] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Timed out: RequestConsensusVote RPC to 127.0.107.194:37391 timed out after 1.564s (SENT)
W20260709 13:00:49.859062  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 391171us
I20260709 13:00:49.859398  1539 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:49.860467  2325 raft_consensus.cc:1240] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 LEADER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:00:49.859934  2297 leader_election.cc:304] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
W20260709 13:00:49.862859  1617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.863050  1688 leader_election.cc:304] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:49.863898  1688 leader_election.cc:304] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:49.869369  1539 leader_election.cc:304] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:49.870148  6446 raft_consensus.cc:493] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:49.870294  1539 leader_election.cc:304] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 13:00:49.870718  6446 raft_consensus.cc:515] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:49.871508  1539 leader_election.cc:400] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391) with higher term. Message: Invalid argument: T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 13. Current term is 14.
I20260709 13:00:49.871572  6646 raft_consensus.cc:2804] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:49.872133  6646 raft_consensus.cc:493] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.872699  6645 raft_consensus.cc:2804] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:49.872481  6646 raft_consensus.cc:3060] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:49.873010  6446 leader_election.cc:290] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:49.873706  6275 raft_consensus.cc:3060] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:49.875627  6655 raft_consensus.cc:493] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:49.876075  6655 raft_consensus.cc:3060] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:49.878960  6686 raft_consensus.cc:515] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:49.881248  6686 leader_election.cc:290] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:49.848289  6652 raft_consensus.cc:2749] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:49.884066  1570 raft_consensus.cc:1240] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:49.884348  1539 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:49.702023  6656 consensus_queue.cc:237] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:49.819556  6288 raft_consensus.cc:2804] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:49.871318  6573 leader_election.cc:290] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:49.887037  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:49.887451  6633 raft_consensus.cc:2804] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:49.887666  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 13:00:49.889122  1691 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.891291  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 13:00:49.892777  1542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:49.896109  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:49.861474  6267 raft_consensus.cc:2749] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:49.883934  6645 raft_consensus.cc:493] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.902535  6645 raft_consensus.cc:3060] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:49.897888  6660 raft_consensus.cc:493] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:49.903825  6660 raft_consensus.cc:515] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:49.904831  6391 raft_consensus.cc:2804] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:49.905323  6391 raft_consensus.cc:493] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.905730  6391 raft_consensus.cc:3060] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:49.911424  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:49.912259  1571 raft_consensus.cc:2468] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 13.
I20260709 13:00:49.914218  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:49.906412  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:49.907114  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:49.919118  1648 raft_consensus.cc:1275] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:00:49.920958  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:49.922060  1573 raft_consensus.cc:3060] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:49.919720  2323 raft_consensus.cc:2410] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 13:00:49.890514  6288 raft_consensus.cc:493] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:49.925462  1539 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:49.891935  6446 raft_consensus.cc:3060] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:49.946199  1615 leader_election.cc:304] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:49.921772  6686 raft_consensus.cc:2804] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:49.939908  6288 raft_consensus.cc:3060] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:49.918732  6695 raft_consensus.cc:2804] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:49.961972  1539 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:49.941556  6301 raft_consensus.cc:2749] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:49.945317  6601 raft_consensus.cc:493] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.969492  6693 raft_consensus.cc:493] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:49.969787  6578 raft_consensus.cc:2804] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:50.008502  1573 raft_consensus.cc:2468] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 13.
W20260709 13:00:50.010305  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 103148us
I20260709 13:00:50.012374  1688 leader_election.cc:304] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
W20260709 13:00:50.014853  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 70709.1us
I20260709 13:00:49.964044  6695 raft_consensus.cc:493] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:49.973887  6267 raft_consensus.cc:2749] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:49.972999  6644 raft_consensus.cc:493] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:50.022859  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 87620us
I20260709 13:00:49.973804  6660 leader_election.cc:290] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:49.995749  6383 raft_consensus.cc:493] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.000005  6578 raft_consensus.cc:493] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
W20260709 13:00:50.033182  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 462108us
W20260709 13:00:50.041356  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 79489.9us
I20260709 13:00:50.042156  1539 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:50.022056  6695 raft_consensus.cc:3060] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:50.014588  6631 consensus_queue.cc:1048] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:00:50.053936  1615 leader_election.cc:304] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:50.054280  6701 raft_consensus.cc:2804] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:50.054836  6660 raft_consensus.cc:2804] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:50.055459  6660 raft_consensus.cc:493] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:50.055848  6660 raft_consensus.cc:3060] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:49.943157  6670 consensus_queue.cc:260] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:50.054900  6701 raft_consensus.cc:697] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 11 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:50.010403  6693 raft_consensus.cc:515] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:49.999424  6601 raft_consensus.cc:515] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:50.039417  6578 raft_consensus.cc:3060] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:50.056353  1615 leader_election.cc:304] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:50.038143  6301 raft_consensus.cc:493] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:50.072661  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.077673  1539 leader_election.cc:304] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 13:00:50.079293  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 83179.9us
W20260709 13:00:50.082429  1542 leader_election.cc:336] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.899s (SENT)
I20260709 13:00:50.050088  6573 raft_consensus.cc:2749] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:50.082984  1542 leader_election.cc:304] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
W20260709 13:00:50.089704  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.036340  6644 raft_consensus.cc:515] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:50.043675  6383 raft_consensus.cc:515] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:50.106163  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.113400  1719 raft_consensus.cc:1275] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:00:50.113787  1719 pending_rounds.cc:85] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4: Aborting all ops after (but not including) 8
I20260709 13:00:50.113978  1719 pending_rounds.cc:107] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:00:50.114193  1719 raft_consensus.cc:2889] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:50.068009  6267 consensus_queue.cc:1059] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:00:50.122205  2323 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386"
dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
mode: GRACEFUL
new_leader_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:39778
I20260709 13:00:50.124821  2323 raft_consensus.cc:606] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 LEADER]: Received request to transfer leadership to TS 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:50.098660  6665 raft_consensus.cc:2804] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:50.096650  6343 raft_consensus.cc:2749] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:50.079465  6301 raft_consensus.cc:515] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:50.103287  6704 consensus_queue.cc:1048] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.044s
W20260709 13:00:50.135485  6698 log.cc:927] Time spent T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:00:50.154239  6383 leader_election.cc:290] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:50.155145  6383 raft_consensus.cc:2804] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:50.155534  6710 raft_consensus.cc:493] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.155800  6383 raft_consensus.cc:697] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 12 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:50.156101  6710 raft_consensus.cc:515] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:50.158766  6710 leader_election.cc:290] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:50.160811  6666 raft_consensus.cc:493] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.161471  6666 raft_consensus.cc:515] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:50.163641  6252 consensus_meta.cc:287] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.512s	user 0.006s	sys 0.002s
I20260709 13:00:50.183697  6693 leader_election.cc:290] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:50.184787  6693 raft_consensus.cc:493] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.185273  6693 raft_consensus.cc:515] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:50.187515  2324 raft_consensus.cc:2468] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 10.
I20260709 13:00:50.126322  6633 raft_consensus.cc:697] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 12 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
W20260709 13:00:50.234519  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:50.237653  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 201282us
I20260709 13:00:50.238606  6383 consensus_queue.cc:237] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:50.239516  6301 leader_election.cc:290] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:50.240849  6694 raft_consensus.cc:493] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.241372  6694 raft_consensus.cc:515] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:50.243431  6694 leader_election.cc:290] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:50.247246  6288 raft_consensus.cc:515] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:50.249454  6601 leader_election.cc:290] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:00:50.252740  1617 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.606s (SENT) [suppressed 99 similar messages]
I20260709 13:00:50.253844  6644 leader_election.cc:290] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:50.258884  6684 raft_consensus.cc:515] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:50.260252  6668 consensus_meta.cc:287] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.809s	user 0.009s	sys 0.002s
I20260709 13:00:50.262938  6666 leader_election.cc:290] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:50.278913  2327 raft_consensus.cc:2410] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 13:00:50.213217  6343 raft_consensus.cc:493] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.302284  1689 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:50.188264  6693 leader_election.cc:290] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:50.179768  6655 raft_consensus.cc:515] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:50.280969  6671 raft_consensus.cc:3060] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:50.281620  6446 raft_consensus.cc:2749] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:50.335482  1689 leader_election.cc:304] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:50.335807  1642 raft_consensus.cc:3055] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:00:50.336227  1719 raft_consensus.cc:1240] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:50.336278  1642 raft_consensus.cc:740] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:50.336612  1689 leader_election.cc:304] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:50.282721  6573 raft_consensus.cc:3055] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:50.279371  6670 raft_consensus.cc:3060] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:50.382827  1723 raft_consensus.cc:1240] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:50.338121  1722 raft_consensus.cc:1240] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:50.383347  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:50.383991  1573 raft_consensus.cc:2468] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 14.
W20260709 13:00:50.386163  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 329882us
I20260709 13:00:50.364928  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:50.395210  1570 raft_consensus.cc:2468] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 7.
I20260709 13:00:50.399199  1615 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:00:50.401353  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 64823.3us
W20260709 13:00:50.398633  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 65771.3us
I20260709 13:00:50.276829  6646 raft_consensus.cc:515] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:50.283418  6660 raft_consensus.cc:515] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
W20260709 13:00:50.402814  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 64247.2us
W20260709 13:00:50.408209  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 387374us
I20260709 13:00:50.407945  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:50.410903  1615 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:50.280925  6645 raft_consensus.cc:515] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:50.408273  2295 leader_election.cc:304] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:50.422816  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:50.272492  6391 raft_consensus.cc:515] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:50.421617  1524 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 48204.3us
I20260709 13:00:50.177511  6701 consensus_queue.cc:237] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:50.337941  6694 raft_consensus.cc:2804] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:50.340663  6573 raft_consensus.cc:740] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
W20260709 13:00:50.429086  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.426983  1717 raft_consensus.cc:2468] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 14.
I20260709 13:00:50.430765  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:50.433156  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:50.433871  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:50.436617  1646 raft_consensus.cc:2393] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 13: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:50.402947  6678 raft_consensus.cc:3060] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:50.333519  6343 raft_consensus.cc:515] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:50.444470  2295 leader_election.cc:304] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:50.437811  1648 raft_consensus.cc:1240] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 9. Current term is 10. Ops: [7.7-9.8]
I20260709 13:00:50.425347  1642 consensus_queue.cc:260] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:50.436251  2323 raft_consensus.cc:2468] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 7.
I20260709 13:00:50.403697  6665 raft_consensus.cc:697] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:50.438236  6686 raft_consensus.cc:697] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 7 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:50.452548  1719 raft_consensus.cc:2468] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 7.
I20260709 13:00:50.329909  6695 raft_consensus.cc:515] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:50.426682  6656 raft_consensus.cc:3060] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:50.473356  1615 leader_election.cc:304] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:50.446000  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:50.432447  6693 raft_consensus.cc:2749] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:50.331537  6668 raft_consensus.cc:515] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:50.435386  6694 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:50.464906  1643 raft_consensus.cc:1275] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:00:50.429005  6446 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.471071  1642 raft_consensus.cc:3060] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:50.474987  1646 raft_consensus.cc:2468] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 9.
I20260709 13:00:50.479795  1719 raft_consensus.cc:1240] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 6. Current term is 7. Ops: []
I20260709 13:00:50.480068  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:50.480135  6667 consensus_queue.cc:1048] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 13:00:50.483461  6708 raft_consensus.cc:2804] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:50.484170  6267 raft_consensus.cc:493] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.484676  6712 consensus_queue.cc:1048] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.055s
W20260709 13:00:50.492427  1542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.499197  6716 consensus_queue.cc:1048] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:50.476760  6301 raft_consensus.cc:493] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:50.501684  6391 leader_election.cc:290] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:50.503538  6684 leader_election.cc:290] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:50.505595  6686 consensus_queue.cc:237] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:50.510474  6655 leader_election.cc:290] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:50.519337  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 65395.7us
W20260709 13:00:50.520382  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.523818  1723 raft_consensus.cc:1240] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:50.461841  6601 raft_consensus.cc:2804] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:50.470062  6654 raft_consensus.cc:2804] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:50.533840  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:50.519131  6694 raft_consensus.cc:3060] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:50.536128  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 91722.7us
I20260709 13:00:50.536206  1716 raft_consensus.cc:2393] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 13: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:50.430001  6633 consensus_queue.cc:237] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:50.523664  6708 raft_consensus.cc:493] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.543663  1615 leader_election.cc:304] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:00:50.561372  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.543402  6601 raft_consensus.cc:493] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.524587  6446 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:50.562960  6383 raft_consensus.cc:493] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.567864  6710 consensus_queue.cc:1059] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:00:50.573125  6652 raft_consensus.cc:3060] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:50.575106  6288 leader_election.cc:290] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:50.569762  6578 raft_consensus.cc:515] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:50.535660  6301 raft_consensus.cc:515] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:50.577107  6668 leader_election.cc:290] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:50.551086  6573 consensus_queue.cc:260] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:50.577523  1716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1947) took 1209 ms. Trace:
I20260709 13:00:50.547559  6693 raft_consensus.cc:2804] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:50.547649  6654 raft_consensus.cc:493] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.564613  6708 raft_consensus.cc:3060] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:50.586139  6695 leader_election.cc:290] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:50.586972  6660 leader_election.cc:290] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373)
W20260709 13:00:50.589304  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 45711.9us
I20260709 13:00:50.587713  6694 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:50.530030  6267 raft_consensus.cc:515] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:50.602082  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:50.625326  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.621495  1615 leader_election.cc:304] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:50.618933  1716 rpcz_store.cc:276] 0709 13:00:49.367847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.374744 (+  6897us) service_pool.cc:224] Handling call
0709 13:00:50.577323 (+1202579us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54000e33d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:50.577447 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2609733376}
I20260709 13:00:50.627527  1647 raft_consensus.cc:1240] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:50.592943  6601 raft_consensus.cc:3060] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:50.619254  6654 raft_consensus.cc:3060] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:50.614754  6710 raft_consensus.cc:3055] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:00:50.634784  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 382030us
I20260709 13:00:50.659683  1725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1944) took 1344 ms. Trace:
I20260709 13:00:50.570151  6655 consensus_queue.cc:1048] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 13:00:50.619086  6693 raft_consensus.cc:493] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:50.619069  6573 raft_consensus.cc:3060] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:50.619618  6656 raft_consensus.cc:2749] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:50.616091  6645 leader_election.cc:290] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:50.676491  1617 leader_election.cc:336] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.150s (SENT)
W20260709 13:00:50.678797  1617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:50.631664  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 75985.4us
I20260709 13:00:50.618408  6578 leader_election.cc:290] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:50.664286  1725 rpcz_store.cc:276] 0709 13:00:49.314892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.345794 (+ 30902us) service_pool.cc:224] Handling call
0709 13:00:50.659396 (+1313602us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54002265d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:50.659605 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2370546432}
I20260709 13:00:50.619887  6301 leader_election.cc:290] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:50.617761  6343 leader_election.cc:290] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:00:50.681118  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 211436us
I20260709 13:00:50.623860  6383 raft_consensus.cc:515] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:50.634428  6660 raft_consensus.cc:2749] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:50.678785  6693 raft_consensus.cc:3060] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:50.663915  6710 raft_consensus.cc:740] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:50.684106  1688 leader_election.cc:304] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
W20260709 13:00:50.689451  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 68069.8us
I20260709 13:00:50.693418  1615 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:50.694612  1615 leader_election.cc:304] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:50.684301  1689 leader_election.cc:304] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:50.685397  6723 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:50.703671  1615 leader_election.cc:304] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:50.706794  1689 leader_election.cc:400] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 election: Vote denied by peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373) with higher term. Message: Invalid argument: T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 12. Current term is 13.
I20260709 13:00:50.707381  1689 leader_election.cc:403] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 13:00:50.710057  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:50.713280  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:50.699586  6704 raft_consensus.cc:2804] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:50.717697  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:50.718194  1719 raft_consensus.cc:1240] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:50.718845  1540 leader_election.cc:304] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 13:00:50.721118  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.612491  6665 consensus_queue.cc:237] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:50.723182  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 13:00:50.764884  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 50646.3us
I20260709 13:00:50.764986  1716 raft_consensus.cc:3060] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:50.723326  6301 raft_consensus.cc:2804] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:50.723210  2327 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340"
dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
mode: GRACEFUL
new_leader_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:39778
I20260709 13:00:50.723815  6446 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:50.728709  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:50.767675  2327 raft_consensus.cc:606] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 LEADER]: Received request to transfer leadership to TS 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:50.767941  2323 raft_consensus.cc:3060] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:50.736219  2326 raft_consensus.cc:2410] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:00:50.736861  6710 consensus_queue.cc:260] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:50.741318  6267 leader_election.cc:290] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:50.741432  6694 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:50.743400  1725 raft_consensus.cc:1275] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 17 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:00:50.749742  6343 raft_consensus.cc:493] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.750461  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:50.740092  6708 raft_consensus.cc:515] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:50.712963  6732 raft_consensus.cc:2764] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 13:00:50.713119  6723 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:50.705415  6660 raft_consensus.cc:2749] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:50.756055  6633 raft_consensus.cc:2749] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 13 LEADER]: Leader election lost for term 12. Reason: Vote denied by peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373) with higher term. Message: Invalid argument: T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 12. Current term is 13.
W20260709 13:00:50.754361  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 48334.6us
I20260709 13:00:50.703299  6578 raft_consensus.cc:2749] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:00:50.762238  6704 raft_consensus.cc:493] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:50.769845  1647 raft_consensus.cc:1240] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:50.716131  6656 raft_consensus.cc:2804] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:50.740303  6678 raft_consensus.cc:2749] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:50.781685  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:50.783939  1642 raft_consensus.cc:1275] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260709 13:00:50.771054  6301 raft_consensus.cc:493] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:50.788657  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 88250.1us
I20260709 13:00:50.952878  1615 leader_election.cc:304] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 13:00:50.772231  6652 raft_consensus.cc:2749] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:50.798637  6708 leader_election.cc:290] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:50.787122  6343 raft_consensus.cc:515] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:50.802273  6670 consensus_queue.cc:1059] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 13:00:50.804571  6710 raft_consensus.cc:3060] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:50.770694  6684 consensus_queue.cc:1059] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 13:00:50.811584  2323 raft_consensus.cc:2468] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 14.
I20260709 13:00:50.952474  6267 raft_consensus.cc:493] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:50.813052  1689 leader_election.cc:304] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:50.815877  6703 consensus_queue.cc:1059] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 13:00:50.948702  1642 pending_rounds.cc:85] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e: Aborting all ops after (but not including) 12
I20260709 13:00:50.980662  1642 pending_rounds.cc:107] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 13:00:50.980999  1642 raft_consensus.cc:2889] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:00:50.942564  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 133582us
I20260709 13:00:50.944147  6578 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
W20260709 13:00:50.950035  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.953990  1716 raft_consensus.cc:2468] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 12.
W20260709 13:00:50.943747  1617 leader_election.cc:336] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.426s (SENT)
I20260709 13:00:50.982888  1617 leader_election.cc:304] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:00:50.984108  1617 leader_election.cc:336] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.607s (SENT)
I20260709 13:00:50.985854  6652 raft_consensus.cc:2749] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:50.987026  6578 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:50.989516  6578 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:50.990880  6601 raft_consensus.cc:515] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:50.966831  6656 raft_consensus.cc:697] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 10 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:50.993500  6707 consensus_queue.cc:1059] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:00:50.957270  1615 leader_election.cc:304] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:00:50.899369  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:50.978292  1649 raft_consensus.cc:1240] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:50.956244  6301 raft_consensus.cc:3060] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:51.014034  6646 leader_election.cc:290] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:51.015523  6343 leader_election.cc:290] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:50.994450  1540 leader_election.cc:304] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 13:00:51.016959  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.017043  6275 raft_consensus.cc:3055] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:51.017519  6275 raft_consensus.cc:740] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:51.017683  6343 raft_consensus.cc:2804] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:51.018296  6343 raft_consensus.cc:697] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:50.992695  6589 consensus_queue.cc:1059] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:00:50.993592  6656 consensus_queue.cc:237] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:50.998885  1643 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0"
dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
mode: GRACEFUL
new_leader_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:35470
I20260709 13:00:51.023869  1643 raft_consensus.cc:606] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Received request to transfer leadership to TS 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:51.024242  1643 raft_consensus.cc:614] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:50.994314  6267 raft_consensus.cc:515] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:50.953001  6391 consensus_queue.cc:1059] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:00:51.004254  6676 consensus_queue.cc:1059] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:51.006805  6677 consensus_queue.cc:1048] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:00:50.964282  6660 raft_consensus.cc:2804] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:50.957187  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:51.033922  2326 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53290 (request call id 1098) took 1145 ms. Trace:
I20260709 13:00:51.021032  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:51.021447  2297 leader_election.cc:304] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:51.035753  2323 raft_consensus.cc:2468] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 14.
I20260709 13:00:51.034510  2326 rpcz_store.cc:276] 0709 13:00:49.885866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.885975 (+   109us) service_pool.cc:224] Handling call
0709 13:00:51.025471 (+1139496us) spinlock_profiling.cc:243] Waited 844 ms on lock 0x7b5400846a54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:51.030796 (+  5325us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1940847488}
W20260709 13:00:51.037025  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 224087us
I20260709 13:00:50.951493  6704 raft_consensus.cc:3060] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:51.014065  6703 raft_consensus.cc:3055] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:51.028543  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:51.069964  2327 raft_consensus.cc:2468] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 11.
I20260709 13:00:51.012360  6708 raft_consensus.cc:3055] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:51.018554  6275 consensus_queue.cc:260] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:51.048969  6678 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.053323  6633 consensus_queue.cc:1059] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:51.055248  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:51.051909  6301 raft_consensus.cc:515] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:51.056383  1725 raft_consensus.cc:1240] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 17 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 13:00:51.056841  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:51.057065  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:51.057235  6391 consensus_queue.cc:1048] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:00:51.057544  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:51.058127  1719 raft_consensus.cc:1240] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:51.058322  6383 leader_election.cc:290] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:51.063280  6660 raft_consensus.cc:697] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 13 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
W20260709 13:00:51.063951  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.065019  6651 raft_consensus.cc:3055] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:51.066371  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:51.069007  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:00:51.073819  1542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.077669  6601 leader_election.cc:290] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 15 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:51.075223  6343 consensus_queue.cc:237] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:51.055832  6670 raft_consensus.cc:3055] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:51.034251  6715 raft_consensus.cc:2749] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:51.037281  6684 raft_consensus.cc:2749] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:00:51.085237  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 63913.5us
W20260709 13:00:51.086491  1617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.069682  6703 raft_consensus.cc:740] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:51.129766  6703 consensus_queue.cc:260] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:51.131551  6703 raft_consensus.cc:3060] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:51.108044  5970 raft_consensus.cc:2804] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:51.108453  1724 raft_consensus.cc:2468] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 10.
I20260709 13:00:51.079826  6678 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:51.109284  6660 consensus_queue.cc:237] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:51.110205  6301 leader_election.cc:290] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:51.113993  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 13:00:51.115154  1542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.117177  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:51.090183  1720 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 12.
I20260709 13:00:51.121385  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:51.072935  6708 raft_consensus.cc:740] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:51.121986  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:51.122368  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:51.122764  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:51.123203  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:51.088210  6651 raft_consensus.cc:740] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:51.147372  1717 raft_consensus.cc:2368] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 11. Current term is 12.
W20260709 13:00:51.147449  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 190229us
I20260709 13:00:51.145514  1725 raft_consensus.cc:2468] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 15.
W20260709 13:00:51.127100  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.127918  6723 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:51.080353  6267 leader_election.cc:290] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:51.141561  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:51.149812  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:51.093416  6670 raft_consensus.cc:740] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:51.144980  1722 raft_consensus.cc:2376] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 12. Re-sending same reply.
I20260709 13:00:51.149364  1615 leader_election.cc:304] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:51.156925  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:51.156057  1718 raft_consensus.cc:2410] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:00:51.159080  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:51.160499  1724 raft_consensus.cc:2393] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 13: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:51.161782  1719 raft_consensus.cc:1240] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:51.157711  1615 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:51.165289  1721 raft_consensus.cc:2410] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:00:51.165669  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:51.167397  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:51.164160  1615 leader_election.cc:304] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 13:00:51.168799  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.166427  1724 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 12.
I20260709 13:00:51.100965  6694 consensus_queue.cc:1059] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 13:00:51.174826  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:51.175156  1615 leader_election.cc:304] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:51.147608  6573 raft_consensus.cc:493] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.176311  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:51.163264  5970 raft_consensus.cc:697] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:51.164351  6383 raft_consensus.cc:2804] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:51.181195  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:51.167171  6578 raft_consensus.cc:2804] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:51.185645  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:51.178892  1615 leader_election.cc:304] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:51.186664  1724 raft_consensus.cc:2410] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 13:00:51.173149  6593 raft_consensus.cc:3055] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:00:51.175900  6652 raft_consensus.cc:2804] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:00:51.178093  6654 consensus_meta.cc:287] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.503s	user 0.008s	sys 0.003s
I20260709 13:00:51.194180  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:51.197569  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:51.181620  6715 raft_consensus.cc:2804] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:51.199100  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:51.199893  1645 raft_consensus.cc:2468] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 11.
I20260709 13:00:51.202205  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:00:51.204027  1617 leader_election.cc:336] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.772s (SENT)
I20260709 13:00:51.205331  1617 leader_election.cc:304] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:51.188794  6593 raft_consensus.cc:740] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:51.190076  6652 raft_consensus.cc:493] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:51.209977  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:51.210909  1650 raft_consensus.cc:1240] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:51.212109  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:51.192636  6716 raft_consensus.cc:2804] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:51.210178  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:51.220089  1646 raft_consensus.cc:2393] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 12: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:51.181969  6573 raft_consensus.cc:515] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:51.220064  1649 raft_consensus.cc:2468] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 13.
I20260709 13:00:51.180738  6670 consensus_queue.cc:260] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:51.221441  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:51.215855  1724 raft_consensus.cc:2468] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 11.
I20260709 13:00:51.202229  6715 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:51.221647  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:51.222033  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:51.219197  6652 raft_consensus.cc:3060] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:51.194952  6651 consensus_queue.cc:260] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:51.226759  1722 raft_consensus.cc:2468] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 10.
I20260709 13:00:51.200449  6693 raft_consensus.cc:515] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:51.195901  6654 raft_consensus.cc:515] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:51.197315  6708 consensus_queue.cc:260] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:51.227948  6715 raft_consensus.cc:3060] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:51.228670  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:51.225983  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:51.229777  1645 raft_consensus.cc:2393] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 12: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:51.232865  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:51.273656  1716 raft_consensus.cc:2468] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 10.
I20260709 13:00:51.274006  1643 raft_consensus.cc:1275] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:00:51.275672  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:51.276435  1651 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 13.
I20260709 13:00:51.278203  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:51.259630  1723 raft_consensus.cc:1275] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:00:51.266820  1717 raft_consensus.cc:1275] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:00:51.267127  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:51.268824  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:51.280341  1722 raft_consensus.cc:2468] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 10.
I20260709 13:00:51.271097  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 13:00:51.239298  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.282407  1721 raft_consensus.cc:2393] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 13: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:51.266212  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:51.285370  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:51.294780  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:51.341614  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:00:51.285373  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 231244us
I20260709 13:00:51.282998  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:51.342761  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:51.343175  1573 raft_consensus.cc:2393] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 13: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:51.283716  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:51.344667  1648 raft_consensus.cc:2468] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 11.
W20260709 13:00:51.316138  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.269467  1649 raft_consensus.cc:2468] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 13.
I20260709 13:00:51.343384  1651 raft_consensus.cc:2468] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 15.
I20260709 13:00:51.357131  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:51.358769  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:51.400067  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: true dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 13:00:51.400378  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 308575us
I20260709 13:00:51.401116  1574 raft_consensus.cc:2368] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 7. Current term is 8.
I20260709 13:00:51.257426  6708 raft_consensus.cc:3060] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:51.253968  6670 raft_consensus.cc:3060] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:51.402081  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:51.260977  6656 raft_consensus.cc:2749] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:51.359521  1571 raft_consensus.cc:2376] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 10. Re-sending same reply.
I20260709 13:00:51.418507  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: true dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:51.419158  1571 raft_consensus.cc:2376] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 13. Re-sending same reply.
I20260709 13:00:51.404495  1720 raft_consensus.cc:1240] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:51.405167  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:51.421782  1716 raft_consensus.cc:2468] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 13.
I20260709 13:00:51.236977  6673 raft_consensus.cc:493] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.266149  6723 raft_consensus.cc:3055] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:51.407395  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:51.408818  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:51.409261  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:51.235911  6654 leader_election.cc:290] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:51.252460  6678 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:51.411018  1570 raft_consensus.cc:3060] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:51.231276  6651 raft_consensus.cc:3060] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:51.232825  6693 leader_election.cc:290] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:51.259056  6573 leader_election.cc:290] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:51.416440  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 13:00:51.422796  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.432029  1575 raft_consensus.cc:2376] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 13. Re-sending same reply.
W20260709 13:00:51.432488  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.420205  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:00:51.411645  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 272715us
I20260709 13:00:51.255415  6275 raft_consensus.cc:3060] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:51.437222  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:51.437883  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:51.443169  1539 leader_election.cc:304] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:51.445014  1539 leader_election.cc:304] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:51.445665  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:51.446071  1567 raft_consensus.cc:2393] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 8: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:51.446297  1644 raft_consensus.cc:2468] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 11.
I20260709 13:00:51.357385  6713 raft_consensus.cc:493] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.448190  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:51.450129  1651 raft_consensus.cc:2393] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 11: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:51.452870  1542 leader_election.cc:304] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:51.454389  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:51.454720  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:51.455175  1568 raft_consensus.cc:2410] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:00:51.449023  1569 raft_consensus.cc:2468] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 12.
I20260709 13:00:51.465174  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:51.467437  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:51.468245  2324 raft_consensus.cc:2393] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 8: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 13:00:51.339825  6732 consensus_queue.cc:1048] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.087s
I20260709 13:00:51.465828  1571 raft_consensus.cc:2468] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 11.
I20260709 13:00:51.251137  6704 raft_consensus.cc:515] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:51.475831  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:51.481743  1571 raft_consensus.cc:2468] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 12.
I20260709 13:00:51.482683  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:51.483392  1571 raft_consensus.cc:2468] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 13.
I20260709 13:00:51.484377  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:51.485788  1571 raft_consensus.cc:2468] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 11.
I20260709 13:00:51.486694  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:51.486824  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:51.238735  6652 raft_consensus.cc:515] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:51.487673  1571 raft_consensus.cc:2468] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 14.
I20260709 13:00:51.477830  1575 raft_consensus.cc:2468] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 8.
I20260709 13:00:51.478039  1539 leader_election.cc:304] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:51.480183  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:51.480576  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:51.490697  1719 raft_consensus.cc:3060] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:51.490981  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: true dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
W20260709 13:00:51.491094  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 287092us
I20260709 13:00:51.491837  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:51.492878  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:51.494453  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:51.495353  2328 raft_consensus.cc:2393] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 14: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 13:00:51.500233  1540 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:51.429981  6723 raft_consensus.cc:740] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:51.503377  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:51.517257  1568 raft_consensus.cc:3060] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:51.504153  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:51.505085  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:51.244796  5970 consensus_queue.cc:237] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:51.519939  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:51.509436  2326 raft_consensus.cc:2368] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 7. Current term is 8.
I20260709 13:00:51.509886  1575 raft_consensus.cc:1240] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 12. Current term is 13. Ops: []
W20260709 13:00:51.492888  1617 leader_election.cc:336] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.805s (SENT)
I20260709 13:00:51.519331  1573 raft_consensus.cc:3060] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:51.523250  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 70452.9us
I20260709 13:00:51.524951  1542 leader_election.cc:304] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:51.528191  2325 raft_consensus.cc:1275] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:00:51.530154  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:51.534775  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:51.541361  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:51.542281  1716 raft_consensus.cc:3060] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:51.474676  6665 raft_consensus.cc:2804] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:00:51.548169  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 55301.2us
W20260709 13:00:51.549600  1617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.553295  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:51.553962  1567 raft_consensus.cc:3060] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:51.489357  6301 raft_consensus.cc:3060] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:51.484102  6578 raft_consensus.cc:697] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 14 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:51.449474  6673 raft_consensus.cc:515] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:51.555764  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:51.560982  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:51.464260  6713 raft_consensus.cc:515] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:51.410548  6593 consensus_queue.cc:260] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:51.558990  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:51.552769  1725 raft_consensus.cc:2393] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 10: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:51.549304  6665 raft_consensus.cc:493] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:51.548645  6646 raft_consensus.cc:2749] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:51.490342  6383 raft_consensus.cc:697] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 15 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:51.560250  1570 raft_consensus.cc:2468] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 15.
I20260709 13:00:51.618847  6646 raft_consensus.cc:2749] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:51.625661  2330 raft_consensus.cc:1275] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:00:51.625372  1573 raft_consensus.cc:2468] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 10.
I20260709 13:00:51.577947  6343 raft_consensus.cc:2804] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:51.575188  6656 raft_consensus.cc:493] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.581399  6665 raft_consensus.cc:3060] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:51.608304  2323 raft_consensus.cc:2376] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 7. Re-sending same reply.
W20260709 13:00:51.591039  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.604029  1716 raft_consensus.cc:2468] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 15.
I20260709 13:00:51.573858  6573 raft_consensus.cc:2804] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:51.633776  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
W20260709 13:00:51.630466  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 152519us
I20260709 13:00:51.648954  1539 leader_election.cc:304] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:51.651234  1539 leader_election.cc:304] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:51.610231  6716 raft_consensus.cc:697] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 13 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:51.633215  6343 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:51.654528  1689 connection.cc:256] RPC call timeout handler was delayed by -2.2550987239999927s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1668s for a response
I20260709 13:00:51.662389  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:51.664378  2330 raft_consensus.cc:2393] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 13: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
W20260709 13:00:51.664312  1689 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.665596  6383 consensus_queue.cc:237] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:51.670904  6746 log.cc:927] Time spent T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
W20260709 13:00:51.672039  6749 log.cc:927] Time spent T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 13:00:51.673357  6745 log.cc:927] Time spent T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.274s	user 0.000s	sys 0.001s
I20260709 13:00:51.659889  6646 raft_consensus.cc:2804] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:51.646785  6573 raft_consensus.cc:493] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:51.584287  6723 consensus_queue.cc:260] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:51.665218  1689 connection.cc:256] RPC call timeout handler was delayed by -1.9976987239999744s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19540000000000002s for a response
I20260709 13:00:51.749675  6686 raft_consensus.cc:3055] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:00:51.777496  1689 connection.cc:256] RPC call timeout handler was delayed by -1.8005987239999968s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21730000000000002s for a response
I20260709 13:00:51.736263  2332 raft_consensus.cc:2468] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 13.
I20260709 13:00:51.778376  6573 raft_consensus.cc:3060] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:51.777153  1648 raft_consensus.cc:1240] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:51.678511  6578 consensus_queue.cc:237] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:51.677407  6343 raft_consensus.cc:3060] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:51.739331  6716 consensus_queue.cc:237] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:51.779954  6646 raft_consensus.cc:493] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:51.758461  1474 catalog_manager.cc:5697] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 7 to 8, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 8 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:51.655795  6761 raft_consensus.cc:2804] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:51.832819  6761 raft_consensus.cc:493] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:51.833273  6761 raft_consensus.cc:3060] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:51.832824  6646 raft_consensus.cc:3060] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:51.780638  6673 leader_election.cc:290] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:51.777846  6686 raft_consensus.cc:740] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:51.750607  6713 leader_election.cc:290] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:51.700248  6752 consensus_queue.cc:1059] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.118s
W20260709 13:00:51.778064  1689 connection.cc:256] RPC call timeout handler was delayed by -1.0223018450000154s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1552s for a response
I20260709 13:00:51.784847  6704 leader_election.cc:290] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:00:51.786970  6748 log.cc:927] Time spent T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.152s	user 0.003s	sys 0.000s
I20260709 13:00:51.791785  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:51.792764  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:51.848064  1651 raft_consensus.cc:2468] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 12.
W20260709 13:00:51.794190  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:51.722563  2326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a"
dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
mode: GRACEFUL
new_leader_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:39778
I20260709 13:00:51.722275  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:51.849886  2330 raft_consensus.cc:2393] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 8: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 13:00:51.802183  1568 raft_consensus.cc:2468] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 12.
I20260709 13:00:51.760031  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:51.807469  1722 raft_consensus.cc:2468] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 15.
I20260709 13:00:51.739539  6651 raft_consensus.cc:493] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.810067  1719 raft_consensus.cc:2468] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 8.
I20260709 13:00:51.739729  6644 raft_consensus.cc:3055] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:00:51.738845  6703 consensus_meta.cc:287] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.607s	user 0.009s	sys 0.000s
I20260709 13:00:51.664449  1617 leader_election.cc:304] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:00:51.875389  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 210989us
I20260709 13:00:51.876748  6693 raft_consensus.cc:2749] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:51.694203  1567 raft_consensus.cc:2468] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 11.
W20260709 13:00:51.709146  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 208994us
I20260709 13:00:51.701598  6677 raft_consensus.cc:993] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66: : Instructing follower 0c7751452c4b46afa95251b9df7169d4 to start an election
I20260709 13:00:51.880266  6759 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.828900  1615 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
W20260709 13:00:51.881551  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 52727.5us
I20260709 13:00:51.882299  1615 leader_election.cc:304] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:51.883337  1615 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:51.884063  6756 raft_consensus.cc:2749] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:51.841521  6686 consensus_queue.cc:260] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 13:00:51.842738  6654 raft_consensus.cc:493] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.884428  1615 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:51.911720  1617 leader_election.cc:304] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:51.739213  6750 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:51.845182  1689 connection.cc:256] RPC call timeout handler was delayed by -1.0088018449999936s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1567s for a response
I20260709 13:00:51.843240  2297 leader_election.cc:304] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
W20260709 13:00:51.917168  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 74048us
I20260709 13:00:51.918259  2297 leader_election.cc:304] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:51.918571  2328 raft_consensus.cc:2468] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 8.
I20260709 13:00:51.862092  1645 raft_consensus.cc:1240] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:51.854480  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:51.652213  6656 raft_consensus.cc:515] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:51.866444  1688 leader_election.cc:304] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
W20260709 13:00:51.870281  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 345417us
I20260709 13:00:51.874060  6301 raft_consensus.cc:2749] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:51.881023  6759 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:51.749665  6652 leader_election.cc:290] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:51.846263  6757 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.934047  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:51.934331  6757 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:51.897526  6752 raft_consensus.cc:3055] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:51.936815  6752 raft_consensus.cc:740] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:51.937016  6593 raft_consensus.cc:3060] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:51.939620  6631 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.941360  2332 raft_consensus.cc:1275] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:00:51.942968  6670 raft_consensus.cc:493] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:51.943516  6670 raft_consensus.cc:515] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:51.922389  6713 consensus_queue.cc:1059] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:00:51.940215  6631 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:51.961851  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 111835us
I20260709 13:00:51.915561  1615 leader_election.cc:304] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:51.921006  2324 raft_consensus.cc:2468] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 9.
I20260709 13:00:51.753031  6715 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:51.923051  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 56707.6us
I20260709 13:00:51.923317  1689 leader_election.cc:304] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:51.920428  6654 raft_consensus.cc:515] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:51.930970  6665 raft_consensus.cc:515] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:51.932663  6751 raft_consensus.cc:2749] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:00:51.932747  6669 raft_consensus.cc:2804] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:51.933220  6753 raft_consensus.cc:2804] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:51.964141  2327 raft_consensus.cc:2468] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 11.
I20260709 13:00:51.894939  6723 raft_consensus.cc:3060] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:51.880666  6267 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:51.884850  6677 raft_consensus.cc:1081] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 LEADER]: Signalling peer 0c7751452c4b46afa95251b9df7169d4 to start an election
W20260709 13:00:51.975844  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 60392.5us
I20260709 13:00:51.865274  6644 raft_consensus.cc:740] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:51.884677  6660 raft_consensus.cc:2749] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:51.886543  6693 raft_consensus.cc:2749] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:00:51.984968  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.031577  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:52.034869  1567 raft_consensus.cc:2468] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 12.
I20260709 13:00:51.986047  1474 catalog_manager.cc:5697] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 8 to 11, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 11 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:00:51.926227  6708 consensus_meta.cc:287] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.514s	user 0.006s	sys 0.002s
I20260709 13:00:51.924700  6275 raft_consensus.cc:2804] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:00:51.991685  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 68433.1us
I20260709 13:00:51.995795  1719 raft_consensus.cc:1240] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:51.997582  1644 raft_consensus.cc:1240] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:51.973363  6732 raft_consensus.cc:2804] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:51.889987  6651 raft_consensus.cc:515] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:52.006604  1569 raft_consensus.cc:2393] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 12: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:51.984298  6756 raft_consensus.cc:2804] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:51.937906  6752 consensus_queue.cc:260] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:51.924003  6750 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:52.010610  6573 raft_consensus.cc:515] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:52.015055  6665 leader_election.cc:290] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:52.018674  6761 raft_consensus.cc:515] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:52.021277  6759 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:52.023196  6631 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:51.978820  6757 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:00:52.034372  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.033490  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:52.032862  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:52.031231  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:51.985388  2329 raft_consensus.cc:1240] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 LEADER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:51.990585  6633 raft_consensus.cc:2749] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:52.074568  2326 raft_consensus.cc:606] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 LEADER]: Received request to transfer leadership to TS 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:52.068679  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:52.075075  1725 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 12.
I20260709 13:00:52.075570  1572 raft_consensus.cc:2468] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 8.
I20260709 13:00:52.076390  1723 raft_consensus.cc:2468] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 8.
W20260709 13:00:52.077596  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.082058  2295 leader_election.cc:304] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:52.074471  1574 raft_consensus.cc:2468] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 16.
I20260709 13:00:52.086254  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:51.992688  6753 raft_consensus.cc:493] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:52.087038  1567 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 13.
W20260709 13:00:52.087818  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 51687.2us
I20260709 13:00:52.083341  2297 leader_election.cc:304] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 13:00:52.028638  6267 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:52.067652  6669 raft_consensus.cc:697] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:52.096271  6669 consensus_queue.cc:237] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:52.096859  6652 raft_consensus.cc:493] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.097448  6652 raft_consensus.cc:515] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:52.101859  1721 raft_consensus.cc:2468] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 12.
I20260709 13:00:52.102269  1689 leader_election.cc:304] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:52.033207  6343 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:52.106345  6715 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:52.107002  6343 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 15 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:52.107478  6752 raft_consensus.cc:3060] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:52.108768  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:52.109360  1646 raft_consensus.cc:2468] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 16.
I20260709 13:00:52.109452  6756 raft_consensus.cc:697] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 10 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:52.110419  6756 consensus_queue.cc:237] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:52.111721  2294 leader_election.cc:304] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:52.033155  1722 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386"
dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:58782
I20260709 13:00:52.112814  1722 raft_consensus.cc:493] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:00:52.113193  1722 raft_consensus.cc:3060] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:00:52.119231  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 157823us
I20260709 13:00:52.026001  6654 leader_election.cc:290] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:52.124374  2331 raft_consensus.cc:2468] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 7.
I20260709 13:00:52.122815  1722 raft_consensus.cc:515] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:52.082826  6732 raft_consensus.cc:493] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.133546  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:52.118534  2294 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:52.123857  6275 raft_consensus.cc:697] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:52.144289  1539 leader_election.cc:304] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:52.137220  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 13:00:52.147107  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 44901.5us
I20260709 13:00:52.147647  1575 raft_consensus.cc:3060] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:52.147886  1689 leader_election.cc:304] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:52.138770  1576 raft_consensus.cc:1240] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:52.140753  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:52.141217  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:52.141851  1722 leader_election.cc:290] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:52.135396  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:52.152181  2324 raft_consensus.cc:1240] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:52.152372  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:52.149451  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:52.154165  1576 raft_consensus.cc:3060] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:52.154194  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:52.117168  6601 raft_consensus.cc:2804] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:52.164988  1648 raft_consensus.cc:1275] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:00:52.104565  6753 raft_consensus.cc:3060] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:52.159417  1651 raft_consensus.cc:2393] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 14: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:52.171228  1651 raft_consensus.cc:3055] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:52.171592  1651 raft_consensus.cc:740] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:52.153730  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:52.172961  1569 raft_consensus.cc:2393] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 13: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:52.159021  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:52.174093  1572 raft_consensus.cc:3060] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:52.158129  1615 leader_election.cc:304] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:52.124760  6744 raft_consensus.cc:2749] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:52.149911  6732 raft_consensus.cc:3060] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:52.107048  6761 leader_election.cc:290] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:52.177264  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:52.134655  6267 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:52.171500  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:52.176573  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:52.168248  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:52.175546  1615 leader_election.cc:304] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:52.187252  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:52.159226  6654 raft_consensus.cc:2804] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:52.159061  6759 raft_consensus.cc:2804] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:52.149556  6676 raft_consensus.cc:2804] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:52.167111  6694 raft_consensus.cc:2749] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:52.215346  1647 raft_consensus.cc:3060] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:52.215423  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:52.224062  1569 raft_consensus.cc:2393] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 13: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:52.214387  1648 raft_consensus.cc:3060] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:00:52.164243  6601 raft_consensus.cc:493] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.213609  1615 leader_election.cc:304] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:52.149703  6633 consensus_queue.cc:1059] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:00:52.221392  1573 raft_consensus.cc:3060] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:00:52.214808  1646 raft_consensus.cc:3060] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:52.231256  1615 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
W20260709 13:00:52.221664  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 73843.6us
I20260709 13:00:52.144954  6715 consensus_queue.cc:1048] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:00:52.185927  1651 consensus_queue.cc:260] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:52.233189  1651 raft_consensus.cc:3060] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:52.233819  1689 leader_election.cc:304] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:52.225783  1575 raft_consensus.cc:2468] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 8.
I20260709 13:00:52.189631  6660 raft_consensus.cc:2804] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:00:52.229746  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 140897us
I20260709 13:00:52.217967  6654 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.234283  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:52.238456  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:52.243275  2324 raft_consensus.cc:3060] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:52.222554  6704 raft_consensus.cc:2749] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:52.234632  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:52.256726  2328 raft_consensus.cc:3060] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:52.257328  6686 raft_consensus.cc:3060] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:52.220901  6383 raft_consensus.cc:2804] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:52.264633  2328 raft_consensus.cc:2468] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 15.
I20260709 13:00:52.236984  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:52.241743  1689 leader_election.cc:304] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:52.220969  6676 raft_consensus.cc:493] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.272250  6676 raft_consensus.cc:3060] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:52.272450  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:52.221381  6759 raft_consensus.cc:493] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.028384  6644 consensus_queue.cc:260] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:52.247766  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:52.275112  1689 leader_election.cc:400] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 election: Vote denied by peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423) with higher term. Message: Invalid argument: T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 7. Current term is 8.
I20260709 13:00:52.275180  2329 raft_consensus.cc:2468] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 14.
I20260709 13:00:52.275537  1689 leader_election.cc:403] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:00:52.248919  6573 leader_election.cc:290] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:52.245945  6694 raft_consensus.cc:2749] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:00:52.235574  6343 consensus_queue.cc:1048] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:00:52.235940  6660 raft_consensus.cc:493] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.246127  6654 raft_consensus.cc:3060] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:52.261350  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 13:00:52.264650  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.228802  6601 raft_consensus.cc:3060] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:52.271775  6383 raft_consensus.cc:493] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.266381  1540 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 13:00:52.361773  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 95460.9us
I20260709 13:00:52.363083  1540 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:52.274181  1648 raft_consensus.cc:2468] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 15.
I20260709 13:00:52.273171  1569 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 14.
I20260709 13:00:52.276510  2324 raft_consensus.cc:2468] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 12.
I20260709 13:00:52.276561  1689 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:52.218547  6646 raft_consensus.cc:515] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:52.365736  6723 raft_consensus.cc:2749] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:52.253422  6715 consensus_queue.cc:1059] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:52.366415  6761 raft_consensus.cc:2804] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:52.366952  6715 raft_consensus.cc:3055] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:52.367039  6761 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:52.367463  6646 leader_election.cc:290] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 16 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:52.367775  1568 raft_consensus.cc:2368] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 15. Current term is 16.
I20260709 13:00:52.254043  1647 raft_consensus.cc:2468] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 12.
I20260709 13:00:52.290697  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:52.367463  6715 raft_consensus.cc:740] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:52.368829  1575 raft_consensus.cc:3060] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:52.369341  6715 consensus_queue.cc:260] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:52.370464  6715 raft_consensus.cc:3060] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:52.371165  6573 raft_consensus.cc:2804] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:52.371942  6573 raft_consensus.cc:697] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
W20260709 13:00:52.279242  1542 leader_election.cc:336] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.575s (SENT)
I20260709 13:00:52.372756  1542 leader_election.cc:304] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
W20260709 13:00:52.373605  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 94410.9us
I20260709 13:00:52.373193  6573 consensus_queue.cc:237] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:52.374198  1542 leader_election.cc:336] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.577s (SENT)
I20260709 13:00:52.374593  1542 leader_election.cc:304] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:52.291656  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:52.376811  6646 raft_consensus.cc:2749] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:00:52.247113  6716 raft_consensus.cc:2804] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:52.376825  6751 raft_consensus.cc:2764] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 13:00:52.303316  1573 raft_consensus.cc:2468] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 7.
I20260709 13:00:52.367794  6761 raft_consensus.cc:3060] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:52.281774  1615 leader_election.cc:304] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:52.384333  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:52.384541  6715 raft_consensus.cc:2804] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:00:52.384454  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 102756us
I20260709 13:00:52.385385  6715 raft_consensus.cc:697] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 10 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:52.386133  1723 raft_consensus.cc:1275] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:00:52.386337  1615 leader_election.cc:304] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:52.386348  6715 consensus_queue.cc:237] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
W20260709 13:00:52.307143  6767 log.cc:927] Time spent T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
W20260709 13:00:52.307901  6770 log.cc:927] Time spent T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
W20260709 13:00:52.387902  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.306449  1651 raft_consensus.cc:1275] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260709 13:00:52.392702  1651 pending_rounds.cc:85] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e: Aborting all ops after (but not including) 10
I20260709 13:00:52.393030  1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2540) took 1126 ms. Trace:
I20260709 13:00:52.235782  6275 consensus_queue.cc:237] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:52.393747  1721 rpcz_store.cc:276] 0709 13:00:51.266718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.339416 (+ 72698us) service_pool.cc:224] Handling call
0709 13:00:51.759874 (+420458us) spinlock_profiling.cc:243] Waited 1.9 ms on lock 0x7b5800196e98. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef296b71 00007fa9ef296a22 00007fa9f81afc09 00007fa9f7309ee0 00007fa9f73d30ab 00007fa9f73d3131 00007fa9f73810a0 00007fa9f7380984 00007fa9f08fb6d4 00007fa9f08fb662
0709 13:00:52.392797 (+632923us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b5400354b54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:52.392951 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":545495808}
I20260709 13:00:52.395579  1615 leader_election.cc:304] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:52.285441  6660 raft_consensus.cc:3060] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:52.317306  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.397401  1569 raft_consensus.cc:1240] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:52.328220  6694 raft_consensus.cc:493] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.343271  6656 leader_election.cc:290] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:52.280547  6633 raft_consensus.cc:2749] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423) with higher term. Message: Invalid argument: T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 7. Current term is 8.
I20260709 13:00:52.292027  6707 consensus_queue.cc:1059] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 13:00:52.345860  6750 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:52.284446  6678 consensus_queue.cc:1048] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 13:00:52.346240  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:00:52.346704  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.347077  6651 leader_election.cc:290] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:52.347520  6744 raft_consensus.cc:493] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:52.353519  6773 log.cc:927] Time spent T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:00:52.356727  2295 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:52.359254  1576 raft_consensus.cc:2468] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 11.
W20260709 13:00:52.364916  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 88436.5us
I20260709 13:00:52.426590  1689 leader_election.cc:304] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e
W20260709 13:00:52.427321  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 70691us
I20260709 13:00:52.365370  6383 raft_consensus.cc:3060] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:52.365237  1540 leader_election.cc:304] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:52.407327  6267 raft_consensus.cc:2749] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:00:52.274564  6704 raft_consensus.cc:2749] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:52.377604  6716 raft_consensus.cc:493] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.277680  6759 raft_consensus.cc:3060] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:52.393033  1651 pending_rounds.cc:107] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e: Aborting uncommitted NO_OP operation due to leader change: 13.11
W20260709 13:00:52.415406  1542 leader_election.cc:336] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.750s (SENT)
I20260709 13:00:52.440475  1651 raft_consensus.cc:2889] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:52.442688  1576 raft_consensus.cc:1240] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:52.444130  1576 raft_consensus.cc:1240] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 LEADER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:52.416955  1575 raft_consensus.cc:2468] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 14.
I20260709 13:00:52.445433  1575 raft_consensus.cc:1240] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:52.446215  1576 raft_consensus.cc:1240] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:52.447569  1575 raft_consensus.cc:1275] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:00:52.428752  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:52.429052  1569 raft_consensus.cc:1240] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:52.429246  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:52.448516  1721 raft_consensus.cc:2468] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 14.
I20260709 13:00:52.448740  1724 raft_consensus.cc:2468] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 10.
I20260709 13:00:52.449434  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:52.449596  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:00:52.430579  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 65424.1us
I20260709 13:00:52.376968  1571 raft_consensus.cc:2393] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 13: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:52.432101  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:52.452504  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:52.413558  6693 raft_consensus.cc:2804] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:52.455965  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:52.434497  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:52.458051  1718 raft_consensus.cc:2393] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 13: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
W20260709 13:00:52.436075  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 145352us
I20260709 13:00:52.436254  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:52.460110  1716 raft_consensus.cc:2368] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 10. Current term is 11.
I20260709 13:00:52.437778  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 13:00:52.453671  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.413141  6752 raft_consensus.cc:2804] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:52.459213  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:52.461789  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:52.461956  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:52.462574  1719 raft_consensus.cc:2393] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 8: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:52.463088  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:52.462973  1717 raft_consensus.cc:2368] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 14. Current term is 15.
I20260709 13:00:52.464226  1725 raft_consensus.cc:1240] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:52.462069  1721 raft_consensus.cc:2468] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 13.
I20260709 13:00:52.466039  1722 raft_consensus.cc:2393] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 7: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
W20260709 13:00:52.466534  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 51183.8us
W20260709 13:00:52.467203  1542 leader_election.cc:336] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.841s (SENT)
I20260709 13:00:52.467617  1542 leader_election.cc:304] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:52.469110  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:52.469897  1724 raft_consensus.cc:2393] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 8: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 13:00:52.470475  1718 raft_consensus.cc:2368] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 12. Current term is 13.
I20260709 13:00:52.437718  6651 raft_consensus.cc:2804] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:52.440119  6716 raft_consensus.cc:3060] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:52.421051  6694 raft_consensus.cc:515] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:52.432818  6633 raft_consensus.cc:2804] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:52.485136  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:52.492686  1716 raft_consensus.cc:2393] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 12: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:52.430869  6728 consensus_queue.cc:1048] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260709 13:00:52.490857  1572 raft_consensus.cc:2468] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 9.
I20260709 13:00:52.436259  6774 raft_consensus.cc:2804] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:52.490518  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:52.493773  1720 raft_consensus.cc:2468] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 12.
W20260709 13:00:52.495580  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 95090.9us
W20260709 13:00:52.498302  1542 leader_election.cc:336] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.868s (SENT)
I20260709 13:00:52.498714  1542 leader_election.cc:304] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:52.498739  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:52.499763  1720 raft_consensus.cc:2468] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 10.
I20260709 13:00:52.473549  6760 raft_consensus.cc:493] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.427207  6744 raft_consensus.cc:515] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:52.503865  1542 leader_election.cc:336] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.954s (SENT)
I20260709 13:00:52.505959  1542 leader_election.cc:304] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:52.502136  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:52.475793  6651 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:52.509490  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:52.512791  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:52.476275  6652 leader_election.cc:290] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:52.518586  1724 raft_consensus.cc:2468] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 10.
I20260709 13:00:52.524302  6786 raft_consensus.cc:493] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:52.537205  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:52.537829  1643 raft_consensus.cc:2468] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 12.
I20260709 13:00:52.526611  6790 consensus_queue.cc:1059] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:52.531405  6670 leader_election.cc:290] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:52.533170  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:52.547395  1722 raft_consensus.cc:3060] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:00:52.540575  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:52.542052  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:52.509063  6710 raft_consensus.cc:3055] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:52.508999  6646 raft_consensus.cc:2749] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:52.548740  1649 raft_consensus.cc:2468] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 11.
I20260709 13:00:52.545228  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:52.503328  6633 raft_consensus.cc:697] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 13 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:52.549036  1651 raft_consensus.cc:1240] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:52.508433  6774 raft_consensus.cc:697] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:52.603901  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:52.604598  1648 raft_consensus.cc:3055] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:52.605710  1648 raft_consensus.cc:740] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:52.528285  6651 raft_consensus.cc:3060] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:00:52.605011  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 54964.1us
I20260709 13:00:52.605752  1716 raft_consensus.cc:2393] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 12: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
W20260709 13:00:52.592868  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.550731  1643 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 13.
W20260709 13:00:52.573189  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.594691  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:52.615249  1720 raft_consensus.cc:2410] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 15 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
W20260709 13:00:52.611637  1617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.617627  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:00:52.617826  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 114001us
W20260709 13:00:52.618731  1542 leader_election.cc:336] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.005s (SENT)
I20260709 13:00:52.619257  1542 leader_election.cc:304] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:52.620829  6780 consensus_queue.cc:1048] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:00:52.606545  1648 consensus_queue.cc:260] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:52.625172  1648 raft_consensus.cc:3060] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:00:52.625838  1542 leader_election.cc:336] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.007s (SENT)
I20260709 13:00:52.626408  1542 leader_election.cc:304] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:52.618321  1644 raft_consensus.cc:2468] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 14.
I20260709 13:00:52.538079  6343 raft_consensus.cc:2749] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:00:52.637864  1542 leader_election.cc:336] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.046s (SENT)
I20260709 13:00:52.638348  1542 leader_election.cc:304] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:52.639079  1646 raft_consensus.cc:2468] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 12.
I20260709 13:00:52.616067  6678 raft_consensus.cc:493] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:52.644009  2294 leader_election.cc:304] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:52.615090  6752 raft_consensus.cc:697] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 11 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
W20260709 13:00:52.645010  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 146235us
I20260709 13:00:52.645447  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:52.648703  2331 raft_consensus.cc:3055] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:52.649015  2331 raft_consensus.cc:740] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:52.605934  6710 raft_consensus.cc:740] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:52.604430  6693 raft_consensus.cc:697] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 12 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
W20260709 13:00:52.657289  1542 leader_election.cc:336] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.068s (SENT)
I20260709 13:00:52.661490  1542 leader_election.cc:304] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:52.650951  1615 leader_election.cc:304] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:52.515514  6760 raft_consensus.cc:515] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:52.641266  6573 raft_consensus.cc:2749] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:00:52.649698  2331 consensus_queue.cc:260] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:52.667238  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:52.674877  2331 raft_consensus.cc:3060] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:52.676193  1648 raft_consensus.cc:1275] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 13:00:52.676555  1648 pending_rounds.cc:85] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e: Aborting all ops after (but not including) 9
I20260709 13:00:52.677861  1648 pending_rounds.cc:107] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 13:00:52.650300  6646 raft_consensus.cc:2749] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:52.658730  1722 raft_consensus.cc:2468] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 12.
I20260709 13:00:52.678263  1648 raft_consensus.cc:2889] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:52.682696  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:52.683830  2332 raft_consensus.cc:2468] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 7.
I20260709 13:00:52.684396  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:52.685279  1722 raft_consensus.cc:3060] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:52.687335  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:52.544090  6786 raft_consensus.cc:515] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:52.690361  6779 log.cc:927] Time spent T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 13:00:52.690519  6786 leader_election.cc:290] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:52.648790  6678 raft_consensus.cc:515] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:52.693487  6678 leader_election.cc:290] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:52.693974  6762 raft_consensus.cc:2749] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:52.701575  1539 leader_election.cc:304] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:52.710264  2331 raft_consensus.cc:2468] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 11.
I20260709 13:00:52.706982  1615 leader_election.cc:304] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:52.712873  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:52.713515  1716 raft_consensus.cc:2468] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 14.
I20260709 13:00:52.713752  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:52.714315  1648 raft_consensus.cc:3060] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:52.719419  1722 raft_consensus.cc:2468] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 14.
I20260709 13:00:52.678231  6343 raft_consensus.cc:2749] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:52.730966  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
W20260709 13:00:52.732476  2327 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:53306 (request call id 818) took 1267 ms (client timeout 1645 ms). Trace:
I20260709 13:00:52.734956  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 13:00:52.734875  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 77612.3us
I20260709 13:00:52.735868  2331 raft_consensus.cc:2393] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 11: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
W20260709 13:00:52.735932  1542 leader_election.cc:336] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.103s (SENT)
I20260709 13:00:52.736443  1542 leader_election.cc:304] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
W20260709 13:00:52.735141  2327 rpcz_store.cc:269] 0709 13:00:51.465271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.465400 (+   129us) service_pool.cc:224] Handling call
0709 13:00:52.732285 (+1266885us) spinlock_profiling.cc:243] Waited 424 ms on lock 0x7b54006c66d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:52.732425 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":975839488}
I20260709 13:00:52.666561  6792 consensus_queue.cc:1048] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.069s
I20260709 13:00:52.723960  6762 raft_consensus.cc:2804] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:00:52.682637  6676 raft_consensus.cc:515] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:52.758072  1648 raft_consensus.cc:2468] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 16.
I20260709 13:00:52.712587  6301 consensus_queue.cc:1048] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
W20260709 13:00:52.775074  6784 log.cc:927] Time spent T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
W20260709 13:00:52.779706  6753 consensus_meta.cc:287] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.591s	user 0.005s	sys 0.002s
I20260709 13:00:52.780289  6794 raft_consensus.cc:2749] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:52.745010  6793 raft_consensus.cc:2804] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:00:52.771344  6686 consensus_meta.cc:287] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.514s	user 0.007s	sys 0.003s
I20260709 13:00:52.731714  6573 consensus_queue.cc:1048] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 13:00:52.727085  6654 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:52.714258  6710 consensus_queue.cc:260] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:52.781003  6785 log.cc:927] Time spent T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.237s	user 0.001s	sys 0.000s
I20260709 13:00:52.734262  6759 raft_consensus.cc:515] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:52.783886  6694 leader_election.cc:290] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:52.796887  1723 raft_consensus.cc:2468] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 10.
I20260709 13:00:52.801905  6383 raft_consensus.cc:515] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:52.788959  6762 raft_consensus.cc:697] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:52.804798  6795 raft_consensus.cc:2804] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:52.715082  6774 consensus_queue.cc:237] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:52.782258  6343 raft_consensus.cc:2749] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:00:52.812148  6732 consensus_meta.cc:287] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.591s	user 0.000s	sys 0.007s
I20260709 13:00:52.813685  6676 leader_election.cc:290] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:52.814122  6744 leader_election.cc:290] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:52.818043  1573 raft_consensus.cc:1240] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:52.818835  1474 catalog_manager.cc:5697] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:00:52.819730  6654 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 17 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:52.744513  6756 raft_consensus.cc:493] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:52.846998  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:52.723620  6633 consensus_queue.cc:237] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:52.792698  6793 raft_consensus.cc:493] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:52.861739  1648 raft_consensus.cc:2468] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 12.
I20260709 13:00:52.853338  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:52.754462  6752 consensus_queue.cc:237] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:52.862828  1642 raft_consensus.cc:2393] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 14: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
W20260709 13:00:52.863897  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.846545  6710 raft_consensus.cc:3060] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:52.765559  6693 consensus_queue.cc:237] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:52.892881  1569 raft_consensus.cc:1275] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:00:52.889931  1688 leader_election.cc:304] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:52.894412  1474 catalog_manager.cc:5697] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:00:52.898218  1569 raft_consensus.cc:1275] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 13:00:52.900739  1469 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55606 (request call id 271) took 46256 ms (client timeout 15000 ms). Trace:
I20260709 13:00:52.859814  6795 raft_consensus.cc:697] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 14 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:52.794750  6753 raft_consensus.cc:515] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:52.839183  6761 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:52.865267  6793 raft_consensus.cc:3060] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:52.925721  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:52.926008  1645 raft_consensus.cc:1240] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:52.926487  1716 raft_consensus.cc:3060] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:52.860142  6732 raft_consensus.cc:515] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:52.865003  6660 raft_consensus.cc:515] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:52.884811  6756 raft_consensus.cc:515] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:52.932895  1567 raft_consensus.cc:2468] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 14.
I20260709 13:00:52.966719  1724 raft_consensus.cc:1240] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:52.935364  6383 leader_election.cc:290] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:52.931536  6794 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:52.941967  1474 catalog_manager.cc:5697] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 7 to 9, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 9 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:52.982980  1716 raft_consensus.cc:2468] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 9.
W20260709 13:00:52.986990  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 87007.6us
W20260709 13:00:52.988924  1542 leader_election.cc:336] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.166s (SENT)
I20260709 13:00:52.913667  6651 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:52.989480  1542 leader_election.cc:304] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:52.992645  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:00:52.993396  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:52.992309  1474 catalog_manager.cc:5697] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:52.993816  1716 raft_consensus.cc:2410] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 for term 13 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 13:00:52.991384  6686 raft_consensus.cc:2804] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:52.994297  6795 consensus_queue.cc:237] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:53.002859  6799 log.cc:927] Time spent T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:00:52.989677  6760 leader_election.cc:290] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:53.009829  6732 leader_election.cc:290] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:53.011591  6759 leader_election.cc:290] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:00:52.990124  6734 consensus_queue.cc:1175] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4dbe7d47a2374afca075d3a98583b49e" responder_term: 14 status { last_received { term: 13 index: 10 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 13. Current term is 14. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:00:53.014192  6651 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 14 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:52.991933  6794 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:53.022977  6794 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:53.024436  6678 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.025010  6678 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:53.025964  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 13:00:53.004338  6601 consensus_meta.cc:287] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.604s	user 0.005s	sys 0.004s
I20260709 13:00:53.026917  6601 raft_consensus.cc:515] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:52.924719  6762 consensus_queue.cc:237] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:53.030089  6761 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:53.030309  1650 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45148 (request call id 2594) took 1757 ms (client timeout 1969 ms). Trace:
W20260709 13:00:53.030768  1650 rpcz_store.cc:269] 0709 13:00:51.273306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:51.277997 (+  4691us) service_pool.cc:224] Handling call
0709 13:00:53.030124 (+1752127us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54003cee54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:53.030251 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2752541440}
I20260709 13:00:53.031194  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:53.013764  1474 catalog_manager.cc:5697] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:00:53.039111  1689 leader_election.cc:304] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:00:52.901419  1469 rpcz_store.cc:269] 0709 13:00:06.632321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:06.646051 (+ 13730us) service_pool.cc:224] Handling call
0709 13:00:52.887156 (+46241105us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:48.706653 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:48.743431 (+ 36778us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:48.750311 (+  6880us) write_op.cc:435] Acquired schema lock
0709 13:00:48.762439 (+ 12128us) tablet.cc:662] Decoding operations
0709 13:00:48.763289 (+   850us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:48.763436 (+   147us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:48.763471 (+    35us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:00:48.764238 (+   767us) tablet.cc:701] Row locks acquired
0709 13:00:48.764293 (+    55us) write_op.cc:260] PREPARE: finished
0709 13:00:48.764520 (+   227us) write_op.cc:270] Start()
0709 13:00:48.764738 (+   218us) write_op.cc:276] Timestamp: P: 1783602048764443 usec, L: 0
0709 13:00:48.764788 (+    50us) op_driver.cc:348] REPLICATION: starting
0709 13:00:48.845008 (+ 80220us) log.cc:844] Serialized 2094 byte log entry
0709 13:00:49.302767 (+457759us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b4400022b4c. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef1f4c85 00007fa9ef1f56a2 00007fa9f1f671db 00007fa9f1f62aaf 00007fa9ef2b10ac 00007fa9f810bab9 00007fa9ef2cd69b 00007fa9ef2cb93f 00007fa9ef2cdc02 00007fa9f1f5520b
0709 13:00:49.950027 (+647260us) op_driver.cc:464] REPLICATION: finished
0709 13:00:50.164297 (+214270us) write_op.cc:301] APPLY: starting
0709 13:00:50.164494 (+   197us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:50.433312 (+268818us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:50.447602 (+ 14290us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:50.661310 (+213708us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:50.702173 (+ 40863us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=10,mrs_lookups=0
0709 13:00:50.707063 (+  4890us) write_op.cc:312] APPLY: finished
0709 13:00:50.744799 (+ 37736us) log.cc:844] Serialized 57 byte log entry
0709 13:00:50.744985 (+   186us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:50.745095 (+   110us) write_op.cc:454] Released schema lock
0709 13:00:50.745153 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:50.745581 (+   428us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:50.745608 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":15561,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":156768,"apply.run_cpu_time_us":11779,"apply.run_wall_time_us":616082,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25027,"num_ops":5,"prepare.queue_time_us":571405,"prepare.run_cpu_time_us":32734,"prepare.run_wall_time_us":737491,"raft.queue_time_us":81819,"raft.run_cpu_time_us":30461,"raft.run_wall_time_us":122786,"replication_time_us":1163991,"spinlock_wait_cycles":28846976,"thread_start_us":895541,"threads_started":4,"wal-append.queue_time_us":521286,"wal-append.run_cpu_time_us":25243,"wal-append.run_wall_time_us":2342937}]]}
I20260709 13:00:53.043566  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:53.045318  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:53.047259  6652 raft_consensus.cc:493] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.048709  6694 raft_consensus.cc:2749] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:53.049832  2327 raft_consensus.cc:1275] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:00:53.052390  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:53.053107  1716 raft_consensus.cc:3060] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:53.055646  6601 leader_election.cc:290] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:53.055869  6652 raft_consensus.cc:515] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:53.057437  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:53.058274  1718 raft_consensus.cc:2393] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 9: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:53.059033  6652 leader_election.cc:290] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:53.059159  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:53.060078  1718 raft_consensus.cc:2393] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 14: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:53.052560  1474 catalog_manager.cc:5697] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:00:53.061442  1689 leader_election.cc:304] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:53.038826  6761 raft_consensus.cc:2749] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:53.082592  2328 raft_consensus.cc:2468] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 14.
W20260709 13:00:53.082836  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 93908.5us
I20260709 13:00:53.085000  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 13:00:53.086643  2295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.085978  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:53.090051  1718 raft_consensus.cc:2410] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:00:53.090821  1540 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:53.084673  6573 consensus_queue.cc:1048] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 13:00:53.091670  1474 catalog_manager.cc:5697] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 7 to 10, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 10 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:53.097173  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:53.098073  1722 raft_consensus.cc:2393] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 12: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:53.098465  6715 raft_consensus.cc:3055] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:53.098871  6715 raft_consensus.cc:740] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:53.099043  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:53.101517  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:53.101871  1689 leader_election.cc:400] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 election: Vote denied by peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373) with higher term. Message: Invalid argument: T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 7. Current term is 8.
I20260709 13:00:53.102423  1725 raft_consensus.cc:2393] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 11: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:53.102880  1689 leader_election.cc:304] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:53.103541  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:53.098151  1474 catalog_manager.cc:5697] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:00:53.100306  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:53.107170  1725 raft_consensus.cc:2410] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:00:53.110818  1542 leader_election.cc:304] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:53.105712  1474 catalog_manager.cc:5697] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 4 to 5, leader changed from 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 5 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:00:53.113197  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:53.114001  1569 raft_consensus.cc:3060] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:53.115352  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:53.115958  1568 raft_consensus.cc:3060] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:53.116066  1722 raft_consensus.cc:1240] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:53.116271  1718 raft_consensus.cc:1240] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:53.117538  1542 leader_election.cc:304] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:53.120235  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:53.121138  1572 raft_consensus.cc:3060] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:53.120309  1716 raft_consensus.cc:2468] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 11.
I20260709 13:00:53.129287  1722 raft_consensus.cc:1275] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 13:00:53.125223  1725 raft_consensus.cc:1275] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:00:53.126279  1716 raft_consensus.cc:1275] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:00:53.132467  6797 raft_consensus.cc:2749] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:53.132825  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:53.133595  1574 raft_consensus.cc:3060] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:53.123816  6794 raft_consensus.cc:2749] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:53.085429  6757 raft_consensus.cc:2804] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:53.117616  6267 raft_consensus.cc:2804] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:53.143031  1568 raft_consensus.cc:2468] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 9.
I20260709 13:00:53.144711  6759 raft_consensus.cc:2764] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:00:53.146000  1542 leader_election.cc:304] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:53.129772  1722 pending_rounds.cc:85] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4: Aborting all ops after (but not including) 9
I20260709 13:00:53.148473  1722 pending_rounds.cc:107] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:00:53.148866  1722 raft_consensus.cc:2889] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:53.151034  6267 raft_consensus.cc:697] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:53.099808  6715 consensus_queue.cc:260] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:53.152136  6267 consensus_queue.cc:237] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:53.153376  6715 raft_consensus.cc:3060] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:53.153100  6793 raft_consensus.cc:515] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:53.154855  6756 leader_election.cc:290] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:53.155375  6793 leader_election.cc:290] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:53.155925  1569 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 14.
I20260709 13:00:53.155987  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:53.129307  6812 consensus_queue.cc:1048] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 13:00:53.159235  1721 raft_consensus.cc:2393] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 8: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 13:00:53.160899  1689 leader_election.cc:304] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:53.161173  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:53.158347  1572 raft_consensus.cc:2468] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 13.
I20260709 13:00:53.162007  1719 raft_consensus.cc:2393] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 13: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:53.162896  6815 raft_consensus.cc:2764] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260709 13:00:53.163949  6660 leader_election.cc:290] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:53.085563  6652 consensus_queue.cc:1048] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
W20260709 13:00:53.215534  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 54697.5us
I20260709 13:00:53.217764  1689 leader_election.cc:304] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
W20260709 13:00:53.221127  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 75233.7us
I20260709 13:00:53.222939  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:00:53.224763  1542 leader_election.cc:336] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.019s (SENT)
I20260709 13:00:53.225154  1542 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:53.229725  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 13:00:53.221905  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 51092.2us
W20260709 13:00:53.240288  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 249541us
I20260709 13:00:53.242771  1689 leader_election.cc:304] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 13:00:53.243211  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:53.244195  1569 raft_consensus.cc:2393] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 14: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:53.229285  6759 raft_consensus.cc:2749] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:00:53.231456  6716 consensus_meta.cc:287] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.733s	user 0.009s	sys 0.002s
I20260709 13:00:53.246127  1569 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5"
dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
mode: GRACEFUL
new_leader_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:49396
I20260709 13:00:53.245968  6716 raft_consensus.cc:515] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:53.246762  1569 raft_consensus.cc:606] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Received request to transfer leadership to TS 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:53.247136  1569 raft_consensus.cc:614] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:00:53.248342   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:00:53.248719  6716 leader_election.cc:290] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:53.249533  1569 raft_consensus.cc:1240] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:00:53.250161   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:00:53.251502  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:53.252928  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:53.253571  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:53.254112  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:53.254688  1651 raft_consensus.cc:3060] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:53.254995  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:53.257933  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:53.258499  1646 raft_consensus.cc:3060] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:53.258944  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:53.259511  1568 raft_consensus.cc:2468] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 12.
I20260709 13:00:53.218751  6732 raft_consensus.cc:2749] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:53.254112  1569 raft_consensus.cc:3060] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:53.261834  1615 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.262770  1574 raft_consensus.cc:2468] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 17.
I20260709 13:00:53.268067  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:53.269896  1649 raft_consensus.cc:3060] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:53.273310  1651 raft_consensus.cc:2468] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 13.
I20260709 13:00:53.275749  6732 raft_consensus.cc:2764] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 13:00:53.269755  2295 leader_election.cc:304] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:53.280623  1646 raft_consensus.cc:2468] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 17.
I20260709 13:00:53.229600  6794 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:53.238688  6797 raft_consensus.cc:2804] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:53.285629  1569 raft_consensus.cc:2468] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 13.
I20260709 13:00:53.238013  6573 raft_consensus.cc:2749] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:53.289347  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:53.290426  1615 leader_election.cc:304] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:53.307690  1574 raft_consensus.cc:2393] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 12: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:53.302603  2324 raft_consensus.cc:1275] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:00:53.312474  2294 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:53.316764  1569 raft_consensus.cc:1275] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:00:53.318017  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.311708  1615 leader_election.cc:304] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:53.312719  2295 leader_election.cc:304] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 13:00:53.324605  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 83778.5us
I20260709 13:00:53.333714  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:53.336001  2328 raft_consensus.cc:3060] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:53.345356  2295 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:53.308161  6797 raft_consensus.cc:493] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:53.327019  6716 raft_consensus.cc:2804] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:53.373294  6716 raft_consensus.cc:493] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.375308  6716 raft_consensus.cc:3060] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:53.311333  6794 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:53.373062  6601 consensus_queue.cc:1048] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:00:53.350584  6651 raft_consensus.cc:2804] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:53.381189  6651 raft_consensus.cc:697] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:53.382120  6651 consensus_queue.cc:237] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:53.385459  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:53.386142  1717 raft_consensus.cc:3060] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:53.350392  6676 raft_consensus.cc:2804] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:00:53.350926  6707 raft_consensus.cc:2804] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:53.349295  6660 raft_consensus.cc:2804] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:53.352694  6677 raft_consensus.cc:2804] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:53.399233  1649 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 14.
I20260709 13:00:53.347803  6793 raft_consensus.cc:493] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:53.357863  6797 raft_consensus.cc:3060] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:53.403797  2328 raft_consensus.cc:2468] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 8.
W20260709 13:00:53.408746  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 166059us
I20260709 13:00:53.401465  6677 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:53.416956  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 70619us
I20260709 13:00:53.419399  1615 leader_election.cc:304] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:53.421901  6812 consensus_queue.cc:1048] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:00:53.421315  6715 raft_consensus.cc:2804] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:53.426421  6794 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:53.426218  6715 raft_consensus.cc:697] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 8 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:53.427453  6715 consensus_queue.cc:237] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:53.431496  6716 raft_consensus.cc:515] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:53.432551  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.410422  6793 raft_consensus.cc:515] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:53.413451  6660 raft_consensus.cc:697] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 13 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:53.436020  6793 leader_election.cc:290] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:53.420362  6677 raft_consensus.cc:3060] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:53.441027  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:53.435483  6660 consensus_queue.cc:237] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:53.441823  2324 raft_consensus.cc:2393] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 11: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:53.444790  1573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36642 (request call id 2657) took 1286 ms. Trace:
I20260709 13:00:53.446753  1573 rpcz_store.cc:276] 0709 13:00:52.159540 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.378881 (+219341us) service_pool.cc:224] Handling call
0709 13:00:52.817855 (+438974us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:52.856845 (+ 38990us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.444610 (+587765us) spinlock_profiling.cc:243] Waited 439 ms on lock 0x7b54002eb3d0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23ba8ad 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:53.444734 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1008737152}
I20260709 13:00:53.412976  6676 raft_consensus.cc:697] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:53.452252  1645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 2048) took 1299 ms. Trace:
I20260709 13:00:53.454233  1645 rpcz_store.cc:276] 0709 13:00:52.151460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.151621 (+   161us) service_pool.cc:224] Handling call
0709 13:00:52.151916 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:52.926480 (+774564us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.450165 (+523685us) spinlock_profiling.cc:243] Waited 774 ms on lock 0x7b54002d96d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:53.450321 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1779706112}
W20260709 13:00:53.456637  6814 log.cc:927] Time spent T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.320s	user 0.003s	sys 0.000s
I20260709 13:00:53.457377  6716 leader_election.cc:290] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:53.451716  6707 raft_consensus.cc:697] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:53.461874  6676 consensus_queue.cc:237] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:53.462812  6677 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:53.463191  6707 consensus_queue.cc:237] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:53.464931  6677 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 15 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:53.414821  1689 leader_election.cc:304] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:53.468318  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:53.469141  1645 raft_consensus.cc:3060] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:00:53.475214  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:53.485380  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 131110us
I20260709 13:00:53.488880  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
W20260709 13:00:53.490980  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 77006.5us
I20260709 13:00:53.491323  1649 raft_consensus.cc:1240] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:53.475626  6684 raft_consensus.cc:2749] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:53.492440  1689 leader_election.cc:304] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:53.493479  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:53.497464  1645 raft_consensus.cc:2468] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 15.
I20260709 13:00:53.501247  6797 raft_consensus.cc:515] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:53.509081  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:53.521292  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.510807  1649 raft_consensus.cc:1240] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:00:53.521864  1689 leader_election.cc:304] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:53.522878  6684 raft_consensus.cc:2749] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:00:53.526882  1650 raft_consensus.cc:1275] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:00:53.527650  1724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 1994) took 1049 ms. Trace:
I20260709 13:00:53.528505  1648 raft_consensus.cc:1240] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 8 LEADER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:53.542119  6753 leader_election.cc:290] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:00:53.545251  6787 log.cc:927] Time spent T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.864s	user 0.003s	sys 0.000s
I20260709 13:00:53.545418  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:53.548466  1649 raft_consensus.cc:1240] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 13 LEADER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:53.549924  1723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1978) took 1111 ms. Trace:
I20260709 13:00:53.550287  1723 rpcz_store.cc:276] 0709 13:00:52.438913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.452211 (+ 13298us) service_pool.cc:224] Handling call
0709 13:00:53.549775 (+1097564us) spinlock_profiling.cc:243] Waited 344 ms on lock 0x7b5400353254. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:53.549868 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":790146304}
I20260709 13:00:53.552817  6797 leader_election.cc:290] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:53.520339  1717 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 13.
I20260709 13:00:53.553752  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 1984) took 1099 ms. Trace:
I20260709 13:00:53.556284  1569 raft_consensus.cc:1275] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:00:53.556849  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:53.557440  1568 raft_consensus.cc:3060] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:53.550588  1574 raft_consensus.cc:1275] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:00:53.561394  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:53.570019  1649 raft_consensus.cc:2368] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 11. Current term is 12.
I20260709 13:00:53.528055  1724 rpcz_store.cc:276] 0709 13:00:52.478359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.530367 (+ 52008us) service_pool.cc:224] Handling call
0709 13:00:52.530746 (+   379us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:52.967271 (+436525us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:53.527400 (+560129us) spinlock_profiling.cc:243] Waited 436 ms on lock 0x7b5400203d54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:53.527589 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1002142976}
I20260709 13:00:53.554111  1717 rpcz_store.cc:276] 0709 13:00:52.454613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.355049 (+900436us) service_pool.cc:224] Handling call
0709 13:00:53.553693 (+198644us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:53.571735  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:53.558439  6644 raft_consensus.cc:3060] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:00:53.587396  2295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:53.590466  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 68673.4us
I20260709 13:00:53.591390  2294 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:53.593533  1688 leader_election.cc:400] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 election: Vote denied by peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391) with higher term. Message: Invalid argument: T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 11. Current term is 12.
I20260709 13:00:53.593830  1688 leader_election.cc:403] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:00:53.598289  1568 raft_consensus.cc:2468] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 13.
I20260709 13:00:53.574337  6660 consensus_queue.cc:1048] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:00:53.589280  6723 raft_consensus.cc:2749] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:53.589859  6728 raft_consensus.cc:493] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.605770  2294 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:53.622541  1689 leader_election.cc:304] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:53.589706  6710 consensus_queue.cc:1059] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:00:53.592305  6684 consensus_queue.cc:1059] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:00:53.601233  6732 consensus_queue.cc:1059] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:00:53.607004  6601 raft_consensus.cc:2804] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:53.613209  6797 raft_consensus.cc:3060] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:53.594432  6713 consensus_queue.cc:1048] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 13:00:53.604291  6669 consensus_queue.cc:1048] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 13:00:53.629379  6832 raft_consensus.cc:2804] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:53.612461  6826 consensus_queue.cc:1059] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:00:53.658289  6723 raft_consensus.cc:3055] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:00:53.655759  6710 raft_consensus.cc:2749] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:00:53.660375  6834 log.cc:927] Time spent T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:00:53.665005  6803 raft_consensus.cc:493] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:53.705597  6803 raft_consensus.cc:515] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:53.707438  1691 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.707671  6803 leader_election.cc:290] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:53.665683  6656 raft_consensus.cc:493] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:53.620702  6728 raft_consensus.cc:515] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:53.708808  6656 raft_consensus.cc:515] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:53.710355  6728 leader_election.cc:290] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:53.711447  6656 leader_election.cc:290] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:53.672814  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.676281  6797 raft_consensus.cc:2749] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391) with higher term. Message: Invalid argument: T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 11. Current term is 12.
I20260709 13:00:53.713769  6686 raft_consensus.cc:493] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:53.714258  6686 raft_consensus.cc:3060] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:53.714567  2297 leader_election.cc:304] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:53.678249  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37682 (request call id 1346) took 1341 ms. Trace:
W20260709 13:00:53.681762  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.686206  6757 raft_consensus.cc:493] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:53.686832  2329 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 10.
I20260709 13:00:53.700667  6601 raft_consensus.cc:697] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
W20260709 13:00:53.714612  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.719015  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:53.717546  1567 rpcz_store.cc:276] 0709 13:00:52.336852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:52.345866 (+  9014us) service_pool.cc:224] Handling call
0709 13:00:53.678069 (+1332203us) spinlock_profiling.cc:243] Waited 511 ms on lock 0x7b5400245754. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:53.678183 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1175421824}
I20260709 13:00:53.722237  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:53.738724  1717 raft_consensus.cc:3060] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:53.740258  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:53.740890  1571 raft_consensus.cc:2468] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 9.
I20260709 13:00:53.700879  6723 raft_consensus.cc:740] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
W20260709 13:00:53.701949  6787 log.cc:927] Time spent T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:00:53.668375  6678 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:53.743427  2326 raft_consensus.cc:2393] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 13: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:53.657061  6732 consensus_queue.cc:1243] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer 4dbe7d47a2374afca075d3a98583b49e log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:00:53.742558  6723 consensus_queue.cc:260] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:53.757202  1724 raft_consensus.cc:1275] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:00:53.703240  6832 raft_consensus.cc:697] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:53.737428  6757 raft_consensus.cc:3060] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:53.722009  6826 consensus_queue.cc:1243] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer 4dbe7d47a2374afca075d3a98583b49e log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:00:53.758864  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:53.763897  1567 raft_consensus.cc:1275] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:00:53.737627  6747 raft_consensus.cc:2749] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:00:53.764906  1615 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.737568  6694 raft_consensus.cc:493] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
W20260709 13:00:53.765748  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 154896us
I20260709 13:00:53.768392  1717 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 14.
I20260709 13:00:53.787155  1717 raft_consensus.cc:1275] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:00:53.771826  6723 raft_consensus.cc:3060] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:00:53.789249  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 166790us
I20260709 13:00:53.792188  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:53.788631  6660 raft_consensus.cc:493] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.804103  1722 raft_consensus.cc:2468] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 9.
I20260709 13:00:53.797087  6826 raft_consensus.cc:493] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.795589  6790 raft_consensus.cc:493] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.810904  1689 leader_election.cc:304] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:53.823818  2297 leader_election.cc:304] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 13:00:53.782910  6694 raft_consensus.cc:515] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:53.786629  6656 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:53.826355  1689 leader_election.cc:304] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:53.831990  1689 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:53.817150  6728 consensus_queue.cc:1048] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:00:53.828874  6790 raft_consensus.cc:515] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:53.823226  6593 consensus_queue.cc:1048] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:00:53.816908  6660 raft_consensus.cc:515] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:53.827942  6831 raft_consensus.cc:2804] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:53.830307  6684 raft_consensus.cc:2804] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:53.807299  6601 consensus_queue.cc:237] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:53.834015  6732 raft_consensus.cc:2749] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:53.815608  6832 consensus_queue.cc:237] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:53.831976  6656 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:53.875283  6656 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:53.877326  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:53.838264  1689 leader_election.cc:304] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:53.877998  1567 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 9.
I20260709 13:00:53.878750  1689 leader_election.cc:304] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:53.878957  6713 raft_consensus.cc:3055] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:00:53.879402  6713 raft_consensus.cc:740] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:53.880718  6684 raft_consensus.cc:697] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 8 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:53.857671  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:53.881230  6734 raft_consensus.cc:2804] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:00:53.881675  1645 raft_consensus.cc:2393] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 12: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:53.881774  6734 raft_consensus.cc:697] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 7 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
W20260709 13:00:53.883791  1542 leader_election.cc:336] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.631s (SENT)
I20260709 13:00:53.884220  1542 leader_election.cc:304] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:53.884918  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:53.884987  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:53.885154  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:53.885669  1651 raft_consensus.cc:2368] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 14. Current term is 15.
I20260709 13:00:53.886389  1689 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:53.825275  6826 raft_consensus.cc:515] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:53.877512  6704 raft_consensus.cc:3055] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:00:53.886515  1649 raft_consensus.cc:1275] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:00:53.858544  1643 raft_consensus.cc:1217] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 8 LEADER]: Deduplicated request from leader. Original: 5.7->[7.8-7.8]   Dedup: 7.8->[]
I20260709 13:00:53.896426  1643 raft_consensus.cc:1240] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 8 LEADER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:00:53.853574  6845 raft_consensus.cc:2804] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:53.888257  1539 leader_election.cc:304] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:53.850453  6694 leader_election.cc:290] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:53.891216  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:53.891844  1569 raft_consensus.cc:1275] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:00:53.897610  1650 raft_consensus.cc:2393] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 12: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
W20260709 13:00:53.888499  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:53.897500  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:53.903402  1643 raft_consensus.cc:2393] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 11: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:53.906013  1643 raft_consensus.cc:1275] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:00:53.898463  6704 raft_consensus.cc:740] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:53.909183  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:53.909798  2324 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 10.
I20260709 13:00:53.909574  6704 consensus_queue.cc:260] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:53.910547  6704 raft_consensus.cc:3060] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:53.911268  6793 consensus_queue.cc:1048] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:00:53.880194  6713 consensus_queue.cc:260] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:53.912909  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:53.913527  6713 raft_consensus.cc:3060] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:53.913587  1646 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 9.
I20260709 13:00:53.914333  1650 raft_consensus.cc:1240] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:53.881678  6684 consensus_queue.cc:237] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:53.916450  6803 raft_consensus.cc:2804] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:00:53.917042  6803 raft_consensus.cc:697] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:53.917917  6803 consensus_queue.cc:237] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:53.918594  6826 leader_election.cc:290] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:53.919575  6686 raft_consensus.cc:515] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:53.898001  6708 raft_consensus.cc:2804] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:53.898694  6845 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.922946  6845 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:53.865000  6831 raft_consensus.cc:493] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:53.923720  1717 raft_consensus.cc:1240] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:53.907681  1615 leader_election.cc:304] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:53.929968  2328 raft_consensus.cc:1240] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 LEADER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:53.895684  6774 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
W20260709 13:00:53.966110  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 79795.4us
W20260709 13:00:53.967041  1617 leader_election.cc:336] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.948s (SENT)
I20260709 13:00:53.980830  6708 raft_consensus.cc:697] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 11 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:53.965939  6734 consensus_queue.cc:237] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:53.982280  6694 raft_consensus.cc:493] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.921664  6686 leader_election.cc:290] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:53.963007  6831 raft_consensus.cc:3060] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:53.898147  6676 raft_consensus.cc:493] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:53.991222  1689 leader_election.cc:304] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 13:00:53.986865  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 79295.8us
I20260709 13:00:54.017318  1568 raft_consensus.cc:1275] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:00:54.018002  1539 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:53.931569  6732 consensus_queue.cc:1048] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 13:00:53.992627  6774 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:54.022135  1539 leader_election.cc:400] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 election: Vote denied by peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391) with higher term. Message: Invalid argument: T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 14. Current term is 15.
I20260709 13:00:54.021519  1689 leader_election.cc:400] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373) with higher term. Message: Invalid argument: T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 15. Current term is 16.
I20260709 13:00:53.995466  6802 raft_consensus.cc:2804] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:53.984318  6848 raft_consensus.cc:2749] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:54.027314  1615 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:54.022491  6686 raft_consensus.cc:2804] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:54.057298  1689 leader_election.cc:304] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:54.024266  6267 raft_consensus.cc:2749] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:54.022255  6383 consensus_queue.cc:1048] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:00:54.049209  6651 raft_consensus.cc:493] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.069759  6651 raft_consensus.cc:515] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:54.057945  6802 raft_consensus.cc:697] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 13 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:54.015539  6676 raft_consensus.cc:515] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:54.007395  6694 raft_consensus.cc:515] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:54.068415  1689 leader_election.cc:304] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:54.053210  6573 consensus_queue.cc:1048] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 13:00:53.962618  6760 consensus_queue.cc:1059] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
W20260709 13:00:54.138216  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 69883.3us
I20260709 13:00:54.020027  6821 consensus_queue.cc:1048] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:00:54.142515  1689 leader_election.cc:304] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:54.092489  6601 raft_consensus.cc:493] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.074431  6832 raft_consensus.cc:493] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.075642  6848 raft_consensus.cc:2749] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:54.089000  6751 raft_consensus.cc:2804] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:54.086261  6686 raft_consensus.cc:697] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 9 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:54.150997  6790 leader_election.cc:290] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:00:54.151521  6859 log.cc:927] Time spent T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
I20260709 13:00:54.148507  6601 raft_consensus.cc:515] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:54.153790  6774 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:54.155692  6383 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:54.156044  6832 raft_consensus.cc:515] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:54.167042  6383 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:54.145820  6826 raft_consensus.cc:2804] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:54.169090  6826 raft_consensus.cc:697] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 11 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:54.169682  6383 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:54.156922  6660 leader_election.cc:290] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:54.157908  6694 leader_election.cc:290] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:54.094574  6794 raft_consensus.cc:2749] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:54.171690  6601 leader_election.cc:290] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:54.168361  6832 leader_election.cc:290] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:54.180337  6802 consensus_queue.cc:237] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:54.182453  6860 log.cc:927] Time spent T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260709 13:00:54.170012  6826 consensus_queue.cc:237] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:54.150343  6751 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:54.186285  6651 leader_election.cc:290] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:54.160398  6684 raft_consensus.cc:2804] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:00:54.192198  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:00:54.210680  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 177454us
I20260709 13:00:54.218412  1724 raft_consensus.cc:1275] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:54.219323  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:54.219511  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:54.220081  1568 raft_consensus.cc:2468] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 8.
I20260709 13:00:54.088124  6708 consensus_queue.cc:237] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:54.223367  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 196136us
I20260709 13:00:54.226200  6803 consensus_queue.cc:1048] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:00:54.196805  6751 raft_consensus.cc:3060] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:54.230734  1568 raft_consensus.cc:1275] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:00:54.231458  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:54.235527  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:54.235742  1574 raft_consensus.cc:2468] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 13.
I20260709 13:00:54.241755  6821 consensus_queue.cc:1048] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:54.247818  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:00:54.285073  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:54.304425  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:54.304766  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:54.305347  1576 raft_consensus.cc:2468] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 7.
I20260709 13:00:54.306864  1575 raft_consensus.cc:1275] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:00:54.227697  6676 leader_election.cc:290] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:54.304352  1571 raft_consensus.cc:2468] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 11.
I20260709 13:00:54.230103  6684 raft_consensus.cc:697] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 11 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
W20260709 13:00:54.321203  1617 leader_election.cc:336] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.642s (SENT)
I20260709 13:00:54.322944  2295 leader_election.cc:304] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:54.208009  6757 raft_consensus.cc:515] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:54.229322  6651 consensus_queue.cc:1059] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.075s
I20260709 13:00:54.344301  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:54.304293  6704 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.316320  6760 raft_consensus.cc:493] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.365412  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:00:54.367473  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:54.370196  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 46002.3us
I20260709 13:00:54.348426  6728 raft_consensus.cc:2804] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:54.358366  6845 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:54.373768  6728 raft_consensus.cc:493] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:54.342267  6686 consensus_queue.cc:237] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:54.369772  6760 raft_consensus.cc:515] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:54.363314  6704 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:54.419729  1542 leader_election.cc:336] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.653s (SENT)
W20260709 13:00:54.417080  6866 log.cc:927] Time spent T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
I20260709 13:00:54.377246  6593 consensus_queue.cc:1048] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:00:54.393404  6728 raft_consensus.cc:3060] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:54.425853  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 212806us
I20260709 13:00:54.433976  1539 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:54.424098  6780 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.391220  6684 consensus_queue.cc:237] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:54.462764  6882 consensus_queue.cc:1059] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.012s
W20260709 13:00:54.481912  6858 log.cc:927] Time spent T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.422s	user 0.001s	sys 0.001s
W20260709 13:00:54.490090  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 119057us
I20260709 13:00:54.491274  2295 leader_election.cc:304] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:54.497967  1573 raft_consensus.cc:1275] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 17 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 13:00:54.500248  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 146022us
I20260709 13:00:54.461920  6762 raft_consensus.cc:2804] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:00:54.500833  6601 raft_consensus.cc:2804] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:00:54.502666  6757 leader_election.cc:290] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:54.460615  6780 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:54.504935  6762 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:54.500700  6832 consensus_queue.cc:1048] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:00:54.527647  6762 raft_consensus.cc:3060] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:54.520880  6886 consensus_queue.cc:1048] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:00:54.520128  6601 raft_consensus.cc:493] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:00:54.627755  1617 leader_election.cc:336] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.011s (SENT)
I20260709 13:00:54.652256  1617 leader_election.cc:304] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:00:54.692658  1542 leader_election.cc:336] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.927s (SENT)
I20260709 13:00:54.730852  2324 raft_consensus.cc:1275] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:00:54.551899  6601 raft_consensus.cc:3060] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:00:54.746162  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 230524us
I20260709 13:00:54.674279  6716 raft_consensus.cc:2749] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:00:54.762696  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:54.753017  6845 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:54.753320  6780 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:54.800006  6905 raft_consensus.cc:493] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.806895  6905 raft_consensus.cc:515] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:54.813313  6868 log.cc:927] Time spent T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.654s	user 0.005s	sys 0.010s
W20260709 13:00:54.814978  6883 log.cc:927] Time spent T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.306s	user 0.000s	sys 0.001s
I20260709 13:00:54.763453  6710 raft_consensus.cc:3055] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:54.796550  6660 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
W20260709 13:00:54.857079  6893 log.cc:927] Time spent T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:00:54.858927  6774 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:54.859613  6774 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:54.861398  6905 leader_election.cc:290] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:54.862142  6905 raft_consensus.cc:493] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:54.862870  6774 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:54.862711  6905 raft_consensus.cc:515] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:54.863215  6728 raft_consensus.cc:515] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:54.833663  6710 raft_consensus.cc:740] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:54.835512  6713 raft_consensus.cc:476] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 11 LEADER]: Not starting pre-election -- already a leader
I20260709 13:00:54.844738  6760 leader_election.cc:290] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:54.888880  6780 raft_consensus.cc:493] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:54.902372  6896 log.cc:927] Time spent T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:00:54.902174  6780 raft_consensus.cc:515] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:54.838248  6894 consensus_queue.cc:1048] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:00:54.904772  6780 leader_election.cc:290] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:54.845311  6892 consensus_queue.cc:1048] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260709 13:00:54.903421  6710 consensus_queue.cc:260] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:54.933300  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 108761us
I20260709 13:00:54.935141  1573 raft_consensus.cc:3055] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:00:54.935542  1573 raft_consensus.cc:740] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:54.936334  1573 consensus_queue.cc:260] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:54.902963  6905 leader_election.cc:290] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:54.871332  6660 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:54.974341  6267 raft_consensus.cc:3055] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:54.974862  6267 raft_consensus.cc:740] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:54.975137  6660 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:54.907086  6831 consensus_meta.cc:287] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.891s	user 0.011s	sys 0.000s
I20260709 13:00:54.978470  6836 raft_consensus.cc:3055] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:54.979025  6836 raft_consensus.cc:740] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
W20260709 13:00:54.964424  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:54.975956  6267 consensus_queue.cc:260] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:54.961808  2328 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32870 (request call id 708) took 1061 ms. Trace:
I20260709 13:00:54.956144  6750 raft_consensus.cc:493] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:54.972016  1573 raft_consensus.cc:3060] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:54.980053  6836 consensus_queue.cc:260] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:54.983171  6836 raft_consensus.cc:3060] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:54.958472  1617 leader_election.cc:336] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 3.042s (SENT)
I20260709 13:00:54.982661  6267 raft_consensus.cc:3060] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:54.989204  6753 raft_consensus.cc:493] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:54.989851  6753 raft_consensus.cc:515] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:54.991302  6751 consensus_meta.cc:287] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.745s	user 0.014s	sys 0.000s
I20260709 13:00:54.980013  6831 raft_consensus.cc:515] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:54.995021  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:54.996009  6831 leader_election.cc:290] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:54.984813  2328 rpcz_store.cc:276] 0709 13:00:53.892660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.892770 (+   110us) service_pool.cc:224] Handling call
0709 13:00:53.924471 (+ 31701us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:53.964763 (+ 40292us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:54.953553 (+988790us) spinlock_profiling.cc:243] Waited 5.23 ms on lock 0x7b54006c5a54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:54.953788 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":12025728}
I20260709 13:00:54.992149  6753 leader_election.cc:290] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:00:54.998835  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.017519  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:55.018208  1575 raft_consensus.cc:3060] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:55.018775  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:55.019212  1574 raft_consensus.cc:3060] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:55.042732  1573 raft_consensus.cc:1275] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 13:00:55.043637  1573 pending_rounds.cc:85] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting all ops after (but not including) 11
I20260709 13:00:55.043915  1573 pending_rounds.cc:107] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 13:00:55.044173  1573 raft_consensus.cc:2889] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:55.010787  6710 raft_consensus.cc:3060] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:55.012013  6684 raft_consensus.cc:493] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:55.012378  6713 raft_consensus.cc:493] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:54.982491  6750 raft_consensus.cc:515] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:54.993156  6751 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:55.089838  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:55.091740  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:55.075903  6728 leader_election.cc:290] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:00:55.106447  1542 leader_election.cc:336] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.882s (SENT)
I20260709 13:00:55.107048  1542 leader_election.cc:304] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
W20260709 13:00:55.107802  2297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.118889  1574 raft_consensus.cc:2468] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 10.
I20260709 13:00:55.135295  6845 raft_consensus.cc:493] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.137877  6845 raft_consensus.cc:515] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:55.141413  6845 leader_election.cc:290] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:55.133024  1575 raft_consensus.cc:2468] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 9.
I20260709 13:00:55.143683  6751 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:55.077140  6684 raft_consensus.cc:515] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:55.080443  6713 raft_consensus.cc:515] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:55.077800  6886 consensus_queue.cc:1048] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.074s
W20260709 13:00:55.160811  6865 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 1.008s	user 0.013s	sys 0.018s
W20260709 13:00:55.160512  6793 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.111s	user 0.020s	sys 0.016s
W20260709 13:00:55.185933  6865 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.033s	user 0.014s	sys 0.019s
I20260709 13:00:55.167050  6751 raft_consensus.cc:493] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
W20260709 13:00:55.195006  6762 consensus_meta.cc:287] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.656s	user 0.012s	sys 0.000s
W20260709 13:00:55.195402  6793 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.162s	user 0.021s	sys 0.016s
I20260709 13:00:55.196075  6601 raft_consensus.cc:515] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:55.214007  6751 raft_consensus.cc:515] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:55.240731  6713 leader_election.cc:290] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:55.243796  2328 raft_consensus.cc:2393] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 8: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
W20260709 13:00:55.242175  6901 log.cc:927] Time spent T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 13:00:55.216660  6762 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:55.251554  6762 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:55.254010  6684 leader_election.cc:290] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:55.260366  1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58782 (request call id 1333) took 1069 ms. Trace:
I20260709 13:00:55.260825  1720 rpcz_store.cc:276] 0709 13:00:54.190483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:54.190582 (+    99us) service_pool.cc:224] Handling call
0709 13:00:55.260150 (+1069568us) spinlock_profiling.cc:243] Waited 304 ms on lock 0x7b5400353754. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:55.260294 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":699567488}
W20260709 13:00:55.262950  1617 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.801s (SENT) [suppressed 32 similar messages]
W20260709 13:00:55.265475  6840 log.cc:927] Time spent T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 1.607s	user 0.007s	sys 0.010s
I20260709 13:00:55.246129  6750 leader_election.cc:290] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:55.268347  6601 leader_election.cc:290] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:00:55.278158  2297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.286109  6751 leader_election.cc:290] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:55.298269  1690 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:55.301523  1615 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.325014  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:55.325737  1651 raft_consensus.cc:2468] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 13.
I20260709 13:00:55.326486  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:55.326517  1642 raft_consensus.cc:1275] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:00:55.327188  1647 raft_consensus.cc:2468] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 16.
I20260709 13:00:55.327342  6793 raft_consensus.cc:493] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:55.327796  1650 raft_consensus.cc:1240] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 14. Current term is 15. Ops: [13.11-14.12]
I20260709 13:00:55.327992  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:55.328171  6915 raft_consensus.cc:493] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:55.328583  1646 raft_consensus.cc:2468] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8.
I20260709 13:00:55.327203  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:55.327214  1615 leader_election.cc:304] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:55.329293  1644 raft_consensus.cc:1240] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:55.329761  1645 raft_consensus.cc:2410] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:00:55.329761  6660 raft_consensus.cc:2804] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:55.330591  1615 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:55.330897  6660 raft_consensus.cc:493] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:55.331314  6660 raft_consensus.cc:3060] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:55.331715  1615 leader_election.cc:304] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:55.331857  6795 raft_consensus.cc:2749] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:00:55.332599  6795 raft_consensus.cc:2804] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:55.332943  6795 raft_consensus.cc:493] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:55.324123  6753 raft_consensus.cc:493] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.304831  6751 raft_consensus.cc:493] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:55.349542  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 13:00:55.359102  1617 leader_election.cc:336] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.503s (SENT)
I20260709 13:00:55.323138  6693 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:55.333278  6795 raft_consensus.cc:3060] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:55.342344  6708 raft_consensus.cc:493] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.404717  1617 leader_election.cc:304] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:55.399297  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:55.342182  6751 raft_consensus.cc:515] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:55.341728  6872 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:00:55.340516  6753 raft_consensus.cc:515] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:55.412719  1722 raft_consensus.cc:1275] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:00:55.412884  1724 raft_consensus.cc:1240] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:55.427335  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 13:00:55.418108  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 59053.3us
I20260709 13:00:55.327881  6793 raft_consensus.cc:515] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:55.416217  6826 raft_consensus.cc:493] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.328653  6915 raft_consensus.cc:515] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:55.439065  6704 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:55.422420  6708 raft_consensus.cc:515] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:55.445076  6708 leader_election.cc:290] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:55.445963   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:00:55.450152  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:55.450855  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:55.428066  6922 log.cc:927] Time spent T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.141s	user 0.001s	sys 0.000s
I20260709 13:00:55.422631  6786 raft_consensus.cc:2749] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:00:55.464044  6753 leader_election.cc:290] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:55.416700  6693 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:55.466079  6693 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:55.466825  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 360413us
I20260709 13:00:55.468689  6882 raft_consensus.cc:2749] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:55.469894  6915 leader_election.cc:290] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:55.469986  1542 leader_election.cc:336] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.925s (SENT)
I20260709 13:00:55.470474  1542 leader_election.cc:304] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:55.470525  6652 consensus_queue.cc:1048] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:00:55.471292  6905 raft_consensus.cc:2749] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:00:55.471659  1542 leader_election.cc:336] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.849s (SENT)
I20260709 13:00:55.472103  1542 leader_election.cc:304] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:55.473331  6703 raft_consensus.cc:493] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.473407  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:55.474336  2329 raft_consensus.cc:2410] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:00:55.457033  6904 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.474876  6904 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:55.430534  6660 raft_consensus.cc:515] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:55.477474  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:55.477757  6904 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:55.461046  6794 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:55.478295  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:55.478623  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:55.455780  6826 raft_consensus.cc:515] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:55.479275  2327 raft_consensus.cc:1240] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:55.480013  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:55.480379  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:55.473968  6703 raft_consensus.cc:515] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:55.457454  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 388785us
I20260709 13:00:55.482558  6703 leader_election.cc:290] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:00:55.483479  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.484133  2324 raft_consensus.cc:1240] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:55.485579  6803 raft_consensus.cc:493] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:55.486127  6803 raft_consensus.cc:515] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:55.478521  6794 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:55.485580  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.478296  2329 raft_consensus.cc:2410] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260709 13:00:55.487936  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
W20260709 13:00:55.488224  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 155437us
I20260709 13:00:55.463663  6793 leader_election.cc:290] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:55.490262  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:55.491281  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:55.491305  2332 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 10.
I20260709 13:00:55.492173  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:55.492641  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:55.493286  1574 raft_consensus.cc:2368] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 11. Current term is 12.
I20260709 13:00:55.493196  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:55.495462  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:55.496229  1573 raft_consensus.cc:2410] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:00:55.498304  1568 raft_consensus.cc:2468] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 12.
I20260709 13:00:55.499200  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:55.499676  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:55.500243  1576 raft_consensus.cc:2468] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 11.
I20260709 13:00:55.500759  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:55.502214  1576 raft_consensus.cc:1240] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 13:00:55.485839  6850 raft_consensus.cc:493] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:55.503822  1575 raft_consensus.cc:1275] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:00:55.504463  6915 consensus_queue.cc:1048] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:55.507701  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:55.526224  1572 raft_consensus.cc:2393] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 10: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:55.512712  6786 raft_consensus.cc:493] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.512953  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:55.513113  6826 leader_election.cc:290] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:55.513345  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:55.548436  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:55.513999  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:55.514184  6803 leader_election.cc:290] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:55.514456  1644 raft_consensus.cc:3060] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:55.552098  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:55.552269  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:55.515445  1645 raft_consensus.cc:3060] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:55.515365  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:55.512982  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:55.553465  1567 raft_consensus.cc:2468] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 8.
I20260709 13:00:55.554322  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:55.554867  1567 raft_consensus.cc:2468] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 15.
I20260709 13:00:55.548313  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:55.555794  1721 raft_consensus.cc:2393] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 13: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:55.517130  1647 raft_consensus.cc:3060] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:55.478468  6660 leader_election.cc:290] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:00:55.522658  2297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.557809  1649 raft_consensus.cc:2393] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 10: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:55.527155  1539 leader_election.cc:304] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:55.559580  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:55.530238  1575 raft_consensus.cc:1275] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:00:55.561362  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:55.562071  1575 raft_consensus.cc:3060] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:55.532334  2295 leader_election.cc:304] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:55.563879  2295 leader_election.cc:304] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:55.539408  1720 raft_consensus.cc:1240] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:55.566762  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:55.567481  1720 raft_consensus.cc:2376] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 12. Re-sending same reply.
I20260709 13:00:55.540308  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:55.540633  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:55.542096  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:55.544996  2332 raft_consensus.cc:1275] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:00:55.545857  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:55.547226  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:55.536548  1615 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:55.570334  1716 raft_consensus.cc:2393] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 12: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:55.550351  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:55.545017  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:55.514624  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:55.570919  1615 leader_election.cc:304] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:55.571801  1651 raft_consensus.cc:3060] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:55.516836  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:55.575397  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:55.575937  1650 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 10.
I20260709 13:00:55.585593  1725 raft_consensus.cc:2393] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 10: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:55.555720  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:55.502941  6267 raft_consensus.cc:2749] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:00:55.557780  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:55.590391  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:55.590626  1719 raft_consensus.cc:2376] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 14. Re-sending same reply.
I20260709 13:00:55.568519  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:55.591279  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:55.569518  1718 raft_consensus.cc:2468] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 15.
I20260709 13:00:55.574189  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:55.556865  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:55.592468  1539 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 13:00:55.592705  6693 raft_consensus.cc:2749] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:55.611802  1721 raft_consensus.cc:2410] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 16 because replica has last-logged OpId of term: 15 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
W20260709 13:00:55.601677  1617 leader_election.cc:336] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.676s (SENT)
I20260709 13:00:55.615484  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:55.618139  1649 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 14.
I20260709 13:00:55.589485  1645 raft_consensus.cc:1275] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:00:55.623906  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:55.542778  6713 raft_consensus.cc:493] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.625970  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:55.637655  1648 raft_consensus.cc:2468] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 12.
I20260709 13:00:55.592415  1722 raft_consensus.cc:2468] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 11.
I20260709 13:00:55.541054  6708 raft_consensus.cc:493] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:55.626017  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 123294us
I20260709 13:00:55.544342  6704 raft_consensus.cc:493] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.503398  6753 consensus_queue.cc:1048] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
W20260709 13:00:55.644152  1542 leader_election.cc:336] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.548s (SENT)
W20260709 13:00:55.643064  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 50707.9us
I20260709 13:00:55.646399  1539 leader_election.cc:304] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:55.647400  1647 raft_consensus.cc:1275] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:00:55.647614  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:55.630882  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:55.649821  1716 raft_consensus.cc:2468] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 10.
I20260709 13:00:55.633308  1651 raft_consensus.cc:2468] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 13.
I20260709 13:00:55.642063  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:55.653229  1575 raft_consensus.cc:2468] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 14.
I20260709 13:00:55.659890  1539 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:55.590430  6589 raft_consensus.cc:2804] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:00:55.661103  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:55.661274  6589 raft_consensus.cc:697] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:55.662611  1647 raft_consensus.cc:1275] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:00:55.662286  6589 consensus_queue.cc:237] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:55.660300  1651 raft_consensus.cc:1275] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:00:55.664263  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:55.667591  6703 consensus_queue.cc:1048] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:55.669626  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:55.670765  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:55.670992  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:55.674170  6794 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:55.658138  6704 raft_consensus.cc:515] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:55.674955  2294 leader_election.cc:304] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:55.675154  1651 raft_consensus.cc:1275] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:00:55.678432  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:55.673785  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:55.679062  1648 raft_consensus.cc:2468] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 13.
I20260709 13:00:55.535463  6850 raft_consensus.cc:515] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:55.676887  6912 raft_consensus.cc:2749] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:00:55.680547  1617 leader_election.cc:336] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.600s (SENT)
I20260709 13:00:55.692795  1617 leader_election.cc:304] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:55.630257  6915 raft_consensus.cc:2804] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:00:55.544620  6786 raft_consensus.cc:515] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:55.656786  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:55.698211  1723 raft_consensus.cc:2468] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 12.
I20260709 13:00:55.685671  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:55.671831  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:55.627154  6831 raft_consensus.cc:2804] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:00:55.695480  2297 leader_election.cc:304] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:55.705590  6905 raft_consensus.cc:493] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.706142  6905 raft_consensus.cc:515] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:55.706935  6651 consensus_queue.cc:1048] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:00:55.708186  6905 leader_election.cc:290] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:55.708716  6747 consensus_queue.cc:1048] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:00:55.697865  6904 raft_consensus.cc:2749] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:00:55.697870  6915 raft_consensus.cc:493] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:55.711433  2294 leader_election.cc:304] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:55.712419  6906 consensus_queue.cc:1048] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:00:55.721963  1688 leader_election.cc:304] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:55.699791  2325 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 10.
I20260709 13:00:55.657931  6872 raft_consensus.cc:2804] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:00:55.738101  1644 raft_consensus.cc:1275] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:00:55.740465  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:55.632156  6652 consensus_queue.cc:1048] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.085s
I20260709 13:00:55.692631  6753 raft_consensus.cc:493] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.657675  6803 consensus_queue.cc:1059] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.088s
I20260709 13:00:55.678861  6907 raft_consensus.cc:2804] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:00:55.642971  6573 consensus_queue.cc:1048] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.094s
I20260709 13:00:55.801580  6684 raft_consensus.cc:493] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.802147  6684 raft_consensus.cc:515] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:55.804798  6904 raft_consensus.cc:3055] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:00:55.805261  6904 raft_consensus.cc:740] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:55.806115  6904 consensus_queue.cc:260] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:55.807387  6904 raft_consensus.cc:3060] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:55.772698  1642 raft_consensus.cc:1275] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:00:55.813586  6831 raft_consensus.cc:697] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:55.813812  6786 leader_election.cc:290] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:55.763361  6872 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:55.814495  6872 raft_consensus.cc:3060] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:55.814622  6831 consensus_queue.cc:237] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:55.820689  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 81295.7us
I20260709 13:00:55.822970  2297 leader_election.cc:304] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:55.823263  6906 consensus_queue.cc:1048] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
W20260709 13:00:55.825613  6895 consensus_queue.cc:1175] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "4dbe7d47a2374afca075d3a98583b49e" responder_term: 12 status { last_received { term: 12 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 12 index: 7 } }
I20260709 13:00:55.737701  6905 raft_consensus.cc:493] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:55.826758  6905 raft_consensus.cc:515] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:55.828867  6651 raft_consensus.cc:2804] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:55.829285  6651 raft_consensus.cc:493] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:55.829663  6651 raft_consensus.cc:3060] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:55.830343  6905 leader_election.cc:290] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:55.737416  6704 leader_election.cc:290] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:55.833897  6850 leader_election.cc:290] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:55.762511  6826 consensus_queue.cc:1048] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.072s
I20260709 13:00:55.835049  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:55.745405  6915 raft_consensus.cc:3060] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:55.835598  1576 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:55.838338  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:55.839071  1718 raft_consensus.cc:2393] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 12: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:55.741403  6267 raft_consensus.cc:493] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:55.840795  6267 raft_consensus.cc:515] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:55.841117  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:55.842187  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:55.842851  6267 leader_election.cc:290] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:55.770735  6845 raft_consensus.cc:2804] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:55.843672  6845 raft_consensus.cc:493] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:55.844028  6845 raft_consensus.cc:3060] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:55.845134  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:55.804319  6684 leader_election.cc:290] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:55.846138  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:55.773656  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:55.847096  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:55.847841  1725 raft_consensus.cc:2393] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 15: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:55.764389  6794 raft_consensus.cc:493] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:55.849066  6905 raft_consensus.cc:493] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:55.849115  6794 raft_consensus.cc:515] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:55.850450  1568 raft_consensus.cc:2410] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:00:55.851434  6794 leader_election.cc:290] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:55.849713  6905 raft_consensus.cc:515] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:55.857216  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:55.858170  1716 raft_consensus.cc:2393] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 10: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:55.858960  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:55.859643  1716 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 14.
I20260709 13:00:55.860639  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:55.861413  1576 raft_consensus.cc:2410] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:00:55.861819  1720 raft_consensus.cc:1275] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:00:55.848475  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:55.862479  6573 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:55.862673  1725 raft_consensus.cc:2376] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 14. Re-sending same reply.
I20260709 13:00:55.863010  6573 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:55.864394  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:55.865295  1720 raft_consensus.cc:2393] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 10: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:55.865329  6573 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:55.866031  6573 raft_consensus.cc:493] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:55.866468  6573 raft_consensus.cc:515] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 13:00:55.867249  2332 raft_consensus.cc:1275] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:00:55.737078  6902 raft_consensus.cc:2749] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:55.764837  1575 raft_consensus.cc:3060] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:00:55.875584  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:55.655938  6708 raft_consensus.cc:515] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 13:00:55.656437  6713 raft_consensus.cc:515] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:55.787250  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 75876.5us
I20260709 13:00:55.771055  6710 consensus_queue.cc:1048] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 13:00:55.799743  6751 leader_election.cc:290] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:55.788615  6907 raft_consensus.cc:493] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:55.869935  2297 leader_election.cc:304] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
W20260709 13:00:55.912937  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 88450.1us
I20260709 13:00:55.914237  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:55.769593  1688 leader_election.cc:304] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:55.915599  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:55.917382  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:55.919433  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:55.920300  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:55.921423  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:55.873080  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:00:55.924050  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 154549us
I20260709 13:00:55.924232  1725 raft_consensus.cc:2468] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 11.
I20260709 13:00:55.868834  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:55.878963  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:55.890172  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:00:55.891535  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.893707  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:55.896468  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:55.899057  1575 raft_consensus.cc:2468] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 8.
I20260709 13:00:55.901240  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:55.907706  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:55.967411  1576 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 10.
I20260709 13:00:55.910499  1615 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:55.911219  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:55.968422  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:55.968623  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:55.969069  1716 raft_consensus.cc:2468] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 13.
I20260709 13:00:55.970170  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:55.970685  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:55.971756  1568 raft_consensus.cc:2468] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 13.
I20260709 13:00:55.973886  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:55.975446  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:55.966886  1720 raft_consensus.cc:2468] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 12.
W20260709 13:00:55.978888  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 70372.5us
I20260709 13:00:55.790673  6753 raft_consensus.cc:515] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:56.002913  2326 consensus_meta.cc:287] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.513s	user 0.004s	sys 0.004s
I20260709 13:00:56.003548  2326 raft_consensus.cc:2468] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 13.
I20260709 13:00:55.988190  6751 raft_consensus.cc:2749] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:55.927060  6906 raft_consensus.cc:493] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.968431  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:55.978901  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:55.964958  6918 raft_consensus.cc:2804] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:00:55.986584  6795 consensus_meta.cc:287] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.563s	user 0.006s	sys 0.002s
I20260709 13:00:55.919106  6575 raft_consensus.cc:2749] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:55.984342  2295 leader_election.cc:304] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:55.992897  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:55.971423  1651 raft_consensus.cc:2468] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 12.
I20260709 13:00:55.915130  6907 raft_consensus.cc:3060] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:56.011839  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:55.985491  6908 raft_consensus.cc:493] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
W20260709 13:00:56.018683  2330 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.013s	sys 0.005s
I20260709 13:00:55.979823  6826 consensus_queue.cc:1048] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 13:00:55.915362  6676 consensus_queue.cc:1048] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.102s
I20260709 13:00:56.012228  6704 raft_consensus.cc:493] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:55.913014  6660 consensus_queue.cc:1048] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.102s
I20260709 13:00:55.969085  1576 raft_consensus.cc:2468] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 13.
W20260709 13:00:56.297446  1690 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.009s	sys 0.025s
I20260709 13:00:56.030061  1642 raft_consensus.cc:1275] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:00:56.106333  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 13:00:56.046845  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.550124  1720 raft_consensus.cc:2393] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 14: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
W20260709 13:00:56.256197  1569 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.008s	sys 0.015s
W20260709 13:00:56.551397  1569 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.921s	user 0.008s	sys 0.023s
I20260709 13:00:56.551595  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 13:00:56.506363  1645 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.004s	sys 0.012s
W20260709 13:00:56.552645  1645 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.005s	sys 0.012s
W20260709 13:00:56.530460  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 288380us
I20260709 13:00:56.019872  6906 raft_consensus.cc:515] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:56.111768  1716 raft_consensus.cc:2468] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 8.
I20260709 13:00:56.556723  6906 leader_election.cc:290] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:00:56.322165  1572 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.005s	sys 0.038s
I20260709 13:00:56.450588  6794 raft_consensus.cc:493] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
W20260709 13:00:56.557314  1572 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.878s	user 0.015s	sys 0.043s
I20260709 13:00:56.557750  1575 raft_consensus.cc:1275] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:00:56.557601  6794 raft_consensus.cc:515] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:56.456785  6708 leader_election.cc:290] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373)
I20260709 13:00:56.048879  6918 raft_consensus.cc:697] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 13 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:56.105755  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:56.030256  6905 leader_election.cc:290] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:56.559101  6918 consensus_queue.cc:237] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:56.072714  6573 leader_election.cc:290] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:56.036715  6926 raft_consensus.cc:2749] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:00:56.556102  1690 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.013s	sys 0.037s
W20260709 13:00:56.563835  2330 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.045s	user 0.017s	sys 0.016s
W20260709 13:00:56.446261  6780 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.767s	user 0.020s	sys 0.031s
I20260709 13:00:56.305009  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:56.030169  1649 raft_consensus.cc:2468] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 14.
I20260709 13:00:56.583834  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:00:56.478111  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:56.566130  1644 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.002s	sys 0.008s
W20260709 13:00:56.585382  1644 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.002s	sys 0.009s
W20260709 13:00:56.030069  6793 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.006s	sys 0.038s
W20260709 13:00:56.306044  1574 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.770s	user 0.021s	sys 0.003s
W20260709 13:00:56.593818  1574 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.058s	user 0.024s	sys 0.005s
W20260709 13:00:56.037144  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 52902.1us
I20260709 13:00:56.069806  6912 raft_consensus.cc:2804] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:00:56.447373  6713 leader_election.cc:290] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:00:56.571049  1615 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.008s	sys 0.000s
W20260709 13:00:56.600476  1615 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.008s	sys 0.000s
W20260709 13:00:56.415699  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 74580.8us
W20260709 13:00:56.600812  1647 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.001s	sys 0.013s
W20260709 13:00:56.601202  1647 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.001s	sys 0.013s
W20260709 13:00:56.577471  1568 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.002s	sys 0.006s
W20260709 13:00:56.603456  1568 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.002s	sys 0.006s
I20260709 13:00:56.437391  1723 raft_consensus.cc:2468] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 11.
W20260709 13:00:56.600835  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 620665us
I20260709 13:00:56.605402  1615 leader_election.cc:304] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:56.606463  1615 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 13:00:56.607882  1615 leader_election.cc:304] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:00:56.444808  6831 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.008s	sys 0.009s
I20260709 13:00:56.620432  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 2509) took 1061 ms. Trace:
I20260709 13:00:56.621212  1568 rpcz_store.cc:276] 0709 13:00:55.576674 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.994298 (+417624us) service_pool.cc:224] Handling call
0709 13:00:55.995025 (+   727us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:55.995258 (+   233us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:00:56.020212 (+ 24954us) log.cc:844] Serialized 14 byte log entry
0709 13:00:56.619846 (+599634us) log.cc:844] Serialized 14 byte log entry
0709 13:00:56.620016 (+   170us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:56.620074 (+    58us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:56.620140 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.620227 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:56.620366 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15677,"prepare.queue_time_us":316255,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"spinlock_wait_cycles":830336,"thread_start_us":583437,"threads_started":1}
W20260709 13:00:56.322803  6732 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.167s	user 0.018s	sys 0.037s
I20260709 13:00:56.614244  1615 leader_election.cc:304] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:56.586916  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:56.617805  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:56.560109  6794 leader_election.cc:290] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:56.582379  6780 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.927s	user 0.026s	sys 0.032s
W20260709 13:00:56.593601  6793 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.068s	user 0.013s	sys 0.046s
I20260709 13:00:56.630663  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:56.619554  1688 leader_election.cc:304] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:56.581352  6753 leader_election.cc:290] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:56.591080  6654 raft_consensus.cc:2804] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:56.632507  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 13:00:56.620956  6831 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.009s	sys 0.009s
I20260709 13:00:56.638044  1542 leader_election.cc:304] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:56.649828  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:56.639398  1615 leader_election.cc:304] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 13:00:56.640369  1722 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.870s	user 0.013s	sys 0.015s
I20260709 13:00:56.642936  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:56.651556  2328 raft_consensus.cc:2468] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 8.
W20260709 13:00:56.627563  6732 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.472s	user 0.023s	sys 0.037s
I20260709 13:00:56.603623  6904 raft_consensus.cc:493] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:56.644991  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:56.625391  6912 raft_consensus.cc:697] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:00:56.582486  6908 raft_consensus.cc:515] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:56.618906  6715 raft_consensus.cc:2749] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:56.619094  6652 raft_consensus.cc:2804] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:00:56.656139  6938 log.cc:927] Time spent T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.408s	user 0.000s	sys 0.001s
I20260709 13:00:56.037201  6795 raft_consensus.cc:515] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:56.408569  6915 raft_consensus.cc:515] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:56.627769  6895 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:56.656081  1542 leader_election.cc:304] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
W20260709 13:00:56.656388  1722 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.892s	user 0.013s	sys 0.015s
I20260709 13:00:56.644469  2326 raft_consensus.cc:1275] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 13:00:56.721880  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 65897.6us
W20260709 13:00:56.645519  6845 consensus_meta.cc:287] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.801s	user 0.008s	sys 0.002s
I20260709 13:00:56.637760  1688 leader_election.cc:304] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:56.722774  1542 leader_election.cc:304] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:56.592092  6704 raft_consensus.cc:515] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:56.704981  6794 raft_consensus.cc:2749] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:56.729785  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 1396) took 1201 ms. Trace:
I20260709 13:00:56.649926  6713 raft_consensus.cc:2804] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:00:56.705852  2325 raft_consensus.cc:1240] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 8. Current term is 9. Ops: []
W20260709 13:00:56.708326  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 69026.5us
I20260709 13:00:56.735083  1615 leader_election.cc:304] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:56.650597  6874 raft_consensus.cc:2749] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:00:56.719447  1572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 1397) took 1183 ms. Trace:
I20260709 13:00:56.707885  6652 raft_consensus.cc:493] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:56.619505  6660 raft_consensus.cc:2804] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:00:56.719758  6951 raft_consensus.cc:2804] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:56.730211  1570 rpcz_store.cc:276] 0709 13:00:55.528376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.528600 (+   224us) service_pool.cc:224] Handling call
0709 13:00:55.559494 (+ 30894us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:55.559842 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:55.559871 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:55.573237 (+ 13366us) log.cc:844] Serialized 26 byte log entry
0709 13:00:55.911510 (+338273us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:55.911566 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:55.911651 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:56.729591 (+817940us) raft_consensus.cc:1685] finished
0709 13:00:56.729610 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:56.729731 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":98,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":52015,"thread_start_us":337950,"threads_started":1,"wal-append.queue_time_us":664899}
I20260709 13:00:56.735905  1572 rpcz_store.cc:276] 0709 13:00:55.536510 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.542095 (+  5585us) service_pool.cc:224] Handling call
0709 13:00:55.542328 (+   233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:55.542507 (+   179us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:00:56.557908 (+1015401us) log.cc:844] Serialized 14 byte log entry
0709 13:00:56.719089 (+161181us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:56.719145 (+    56us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:56.719197 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.719267 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:56.719393 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":88230,"prepare.queue_time_us":126475,"raft.queue_time_us":7526,"spinlock_wait_cycles":25468160,"thread_start_us":1039713,"threads_started":2}
W20260709 13:00:56.725160  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 87467.3us
I20260709 13:00:56.707147  6904 raft_consensus.cc:515] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:56.740309  1650 raft_consensus.cc:1240] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:00:56.659672  6905 consensus_queue.cc:1059] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 13:00:56.727270  1542 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:56.744074  1718 raft_consensus.cc:2376] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 11. Re-sending same reply.
I20260709 13:00:56.730451  6826 raft_consensus.cc:2804] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:56.753104  1615 leader_election.cc:304] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:56.734102  6713 raft_consensus.cc:493] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:56.757241  1542 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 13:00:56.744112  6652 raft_consensus.cc:3060] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:00:56.747174  6660 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:56.731591  6845 raft_consensus.cc:515] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:57.057246  6660 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:00:57.057801  1719 raft_consensus.cc:1240] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:57.059051  6845 leader_election.cc:290] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:00:57.046037  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:00:56.821936  6826 raft_consensus.cc:493] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.061159  6826 raft_consensus.cc:3060] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:56.790234  6713 raft_consensus.cc:3060] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:00:57.051293  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 298241us
I20260709 13:00:57.051628  6732 raft_consensus.cc:493] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.051807  6904 leader_election.cc:290] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:57.052053  6753 raft_consensus.cc:2804] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:57.052109  6708 raft_consensus.cc:493] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:56.756289  6715 raft_consensus.cc:2804] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:56.726570  6895 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:56.756042  6951 raft_consensus.cc:697] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 14 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:00:57.152652  1539 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:56.746637  6794 raft_consensus.cc:2749] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:57.229311  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:57.113950  6753 raft_consensus.cc:493] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.068912  6732 raft_consensus.cc:515] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:57.115571  6904 raft_consensus.cc:2749] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:57.241811  1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 2016) took 1684 ms. Trace:
I20260709 13:00:57.266129  1721 rpcz_store.cc:276] 0709 13:00:55.564421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.228761 (+1664340us) service_pool.cc:224] Handling call
0709 13:00:57.241714 (+ 12953us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:57.259971  1574 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.000s	sys 0.012s
W20260709 13:00:57.300181  1574 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.000s	sys 0.012s
I20260709 13:00:57.301672  1574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36642 (request call id 2674) took 1807 ms. Trace:
W20260709 13:00:57.259701  1725 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.005s	sys 0.009s
I20260709 13:00:57.143113  6715 raft_consensus.cc:493] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
W20260709 13:00:57.261201  1573 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.241s	user 0.005s	sys 0.012s
W20260709 13:00:57.343704  1573 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.323s	user 0.005s	sys 0.012s
W20260709 13:00:57.326262  1725 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.006s	sys 0.009s
I20260709 13:00:57.338903  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:56.788321  6912 consensus_queue.cc:237] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:57.344911  1721 raft_consensus.cc:3060] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:57.121665  6905 raft_consensus.cc:3055] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:57.218758  6693 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:57.263531  6753 raft_consensus.cc:3060] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:00:57.386487  1644 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.751s	user 0.011s	sys 0.010s
W20260709 13:00:57.420734  1644 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.785s	user 0.012s	sys 0.010s
W20260709 13:00:57.404860  1647 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.773s	user 0.012s	sys 0.029s
W20260709 13:00:57.422650  1647 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.012s	sys 0.030s
I20260709 13:00:57.165211  6708 raft_consensus.cc:515] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:57.302189  1574 rpcz_store.cc:276] 0709 13:00:55.494098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.494234 (+   136us) service_pool.cc:224] Handling call
0709 13:00:55.494590 (+   356us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:55.494819 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:00:55.535905 (+ 41086us) log.cc:844] Serialized 14 byte log entry
0709 13:00:57.301138 (+1765233us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:57.301221 (+    83us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:57.301297 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.301398 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:57.301605 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":57020,"prepare.queue_time_us":60720,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":39718,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":5738,"thread_start_us":1725187,"threads_started":2}
I20260709 13:00:57.339978  6573 raft_consensus.cc:2749] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:57.355638  6715 raft_consensus.cc:3060] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:57.389243  6905 raft_consensus.cc:740] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:57.388851  6794 raft_consensus.cc:2804] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:00:57.442598  1722 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.719s	user 0.009s	sys 0.018s
W20260709 13:00:57.460281  1722 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.737s	user 0.010s	sys 0.018s
W20260709 13:00:57.464301  2295 thread.cc:641] server-negotiator [worker] (thread pool) Time spent creating pthread: real 0.831s	user 0.001s	sys 0.029s
I20260709 13:00:57.417974  6904 raft_consensus.cc:493] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.428181  6793 raft_consensus.cc:493] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:57.436771  1721 raft_consensus.cc:2468] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 13.
W20260709 13:00:57.467344  1721 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2595) took 1419 ms (client timeout 1801 ms). Trace:
W20260709 13:00:57.467736  1721 rpcz_store.cc:269] 0709 13:00:56.048486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.338467 (+1289981us) service_pool.cc:224] Handling call
0709 13:00:57.467287 (+128820us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:57.456575  1574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 1404) took 1801 ms. Trace:
W20260709 13:00:57.461617  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 292120us
W20260709 13:00:57.464371  1576 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.009s	sys 0.021s
W20260709 13:00:57.441938  6918 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.734s	user 0.014s	sys 0.014s
W20260709 13:00:57.459663  6932 log.cc:927] Time spent T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.645s	user 0.000s	sys 0.001s
W20260709 13:00:57.460091  6942 log.cc:927] Time spent T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.747s	user 0.001s	sys 0.000s
W20260709 13:00:57.516830  1576 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.778s	user 0.013s	sys 0.021s
W20260709 13:00:57.459446  6949 log.cc:927] Time spent T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
W20260709 13:00:57.485240  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:57.481312  1542 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.015s	sys 0.015s
W20260709 13:00:57.551654  1542 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.017s	sys 0.017s
W20260709 13:00:57.552603  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 795380us
W20260709 13:00:57.481168  1569 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.828s	user 0.009s	sys 0.014s
W20260709 13:00:57.553481  1569 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.905s	user 0.012s	sys 0.016s
W20260709 13:00:57.554044  2295 thread.cc:608] server-negotiator [worker] (thread pool) Time spent starting thread: real 0.920s	user 0.004s	sys 0.032s
I20260709 13:00:57.554440  1542 leader_election.cc:304] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:57.469758  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:57.459543  6794 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:00:57.459503  6947 raft_consensus.cc:493] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:57.431300  6693 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:57.558009  6961 log.cc:927] Time spent T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
W20260709 13:00:57.558879  6956 log.cc:927] Time spent T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
W20260709 13:00:57.559625  6960 log.cc:927] Time spent T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
W20260709 13:00:57.560410  6944 log.cc:927] Time spent T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
W20260709 13:00:57.561106  6954 log.cc:927] Time spent T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.290s	user 0.000s	sys 0.000s
I20260709 13:00:57.517735  1574 rpcz_store.cc:276] 0709 13:00:55.655022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.442402 (+1787380us) service_pool.cc:224] Handling call
0709 13:00:57.455845 (+ 13443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:57.456036 (+   191us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:57.456060 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:57.456299 (+   239us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:57.456335 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.456393 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:57.456505 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:57.517520  6948 log.cc:927] Time spent T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.786s	user 0.000s	sys 0.001s
I20260709 13:00:57.466331  6874 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:57.469803  6704 leader_election.cc:290] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:00:57.519912  6918 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.816s	user 0.014s	sys 0.014s
I20260709 13:00:57.519097  6845 raft_consensus.cc:493] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:57.576359  6947 raft_consensus.cc:515] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:57.592067  1574 raft_consensus.cc:1240] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 8. Current term is 9. Ops: []
W20260709 13:00:57.592167  6713 consensus_meta.cc:287] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.529s	user 0.009s	sys 0.000s
I20260709 13:00:57.592381  1649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45148 (request call id 2648) took 1027 ms. Trace:
I20260709 13:00:57.630620  1574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36642 (request call id 2684) took 1975 ms. Trace:
I20260709 13:00:57.570161  6964 raft_consensus.cc:493] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:57.594697  1571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 2496) took 2106 ms. Trace:
I20260709 13:00:57.634042  1571 rpcz_store.cc:276] 0709 13:00:55.488297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.488614 (+   317us) service_pool.cc:224] Handling call
0709 13:00:55.488894 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:55.489197 (+   303us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:55.489219 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:55.491318 (+  2099us) log.cc:844] Serialized 26 byte log entry
0709 13:00:55.989424 (+498106us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b180035a700. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef2b0e07 00007fa9f810bab9 00007fa9ef2cd69b 00007fa9ef2cb93f 00007fa9ef2cdc02 00007fa9f1f5520b 00007fa9f1f5ad23 00007fa9f1f5b0d1 00007fa9f2376a0f
0709 13:00:56.306178 (+316754us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:56.306233 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.306318 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:57.594296 (+1287978us) raft_consensus.cc:1685] finished
0709 13:00:57.594318 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:57.594605 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8196,"raft.queue_time_us":4987,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":2501,"spinlock_wait_cycles":40909696,"thread_start_us":316558,"threads_started":1,"wal-append.queue_time_us":1614639}
I20260709 13:00:57.580636  6795 leader_election.cc:290] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:00:57.589844  6651 consensus_meta.cc:287] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 1.756s	user 0.013s	sys 0.000s
I20260709 13:00:57.648094  1725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 1358) took 1732 ms. Trace:
I20260709 13:00:57.648449  6651 raft_consensus.cc:515] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:57.648775  1725 rpcz_store.cc:276] 0709 13:00:55.915533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.925545 (+ 10012us) service_pool.cc:224] Handling call
0709 13:00:55.925883 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:55.926446 (+   563us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:55.926487 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:55.994703 (+ 68216us) log.cc:844] Serialized 26 byte log entry
0709 13:00:56.706738 (+712035us) spinlock_profiling.cc:243] Waited 9.66 ms on lock 0x7b18001061e0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef2b0e07 00007fa9f810bab9 00007fa9ef2cd69b 00007fa9ef2cb93f 00007fa9ef2cdc02 00007fa9f1f5520b 00007fa9f1f5ad23 00007fa9f1f5b0d1 00007fa9f2376a0f
0709 13:00:57.358361 (+651623us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:57.358425 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.358535 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:57.647654 (+289119us) raft_consensus.cc:1685] finished
0709 13:00:57.647686 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:57.647989 (+   303us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5193,"raft.queue_time_us":37800,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":3541,"spinlock_wait_cycles":22207872,"thread_start_us":651371,"threads_started":1,"wal-append.queue_time_us":1577782}
I20260709 13:00:57.650620  6651 leader_election.cc:290] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 14 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:57.549503  6904 raft_consensus.cc:515] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:57.629106  6895 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:57.476663  6908 leader_election.cc:290] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:57.466246  6953 raft_consensus.cc:493] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:57.600067  2327 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32870 (request call id 715) took 2116 ms. Trace:
W20260709 13:00:57.602397  6872 consensus_meta.cc:287] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 1.787s	user 0.018s	sys 0.000s
I20260709 13:00:57.569156  6794 raft_consensus.cc:3060] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:57.517819  6747 raft_consensus.cc:493] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
W20260709 13:00:57.463681  6780 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.804s	user 0.007s	sys 0.015s
I20260709 13:00:57.442319  6951 consensus_queue.cc:237] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:57.579751  6958 log.cc:927] Time spent T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.786s	user 0.000s	sys 0.001s
W20260709 13:00:57.625648  6936 log.cc:927] Time spent T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:00:57.626552  6732 leader_election.cc:290] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:57.631098  1574 rpcz_store.cc:276] 0709 13:00:55.655078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.591581 (+1936503us) service_pool.cc:224] Handling call
0709 13:00:57.591903 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:57.630356 (+ 38453us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.630567 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:57.630511  1649 rpcz_store.cc:276] 0709 13:00:56.564873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.635780 (+ 70907us) service_pool.cc:224] Handling call
0709 13:00:56.636127 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:56.636488 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:56.636544 (+    56us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:56.637042 (+   498us) log.cc:844] Serialized 26 byte log entry
0709 13:00:56.751868 (+114826us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:56.751910 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.751980 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:57.592164 (+840184us) raft_consensus.cc:1685] finished
0709 13:00:57.592185 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:57.592320 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50117,"raft.queue_time_us":9038,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":6679,"thread_start_us":45120,"threads_started":1,"wal-append.queue_time_us":583022}
W20260709 13:00:57.595186  6941 log.cc:927] Time spent T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.538s	user 0.006s	sys 0.005s
I20260709 13:00:57.519352  6793 raft_consensus.cc:515] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:57.604686  6946 log.cc:927] Time spent T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.786s	user 0.000s	sys 0.001s
I20260709 13:00:57.583725  6952 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:57.576007  6905 consensus_queue.cc:260] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:57.646242  6693 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:57.629769  6874 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:57.643990  6713 raft_consensus.cc:515] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:57.681828  6780 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.029s	user 0.010s	sys 0.021s
I20260709 13:00:57.665915  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:57.670513  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:57.749786  1725 raft_consensus.cc:3060] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:00:57.713533  6660 consensus_meta.cc:287] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.643s	user 0.008s	sys 0.002s
I20260709 13:00:57.722273  6753 raft_consensus.cc:515] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:57.674192  6872 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:57.723225  6952 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:57.664451  6845 raft_consensus.cc:515] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:57.675164  6795 raft_consensus.cc:493] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.725049  6975 raft_consensus.cc:2749] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:57.726449  6793 leader_election.cc:290] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:57.726970  6966 consensus_queue.cc:1048] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:57.727937  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 2085) took 1837 ms. Trace:
I20260709 13:00:57.768973  1642 rpcz_store.cc:276] 0709 13:00:55.891037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.891181 (+   144us) service_pool.cc:224] Handling call
0709 13:00:55.918775 (+ 27594us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:56.549679 (+630904us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.727717 (+1178038us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b540030e654. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:57.727881 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":232809344}
I20260709 13:00:57.728288  6908 raft_consensus.cc:493] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:57.652874  6964 raft_consensus.cc:515] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:57.672773  6953 raft_consensus.cc:515] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:57.729830  6947 leader_election.cc:290] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:57.727800  6895 raft_consensus.cc:2804] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:00:57.730310  6646 raft_consensus.cc:2804] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:57.772114  1725 raft_consensus.cc:2468] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 14.
I20260709 13:00:57.778030  6713 leader_election.cc:290] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:57.775329  6952 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:57.775851  6953 leader_election.cc:290] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:57.776780  6872 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 17 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:57.774075  6964 leader_election.cc:290] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:57.780800  6753 leader_election.cc:290] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:57.781211  6965 log.cc:927] Time spent T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
W20260709 13:00:57.778079  1725 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2602) took 1478 ms (client timeout 1656 ms). Trace:
W20260709 13:00:57.782277  1725 rpcz_store.cc:269] 0709 13:00:56.300149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.670172 (+1370023us) service_pool.cc:224] Handling call
0709 13:00:57.778000 (+107828us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:57.783429  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:57.731001  6905 raft_consensus.cc:3060] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:57.712878  2329 raft_consensus.cc:1240] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 LEADER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:57.653038  2327 rpcz_store.cc:276] 0709 13:00:55.483666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.488673 (+  5007us) service_pool.cc:224] Handling call
0709 13:00:55.488894 (+   221us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:55.490541 (+  1647us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:55.490571 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:55.498500 (+  7929us) log.cc:844] Serialized 26 byte log entry
0709 13:00:55.999922 (+501422us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:55.999979 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.000066 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:57.599773 (+1599707us) raft_consensus.cc:1685] finished
0709 13:00:57.599802 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:57.599970 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1299,"raft.queue_time_us":1396,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":6696,"thread_start_us":489337,"threads_started":1,"wal-append.queue_time_us":936771}
W20260709 13:00:57.713615  6907 consensus_meta.cc:287] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 1.147s	user 0.011s	sys 0.000s
W20260709 13:00:57.749811  1720 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2597) took 1596 ms (client timeout 1825 ms). Trace:
I20260709 13:00:57.786501  6703 raft_consensus.cc:493] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.673988  6904 leader_election.cc:290] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:57.684187  6704 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:57.766945  6795 raft_consensus.cc:515] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:57.755643  6988 raft_consensus.cc:493] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:57.767928  6874 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:57.756819  6660 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:57.786365  6826 consensus_meta.cc:287] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.725s	user 0.009s	sys 0.001s
I20260709 13:00:57.755445  6708 leader_election.cc:290] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:57.683899  6747 raft_consensus.cc:515] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:57.771368  6966 consensus_queue.cc:1243] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer 0c7751452c4b46afa95251b9df7169d4 log is divergent from this leader: its last log entry 15.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:00:57.773903  6845 leader_election.cc:290] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:57.789865  6895 raft_consensus.cc:697] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:00:57.780663  6908 raft_consensus.cc:515] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:57.869820  6935 log.cc:927] Time spent T 00000000000000000000000000000000 P fcfaa17e55ae48e194c5d95ca24a659f: Append to log took a long time: real 1.558s	user 0.005s	sys 0.016s
I20260709 13:00:57.827010  6907 raft_consensus.cc:515] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:57.884361  6978 log.cc:927] Time spent T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:00:57.862195  6988 raft_consensus.cc:515] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:57.892139  6988 leader_election.cc:290] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:57.920538  1459 thread.cc:641] client-negotiator [worker] (thread pool) Time spent creating pthread: real 1.246s	user 0.008s	sys 0.020s
W20260709 13:00:57.921769  1459 thread.cc:608] client-negotiator [worker] (thread pool) Time spent starting thread: real 1.448s	user 0.009s	sys 0.020s
W20260709 13:00:57.924500  1540 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.087s	user 0.012s	sys 0.006s
I20260709 13:00:57.728011  1573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36642 (request call id 2677) took 2226 ms. Trace:
W20260709 13:00:57.925087  1540 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.087s	user 0.012s	sys 0.007s
I20260709 13:00:57.925432  1573 rpcz_store.cc:276] 0709 13:00:55.501877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.501977 (+   100us) service_pool.cc:224] Handling call
0709 13:00:55.517933 (+ 15956us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:55.518206 (+   273us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:00:56.020212 (+502006us) log.cc:844] Serialized 14 byte log entry
0709 13:00:57.615404 (+1595192us) log.cc:844] Serialized 14 byte log entry
0709 13:00:57.727672 (+112268us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:57.727727 (+    55us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:57.727777 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.727845 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:57.727948 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":131371,"prepare.queue_time_us":150396,"prepare.run_cpu_time_us":107,"prepare.run_wall_time_us":9799,"raft.queue_time_us":538653,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":4460,"thread_start_us":2049656,"threads_started":3,"wal-append.queue_time_us":1547862}
I20260709 13:00:57.930898  1573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 1406) took 2265 ms. Trace:
W20260709 13:00:57.931556  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 376999us
I20260709 13:00:57.932219  1570 raft_consensus.cc:1240] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 17 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 16. Current term is 17. Ops: []
I20260709 13:00:57.654258  1571 raft_consensus.cc:1240] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:00:57.934298  1571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36642 (request call id 2685) took 2275 ms. Trace:
I20260709 13:00:57.934719  1571 rpcz_store.cc:276] 0709 13:00:55.658693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.653699 (+1995006us) service_pool.cc:224] Handling call
0709 13:00:57.654048 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:57.933674 (+279626us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.934088 (+   414us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:57.935633  1542 leader_election.cc:304] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:57.931529  1573 rpcz_store.cc:276] 0709 13:00:55.665215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.928814 (+2263599us) service_pool.cc:224] Handling call
0709 13:00:57.929757 (+   943us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:57.930264 (+   507us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:57.930316 (+    52us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:57.930383 (+    67us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:57.930452 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.930559 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:57.930763 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:57.699944  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 126215us
I20260709 13:00:57.947345  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 1040) took 2049 ms. Trace:
I20260709 13:00:57.947552  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 1039) took 2050 ms. Trace:
I20260709 13:00:57.947852  1644 rpcz_store.cc:276] 0709 13:00:55.897466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.916468 (+ 19002us) service_pool.cc:224] Handling call
0709 13:00:55.980835 (+ 64367us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:00:56.585791 (+604956us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:56.585824 (+    33us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:00:56.586392 (+   568us) log.cc:844] Serialized 52 byte log entry
0709 13:00:57.421829 (+835437us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:57.421886 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.422048 (+   162us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:57.946576 (+524528us) raft_consensus.cc:1685] finished
0709 13:00:57.946621 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:57.947043 (+   422us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":89949,"raft.queue_time_us":34581,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":15122,"thread_start_us":1390831,"threads_started":2,"wal-append.queue_time_us":932589}
I20260709 13:00:57.724990  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:57.949599  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:57.952013  1651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45148 (request call id 2647) took 2021 ms. Trace:
I20260709 13:00:57.727275  1650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45148 (request call id 2644) took 1797 ms. Trace:
W20260709 13:00:57.682727  1689 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:57.821177  1720 rpcz_store.cc:269] 0709 13:00:56.153134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.665564 (+1512430us) service_pool.cc:224] Handling call
0709 13:00:57.749739 (+ 84175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:57.752733  1721 raft_consensus.cc:2368] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 12. Current term is 13.
W20260709 13:00:57.790715  1725 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2590) took 1813 ms (client timeout 2078 ms). Trace:
I20260709 13:00:57.827961  6703 raft_consensus.cc:515] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:57.856165  6704 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:57.862852  6826 raft_consensus.cc:515] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:57.972922  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:57.952494  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
W20260709 13:00:58.017874  1646 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.760s	user 0.000s	sys 0.008s
W20260709 13:00:58.018534  1646 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.788s	user 0.001s	sys 0.008s
W20260709 13:00:57.954372  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 227019us
I20260709 13:00:57.958478  1542 leader_election.cc:304] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:57.970405  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:57.969383  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:57.953090  1650 rpcz_store.cc:276] 0709 13:00:55.929875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.061021 (+131146us) service_pool.cc:224] Handling call
0709 13:00:56.061467 (+   446us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:56.750824 (+689357us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.727023 (+976199us) spinlock_profiling.cc:243] Waited 675 ms on lock 0x7b54000d8ed4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:57.727209 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1553116032}
I20260709 13:00:58.028966  6973 raft_consensus.cc:493] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:58.029636  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:58.030018  6973 raft_consensus.cc:515] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:58.031677  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:57.995194  6826 leader_election.cc:290] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:00:57.962172  1725 rpcz_store.cc:269] 0709 13:00:55.977612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.783136 (+1805524us) service_pool.cc:224] Handling call
0709 13:00:57.790640 (+  7504us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:58.032917  6976 raft_consensus.cc:493] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:58.033020  6992 raft_consensus.cc:2749] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:00:57.984952  6708 raft_consensus.cc:493] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.033934  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:58.034140  6976 raft_consensus.cc:515] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:58.034835  1725 raft_consensus.cc:2468] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 14.
I20260709 13:00:58.034741  6708 raft_consensus.cc:515] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:58.035495  1725 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 2032) took 2121 ms (client timeout 2182 ms). Trace:
W20260709 13:00:58.035908  1725 rpcz_store.cc:269] 0709 13:00:55.926894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.033489 (+2106595us) service_pool.cc:224] Handling call
0709 13:00:58.035396 (+  1907us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:58.036806  6980 raft_consensus.cc:493] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.037026  1568 raft_consensus.cc:1240] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:58.037448  6708 leader_election.cc:290] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:57.968603  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:58.037751  6980 raft_consensus.cc:515] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:58.040041  6931 log.cc:927] Time spent T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 1.824s	user 0.011s	sys 0.017s
I20260709 13:00:58.042737  6908 leader_election.cc:290] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:58.044261  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:57.967768  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:57.975270  6660 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:57.991044  6795 leader_election.cc:290] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:57.966910  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:57.960889  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:57.979089  6747 leader_election.cc:290] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:57.979161  6703 leader_election.cc:290] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:58.002887  6907 leader_election.cc:290] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:58.052475  1720 raft_consensus.cc:2376] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 14. Re-sending same reply.
I20260709 13:00:58.052675  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:58.052843  6826 raft_consensus.cc:493] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:57.952682  1651 rpcz_store.cc:276] 0709 13:00:55.930770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.554760 (+623990us) service_pool.cc:224] Handling call
0709 13:00:56.555126 (+   366us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:56.598182 (+ 43056us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:56.598228 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:56.598806 (+   578us) log.cc:844] Serialized 26 byte log entry
0709 13:00:57.770830 (+1172024us) spinlock_profiling.cc:243] Waited 4.9 ms on lock 0x7b18003a23a0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef2b0e07 00007fa9f810bab9 00007fa9ef2cd69b 00007fa9ef2cb93f 00007fa9ef2cdc02 00007fa9f1f5520b 00007fa9f1f5ad23 00007fa9f1f5b0d1 00007fa9f2376a0f
0709 13:00:57.950760 (+179930us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:57.950907 (+   147us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.951123 (+   216us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:57.951203 (+    80us) raft_consensus.cc:1685] finished
0709 13:00:57.951217 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:57.951745 (+   528us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51306,"raft.queue_time_us":42706,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":19664,"spinlock_wait_cycles":11262848,"thread_start_us":179304,"threads_started":1,"wal-append.queue_time_us":1282047}
I20260709 13:00:58.053818  1650 raft_consensus.cc:2393] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 13: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:58.052178  6994 raft_consensus.cc:493] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:57.948307  1647 rpcz_store.cc:276] 0709 13:00:55.897165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.915099 (+ 17934us) service_pool.cc:224] Handling call
0709 13:00:55.978313 (+ 63214us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:56.601543 (+623230us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:00:57.423103 (+821560us) log.cc:844] Serialized 14 byte log entry
0709 13:00:57.675203 (+252100us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:57.675791 (+   588us) log.cc:844] Serialized 26 byte log entry
0709 13:00:57.675956 (+   165us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:57.676002 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:57.676090 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:57.946723 (+270633us) raft_consensus.cc:1685] finished
0709 13:00:57.946794 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:57.947248 (+   454us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2371,"prepare.queue_time_us":459061,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":81990,"raft.run_cpu_time_us":325,"raft.run_wall_time_us":17623,"thread_start_us":1664008,"threads_started":3,"wal-append.queue_time_us":333851}
I20260709 13:00:58.060284  6845 raft_consensus.cc:493] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:58.061299  1722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 1357) took 2366 ms. Trace:
I20260709 13:00:58.063617  6908 consensus_queue.cc:1048] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:00:58.064720  1644 raft_consensus.cc:3060] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:58.069100  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:57.984434  6704 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:58.070287  1720 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2583) took 2091 ms (client timeout 2092 ms). Trace:
I20260709 13:00:58.046986  6980 leader_election.cc:290] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:58.074250  6987 raft_consensus.cc:493] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:58.074141  6845 raft_consensus.cc:515] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:58.075271  1720 rpcz_store.cc:269] 0709 13:00:55.975926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.959720 (+1983794us) service_pool.cc:224] Handling call
0709 13:00:58.067154 (+107434us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:58.070823  1722 rpcz_store.cc:276] 0709 13:00:55.694895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.701590 (+  6695us) service_pool.cc:224] Handling call
0709 13:00:55.701884 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:55.702102 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:00:56.723283 (+1021181us) log.cc:844] Serialized 14 byte log entry
0709 13:00:58.059382 (+1336099us) log.cc:844] Serialized 14 byte log entry
0709 13:00:58.059720 (+   338us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:58.059808 (+    88us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:58.059955 (+   147us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.060841 (+   886us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:58.061079 (+   238us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4083,"prepare.queue_time_us":698710,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":66,"raft.queue_time_us":169991,"raft.run_cpu_time_us":328,"raft.run_wall_time_us":20413,"thread_start_us":2294468,"threads_started":4,"wal-append.queue_time_us":882084}
I20260709 13:00:58.081532  6994 raft_consensus.cc:515] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:58.044494  6977 raft_consensus.cc:493] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.044713  6966 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.089251  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:58.089404  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:00:58.090006  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 131836us
I20260709 13:00:58.090426  1720 raft_consensus.cc:2468] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 12.
W20260709 13:00:58.091038  1720 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2584) took 2114 ms (client timeout 2149 ms). Trace:
I20260709 13:00:58.091078  1542 leader_election.cc:304] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
W20260709 13:00:58.091499  1720 rpcz_store.cc:269] 0709 13:00:55.976157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.088973 (+2112816us) service_pool.cc:224] Handling call
0709 13:00:58.090959 (+  1986us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:58.092684  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:58.092852  6992 raft_consensus.cc:2804] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:00:58.093129  1642 raft_consensus.cc:2468] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 14.
I20260709 13:00:58.093346  6992 raft_consensus.cc:493] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:58.093801  6992 raft_consensus.cc:3060] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:58.094039  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:58.094218  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:00:58.094868  1722 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2589) took 2117 ms (client timeout 2169 ms). Trace:
W20260709 13:00:58.095217  1722 rpcz_store.cc:269] 0709 13:00:55.977368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.093708 (+2116340us) service_pool.cc:224] Handling call
0709 13:00:58.094816 (+  1108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:58.096832  6907 raft_consensus.cc:2749] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:58.097673  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:58.000276  6895 consensus_queue.cc:237] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:58.098385  1722 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2599) took 1858 ms (client timeout 1927 ms). Trace:
W20260709 13:00:58.098776  1722 rpcz_store.cc:269] 0709 13:00:56.240519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.097368 (+1856849us) service_pool.cc:224] Handling call
0709 13:00:58.098339 (+   971us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:58.101538  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:58.101648  1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 2074) took 2776 ms. Trace:
I20260709 13:00:58.102129  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:58.103065  1649 raft_consensus.cc:3060] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:00:58.102119  1643 rpcz_store.cc:276] 0709 13:00:55.325574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.331068 (+  5494us) service_pool.cc:224] Handling call
0709 13:00:55.331320 (+   252us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:55.476060 (+144740us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:55.476088 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:55.476512 (+   424us) log.cc:844] Serialized 26 byte log entry
0709 13:00:55.876369 (+399857us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:55.876407 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.579212 (+702805us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b54001f7f54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:56.579260 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:58.039072 (+1459812us) spinlock_profiling.cc:243] Waited 18.2 ms on lock 0x7b4400022b4c. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef1f4c85 00007fa9ef1f56a2 00007fa9f1f671db 00007fa9f1f62aaf 00007fa9f1f5686e 00007fa9f1f55bb6 00007fa9f1f557d8 00007fa9f1f5f221 00007fa9f1f5f1d9 00007fa9f1f5f169
0709 13:00:58.101261 (+ 62189us) raft_consensus.cc:1685] finished
0709 13:00:58.101282 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:58.101468 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17932,"raft.queue_time_us":11532,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":5857,"spinlock_wait_cycles":374075392,"thread_start_us":399476,"threads_started":1,"wal-append.queue_time_us":538699}
I20260709 13:00:58.075028  6826 raft_consensus.cc:515] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:58.105063  6966 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:58.105592  1575 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 1401) took 2520 ms. Trace:
I20260709 13:00:58.106456  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:58.107363  1576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 2510) took 2514 ms. Trace:
I20260709 13:00:58.107101  6977 raft_consensus.cc:515] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:58.107769  1576 rpcz_store.cc:276] 0709 13:00:55.593080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.557799 (+964719us) service_pool.cc:224] Handling call
0709 13:00:56.558046 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:56.725786 (+167740us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:00:56.738767 (+ 12981us) log.cc:844] Serialized 14 byte log entry
0709 13:00:57.550377 (+811610us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:57.550458 (+    81us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:57.550547 (+    89us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.106826 (+556279us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b54003674d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:58.106909 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:58.107161 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":145,"prepare.queue_time_us":14767,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":58,"raft.queue_time_us":176579,"raft.run_cpu_time_us":55,"raft.run_wall_time_us":55,"spinlock_wait_cycles":385232768,"thread_start_us":810994,"threads_started":1,"wal-append.queue_time_us":856481}
I20260709 13:00:58.110184  6987 raft_consensus.cc:515] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:58.111665  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 2503) took 2582 ms. Trace:
I20260709 13:00:58.112363  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:58.113389  6976 leader_election.cc:290] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:58.106031  1575 rpcz_store.cc:276] 0709 13:00:55.584903 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.992361 (+407458us) service_pool.cc:224] Handling call
0709 13:00:56.557443 (+565082us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:56.558126 (+   683us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.105162 (+1547036us) spinlock_profiling.cc:243] Waited 563 ms on lock 0x7b54003291d0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23ba8ad 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:58.105401 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1294055808}
I20260709 13:00:58.118600  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:00:58.119012  1718 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2578) took 2144 ms (client timeout 1676 ms). Trace:
I20260709 13:00:58.119477  1575 raft_consensus.cc:2468] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 14.
W20260709 13:00:58.119534  1718 rpcz_store.cc:269] 0709 13:00:55.974699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.036324 (+ 61625us) service_pool.cc:224] Handling call
0709 13:00:58.118615 (+2082291us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b54002ab7d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:58.118800 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":426012928}
I20260709 13:00:58.121481  1689 leader_election.cc:304] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:58.121806  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:58.122998  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:58.123277  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:58.123875  1723 raft_consensus.cc:2468] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 13.
I20260709 13:00:58.112174  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 1403) took 2463 ms. Trace:
I20260709 13:00:58.124663  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:58.124476  1570 rpcz_store.cc:276] 0709 13:00:55.648973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.799966 (+1150993us) service_pool.cc:224] Handling call
0709 13:00:57.050746 (+250780us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:57.933006 (+882260us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.111850 (+178844us) spinlock_profiling.cc:243] Waited 881 ms on lock 0x7b540024a4d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:58.112102 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2025839872}
I20260709 13:00:58.125522  1724 raft_consensus.cc:2376] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 8. Re-sending same reply.
I20260709 13:00:58.126021  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:58.126823  1570 raft_consensus.cc:3060] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:00:58.129410  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:58.131762  2330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53290 (request call id 1121) took 2654 ms. Trace:
I20260709 13:00:58.134537  6973 leader_election.cc:290] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:58.138155  6966 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:58.139894  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 49085.7us
I20260709 13:00:58.139894  2329 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53306 (request call id 844) took 1497 ms. Trace:
W20260709 13:00:58.140982  1721 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2570) took 2185 ms (client timeout 1927 ms). Trace:
I20260709 13:00:58.112094  1569 rpcz_store.cc:276] 0709 13:00:55.529468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.538002 (+  8534us) service_pool.cc:224] Handling call
0709 13:00:55.538263 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:55.538441 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:00:56.551844 (+1013403us) log.cc:844] Serialized 14 byte log entry
0709 13:00:57.569961 (+1018117us) log.cc:844] Serialized 14 byte log entry
0709 13:00:57.724707 (+154746us) spinlock_profiling.cc:243] Waited 2.92 ms on lock 0x7b18002f4a60. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef248c0a 00007fa9f8988219 00007fa9ef2d0a40 00007fa9ef2cb4e4 00007fa9ef2cb455 00007fa9f23b3060 00007fa9f23c5716 00007fa9f23d6287 00007fa9f23d6208
0709 13:00:58.110986 (+386279us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:58.111106 (+   120us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:58.111205 (+    99us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.111327 (+   122us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:58.111507 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26055,"prepare.queue_time_us":147716,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":101,"raft.queue_time_us":212850,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":210,"spinlock_wait_cycles":6715776,"thread_start_us":2223822,"threads_started":4,"wal-append.queue_time_us":184712}
I20260709 13:00:58.142292  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:00:58.126116  1724 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2594) took 2088 ms (client timeout 1786 ms). Trace:
I20260709 13:00:58.091094  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:58.095495  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:58.147392  6977 leader_election.cc:290] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:00:58.124449  1723 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2600) took 1877 ms (client timeout 2244 ms). Trace:
I20260709 13:00:58.137154  2325 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53306 (request call id 839) took 2548 ms. Trace:
I20260709 13:00:58.146113  1722 raft_consensus.cc:2376] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 8. Re-sending same reply.
I20260709 13:00:58.151847  1720 raft_consensus.cc:2393] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 10: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
W20260709 13:00:58.153815  1721 rpcz_store.cc:269] 0709 13:00:55.955547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.469399 (+1513852us) service_pool.cc:224] Handling call
0709 13:00:58.140618 (+671219us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b54000e2254. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:58.140776 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":453396864}
I20260709 13:00:58.160010  6994 leader_election.cc:290] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:58.160490  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:58.160614  6708 consensus_queue.cc:1059] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:00:58.161562  1721 raft_consensus.cc:2393] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 10: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
W20260709 13:00:58.162096  1721 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2592) took 2136 ms (client timeout 2557 ms). Trace:
W20260709 13:00:58.162453  1721 rpcz_store.cc:269] 0709 13:00:56.025943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.160141 (+2134198us) service_pool.cc:224] Handling call
0709 13:00:58.162039 (+  1898us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:58.163846  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:58.164948  1721 raft_consensus.cc:2410] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 13:00:58.165480  1721 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:58782 (request call id 1362) took 1562 ms (client timeout 2041 ms). Trace:
W20260709 13:00:58.165894  1721 rpcz_store.cc:269] 0709 13:00:56.602917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.163484 (+1560567us) service_pool.cc:224] Handling call
0709 13:00:58.165408 (+  1924us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:58.167222  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:58.168152  1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2607) took 1605 ms. Trace:
I20260709 13:00:58.150921  2330 rpcz_store.cc:276] 0709 13:00:55.476776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.478807 (+  2031us) service_pool.cc:224] Handling call
0709 13:00:55.492846 (+ 14039us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:55.493046 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:55.518281 (+ 25235us) log.cc:844] Serialized 14 byte log entry
0709 13:00:56.575476 (+1057195us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:56.575527 (+    51us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:56.575573 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.575700 (+   127us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:58.131356 (+1555656us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b5400632250. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23ba8ad 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:58.131581 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32548,"prepare.queue_time_us":25505,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":4694,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":17095,"spinlock_wait_cycles":37931264,"thread_start_us":1056842,"threads_started":1,"wal-append.queue_time_us":1212610}
I20260709 13:00:58.153542  2329 rpcz_store.cc:276] 0709 13:00:56.642277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.642410 (+   133us) service_pool.cc:224] Handling call
0709 13:00:56.705523 (+ 63113us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:57.793632 (+1088109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.139379 (+345747us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54005b5754. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:58.139650 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2315720960}
I20260709 13:00:58.168493  1721 rpcz_store.cc:276] 0709 13:00:56.562443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.166807 (+1604364us) service_pool.cc:224] Handling call
0709 13:00:58.168074 (+  1267us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:58.173141  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 1041) took 2252 ms. Trace:
W20260709 13:00:58.155592  1724 rpcz_store.cc:269] 0709 13:00:56.037339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.650799 (+613460us) service_pool.cc:224] Handling call
0709 13:00:58.124381 (+1473582us) spinlock_profiling.cc:243] Waited 1.43 ms on lock 0x7b5800196e98. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef296b71 00007fa9ef296a22 00007fa9f81afc09 00007fa9f7309ee0 00007fa9f73d30ab 00007fa9f73d3131 00007fa9f73810a0 00007fa9f7380984 00007fa9f08fb6d4 00007fa9f08fb662
0709 13:00:58.126020 (+  1639us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3281664}
W20260709 13:00:58.158843  1723 rpcz_store.cc:269] 0709 13:00:56.246854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.122529 (+1875675us) service_pool.cc:224] Handling call
0709 13:00:58.124400 (+  1871us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:58.184790  1646 rpcz_store.cc:276] 0709 13:00:55.920521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.924857 (+  4336us) service_pool.cc:224] Handling call
0709 13:00:55.989006 (+ 64149us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:55.998406 (+  9400us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:55.998439 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:55.998982 (+   543us) log.cc:844] Serialized 26 byte log entry
0709 13:00:57.230111 (+1231129us) spinlock_profiling.cc:243] Waited 8.98 ms on lock 0x7b1800085240. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef2b0e07 00007fa9f810bab9 00007fa9ef2cd69b 00007fa9ef2cb93f 00007fa9ef2cdc02 00007fa9f1f5520b 00007fa9f1f5ad23 00007fa9f1f5b0d1 00007fa9f2376a0f
0709 13:00:58.019496 (+789385us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:58.019614 (+   118us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.019765 (+   151us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:58.172745 (+152980us) raft_consensus.cc:1685] finished
0709 13:00:58.172772 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:58.173068 (+   296us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":153652,"raft.queue_time_us":30360,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":21087,"spinlock_wait_cycles":20649856,"thread_start_us":788775,"threads_started":1,"wal-append.queue_time_us":2006576}
I20260709 13:00:58.187881  6654 raft_consensus.cc:493] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:58.188547  6654 raft_consensus.cc:3060] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:58.189038  1646 raft_consensus.cc:1240] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 15. Current term is 16. Ops: []
I20260709 13:00:58.189528  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:58.189729  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 1042) took 1589 ms. Trace:
I20260709 13:00:58.173518  6826 leader_election.cc:290] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:00:58.173238  2297 leader_election.cc:304] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:58.192515  6747 raft_consensus.cc:2749] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:00:58.158874  2325 rpcz_store.cc:276] 0709 13:00:55.588563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.848599 (+260036us) service_pool.cc:224] Handling call
0709 13:00:55.848840 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:56.738414 (+889574us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.136695 (+1398281us) spinlock_profiling.cc:243] Waited 811 ms on lock 0x7b5400561154. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:58.136978 (+   283us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1866321792}
I20260709 13:00:58.190079  1646 rpcz_store.cc:276] 0709 13:00:56.600557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.188210 (+1587653us) service_pool.cc:224] Handling call
0709 13:00:58.188691 (+   481us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.189478 (+   787us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.189659 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:58.197160  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 76031.4us
I20260709 13:00:58.198319  1689 leader_election.cc:304] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:58.198625  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 1043) took 1597 ms. Trace:
I20260709 13:00:58.199087  1646 rpcz_store.cc:276] 0709 13:00:56.601211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.197328 (+1596117us) service_pool.cc:224] Handling call
0709 13:00:58.197855 (+   527us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.198240 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:58.198272 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:58.198330 (+    58us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:00:58.198387 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.198446 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:58.198569 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:58.200455  1642 raft_consensus.cc:3060] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:58.205067  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:58.206228  1721 raft_consensus.cc:2393] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 10: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:00:58.206754  1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2579) took 2231 ms. Trace:
I20260709 13:00:58.207175  1721 rpcz_store.cc:276] 0709 13:00:55.974955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.204731 (+2229776us) service_pool.cc:224] Handling call
0709 13:00:58.206703 (+  1972us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:58.190328  1575 raft_consensus.cc:3060] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Advancing to term 13
W20260709 13:00:58.207801  6715 consensus_meta.cc:287] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.748s	user 0.009s	sys 0.009s
I20260709 13:00:58.196364  1570 raft_consensus.cc:2468] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 12.
I20260709 13:00:58.172144  1542 leader_election.cc:304] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
W20260709 13:00:58.177706  1722 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2587) took 2182 ms (client timeout 2341 ms). Trace:
W20260709 13:00:58.216885  1722 rpcz_store.cc:269] 0709 13:00:55.976893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.099452 (+2122559us) service_pool.cc:224] Handling call
0709 13:00:58.159100 (+ 59648us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:58.208567  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:00:58.223620  1718 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2608) took 1660 ms (client timeout 1989 ms). Trace:
W20260709 13:00:58.224130  1718 rpcz_store.cc:269] 0709 13:00:56.562763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.141913 (+1579150us) service_pool.cc:224] Handling call
0709 13:00:58.223560 (+ 81647us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:58.225741  1725 raft_consensus.cc:2468] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 14.
I20260709 13:00:58.229522  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:58.226758  6715 raft_consensus.cc:515] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:58.233911  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:58.234164  1643 raft_consensus.cc:1240] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 13. Current term is 14. Ops: []
I20260709 13:00:58.235934  6715 leader_election.cc:290] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:58.241032  6708 consensus_queue.cc:1243] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer 4dbe7d47a2374afca075d3a98583b49e log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 13:00:58.241470  6652 consensus_meta.cc:287] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 1.180s	user 0.017s	sys 0.004s
I20260709 13:00:58.309505  1644 raft_consensus.cc:2410] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:00:58.309351  6652 raft_consensus.cc:515] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:58.310061  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45148 (request call id 2655) took 1245 ms. Trace:
I20260709 13:00:58.310186  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 17 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:58.310453  1644 rpcz_store.cc:276] 0709 13:00:57.064955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.972331 (+907376us) service_pool.cc:224] Handling call
0709 13:00:58.309981 (+337650us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:58.311867  6652 leader_election.cc:290] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:58.245622  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:58.312215  1644 raft_consensus.cc:1240] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:00:58.250128  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 1044) took 1647 ms. Trace:
I20260709 13:00:58.248200  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:58.257726  7002 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.258081  6660 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:58.260046  1651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45148 (request call id 2653) took 1677 ms. Trace:
I20260709 13:00:58.178566  6980 raft_consensus.cc:2749] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:00:58.176011  6646 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:58.312384  6654 raft_consensus.cc:515] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:58.260492  6915 leader_election.cc:290] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:58.283816  1645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 2083) took 2751 ms. Trace:
I20260709 13:00:58.285498  1719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49996 (request call id 2015) took 2728 ms. Trace:
W20260709 13:00:58.263130  6929 log.cc:927] Time spent T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 1.952s	user 0.003s	sys 0.020s
I20260709 13:00:58.265057  6573 raft_consensus.cc:2804] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:58.288937  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:00:58.265868  6987 leader_election.cc:290] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:58.266609  6933 log.cc:927] Time spent T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 1.478s	user 0.000s	sys 0.006s
W20260709 13:00:58.268450  6940 log.cc:927] Time spent T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 1.957s	user 0.010s	sys 0.026s
I20260709 13:00:58.272716  6994 raft_consensus.cc:2749] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:00:58.274138  1642 raft_consensus.cc:2468] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 15.
I20260709 13:00:58.312572  1576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 1409) took 2614 ms. Trace:
W20260709 13:00:58.283010  6794 consensus_meta.cc:287] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.599s	user 0.006s	sys 0.017s
W20260709 13:00:58.292694  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 94617.1us
I20260709 13:00:58.319005  1648 raft_consensus.cc:1240] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:00:58.328246  1689 leader_election.cc:400] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 election: Vote denied by peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373) with higher term. Message: Invalid argument: T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 11. Current term is 12.
I20260709 13:00:58.296638  6845 leader_election.cc:290] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:58.312834  1569 raft_consensus.cc:2393] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 17: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:58.321064  1651 rpcz_store.cc:276] 0709 13:00:56.582457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.226812 (+1644355us) service_pool.cc:224] Handling call
0709 13:00:58.259182 (+ 32370us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.259610 (+   428us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:58.259639 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:58.259719 (+    80us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:58.259773 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.259836 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:58.259962 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:58.333806  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:58.334738  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36642 (request call id 2679) took 2689 ms. Trace:
I20260709 13:00:58.327107  1646 rpcz_store.cc:276] 0709 13:00:56.602568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.200092 (+1597524us) service_pool.cc:224] Handling call
0709 13:00:58.208489 (+  8397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.249683 (+ 41194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:58.249717 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:58.249783 (+    66us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:00:58.249827 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.249903 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:58.250040 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:58.322608  1572 raft_consensus.cc:3060] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:00:58.296793  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 124756us
I20260709 13:00:58.299994  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:58.326208  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 1047) took 1583 ms. Trace:
I20260709 13:00:58.327013  1718 raft_consensus.cc:2410] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
W20260709 13:00:58.301342  1617 connection.cc:256] RPC call timeout handler was delayed by -1.7075700729999994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3003s for a response
I20260709 13:00:58.303828  6651 raft_consensus.cc:493] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.249356  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:58.325348  1576 rpcz_store.cc:276] 0709 13:00:55.698170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.311264 (+2613094us) service_pool.cc:224] Handling call
0709 13:00:58.311695 (+   431us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.312007 (+   312us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:58.312048 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:58.312110 (+    62us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:58.312158 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.312234 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:58.312473 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:58.306587  1725 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2586) took 2249 ms (client timeout 2144 ms). Trace:
I20260709 13:00:58.340278  1642 rpcz_store.cc:276] 0709 13:00:56.743264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.325023 (+1581759us) service_pool.cc:224] Handling call
0709 13:00:58.325454 (+   431us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.325827 (+   373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:58.325855 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:58.325931 (+    76us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:58.325971 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.326032 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:58.326151 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:58.335289  1568 rpcz_store.cc:276] 0709 13:00:55.645609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.623294 (+977685us) service_pool.cc:224] Handling call
0709 13:00:56.623654 (+   360us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.037646 (+1413992us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.334314 (+296668us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b54003b9054. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:58.334635 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3174356864}
W20260709 13:00:58.374904  1725 rpcz_store.cc:269] 0709 13:00:55.976643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.066116 (+2089473us) service_pool.cc:224] Handling call
0709 13:00:58.226235 (+160119us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:58.321008  1644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 1046) took 1674 ms. Trace:
I20260709 13:00:58.385363  1644 rpcz_store.cc:276] 0709 13:00:56.646173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.311423 (+1665250us) service_pool.cc:224] Handling call
0709 13:00:58.311861 (+   438us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:58.320703 (+  8842us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.320922 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:58.326983  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 1399) took 2768 ms. Trace:
I20260709 13:00:58.321650  1719 rpcz_store.cc:276] 0709 13:00:55.557359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.849048 (+291689us) service_pool.cc:224] Handling call
0709 13:00:55.849303 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:57.058183 (+1208880us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.285076 (+1226893us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b540013bfd4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:58.285332 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2778818432}
I20260709 13:00:58.321988  6660 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:58.390239  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:58.327545  7002 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:58.393499  2297 leader_election.cc:304] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:58.393855  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 1411) took 1796 ms. Trace:
I20260709 13:00:58.394353  1568 rpcz_store.cc:276] 0709 13:00:56.597088 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.392799 (+1795711us) service_pool.cc:224] Handling call
0709 13:00:58.393196 (+   397us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.393474 (+   278us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:58.393505 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:58.393549 (+    44us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:58.393621 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.393676 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:58.393773 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:58.395061  6885 raft_consensus.cc:2749] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:00:58.421399  1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2566) took 2472 ms. Trace:
I20260709 13:00:58.422008  1718 rpcz_store.cc:276] 0709 13:00:55.954316 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.247787 (+2293471us) service_pool.cc:224] Handling call
0709 13:00:58.421317 (+173530us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:58.321277  6646 raft_consensus.cc:3060] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:58.322266  6573 raft_consensus.cc:493] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:58.427340  6573 raft_consensus.cc:3060] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:00:58.432823  6660 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:58.433940  1720 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2565) took 2485 ms (client timeout 2189 ms). Trace:
I20260709 13:00:58.436028  1649 raft_consensus.cc:2468] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 13.
W20260709 13:00:58.434458  1720 rpcz_store.cc:269] 0709 13:00:55.948233 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.092293 (+2144060us) service_pool.cc:224] Handling call
0709 13:00:58.433686 (+341393us) spinlock_profiling.cc:243] Waited 51.4 ms on lock 0x7b5400018454. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:58.433831 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":118226816}
I20260709 13:00:58.437276  1575 raft_consensus.cc:2468] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 13.
W20260709 13:00:58.438467  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 45080.9us
I20260709 13:00:58.446131  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:58.446336  2297 leader_election.cc:304] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:58.321548  1645 rpcz_store.cc:276] 0709 13:00:55.531963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.657336 (+125373us) service_pool.cc:224] Handling call
0709 13:00:55.657910 (+   574us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:55.866311 (+208401us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:55.866340 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:55.866822 (+   482us) log.cc:844] Serialized 26 byte log entry
0709 13:00:56.553450 (+686628us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:56.641447 (+ 87997us) log.cc:844] Serialized 14 byte log entry
0709 13:00:56.721218 (+ 79771us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.282991 (+1561773us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b54002b1954. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:58.283073 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:58.283158 (+    85us) raft_consensus.cc:1685] finished
0709 13:00:58.283309 (+   151us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:58.283602 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":86347,"prepare.queue_time_us":235690,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":84506,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":26113,"spinlock_wait_cycles":478445952,"thread_start_us":773559,"threads_started":2,"wal-append.queue_time_us":766971}
I20260709 13:00:58.424705  6915 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:58.454284  1725 raft_consensus.cc:1275] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:00:58.459937  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:00:58.327639  6794 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:58.465109  1542 leader_election.cc:304] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:00:58.438016  7002 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:58.387743  1567 rpcz_store.cc:276] 0709 13:00:55.558387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.586846 (+ 28459us) service_pool.cc:224] Handling call
0709 13:00:55.587151 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:55.642957 (+ 55806us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:00:55.643001 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:55.643442 (+   441us) log.cc:844] Serialized 26 byte log entry
0709 13:00:56.009569 (+366127us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:56.009613 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:56.009684 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:58.267128 (+2257444us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b4400022b4c. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef1f4c85 00007fa9ef1f56a2 00007fa9f1f671db 00007fa9f1f62aaf 00007fa9f1f5686e 00007fa9f1f55bb6 00007fa9f1f557d8 00007fa9f1f5f221 00007fa9f1f5f1d9 00007fa9f1f5f169
0709 13:00:58.326540 (+ 59412us) raft_consensus.cc:1685] finished
0709 13:00:58.326561 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:58.326810 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64719,"raft.queue_time_us":55826,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":16507,"spinlock_wait_cycles":236340480,"thread_start_us":365823,"threads_started":1,"wal-append.queue_time_us":667500}
I20260709 13:00:58.467971  1725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2572) took 2500 ms. Trace:
I20260709 13:00:58.470510  1725 rpcz_store.cc:276] 0709 13:00:55.956251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.415936 (+2459685us) service_pool.cc:224] Handling call
0709 13:00:58.442956 (+ 27020us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.456679 (+ 13723us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.456868 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:58.470079  1716 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 10.
I20260709 13:00:58.477771  1720 raft_consensus.cc:1275] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:00:58.478694  1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2580) took 2503 ms. Trace:
I20260709 13:00:58.483067  1720 rpcz_store.cc:276] 0709 13:00:55.975196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.441869 (+2466673us) service_pool.cc:224] Handling call
0709 13:00:58.459364 (+ 17495us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.478347 (+ 18983us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.478625 (+   278us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:58.455987  6845 raft_consensus.cc:493] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.480329  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 13:00:58.492086  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 164150us
I20260709 13:00:58.494078  1722 raft_consensus.cc:2376] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 13. Re-sending same reply.
I20260709 13:00:58.505591  6654 leader_election.cc:290] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:58.506610  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 1342) took 3107 ms. Trace:
I20260709 13:00:58.507120  1717 rpcz_store.cc:276] 0709 13:00:55.355105 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.355673 (+   568us) service_pool.cc:224] Handling call
0709 13:00:55.356122 (+   449us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:55.368902 (+ 12780us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:55.368945 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:55.416372 (+ 47427us) log.cc:844] Serialized 26 byte log entry
0709 13:00:55.879888 (+463516us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:55.879943 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:55.880028 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:58.262111 (+2382083us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b4400022b4c. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef1f4c85 00007fa9ef1f56a2 00007fa9f1f671db 00007fa9f1f62aaf 00007fa9f1f5686e 00007fa9f1f55bb6 00007fa9f1f557d8 00007fa9f1f5f221 00007fa9f1f5f1d9 00007fa9f1f5f169
0709 13:00:58.323021 (+ 60910us) raft_consensus.cc:1685] finished
0709 13:00:58.323055 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:58.455583 (+132528us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12477,"raft.queue_time_us":13332,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":11875,"spinlock_wait_cycles":27044608,"thread_start_us":438344,"threads_started":1,"wal-append.queue_time_us":830123}
I20260709 13:00:58.511263  1615 leader_election.cc:304] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:58.512168  6895 raft_consensus.cc:493] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.512828  6894 raft_consensus.cc:493] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.512858  6895 raft_consensus.cc:515] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:58.513765  1717 raft_consensus.cc:1275] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:00:58.513717  6894 raft_consensus.cc:515] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:58.514786  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2598) took 2324 ms. Trace:
I20260709 13:00:58.515276  1717 rpcz_store.cc:276] 0709 13:00:56.190240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.512756 (+2322516us) service_pool.cc:224] Handling call
0709 13:00:58.513211 (+   455us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.514353 (+  1142us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.514681 (+   328us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:58.516085  6895 leader_election.cc:290] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:58.442936  6651 raft_consensus.cc:515] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:58.548009  1724 raft_consensus.cc:1275] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 13:00:58.548141  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:58.526892  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:58.529131  1648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45148 (request call id 2649) took 1949 ms. Trace:
I20260709 13:00:58.535884  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:58.546736  1571 raft_consensus.cc:1240] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:00:58.525518  1718 raft_consensus.cc:1275] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:00:58.546627  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:58.543700  1567 raft_consensus.cc:1240] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 14. Current term is 15. Ops: []
I20260709 13:00:58.602954  1724 pending_rounds.cc:85] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4: Aborting all ops after (but not including) 7
I20260709 13:00:58.517659  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:58.532855  1723 raft_consensus.cc:1275] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 13:00:58.518527  1721 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2576) took 2544 ms (client timeout 3265 ms). Trace:
W20260709 13:00:58.498009  1722 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2567) took 2543 ms (client timeout 3342 ms). Trace:
W20260709 13:00:58.531088  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 83271.2us
W20260709 13:00:58.608623  1722 rpcz_store.cc:269] 0709 13:00:55.954698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.225113 (+2270415us) service_pool.cc:224] Handling call
0709 13:00:58.497938 (+272825us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:58.524152  1574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 1405) took 2859 ms. Trace:
I20260709 13:00:58.620582  1723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2575) took 2633 ms. Trace:
I20260709 13:00:58.621255  1723 rpcz_store.cc:276] 0709 13:00:55.973962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.440172 (+2466210us) service_pool.cc:224] Handling call
0709 13:00:58.490546 (+ 50374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.607556 (+117010us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.607720 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:58.623006  1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2574) took 2640 ms. Trace:
W20260709 13:00:58.609570  1721 rpcz_store.cc:269] 0709 13:00:55.974197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.226532 (+2252335us) service_pool.cc:224] Handling call
0709 13:00:58.518166 (+291634us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b5400387b28. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f8198924 00007fa9f7381227 00007fa9f7380ab8 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:58.518466 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36506880}
I20260709 13:00:58.623564  1718 rpcz_store.cc:276] 0709 13:00:55.973669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.439612 (+2465943us) service_pool.cc:224] Handling call
0709 13:00:58.473833 (+ 34221us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.606271 (+132438us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.613711 (+  7440us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:58.534348  1576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 1410) took 1937 ms. Trace:
W20260709 13:00:58.536685  7006 log.cc:927] Time spent T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:00:58.620349  1574 rpcz_store.cc:276] 0709 13:00:55.664929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.730314 (+2065385us) service_pool.cc:224] Handling call
0709 13:00:57.730721 (+   407us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:57.925354 (+194633us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:57.925434 (+    80us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:57.925534 (+   100us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:00:57.925596 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.523747 (+598151us) spinlock_profiling.cc:243] Waited 194 ms on lock 0x7b5400314554. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:58.523791 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:58.523943 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":446105856}
I20260709 13:00:58.496690  1573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 1408) took 2800 ms. Trace:
I20260709 13:00:58.531042  1688 leader_election.cc:304] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:58.641151  1725 raft_consensus.cc:1275] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 13:00:58.641683  1725 pending_rounds.cc:85] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4: Aborting all ops after (but not including) 6
I20260709 13:00:58.641983  1725 pending_rounds.cc:107] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:00:58.642262  1725 raft_consensus.cc:2889] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:58.642457  1718 raft_consensus.cc:1240] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:00:58.643426  1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2605) took 2081 ms. Trace:
I20260709 13:00:58.643821  1718 rpcz_store.cc:276] 0709 13:00:56.561866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.634885 (+2073019us) service_pool.cc:224] Handling call
0709 13:00:58.642064 (+  7179us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:58.643090 (+  1026us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.643339 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:58.645794  1542 leader_election.cc:304] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:58.646751  6646 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:58.648114  1570 raft_consensus.cc:2393] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 14: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:00:58.648279  1721 raft_consensus.cc:1275] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:00:58.648931  1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2604) took 2087 ms. Trace:
I20260709 13:00:58.626158  2329 raft_consensus.cc:2468] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 14.
W20260709 13:00:58.652936  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 358674us
I20260709 13:00:58.641053  1645 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 10.
I20260709 13:00:58.664877  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:58.666509  6895 raft_consensus.cc:493] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.667104  6895 raft_consensus.cc:515] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:58.668380  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 222182us
W20260709 13:00:58.672909  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 141933us
I20260709 13:00:58.674175  1688 leader_election.cc:304] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:58.674386  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:00:58.675727  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:58.677115  6947 raft_consensus.cc:2804] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:00:58.677878  6947 raft_consensus.cc:697] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 15 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:58.678190  6918 raft_consensus.cc:2804] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:00:58.678709  1539 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:00:58.635035  1576 rpcz_store.cc:276] 0709 13:00:56.596724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.402615 (+1805891us) service_pool.cc:224] Handling call
0709 13:00:58.475628 (+ 73013us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.533868 (+ 58240us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:58.533912 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:58.533988 (+    76us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:58.534045 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.534127 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:58.534258 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:58.650295  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:58.655691  2294 leader_election.cc:304] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:00:58.654018  1721 rpcz_store.cc:276] 0709 13:00:56.561417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.626849 (+2065432us) service_pool.cc:224] Handling call
0709 13:00:58.647930 (+ 21081us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.648644 (+   714us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.648853 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:58.658171  1716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 1361) took 2055 ms. Trace:
I20260709 13:00:58.661528  1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 1359) took 2674 ms. Trace:
I20260709 13:00:58.662263  1568 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 1412) took 2058 ms. Trace:
I20260709 13:00:58.663609  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:00:58.687953  1642 raft_consensus.cc:2393] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 9: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:00:58.664829  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:58.678884  6918 raft_consensus.cc:697] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 13 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:58.649732  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 1360) took 2405 ms. Trace:
I20260709 13:00:58.642606  1725 pending_rounds.cc:107] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:00:58.606998  1724 pending_rounds.cc:107] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 13:00:58.679128  6947 consensus_queue.cc:237] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:58.604425  1648 rpcz_store.cc:276] 0709 13:00:56.579616 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:56.745404 (+165788us) service_pool.cc:224] Handling call
0709 13:00:56.745806 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.328353 (+1582547us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.528861 (+200508us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b54002b3c54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:58.529069 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3609879296}
I20260709 13:00:58.687229  1568 rpcz_store.cc:276] 0709 13:00:56.603970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.395363 (+1791393us) service_pool.cc:224] Handling call
0709 13:00:58.457798 (+ 62435us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.499411 (+ 41613us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:58.499456 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:58.620117 (+120661us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:00:58.661977 (+ 41860us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.662061 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:58.662203 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:58.487430  6589 raft_consensus.cc:2749] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260709 13:00:58.697961  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 300320us
I20260709 13:00:58.699282  1717 rpcz_store.cc:276] 0709 13:00:56.243955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.516361 (+2272406us) service_pool.cc:224] Handling call
0709 13:00:58.621504 (+105143us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.649373 (+ 27869us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:58.649411 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:58.649473 (+    62us) raft_consensus.cc:1645] Marking committed up to 13
0709 13:00:58.649523 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.649579 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:58.649681 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:58.710265  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:58.686781  1720 rpcz_store.cc:276] 0709 13:00:55.987076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.555792 (+2568716us) service_pool.cc:224] Handling call
0709 13:00:58.660910 (+105118us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.661145 (+   235us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:58.661173 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:58.661218 (+    45us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:58.661250 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.661307 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:58.661455 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:58.516918  7005 log.cc:927] Time spent T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 13:00:58.702010  1724 raft_consensus.cc:2889] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:58.702445  1725 raft_consensus.cc:2889] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:00:58.516701  6715 raft_consensus.cc:2804] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:58.686726  1716 rpcz_store.cc:276] 0709 13:00:56.602654 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.656833 (+2054179us) service_pool.cc:224] Handling call
0709 13:00:58.657296 (+   463us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.657688 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:58.657727 (+    39us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:58.657808 (+    81us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:58.657862 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.657943 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:58.658077 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:58.546350  6794 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 15 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:58.640064  1573 rpcz_store.cc:276] 0709 13:00:55.692402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.938260 (+2245858us) service_pool.cc:224] Handling call
0709 13:00:57.938677 (+   417us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:57.939146 (+   469us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:00:58.179121 (+239975us) log.cc:844] Serialized 14 byte log entry
0709 13:00:58.477291 (+298170us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:58.477361 (+    70us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:58.489622 (+ 12261us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.492867 (+  3245us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:58.492978 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":104450,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":75,"raft.queue_time_us":15949,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":6156,"thread_start_us":484616,"threads_started":2}
I20260709 13:00:58.688618  1645 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 10.
I20260709 13:00:58.538522  6977 raft_consensus.cc:3055] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:00:58.725879  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:58.546037  1643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45148 (request call id 2650) took 1965 ms. Trace:
W20260709 13:00:58.710184  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 156371us
I20260709 13:00:58.480940  6915 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:58.698722  6660 raft_consensus.cc:493] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:58.738121  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:58.738920  1575 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 10.
I20260709 13:00:58.732797  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:58.535589  6845 raft_consensus.cc:515] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:58.516336  6894 leader_election.cc:290] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:58.715970  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:00:58.716368  6589 raft_consensus.cc:2804] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:00:58.718163  1646 raft_consensus.cc:1240] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 12. Current term is 13. Ops: []
I20260709 13:00:58.718972  1689 leader_election.cc:304] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:58.715692  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:00:58.746937  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:58.716146  6715 raft_consensus.cc:493] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:00:58.719362  6908 raft_consensus.cc:2749] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:00:58.760805  1572 raft_consensus.cc:2468] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 14.
I20260709 13:00:58.724659  6977 raft_consensus.cc:740] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:58.718945  6646 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:58.731662  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:00:58.771183  1721 raft_consensus.cc:3060] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:00:58.535897  6905 raft_consensus.cc:2749] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:00:58.777650  6918 consensus_queue.cc:237] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:58.712054  1617 connection.cc:256] RPC call timeout handler was delayed by -1.5823732840000275s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3265s for a response
I20260709 13:00:58.498445  6992 raft_consensus.cc:515] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:58.751540  1725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2581) took 2769 ms. Trace:
I20260709 13:00:58.747665  2325 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 10.
I20260709 13:00:58.802182  1725 rpcz_store.cc:276] 0709 13:00:55.975436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.476990 (+2501554us) service_pool.cc:224] Handling call
0709 13:00:58.621941 (+144951us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.744187 (+122246us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.744445 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:58.811486  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:00:58.760026  6984 raft_consensus.cc:493] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:00:58.753078  6589 raft_consensus.cc:493] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:58.765568  6995 raft_consensus.cc:493] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:58.765750  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 1363) took 2027 ms. Trace:
I20260709 13:00:58.766889  1724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2585) took 2790 ms. Trace:
I20260709 13:00:58.768841  1567 raft_consensus.cc:2410] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:00:58.761636  6715 raft_consensus.cc:3060] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:58.817425  1570 raft_consensus.cc:2468] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 12.
I20260709 13:00:58.827680  1724 rpcz_store.cc:276] 0709 13:00:55.976377 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.495214 (+2518837us) service_pool.cc:224] Handling call
0709 13:00:58.547460 (+ 52246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.766586 (+219126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.766819 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:58.732985  6573 raft_consensus.cc:515] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:58.811585  6794 raft_consensus.cc:493] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
W20260709 13:00:58.862039  7007 log.cc:927] Time spent T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
I20260709 13:00:58.813405  6894 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:58.863094  6894 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:58.882485  1725 raft_consensus.cc:3055] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:00:58.883138  1725 raft_consensus.cc:740] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
W20260709 13:00:58.889443  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 60229us
I20260709 13:00:58.728513  1643 rpcz_store.cc:276] 0709 13:00:56.580225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.128202 (+1547977us) service_pool.cc:224] Handling call
0709 13:00:58.128683 (+   481us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.235228 (+106545us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.545778 (+310550us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b5400174dd4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:58.545955 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":242146688}
I20260709 13:00:58.958546  1574 raft_consensus.cc:1240] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 13. Current term is 14. Ops: []
W20260709 13:00:58.888290  1617 leader_election.cc:336] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.698s (SENT)
I20260709 13:00:58.826313  6589 raft_consensus.cc:3060] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:00:58.802167  6660 raft_consensus.cc:515] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:58.959628  1617 leader_election.cc:304] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:00:58.976121  1571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 1407) took 3295 ms. Trace:
I20260709 13:00:58.976722  1571 rpcz_store.cc:276] 0709 13:00:55.680426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:57.935732 (+2255306us) service_pool.cc:224] Handling call
0709 13:00:57.936279 (+   547us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:58.622833 (+686554us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.975776 (+352943us) spinlock_profiling.cc:243] Waited 555 ms on lock 0x7b540017e654. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:58.976046 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1275917184}
W20260709 13:00:59.076561  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 90788.7us
W20260709 13:00:59.094060  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 455298us
I20260709 13:00:58.972558  6885 consensus_queue.cc:1059] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.096s
I20260709 13:00:59.099903  1571 raft_consensus.cc:1275] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:00:59.139623  2296 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.006s	sys 0.018s
W20260709 13:00:59.140286  2296 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.006s	sys 0.018s
W20260709 13:00:59.072328  6652 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.008s	sys 0.017s
W20260709 13:00:59.141136  6652 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.009s	sys 0.017s
I20260709 13:00:58.882572  6984 raft_consensus.cc:515] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:00:59.231434  1722 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.001s	sys 0.009s
W20260709 13:00:59.481509  1722 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.002s	sys 0.009s
W20260709 13:00:59.458492  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 779809us
W20260709 13:00:59.362219  1615 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.000s	sys 0.009s
W20260709 13:00:59.362453  1719 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.813s	user 0.000s	sys 0.011s
W20260709 13:00:59.483613  1719 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.934s	user 0.000s	sys 0.012s
I20260709 13:00:58.826650  1717 rpcz_store.cc:276] 0709 13:00:56.738005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.725654 (+1987649us) service_pool.cc:224] Handling call
0709 13:00:58.765044 (+ 39390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.765337 (+   293us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:58.765372 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:58.765443 (+    71us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:00:58.765486 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.765568 (+    82us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:58.765688 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:59.441152  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:00:59.362744  1647 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.003s	sys 0.007s
W20260709 13:00:59.465725  1650 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.000s	sys 0.011s
W20260709 13:00:59.487965  1647 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.003s	sys 0.009s
W20260709 13:00:59.483338  1615 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.000s	sys 0.010s
W20260709 13:00:59.488044  1650 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.000s	sys 0.012s
I20260709 13:00:59.115170  6995 raft_consensus.cc:515] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:59.490059  1724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 1365) took 1342 ms. Trace:
W20260709 13:00:59.441596  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 628780us
W20260709 13:00:59.237025  1569 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.000s	sys 0.041s
W20260709 13:00:59.495036  1569 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.998s	user 0.008s	sys 0.061s
I20260709 13:00:59.494207  1724 rpcz_store.cc:276] 0709 13:00:58.137310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.832910 (+695600us) service_pool.cc:224] Handling call
0709 13:00:59.466662 (+633752us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:59.478961 (+ 12299us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:59.479011 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:59.479085 (+    74us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:59.479142 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:59.479243 (+   101us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:59.479458 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:00:59.496778  2324 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.765s	user 0.014s	sys 0.023s
W20260709 13:00:59.497191  2324 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.765s	user 0.014s	sys 0.023s
W20260709 13:00:59.236778  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 122080us
I20260709 13:00:59.498833  1539 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
W20260709 13:00:59.429062  6654 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.739s	user 0.015s	sys 0.016s
W20260709 13:00:59.501948  1718 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.000s	sys 0.011s
W20260709 13:00:59.250820  6704 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.722s	user 0.003s	sys 0.010s
W20260709 13:00:59.506523  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 271872us
W20260709 13:00:59.505414  1718 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.000s	sys 0.012s
I20260709 13:00:59.510895  1570 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 2521) took 1519 ms. Trace:
I20260709 13:00:59.511710  1570 rpcz_store.cc:276] 0709 13:00:57.991886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.832668 (+840782us) service_pool.cc:224] Handling call
0709 13:00:59.466253 (+633585us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:59.503893 (+ 37640us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:59.503953 (+    60us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:59.509563 (+  5610us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:59.509878 (+   315us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:59.510184 (+   306us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:59.510693 (+   509us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:59.114413  6794 raft_consensus.cc:515] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:59.502787  6907 raft_consensus.cc:2804] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:00:59.517683  6951 raft_consensus.cc:2749] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:00:59.518841  6885 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:59.521003  6915 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:59.521384  7021 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:59.521656  6713 consensus_queue.cc:1059] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
W20260709 13:00:59.491045  6747 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.005s	sys 0.011s
W20260709 13:00:59.504793  6654 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.850s	user 0.016s	sys 0.016s
W20260709 13:00:59.530068  7008 log.cc:927] Time spent T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.295s	user 0.001s	sys 0.000s
I20260709 13:00:59.491590  6651 leader_election.cc:290] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:00:59.513065  6704 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.978s	user 0.007s	sys 0.011s
I20260709 13:00:59.537348  6573 leader_election.cc:290] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:59.538728  7021 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:00:59.537194  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 688010us
I20260709 13:00:59.540467  6984 leader_election.cc:290] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:59.510792  6894 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:00:59.559785  1721 consensus_meta.cc:287] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.781s	user 0.010s	sys 0.000s
I20260709 13:00:59.578917  1721 raft_consensus.cc:2468] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 11.
I20260709 13:00:59.580240  1721 raft_consensus.cc:3055] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:00:59.580643  1721 raft_consensus.cc:740] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:59.580456  6732 consensus_queue.cc:1059] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:59.581749  1721 consensus_queue.cc:260] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:59.533941  6845 leader_election.cc:290] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:00:59.549973  6747 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.765s	user 0.005s	sys 0.012s
I20260709 13:00:59.795771  1574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 2518) took 1845 ms. Trace:
I20260709 13:00:59.584690  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 1366) took 1441 ms. Trace:
I20260709 13:00:59.796867  1574 rpcz_store.cc:276] 0709 13:00:57.950080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.769304 (+819224us) service_pool.cc:224] Handling call
0709 13:00:58.822766 (+ 53462us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:59.012764 (+189998us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:59.795492 (+782728us) spinlock_profiling.cc:243] Waited 71.1 ms on lock 0x7b54003679d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:00:59.795704 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":163591424}
W20260709 13:00:59.625844  1617 leader_election.cc:336] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.144s (SENT)
W20260709 13:00:59.584424  2295 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.713s	user 0.003s	sys 0.008s
W20260709 13:00:59.799279  2295 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.261s	user 0.017s	sys 0.042s
I20260709 13:00:59.622336  1689 leader_election.cc:304] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
W20260709 13:00:59.799798  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 1.26136e+06us
I20260709 13:00:59.797093  1717 rpcz_store.cc:276] 0709 13:00:58.137596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.495997 (+1358401us) service_pool.cc:224] Handling call
0709 13:00:59.512987 (+ 16990us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:59.565288 (+ 52301us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:59.565334 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:59.565395 (+    61us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:59.578643 (+ 13248us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:59.578735 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:59.578870 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:00:59.794845  1725 consensus_queue.cc:260] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:59.633667  1615 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:00:59.781641  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 196807us
I20260709 13:00:59.795413  6660 leader_election.cc:290] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:00:59.783484  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 266585us
I20260709 13:00:59.783694  6794 leader_election.cc:290] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:00:59.855611  1721 raft_consensus.cc:3060] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:00:59.860659  7002 consensus_queue.cc:1059] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:00:59.861928  7002 raft_consensus.cc:3055] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:00:59.862319  7002 raft_consensus.cc:740] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
W20260709 13:00:59.863441  6715 consensus_meta.cc:287] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.998s	user 0.008s	sys 0.001s
I20260709 13:00:59.866614  1572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 2519) took 1910 ms. Trace:
I20260709 13:00:59.867033  1572 rpcz_store.cc:276] 0709 13:00:57.956568 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.795146 (+838578us) service_pool.cc:224] Handling call
0709 13:00:58.833307 (+ 38161us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.969041 (+135734us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:58.969085 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:58.969144 (+    59us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:58.969190 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:58.969265 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:59.866421 (+897156us) spinlock_profiling.cc:243] Waited 37.7 ms on lock 0x7b5400365bd0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23ba8ad 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:00:59.866550 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":86697344}
I20260709 13:00:59.868820  1725 raft_consensus.cc:3060] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:00:59.871146  7015 log.cc:927] Time spent T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.092s	user 0.002s	sys 0.000s
I20260709 13:00:59.873438  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 2513) took 3985 ms. Trace:
I20260709 13:00:59.874123  7002 consensus_queue.cc:260] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:59.875896  6995 leader_election.cc:290] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:59.873842  1569 rpcz_store.cc:276] 0709 13:00:55.888343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.335048 (+2446705us) service_pool.cc:224] Handling call
0709 13:00:58.335432 (+   384us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:58.443453 (+108021us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:58.443499 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:58.459582 (+ 16083us) log.cc:844] Serialized 26 byte log entry
0709 13:00:59.495543 (+1035961us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:59.495591 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:59.495678 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:59.870439 (+374761us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b4400022b4c. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef1f4c85 00007fa9ef1f56a2 00007fa9f1f671db 00007fa9f1f62aaf 00007fa9f1f5686e 00007fa9f1f55bb6 00007fa9f1f557d8 00007fa9f1f5f221 00007fa9f1f5f1d9 00007fa9f1f5f169
0709 13:00:59.873113 (+  2674us) raft_consensus.cc:1685] finished
0709 13:00:59.873136 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:59.873378 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":97763,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":107,"spinlock_wait_cycles":26392448,"thread_start_us":1000887,"threads_started":1,"wal-append.queue_time_us":1291607}
I20260709 13:00:59.876012  7002 raft_consensus.cc:3060] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:00:59.884825  6669 consensus_queue.cc:1048] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:00:59.894133  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 2101) took 1230 ms. Trace:
I20260709 13:00:59.894685  1647 rpcz_store.cc:276] 0709 13:00:58.663917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.666232 (+  2315us) service_pool.cc:224] Handling call
0709 13:00:58.666761 (+   529us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:00:58.667498 (+   737us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:58.667541 (+    43us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:00:58.698340 (+ 30799us) log.cc:844] Serialized 78 byte log entry
0709 13:00:59.488461 (+790121us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:00:59.488498 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:59.488581 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:59.893841 (+405260us) raft_consensus.cc:1685] finished
0709 13:00:59.893871 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:59.894060 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":29433,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":34975,"thread_start_us":720438,"threads_started":1,"wal-append.queue_time_us":1031532}
I20260709 13:00:59.897624  1725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 1364) took 1760 ms. Trace:
I20260709 13:00:59.898046  1725 rpcz_store.cc:276] 0709 13:00:58.136978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.811099 (+674121us) service_pool.cc:224] Handling call
0709 13:00:58.832400 (+ 21301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:59.794320 (+961920us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b4c00009f40. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f0687a20 00007fa9f0698a29 00007fa9f065e644 00007fa9f0685f2d 00007fa9f0685b93 00007fa9f23b618b 00007fa9f23b6cb5 00007fa9f23b1f30 00007fa9f23b37de 00007fa9f23bdb49 00007fa9f23be416
0709 13:00:59.897266 (+102946us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:00:59.897295 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:59.897333 (+    38us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:00:59.897360 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:59.897431 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:59.897549 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":324024064}
W20260709 13:00:59.900980  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 267369us
I20260709 13:00:59.901242  6977 consensus_queue.cc:260] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:59.619864  6654 raft_consensus.cc:493] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:00:59.596551  6951 raft_consensus.cc:493] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:00:59.863876  6715 raft_consensus.cc:515] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:00:59.588189  6573 raft_consensus.cc:2749] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:00:59.854228  6992 leader_election.cc:290] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:00:59.561676  6885 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:00:59.920109  6947 raft_consensus.cc:3055] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:00:59.941613  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 1414) took 1316 ms. Trace:
W20260709 13:00:59.915356  1649 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.025s	user 0.004s	sys 0.008s
W20260709 13:00:59.943041  1649 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.052s	user 0.004s	sys 0.008s
I20260709 13:00:59.926822  1722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2601) took 3667 ms. Trace:
I20260709 13:00:59.919011  6995 raft_consensus.cc:2749] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:00:59.942085  1567 rpcz_store.cc:276] 0709 13:00:58.625488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.848844 (+223356us) service_pool.cc:224] Handling call
0709 13:00:59.478796 (+629952us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:59.941238 (+462442us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:59.941274 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:59.941321 (+    47us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:59.941362 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:59.941426 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:59.941557 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":54319,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":10112,"thread_start_us":370526,"threads_started":1}
I20260709 13:00:59.918696  6794 raft_consensus.cc:493] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:59.944931  1571 raft_consensus.cc:1240] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:00:59.928022  6894 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:00:59.943684  6947 raft_consensus.cc:740] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:00:59.944062  1722 rpcz_store.cc:276] 0709 13:00:56.259912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.618951 (+2359039us) service_pool.cc:224] Handling call
0709 13:00:58.624492 (+  5541us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:58.672849 (+ 48357us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:58.672879 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:58.673396 (+   517us) log.cc:844] Serialized 26 byte log entry
0709 13:00:59.482392 (+808996us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:59.926243 (+443851us) log.cc:844] Serialized 14 byte log entry
0709 13:00:59.926490 (+   247us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:59.926567 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:00:59.926612 (+    45us) raft_consensus.cc:1685] finished
0709 13:00:59.926636 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:59.926765 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":34145,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":38401,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":99,"thread_start_us":1222875,"threads_started":2,"wal-append.queue_time_us":980090}
I20260709 13:00:59.965529  1615 leader_election.cc:304] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:00:59.973161  2324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:32870 (request call id 733) took 1301 ms. Trace:
W20260709 13:00:59.984754  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 433570us
I20260709 13:00:59.962406  6977 raft_consensus.cc:3060] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:00.140300  2296 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.012s	sys 0.029s
W20260709 13:01:00.143177  2296 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.012s	sys 0.029s
I20260709 13:00:59.941216  6654 raft_consensus.cc:515] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:00.154023  6747 raft_consensus.cc:493] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:00:59.995433  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 388320us
I20260709 13:00:59.978612  2324 rpcz_store.cc:276] 0709 13:00:58.671771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.703555 (+ 31784us) service_pool.cc:224] Handling call
0709 13:00:58.730944 (+ 27389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.731415 (+   471us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:00:58.731775 (+   360us) log.cc:844] Serialized 14 byte log entry
0709 13:00:59.968126 (+1236351us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:59.968189 (+    63us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:00:59.968238 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:59.972886 (+  4648us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:00:59.973085 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":94478,"prepare.queue_time_us":159,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":129234,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":36033,"thread_start_us":1216377,"threads_started":2,"wal-append.queue_time_us":1060338}
W20260709 13:01:00.166817  1617 connection.cc:256] RPC call timeout handler was delayed by -1.5191620869999838s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1726s for a response
W20260709 13:01:00.167447  1617 connection.cc:256] RPC call timeout handler was delayed by -1.5116906189999781s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1666s for a response
I20260709 13:01:00.181030  1615 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:01:00.161773  1642 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.188s	user 0.021s	sys 0.025s
W20260709 13:01:00.189502  1642 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.216s	user 0.022s	sys 0.025s
W20260709 13:01:00.156323  6652 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.017s	sys 0.027s
I20260709 13:00:59.970343  6794 raft_consensus.cc:515] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:00.154846  6747 raft_consensus.cc:515] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:01:00.183758  1617 connection.cc:256] RPC call timeout handler was delayed by -1.4255830459999856s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2169s for a response
I20260709 13:00:59.966446  6951 raft_consensus.cc:515] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:01:00.203656  1723 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.671s	user 0.026s	sys 0.024s
W20260709 13:01:00.252990  1723 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.026s	sys 0.024s
I20260709 13:01:00.191702  6704 raft_consensus.cc:2804] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:01:00.205402  1718 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.013s	sys 0.038s
W20260709 13:01:00.205633  1650 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.013s	sys 0.037s
W20260709 13:01:00.256486  1718 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.013s	sys 0.038s
I20260709 13:01:00.162221  6894 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:00.257011  1721 raft_consensus.cc:1275] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:01:00.257700  1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2606) took 3695 ms. Trace:
I20260709 13:01:00.198805  7021 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:00.206105  6669 consensus_queue.cc:1059] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.014s
W20260709 13:01:00.251389  1617 connection.cc:256] RPC call timeout handler was delayed by -1.42336506099997s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1786s for a response
W20260709 13:01:00.256574  1650 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.014s	sys 0.037s
W20260709 13:01:00.213945  6589 consensus_meta.cc:287] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 1.125s	user 0.012s	sys 0.001s
I20260709 13:01:00.261780  1723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2603) took 3941 ms. Trace:
I20260709 13:01:00.258291  1718 rpcz_store.cc:276] 0709 13:00:56.562179 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.644817 (+2082638us) service_pool.cc:224] Handling call
0709 13:00:58.645357 (+   540us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:58.707695 (+ 62338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:58.707739 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:58.726745 (+ 19006us) log.cc:844] Serialized 26 byte log entry
0709 13:00:59.509103 (+782358us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:59.520892 (+ 11789us) log.cc:844] Serialized 14 byte log entry
0709 13:01:00.257210 (+736318us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:00.257339 (+   129us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:00.257402 (+    63us) raft_consensus.cc:1685] finished
0709 13:01:00.257424 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:00.257622 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63015,"prepare.queue_time_us":11328,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":432042,"raft.run_cpu_time_us":308,"raft.run_wall_time_us":27127,"thread_start_us":1439327,"threads_started":2,"wal-append.queue_time_us":1042951}
W20260709 13:01:00.245353  6652 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.017s	sys 0.027s
I20260709 13:01:00.218971  6660 raft_consensus.cc:2804] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:01:00.275876  1617 connection.cc:256] RPC call timeout handler was delayed by -1.4233026119999863s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20779999999999998s for a response
I20260709 13:01:00.257616  1721 pending_rounds.cc:85] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4: Aborting all ops after (but not including) 9
I20260709 13:01:00.256273  6704 raft_consensus.cc:493] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:00.295974  1721 pending_rounds.cc:107] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:01:00.262133  6715 leader_election.cc:290] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 15 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:00.301199  1721 raft_consensus.cc:2889] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:00.205284  6947 consensus_queue.cc:260] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:00.277861  1723 rpcz_store.cc:276] 0709 13:00:56.320013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.622770 (+2302757us) service_pool.cc:224] Handling call
0709 13:00:58.725936 (+103166us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.855823 (+129887us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 13:00:59.480070 (+624247us) log.cc:844] Serialized 14 byte log entry
0709 13:01:00.261280 (+781210us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:00.261357 (+    77us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:00.261426 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:00.261521 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:00.261711 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":622832,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":8891,"thread_start_us":1133735,"threads_started":2}
I20260709 13:01:00.261292  6980 raft_consensus.cc:2749] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:01:00.297756  1617 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 3.342s (SENT) [suppressed 12 similar messages]
I20260709 13:01:00.279680  6589 raft_consensus.cc:515] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:01:00.338220  6713 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.753s	user 0.021s	sys 0.054s
I20260709 13:01:00.310861  6704 raft_consensus.cc:3060] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:00.374312  1542 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.007s	sys 0.004s
W20260709 13:01:00.377877  1542 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.007s	sys 0.004s
W20260709 13:01:00.378459  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 1.52924e+06us
I20260709 13:01:00.315136  6660 raft_consensus.cc:697] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 12 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
W20260709 13:01:00.392062  1688 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.007s	sys 0.008s
W20260709 13:01:00.393636  1688 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.007s	sys 0.008s
W20260709 13:01:00.395218  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:00.397481  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:00.400009  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.398252  1573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 1413) took 1885 ms. Trace:
W20260709 13:01:00.400848  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:00.374955  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 883177us
W20260709 13:01:00.376173  1645 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.750s	user 0.004s	sys 0.008s
W20260709 13:01:00.402868  1645 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.777s	user 0.004s	sys 0.008s
W20260709 13:01:00.375849  6713 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.805s	user 0.021s	sys 0.054s
I20260709 13:01:00.406986  1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 1373) took 1700 ms. Trace:
I20260709 13:01:00.407517  1721 rpcz_store.cc:276] 0709 13:00:58.706281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.579752 (+873471us) service_pool.cc:224] Handling call
0709 13:00:59.580063 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:00.341161 (+761098us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:00.406919 (+ 65758us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:01:00.400782  1573 rpcz_store.cc:276] 0709 13:00:58.512455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.851569 (+339114us) service_pool.cc:224] Handling call
0709 13:00:59.490507 (+638938us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:59.546314 (+ 55807us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:59.546350 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:00:59.546404 (+    54us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:00:59.546440 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:00.397949 (+851509us) spinlock_profiling.cc:243] Waited 55.6 ms on lock 0x7b5400245254. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:01:00.398014 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:00.398178 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":127865728}
W20260709 13:01:00.409026  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 200064us
I20260709 13:01:00.412499  7046 raft_consensus.cc:493] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.413205  7046 raft_consensus.cc:515] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:00.394179  6669 raft_consensus.cc:3055] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:01:00.418850  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 796646us
W20260709 13:01:00.409412  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 200798us
I20260709 13:01:00.425065  2294 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
W20260709 13:01:00.428581  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 265042us
I20260709 13:01:00.430883  6794 leader_election.cc:290] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:00.431934  1615 leader_election.cc:304] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:00.432585  7040 raft_consensus.cc:493] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:00.433233  7040 raft_consensus.cc:515] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:00.434057  6907 raft_consensus.cc:493] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:00.434515  6907 raft_consensus.cc:3060] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:00.435523  7040 leader_election.cc:290] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:00.437228  6951 leader_election.cc:290] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:01:00.437780  7019 log.cc:927] Time spent T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.922s	user 0.003s	sys 0.008s
W20260709 13:01:00.438603  7048 log.cc:927] Time spent T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:01:00.439270  6589 leader_election.cc:290] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 15 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:00.439808  1571 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36642 (request call id 2687) took 1791 ms. Trace:
I20260709 13:01:00.423425  7034 raft_consensus.cc:493] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.440214  1571 rpcz_store.cc:276] 0709 13:00:58.648702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:59.208809 (+560107us) service_pool.cc:224] Handling call
0709 13:00:59.942498 (+733689us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:59.963229 (+ 20731us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:00.439609 (+476380us) spinlock_profiling.cc:243] Waited 459 ms on lock 0x7b54002ea4d0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23ba8ad 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:01:00.439750 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1056310656}
I20260709 13:01:00.417382  6715 raft_consensus.cc:3060] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:00.569182  6894 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:00.545156  7060 consensus_queue.cc:1048] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:00.633093  1576 raft_consensus.cc:1275] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:01:00.541177  1689 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:00.423950  6669 raft_consensus.cc:740] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:01:00.674724  1567 raft_consensus.cc:1240] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 13:01:00.425590  6947 raft_consensus.cc:3060] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:00.510005  7034 raft_consensus.cc:515] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:00.523451  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:01:00.533206  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 108180us
I20260709 13:01:00.559309  6747 leader_election.cc:290] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:00.540650  7013 consensus_queue.cc:1059] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:01:00.619666  7051 raft_consensus.cc:493] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.674611  6669 consensus_queue.cc:260] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:00.678197  7051 raft_consensus.cc:515] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:00.680373  6703 raft_consensus.cc:3055] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 13:01:00.637934  1459 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 8e94ee9035214526808abfaab11799fe with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 05476b84d8f84d76a9a1f51b620a3c66 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:01:00.680855  6703 raft_consensus.cc:740] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:01:00.675954  7017 raft_consensus.cc:493] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:00.542186  7041 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:00.681579  7017 raft_consensus.cc:515] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:00.681872  6703 consensus_queue.cc:260] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:00.680912  7051 leader_election.cc:290] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:00.542587  7058 raft_consensus.cc:2804] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:01:00.653108  7038 log.cc:927] Time spent T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
W20260709 13:01:00.653587  7035 log.cc:927] Time spent T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.303s	user 0.001s	sys 0.000s
I20260709 13:01:00.635291  6651 raft_consensus.cc:493] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
W20260709 13:01:00.554068  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 256401us
I20260709 13:01:00.539909  7031 raft_consensus.cc:2804] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:01:00.479116  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 47232.1us
I20260709 13:01:00.660897  7067 raft_consensus.cc:493] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:00.459792  1650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 1056) took 1832 ms. Trace:
I20260709 13:01:00.671808  1645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45148 (request call id 2667) took 2002 ms. Trace:
I20260709 13:01:00.521364  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:00.678644  6669 raft_consensus.cc:3060] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:00.681834  7041 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:00.552778  7046 leader_election.cc:290] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:01:00.559825  1542 connection.cc:256] RPC call timeout handler was delayed by -1.497256311000001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2599s for a response
I20260709 13:01:00.692430  1650 rpcz_store.cc:276] 0709 13:00:58.627055 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.640280 (+ 13225us) service_pool.cc:224] Handling call
0709 13:00:58.712418 (+ 72138us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.811983 (+ 99565us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:00:59.492785 (+680802us) log.cc:844] Serialized 14 byte log entry
0709 13:01:00.443638 (+950853us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:00.459206 (+ 15568us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:00.459285 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:00.459407 (+   122us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:00.459719 (+   312us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":728694,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":161705,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":80,"thread_start_us":1545389,"threads_started":3,"wal-append.queue_time_us":889768}
I20260709 13:01:00.558794  6660 consensus_queue.cc:237] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:01:00.680873  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 154341us
I20260709 13:01:00.683651  7051 raft_consensus.cc:2749] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:00.677230  1647 raft_consensus.cc:2468] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 11.
W20260709 13:01:00.692063  1459 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 76408.6us
I20260709 13:01:00.693867  1645 rpcz_store.cc:276] 0709 13:00:58.669875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.725410 (+ 55535us) service_pool.cc:224] Handling call
0709 13:00:59.471199 (+745789us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:59.532077 (+ 60878us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:00:59.594981 (+ 62904us) log.cc:844] Serialized 14 byte log entry
0709 13:01:00.670561 (+1075580us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:00.670620 (+    59us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:00.670678 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:00.671603 (+   925us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:00.671735 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32204,"prepare.queue_time_us":78444,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":56,"raft.queue_time_us":76492,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":15624,"thread_start_us":1010699,"threads_started":2,"wal-append.queue_time_us":934476}
I20260709 13:01:00.683658  6703 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:00.737277  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:01:00.739204  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 59011.8us
I20260709 13:01:00.683946  7017 leader_election.cc:290] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:00.687912  6895 leader_election.cc:290] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:01:00.752182  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 56038.9us
W20260709 13:01:00.752986  1617 connection.cc:256] RPC call timeout handler was delayed by -1.3908383109999818s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1801s for a response
W20260709 13:01:00.753420  1617 connection.cc:256] RPC call timeout handler was delayed by -1.3881407249999711s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23410000000000003s for a response
W20260709 13:01:00.753888  1617 connection.cc:256] RPC call timeout handler was delayed by -1.3608947939999894s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1825s for a response
W20260709 13:01:00.754325  1617 connection.cc:256] RPC call timeout handler was delayed by -1.3048018789999674s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1656s for a response
W20260709 13:01:00.754920  1617 connection.cc:256] RPC call timeout handler was delayed by -1.1171210899999551s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1927s for a response
I20260709 13:01:00.690912  7031 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:00.864965  2297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.865397  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:00.866110  1644 raft_consensus.cc:3060] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:00.867782  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:00.868467  1573 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:00.865310  1688 leader_election.cc:304] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:00.870296  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:00.871968  1647 raft_consensus.cc:2410] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:01:00.871960  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:00.874305  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:00.875089  1572 raft_consensus.cc:2393] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 9: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:01:00.875916  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 13:01:00.876935  1691 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.877190  7041 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:01:00.877918  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 121192us
I20260709 13:01:00.878710  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:00.880350  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:00.709548  7067 raft_consensus.cc:515] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:00.880831  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:00.882721  7067 leader_election.cc:290] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:00.882822  6895 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.883280  7067 raft_consensus.cc:493] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:00.883363  6895 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:01:00.884632  7018 log.cc:927] Time spent T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 1.103s	user 0.004s	sys 0.010s
I20260709 13:01:00.888931  1719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2568) took 4934 ms. Trace:
I20260709 13:01:00.889343  1719 rpcz_store.cc:276] 0709 13:00:55.954999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.391686 (+2436687us) service_pool.cc:224] Handling call
0709 13:00:58.392234 (+   548us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 13:00:58.443455 (+ 51221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:58.443515 (+    60us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 13:00:58.496340 (+ 52825us) log.cc:844] Serialized 78 byte log entry
0709 13:00:59.486751 (+990411us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:59.518465 (+ 31714us) log.cc:844] Serialized 14 byte log entry
0709 13:00:59.847071 (+328606us) log.cc:844] Serialized 14 byte log entry
0709 13:00:59.852830 (+  5759us) log.cc:844] Serialized 14 byte log entry
0709 13:01:00.330854 (+478024us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:00.330947 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:00.438839 (+107892us) spinlock_profiling.cc:243] Waited 4.82 ms on lock 0x7b18003f07c0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef2ce3f3 00007fa9ef2d07c1 00007fa9ef2d0779 00007fa9ef2d0709 00007fa9ef2d06d1 00007fa9ef2cf9cd 000000000038f354 000000000038f199 00007fa9ef2b183a
0709 13:01:00.741632 (+302793us) spinlock_profiling.cc:243] Waited 1.77 ms on lock 0x7b4400022b4c. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef1f4c85 00007fa9ef1f56a2 00007fa9f1f671db 00007fa9f1f62aaf 00007fa9f1f5686e 00007fa9f1f55bb6 00007fa9f1f557d8 00007fa9f1f5f221 00007fa9f1f5f1d9 00007fa9f1f5f169
0709 13:01:00.888700 (+147068us) raft_consensus.cc:1685] finished
0709 13:01:00.888722 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:00.888866 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20723,"prepare.queue_time_us":62109,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":108,"raft.queue_time_us":973352,"raft.run_cpu_time_us":630,"raft.run_wall_time_us":37842,"spinlock_wait_cycles":15174144,"thread_start_us":1688362,"threads_started":3,"wal-append.queue_time_us":1272191}
I20260709 13:01:00.891701  1689 leader_election.cc:304] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:00.892673  7054 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:00.893188  1689 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:00.894378  7052 raft_consensus.cc:2749] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:00.896189  7034 leader_election.cc:290] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:00.897367  7040 raft_consensus.cc:2804] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:00.897827  7040 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:00.898226  7040 raft_consensus.cc:3060] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:00.901310  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:00.883862  7067 raft_consensus.cc:515] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:00.905601  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:01:00.906834  7047 log.cc:927] Time spent T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.382s	user 0.001s	sys 0.000s
I20260709 13:01:00.861852  7031 raft_consensus.cc:3060] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:00.907227  1720 raft_consensus.cc:3055] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:01:00.694676  6651 raft_consensus.cc:515] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:00.909159  7030 raft_consensus.cc:2804] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:00.909626  7030 raft_consensus.cc:493] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:00.909988  7030 raft_consensus.cc:3060] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:00.914301  7042 log.cc:927] Time spent T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.378s	user 0.000s	sys 0.001s
I20260709 13:01:00.907699  1720 raft_consensus.cc:740] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:01:00.903079  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:00.868223  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:00.918025  1573 raft_consensus.cc:2468] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 16.
W20260709 13:01:00.923077  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:00.924842  1575 raft_consensus.cc:2468] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 10.
I20260709 13:01:00.925904  1648 raft_consensus.cc:2468] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 11.
W20260709 13:01:00.929896  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 61616.3us
I20260709 13:01:00.937534  7067 leader_election.cc:290] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:01:00.938360  7055 log.cc:927] Time spent T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.287s	user 0.000s	sys 0.000s
I20260709 13:01:00.939033  1720 consensus_queue.cc:260] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:00.942214  1720 raft_consensus.cc:3060] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:01:00.945664  1617 leader_election.cc:336] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.726s (SENT)
I20260709 13:01:00.946162  1617 leader_election.cc:304] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:00.893210  7054 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:00.948851  1649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 1052) took 2902 ms. Trace:
I20260709 13:01:00.949317  1649 rpcz_store.cc:276] 0709 13:00:58.046053 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.436942 (+390889us) service_pool.cc:224] Handling call
0709 13:00:58.447792 (+ 10850us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.815331 (+367539us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:00:59.945547 (+1130216us) log.cc:844] Serialized 14 byte log entry
0709 13:01:00.524375 (+578828us) log.cc:844] Serialized 14 byte log entry
0709 13:01:00.670959 (+146584us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:00.671011 (+    52us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:00.671058 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:00.948628 (+277570us) spinlock_profiling.cc:243] Waited 358 ms on lock 0x7b54001752d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:01:00.948674 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:00.948791 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":124708,"prepare.queue_time_us":691362,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":2323,"raft.queue_time_us":126996,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"spinlock_wait_cycles":835069056,"thread_start_us":1645423,"threads_started":3,"wal-append.queue_time_us":611184}
I20260709 13:01:00.957266  7040 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:00.957830  6895 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:00.962116  7040 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:00.932426  7017 consensus_queue.cc:1048] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:01:00.989102  6651 leader_election.cc:290] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:01:00.994158  6907 consensus_meta.cc:287] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.559s	user 0.011s	sys 0.000s
W20260709 13:01:00.995000  7002 consensus_meta.cc:287] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 1.112s	user 0.011s	sys 0.000s
I20260709 13:01:00.998435  6715 raft_consensus.cc:2749] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:01:01.000118  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 67074.7us
I20260709 13:01:01.004324  1646 raft_consensus.cc:1240] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:00.994650  6907 raft_consensus.cc:515] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:01:01.007352  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 66501us
I20260709 13:01:01.010715  1644 raft_consensus.cc:2468] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 15.
I20260709 13:01:00.948881  7054 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:01:01.059515  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 56688us
W20260709 13:01:01.057777  1542 leader_election.cc:336] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.599s (SENT)
I20260709 13:01:01.066294  1542 leader_election.cc:304] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:01.074244  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:01:01.075379  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:01.012279  7051 consensus_queue.cc:1059] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:01:01.078296  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:01.083307  7068 raft_consensus.cc:493] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.084089  7068 raft_consensus.cc:515] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:01.086859  7068 leader_election.cc:290] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:01.093498  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:01.093920  7031 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:01:01.096238  7011 log.cc:927] Time spent T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 1.580s	user 0.059s	sys 0.058s
I20260709 13:01:01.093528  7030 raft_consensus.cc:515] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:01.102772  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:01.103153  7031 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:01.103477  2325 raft_consensus.cc:2468] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 13.
I20260709 13:01:01.128400  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:01.129134  1646 raft_consensus.cc:3060] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:01.108292  6977 consensus_meta.cc:287] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.945s	user 0.011s	sys 0.003s
I20260709 13:01:01.102809  6732 raft_consensus.cc:3055] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:01.134166  1720 raft_consensus.cc:1275] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 13:01:01.107362  7067 raft_consensus.cc:2749] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:01.135918  1643 raft_consensus.cc:1217] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 12 LEADER]: Deduplicated request from leader. Original: 8.5->[9.6-11.7]   Dedup: 9.6->[11.7-11.7]
I20260709 13:01:01.137769  1689 leader_election.cc:304] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:01.139431  1643 raft_consensus.cc:1240] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 12 LEADER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 11. Current term is 12. Ops: [9.6-11.7]
I20260709 13:01:01.134665  1720 pending_rounds.cc:85] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4: Aborting all ops after (but not including) 7
I20260709 13:01:01.140622  1720 pending_rounds.cc:107] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:01:01.140933  1720 raft_consensus.cc:2889] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:01.150028  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 103303us
I20260709 13:01:01.132191  6732 raft_consensus.cc:740] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:01:01.162451  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:01.170472  1644 raft_consensus.cc:2468] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 15.
I20260709 13:01:01.146692  7030 leader_election.cc:290] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:01.155936  7054 raft_consensus.cc:2749] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:01.149276  6885 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:01:01.186087  7050 log.cc:927] Time spent T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.664s	user 0.008s	sys 0.012s
I20260709 13:01:01.187361  6654 leader_election.cc:290] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:01.191479  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:01.192124  1717 raft_consensus.cc:2468] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 8.
I20260709 13:01:01.196019  2294 leader_election.cc:304] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
W20260709 13:01:01.211637  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 105762us
I20260709 13:01:01.212589  1689 leader_election.cc:304] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:01.213389  6977 raft_consensus.cc:2749] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:01.215196  7058 raft_consensus.cc:697] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 13 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:01.216065  6977 consensus_queue.cc:1059] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:01.216462  7058 consensus_queue.cc:237] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:01.217252  6977 raft_consensus.cc:3055] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:01.217623  6977 raft_consensus.cc:740] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:01:01.218397  6977 consensus_queue.cc:260] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:01:01.220057  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 510658us
I20260709 13:01:01.220674  6977 raft_consensus.cc:3060] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:01.221489  6652 consensus_queue.cc:1059] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:01.222712  6652 raft_consensus.cc:3055] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:01.223114  6652 raft_consensus.cc:740] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:01.226392  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45148 (request call id 2668) took 2556 ms. Trace:
W20260709 13:01:01.226800  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 281132us
I20260709 13:01:01.227079  7021 raft_consensus.cc:2749] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 13:01:01.227638  1617 leader_election.cc:336] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.786s (SENT)
I20260709 13:01:01.230585  1646 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 11.
I20260709 13:01:01.231688  2294 leader_election.cc:304] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:01.232664  2324 raft_consensus.cc:2468] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 16.
I20260709 13:01:01.216244  1689 leader_election.cc:304] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:01.245076  1651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45148 (request call id 2654) took 4494 ms. Trace:
I20260709 13:01:01.249223  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:01.249541  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:01.226836  1642 rpcz_store.cc:276] 0709 13:00:58.670240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.815194 (+144954us) service_pool.cc:224] Handling call
0709 13:00:58.849109 (+ 33915us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:00:58.957959 (+108850us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 13:01:00.245759 (+1287800us) log.cc:844] Serialized 14 byte log entry
0709 13:01:01.194639 (+948880us) spinlock_profiling.cc:243] Waited 5.42 ms on lock 0x7b18001ab900. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9f1f634bc 00007fa9ef2b148b 00007fa9f810bab9 00007fa9ef2cd69b 00007fa9ef2cb93f 00007fa9ef2cdc02 00007fa9f1f5520b 00007fa9f1f5ad23 00007fa9f1f5b23a
0709 13:01:01.226012 (+ 31373us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:01.226077 (+    65us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:01.226133 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:01.226210 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:01.226339 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":31135,"prepare.queue_time_us":568009,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":31273,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":87,"spinlock_wait_cycles":22521600,"thread_start_us":1633616,"threads_started":2,"wal-append.queue_time_us":377941}
I20260709 13:01:01.245679  1651 rpcz_store.cc:276] 0709 13:00:56.750590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:58.333806 (+1583216us) service_pool.cc:224] Handling call
0709 13:00:58.334208 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:00:58.334769 (+   561us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:00:58.334812 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:00:58.335419 (+   607us) log.cc:844] Serialized 26 byte log entry
0709 13:00:59.441126 (+1105707us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:00:59.441170 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:00:59.441245 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:01.095451 (+1654206us) spinlock_profiling.cc:243] Waited 4.33 ms on lock 0x7b4400022b4c. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef1f4c85 00007fa9ef1f56a2 00007fa9f1f671db 00007fa9f1f62aaf 00007fa9f1f5686e 00007fa9f1f55bb6 00007fa9f1f557d8 00007fa9f1f5f221 00007fa9f1f5f1d9 00007fa9f1f5f169
0709 13:01:01.230518 (+135067us) raft_consensus.cc:1685] finished
0709 13:01:01.230686 (+   168us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:01.244991 (+ 14305us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2922,"raft.queue_time_us":1276,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":24715,"spinlock_wait_cycles":9968512,"thread_start_us":467833,"threads_started":1,"wal-append.queue_time_us":1180405}
I20260709 13:01:01.257877  1645 raft_consensus.cc:2393] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 11: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 13:01:01.258059  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:01.258684  1648 raft_consensus.cc:3060] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:01.258986  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.263978  1649 raft_consensus.cc:1240] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:01.261766  2294 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:01.267738  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:01.270298  1568 raft_consensus.cc:3060] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:01.224078  6652 consensus_queue.cc:260] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:01:01.287294  1691 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.273847  1650 raft_consensus.cc:1275] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 13:01:01.259479  6907 leader_election.cc:290] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:01.274957  6651 raft_consensus.cc:493] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:01.297572  6651 raft_consensus.cc:515] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:01.272502  7030 raft_consensus.cc:493] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.296478  2297 leader_election.cc:304] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:01.258319  6794 raft_consensus.cc:493] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:01:01.273056  7074 raft_consensus.cc:2804] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:01:01.302388  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 74808.1us
W20260709 13:01:01.303956  7029 log.cc:927] Time spent T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 1.536s	user 0.006s	sys 0.008s
I20260709 13:01:01.304687  7045 raft_consensus.cc:2804] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:01.305192  7045 raft_consensus.cc:493] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.305599  7045 raft_consensus.cc:3060] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:01.299042  6845 consensus_queue.cc:1059] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 13:01:01.309690  6845 raft_consensus.cc:3055] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:01.310106  6845 raft_consensus.cc:740] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:01:01.311153  6845 consensus_queue.cc:260] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:01:01.312865  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 96688.7us
I20260709 13:01:01.308761  6912 raft_consensus.cc:2804] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:01.314352  6912 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:01.314787  6912 raft_consensus.cc:3060] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:01.317950  1615 leader_election.cc:304] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 13:01:01.320550  6660 raft_consensus.cc:2804] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:01.321189  6660 raft_consensus.cc:697] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 14 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:01.321637  7021 consensus_queue.cc:1059] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:01.274866  6947 raft_consensus.cc:2749] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:01.322191  6660 consensus_queue.cc:237] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:01.323276  7061 raft_consensus.cc:3055] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:01.323674  7061 raft_consensus.cc:740] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:01.324560  7061 consensus_queue.cc:260] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:01.313800  1689 leader_election.cc:304] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:01.326007  2297 leader_election.cc:304] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:01.326972  1615 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:01.329061  1689 leader_election.cc:304] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:01.330382  1689 leader_election.cc:304] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:01.332827  2297 leader_election.cc:304] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:01.330927  6947 raft_consensus.cc:2749] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:01.331830  6703 consensus_queue.cc:1048] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 13:01:01.332057  6794 raft_consensus.cc:515] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:01.336889  1689 leader_election.cc:304] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:01.327883  7030 raft_consensus.cc:515] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:01.337721  6713 raft_consensus.cc:2749] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:01.338522  6794 leader_election.cc:290] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:01.338389  6713 consensus_queue.cc:1048] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:01:01.352837  1617 leader_election.cc:336] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.801s (SENT)
I20260709 13:01:01.331249  7043 raft_consensus.cc:2804] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:01.338991  7051 raft_consensus.cc:2804] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:01.299610  6732 consensus_queue.cc:260] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:01.339023  7030 leader_election.cc:290] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:01.340457  1689 leader_election.cc:304] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:01.364768  7043 raft_consensus.cc:697] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:01:01.366163  7043 consensus_queue.cc:237] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:01.367771  7040 raft_consensus.cc:2749] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:01.367846  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:01.368340  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:01.368669  7058 raft_consensus.cc:2804] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:01.368957  1717 raft_consensus.cc:2468] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 14.
I20260709 13:01:01.369226  7058 raft_consensus.cc:697] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 16 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:01.369942  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:01.370196  7058 consensus_queue.cc:237] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:01.370493  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:01.371321  1725 raft_consensus.cc:2468] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 15.
W20260709 13:01:01.346239  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.350903  7069 raft_consensus.cc:2749] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:01.347414  7074 raft_consensus.cc:697] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:01:01.373492  7033 raft_consensus.cc:2749] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:01.373212  7074 consensus_queue.cc:237] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:01.374092  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:01:01.342429  6704 consensus_meta.cc:287] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.936s	user 0.010s	sys 0.000s
W20260709 13:01:01.353989  1617 leader_election.cc:336] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.825s (SENT)
I20260709 13:01:01.332104  6977 raft_consensus.cc:2749] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:01.360560  1615 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:01.361261  7051 raft_consensus.cc:493] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.370729  1720 raft_consensus.cc:2410] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 8.
I20260709 13:01:01.380439  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:01.371409  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:01.381656  1721 raft_consensus.cc:2468] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 13.
I20260709 13:01:01.372154  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:01.375239  1617 leader_election.cc:304] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:01.359778  1648 raft_consensus.cc:2468] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 12.
I20260709 13:01:01.342320  7061 raft_consensus.cc:3060] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:01.379490  6704 raft_consensus.cc:515] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:01.379874  6732 raft_consensus.cc:3060] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:01.417166  1568 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 11.
I20260709 13:01:01.359340  6651 leader_election.cc:290] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:01.347661  6845 raft_consensus.cc:3060] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:01.431105  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 49717.7us
I20260709 13:01:01.433204  1723 raft_consensus.cc:2468] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 10.
I20260709 13:01:01.441556  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:01.442683  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:01.443413  1570 raft_consensus.cc:2393] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 15: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:01:01.432868  7051 raft_consensus.cc:3060] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:01.092650   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:01.435025  2297 leader_election.cc:304] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:01.455312  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:01.456176  1717 raft_consensus.cc:2468] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 11.
I20260709 13:01:01.458267  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:01.458904  1725 raft_consensus.cc:2468] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 10.
I20260709 13:01:01.461994  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:01:01.462273  1615 connection.cc:256] RPC call timeout handler was delayed by -2.1005154690000154s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1544s for a response
I20260709 13:01:01.462496  1716 raft_consensus.cc:1217] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Deduplicated request from leader. Original: 9.5->[11.6-16.9]   Dedup: 12.7->[14.8-16.9]
I20260709 13:01:01.464478  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:01.465031  1645 raft_consensus.cc:2468] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 12.
I20260709 13:01:01.465773  1645 raft_consensus.cc:1240] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:01.433097  7066 raft_consensus.cc:2804] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:01.462983  1716 pending_rounds.cc:85] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4: Aborting all ops after (but not including) 7
I20260709 13:01:01.475893  1716 pending_rounds.cc:107] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4: Aborting uncommitted NO_OP operation due to leader change: 15.8
I20260709 13:01:01.476200  1716 raft_consensus.cc:2889] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:01.476301  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:01.470610  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:01.462641  1574 raft_consensus.cc:2468] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 11.
I20260709 13:01:01.476982  1567 raft_consensus.cc:3060] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:01.474762  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:01.478063  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:01.478129  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:01.478737  1647 raft_consensus.cc:2468] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 12.
I20260709 13:01:01.368515  7040 consensus_queue.cc:1048] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.093s
I20260709 13:01:01.480636  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:01.481452  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:01.481956  1644 raft_consensus.cc:3060] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:01.469990  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:01.474231  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:01.483039  1573 raft_consensus.cc:2468] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 13.
I20260709 13:01:01.483382  2294 leader_election.cc:304] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:01.459873  6951 raft_consensus.cc:2749] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:01.487166  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:01.484637  1688 leader_election.cc:304] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:01.489354  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:01.489996  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:01.490792  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:01.493498  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:01.467036  7069 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.466861  6715 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:01.499577  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:01:01.498319  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 144344us
I20260709 13:01:01.492275  1643 raft_consensus.cc:2468] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 12.
I20260709 13:01:01.494959  1568 raft_consensus.cc:1240] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:01.509753  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:01.475821  7066 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:01.514181  1717 raft_consensus.cc:2393] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 11: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
W20260709 13:01:01.515424  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.480494  7013 raft_consensus.cc:2804] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:01.488006  6713 consensus_queue.cc:1048] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:01:01.491438  6589 raft_consensus.cc:2804] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:01.475344  7067 consensus_queue.cc:1059] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:01:01.530455  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:01.532069  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:01.534245  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:01.535051  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:01.544777  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:01.545408  1725 raft_consensus.cc:2468] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 13.
I20260709 13:01:01.537643  7045 raft_consensus.cc:515] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:01.516440  6715 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:01.525236  6589 raft_consensus.cc:493] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:01.512377  6977 raft_consensus.cc:2804] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:01.549033  1567 raft_consensus.cc:2468] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 15.
I20260709 13:01:01.557664  1644 raft_consensus.cc:2468] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 14.
W20260709 13:01:01.560791  1617 leader_election.cc:336] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.927s (SENT)
I20260709 13:01:01.517877  7066 raft_consensus.cc:3060] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:01.567579  1617 leader_election.cc:304] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:01.570631  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:01.573201  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:01.574401  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:01.574401  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:01.575284  1725 raft_consensus.cc:2468] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 12.
I20260709 13:01:01.575902  1647 raft_consensus.cc:2368] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 11. Current term is 12.
I20260709 13:01:01.579974  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:01.580799  1644 raft_consensus.cc:2468] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 15.
I20260709 13:01:01.586287  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:01.587015  1643 raft_consensus.cc:2468] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 9.
I20260709 13:01:01.589042  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 13:01:01.590787  7062 log.cc:927] Time spent T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.957s	user 0.001s	sys 0.003s
I20260709 13:01:01.566854  6589 raft_consensus.cc:3060] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:01.592767  6986 raft_consensus.cc:493] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.593272  6986 raft_consensus.cc:515] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:01.598160  2324 raft_consensus.cc:1240] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 LEADER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:01.513454  7069 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:01.603307  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:01.603590  6747 raft_consensus.cc:3055] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:01.609658  6715 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:01.575423  6977 raft_consensus.cc:697] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 12 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:01:01.611379  7045 leader_election.cc:290] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:01.624306  6977 consensus_queue.cc:237] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:01.625748  6589 raft_consensus.cc:515] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:01.613651  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:01.629603  1725 raft_consensus.cc:3060] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:01.599202  7059 consensus_queue.cc:1048] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.192s
I20260709 13:01:01.638998  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:01.621021  7058 raft_consensus.cc:2749] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:01.620947  6747 raft_consensus.cc:740] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:01:01.642014  2327 raft_consensus.cc:2393] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 13: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 13:01:01.641861  6747 consensus_queue.cc:260] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:01.643319  6747 raft_consensus.cc:3060] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:01.616664  7046 raft_consensus.cc:493] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.648380  7046 raft_consensus.cc:515] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:01.636234  1719 raft_consensus.cc:2468] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 9.
I20260709 13:01:01.630614  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:01.656060  1717 raft_consensus.cc:2410] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:01:01.679893  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:01.681885  1725 raft_consensus.cc:2410] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:01:01.687659  2325 raft_consensus.cc:1240] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 12. Current term is 13. Ops: []
W20260709 13:01:01.699573  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 138818us
I20260709 13:01:01.706096  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:01.708468  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:01.709100  1717 raft_consensus.cc:3060] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:01.695230  6589 leader_election.cc:290] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:01.716711  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:01.717394  1646 raft_consensus.cc:3060] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:01:01.723111  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:01.698614  6912 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:01.730305  6912 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 16 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:01.730587  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:01.731089  2329 raft_consensus.cc:1240] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:01.731848  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:01.732977  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:01.738481  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:01.739086  1725 raft_consensus.cc:2468] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 9.
I20260709 13:01:01.741175  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:01.743708  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:01.748608  7013 raft_consensus.cc:493] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:01.748795  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:01.749194  7013 raft_consensus.cc:3060] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:01.753067  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:01.753748  1644 raft_consensus.cc:2468] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 12.
I20260709 13:01:01.753399  6895 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.754694  6895 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:01.757682  6895 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:01.759244  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:01.759917  2329 raft_consensus.cc:2468] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 17.
I20260709 13:01:01.762006  6652 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:01.763273  7069 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:01.764252  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:01.764451  7046 leader_election.cc:290] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:01.764859  1644 raft_consensus.cc:2468] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 17.
I20260709 13:01:01.753365  7051 raft_consensus.cc:515] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:01.806648  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:01.807354  1644 raft_consensus.cc:2468] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 12.
I20260709 13:01:01.808221  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:01.809065  1644 raft_consensus.cc:2393] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 15: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:01:01.809298  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:01.809520  1719 raft_consensus.cc:1240] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 15 LEADER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:01.809795  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:01.809898  1716 raft_consensus.cc:2468] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 8.
I20260709 13:01:01.810745  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:01.810858  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:01.811221  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:01.811700  1644 raft_consensus.cc:2393] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 11: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 13:01:01.811896  1716 raft_consensus.cc:2468] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 10.
I20260709 13:01:01.812649  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:01.811353  1650 raft_consensus.cc:2376] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 14. Re-sending same reply.
I20260709 13:01:01.813213  1649 raft_consensus.cc:1240] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:01.813642  1644 raft_consensus.cc:2393] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 9: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:01:01.813947  7070 raft_consensus.cc:3055] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:01.818708  1717 raft_consensus.cc:2468] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 14.
I20260709 13:01:01.821559  1645 raft_consensus.cc:2468] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 14.
W20260709 13:01:01.822393  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:01.825887  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 104136us
I20260709 13:01:01.827260  1570 raft_consensus.cc:1240] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:01:01.833627  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:01:01.826655  1617 leader_election.cc:336] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.078s (SENT)
I20260709 13:01:01.834980  1617 leader_election.cc:304] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:01.814366  7070 raft_consensus.cc:740] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:01:01.840399  1647 raft_consensus.cc:1240] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:01.840726  1646 raft_consensus.cc:2468] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 13.
I20260709 13:01:01.841909  2294 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:01.844261  7058 raft_consensus.cc:2749] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:01.844446  2294 leader_election.cc:304] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:01.845332  6703 raft_consensus.cc:2804] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:01.845820  6703 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:01.845392  7070 consensus_queue.cc:260] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:01.846144  6703 raft_consensus.cc:3060] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:01.846515  7070 raft_consensus.cc:3060] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:01.849222  7060 raft_consensus.cc:2804] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:01.820497  6907 raft_consensus.cc:493] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.860184  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:01.860834  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:01.860942  1716 raft_consensus.cc:2468] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 14.
W20260709 13:01:01.867581  1691 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:01.858220  6907 raft_consensus.cc:515] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:01.871451  6907 leader_election.cc:290] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:01.873128  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:01.873955  1725 raft_consensus.cc:2393] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 11: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:01:01.874042  6986 leader_election.cc:290] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:01.873235  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:01.874776  1719 raft_consensus.cc:2468] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 12.
I20260709 13:01:01.875223  1721 raft_consensus.cc:1240] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:01.875438  6845 raft_consensus.cc:493] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.875883  6845 raft_consensus.cc:515] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:01.878072  6713 raft_consensus.cc:493] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:01.878567  6713 raft_consensus.cc:515] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:01.879843  1719 pending_rounds.cc:85] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4: Aborting all ops after (but not including) 7
I20260709 13:01:01.880134  1719 pending_rounds.cc:107] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 13:01:01.880604  6713 leader_election.cc:290] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:01.883340  7013 raft_consensus.cc:515] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:01.849754  7060 raft_consensus.cc:697] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:01:01.885492  7060 consensus_queue.cc:237] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:01.886154  6704 leader_election.cc:290] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:01.888484  1642 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 15.
I20260709 13:01:01.889317  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:01.880362  1719 raft_consensus.cc:2889] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:01.890041  1649 raft_consensus.cc:2393] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 12: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:01:01.895180  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:01.899839  7069 raft_consensus.cc:493] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:01.900363  7069 raft_consensus.cc:515] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:01.901443  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:01.902374  7069 leader_election.cc:290] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:01.902513  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:01.902629  1615 leader_election.cc:304] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:01.903319  1645 raft_consensus.cc:2393] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 13: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:01:01.896013  1723 raft_consensus.cc:2468] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 11.
I20260709 13:01:01.907552  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:01.907891  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:01.908166  1717 raft_consensus.cc:2468] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 10.
I20260709 13:01:01.899881  7051 leader_election.cc:290] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:01.909026  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:01.909750  1646 raft_consensus.cc:2468] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 17.
I20260709 13:01:01.910234  2295 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:01.912726  7074 raft_consensus.cc:2804] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:01.913247  7074 raft_consensus.cc:697] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
W20260709 13:01:01.915146  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 88531us
I20260709 13:01:01.916044  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:01.914179  7074 consensus_queue.cc:237] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:01.978412  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:02.069985  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:01:02.072130  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:02.035629  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:02.071643  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 92672.9us
I20260709 13:01:02.002166  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:02.074529  1723 raft_consensus.cc:2468] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 14.
I20260709 13:01:02.009665  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:02.072393  1720 raft_consensus.cc:2468] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 10.
I20260709 13:01:02.084991  1717 raft_consensus.cc:3060] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:01.947362  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 44815.1us
I20260709 13:01:01.934221  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:02.078292  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:02.079070  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:02.084195  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
W20260709 13:01:02.002175  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 89635.9us
I20260709 13:01:02.101552  1615 leader_election.cc:304] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:02.101989  1570 raft_consensus.cc:2468] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 17.
I20260709 13:01:02.102675  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:01:02.022176  7107 log.cc:927] Time spent T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
W20260709 13:01:02.074316  7011 log.cc:927] Time spent T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:01:02.103782  1540 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:01.914606  7013 leader_election.cc:290] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:02.112231  6794 consensus_queue.cc:1059] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:02.104146  6907 consensus_queue.cc:1059] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 13:01:02.116706  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:02.118021  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:02.116752  7046 consensus_queue.cc:1059] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
W20260709 13:01:02.122140  7066 consensus_meta.cc:287] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.539s	user 0.008s	sys 0.001s
I20260709 13:01:02.125114  1539 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 13:01:02.126272  2295 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:01:01.933828  7103 log.cc:927] Time spent T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 13:01:01.914532  6845 leader_election.cc:290] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:01.932569  7061 raft_consensus.cc:2764] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:01:02.053064  7070 raft_consensus.cc:493] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:02.070206  1471 catalog_manager.cc:5697] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 8 to 9, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 9 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:02.138710  1617 leader_election.cc:336] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.189s (SENT)
I20260709 13:01:02.146201  1720 raft_consensus.cc:2410] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:01:02.147960  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:02.180405  1617 leader_election.cc:304] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:02.149574  1717 raft_consensus.cc:2468] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 13.
I20260709 13:01:02.176712  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:02.181449  1576 raft_consensus.cc:2468] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 17.
I20260709 13:01:02.180696  2330 raft_consensus.cc:1275] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:01:02.177048  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:02.122761  7058 raft_consensus.cc:2804] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:01:02.180334  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 52881.9us
I20260709 13:01:02.184863  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:02.185817  1725 raft_consensus.cc:2468] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 15.
I20260709 13:01:02.186969  2297 leader_election.cc:304] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:02.187522  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:02.190833  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:02.191483  1717 raft_consensus.cc:2468] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 13.
I20260709 13:01:02.192150  2331 raft_consensus.cc:1275] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260709 13:01:02.192695  2331 pending_rounds.cc:85] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66: Aborting all ops after (but not including) 9
I20260709 13:01:02.193051  2331 pending_rounds.cc:107] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 13:01:02.193395  2331 raft_consensus.cc:2889] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:02.188433  1716 raft_consensus.cc:2468] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 12.
I20260709 13:01:01.945541  6895 consensus_queue.cc:1059] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.231s
I20260709 13:01:02.141093  7067 raft_consensus.cc:2804] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:01:02.198945  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 72748.7us
I20260709 13:01:02.202353  1642 raft_consensus.cc:1275] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:01:02.205273  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:02.216560  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:02.212493  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:02.219460  1717 raft_consensus.cc:2468] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 13.
I20260709 13:01:02.189273  7058 raft_consensus.cc:493] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:01:02.223047  7071 raft_consensus.cc:2804] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:02.223251  7058 raft_consensus.cc:3060] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:02.223527  7071 raft_consensus.cc:493] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:02.223944  7071 raft_consensus.cc:3060] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:02.216764  6660 raft_consensus.cc:2749] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:02.203051  7067 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:02.228911  7067 raft_consensus.cc:3060] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:02.232079  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:02.234081  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:02.235805  2295 leader_election.cc:304] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:02.215585  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:02.240792  1716 raft_consensus.cc:2393] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 9: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:01:02.202855  7031 raft_consensus.cc:2749] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:02.212806  1471 catalog_manager.cc:5697] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:02.248271  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:02.254364  1724 raft_consensus.cc:2376] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 9. Re-sending same reply.
I20260709 13:01:02.255707  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:02.262305  1724 raft_consensus.cc:2410] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 13:01:02.249384  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:02.189889  7070 raft_consensus.cc:515] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:02.262786  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:02.262843  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:02.266250  1615 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:02.266222  1720 raft_consensus.cc:3060] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:02.266944  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:02.259059  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:02.264073  1725 raft_consensus.cc:2468] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 14.
I20260709 13:01:02.267773  1724 raft_consensus.cc:2376] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 14. Re-sending same reply.
I20260709 13:01:02.270680  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:02.270911  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:02.271327  1723 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 15.
I20260709 13:01:02.272785  7013 raft_consensus.cc:2749] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:02.274583  2297 leader_election.cc:304] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:02.275856  2297 leader_election.cc:304] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:02.272298  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:02.277766  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:02.277920  1615 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:02.278111  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:02.279373  1722 raft_consensus.cc:2393] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 11: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:01:02.277022  1723 raft_consensus.cc:2468] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 12.
I20260709 13:01:02.285014  1644 raft_consensus.cc:3055] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:02.285425  1644 raft_consensus.cc:740] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:02.288146  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:02.290329  1650 raft_consensus.cc:1275] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:01:02.289880  6915 raft_consensus.cc:3060] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:02.281443  6652 raft_consensus.cc:2749] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:02.297163  6845 consensus_queue.cc:1048] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:02.286172  1644 consensus_queue.cc:260] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:02.280886  7028 raft_consensus.cc:2749] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:02.301090  1644 raft_consensus.cc:3060] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:02.307060  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 168441us
W20260709 13:01:02.308591  1617 leader_election.cc:336] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.341s (SENT)
W20260709 13:01:02.311224  1617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:02.312073  1617 connection.cc:256] RPC call timeout handler was delayed by -1.2120038099999988s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1519s for a response
I20260709 13:01:02.313856  7070 leader_election.cc:290] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:02.323177  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:02.323335  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:02.327490  1644 raft_consensus.cc:1275] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:01:02.328126  1570 raft_consensus.cc:1275] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:01:02.329291  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 45436.1us
I20260709 13:01:02.307854  6703 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:02.324139  1716 raft_consensus.cc:2468] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 11.
I20260709 13:01:02.292300  1615 leader_election.cc:304] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:02.337584  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:02.353464  2330 raft_consensus.cc:2468] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 14.
I20260709 13:01:02.339781  2297 leader_election.cc:304] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:02.354300  6703 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 18 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:02.354921  6703 raft_consensus.cc:2749] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:02.355744  1540 leader_election.cc:304] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:02.338009  6915 raft_consensus.cc:2749] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:01:02.342885  7106 log.cc:927] Time spent T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:01:02.345501  1725 raft_consensus.cc:1275] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:01:02.358116  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 65884.9us
I20260709 13:01:02.358773  1615 leader_election.cc:304] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:02.359663  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:02.359937  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:02.360489  7117 raft_consensus.cc:2804] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:02.360960  7117 raft_consensus.cc:493] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:02.361364  7117 raft_consensus.cc:3060] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:02.364379  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:02.279189  6907 raft_consensus.cc:3055] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:02.365849  6907 raft_consensus.cc:740] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:01:02.367003  6907 consensus_queue.cc:260] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:02.196309  7066 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:02.369150  7044 consensus_queue.cc:1059] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:02.370069  7044 raft_consensus.cc:3055] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:02.370256  1615 leader_election.cc:304] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:02.370476  7044 raft_consensus.cc:740] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:02.370702  7066 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:02.371150  6652 raft_consensus.cc:3060] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:02.371850  1648 raft_consensus.cc:1240] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:02.371507  7044 consensus_queue.cc:260] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:02.372962  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:02.377004  1471 catalog_manager.cc:5697] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:02.378877  1471 catalog_manager.cc:5697] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 6 to 7, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 7 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:02.380020  1615 leader_election.cc:304] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:02.381502  6652 raft_consensus.cc:2749] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:02.383302  7117 raft_consensus.cc:515] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:02.384918  6907 raft_consensus.cc:3060] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:02.385645  7117 leader_election.cc:290] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:02.386369  6660 raft_consensus.cc:2804] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader election won for term 15
W20260709 13:01:02.386785  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 55695.5us
I20260709 13:01:02.386922  6660 raft_consensus.cc:697] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 15 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:02.333734  1720 raft_consensus.cc:2468] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 14.
W20260709 13:01:02.390103  1691 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.387874  6660 consensus_queue.cc:237] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:02.392921  7013 consensus_queue.cc:1048] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:02.321368  6747 raft_consensus.cc:2749] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:02.394830  1615 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:02.396063  7115 raft_consensus.cc:2804] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:02.396495  7115 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:02.396915  7115 raft_consensus.cc:3060] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:02.348696  7033 consensus_queue.cc:1048] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:02.401345  2324 raft_consensus.cc:1240] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 LEADER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:01:02.401412  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 13:01:02.367906  1474 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48478 (request call id 177) took 23102 ms (client timeout 15000 ms). Trace:
I20260709 13:01:02.404881  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:02.406419  7033 consensus_queue.cc:1059] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:02.407330  7115 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:02.407774  7033 raft_consensus.cc:3055] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:02.407927  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:02.408665  1651 raft_consensus.cc:3060] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:02.409664  7115 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 18 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:02.410600  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:02.413199  1649 raft_consensus.cc:1275] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:02.412326  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:02.416700  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:02.402825  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:02.418319  1568 raft_consensus.cc:2410] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:01:02.403581  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:02.419127  1567 raft_consensus.cc:2393] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 13: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:01:02.420980  2330 raft_consensus.cc:1240] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:02.421072  1569 raft_consensus.cc:1275] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 13:01:02.433434  1567 raft_consensus.cc:1275] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:01:02.435001  6747 consensus_queue.cc:1048] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:02.436570  1572 raft_consensus.cc:1275] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:01:02.447250  7044 raft_consensus.cc:3060] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:02.448513  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:02.408357  7033 raft_consensus.cc:740] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:01:02.451704  7033 consensus_queue.cc:260] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:02.453845  7033 raft_consensus.cc:3060] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:02.454221  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:02.380429  1471 catalog_manager.cc:5697] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:01:02.458007  1471 catalog_manager.cc:5697] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 9 to 12, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 12 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:02.461038  1471 catalog_manager.cc:5697] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 9 to 10, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 10 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } }
I20260709 13:01:03.053256  1471 catalog_manager.cc:5697] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:03.054855  1471 catalog_manager.cc:5697] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 8 to 11, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 11 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:02.404131  1474 rpcz_store.cc:269] 0709 13:00:39.265075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:39.272680 (+  7605us) service_pool.cc:224] Handling call
0709 13:00:40.938787 (+1666107us) spinlock_profiling.cc:243] Waited 34.2 ms on lock 0x7b5400002490. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef296b71 00007fa9ef2970b2 00007fa9f8210a89 00007fa9f81a8da6 00007fa9f817a088 00007fa9f827837e 00007fa9f67392a4 00007fa9f6739232 00007fa9f6739161 00007fa9f67390dc
0709 13:01:02.367654 (+21428867us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:00:53.705608 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:00:53.706216 (+   608us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:00:53.706254 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:00:53.706274 (+    20us) tablet.cc:662] Decoding operations
0709 13:00:53.707345 (+  1071us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:00:53.707425 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 13:00:53.707455 (+    30us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:00:53.708483 (+  1028us) tablet.cc:701] Row locks acquired
0709 13:00:53.708503 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:00:53.738274 (+ 29771us) write_op.cc:270] Start()
0709 13:00:53.752820 (+ 14546us) write_op.cc:276] Timestamp: P: 1783602053738200 usec, L: 0
0709 13:00:53.752857 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 13:00:53.753647 (+   790us) log.cc:844] Serialized 4430 byte log entry
0709 13:00:54.152215 (+398568us) op_driver.cc:464] REPLICATION: finished
0709 13:00:54.989007 (+836792us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b4400022b4c. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef1f4c85 00007fa9ef1f56a2 00007fa9f1f671db 00007fa9f1f62aaf 00007fa9ef2b10ac 00007fa9f810bab9 00007fa9ef2cd69b 00007fa9ef2cb93f 00007fa9ef2cdc02 00007fa9f5df1ef0
0709 13:00:55.239612 (+250605us) write_op.cc:301] APPLY: starting
0709 13:00:55.243568 (+  3956us) tablet.cc:1367] starting BulkCheckPresence
0709 13:00:55.435787 (+192219us) tablet.cc:1370] finished BulkCheckPresence
0709 13:00:55.450858 (+ 15071us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:00:55.520735 (+ 69877us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:00:55.521006 (+   271us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 13:00:55.521058 (+    52us) write_op.cc:312] APPLY: finished
0709 13:00:55.521373 (+   315us) log.cc:844] Serialized 105 byte log entry
0709 13:00:56.030421 (+509048us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:56.072924 (+ 42503us) write_op.cc:454] Released schema lock
0709 13:00:56.073009 (+    85us) write_op.cc:341] FINISH: Updating metrics
0709 13:00:56.213897 (+140888us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:00:56.217738 (+  3841us) write_op.cc:454] Released schema lock
0709 13:00:57.867819 (+1650081us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b4400022b4c. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef1f4c85 00007fa9ef1f56a2 00007fa9f1f671db 00007fa9f1f62aaf 00007fa9f1f5686e 00007fa9f1f55bb6 00007fa9f1f557d8 00007fa9f1f5f221 00007fa9f1f5f1d9 00007fa9f1f5f169
Metrics: {"mutex_wait_us":862422,"reported_tablets":30,"spinlock_wait_cycles":78737920,"child_traces":[["op",{"apply.queue_time_us":1072526,"apply.run_cpu_time_us":55286,"apply.run_wall_time_us":898510,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50107,"num_ops":11,"prepare.queue_time_us":315439,"prepare.run_cpu_time_us":16892,"prepare.run_wall_time_us":162405,"raft.queue_time_us":175245,"raft.run_cpu_time_us":33627,"raft.run_wall_time_us":1059445,"replication_time_us":399193,"spinlock_wait_cycles":263471232,"thread_start_us":1872976,"threads_started":5,"wal-append.queue_time_us":922018,"wal-append.run_cpu_time_us":39407,"wal-append.run_wall_time_us":3949534}]]}
W20260709 13:01:02.593394  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 468340us
W20260709 13:01:03.103947  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:02.461864  1567 raft_consensus.cc:2468] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 13.
W20260709 13:01:02.591636  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 93661us
W20260709 13:01:02.513139  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:02.517542  1617 leader_election.cc:336] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.092s (SENT)
W20260709 13:01:03.159962  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 642406us
I20260709 13:01:02.512285  1651 raft_consensus.cc:2468] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 18.
I20260709 13:01:02.491431  1644 raft_consensus.cc:1240] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 18 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:02.469244  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:03.177798  1571 raft_consensus.cc:3060] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:02.495029  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:01:02.496616  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:02.528961  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:02.530365  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:02.537560  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:02.496738  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:02.500980  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
W20260709 13:01:02.837882  1650 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.002s	sys 0.018s
W20260709 13:01:03.186949  1650 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.880s	user 0.003s	sys 0.018s
W20260709 13:01:02.878624  1542 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.022s	sys 0.074s
W20260709 13:01:03.188016  1542 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.812s	user 0.022s	sys 0.075s
W20260709 13:01:03.189081  1542 leader_election.cc:336] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.528s (SENT)
I20260709 13:01:03.189555  1542 leader_election.cc:304] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:02.529299  6794 raft_consensus.cc:3055] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:03.217469  6794 raft_consensus.cc:740] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:01:03.218430  6794 consensus_queue.cc:260] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:03.219504  6794 raft_consensus.cc:3060] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:02.584012  6895 consensus_queue.cc:1243] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer 05476b84d8f84d76a9a1f51b620a3c66 log is divergent from this leader: its last log entry 15.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 13:01:02.526225  7013 consensus_queue.cc:1048] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:02.718456  7046 raft_consensus.cc:2804] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:03.236784  7046 raft_consensus.cc:493] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.237383  7046 raft_consensus.cc:3060] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:02.482441  7058 raft_consensus.cc:515] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:03.244633  1648 raft_consensus.cc:1240] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:03.244978  1576 raft_consensus.cc:3055] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:03.245496  1576 raft_consensus.cc:740] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:01:03.245694  7058 leader_election.cc:290] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:02.490996  7061 consensus_queue.cc:1048] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:03.246491  1576 consensus_queue.cc:260] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:03.248214  1576 raft_consensus.cc:3060] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:02.352147  7071 raft_consensus.cc:515] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:03.277678  2330 raft_consensus.cc:1240] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:02.929884  7070 raft_consensus.cc:3055] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:03.279729  7070 raft_consensus.cc:740] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:01:02.487136  7115 consensus_queue.cc:1048] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:01:03.280668  7070 consensus_queue.cc:260] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:03.281797  7070 raft_consensus.cc:3060] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:02.528805  7119 raft_consensus.cc:2804] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:03.289397  7119 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:03.289870  7119 raft_consensus.cc:3060] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:02.740602  7124 raft_consensus.cc:493] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:03.294467  7124 raft_consensus.cc:515] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:01:02.980980  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:03.297068  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.297451  7071 leader_election.cc:290] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:01:03.046218  1647 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.008s	sys 0.021s
W20260709 13:01:03.300799  1647 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.878s	user 0.008s	sys 0.021s
I20260709 13:01:03.303258  1567 raft_consensus.cc:1275] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:01:03.304486  1576 raft_consensus.cc:1275] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:01:03.305255  1576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 1456) took 1030 ms. Trace:
W20260709 13:01:03.077490  1691 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.095427  7066 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:03.109891  7129 consensus_queue.cc:1048] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:03.118932  6652 consensus_queue.cc:1048] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:03.163601  7132 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.315485  7132 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:03.316538  2332 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 15.
I20260709 13:01:03.165452  2326 raft_consensus.cc:1240] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:03.169729  1646 raft_consensus.cc:1275] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
W20260709 13:01:03.176826  1617 leader_election.cc:336] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 2.149s (SENT)
I20260709 13:01:03.193265  6915 raft_consensus.cc:2764] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
W20260709 13:01:03.193742  1542 leader_election.cc:336] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.531s (SENT)
I20260709 13:01:03.320390  1542 leader_election.cc:304] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:03.192680  2294 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:03.198395  2323 raft_consensus.cc:2468] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 11.
W20260709 13:01:03.321298  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 128901us
W20260709 13:01:03.205821  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 91966.3us
I20260709 13:01:03.198809  7118 raft_consensus.cc:2749] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:03.212435  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 101509us
I20260709 13:01:03.324067  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:03.248970  7117 consensus_queue.cc:1048] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:03.324728  1719 raft_consensus.cc:2376] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 14. Re-sending same reply.
I20260709 13:01:03.325693  6912 raft_consensus.cc:2804] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:02.464191  7067 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:03.317559  7066 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:03.327993  1570 raft_consensus.cc:2393] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 18: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:01:03.260293  7131 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.328817  7131 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:03.329311  7066 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:03.330883  7131 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:03.331390  7131 consensus_queue.cc:1048] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:01:03.334563  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 157774us
W20260709 13:01:03.340122  1615 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:03.340958  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 147236us
I20260709 13:01:03.342178  1567 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413"
dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
mode: GRACEFUL
new_leader_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:49396
I20260709 13:01:03.344302  1570 raft_consensus.cc:1275] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:01:03.345286  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:01:03.276583  1571 raft_consensus.cc:2468] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 18.
I20260709 13:01:03.346684  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:03.055958  1471 catalog_manager.cc:5697] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 9 to 10, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 10 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:03.347317  1569 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 15.
I20260709 13:01:03.347186  1574 raft_consensus.cc:1240] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 18 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:03.308338  1576 rpcz_store.cc:276] 0709 13:01:02.275247 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.281765 (+  6518us) service_pool.cc:224] Handling call
0709 13:01:02.295940 (+ 14175us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:03.244854 (+948914us) spinlock_profiling.cc:243] Waited 928 ms on lock 0x7b540003bc20. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f2332dc0 00007fa9f23bd1c0 00007fa9f23be231 00007fa9f23bad8f 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c
0709 13:01:03.305007 (+ 60153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.305200 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2133626624}
I20260709 13:01:03.311367  7124 leader_election.cc:290] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:03.307868  7044 consensus_queue.cc:1048] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.007s
W20260709 13:01:03.204838  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 117758us
W20260709 13:01:03.322170  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.323063  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:03.352075  1721 raft_consensus.cc:2468] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 12.
I20260709 13:01:03.323289  1718 raft_consensus.cc:1275] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:01:03.343025  1567 raft_consensus.cc:606] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Received request to transfer leadership to TS 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:03.353335  1567 raft_consensus.cc:614] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:03.323171  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 17 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:03.326329  6912 raft_consensus.cc:697] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 18 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:01:03.323562  7132 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:03.360975  6912 consensus_queue.cc:237] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:03.364574  1539 leader_election.cc:304] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:03.365331  1471 catalog_manager.cc:5697] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:03.367045  1471 catalog_manager.cc:5697] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 5 to 8, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 8 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:03.367915  1539 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
W20260709 13:01:03.321938  7116 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260709 13:01:03.369719  7116 raft_consensus.cc:2804] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:03.369956  6895 raft_consensus.cc:2749] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:03.370198  7116 raft_consensus.cc:493] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.368731  1471 catalog_manager.cc:5697] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:03.369622  1539 leader_election.cc:304] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:03.371342  1723 raft_consensus.cc:2410] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:01:03.371579  1539 leader_election.cc:304] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:03.372298  6895 raft_consensus.cc:2804] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:03.372705  6895 raft_consensus.cc:493] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.373040  6895 raft_consensus.cc:3060] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:03.342569  7046 raft_consensus.cc:515] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:03.346973  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:03.388959  1570 raft_consensus.cc:2468] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 16.
I20260709 13:01:03.349895  1542 leader_election.cc:304] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 13:01:03.389910  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:03.390710  1648 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 15.
W20260709 13:01:03.355504  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.391862  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:01:03.356287  1617 leader_election.cc:336] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.513s (SENT)
I20260709 13:01:03.356927  6977 consensus_queue.cc:1059] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:03.349085  7118 raft_consensus.cc:2749] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:03.359778  7031 consensus_queue.cc:1059] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:01:03.370611  7116 raft_consensus.cc:3060] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:03.348732  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:03.412250  1720 raft_consensus.cc:3060] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:03.401218  7123 raft_consensus.cc:2804] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:01:03.373237  1471 catalog_manager.cc:5697] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 6 to 10, leader changed from 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 10 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:01:03.380786  7124 raft_consensus.cc:2804] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:03.382748  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:03.384696  7131 consensus_queue.cc:1048] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:03.385365  2326 raft_consensus.cc:1240] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:03.386241  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:01:03.386487  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:03.387126  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:01:03.387866  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:03.391453  1542 leader_election.cc:304] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:03.393199  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:03.328279  7067 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 18 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:01:03.350157  1615 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.422533  1471 catalog_manager.cc:5697] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 8 to 12, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 12 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:03.385742  1539 leader_election.cc:304] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:03.423398  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:03.424011  1648 raft_consensus.cc:2376] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 14. Re-sending same reply.
W20260709 13:01:03.395848  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 44326.2us
I20260709 13:01:03.410853  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:03.402468  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:03.424641  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:03.419008  1718 raft_consensus.cc:2468] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 15.
W20260709 13:01:03.429273  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 43595.7us
I20260709 13:01:03.430284  1539 leader_election.cc:304] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:03.437752  1720 raft_consensus.cc:2468] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 13.
I20260709 13:01:03.438294  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:03.441210  1721 raft_consensus.cc:1275] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:03.443225  1615 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:03.444926  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:03.445775  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:03.445093  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:03.445808  1720 raft_consensus.cc:2393] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 9: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:01:03.463189  1615 leader_election.cc:304] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:03.463434  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:03.464178  1720 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 15.
W20260709 13:01:03.467898  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 111626us
I20260709 13:01:03.471307  1615 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 13:01:03.413105  7123 raft_consensus.cc:493] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:03.473927  1716 raft_consensus.cc:2393] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 13: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:01:03.415716  7124 raft_consensus.cc:493] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.391650  6895 raft_consensus.cc:515] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:03.481882  1570 raft_consensus.cc:1240] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:01:03.486820  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:01:03.494441  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 64208.1us
I20260709 13:01:03.494633  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:03.507539  1720 raft_consensus.cc:2393] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 13: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:01:03.494861  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:03.496052  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:03.497124  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:03.497512  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:03.509629  1717 raft_consensus.cc:2368] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 13. Current term is 14.
I20260709 13:01:03.498625  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:01:03.499867  2294 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:03.478363  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:03.510488  2326 raft_consensus.cc:2393] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 9: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 13:01:03.510733  1723 raft_consensus.cc:3060] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:03.439481  7118 raft_consensus.cc:493] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.503314  2295 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:03.512459  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:03.516837  1721 raft_consensus.cc:2410] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:01:03.516767  1574 raft_consensus.cc:2468] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 16.
I20260709 13:01:03.508308  1722 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 15.
I20260709 13:01:03.519315  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:03.520166  2325 raft_consensus.cc:2393] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 16: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 13:01:03.511689  1471 catalog_manager.cc:5697] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
W20260709 13:01:03.529106  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 60207.7us
W20260709 13:01:03.530195  1617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:03.589090  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 68824.5us
I20260709 13:01:03.590220  1725 raft_consensus.cc:2468] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 14.
I20260709 13:01:03.503000  7129 raft_consensus.cc:2804] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:03.505280  6915 raft_consensus.cc:2804] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:03.498704  7123 raft_consensus.cc:3060] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:03.506140  7124 raft_consensus.cc:3060] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:03.554863  1471 catalog_manager.cc:5697] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 9 to 10, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 10 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:03.593561  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 72661.1us
I20260709 13:01:03.504642  6652 raft_consensus.cc:2804] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:03.473322  7066 consensus_queue.cc:1059] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.131s
I20260709 13:01:03.592927  6654 raft_consensus.cc:2804] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:03.542585  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
W20260709 13:01:03.594879  7127 log.cc:927] Time spent T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 13:01:03.605808  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 214398us
I20260709 13:01:03.627573  1471 catalog_manager.cc:5697] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 9 to 10, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 10 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:03.628940  1542 leader_election.cc:304] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 13:01:03.503455  7067 raft_consensus.cc:2749] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:03.626624  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 13:01:03.639680  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.639819  1720 raft_consensus.cc:1275] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:01:03.631757  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:03.503320  7115 consensus_queue.cc:1048] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.120s
I20260709 13:01:03.511091  7046 leader_election.cc:290] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 15 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:03.548257  7070 raft_consensus.cc:2804] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:03.610217  7059 raft_consensus.cc:3055] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:01:03.624749  6654 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.542867  7132 consensus_queue.cc:1059] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.098s
I20260709 13:01:03.606665  7129 raft_consensus.cc:697] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 13 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:03.600958  7148 raft_consensus.cc:2804] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 13:01:03.688827  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 56805.1us
I20260709 13:01:03.542153  7118 raft_consensus.cc:515] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:01:03.667850  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 124580us
I20260709 13:01:03.697433  1539 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:03.641487  1722 raft_consensus.cc:2376] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 14. Re-sending same reply.
I20260709 13:01:03.516458  7071 consensus_queue.cc:1048] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.117s
I20260709 13:01:03.671360  1720 raft_consensus.cc:1275] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:01:03.671244  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:03.713501  1718 raft_consensus.cc:2376] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 14. Re-sending same reply.
I20260709 13:01:03.679311  6654 raft_consensus.cc:3060] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:03.680634  1689 connection.cc:256] RPC call timeout handler was delayed by -1.3268507399999976s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:01:03.681043  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:03.681547  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:03.629328  6915 raft_consensus.cc:697] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 11 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:03.694245  1725 raft_consensus.cc:2468] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 13.
I20260709 13:01:03.722581  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:03.723495  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:03.723832  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:03.724022  1725 raft_consensus.cc:2376] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 14. Re-sending same reply.
I20260709 13:01:03.721520  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:03.601122  7140 consensus_queue.cc:1059] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.095s
I20260709 13:01:03.664659  7059 raft_consensus.cc:740] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:01:03.659313  7058 consensus_queue.cc:1048] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:01:03.716459  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:03.678928  7070 raft_consensus.cc:697] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:01:03.700129  1717 raft_consensus.cc:1275] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:01:03.725907  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:03.731611  1721 raft_consensus.cc:2368] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 10. Current term is 11.
I20260709 13:01:03.672669  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:03.696218  7148 raft_consensus.cc:493] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:03.736159  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:03.727197  1539 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:03.695919  7046 raft_consensus.cc:2804] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:03.730441  1722 raft_consensus.cc:2393] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 13: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:01:03.727533  1720 raft_consensus.cc:2410] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 13:01:03.732934  1718 raft_consensus.cc:2393] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 13: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:01:03.664697  7119 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:01:03.714372  7144 log.cc:927] Time spent T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
W20260709 13:01:03.732595  1689 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.738355  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:03.740000  1539 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:03.740459  1719 raft_consensus.cc:2368] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 10. Current term is 11.
I20260709 13:01:03.755136  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:03.753384  1539 leader_election.cc:304] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 13:01:03.756381  1689 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:03.756659  6977 raft_consensus.cc:493] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.732995  7149 raft_consensus.cc:2749] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:03.743351  7134 raft_consensus.cc:3055] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:03.767634  7134 raft_consensus.cc:740] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:03.768646  7134 consensus_queue.cc:260] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:03.718845  6747 consensus_queue.cc:1048] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:01:03.770660  7134 raft_consensus.cc:3060] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:03.782482  1572 raft_consensus.cc:1240] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:03.742367  7148 raft_consensus.cc:3060] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:03.743875  7046 raft_consensus.cc:493] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:03.744282  7156 raft_consensus.cc:3055] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:03.740200  7044 consensus_queue.cc:1048] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:01:03.753926  7028 raft_consensus.cc:2804] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 13:01:03.822322  1691 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:03.787431  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 159775us
I20260709 13:01:03.743381  7117 consensus_queue.cc:1048] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 13:01:03.757175  6977 raft_consensus.cc:515] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:01:03.783126  7145 log.cc:927] Time spent T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.242s	user 0.001s	sys 0.000s
I20260709 13:01:03.781176  6652 raft_consensus.cc:697] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 18 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:03.748886  7140 consensus_queue.cc:1048] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 13:01:03.755594  7118 leader_election.cc:290] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:03.847982  7046 raft_consensus.cc:3060] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:03.787969  6895 leader_election.cc:290] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:03.883425  1615 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:03.854256  7156 raft_consensus.cc:740] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:03.847975  7066 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.852038  7149 raft_consensus.cc:2749] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:03.851649  7115 raft_consensus.cc:493] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:03.893198  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 124023us
W20260709 13:01:03.875969  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 181677us
W20260709 13:01:03.893443  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 264624us
I20260709 13:01:03.879662  6845 raft_consensus.cc:3055] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:03.922469  6845 raft_consensus.cc:740] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:01:03.879912  7154 raft_consensus.cc:2804] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:03.887727  6794 raft_consensus.cc:2804] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:03.847255  7136 consensus_queue.cc:1048] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 13:01:03.923688  6845 consensus_queue.cc:260] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:01:03.913097  7143 log.cc:927] Time spent T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.244s	user 0.001s	sys 0.000s
I20260709 13:01:03.949239  1724 raft_consensus.cc:2468] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 15.
I20260709 13:01:03.939908  1542 leader_election.cc:304] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:03.924625  7133 raft_consensus.cc:493] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:03.960599  1723 raft_consensus.cc:2468] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 13.
I20260709 13:01:03.913432  7171 raft_consensus.cc:493] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
W20260709 13:01:04.008617  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 115408us
W20260709 13:01:03.954393  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 65151.6us
I20260709 13:01:03.976555  1721 raft_consensus.cc:1275] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:01:03.929225  7154 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:03.945490  7117 consensus_queue.cc:1048] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 13:01:04.013191  6977 leader_election.cc:290] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:04.013581  1650 raft_consensus.cc:1275] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:01:04.013782  7171 raft_consensus.cc:515] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:04.015625  7156 consensus_queue.cc:260] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:03.889609  7058 consensus_queue.cc:1059] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 13:01:04.023322  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:01:04.019784  2353 debug-util.cc:398] Leaking SignalData structure 0x7b080037ab40 after lost signal to thread 434
I20260709 13:01:03.879101  6915 consensus_queue.cc:237] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:03.854696  7129 consensus_queue.cc:237] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:04.021502  2297 leader_election.cc:304] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e
W20260709 13:01:04.069600  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 48225.1us
W20260709 13:01:04.024263  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 47094.1us
I20260709 13:01:03.928741  7115 raft_consensus.cc:515] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:03.892494  7070 consensus_queue.cc:237] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:04.076701  1689 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
W20260709 13:01:04.076836  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 179372us
I20260709 13:01:04.016256  7171 leader_election.cc:290] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:03.937722  7166 raft_consensus.cc:2804] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:03.962289  6794 raft_consensus.cc:697] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:01:03.917445  7066 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:04.078009  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:04.047878  7163 raft_consensus.cc:493] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:01:03.960680  6885 consensus_queue.cc:1048] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.117s
I20260709 13:01:04.021245  7154 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:04.020644  6895 raft_consensus.cc:2804] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 13:01:04.094053  7141 log.cc:927] Time spent T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.646s	user 0.005s	sys 0.000s
W20260709 13:01:04.111357  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 185761us
I20260709 13:01:04.112380  1542 leader_election.cc:304] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
W20260709 13:01:04.101065  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:04.078298  2353 debug-util.cc:398] Leaking SignalData structure 0x7b0800316ae0 after lost signal to thread 1508
W20260709 13:01:04.115761  2353 debug-util.cc:398] Leaking SignalData structure 0x7b0800338420 after lost signal to thread 1600
W20260709 13:01:04.116132  2353 debug-util.cc:398] Leaking SignalData structure 0x7b08003311c0 after lost signal to thread 1601
I20260709 13:01:04.102728  7146 consensus_queue.cc:1048] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:04.089572  6977 consensus_queue.cc:1059] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 13:01:04.105154  7066 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:04.079054  6986 raft_consensus.cc:2804] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:04.130743  6986 raft_consensus.cc:697] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:01:04.131958  6986 consensus_queue.cc:237] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:04.115145  7163 raft_consensus.cc:515] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:04.134802  7163 leader_election.cc:290] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:04.134574  7059 consensus_queue.cc:260] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:01:04.117756  2353 debug-util.cc:398] Leaking SignalData structure 0x7b0800330fe0 after lost signal to thread 1675
W20260709 13:01:04.125023  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 48386.6us
W20260709 13:01:04.137025  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:04.137370  2353 debug-util.cc:398] Leaking SignalData structure 0x7b0800398380 after lost signal to thread 1749
W20260709 13:01:04.137717  2353 debug-util.cc:398] Leaking SignalData structure 0x7b080032fa40 after lost signal to thread 1750
W20260709 13:01:04.116825  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.137948  1689 leader_election.cc:304] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
W20260709 13:01:04.138839  2353 debug-util.cc:398] Leaking SignalData structure 0x7b08001f8720 after lost signal to thread 2356
W20260709 13:01:04.139155  2353 debug-util.cc:398] Leaking SignalData structure 0x7b080039e7a0 after lost signal to thread 2357
I20260709 13:01:04.081903  7058 raft_consensus.cc:3055] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:04.023770  7133 raft_consensus.cc:515] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:04.129933  6977 raft_consensus.cc:3055] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:04.119449  7149 raft_consensus.cc:2749] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:01:04.142053  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:01:04.132298  7123 consensus_meta.cc:287] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.508s	user 0.005s	sys 0.002s
I20260709 13:01:04.107105  6895 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:04.080974  6845 raft_consensus.cc:3060] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:04.089339  7156 raft_consensus.cc:3060] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:04.136015  7059 raft_consensus.cc:3060] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:04.174312  6895 raft_consensus.cc:3060] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:04.065600  6652 consensus_queue.cc:237] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:04.159621  1572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37682 (request call id 1469) took 1629 ms. Trace:
I20260709 13:01:04.196724  1572 rpcz_store.cc:276] 0709 13:01:02.530127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:02.530250 (+   123us) service_pool.cc:224] Handling call
0709 13:01:02.530649 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:03.791481 (+1260832us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:04.159307 (+367826us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b5400245754. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:01:04.159548 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2878484352}
I20260709 13:01:04.160748  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
W20260709 13:01:04.164386  7151 log.cc:927] Time spent T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.282s	user 0.000s	sys 0.000s
I20260709 13:01:04.165175  7133 leader_election.cc:290] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:04.083894  7166 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:04.205687  7166 raft_consensus.cc:3060] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:04.168005  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 55747.9us
I20260709 13:01:04.206877  1542 leader_election.cc:304] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:04.207937  7149 raft_consensus.cc:2764] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 13:01:04.208005  1542 leader_election.cc:304] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:04.209026  7149 raft_consensus.cc:2749] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:04.150863  7058 raft_consensus.cc:740] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:04.210206  1542 leader_election.cc:304] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:04.210433  7058 consensus_queue.cc:260] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:04.157989  1689 leader_election.cc:304] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:04.212134  7170 raft_consensus.cc:2749] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:04.183998  7168 log.cc:927] Time spent T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:01:04.213500  1617 leader_election.cc:304] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:04.156101  6977 raft_consensus.cc:740] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:01:04.215013  6977 consensus_queue.cc:260] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:04.215727  1617 leader_election.cc:400] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 pre-election: Vote denied by peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473) with higher term. Message: Invalid argument: T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 13. Current term is 14.
I20260709 13:01:04.174081  7123 raft_consensus.cc:515] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:04.217553  6654 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:04.219736  7123 leader_election.cc:290] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:04.220175  6654 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 16 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:04.166824  7119 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 16 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:04.220512  7115 leader_election.cc:290] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:04.222046  7156 raft_consensus.cc:2749] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:04.226792  1717 raft_consensus.cc:2410] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:01:04.230540  7046 raft_consensus.cc:515] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:04.195701  7172 raft_consensus.cc:2749] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:01:04.198452  7124 consensus_meta.cc:287] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.575s	user 0.008s	sys 0.003s
I20260709 13:01:04.234014  1542 leader_election.cc:304] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:04.235073  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:04.239001  7148 raft_consensus.cc:515] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 13:01:04.241093  6845 raft_consensus.cc:2749] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:04.242803  7058 raft_consensus.cc:3060] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:04.180739  7174 raft_consensus.cc:493] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
W20260709 13:01:04.242910  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.227996  6895 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:04.245338  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:01:04.198724  7171 raft_consensus.cc:2749] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:01:04.241189  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 83294.1us
I20260709 13:01:04.255645  1721 raft_consensus.cc:3060] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:04.253800  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 173316us
I20260709 13:01:04.263705  1646 raft_consensus.cc:1240] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:04.269465  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:01:04.254884  7181 raft_consensus.cc:493] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:04.288055  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 76336.3us
I20260709 13:01:04.289678  1542 leader_election.cc:304] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:04.289948  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:04.257582  7130 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.292905  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:04.290632  1646 raft_consensus.cc:2468] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 9.
I20260709 13:01:04.287086  1689 leader_election.cc:304] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:04.294055  1688 leader_election.cc:304] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:04.271776  6660 raft_consensus.cc:493] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.295751  6660 raft_consensus.cc:515] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:01:04.296794  7162 log.cc:927] Time spent T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.212s	user 0.002s	sys 0.000s
I20260709 13:01:04.297833  1572 raft_consensus.cc:1275] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:01:04.298146  6660 leader_election.cc:290] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:04.269734  7124 raft_consensus.cc:515] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:04.299777  6895 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 15 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:04.296826  7148 leader_election.cc:290] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:04.301791  7154 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:04.302538  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:04.303725  1576 raft_consensus.cc:2393] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 16: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:01:04.303864  7154 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 16 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:04.203267  6794 consensus_queue.cc:237] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:04.260329  7119 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:04.258989  7046 leader_election.cc:290] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:04.312049  1689 leader_election.cc:304] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:04.317021  1542 leader_election.cc:304] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:04.320211  1721 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 16.
I20260709 13:01:04.307415  7123 raft_consensus.cc:2749] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:04.288444  7156 consensus_queue.cc:1048] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:01:04.308035  6845 raft_consensus.cc:2804] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:04.325515  1542 leader_election.cc:304] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:04.295320  7070 raft_consensus.cc:2804] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 13:01:04.328480  1691 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.343869  7028 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:04.344460  7028 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:04.307180  7146 consensus_queue.cc:1059] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 13:01:04.345959  1542 leader_election.cc:304] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:04.339774  6845 raft_consensus.cc:493] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:04.353021  6845 raft_consensus.cc:3060] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:04.356568  7165 raft_consensus.cc:2749] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:04.357599  7147 raft_consensus.cc:2804] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:01:04.358156  7147 raft_consensus.cc:697] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:01:04.360723  7124 leader_election.cc:290] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:04.348368  1689 leader_election.cc:304] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:04.331458  7046 raft_consensus.cc:2749] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:04.338819  7156 consensus_queue.cc:1243] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer 0c7751452c4b46afa95251b9df7169d4 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:01:04.385978  1649 raft_consensus.cc:1240] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 18 LEADER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:04.317245  7119 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:04.347702  7171 raft_consensus.cc:2749] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:04.391021  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:04.391477  1542 leader_election.cc:304] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:04.342378  7070 raft_consensus.cc:493] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
W20260709 13:01:04.389065  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 95025us
I20260709 13:01:04.398977  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:04.399761  1648 raft_consensus.cc:2393] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 14: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:01:04.402485  1644 raft_consensus.cc:3060] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:04.403923  2297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.347115  7149 raft_consensus.cc:2749] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:04.409857  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 58727.8us
I20260709 13:01:04.410573  1542 leader_election.cc:304] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
W20260709 13:01:04.408712  1615 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.413537  1643 raft_consensus.cc:1217] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Deduplicated request from leader. Original: 12.7->[14.8-14.8]   Dedup: 14.8->[]
I20260709 13:01:04.414300  1643 raft_consensus.cc:1240] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 13:01:04.413980  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:04.415689  1542 leader_election.cc:304] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:04.417615  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
W20260709 13:01:04.418107  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 69786.8us
I20260709 13:01:04.418869  1689 leader_election.cc:304] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:04.421061  1542 leader_election.cc:304] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:04.422142  1642 raft_consensus.cc:2410] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:01:04.422477  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
W20260709 13:01:04.405687  7116 consensus_meta.cc:287] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.983s	user 0.008s	sys 0.004s
I20260709 13:01:04.426118  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:04.429917  1567 raft_consensus.cc:1240] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:04.427803  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:04.404186  7070 raft_consensus.cc:3060] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:04.430986  1651 raft_consensus.cc:2393] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 18: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 13:01:04.427724  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:04.434064  1572 raft_consensus.cc:2468] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 12.
I20260709 13:01:04.431742  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:04.432147  1542 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
W20260709 13:01:04.436405  1691 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:04.436496  1542 leader_election.cc:304] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:04.437942  1542 leader_election.cc:304] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:04.438305  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:04.438889  1644 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 16.
I20260709 13:01:04.439109  1542 leader_election.cc:304] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:04.439114  1642 raft_consensus.cc:3060] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:04.444084  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 168522us
I20260709 13:01:04.444906  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
W20260709 13:01:04.445433  1617 leader_election.cc:336] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.656s (SENT)
I20260709 13:01:04.445583  1646 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:04.446980  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:04.447190  1570 raft_consensus.cc:1240] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:04.418969  7067 raft_consensus.cc:2749] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:04.418650  7046 raft_consensus.cc:2749] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:04.449067  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:04.451480  1689 leader_election.cc:304] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:04.447750  1644 raft_consensus.cc:2468] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 13.
I20260709 13:01:04.425997  7124 raft_consensus.cc:2804] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:04.452803  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:04.425801  7118 raft_consensus.cc:2749] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:04.288029  7181 raft_consensus.cc:515] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:04.485249  7197 raft_consensus.cc:2749] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:04.487409  7181 leader_election.cc:290] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:04.487934  7160 raft_consensus.cc:2749] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:04.489902  7119 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:04.437575  7066 raft_consensus.cc:493] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:04.487550  7173 log.cc:927] Time spent T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.362s	user 0.001s	sys 0.000s
I20260709 13:01:04.501255  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:04.501968  1644 raft_consensus.cc:2468] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 14.
I20260709 13:01:04.503688  1688 leader_election.cc:304] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:04.288642  7174 raft_consensus.cc:515] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:01:04.506001  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 60587.1us
W20260709 13:01:04.507675  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 68635.1us
I20260709 13:01:04.510779  1642 raft_consensus.cc:2468] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 13.
I20260709 13:01:04.307607  7130 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:04.444135  7148 raft_consensus.cc:2749] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:04.452795  7149 raft_consensus.cc:2804] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:01:04.515730  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 64311us
I20260709 13:01:04.447862  7123 raft_consensus.cc:2804] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:04.513978  1542 leader_election.cc:304] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:04.524771  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:04.525552  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:04.526546  2331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53306 (request call id 860) took 1139 ms. Trace:
I20260709 13:01:04.514346  1646 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 16.
I20260709 13:01:04.359083  7147 consensus_queue.cc:237] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:01:04.513846  1617 leader_election.cc:336] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.666s (SENT)
I20260709 13:01:04.540781  1617 leader_election.cc:304] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:04.542061  7201 raft_consensus.cc:2749] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:04.543272  7201 raft_consensus.cc:493] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.543730  7201 raft_consensus.cc:515] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:04.528712  7130 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:04.479902  7124 raft_consensus.cc:493] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:04.447546  7170 raft_consensus.cc:3060] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:04.557749  7201 leader_election.cc:290] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:01:04.543628  1617 leader_election.cc:336] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.989s (SENT)
I20260709 13:01:04.560714  7194 consensus_queue.cc:1048] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 13:01:04.432780  7116 raft_consensus.cc:515] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:04.534353  2331 rpcz_store.cc:276] 0709 13:01:03.387264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.401105 (+ 13841us) service_pool.cc:224] Handling call
0709 13:01:03.418250 (+ 17145us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:03.445737 (+ 27487us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:03.445767 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:03.467292 (+ 21525us) log.cc:844] Serialized 26 byte log entry
0709 13:01:03.950688 (+483396us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:03.950735 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:03.950806 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:04.486908 (+536102us) spinlock_profiling.cc:243] Waited 5.76 ms on lock 0x7b4400022b4c. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef1f4c85 00007fa9ef1f56a2 00007fa9f1f671db 00007fa9f1f62aaf 00007fa9f1f5686e 00007fa9f1f55bb6 00007fa9f1f557d8 00007fa9f1f5f221 00007fa9f1f5f1d9 00007fa9f1f5f169
0709 13:01:04.526218 (+ 39310us) raft_consensus.cc:1685] finished
0709 13:01:04.526248 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:04.526484 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41358,"raft.queue_time_us":28145,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":38292,"spinlock_wait_cycles":13250816,"thread_start_us":434518,"threads_started":1,"wal-append.queue_time_us":567285}
I20260709 13:01:04.565085  7164 raft_consensus.cc:2749] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:04.512785  7066 raft_consensus.cc:515] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:01:04.565764  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 51872.2us
I20260709 13:01:04.565827  6845 raft_consensus.cc:515] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:04.566766  7028 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:04.567657  7174 leader_election.cc:290] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:04.565016  7148 raft_consensus.cc:2804] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:04.515354  7146 raft_consensus.cc:2804] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:04.533124  7123 raft_consensus.cc:493] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:04.586637  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:04.595180  1576 raft_consensus.cc:2410] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 15 because replica has last-logged OpId of term: 14 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260709 13:01:04.587816  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:04.588470  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:04.588413  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:01:04.575181  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 87606.9us
I20260709 13:01:04.574523  7124 raft_consensus.cc:3060] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:04.586197  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:04.598589  1571 raft_consensus.cc:2393] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 11: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:01:04.589483  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:04.523758  7149 raft_consensus.cc:493] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:04.607569  7149 raft_consensus.cc:3060] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:04.610150  1615 leader_election.cc:304] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:04.610457  1567 raft_consensus.cc:2393] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 15: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:01:04.613322  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:04.586212  1572 raft_consensus.cc:1240] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 11. Current term is 12. Ops: []
W20260709 13:01:04.593348  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 49761.6us
I20260709 13:01:04.584687  7013 raft_consensus.cc:493] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.601081  6669 raft_consensus.cc:493] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.602486  2294 leader_election.cc:304] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:04.606853  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:04.622653  2331 raft_consensus.cc:2393] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 11: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:01:04.626693  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:04.626819  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:04.591348  7146 raft_consensus.cc:493] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:04.627889  1567 raft_consensus.cc:2468] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 13.
I20260709 13:01:04.634019  1539 leader_election.cc:304] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:04.595943  7123 raft_consensus.cc:3060] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:04.632405  2294 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:04.630319  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:04.645620  1572 raft_consensus.cc:2368] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 10. Current term is 11.
I20260709 13:01:04.632402  6651 raft_consensus.cc:3060] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:04.533152  7166 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:04.644675  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:04.649083  1615 leader_election.cc:304] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:04.597064  7148 raft_consensus.cc:697] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:01:04.645628  1539 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:04.658824  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:04.643353  7146 raft_consensus.cc:3060] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:04.662184  1617 leader_election.cc:304] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:04.653681  7134 consensus_queue.cc:1048] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 13:01:04.665062  1539 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:04.662794  7199 raft_consensus.cc:2749] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:04.675524  1539 leader_election.cc:304] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:04.676359  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:04.628810  7044 consensus_queue.cc:1059] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 13:01:04.653501  6885 raft_consensus.cc:2804] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:04.682101  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:04.681394  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:04.678243  1539 leader_election.cc:304] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:04.644841  7174 consensus_queue.cc:1059] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 13:01:04.634049  7013 raft_consensus.cc:515] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:04.643759  6669 raft_consensus.cc:515] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:04.684387  1539 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:04.692005  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:04.673110  6794 raft_consensus.cc:2749] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:04.662796  7066 leader_election.cc:290] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:04.697788  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:04.677747  7046 raft_consensus.cc:2749] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 13:01:04.681967  7119 raft_consensus.cc:2804] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:04.700706  1539 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:04.701977  7187 raft_consensus.cc:2804] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:04.702401  7187 raft_consensus.cc:493] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:04.702768  7187 raft_consensus.cc:3060] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:04.703193  7013 leader_election.cc:290] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:04.704559  6845 leader_election.cc:290] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:04.705873  7116 leader_election.cc:290] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:04.695529  7201 raft_consensus.cc:2804] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:04.708815  7148 consensus_queue.cc:237] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:04.713716  2331 raft_consensus.cc:2468] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 13.
I20260709 13:01:04.695963  1617 leader_election.cc:304] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:04.698532  1567 raft_consensus.cc:2468] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 11.
I20260709 13:01:04.694379  7199 raft_consensus.cc:2804] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:01:04.721982  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 189911us
I20260709 13:01:04.724476  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:04.725314  1725 raft_consensus.cc:2376] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 13. Re-sending same reply.
I20260709 13:01:04.730047  1689 leader_election.cc:304] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:04.695104  6885 raft_consensus.cc:697] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:01:04.729115  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:04.735255  1722 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 15.
I20260709 13:01:04.758262  1567 raft_consensus.cc:1275] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 13:01:04.758469  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:04.758782  1567 pending_rounds.cc:85] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting all ops after (but not including) 7
I20260709 13:01:04.759122  1567 pending_rounds.cc:107] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 13:01:04.712420  7119 raft_consensus.cc:493] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:04.759372  1567 raft_consensus.cc:2889] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:04.761184  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:04.762424  1717 raft_consensus.cc:2410] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
W20260709 13:01:04.765318  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 69415us
I20260709 13:01:04.726827  7116 raft_consensus.cc:3060] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:04.773926  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 17 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:04.726621  7174 raft_consensus.cc:3055] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:04.721060  7147 raft_consensus.cc:2804] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:04.853559  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:04.853672  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:04.723223  7044 raft_consensus.cc:3055] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:04.867300  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:04.854596  1617 leader_election.cc:400] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 election: Vote denied by peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473) with higher term. Message: Invalid argument: T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 10. Current term is 11.
I20260709 13:01:04.870949  7044 raft_consensus.cc:740] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
W20260709 13:01:04.871004  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 94605.2us
I20260709 13:01:04.737033  7199 raft_consensus.cc:697] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:01:04.891273  1572 raft_consensus.cc:2393] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 14: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:01:04.768208  7181 raft_consensus.cc:2749] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:04.768350  7119 raft_consensus.cc:3060] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:04.898470  1617 leader_election.cc:403] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:01:04.900202  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:04.902973  1615 leader_election.cc:400] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Vote denied by peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373) with higher term. Message: Invalid argument: T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 10. Current term is 11.
I20260709 13:01:04.860852  7174 raft_consensus.cc:740] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:04.854350  7070 raft_consensus.cc:515] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:04.895848  7148 raft_consensus.cc:493] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:04.981556  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 80127.2us
I20260709 13:01:04.919530  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:05.039108  1575 raft_consensus.cc:3060] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:04.923050  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:04.918757  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:04.969079  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:04.919157  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:05.040346  1646 raft_consensus.cc:3060] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:04.920780  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:05.023445  1615 leader_election.cc:403] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:05.040935  1642 raft_consensus.cc:2468] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 16.
I20260709 13:01:04.855400  1716 raft_consensus.cc:2410] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for term 17 because replica has last-logged OpId of term: 16 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:01:04.865108  6845 raft_consensus.cc:493] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:04.871580  7160 raft_consensus.cc:493] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:05.053395  7160 raft_consensus.cc:515] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:04.920595  1568 raft_consensus.cc:1240] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:04.994906  1572 raft_consensus.cc:1240] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 LEADER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:04.864774  7214 raft_consensus.cc:2749] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:04.971845  1647 raft_consensus.cc:1275] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 18 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:01:04.896142  6794 raft_consensus.cc:493] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:05.057572  6794 raft_consensus.cc:515] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:05.059900  6794 leader_election.cc:290] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:05.060724  6845 raft_consensus.cc:515] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 13:01:05.062976  6651 raft_consensus.cc:2749] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:05.064169  2326 raft_consensus.cc:1240] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 13:01:05.065657  2328 raft_consensus.cc:1240] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:05.067289  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:05.069721  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:05.043953  6885 consensus_queue.cc:237] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:05.047883  7148 raft_consensus.cc:515] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:05.075271  7148 leader_election.cc:290] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:05.077932  7069 raft_consensus.cc:493] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:01:05.078536  7069 raft_consensus.cc:515] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:04.969599  6669 leader_election.cc:290] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:05.083786  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:05.048259  7187 raft_consensus.cc:515] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:05.086721  7187 leader_election.cc:290] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:01:05.087973  7215 log.cc:927] Time spent T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.186s	user 0.000s	sys 0.000s
I20260709 13:01:05.091678  7164 raft_consensus.cc:493] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:05.092417  7164 raft_consensus.cc:515] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:05.095270  7164 leader_election.cc:290] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:01:05.096181  1689 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:05.096837  1689 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:05.099256  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:05.044159  1723 pending_rounds.cc:85] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4: Aborting all ops after (but not including) 6
I20260709 13:01:05.100514  1576 raft_consensus.cc:2410] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:01:05.100800  1723 pending_rounds.cc:107] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:01:05.099644  1575 raft_consensus.cc:2468] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 12.
I20260709 13:01:05.050014  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:04.947018  7184 raft_consensus.cc:2804] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:04.899735  7147 raft_consensus.cc:697] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
W20260709 13:01:05.051590  7208 log.cc:927] Time spent T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.150s	user 0.000s	sys 0.003s
I20260709 13:01:05.063097  6845 leader_election.cc:290] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373)
I20260709 13:01:05.120636  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:05.048641  1573 raft_consensus.cc:2410] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:01:05.101146  1723 raft_consensus.cc:2889] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:05.045742  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:05.124020  1642 raft_consensus.cc:2393] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 14: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:01:04.964365  6915 raft_consensus.cc:493] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:04.899763  7028 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 17 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:04.939443  6986 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.110327  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:01:05.116047  7170 consensus_meta.cc:287] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.527s	user 0.008s	sys 0.002s
I20260709 13:01:05.113157  1569 raft_consensus.cc:1240] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:05.114146  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:01:05.118513  7149 consensus_meta.cc:287] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.510s	user 0.003s	sys 0.007s
I20260709 13:01:05.115219  7187 raft_consensus.cc:2749] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473) with higher term. Message: Invalid argument: T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 10. Current term is 11.
I20260709 13:01:05.127221  7070 leader_election.cc:290] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:05.127789  7174 consensus_queue.cc:260] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:05.056420  7160 leader_election.cc:290] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:05.159317  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:05.159895  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:05.129001  7147 consensus_queue.cc:237] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:05.125042  1646 raft_consensus.cc:2468] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 10.
W20260709 13:01:05.111392  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 208545us
I20260709 13:01:05.109404  7171 raft_consensus.cc:493] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.140488  1649 raft_consensus.cc:2468] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 9.
I20260709 13:01:05.176116  1688 leader_election.cc:304] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:05.126755  7133 raft_consensus.cc:3055] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:05.148860  1571 raft_consensus.cc:1275] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:01:05.177106  1568 raft_consensus.cc:1240] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:05.154413  1645 raft_consensus.cc:1240] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:05.155615  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:05.117918  7184 raft_consensus.cc:697] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 14 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:05.155862  2294 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
W20260709 13:01:05.157435  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 384731us
I20260709 13:01:05.145740  7170 raft_consensus.cc:2749] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:05.117561  7044 consensus_queue.cc:260] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 13:01:05.158540  7216 raft_consensus.cc:3060] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:01:05.159993  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:05.191008  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:05.161171  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:05.159193  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:05.174808  1572 raft_consensus.cc:1275] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 18 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:01:05.193924  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:05.116394  7116 raft_consensus.cc:2749] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:05.138567  7069 leader_election.cc:290] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:05.116333  7123 raft_consensus.cc:515] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:05.183014  1617 leader_election.cc:304] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:05.158016  1648 raft_consensus.cc:1275] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 13:01:05.184265  1615 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:05.194701  1573 raft_consensus.cc:3060] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:05.204713  1576 raft_consensus.cc:1275] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:05.167873  7166 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:05.196175  7175 raft_consensus.cc:2804] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:05.182593  7133 raft_consensus.cc:740] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
W20260709 13:01:05.189760  7058 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.029s	sys 0.046s
I20260709 13:01:05.152505  7149 raft_consensus.cc:515] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:01:05.217456  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:05.221720  1691 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:05.237627  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 54699.9us
W20260709 13:01:05.201834  7124 consensus_meta.cc:287] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.570s	user 0.008s	sys 0.001s
I20260709 13:01:05.196600  7200 raft_consensus.cc:2804] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:05.139402  6915 raft_consensus.cc:515] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:05.144707  6986 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:05.196813  7174 raft_consensus.cc:3060] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:05.247874  1574 raft_consensus.cc:1240] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:01:05.249322  1573 raft_consensus.cc:2468] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 14.
W20260709 13:01:05.279384  7058 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.035s	sys 0.056s
I20260709 13:01:05.257413  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:05.257630  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:05.301213  1568 raft_consensus.cc:1240] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:05.196697  7160 consensus_queue.cc:1059] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 13:01:05.293268  1617 leader_election.cc:400] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Vote denied by peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473) with higher term. Message: Invalid argument: T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 10. Current term is 11.
W20260709 13:01:05.245595  7173 log.cc:927] Time spent T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:01:05.213403  7221 raft_consensus.cc:2749] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:05.186812  7171 raft_consensus.cc:515] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:05.264089  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:05.292241  7200 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.270915  1645 raft_consensus.cc:1275] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:01:05.181733  7199 consensus_queue.cc:237] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:01:05.279129  1691 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:05.304880  7146 consensus_meta.cc:287] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.626s	user 0.008s	sys 0.004s
I20260709 13:01:05.266033  7165 raft_consensus.cc:493] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.263635  7164 raft_consensus.cc:493] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:05.297055  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:05.252066  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:05.262180  7166 consensus_queue.cc:1059] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.017s
I20260709 13:01:05.292457  1575 raft_consensus.cc:2468] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 16.
I20260709 13:01:05.308367  1571 raft_consensus.cc:2410] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:01:05.244108  7175 raft_consensus.cc:697] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 10 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:01:05.329716  7175 consensus_queue.cc:237] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:05.283461  1570 raft_consensus.cc:2468] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 13.
W20260709 13:01:05.332685  7226 log.cc:927] Time spent T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
W20260709 13:01:05.335254  1689 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:34373 timed out after 2.949s (SENT) [suppressed 69 similar messages]
I20260709 13:01:05.336992  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:05.292002  7124 raft_consensus.cc:515] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:05.339617  7124 leader_election.cc:290] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 15 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:05.325938  7166 raft_consensus.cc:3055] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:05.340884  7166 raft_consensus.cc:740] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:05.341922  7166 consensus_queue.cc:260] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:05.343364  7166 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:01:05.337265  7222 log.cc:927] Time spent T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:01:05.345360  7164 raft_consensus.cc:515] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:05.347960  7164 leader_election.cc:290] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:05.355415  6977 raft_consensus.cc:3060] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:05.328078  7119 raft_consensus.cc:515] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:05.361459  6915 leader_election.cc:290] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:05.361879  7119 leader_election.cc:290] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:05.362210  7165 raft_consensus.cc:515] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:05.318353  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:05.366102  1572 raft_consensus.cc:2376] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 12. Re-sending same reply.
W20260709 13:01:05.370772  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 77686.7us
I20260709 13:01:05.324306  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:05.372169  1575 raft_consensus.cc:2393] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 15: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:01:05.312892  7200 raft_consensus.cc:3060] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:05.381547  1617 leader_election.cc:304] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:05.375633  1575 raft_consensus.cc:1240] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 8. Current term is 9. Ops: []
I20260709 13:01:05.383364  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:05.383970  1575 raft_consensus.cc:2468] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 16.
I20260709 13:01:05.384850  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:05.376371  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:05.394220  1573 raft_consensus.cc:3060] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:05.396198  1615 leader_election.cc:304] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:05.397320  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:05.399320  1721 raft_consensus.cc:2468] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 9.
I20260709 13:01:05.291402  7184 consensus_queue.cc:237] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:05.418648  1617 leader_election.cc:304] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:05.413396  1615 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 13:01:05.393905  7195 log.cc:927] Time spent T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:01:05.429178  1716 raft_consensus.cc:1275] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:01:05.431011  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:05.397135  7119 raft_consensus.cc:493] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.394665  6915 raft_consensus.cc:2749] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:05.438216  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:05.418334  7194 raft_consensus.cc:2804] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:05.446704  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:05.448789  1573 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 16.
I20260709 13:01:05.449645  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:05.450330  1573 raft_consensus.cc:2393] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 14: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:01:05.323369  7146 raft_consensus.cc:515] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:05.446307  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:05.451349  1645 raft_consensus.cc:3060] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:05.457998  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
W20260709 13:01:05.460920  7230 log.cc:927] Time spent T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
W20260709 13:01:05.461071  7225 log.cc:927] Time spent T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 13:01:05.441303  7058 raft_consensus.cc:2749] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:05.463296  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:05.465705  1571 raft_consensus.cc:1275] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 18 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:01:05.415844  7154 consensus_queue.cc:1048] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 13:01:05.419770  7061 consensus_queue.cc:1048] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
W20260709 13:01:05.475584  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 57027.7us
I20260709 13:01:05.488572  1722 raft_consensus.cc:2393] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 15: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:01:05.452159  7123 leader_election.cc:290] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:05.414752  7221 consensus_queue.cc:1059] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 13:01:05.504508  7146 leader_election.cc:290] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:05.504917  1567 raft_consensus.cc:1275] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:01:05.445282  7119 raft_consensus.cc:515] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:05.442724  7165 leader_election.cc:290] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:05.507244  7119 leader_election.cc:290] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:05.488590  1572 raft_consensus.cc:1240] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:05.452672  7169 raft_consensus.cc:2804] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:05.496925  7149 leader_election.cc:290] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:05.500046  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:05.502863  7171 leader_election.cc:290] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:05.503435  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:05.483637  1645 raft_consensus.cc:2468] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 14.
I20260709 13:01:05.529704  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:05.530664  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:05.532385  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:05.552141  1718 raft_consensus.cc:2468] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 13.
I20260709 13:01:05.552700  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:05.552990  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:05.553493  1725 raft_consensus.cc:3060] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:05.534873  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:05.549619  1568 raft_consensus.cc:2393] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 11: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:01:05.553563  1718 raft_consensus.cc:3060] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:05.533236  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:05.557758  1721 raft_consensus.cc:3060] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:05.567584  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 66509.4us
I20260709 13:01:05.567848  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:05.568732  1724 raft_consensus.cc:3060] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:05.572674  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 85689.6us
I20260709 13:01:05.574301  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:05.575176  1570 raft_consensus.cc:2468] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 9.
I20260709 13:01:05.583341  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:05.580384  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:05.585788  1573 raft_consensus.cc:2468] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 14.
I20260709 13:01:05.586613  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:05.587167  1723 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:05.584028  1570 raft_consensus.cc:2376] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 12. Re-sending same reply.
I20260709 13:01:05.595309  1721 raft_consensus.cc:2468] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 13.
I20260709 13:01:05.580183  7194 raft_consensus.cc:697] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 14 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:05.597950  1617 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:05.599378  1617 leader_election.cc:304] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:05.601342  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:05.536487  7134 consensus_queue.cc:1048] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 13:01:05.607829  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:05.606853  1724 raft_consensus.cc:2468] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 11.
I20260709 13:01:05.609989  1725 raft_consensus.cc:2468] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 11.
I20260709 13:01:05.595592  6986 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:05.616350  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:05.618631  1617 leader_election.cc:304] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:05.579059  7061 consensus_queue.cc:1059] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:01:05.593196  7169 raft_consensus.cc:697] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 16 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:05.617225  7218 raft_consensus.cc:493] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.626938  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:05.627499  1724 raft_consensus.cc:1240] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 10 LEADER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:05.610983  6652 raft_consensus.cc:2764] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 13:01:05.595356  7175 consensus_queue.cc:1048] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:01:05.625888  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:05.631009  7217 consensus_queue.cc:1048] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 13:01:05.631487  7194 consensus_queue.cc:237] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:01:05.634991  7239 log.cc:927] Time spent T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 13:01:05.637920  1645 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e"
dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
mode: GRACEFUL
new_leader_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:35470
I20260709 13:01:05.638612  1645 raft_consensus.cc:606] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 14 LEADER]: Received request to transfer leadership to TS 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:05.638797  1570 raft_consensus.cc:2393] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 11: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:01:05.639704  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:05.630631  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:05.645939  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:05.620793  7115 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.649636  7244 raft_consensus.cc:2749] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:05.641340  7218 raft_consensus.cc:515] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:05.643859  7061 raft_consensus.cc:2749] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:05.655656  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:05.672891  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:05.713027  1570 raft_consensus.cc:2393] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 15: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:01:05.713574  1573 raft_consensus.cc:2410] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
W20260709 13:01:05.713399  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 64483.9us
W20260709 13:01:05.680778  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:05.717258  1689 leader_election.cc:304] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:05.699824  1569 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 2573) took 1408 ms. Trace:
I20260709 13:01:05.718218  1569 rpcz_store.cc:276] 0709 13:01:04.291369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.291610 (+   241us) service_pool.cc:224] Handling call
0709 13:01:04.291860 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:05.145230 (+853370us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:05.689552 (+544322us) spinlock_profiling.cc:243] Waited 821 ms on lock 0x7b54003674d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:01:05.699761 (+ 10209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1888376064}
I20260709 13:01:05.700204  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:05.640967  7169 consensus_queue.cc:237] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:05.711232  1723 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 16.
I20260709 13:01:05.655593  7165 raft_consensus.cc:493] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:05.711599  1542 connection.cc:256] RPC call timeout handler was delayed by -1.6927912310000579s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17s for a response
I20260709 13:01:05.674218  7218 leader_election.cc:290] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:05.720571  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 13:01:05.726528  1542 connection.cc:256] RPC call timeout handler was delayed by -1.5448117590000265s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1864s for a response
I20260709 13:01:05.729557  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:05.730368  1573 raft_consensus.cc:2393] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 14: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:01:05.727186  1542 leader_election.cc:304] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:05.733171  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:05.734223  1542 leader_election.cc:304] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
W20260709 13:01:05.725711  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 80745.5us
I20260709 13:01:05.740226  7199 raft_consensus.cc:2749] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:05.692971  7115 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:01:05.742136  7216 consensus_meta.cc:287] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.534s	user 0.008s	sys 0.003s
I20260709 13:01:05.742556  7216 raft_consensus.cc:2749] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373) with higher term. Message: Invalid argument: T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 10. Current term is 11.
I20260709 13:01:05.712642  7201 raft_consensus.cc:493] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:01:05.744299  7201 raft_consensus.cc:3060] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:05.747202  1576 raft_consensus.cc:1240] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:05.727406  7172 consensus_queue.cc:1048] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:01:05.754848  1648 raft_consensus.cc:2468] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 11.
I20260709 13:01:05.757040  7158 consensus_queue.cc:1048] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 13:01:05.760764  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 394563us
I20260709 13:01:05.764155  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:05.764943  1576 raft_consensus.cc:2468] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 11.
I20260709 13:01:05.773064  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:05.773624  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:05.774716  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:05.775321  1649 raft_consensus.cc:2468] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 14.
I20260709 13:01:05.776232  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:05.776791  1644 raft_consensus.cc:3060] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:05.778288  1569 raft_consensus.cc:2468] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 15.
W20260709 13:01:05.779467  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 45389.2us
I20260709 13:01:05.713012  7175 consensus_queue.cc:1059] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:01:05.742565  7115 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:05.752590  7044 raft_consensus.cc:3060] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:05.790644  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 52289.1us
I20260709 13:01:05.791352  1644 raft_consensus.cc:2468] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 15.
I20260709 13:01:05.792768  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:05.793368  1569 raft_consensus.cc:2468] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 18.
I20260709 13:01:05.779222  7028 consensus_queue.cc:1059] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 13:01:05.796005  6660 consensus_queue.cc:1059] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:05.796864  6660 raft_consensus.cc:3055] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:05.797201  6660 raft_consensus.cc:740] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:05.798174  6660 consensus_queue.cc:260] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:05.799583  6660 raft_consensus.cc:3060] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:05.799786  7201 raft_consensus.cc:515] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:05.783221  7060 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.783440  7147 raft_consensus.cc:2749] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:05.735301  7165 raft_consensus.cc:515] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:05.814649  1615 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:05.822023  7174 consensus_queue.cc:1059] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:01:05.814882  7184 consensus_queue.cc:1048] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 13:01:05.829582  1574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 2585) took 1136 ms. Trace:
I20260709 13:01:05.829988  1574 rpcz_store.cc:276] 0709 13:01:04.693349 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.693516 (+   167us) service_pool.cc:224] Handling call
0709 13:01:04.693850 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:05.296007 (+602157us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:05.829336 (+533329us) spinlock_profiling.cc:243] Waited 551 ms on lock 0x7b54002ec7d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:01:05.829525 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1266878720}
I20260709 13:01:05.822371  7166 raft_consensus.cc:2804] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:05.842557  1718 raft_consensus.cc:2468] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 14.
I20260709 13:01:05.805315  7060 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:05.844769  7200 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:05.854370  1539 leader_election.cc:304] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:05.856081  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:05.857044  1649 raft_consensus.cc:1240] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 13:01:05.856294  1575 raft_consensus.cc:1240] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:05.860126  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:05.860570  1644 raft_consensus.cc:1275] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:01:05.863804  1646 raft_consensus.cc:1275] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:01:05.865303  7119 consensus_queue.cc:1048] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:05.843961  7166 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.862143  7170 raft_consensus.cc:2804] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:05.844820  7134 consensus_queue.cc:1059] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:01:05.861510  7245 consensus_queue.cc:1059] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:01:05.893072  1722 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2654) took 1165 ms. Trace:
I20260709 13:01:05.861431  7199 consensus_queue.cc:1059] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:01:05.893603  1722 rpcz_store.cc:276] 0709 13:01:04.728127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:04.759792 (+ 31665us) service_pool.cc:224] Handling call
0709 13:01:05.892869 (+1133077us) spinlock_profiling.cc:243] Waited 624 ms on lock 0x7b540009c9d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:01:05.893013 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1435832320}
I20260709 13:01:05.893985  7199 raft_consensus.cc:3055] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:05.893198  7245 raft_consensus.cc:3055] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:05.871541  7166 raft_consensus.cc:3060] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:05.894351  7199 raft_consensus.cc:740] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:01:05.872429  7149 consensus_queue.cc:1048] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:01:05.896857  7245 raft_consensus.cc:740] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:05.899408  7170 raft_consensus.cc:697] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
W20260709 13:01:05.933269  1691 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:05.933511  7177 raft_consensus.cc:493] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.934123  7177 raft_consensus.cc:515] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:01:05.934311  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 157004us
I20260709 13:01:05.936256  7177 leader_election.cc:290] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:05.936800  7175 consensus_queue.cc:1243] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 13:01:05.938201  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 221012us
I20260709 13:01:05.938352  7172 raft_consensus.cc:2749] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:05.938908  1689 leader_election.cc:304] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:05.939702  6977 raft_consensus.cc:2749] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:05.940048  1689 leader_election.cc:304] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:05.940543  1688 leader_election.cc:304] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:05.941668  7171 raft_consensus.cc:2804] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:05.942061  7171 raft_consensus.cc:493] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:05.942408  7171 raft_consensus.cc:3060] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:05.943123  1688 leader_election.cc:304] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:05.943909  1650 raft_consensus.cc:2410] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:01:05.944221  6977 raft_consensus.cc:2804] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:05.944823  6977 raft_consensus.cc:697] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 15 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:01:05.945737  6977 consensus_queue.cc:237] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:05.949630  7060 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:05.951977  1651 raft_consensus.cc:1240] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:05.952458  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:01:05.953020  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 764329us
I20260709 13:01:05.902612  7200 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 17 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:05.960386  1689 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:01:05.961735  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 522453us
I20260709 13:01:05.965430  1689 leader_election.cc:304] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:05.963322  6986 raft_consensus.cc:493] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:05.973984  6986 raft_consensus.cc:515] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:05.976078  6986 leader_election.cc:290] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:05.967306  7074 raft_consensus.cc:3055] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:05.976678  7074 raft_consensus.cc:740] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:01:05.977536  7074 consensus_queue.cc:260] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:05.978967  7074 raft_consensus.cc:3060] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:05.980682  7013 raft_consensus.cc:493] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:05.981204  7013 raft_consensus.cc:515] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:05.983635  7013 leader_election.cc:290] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:05.984573  7245 consensus_queue.cc:260] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:05.985594  2295 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:05.967724  7146 raft_consensus.cc:2749] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:05.990965  1722 raft_consensus.cc:1275] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:01:05.989907  7158 raft_consensus.cc:2749] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:01:05.994714  7133 consensus_queue.cc:260] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:05.996179  7133 raft_consensus.cc:3060] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:05.985747  7245 raft_consensus.cc:3060] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:05.957976  7199 consensus_queue.cc:260] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:05.999313  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:05.958474  7175 raft_consensus.cc:2749] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:05.999955  1571 raft_consensus.cc:3060] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:06.001884  7149 consensus_queue.cc:1059] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:01:06.002980  7201 leader_election.cc:290] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:06.003216  7149 raft_consensus.cc:3055] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:06.003794  7149 raft_consensus.cc:740] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:01:05.981272  7045 consensus_queue.cc:1059] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:05.984411  7170 consensus_queue.cc:237] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:06.004966  7149 consensus_queue.cc:260] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:06.005426  6915 raft_consensus.cc:3055] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:06.005843  6915 raft_consensus.cc:740] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:06.005966  7149 raft_consensus.cc:3060] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:06.006654  6915 consensus_queue.cc:260] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:06.007714  6915 raft_consensus.cc:3060] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:06.008780  7165 leader_election.cc:290] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:05.999449  7199 raft_consensus.cc:3060] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:06.015633  1571 raft_consensus.cc:2468] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 14.
I20260709 13:01:06.016698  1615 leader_election.cc:304] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 13:01:06.020670  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 63260.1us
I20260709 13:01:06.014843  1539 leader_election.cc:304] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:06.023926  1572 raft_consensus.cc:1240] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:06.023936  2294 leader_election.cc:304] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:01:06.026469  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 61144.8us
I20260709 13:01:06.027194  1689 leader_election.cc:304] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:06.027889  2326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb"
dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
mode: GRACEFUL
new_leader_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:39778
I20260709 13:01:06.022171  6660 raft_consensus.cc:2804] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:06.028779  1689 leader_election.cc:304] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:06.030694  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0203dcfbe4440c790f2bf709bd16179" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:06.028748  2326 raft_consensus.cc:606] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 LEADER]: Received request to transfer leadership to TS 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:06.029497  7175 raft_consensus.cc:2749] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:06.033612  6660 raft_consensus.cc:697] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 14 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:06.027917  7124 raft_consensus.cc:2804] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:06.036335  6660 consensus_queue.cc:237] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:06.022091  6885 consensus_queue.cc:1048] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.015s
I20260709 13:01:06.028157  7115 consensus_queue.cc:1059] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 13:01:06.038177  7200 consensus_queue.cc:1059] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:06.038801  6885 raft_consensus.cc:3060] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:06.029595  7165 raft_consensus.cc:2749] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:06.040679  7175 raft_consensus.cc:2749] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:06.035310  2295 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:06.038313  2294 leader_election.cc:304] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:06.035643  1689 leader_election.cc:304] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:06.043656  1689 leader_election.cc:304] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:06.028309  7066 raft_consensus.cc:493] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.047595  7066 raft_consensus.cc:515] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:06.049181  7013 raft_consensus.cc:3055] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:06.049638  7013 raft_consensus.cc:740] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:01:06.050526  7013 consensus_queue.cc:260] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:06.051324  7204 raft_consensus.cc:3055] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:01:06.051733  7204 raft_consensus.cc:740] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:01:06.052038  7013 raft_consensus.cc:3060] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:06.052511  7204 consensus_queue.cc:260] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:06.053741  7204 raft_consensus.cc:3060] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:01:06.055400  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:06.056375  7066 leader_election.cc:290] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:06.056903  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:06.057487  1572 raft_consensus.cc:2468] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 15.
I20260709 13:01:06.058422  1648 raft_consensus.cc:1275] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:01:06.058894  1615 leader_election.cc:304] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:06.046494  7146 raft_consensus.cc:2804] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:06.045841  1689 leader_election.cc:304] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:06.060115  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:06.061431  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:06.062304  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:06.059826  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:06.059821  7165 raft_consensus.cc:2804] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:06.061110  7066 raft_consensus.cc:2804] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:06.061721  7071 raft_consensus.cc:2804] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:06.094971  7071 raft_consensus.cc:493] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.095364  7071 raft_consensus.cc:3060] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:06.059875  7146 raft_consensus.cc:493] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:06.096797  7146 raft_consensus.cc:3060] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:06.099455  1645 raft_consensus.cc:2468] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 15.
I20260709 13:01:06.092911  7165 raft_consensus.cc:493] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:06.061573  7158 consensus_queue.cc:1048] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
W20260709 13:01:06.100462  1615 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:06.100109  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 54307.7us
I20260709 13:01:06.107152  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:01:06.107553  1689 leader_election.cc:304] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:06.108028  2324 raft_consensus.cc:2368] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 16. Current term is 17.
I20260709 13:01:06.110594  1572 raft_consensus.cc:1275] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:01:06.111426  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:06.111721  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:06.110867  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:06.112417  1571 raft_consensus.cc:3060] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:06.113196  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:06.113409  1689 leader_election.cc:304] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:06.114382  1689 leader_election.cc:304] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:06.120131  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:01:06.121111  1689 leader_election.cc:304] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:06.122895  1574 raft_consensus.cc:2393] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 15: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:01:06.122743  1571 raft_consensus.cc:2468] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 17.
I20260709 13:01:06.124269  1689 leader_election.cc:304] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:06.100836  7069 raft_consensus.cc:2804] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:06.124439  2295 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:06.126267  2331 raft_consensus.cc:1275] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 18 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 13:01:06.101213  7175 raft_consensus.cc:2749] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:06.102006  7066 raft_consensus.cc:493] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.128983  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:06.130582  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 13:01:06.137406  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 98400.4us
I20260709 13:01:06.125696  7177 consensus_queue.cc:1048] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 13:01:06.122201  7164 raft_consensus.cc:2749] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:06.140054  7177 raft_consensus.cc:2749] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:06.123349  7172 raft_consensus.cc:2749] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:06.141038  7159 raft_consensus.cc:2804] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:06.142297  7159 raft_consensus.cc:697] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:01:06.143126  7159 consensus_queue.cc:237] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:06.124269  7200 consensus_queue.cc:1048] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:01:06.103060  7165 raft_consensus.cc:3060] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:06.122381  7181 raft_consensus.cc:2749] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:06.148866  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:06.149565  2323 raft_consensus.cc:2468] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 14.
I20260709 13:01:06.151782  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:06.133348  2326 raft_consensus.cc:1275] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:06.152945  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:06.153764  2332 raft_consensus.cc:2468] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 14.
I20260709 13:01:06.163439  2294 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:06.166225  7166 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:06.168955  7028 raft_consensus.cc:2749] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:06.164208  7200 consensus_queue.cc:1048] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:06.125424  7176 raft_consensus.cc:3055] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:06.169961  7176 raft_consensus.cc:740] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:06.170817  7176 consensus_queue.cc:260] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:06.172040  7176 raft_consensus.cc:3060] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:06.172610  7069 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.172859  1649 raft_consensus.cc:1240] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 19 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:01:06.173108  7069 raft_consensus.cc:3060] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:06.177964  1615 leader_election.cc:400] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 election: Vote denied by peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423) with higher term. Message: Invalid argument: T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 16. Current term is 17.
I20260709 13:01:06.189090  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:06.128242  6977 raft_consensus.cc:2749] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:06.189775  2297 leader_election.cc:304] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:06.198212  7200 raft_consensus.cc:2749] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:06.199041  7200 consensus_queue.cc:1048] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:06.200456  7071 raft_consensus.cc:515] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:06.177531  7066 raft_consensus.cc:3060] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:06.204748  7013 consensus_queue.cc:1048] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:06.209357  1540 leader_election.cc:304] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:06.210242  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:06.211436  1718 raft_consensus.cc:2410] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 13:01:06.212630  7154 raft_consensus.cc:2749] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:01:06.213214  7257 log.cc:927] Time spent T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.250s	user 0.006s	sys 0.004s
I20260709 13:01:06.214112  7166 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 19 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:06.219329  7165 raft_consensus.cc:515] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:01:06.220201  7258 log.cc:927] Time spent T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.236s	user 0.005s	sys 0.005s
I20260709 13:01:06.220638  1688 leader_election.cc:304] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:01:06.222204  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.227952  1647 raft_consensus.cc:1275] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:01:06.229794  1647 raft_consensus.cc:1275] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:01:06.236449  7124 raft_consensus.cc:697] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:01:06.238129  7124 consensus_queue.cc:237] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:01:06.240330  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 116115us
I20260709 13:01:06.241201  1689 leader_election.cc:304] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:06.254771  1689 leader_election.cc:304] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:06.255159  2297 leader_election.cc:304] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:06.261770  1689 leader_election.cc:304] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:06.266445  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:01:06.266672  2326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67"
dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
mode: GRACEFUL
new_leader_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:39778
I20260709 13:01:06.267565  2326 raft_consensus.cc:606] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Received request to transfer leadership to TS 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:06.273492  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:06.274992  1542 leader_election.cc:304] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:06.223778  7175 raft_consensus.cc:2749] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:06.286384  1542 leader_election.cc:304] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:06.288885  7140 raft_consensus.cc:3055] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 13 LEADER]: Stepping down as leader of term 13
W20260709 13:01:06.293485  7256 log.cc:927] Time spent T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.309s	user 0.002s	sys 0.009s
W20260709 13:01:06.295372  7263 log.cc:927] Time spent T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.145s	user 0.002s	sys 0.000s
W20260709 13:01:06.297127  1615 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.299571  7165 leader_election.cc:290] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:06.206928  7217 consensus_queue.cc:1048] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 13:01:06.234592  6977 raft_consensus.cc:493] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:06.264827  7181 raft_consensus.cc:3060] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:06.321826  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.320042  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:06.259994  7013 raft_consensus.cc:2749] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:06.303030  6885 raft_consensus.cc:2749] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:06.330379  1542 leader_election.cc:304] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
W20260709 13:01:06.334906  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.335441  1542 leader_election.cc:304] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:06.269035  7177 raft_consensus.cc:2749] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:06.224584  7146 raft_consensus.cc:515] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:06.338406  1542 leader_election.cc:304] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:06.339924  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:06.258785  7123 consensus_queue.cc:1048] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 13:01:06.303718  7172 raft_consensus.cc:2749] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:06.344714  1649 raft_consensus.cc:1275] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:01:06.323298  7133 raft_consensus.cc:493] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.316324  7269 raft_consensus.cc:2749] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:01:06.351231  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.263952  7154 consensus_queue.cc:1048] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
I20260709 13:01:06.356483  2331 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064"
dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
mode: GRACEFUL
new_leader_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:39778
I20260709 13:01:06.345222  2326 raft_consensus.cc:2468] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 14.
I20260709 13:01:06.322947  7149 raft_consensus.cc:2749] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:01:06.322662  7140 raft_consensus.cc:740] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:06.357290  2331 raft_consensus.cc:606] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Received request to transfer leadership to TS 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:06.346616  7187 raft_consensus.cc:493] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.349786  7119 raft_consensus.cc:2804] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:06.342712  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:06.259254  7166 consensus_queue.cc:1048] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.076s
I20260709 13:01:06.332006  7175 raft_consensus.cc:493] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.332646  7164 raft_consensus.cc:493] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.364848  1571 raft_consensus.cc:1275] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:06.342170  2294 leader_election.cc:304] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:06.340556  6977 raft_consensus.cc:515] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:06.343396  7116 raft_consensus.cc:2749] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:06.343835  1542 leader_election.cc:304] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:06.345703  7261 raft_consensus.cc:2749] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:06.360824  7218 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.345753  6986 consensus_queue.cc:1059] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.024s
W20260709 13:01:06.389662  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 45901.3us
I20260709 13:01:06.394166  1542 leader_election.cc:304] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:06.381580  7045 raft_consensus.cc:2804] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:06.356599  7133 raft_consensus.cc:515] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:06.399441  1571 raft_consensus.cc:3060] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:06.416107  7262 log.cc:927] Time spent T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.277s	user 0.002s	sys 0.000s
I20260709 13:01:06.407086  7116 raft_consensus.cc:2804] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:06.396243  7045 raft_consensus.cc:493] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:06.426211  6977 leader_election.cc:290] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:01:06.433411  7270 log.cc:927] Time spent T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:01:06.380559  7175 raft_consensus.cc:515] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:06.440303  1570 raft_consensus.cc:2410] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 9.
I20260709 13:01:06.381640  7115 consensus_queue.cc:1048] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.058s
I20260709 13:01:06.439487  1571 raft_consensus.cc:1275] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:01:06.448493  7071 leader_election.cc:290] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:01:06.450948  7264 log.cc:927] Time spent T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.318s	user 0.001s	sys 0.000s
I20260709 13:01:06.454536  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:06.493264  1720 raft_consensus.cc:3060] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:06.467914  7066 raft_consensus.cc:515] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:06.456262  7146 leader_election.cc:290] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:06.482218  7045 raft_consensus.cc:3060] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:06.460912  1576 raft_consensus.cc:1240] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:01:06.460916  1569 raft_consensus.cc:1240] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 17 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:06.462121  7133 leader_election.cc:290] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:06.463439  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:06.508594  1645 raft_consensus.cc:2468] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 12.
I20260709 13:01:06.464254  2326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e94ee9035214526808abfaab11799fe"
dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
mode: GRACEFUL
new_leader_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:39778
I20260709 13:01:06.510251  2326 raft_consensus.cc:606] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 LEADER]: Received request to transfer leadership to TS 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:06.465437  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:06.469033  1615 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:01:06.512195  7265 log.cc:927] Time spent T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
W20260709 13:01:06.512678  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 43742.3us
I20260709 13:01:06.513952  7175 leader_election.cc:290] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:06.471858  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:06.520884  1651 raft_consensus.cc:3060] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:06.521009  7166 raft_consensus.cc:2749] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:01:06.486016  7069 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:06.524590  2325 raft_consensus.cc:1240] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:01:06.394193  7269 raft_consensus.cc:2749] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:06.526505  7204 raft_consensus.cc:3055] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:01:06.526952  7204 raft_consensus.cc:740] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:01:06.370393  7187 raft_consensus.cc:515] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 13:01:06.531558  7187 leader_election.cc:290] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373)
I20260709 13:01:06.479341  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:01:06.533759  7245 consensus_meta.cc:287] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.514s	user 0.010s	sys 0.000s
W20260709 13:01:06.534559  1615 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.495901  7116 raft_consensus.cc:697] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:01:06.491247  1571 raft_consensus.cc:1240] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 13:01:06.383085  7164 raft_consensus.cc:515] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:06.402024  7140 consensus_queue.cc:260] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:06.399673  7218 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:06.409324  7171 raft_consensus.cc:515] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:06.381786  7172 consensus_queue.cc:1048] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:01:06.544171  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:06.539513  2328 raft_consensus.cc:2468] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 14.
I20260709 13:01:06.538612  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:06.538147  1688 leader_election.cc:304] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:06.546311  1646 raft_consensus.cc:1240] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 19 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 13:01:06.527839  7204 consensus_queue.cc:260] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:06.549798  1720 raft_consensus.cc:2468] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 10.
W20260709 13:01:06.539955  7170 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.010s	sys 0.020s
I20260709 13:01:06.556646  1651 raft_consensus.cc:2468] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 10.
W20260709 13:01:06.559237  7170 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.011s	sys 0.020s
I20260709 13:01:06.560396  7181 raft_consensus.cc:2749] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:06.606354  2332 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b"
dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
mode: GRACEFUL
new_leader_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:39778
I20260709 13:01:06.607270  2332 raft_consensus.cc:606] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 LEADER]: Received request to transfer leadership to TS 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:06.609779  7164 leader_election.cc:290] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:06.536095  7116 consensus_queue.cc:237] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:06.617553  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:06.618542  1569 raft_consensus.cc:2468] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 15.
I20260709 13:01:06.556032  7175 raft_consensus.cc:2804] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:06.555195  7166 consensus_queue.cc:1048] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 13:01:06.624985  1615 leader_election.cc:304] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:06.555377  7119 raft_consensus.cc:697] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:01:06.551554  7187 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:06.623126  7172 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.628816  7175 raft_consensus.cc:493] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:06.629474  7175 raft_consensus.cc:3060] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:06.629371  7172 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:06.626104  7156 raft_consensus.cc:2804] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:06.633104  7156 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:06.633522  7156 raft_consensus.cc:3060] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:06.635042  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:06.638746  7171 leader_election.cc:290] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:06.626919  7129 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.640901  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:06.640774  7129 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:06.641981  7172 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:06.643071  7129 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:06.644723  1648 raft_consensus.cc:1275] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:01:06.647594  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:06.648200  1648 raft_consensus.cc:3060] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:06.612422  7218 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:06.649588  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:06.650331  2332 raft_consensus.cc:2468] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 17.
I20260709 13:01:06.654884  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:06.659879  7170 raft_consensus.cc:493] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.660806  7170 raft_consensus.cc:515] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:06.663447  7170 leader_election.cc:290] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:06.663709  7147 consensus_queue.cc:1048] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:06.663462  1615 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:06.664494  7045 raft_consensus.cc:515] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:06.564006  7204 raft_consensus.cc:3060] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:06.563300  7140 raft_consensus.cc:3060] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:06.675345  1648 raft_consensus.cc:2468] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 15.
I20260709 13:01:06.716787  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:06.718099  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:06.656343  7069 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:06.668933  7218 raft_consensus.cc:2804] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:01:06.723126  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.732256  2324 raft_consensus.cc:1275] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:06.555215  6660 consensus_queue.cc:1059] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.093s
W20260709 13:01:06.740445  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.748859  2294 leader_election.cc:304] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:06.740418  7066 leader_election.cc:290] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:06.743057  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:06.749907  1570 raft_consensus.cc:3060] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:06.736047  1688 leader_election.cc:304] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
W20260709 13:01:06.751493  1691 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.755035  1689 leader_election.cc:304] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:06.766626  7146 raft_consensus.cc:2749] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:06.757975  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:06.759696  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:06.767486  1689 leader_election.cc:304] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:06.768405  7146 raft_consensus.cc:2749] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:06.747236  7218 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:06.785018  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.786188  1689 leader_election.cc:304] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:06.745106  7276 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:06.677371  7187 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:06.762775  7181 raft_consensus.cc:2804] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:06.815915  7116 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:06.821527  1570 raft_consensus.cc:2468] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 16.
I20260709 13:01:06.823982  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:01:06.832329  2328 raft_consensus.cc:3060] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:06.730321  7061 consensus_queue.cc:1059] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:01:06.758992  7028 raft_consensus.cc:493] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
W20260709 13:01:06.827955  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 47774.2us
I20260709 13:01:06.839439  1718 raft_consensus.cc:1240] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:06.840050  1615 leader_election.cc:304] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:06.793829  7218 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:01:06.824599  7256 log.cc:927] Time spent T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 13:01:06.841717  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 55642.8us
I20260709 13:01:06.795307  7074 raft_consensus.cc:2804] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:06.854465  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:06.855242  1716 raft_consensus.cc:2376] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 15. Re-sending same reply.
I20260709 13:01:06.855675  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:06.856099  1721 raft_consensus.cc:1240] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:06.856796  1724 raft_consensus.cc:1240] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 14. Current term is 15. Ops: []
W20260709 13:01:06.857196  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:06.858134  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:06.858619  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:06.859217  1725 raft_consensus.cc:2468] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 14.
I20260709 13:01:06.859968  1716 raft_consensus.cc:1240] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 13:01:06.860368  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:06.861059  1718 raft_consensus.cc:2368] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 10. Current term is 11.
I20260709 13:01:06.865734  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:06.876187  1718 raft_consensus.cc:1275] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:01:06.877322  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:06.879587  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:06.880185  1725 raft_consensus.cc:2468] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 11.
I20260709 13:01:06.881652  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:06.882241  1725 raft_consensus.cc:2468] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 15.
I20260709 13:01:06.884467  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:06.885607  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:06.886709  1718 raft_consensus.cc:3060] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:06.887845  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:06.893366  2331 raft_consensus.cc:1240] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 LEADER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:06.885653  2328 raft_consensus.cc:2468] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 16.
I20260709 13:01:06.873492   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 13:01:06.934267  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:06.935042  1721 raft_consensus.cc:3060] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:06.947410  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:06.892005  7171 raft_consensus.cc:2804] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:06.872184  7045 leader_election.cc:290] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 15 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:06.825295  7276 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:06.895226  7181 raft_consensus.cc:697] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 15 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:01:06.986454  1721 raft_consensus.cc:2468] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 14.
I20260709 13:01:06.990355  1718 raft_consensus.cc:2468] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 14.
I20260709 13:01:06.946542  7166 raft_consensus.cc:2804] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:06.997047  1721 raft_consensus.cc:1240] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 15 LEADER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 14. Current term is 15. Ops: []
W20260709 13:01:06.980643  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 144221us
I20260709 13:01:06.841177  7116 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:06.893028  7028 raft_consensus.cc:515] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:06.952833  7164 raft_consensus.cc:493] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:07.013595  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:06.959375  7171 raft_consensus.cc:493] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:07.022944  1721 raft_consensus.cc:1275] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:01:07.025054  1718 raft_consensus.cc:1275] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 13:01:06.932461  7156 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:06.961704  7280 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:07.046499  1721 raft_consensus.cc:1275] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:01:07.056397  1718 raft_consensus.cc:1275] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:01:06.844691  7119 consensus_queue.cc:237] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 13:01:07.017585  7166 raft_consensus.cc:697] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 16 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:07.069521  7166 consensus_queue.cc:237] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:07.069974  1617 leader_election.cc:304] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:07.071375  1617 leader_election.cc:304] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:07.072377  1617 leader_election.cc:304] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:07.072629  1721 raft_consensus.cc:1275] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:01:07.081559  1689 leader_election.cc:304] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:07.082825  1617 leader_election.cc:400] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 10 pre-election: Vote denied by peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473) with higher term. Message: Invalid argument: T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 10. Current term is 11.
I20260709 13:01:07.085611  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:07.086282  1718 raft_consensus.cc:2468] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 14.
I20260709 13:01:07.042909  7171 raft_consensus.cc:3060] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:07.131197  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 283388us
I20260709 13:01:07.058830  6915 raft_consensus.cc:493] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.081044  7061 raft_consensus.cc:2749] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:07.043648  7164 raft_consensus.cc:515] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:07.129750  7074 raft_consensus.cc:697] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:01:07.176944  7061 raft_consensus.cc:2804] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:07.177480  7061 raft_consensus.cc:493] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:07.177887  7061 raft_consensus.cc:3060] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:07.073051  7280 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:07.190578  7066 raft_consensus.cc:3055] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:07.191185  7066 raft_consensus.cc:740] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
W20260709 13:01:07.192346  7284 log.cc:927] Time spent T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
W20260709 13:01:07.195168  7278 log.cc:927] Time spent T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.361s	user 0.001s	sys 0.000s
W20260709 13:01:07.196596  7277 log.cc:927] Time spent T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.305s	user 0.000s	sys 0.001s
W20260709 13:01:07.197695  7291 log.cc:927] Time spent T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.192s	user 0.000s	sys 0.000s
W20260709 13:01:07.199311  7292 log.cc:927] Time spent T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260709 13:01:07.099790  6660 raft_consensus.cc:2749] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:01:07.206125  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 117744us
I20260709 13:01:07.207549  1617 leader_election.cc:304] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:07.214051  1617 leader_election.cc:304] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
W20260709 13:01:07.227638  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 387613us
I20260709 13:01:07.087750  7201 consensus_queue.cc:1059] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.088s
W20260709 13:01:07.244336  7293 log.cc:927] Time spent T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
W20260709 13:01:07.246207  7283 log.cc:927] Time spent T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.287s	user 0.001s	sys 0.000s
W20260709 13:01:07.243425  1615 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:07.251148  1615 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:07.252957  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 171466us
I20260709 13:01:07.261797  1721 raft_consensus.cc:3055] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:07.262315  1721 raft_consensus.cc:740] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:01:07.263336  1721 consensus_queue.cc:260] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:07.210664  7187 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:07.104928  7181 consensus_queue.cc:237] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:07.293907  1725 raft_consensus.cc:1275] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:01:07.171206  6915 raft_consensus.cc:515] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:07.192137  7066 consensus_queue.cc:260] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:07.278831  7045 raft_consensus.cc:993] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66: : Instructing follower 0c7751452c4b46afa95251b9df7169d4 to start an election
W20260709 13:01:07.328437  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:07.345969  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 257530us
I20260709 13:01:07.292572  7159 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.210249  7300 consensus_queue.cc:1059] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.101s
W20260709 13:01:07.365963  1645 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.008s	sys 0.012s
W20260709 13:01:07.457201  1646 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.015s	sys 0.023s
I20260709 13:01:07.298168  7187 raft_consensus.cc:2749] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:01:07.362843  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 224157us
W20260709 13:01:07.363605  7306 log.cc:927] Time spent T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
W20260709 13:01:07.500839  1645 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.011s	sys 0.032s
W20260709 13:01:07.457437  7294 log.cc:927] Time spent T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260709 13:01:07.509203  7217 raft_consensus.cc:2804] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:07.494625  7276 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:07.365908  6660 consensus_queue.cc:1048] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.167s
I20260709 13:01:07.537213  7302 raft_consensus.cc:493] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.526521  7279 raft_consensus.cc:1081] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 LEADER]: Signalling peer 0c7751452c4b46afa95251b9df7169d4 to start an election
I20260709 13:01:07.523758  7116 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:07.525234  7066 raft_consensus.cc:3060] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:07.561094  2295 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:07.564373  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:01:07.538761  7275 log.cc:927] Time spent T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.460s	user 0.000s	sys 0.001s
W20260709 13:01:07.528861  7218 consensus_meta.cc:287] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.679s	user 0.015s	sys 0.004s
I20260709 13:01:07.509229  7159 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:01:07.569903  7296 log.cc:927] Time spent T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 13:01:07.539793  7028 leader_election.cc:290] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:07.460259  7074 consensus_queue.cc:237] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:07.566761  7156 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:01:07.592700  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 326142us
I20260709 13:01:07.566938  7280 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:07.559511  7217 raft_consensus.cc:493] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:07.601099  7217 raft_consensus.cc:3060] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:07.597967  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:07.606208  1723 raft_consensus.cc:3060] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:07.607360  1649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 1139) took 1243 ms. Trace:
I20260709 13:01:07.607787  1649 rpcz_store.cc:276] 0709 13:01:06.364481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.365393 (+   912us) service_pool.cc:224] Handling call
0709 13:01:06.365897 (+   504us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:06.375229 (+  9332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:06.375281 (+    52us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:06.380137 (+  4856us) log.cc:844] Serialized 26 byte log entry
0709 13:01:06.749599 (+369462us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:06.749653 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:06.749729 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:07.607159 (+857430us) raft_consensus.cc:1685] finished
0709 13:01:07.607180 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:07.607305 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8742,"raft.queue_time_us":8884,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":8221,"thread_start_us":369152,"threads_started":1,"wal-append.queue_time_us":625548}
I20260709 13:01:07.598812  7300 raft_consensus.cc:3055] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:07.570458  7302 raft_consensus.cc:515] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:07.603523  6977 raft_consensus.cc:2749] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:01:07.623268  7175 consensus_meta.cc:287] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.993s	user 0.012s	sys 0.001s
I20260709 13:01:07.622529  7164 leader_election.cc:290] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:07.643918  1725 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b"
dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:58782
I20260709 13:01:07.646131  7300 raft_consensus.cc:740] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:01:07.682606  1725 raft_consensus.cc:493] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:07.683238  1725 raft_consensus.cc:3060] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:07.608296  7218 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:07.628871  7279 raft_consensus.cc:2749] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:07.685350  1723 raft_consensus.cc:2468] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 16.
I20260709 13:01:07.679620  7201 raft_consensus.cc:493] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:01:07.679893  7245 raft_consensus.cc:493] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
W20260709 13:01:07.703061  7286 log.cc:927] Time spent T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.422s	user 0.000s	sys 0.001s
I20260709 13:01:07.702565  7315 raft_consensus.cc:493] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:07.713068  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 152014us
I20260709 13:01:07.670606  7175 raft_consensus.cc:515] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:07.701508  7320 raft_consensus.cc:493] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:07.723098  1725 raft_consensus.cc:515] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:01:07.713356  7304 log.cc:927] Time spent T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
I20260709 13:01:07.726946  1649 raft_consensus.cc:1275] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:01:07.733299  1690 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.674s	user 0.007s	sys 0.011s
I20260709 13:01:07.733582  1716 raft_consensus.cc:1240] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 11. Current term is 12. Ops: []
W20260709 13:01:07.733673  1690 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.787s	user 0.007s	sys 0.012s
I20260709 13:01:07.705623  7316 raft_consensus.cc:493] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:01:07.741165  7159 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:07.741505  1725 leader_election.cc:290] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:07.743076  7218 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 18 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:07.745182  7175 leader_election.cc:290] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:07.750082  7324 raft_consensus.cc:493] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.750726  7324 raft_consensus.cc:515] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:07.752684  7187 raft_consensus.cc:493] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:07.753305  7187 raft_consensus.cc:515] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:07.755622  7305 raft_consensus.cc:3055] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:07.756048  7305 raft_consensus.cc:740] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:07.757210  7328 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:07.757771  7328 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:01:07.764953  7325 log.cc:927] Time spent T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:01:07.712764  7201 raft_consensus.cc:515] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:07.770645  7330 raft_consensus.cc:493] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.771229  7330 raft_consensus.cc:515] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:07.773592  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 1470) took 1399 ms. Trace:
I20260709 13:01:07.734675  6915 leader_election.cc:290] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:07.774102  2331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53290 (request call id 1170) took 1305 ms. Trace:
I20260709 13:01:07.774632  2331 rpcz_store.cc:276] 0709 13:01:06.468605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.469672 (+  1067us) service_pool.cc:224] Handling call
0709 13:01:06.469996 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.901052 (+431056us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.107900 (+206848us) spinlock_profiling.cc:243] Waited 5.66 ms on lock 0x7b5400541120. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f2332dc0 00007fa9f23bea02 00007fa9f23badd6 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2
0709 13:01:07.773868 (+665968us) spinlock_profiling.cc:243] Waited 404 ms on lock 0x7b540069c154. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:01:07.774042 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":941825152}
I20260709 13:01:07.723608  7315 raft_consensus.cc:515] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:07.720078  7245 raft_consensus.cc:515] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:07.735545  7320 raft_consensus.cc:515] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:07.777604  7302 leader_election.cc:290] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:07.723397  7300 consensus_queue.cc:260] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:01:07.729213  7308 log.cc:927] Time spent T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
I20260709 13:01:07.773968  1717 rpcz_store.cc:276] 0709 13:01:06.374144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.374372 (+   228us) service_pool.cc:224] Handling call
0709 13:01:06.386343 (+ 11971us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:06.558447 (+172104us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:06.558477 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:06.558947 (+   470us) log.cc:844] Serialized 26 byte log entry
0709 13:01:06.787694 (+228747us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:06.787750 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.177290 (+389540us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b540007e254. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:01:07.177367 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:07.773269 (+595902us) raft_consensus.cc:1685] finished
0709 13:01:07.773290 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:07.773532 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1033,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":97,"spinlock_wait_cycles":394908928,"thread_start_us":228431,"threads_started":1,"wal-append.queue_time_us":532495}
W20260709 13:01:07.792919  1614 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.806941  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:07.807749  1723 raft_consensus.cc:2468] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 14.
I20260709 13:01:07.833050  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:07.833169  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:07.836074  1643 raft_consensus.cc:1275] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:01:07.836324  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:07.836973  1644 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 11.
I20260709 13:01:07.838829  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:07.849092  1648 raft_consensus.cc:2468] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 12.
I20260709 13:01:07.854354  1723 raft_consensus.cc:1240] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 14. Current term is 15. Ops: []
W20260709 13:01:07.854630  1574 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.015s	sys 0.016s
W20260709 13:01:07.855177  1574 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.016s	sys 0.016s
I20260709 13:01:07.767904  7305 consensus_queue.cc:260] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:07.810667  7164 raft_consensus.cc:493] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:07.810942  7280 raft_consensus.cc:493] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:07.828825  7175 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
W20260709 13:01:07.861847  7204 consensus_meta.cc:287] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 1.132s	user 0.010s	sys 0.003s
I20260709 13:01:07.736356  7316 raft_consensus.cc:515] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:01:07.905966  2294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.861881  6651 raft_consensus.cc:493] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.917881  7028 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:07.928107  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.927019  2324 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53290 (request call id 1166) took 1795 ms. Trace:
I20260709 13:01:07.930190  2324 rpcz_store.cc:276] 0709 13:01:06.131252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.131378 (+   126us) service_pool.cc:224] Handling call
0709 13:01:06.725374 (+593996us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:06.746721 (+ 21347us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.926781 (+1180060us) spinlock_profiling.cc:243] Waited 594 ms on lock 0x7b54006202d0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23ba8ad 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:01:07.926943 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1365399808}
I20260709 13:01:07.933522  1720 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2660) took 1079 ms. Trace:
I20260709 13:01:07.934017  1720 rpcz_store.cc:276] 0709 13:01:06.854546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.854654 (+   108us) service_pool.cc:224] Handling call
0709 13:01:06.854968 (+   314us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:06.904798 (+ 49830us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:06.904840 (+    42us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:06.953358 (+ 48518us) log.cc:844] Serialized 52 byte log entry
0709 13:01:07.151389 (+198031us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:07.151446 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.151543 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:07.933298 (+781755us) raft_consensus.cc:1685] finished
0709 13:01:07.933319 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:07.933453 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56198,"raft.queue_time_us":39376,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":35011,"thread_start_us":125388,"threads_started":1,"wal-append.queue_time_us":300495}
I20260709 13:01:07.893698  7317 raft_consensus.cc:493] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:07.934114  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:07.937107  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:07.937912  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:01:07.943580  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:01:07.920686  7305 raft_consensus.cc:3060] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:07.946494  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 100679us
I20260709 13:01:07.946473  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:07.947732  2328 raft_consensus.cc:2468] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 11.
I20260709 13:01:07.927006  7245 leader_election.cc:290] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:07.897303  7164 raft_consensus.cc:515] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:07.937597  7187 leader_election.cc:290] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:07.954759  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:07.917564  7280 raft_consensus.cc:515] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:07.904126  7175 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:07.945407  7315 leader_election.cc:290] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:07.942471  7320 leader_election.cc:290] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:07.946062  7330 leader_election.cc:290] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:07.933601  7028 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:07.929068  6651 raft_consensus.cc:515] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:07.961161  7337 raft_consensus.cc:493] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:07.992019  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:07.944017  7317 raft_consensus.cc:515] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:07.992910  7337 raft_consensus.cc:515] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:07.993011  1647 raft_consensus.cc:2468] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 15.
I20260709 13:01:07.995262  7317 leader_election.cc:290] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:07.995820  7317 raft_consensus.cc:493] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:07.955703  7298 log.cc:927] Time spent T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.649s	user 0.004s	sys 0.000s
I20260709 13:01:07.997682  7337 leader_election.cc:290] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:07.998548  7280 leader_election.cc:290] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:01:07.972658  7327 log.cc:927] Time spent T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:01:07.999352  7245 consensus_queue.cc:1048] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:07.998570  1689 leader_election.cc:304] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:08.000506  7320 raft_consensus.cc:2749] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:08.001062  1646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45142 (request call id 2178) took 1177 ms. Trace:
I20260709 13:01:08.001246  1689 leader_election.cc:304] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 13:01:07.989786  7164 leader_election.cc:290] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:08.002818  7320 raft_consensus.cc:2804] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:07.984961  7338 raft_consensus.cc:493] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.003399  7320 raft_consensus.cc:493] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:08.003727  7338 raft_consensus.cc:515] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:08.004595  7181 consensus_queue.cc:1048] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:08.006305  7338 leader_election.cc:290] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:01:07.973635  7331 log.cc:927] Time spent T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:01:08.011839  6651 leader_election.cc:290] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:07.988243  7328 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:08.012539  2326 raft_consensus.cc:3060] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:08.013939  7333 log.cc:927] Time spent T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:01:08.015154  1574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 2619) took 1491 ms. Trace:
I20260709 13:01:08.015496  1574 rpcz_store.cc:276] 0709 13:01:06.524142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.536773 (+ 12631us) service_pool.cc:224] Handling call
0709 13:01:06.537222 (+   449us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:06.545112 (+  7890us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:06.545143 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:06.558414 (+ 13271us) log.cc:844] Serialized 26 byte log entry
0709 13:01:07.293037 (+734623us) spinlock_profiling.cc:243] Waited 2.71 ms on lock 0x7b18002d7d20. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef2b0e07 00007fa9f810bab9 00007fa9ef2cd69b 00007fa9ef2cb93f 00007fa9ef2cdc02 00007fa9f1f5520b 00007fa9f1f5ad23 00007fa9f1f5b0d1 00007fa9f2376a0f
0709 13:01:07.855834 (+562797us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:01:07.855896 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.856008 (+   112us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:08.014843 (+158835us) raft_consensus.cc:1685] finished
0709 13:01:08.014863 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:08.015098 (+   235us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7360,"raft.queue_time_us":8048,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":6608,"spinlock_wait_cycles":6223104,"thread_start_us":562445,"threads_started":1,"wal-append.queue_time_us":1381384}
I20260709 13:01:07.996292  7317 raft_consensus.cc:515] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:07.986649  7316 leader_election.cc:290] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:08.018699  7317 leader_election.cc:290] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:08.021643  7217 raft_consensus.cc:515] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
W20260709 13:01:07.990672  7061 consensus_meta.cc:287] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.811s	user 0.008s	sys 0.004s
I20260709 13:01:08.023413  7061 raft_consensus.cc:515] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:08.024087  7217 leader_election.cc:290] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373)
I20260709 13:01:08.026374  7061 leader_election.cc:290] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 15 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:08.029237  1642 raft_consensus.cc:1275] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
W20260709 13:01:08.032996  7171 consensus_meta.cc:287] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.892s	user 0.009s	sys 0.004s
I20260709 13:01:08.034162  7337 raft_consensus.cc:493] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:08.001451  1646 rpcz_store.cc:276] 0709 13:01:06.823948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.825584 (+  1636us) service_pool.cc:224] Handling call
0709 13:01:06.825986 (+   402us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:06.894634 (+ 68648us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:01:07.501242 (+606608us) log.cc:844] Serialized 14 byte log entry
0709 13:01:07.737573 (+236331us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:07.738032 (+   459us) log.cc:844] Serialized 26 byte log entry
0709 13:01:07.738166 (+   134us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:07.738199 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:07.738263 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:08.000853 (+262590us) raft_consensus.cc:1685] finished
0709 13:01:08.000874 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:08.001004 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46581,"prepare.queue_time_us":146667,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":67739,"raft.run_cpu_time_us":350,"raft.run_wall_time_us":47303,"thread_start_us":702998,"threads_started":2,"wal-append.queue_time_us":300000}
I20260709 13:01:08.003916  7320 raft_consensus.cc:3060] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:07.987746  7140 consensus_meta.cc:287] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 1.243s	user 0.010s	sys 0.002s
I20260709 13:01:08.046618  1642 pending_rounds.cc:85] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e: Aborting all ops after (but not including) 12
I20260709 13:01:08.064891  1642 pending_rounds.cc:107] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 13:01:08.065348  1642 raft_consensus.cc:2889] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:08.047638  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 97137us
I20260709 13:01:08.046566  7317 raft_consensus.cc:493] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:08.048417  7171 raft_consensus.cc:515] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:08.022032  2326 raft_consensus.cc:2468] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 15.
W20260709 13:01:08.053112  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 53052.7us
I20260709 13:01:08.059542  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:08.069301  1718 raft_consensus.cc:2468] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 8.
I20260709 13:01:08.061414  1572 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36642 (request call id 2754) took 1619 ms. Trace:
I20260709 13:01:08.064256  7199 raft_consensus.cc:493] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
W20260709 13:01:08.063853  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:07.992401  7175 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:08.073060  1718 raft_consensus.cc:1240] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:08.075595  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:08.077133  7220 raft_consensus.cc:3055] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:08.079229  1542 leader_election.cc:304] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:08.070304  1572 rpcz_store.cc:276] 0709 13:01:06.441722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.474505 (+ 32783us) service_pool.cc:224] Handling call
0709 13:01:06.474893 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:06.482342 (+  7449us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:01:06.680648 (+198306us) log.cc:844] Serialized 14 byte log entry
0709 13:01:06.933550 (+252902us) log.cc:844] Serialized 14 byte log entry
0709 13:01:06.933720 (+   170us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:06.946180 (+ 12460us) log.cc:844] Serialized 26 byte log entry
0709 13:01:06.946324 (+   144us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:06.946510 (+   186us) log.cc:844] Serialized 14 byte log entry
0709 13:01:08.061081 (+1114571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.061156 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:08.061216 (+    60us) raft_consensus.cc:1685] finished
0709 13:01:08.061230 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:08.061355 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1155185,"prepare.queue_time_us":367735,"prepare.run_cpu_time_us":145,"prepare.run_wall_time_us":6625,"raft.queue_time_us":3409123,"raft.run_cpu_time_us":370,"raft.run_wall_time_us":13307,"thread_start_us":397009,"threads_started":2,"wal-append.queue_time_us":490043}
I20260709 13:01:08.094587  1688 leader_election.cc:304] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:08.099159  2294 leader_election.cc:304] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:08.049404  7338 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.111824  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:08.112643  1646 raft_consensus.cc:2368] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 17. Current term is 18.
I20260709 13:01:08.114073  2294 leader_election.cc:304] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:08.117206  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:08.117756  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:08.118429  1646 raft_consensus.cc:2468] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 15.
I20260709 13:01:08.119678  7171 leader_election.cc:290] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:01:08.120815  1615 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.070542  7218 raft_consensus.cc:493] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.072929  7124 raft_consensus.cc:493] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:01:08.134209  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:08.135673  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:08.135854  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:08.136591  1644 raft_consensus.cc:2410] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 13:01:08.136626  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:08.049499  7337 raft_consensus.cc:515] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:08.065089  7129 raft_consensus.cc:493] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:08.095682  7220 raft_consensus.cc:740] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:08.108677  7116 raft_consensus.cc:493] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.141424  2297 leader_election.cc:304] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 13:01:08.143997  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
W20260709 13:01:08.130376  7069 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.784s	user 0.023s	sys 0.025s
I20260709 13:01:08.144623  1645 raft_consensus.cc:3060] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:01:08.129055  7154 raft_consensus.cc:493] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:08.145921  7147 raft_consensus.cc:493] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.115020  7338 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:08.130208  7170 raft_consensus.cc:493] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:08.146893  7315 raft_consensus.cc:993] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66: : Instructing follower 0c7751452c4b46afa95251b9df7169d4 to start an election
I20260709 13:01:08.146978  7313 raft_consensus.cc:993] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66: : Instructing follower 0c7751452c4b46afa95251b9df7169d4 to start an election
I20260709 13:01:08.147362  7149 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.146733  7220 consensus_queue.cc:260] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:08.189635  7220 raft_consensus.cc:3060] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:08.121361  1615 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.190408  7313 raft_consensus.cc:1081] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 LEADER]: Signalling peer 0c7751452c4b46afa95251b9df7169d4 to start an election
W20260709 13:01:08.190493  1615 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.120585  7123 raft_consensus.cc:493] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:08.193585  7123 raft_consensus.cc:515] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:08.195930  7123 leader_election.cc:290] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:08.196732  7315 raft_consensus.cc:1081] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Signalling peer 0c7751452c4b46afa95251b9df7169d4 to start an election
I20260709 13:01:08.155489  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:08.198295  1646 raft_consensus.cc:2468] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 11.
I20260709 13:01:08.131619  7071 raft_consensus.cc:2749] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:08.094931  7199 raft_consensus.cc:515] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:08.138171  7261 raft_consensus.cc:493] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.199991  7261 raft_consensus.cc:515] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:08.201283  7199 leader_election.cc:290] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:08.203428  7261 leader_election.cc:290] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:08.163569  7163 raft_consensus.cc:2804] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:01:08.204224  7163 raft_consensus.cc:493] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:08.204845  7163 raft_consensus.cc:3060] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:08.163609  7301 raft_consensus.cc:2749] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:08.167272  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:08.167821  7149 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:08.168630  7342 raft_consensus.cc:2804] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:08.169425  7324 leader_election.cc:290] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:08.171239  7338 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:08.171772  7337 leader_election.cc:290] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:08.171686  7170 raft_consensus.cc:515] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:08.137436  7218 raft_consensus.cc:515] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:08.150708  7129 raft_consensus.cc:515] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:08.151154  7116 raft_consensus.cc:515] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:08.172712  7300 raft_consensus.cc:3060] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:08.160059  7140 raft_consensus.cc:493] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:08.162451  7147 raft_consensus.cc:515] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:08.161509  7154 raft_consensus.cc:515] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:08.184310  7276 raft_consensus.cc:493] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:08.184778  7320 raft_consensus.cc:515] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:08.185065  7060 consensus_queue.cc:1059] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:08.187330  7269 raft_consensus.cc:2749] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:08.139019  7124 raft_consensus.cc:515] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:08.073616  7317 raft_consensus.cc:515] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:01:08.159370  7069 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.857s	user 0.024s	sys 0.025s
I20260709 13:01:08.218053  7149 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:08.237828  7201 leader_election.cc:290] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:08.238946  7147 leader_election.cc:290] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:08.231389  7140 raft_consensus.cc:515] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:08.243636  7317 leader_election.cc:290] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:08.243758  7320 leader_election.cc:290] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:08.245131  7140 leader_election.cc:290] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:08.245221  7154 leader_election.cc:290] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:08.233604  7276 raft_consensus.cc:515] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:08.247231  7276 leader_election.cc:290] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:08.243027  7129 leader_election.cc:290] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:08.249267  7170 leader_election.cc:290] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:08.250257  7163 raft_consensus.cc:515] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:08.289089  1539 leader_election.cc:400] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391) with higher term. Message: Invalid argument: T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 17. Current term is 18.
I20260709 13:01:08.290020  1539 leader_election.cc:403] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:08.291395  1539 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:08.297273  1567 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36642 (request call id 2755) took 1821 ms. Trace:
I20260709 13:01:08.297853  1567 rpcz_store.cc:276] 0709 13:01:06.475759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.478380 (+  2621us) service_pool.cc:224] Handling call
0709 13:01:06.495092 (+ 16712us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:06.495622 (+   530us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:01:06.716883 (+221261us) log.cc:844] Serialized 14 byte log entry
0709 13:01:06.843234 (+126351us) log.cc:844] Serialized 14 byte log entry
0709 13:01:06.905569 (+ 62335us) log.cc:844] Serialized 14 byte log entry
0709 13:01:08.059242 (+1153673us) spinlock_profiling.cc:243] Waited 8.37 ms on lock 0x7b18002eb1c0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef248c0a 00007fa9f8988219 00007fa9ef2d0a40 00007fa9ef2cb4e4 00007fa9ef2cb455 00007fa9f23b3060 00007fa9f23c5716 00007fa9f23d6287 00007fa9f23d6208
0709 13:01:08.059382 (+   140us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:08.059874 (+   492us) log.cc:844] Serialized 26 byte log entry
0709 13:01:08.060038 (+   164us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:01:08.060257 (+   219us) log.cc:844] Serialized 14 byte log entry
0709 13:01:08.060508 (+   251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.060612 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:08.296563 (+235951us) raft_consensus.cc:1685] finished
0709 13:01:08.296655 (+    92us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:08.297026 (+   371us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1249130,"prepare.queue_time_us":173427,"prepare.run_cpu_time_us":142,"prepare.run_wall_time_us":4983,"raft.queue_time_us":1247546,"raft.run_cpu_time_us":452,"raft.run_wall_time_us":54059,"spinlock_wait_cycles":19244928,"thread_start_us":270795,"threads_started":2,"wal-append.queue_time_us":542887}
W20260709 13:01:08.302829  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 223547us
I20260709 13:01:08.306324  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:08.307336  1573 raft_consensus.cc:1275] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 17 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:01:08.307971  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:08.308887  1576 raft_consensus.cc:2468] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 11.
I20260709 13:01:08.307336  1570 raft_consensus.cc:2468] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 9.
I20260709 13:01:08.304519  1542 leader_election.cc:304] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:08.302577  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:08.311646  1568 raft_consensus.cc:2468] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 16.
I20260709 13:01:08.312783  1542 leader_election.cc:304] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
W20260709 13:01:08.315965  1615 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:08.337213  1615 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.337208  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:08.321273  7355 raft_consensus.cc:493] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:08.340396  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:08.214279  1645 raft_consensus.cc:2468] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 15.
I20260709 13:01:08.344139  1647 raft_consensus.cc:1275] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 13:01:08.344586  1647 pending_rounds.cc:85] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e: Aborting all ops after (but not including) 7
I20260709 13:01:08.344918  1647 pending_rounds.cc:107] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 13:01:08.345227  1647 raft_consensus.cc:2889] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:08.345374  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:08.177230  1617 leader_election.cc:304] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
W20260709 13:01:08.347622  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 170371us
I20260709 13:01:08.324364  1648 raft_consensus.cc:2410] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 14 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 6.
I20260709 13:01:08.212473  1722 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8e94ee9035214526808abfaab11799fe"
dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:58782
W20260709 13:01:08.351382  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.351636  1722 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:08.352207  1722 raft_consensus.cc:3060] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:08.352721  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:08.352970  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:08.353551  1573 raft_consensus.cc:3060] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:08.353681  1568 raft_consensus.cc:3060] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:08.357226  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:08.358804  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:08.360137  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:08.212654  1725 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064"
dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:58782
W20260709 13:01:08.208870  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 80311.2us
I20260709 13:01:08.350049  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:08.353173  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:08.361171  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:08.393401  2294 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:08.394742  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:08.329326  1723 raft_consensus.cc:2468] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 11.
I20260709 13:01:08.362463  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:08.396399  6986 raft_consensus.cc:2804] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:08.396870  6986 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:08.397347  6986 raft_consensus.cc:3060] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:08.400316  1572 raft_consensus.cc:1275] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:01:08.400941  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:08.362807  1617 leader_election.cc:304] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:08.365989  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:08.366308  6915 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:08.366217  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:08.402570  2326 raft_consensus.cc:2393] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 17: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 13:01:08.367296  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:08.402441  6915 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:08.367565  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:08.368669  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:08.369159  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:08.404711  2331 raft_consensus.cc:2468] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 14.
I20260709 13:01:08.405020  2332 raft_consensus.cc:2393] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 10: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 13:01:08.405746  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:08.406337  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:08.406613  1572 raft_consensus.cc:2468] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 14.
I20260709 13:01:08.406677  6915 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:08.407343  1719 raft_consensus.cc:3060] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:08.371073  2324 raft_consensus.cc:2468] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 10.
I20260709 13:01:08.368394  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:08.372954  7060 consensus_queue.cc:1048] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:01:08.375432  7116 leader_election.cc:290] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:08.409080  2330 raft_consensus.cc:2468] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 11.
I20260709 13:01:08.410081  1717 raft_consensus.cc:3060] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:08.375511  2295 leader_election.cc:304] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:08.378614  7124 leader_election.cc:290] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:08.252763  7163 leader_election.cc:290] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:08.379534  7129 raft_consensus.cc:493] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.380031  7199 consensus_queue.cc:1048] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:08.379923  7220 raft_consensus.cc:493] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:08.391043  7269 raft_consensus.cc:2804] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:08.391762  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:08.392122  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:08.386354  1722 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:08.418759  7220 raft_consensus.cc:515] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:08.420679  1722 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:08.421850  7220 leader_election.cc:290] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:08.421973  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:08.423079  1722 raft_consensus.cc:2368] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 14. Current term is 15.
I20260709 13:01:08.423693  7276 raft_consensus.cc:493] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:08.424594  7349 raft_consensus.cc:493] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
W20260709 13:01:08.424821  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 62253.6us
I20260709 13:01:08.425339  7349 raft_consensus.cc:515] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:08.426158  6915 raft_consensus.cc:2804] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:08.426618  6915 raft_consensus.cc:493] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:08.426733  7199 raft_consensus.cc:2749] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:08.427065  6915 raft_consensus.cc:3060] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:08.419298  2330 raft_consensus.cc:1240] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 13:01:08.387058  7261 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Advancing to term 18
I20260709 13:01:08.440173  7116 consensus_queue.cc:1048] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:08.440723  7154 raft_consensus.cc:493] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:08.441740  7154 raft_consensus.cc:515] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:08.424590  7276 raft_consensus.cc:515] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:08.444679  7276 leader_election.cc:290] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:08.418092  7269 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:08.427876  7349 leader_election.cc:290] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:08.445570  7269 raft_consensus.cc:3060] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:08.423764  7351 raft_consensus.cc:493] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:08.444707  7355 raft_consensus.cc:515] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:08.447460  7351 raft_consensus.cc:515] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:08.417510  1573 raft_consensus.cc:2468] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 10.
I20260709 13:01:08.422886  7347 raft_consensus.cc:493] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:08.444976  7115 raft_consensus.cc:2804] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:08.452122  7347 raft_consensus.cc:515] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:08.453354  1647 raft_consensus.cc:1240] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:08.454774  7218 leader_election.cc:290] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:08.454946  7347 leader_election.cc:290] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:08.391594  1725 raft_consensus.cc:493] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:08.455725  1725 raft_consensus.cc:3060] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:08.424871  7129 raft_consensus.cc:515] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:08.459563  7129 leader_election.cc:290] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:08.431277  7170 raft_consensus.cc:2749] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:08.439945  7140 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:08.461221  7140 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:08.415042  1568 raft_consensus.cc:2468] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 16.
I20260709 13:01:08.452143  7115 raft_consensus.cc:697] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 16 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
W20260709 13:01:08.465621  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 90485.1us
I20260709 13:01:08.445262  7154 leader_election.cc:290] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:08.473626  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:01:08.473762  7300 raft_consensus.cc:2804] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:08.474366  2330 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:08.474468  7300 raft_consensus.cc:493] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:08.475169  7300 raft_consensus.cc:3060] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:08.476858  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:08.478574  7115 consensus_queue.cc:237] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:08.480199  7355 leader_election.cc:290] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:08.481701  1570 raft_consensus.cc:1275] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:01:08.482774  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:08.482859  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:08.483414  1570 raft_consensus.cc:2468] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 15.
I20260709 13:01:08.483834  1647 raft_consensus.cc:2468] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 15.
I20260709 13:01:08.487007  2332 raft_consensus.cc:1275] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:01:08.488049  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:08.488430  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:08.489058  2326 raft_consensus.cc:2393] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 14: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 13:01:08.489462  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:08.489075  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:08.490533  7269 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:08.504415  2330 raft_consensus.cc:2468] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 18.
I20260709 13:01:08.506542   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:08.507230  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:08.508399  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:08.508927  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:08.509793  1718 raft_consensus.cc:2468] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 13.
I20260709 13:01:08.513027  1716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2671) took 1642 ms. Trace:
I20260709 13:01:08.513552  1716 rpcz_store.cc:276] 0709 13:01:06.870864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.871169 (+   305us) service_pool.cc:224] Handling call
0709 13:01:06.871505 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:07.738919 (+867414us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.512549 (+773630us) spinlock_profiling.cc:243] Waited 862 ms on lock 0x7b54002ab7d4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:01:08.512824 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1982116736}
I20260709 13:01:08.514391  7349 consensus_queue.cc:1059] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:08.514770  7146 consensus_queue.cc:1059] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:08.514995  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:08.515561  7351 leader_election.cc:290] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:08.516266  1646 raft_consensus.cc:2393] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 15: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:01:08.519434  1574 raft_consensus.cc:2368] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 16. Current term is 17.
I20260709 13:01:08.519387  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:08.521999  1539 leader_election.cc:304] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:08.529543  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:08.534578  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:08.532502  1725 raft_consensus.cc:515] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:08.541328  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:08.542722  1717 raft_consensus.cc:2468] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 15.
I20260709 13:01:08.549379  1725 leader_election.cc:290] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:01:08.552973  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 240563us
I20260709 13:01:08.553041  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:08.541749  7351 raft_consensus.cc:2804] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:08.551947  1722 raft_consensus.cc:2468] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 14.
I20260709 13:01:08.555537  1719 raft_consensus.cc:2468] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 12.
I20260709 13:01:08.560657  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 13:01:08.568948  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 424428us
I20260709 13:01:08.577335  1650 raft_consensus.cc:1240] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:08.579583  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:08.580914  1568 raft_consensus.cc:2468] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 10.
I20260709 13:01:08.581890  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:08.582340  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:08.557052  7351 raft_consensus.cc:493] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:08.596212  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:08.596916  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:08.597533  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:08.598724  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:08.599422  1568 raft_consensus.cc:2468] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 14.
I20260709 13:01:08.600231  7301 raft_consensus.cc:3055] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:08.600226  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:08.605880  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:01:08.609819  1615 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.595894  7351 raft_consensus.cc:3060] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:08.600845  7301 raft_consensus.cc:740] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:01:08.606441  7261 raft_consensus.cc:2749] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391) with higher term. Message: Invalid argument: T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 17. Current term is 18.
I20260709 13:01:08.618782  1650 raft_consensus.cc:1275] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:08.605708  7269 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 17 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:08.620929  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:08.632098  7342 raft_consensus.cc:697] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 12 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:01:08.633140  1542 leader_election.cc:304] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:08.633769  7342 consensus_queue.cc:237] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:08.635528  1542 leader_election.cc:304] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:08.636983  7269 raft_consensus.cc:2804] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:08.637641  7269 raft_consensus.cc:697] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
W20260709 13:01:08.637842  7356 log.cc:927] Time spent T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:01:08.638756  7269 consensus_queue.cc:237] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:08.641420  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 17 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:08.659312  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:08.672698  1650 raft_consensus.cc:3060] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:08.662063  7261 raft_consensus.cc:2749] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:08.688758  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
W20260709 13:01:08.696828  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 75183.7us
I20260709 13:01:08.698119  1540 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:08.699198  7261 raft_consensus.cc:2749] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:08.701855  6986 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:08.703640  2325 raft_consensus.cc:2368] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 16. Current term is 17.
I20260709 13:01:08.705865  6986 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 17 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:08.708127  1617 leader_election.cc:400] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Vote denied by peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473) with higher term. Message: Invalid argument: T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 14. Current term is 15.
I20260709 13:01:08.714223  1617 leader_election.cc:403] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:08.710788  1540 leader_election.cc:304] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:08.663501  7028 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:01:08.721246  2294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:08.723098  7367 log.cc:927] Time spent T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:01:08.723850  1650 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 12.
I20260709 13:01:08.727878  1647 raft_consensus.cc:3060] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Advancing to term 17
W20260709 13:01:08.731551  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 44615.7us
I20260709 13:01:08.732654  1617 leader_election.cc:304] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:08.733613  7115 raft_consensus.cc:2749] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473) with higher term. Message: Invalid argument: T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 14. Current term is 15.
I20260709 13:01:08.734136  7119 raft_consensus.cc:3055] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:08.734436  7115 raft_consensus.cc:2804] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:08.734568  7119 raft_consensus.cc:740] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:01:08.734910  7115 raft_consensus.cc:493] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:08.735324  7115 raft_consensus.cc:3060] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:08.735600  7119 consensus_queue.cc:260] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:08.718918  7261 raft_consensus.cc:2804] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:08.736958  7261 raft_consensus.cc:493] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:08.737459  7261 raft_consensus.cc:3060] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:08.738780  7360 log.cc:927] Time spent T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.155s	user 0.002s	sys 0.000s
I20260709 13:01:08.740618  7119 raft_consensus.cc:3060] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:08.741451  1615 leader_election.cc:304] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:08.741432  7136 consensus_queue.cc:1048] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:08.742520  7220 consensus_queue.cc:1048] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:08.743045  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:08.743933  7136 raft_consensus.cc:2804] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:08.744453  7136 raft_consensus.cc:493] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:08.744951  7136 raft_consensus.cc:3060] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:08.747565  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 47076.2us
I20260709 13:01:08.743924  1569 raft_consensus.cc:2468] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 15.
W20260709 13:01:08.759641  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 124234us
I20260709 13:01:08.763634  1617 leader_election.cc:304] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:08.769311  7355 consensus_queue.cc:1048] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:08.769757  6885 raft_consensus.cc:993] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66: : Instructing follower 0c7751452c4b46afa95251b9df7169d4 to start an election
I20260709 13:01:08.770735  1617 leader_election.cc:304] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:08.771827  1617 leader_election.cc:304] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:08.772778  7129 raft_consensus.cc:2804] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:08.773551  7129 raft_consensus.cc:697] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 15 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
W20260709 13:01:08.773903  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.774827  7129 consensus_queue.cc:237] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:08.776839  7220 raft_consensus.cc:2804] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:08.777452  7220 raft_consensus.cc:697] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 12 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:08.778750  7220 consensus_queue.cc:237] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 13:01:08.782243  7069 raft_consensus.cc:1081] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Signalling peer 0c7751452c4b46afa95251b9df7169d4 to start an election
I20260709 13:01:08.722566  7301 consensus_queue.cc:260] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:08.786373  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:01:08.788892  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:08.789270  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:08.789794  2330 raft_consensus.cc:2368] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 9. Current term is 10.
I20260709 13:01:08.790570  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:01:08.792258  7355 consensus_queue.cc:1048] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:08.787691  1567 raft_consensus.cc:2468] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 18.
I20260709 13:01:08.787629  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:08.791646  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:08.794499  7355 consensus_queue.cc:1048] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:08.795219  2331 raft_consensus.cc:3060] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:08.789794  1542 leader_election.cc:304] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:08.791646  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:08.798069  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:08.790763  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:08.758994  7172 raft_consensus.cc:493] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:08.799584  7172 raft_consensus.cc:515] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:08.801407  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:08.773120  7300 raft_consensus.cc:515] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:08.802116  1717 raft_consensus.cc:2468] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 10.
I20260709 13:01:08.802428  7172 leader_election.cc:290] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:08.791836  7199 consensus_queue.cc:1048] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:08.805064  1540 leader_election.cc:304] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:08.813500  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:08.804275  7300 leader_election.cc:290] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:01:08.821995  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 66155.3us
I20260709 13:01:08.818401  1688 leader_election.cc:304] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:08.810967  7199 raft_consensus.cc:2804] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:08.837334  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
W20260709 13:01:08.845309  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 73609.6us
I20260709 13:01:08.847446  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:08.843966  1716 raft_consensus.cc:2468] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 14.
I20260709 13:01:08.849416  7156 raft_consensus.cc:2804] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:08.849879  7156 raft_consensus.cc:493] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:08.850193  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:01:08.850394  7156 raft_consensus.cc:3060] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:08.850875  2323 raft_consensus.cc:3055] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:08.851219  2323 raft_consensus.cc:740] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:01:08.852983  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: true dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:01:08.853659  2326 raft_consensus.cc:3055] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:08.853943  2326 raft_consensus.cc:740] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:01:08.854715  2326 consensus_queue.cc:260] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:08.855877  2326 raft_consensus.cc:3060] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:08.858489  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
W20260709 13:01:08.859740  1571 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36640 (request call id 2620) took 2321 ms (client timeout 1527 ms). Trace:
I20260709 13:01:08.860929  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:08.861740  1645 raft_consensus.cc:2468] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 19.
I20260709 13:01:08.852038  2323 consensus_queue.cc:260] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:08.869665  2323 raft_consensus.cc:3060] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:08.829466  7170 raft_consensus.cc:2804] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:08.873374  2330 raft_consensus.cc:1275] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:01:08.860165  1571 rpcz_store.cc:269] 0709 13:01:06.538245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:06.538388 (+   143us) service_pool.cc:224] Handling call
0709 13:01:08.859333 (+2320945us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b5400365bd4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:01:08.859545 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2937730816}
I20260709 13:01:08.872210  1617 leader_election.cc:304] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:08.875526  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:01:08.875661  7170 raft_consensus.cc:493] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:08.876264  2332 raft_consensus.cc:2368] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 11. Current term is 12.
I20260709 13:01:08.877736  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:08.876279  7170 raft_consensus.cc:3060] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:08.878615  1725 raft_consensus.cc:3060] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Advancing to term 10
W20260709 13:01:08.880460  2297 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:08.876048  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:08.885434  2294 leader_election.cc:304] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:08.886204  7301 raft_consensus.cc:3060] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:08.886271  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 13:01:08.887413  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 72434.8us
I20260709 13:01:08.887687  7165 raft_consensus.cc:2804] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:08.832260  7199 raft_consensus.cc:493] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:08.893160  7165 raft_consensus.cc:493] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:08.897665  7165 raft_consensus.cc:3060] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:08.901777  1688 leader_election.cc:304] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:08.904482  7267 raft_consensus.cc:2804] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:08.904840  7312 raft_consensus.cc:2804] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:08.905316  7312 raft_consensus.cc:493] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:08.905718  7312 raft_consensus.cc:3060] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:08.905821  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:08.905103  7267 raft_consensus.cc:697] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 15 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:01:08.906806  1718 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 16.
I20260709 13:01:08.907683  7267 consensus_queue.cc:237] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:08.918175  1642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 1151) took 1085 ms. Trace:
I20260709 13:01:08.918668  1642 rpcz_store.cc:276] 0709 13:01:07.832119 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.833543 (+  1424us) service_pool.cc:224] Handling call
0709 13:01:07.833796 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:08.065956 (+232160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:08.917658 (+851702us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b54002b1954. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:01:08.917919 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":448344832}
I20260709 13:01:08.914873  7140 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:08.915532  1646 raft_consensus.cc:1275] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260709 13:01:08.927598  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 171947us
W20260709 13:01:08.933477  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 94976.1us
I20260709 13:01:08.935501  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:08.936023  1615 leader_election.cc:304] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:08.924041  1721 raft_consensus.cc:3060] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:08.941047  1717 raft_consensus.cc:1240] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:08.946310  6703 raft_consensus.cc:2749] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:08.948398  2323 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 12.
I20260709 13:01:08.949319  2326 raft_consensus.cc:2468] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 10.
I20260709 13:01:08.954176  2327 raft_consensus.cc:2468] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 11.
I20260709 13:01:08.955014  1617 leader_election.cc:304] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:08.956928  1617 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:08.968412  1647 raft_consensus.cc:2468] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 17.
W20260709 13:01:08.971359  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 181742us
I20260709 13:01:08.924350  7199 raft_consensus.cc:3060] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:08.963457  7140 raft_consensus.cc:2804] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:08.993561  1721 raft_consensus.cc:1275] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:01:08.997234  1615 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:08.966085  7218 raft_consensus.cc:2804] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:09.001183  1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2677) took 1745 ms. Trace:
I20260709 13:01:09.000948  1725 raft_consensus.cc:2468] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 10.
I20260709 13:01:09.004280  1615 leader_election.cc:304] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:09.004647  1725 raft_consensus.cc:1240] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:09.001579  1721 rpcz_store.cc:276] 0709 13:01:07.255308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:07.261224 (+  5916us) service_pool.cc:224] Handling call
0709 13:01:07.261638 (+   414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:08.511694 (+1250056us) spinlock_profiling.cc:243] Waited 953 ms on lock 0x7b1800240360. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23f6646 00007fa9f233058e 00007fa9f23b1f9e 00007fa9f23b37de 00007fa9f23bdb49 00007fa9f23be416 00007fa9f23bad8f 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4
0709 13:01:08.923313 (+411619us) spinlock_profiling.cc:243] Waited 359 ms on lock 0x7b580086ffd0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23170aa 00007fa9f2399447 00007fa9f23b1fe7 00007fa9f23b37de 00007fa9f23bdb49 00007fa9f23be416 00007fa9f23bad8f 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4
0709 13:01:08.994125 (+ 70812us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:09.001127 (+  7002us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3017385216}
I20260709 13:01:08.997005  7140 raft_consensus.cc:493] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:09.000181  7218 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:09.024843  1723 raft_consensus.cc:1240] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 10. Current term is 11. Ops: []
W20260709 13:01:09.019840  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 134551us
I20260709 13:01:09.025581  2295 leader_election.cc:304] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:09.012308  7220 raft_consensus.cc:2804] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:09.015728  7140 raft_consensus.cc:3060] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:09.011431  7269 consensus_queue.cc:1048] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
W20260709 13:01:09.028704  6915 consensus_meta.cc:287] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.601s	user 0.008s	sys 0.008s
I20260709 13:01:09.030169  7342 consensus_queue.cc:1048] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 13:01:09.048864  7324 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.066727  7324 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:09.067703  1469 catalog_manager.cc:5697] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:09.068905  7324 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:09.069463  1469 catalog_manager.cc:5697] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 9 to 12, leader changed from 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 12 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:01:09.051025  7136 raft_consensus.cc:515] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:09.051074  6885 consensus_queue.cc:1048] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:09.056071  7156 raft_consensus.cc:515] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:09.017659  7218 raft_consensus.cc:3060] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:09.064440  2331 raft_consensus.cc:2468] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 15.
I20260709 13:01:09.065436  6915 raft_consensus.cc:515] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:09.066033  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:09.049324  6977 raft_consensus.cc:493] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.077008  1651 raft_consensus.cc:2368] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 15. Current term is 16.
I20260709 13:01:09.022294  7351 raft_consensus.cc:515] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:09.034004  7220 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:09.098707  7129 raft_consensus.cc:2804] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:09.099252  7129 raft_consensus.cc:493] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:09.099622  7129 raft_consensus.cc:3060] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:09.100630  2294 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:09.101980  6915 leader_election.cc:290] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 15 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:09.102137  6703 raft_consensus.cc:2804] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 13:01:09.102736  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.102669  6703 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:09.103348  6703 raft_consensus.cc:3060] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:09.076785  6977 raft_consensus.cc:515] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:09.074136  7165 raft_consensus.cc:515] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:09.106779  7165 leader_election.cc:290] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:09.075204  7269 raft_consensus.cc:493] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.113445  7136 leader_election.cc:290] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:09.028941  7261 raft_consensus.cc:515] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:09.123648  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:09.088148  7324 raft_consensus.cc:2749] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:09.056114  7115 raft_consensus.cc:515] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:09.130666  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:09.134917  1573 raft_consensus.cc:2393] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 17: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:01:09.127640  1469 catalog_manager.cc:5697] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 14 to 15, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 15 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:09.111243  7220 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:09.106953  6977 leader_election.cc:290] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:09.132709  1574 raft_consensus.cc:1275] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 13:01:09.144636  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:09.135581  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:09.141039  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:09.143090  1574 pending_rounds.cc:85] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting all ops after (but not including) 5
I20260709 13:01:09.150413  1574 pending_rounds.cc:107] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 13:01:09.150910  1574 raft_consensus.cc:2889] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:09.159271  1571 raft_consensus.cc:2468] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 18.
I20260709 13:01:09.159554  1649 raft_consensus.cc:1240] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:09.159334  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:09.160781  2295 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:09.168880  1575 raft_consensus.cc:2393] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 12: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:01:09.174418  1688 leader_election.cc:400] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391) with higher term. Message: Invalid argument: T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 15. Current term is 16.
I20260709 13:01:09.174819  1688 leader_election.cc:403] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:09.174995  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:09.178781  7375 raft_consensus.cc:2804] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:09.182114  7115 leader_election.cc:290] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:09.182976  1469 catalog_manager.cc:5697] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 9 to 13, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 13 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:09.184789  1469 catalog_manager.cc:5697] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:09.186436  1469 catalog_manager.cc:5697] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 10 to 15, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 15 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:09.189991  7261 leader_election.cc:290] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 15 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:09.191183  1723 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67"
dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:58782
I20260709 13:01:09.192051  1723 raft_consensus.cc:493] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:09.192436  1723 raft_consensus.cc:3060] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:09.198099  1651 raft_consensus.cc:1240] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 14 LEADER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 13. Current term is 14. Ops: []
W20260709 13:01:09.201725  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:09.216043  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.202426  1469 catalog_manager.cc:5697] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:09.219594  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:01:09.145701  7028 consensus_queue.cc:1048] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
W20260709 13:01:09.229277  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 70238.2us
I20260709 13:01:09.154752  7269 raft_consensus.cc:515] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:09.171277  6885 raft_consensus.cc:2749] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 13:01:09.236317  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:09.203593  7342 raft_consensus.cc:493] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:09.240887  1576 raft_consensus.cc:2410] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:01:09.203998  7375 raft_consensus.cc:697] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:01:09.238334  1723 raft_consensus.cc:515] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:09.242380  7267 raft_consensus.cc:3060] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Advancing to term 16
W20260709 13:01:09.256930  1471 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55606 (request call id 272) took 39468 ms (client timeout 15000 ms). Trace:
I20260709 13:01:09.260916  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:09.261593  7375 consensus_queue.cc:237] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:09.240547  7342 raft_consensus.cc:515] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:09.275882  6703 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:09.290460  6703 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 20 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:09.291474  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:09.292223  1717 raft_consensus.cc:3060] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:09.294925  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 338046us
I20260709 13:01:09.302055  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:09.302186  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:09.303402  1568 raft_consensus.cc:3060] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:01:09.297570  1469 catalog_manager.cc:5697] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 12 to 17, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 17 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:09.303673  1723 leader_election.cc:290] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:09.307080  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
W20260709 13:01:09.257405  1471 rpcz_store.cc:269] 0709 13:00:29.763501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:29.763838 (+   337us) service_pool.cc:224] Handling call
0709 13:01:09.222518 (+39458680us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:04.125352 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:04.126134 (+   782us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:04.126198 (+    64us) write_op.cc:435] Acquired schema lock
0709 13:01:04.126214 (+    16us) tablet.cc:662] Decoding operations
0709 13:01:04.127981 (+  1767us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:04.128092 (+   111us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:04.128123 (+    31us) tablet.cc:685] Acquiring locks for 18 operations
0709 13:01:04.221539 (+ 93416us) tablet.cc:701] Row locks acquired
0709 13:01:04.221595 (+    56us) write_op.cc:260] PREPARE: finished
0709 13:01:04.221777 (+   182us) write_op.cc:270] Start()
0709 13:01:04.221947 (+   170us) write_op.cc:276] Timestamp: P: 1783602064221709 usec, L: 0
0709 13:01:04.221993 (+    46us) op_driver.cc:348] REPLICATION: starting
0709 13:01:04.222678 (+   685us) log.cc:844] Serialized 7178 byte log entry
0709 13:01:04.637019 (+414341us) op_driver.cc:464] REPLICATION: finished
0709 13:01:05.063857 (+426838us) write_op.cc:301] APPLY: starting
0709 13:01:05.063977 (+   120us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:05.766094 (+702117us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:05.766221 (+   127us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:05.847011 (+ 80790us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:05.847411 (+   400us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=36,key_file_lookups=36,delta_file_lookups=36,mrs_lookups=0
0709 13:01:05.847459 (+    48us) write_op.cc:312] APPLY: finished
0709 13:01:05.847917 (+   458us) log.cc:844] Serialized 164 byte log entry
0709 13:01:05.922739 (+ 74822us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:05.959751 (+ 37012us) write_op.cc:454] Released schema lock
0709 13:01:05.980740 (+ 20989us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:05.981201 (+   461us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:05.981234 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":195242,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":426464,"apply.run_cpu_time_us":42596,"apply.run_wall_time_us":917371,"cfile_cache_hit":74,"cfile_cache_hit_bytes":79367,"num_ops":18,"prepare.queue_time_us":194111,"prepare.run_cpu_time_us":20436,"prepare.run_wall_time_us":218814,"raft.queue_time_us":103613,"raft.run_cpu_time_us":12901,"raft.run_wall_time_us":94972,"replication_time_us":414808,"thread_start_us":377369,"threads_started":5,"wal-append.queue_time_us":300078,"wal-append.run_cpu_time_us":16972,"wal-append.run_wall_time_us":2316535}]]}
W20260709 13:01:09.310629  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 260650us
I20260709 13:01:09.389045  1651 raft_consensus.cc:3060] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:09.313858  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:09.314908  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:09.314965  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:09.390337  1575 raft_consensus.cc:2393] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 12: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:01:09.315718  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:09.315949  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:09.315625  7218 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:09.315636  1573 raft_consensus.cc:1275] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 13:01:09.392028  1573 pending_rounds.cc:85] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting all ops after (but not including) 9
I20260709 13:01:09.392282  1573 pending_rounds.cc:107] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 13:01:09.392517  1573 raft_consensus.cc:2889] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:09.316845  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:09.393203  1574 raft_consensus.cc:2368] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 9. Current term is 10.
I20260709 13:01:09.314118  7129 raft_consensus.cc:515] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:09.322168  7312 raft_consensus.cc:515] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:09.314154  7140 raft_consensus.cc:515] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:09.326112  1721 raft_consensus.cc:1275] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:01:09.335502  7373 log.cc:927] Time spent T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.105s	user 0.000s	sys 0.002s
I20260709 13:01:09.336731  7165 raft_consensus.cc:493] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:09.337363  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: true dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:09.341686  7220 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:09.343286  7351 leader_election.cc:290] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 15 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:09.348407  1568 raft_consensus.cc:2468] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 20.
I20260709 13:01:09.353638  1469 catalog_manager.cc:5697] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 15 to 16, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 16 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:09.356974  6915 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.304478  7156 leader_election.cc:290] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 15 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:09.386016  7115 raft_consensus.cc:493] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:01:09.393975  1576 raft_consensus.cc:3060] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:09.401119  7129 leader_election.cc:290] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 15 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:09.401641  7312 leader_election.cc:290] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:09.402369  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:09.403133  1572 raft_consensus.cc:3060] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:09.403342  1646 raft_consensus.cc:1240] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:01:09.408504  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:09.412154  2295 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:09.422892  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:09.416412  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:01:09.416529  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 412311us
I20260709 13:01:09.423790  1716 raft_consensus.cc:3060] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:09.417435  1648 raft_consensus.cc:1240] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:09.419867  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:09.433118  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:09.433856  1573 raft_consensus.cc:3060] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:09.426961  1469 catalog_manager.cc:5697] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:01:09.441047  1567 raft_consensus.cc:2393] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 15: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:01:09.441687  1717 raft_consensus.cc:2468] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 12.
I20260709 13:01:09.443274  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:09.444183  1721 raft_consensus.cc:3060] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:09.445199  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:09.446328  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:09.448721  7375 raft_consensus.cc:2804] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:01:09.450474  1615 leader_election.cc:304] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:09.452484  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:09.456954  1725 raft_consensus.cc:1275] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:01:09.460012  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:09.462383  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:09.462981  1717 raft_consensus.cc:3060] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:01:09.464254  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 17 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:09.466539  1718 raft_consensus.cc:1275] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:01:09.468457  1644 raft_consensus.cc:1275] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:01:09.469548  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:09.473722  1722 raft_consensus.cc:3060] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:09.475742  1573 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 12.
I20260709 13:01:09.478029  7342 leader_election.cc:290] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:01:09.480830  2295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.441699  7165 raft_consensus.cc:515] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:09.482301  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:09.483574  7165 leader_election.cc:290] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:09.484752  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:09.485142  7218 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 15 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:09.487593  7220 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 17 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:09.489452  7140 leader_election.cc:290] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:09.471411  1469 catalog_manager.cc:5697] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:09.497180  7267 raft_consensus.cc:2749] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391) with higher term. Message: Invalid argument: T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 15. Current term is 16.
I20260709 13:01:09.497505  1469 catalog_manager.cc:5697] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 8 to 10, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 10 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:09.489444  1615 leader_election.cc:304] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:09.503288  7140 raft_consensus.cc:2804] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:09.503749  7140 raft_consensus.cc:493] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:01:09.504205  7140 raft_consensus.cc:3060] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:09.469695  6915 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:09.507297  6915 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:09.508373   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:09.502948  1615 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:09.509706  7220 raft_consensus.cc:2804] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:09.510335  7220 raft_consensus.cc:697] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 18 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:09.511329  7220 consensus_queue.cc:237] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:09.455344  7375 raft_consensus.cc:697] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 20 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:01:09.514145  1689 leader_election.cc:400] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423) with higher term. Message: Invalid argument: T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 9. Current term is 10.
I20260709 13:01:09.514642  1689 leader_election.cc:403] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:09.515226  1720 raft_consensus.cc:1275] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260709 13:01:09.517670  7170 consensus_meta.cc:287] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 0.638s	user 0.009s	sys 0.003s
I20260709 13:01:09.518216  7170 raft_consensus.cc:515] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:09.519727  1570 raft_consensus.cc:2393] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 12: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:01:09.513710  7375 consensus_queue.cc:237] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:09.536346  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:09.537124  1725 raft_consensus.cc:3060] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:09.523957  1572 raft_consensus.cc:2468] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 10.
I20260709 13:01:09.540434  1651 raft_consensus.cc:2468] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 20.
I20260709 13:01:09.530956  1721 raft_consensus.cc:2468] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 15.
I20260709 13:01:09.543592  1722 raft_consensus.cc:2468] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 15.
I20260709 13:01:09.467245  7324 raft_consensus.cc:2749] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:01:09.548906  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 131273us
I20260709 13:01:09.442271  7115 raft_consensus.cc:515] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:09.560887  1689 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:09.471153  7269 leader_election.cc:290] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:09.496197  7199 raft_consensus.cc:515] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:09.556699  6703 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.565258  7133 consensus_queue.cc:1048] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:09.569126  7170 leader_election.cc:290] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:09.571548  6885 consensus_queue.cc:1059] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:09.589126  6703 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:09.571602  7329 consensus_queue.cc:1059] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 13:01:09.588181  2297 leader_election.cc:304] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:09.590062  7376 consensus_queue.cc:1048] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:09.590742  7329 raft_consensus.cc:3055] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:09.591172  7329 raft_consensus.cc:740] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:01:09.591643  7376 raft_consensus.cc:2804] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:09.591758  6703 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:09.556859  7342 raft_consensus.cc:493] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.592257  7376 raft_consensus.cc:697] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:01:09.592944  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:09.593097  7342 raft_consensus.cc:515] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:09.593902  1647 raft_consensus.cc:2410] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 13:01:09.595535  7342 leader_election.cc:290] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:09.598004  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 17 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:09.579952  1717 raft_consensus.cc:2468] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 15.
I20260709 13:01:09.580183  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:09.584113  1469 catalog_manager.cc:5697] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 6 to 10, leader changed from 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 10 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:01:09.588033  7199 leader_election.cc:290] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 15 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:09.601210  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:01:09.592190  7329 consensus_queue.cc:260] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:09.574183  1576 raft_consensus.cc:2468] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 11.
I20260709 13:01:09.598994  2331 raft_consensus.cc:2410] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 17 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260709 13:01:09.549180  7267 raft_consensus.cc:2749] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423) with higher term. Message: Invalid argument: T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 9. Current term is 10.
I20260709 13:01:09.607460  1615 leader_election.cc:400] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 pre-election: Vote denied by peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373) with higher term. Message: Invalid argument: T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 16. Current term is 17.
I20260709 13:01:09.607805  1615 leader_election.cc:403] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:09.605255  1716 raft_consensus.cc:2468] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 14.
I20260709 13:01:09.605612  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:01:09.608479  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 67350.4us
I20260709 13:01:09.563470  1719 raft_consensus.cc:2468] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 16.
I20260709 13:01:09.614108  1469 catalog_manager.cc:5697] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:09.593684  7376 consensus_queue.cc:237] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:09.613168  7133 raft_consensus.cc:2749] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:09.634183  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:09.644145  1568 raft_consensus.cc:3060] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:09.635993  1574 raft_consensus.cc:1275] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:01:09.636662  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:09.646617  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:09.647475  1573 raft_consensus.cc:3060] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:09.641726  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:01:09.645197  1648 raft_consensus.cc:1275] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:01:09.646509  1539 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 13:01:09.649869  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:01:09.651221  7351 raft_consensus.cc:2804] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:09.651335  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:09.651908  7351 raft_consensus.cc:697] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 17 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:01:09.652671  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:09.652994  7351 consensus_queue.cc:237] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:09.655409  7350 consensus_queue.cc:1059] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:09.656543  7350 raft_consensus.cc:3055] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:09.656927  7350 raft_consensus.cc:740] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:01:09.657878  7350 consensus_queue.cc:260] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:09.659143  7350 raft_consensus.cc:3060] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:09.649977  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:09.664047  1569 raft_consensus.cc:1240] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:09.664819  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:09.666173  1569 raft_consensus.cc:1275] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:01:09.644549  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:09.653858  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:09.615060  7218 raft_consensus.cc:2749] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373) with higher term. Message: Invalid argument: T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 16. Current term is 17.
I20260709 13:01:09.673897  1725 raft_consensus.cc:2468] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 11.
I20260709 13:01:09.674937  1717 raft_consensus.cc:1240] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 10. Current term is 11. Ops: [8.9-10.10]
W20260709 13:01:09.676460  1615 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.678555  1689 leader_election.cc:304] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
W20260709 13:01:09.681207  7395 log.cc:927] Time spent T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.136s	user 0.002s	sys 0.000s
I20260709 13:01:09.683749  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:09.684487  2331 raft_consensus.cc:2468] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 12.
I20260709 13:01:09.686712  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:09.689100  1689 leader_election.cc:304] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:09.690680  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:09.701005  1469 catalog_manager.cc:5697] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:01:09.715272  7394 log.cc:927] Time spent T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 13:01:09.717648  7115 leader_election.cc:290] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:09.644152  7329 raft_consensus.cc:3060] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:09.728878  1469 catalog_manager.cc:5697] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:01:09.731124  1573 raft_consensus.cc:2468] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 15.
W20260709 13:01:09.620388  7310 consensus_queue.cc:1175] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" responder_term: 10 status { last_received { term: 10 index: 11 } last_committed_idx: 11 last_received_current_leader { term: 10 index: 11 } }
I20260709 13:01:09.697413  7165 raft_consensus.cc:2749] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:01:09.745623  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 65214.5us
I20260709 13:01:09.742332  1568 raft_consensus.cc:2468] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 16.
I20260709 13:01:09.643895  7199 consensus_queue.cc:1059] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.090s
I20260709 13:01:09.756346  1469 catalog_manager.cc:5697] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 7 to 10, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 10 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:09.760051  1469 catalog_manager.cc:5697] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 7 to 9, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 9 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:09.774591  7280 raft_consensus.cc:2749] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:09.840170  1570 raft_consensus.cc:2468] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 14.
I20260709 13:01:09.813679  1469 catalog_manager.cc:5697] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:09.805457  6885 raft_consensus.cc:3055] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:01:09.883538  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 71854.5us
I20260709 13:01:09.885203  1615 leader_election.cc:304] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:09.857245  6885 raft_consensus.cc:740] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:01:09.887521  7218 raft_consensus.cc:2749] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:09.888617  6885 consensus_queue.cc:260] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:09.889819  7399 raft_consensus.cc:493] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.890139  6885 raft_consensus.cc:3060] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:09.890465  7399 raft_consensus.cc:515] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:09.886837  1615 leader_election.cc:304] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
W20260709 13:01:09.897393  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 151025us
I20260709 13:01:09.806674  7115 consensus_queue.cc:1048] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 13:01:09.858884  1469 catalog_manager.cc:5697] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 10 to 14, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 14 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:09.902123  1689 leader_election.cc:400] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 election: Vote denied by peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423) with higher term. Message: Invalid argument: T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 11. Current term is 12.
I20260709 13:01:09.902487  1689 leader_election.cc:403] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 13:01:09.943778  2294 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:01:09.957695  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 71024.9us
I20260709 13:01:09.936972  7342 raft_consensus.cc:2749] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423) with higher term. Message: Invalid argument: T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 11. Current term is 12.
I20260709 13:01:09.944923  7156 raft_consensus.cc:2749] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:09.947543  7074 raft_consensus.cc:2749] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:09.959586  7146 raft_consensus.cc:493] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:09.960029  7261 raft_consensus.cc:493] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:09.942037  7133 consensus_queue.cc:1048] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 13:01:09.959681  7218 raft_consensus.cc:493] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
W20260709 13:01:09.988613  2294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:09.978425  1689 leader_election.cc:304] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 13:01:09.994752  1615 leader_election.cc:400] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 pre-election: Vote denied by peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423) with higher term. Message: Invalid argument: T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e for earlier term 16. Current term is 17.
I20260709 13:01:09.997859  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:09.973402  7146 raft_consensus.cc:515] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:09.981192  7140 raft_consensus.cc:515] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:10.006814  7146 leader_election.cc:290] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:10.010344  1649 raft_consensus.cc:1240] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:10.013024  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:01:10.010361  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 45997us
I20260709 13:01:10.014604  1615 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:10.022372  1689 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:09.969753  7324 raft_consensus.cc:493] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:10.023762  7133 raft_consensus.cc:2804] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:10.030879  1644 raft_consensus.cc:1240] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:09.969842  7399 leader_election.cc:290] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:10.032220  1642 raft_consensus.cc:1240] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:10.031008  1689 leader_election.cc:304] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 13:01:10.020867  6915 raft_consensus.cc:2804] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:10.038880  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:09.968567  7280 consensus_queue.cc:1048] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.060s
W20260709 13:01:10.044541  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.038195  7146 raft_consensus.cc:2804] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:10.046957  1567 raft_consensus.cc:1240] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:10.047976  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:10.054237  1615 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:10.059036  1572 raft_consensus.cc:3060] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:10.023598  7140 leader_election.cc:290] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:10.051118  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:09.985003  7218 raft_consensus.cc:515] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:09.980062  7261 raft_consensus.cc:515] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:10.062278  2331 raft_consensus.cc:2468] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 15.
I20260709 13:01:10.064792  1573 raft_consensus.cc:1275] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:01:10.032776  7396 log.cc:927] Time spent T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:01:10.073475  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:01:10.075361  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 44456.7us
I20260709 13:01:10.079229  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:10.096683  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:10.053064  6915 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.142553  1645 raft_consensus.cc:2410] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260709 13:01:10.141142  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 87277.9us
I20260709 13:01:10.148736  1646 raft_consensus.cc:1240] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:10.079746  7115 raft_consensus.cc:2749] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:10.152288  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 17 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:10.150382  7154 consensus_queue.cc:1059] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:01:10.154112  7408 raft_consensus.cc:2804] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:01:10.154435  7412 log.cc:927] Time spent T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 13:01:10.154664  7408 raft_consensus.cc:697] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 10 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:01:10.155961  7351 raft_consensus.cc:493] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.156479  7351 raft_consensus.cc:515] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:10.158538  7351 leader_election.cc:290] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:10.158897  7218 leader_election.cc:290] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:10.159837  7154 raft_consensus.cc:3055] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:10.160233  7154 raft_consensus.cc:740] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:01:10.160679  7261 leader_election.cc:290] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:10.161345  1689 leader_election.cc:304] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 13:01:10.155566  7408 consensus_queue.cc:237] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:10.163903  2295 leader_election.cc:304] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:10.161052  7154 consensus_queue.cc:260] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:10.165306  7154 raft_consensus.cc:3060] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:10.165343  7376 consensus_queue.cc:1048] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:10.169724  7342 raft_consensus.cc:2804] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:10.170445  7342 raft_consensus.cc:697] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 11 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:01:10.175940  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:10.177244  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:10.186751  1574 raft_consensus.cc:2410] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:01:10.141803  6915 raft_consensus.cc:3060] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:10.052495  7324 raft_consensus.cc:515] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:10.139706  7199 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.192255  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:10.206552  1573 raft_consensus.cc:3060] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:10.145182  7146 raft_consensus.cc:697] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 12 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:01:10.209503  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:01:10.209548  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:10.147336  7133 raft_consensus.cc:697] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 10 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:01:10.214470  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:10.216187  1572 raft_consensus.cc:2468] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 16.
I20260709 13:01:10.193557  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:10.224460  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:10.227913  2324 raft_consensus.cc:2468] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 11.
I20260709 13:01:10.171746  7342 consensus_queue.cc:237] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:10.230986  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:01:10.207172  1689 connection.cc:256] RPC call timeout handler was delayed by -1.1911289419999775s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21190000000000003s for a response
I20260709 13:01:10.229022  1568 raft_consensus.cc:2393] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 15: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
W20260709 13:01:10.232769  1689 connection.cc:256] RPC call timeout handler was delayed by -1.158728941999982s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2155s for a response
W20260709 13:01:10.233678  1689 connection.cc:256] RPC call timeout handler was delayed by -1.152552270000001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15990000000000001s for a response
I20260709 13:01:10.236169  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:10.186127  7403 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:10.238421  1571 raft_consensus.cc:1275] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:01:10.239048  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 161049us
I20260709 13:01:10.239722  2330 raft_consensus.cc:1275] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:01:10.243813  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:10.247609  1719 raft_consensus.cc:1240] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:10.191217  7413 consensus_queue.cc:1059] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 13:01:10.250357  1717 raft_consensus.cc:1275] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:01:10.222402  7156 consensus_queue.cc:1048] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 13:01:10.217911  7199 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:10.249991  7300 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:10.194360  7419 consensus_queue.cc:1059] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.068s
I20260709 13:01:10.274677  1573 raft_consensus.cc:2468] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 10.
I20260709 13:01:10.250452  7129 consensus_queue.cc:1048] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:01:10.278304  7163 raft_consensus.cc:493] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.241570  7403 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:01:10.324074  1542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.269109  7218 consensus_queue.cc:1048] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
W20260709 13:01:10.356104  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 106453us
W20260709 13:01:10.361093  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 120591us
W20260709 13:01:10.363020  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 67529.5us
W20260709 13:01:10.364665  1689 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.193:34373 timed out after 2.089s (SENT) [suppressed 5 similar messages]
I20260709 13:01:10.365392  1615 leader_election.cc:304] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:10.366416  7420 raft_consensus.cc:2804] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:10.367188  7420 raft_consensus.cc:697] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 15 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:10.368458  7420 consensus_queue.cc:237] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:10.373894  1615 leader_election.cc:304] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:10.375077  7220 raft_consensus.cc:2804] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:10.375720  7220 raft_consensus.cc:697] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 16 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:10.376941  7220 consensus_queue.cc:237] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:10.382341  1615 leader_election.cc:304] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:10.351889  7154 raft_consensus.cc:493] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.388408  7419 consensus_queue.cc:1048] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:01:10.309069  7300 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:10.402676  7424 raft_consensus.cc:2804] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:10.403760  7324 leader_election.cc:290] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:10.337581  7163 raft_consensus.cc:515] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:10.406353  7163 leader_election.cc:290] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:10.418252  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:10.415359  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:01:10.401242  7402 log.cc:927] Time spent T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.427s	user 0.005s	sys 0.000s
W20260709 13:01:10.411005  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 56552.9us
I20260709 13:01:10.398325  7074 raft_consensus.cc:493] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:01:10.426458  1574 raft_consensus.cc:2468] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 9.
I20260709 13:01:10.435003  2295 leader_election.cc:304] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:10.436812  7074 raft_consensus.cc:515] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:10.439306  7074 leader_election.cc:290] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:10.396385  7154 raft_consensus.cc:515] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:01:10.440299  7398 log.cc:927] Time spent T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.466s	user 0.000s	sys 0.004s
I20260709 13:01:10.335723  7133 consensus_queue.cc:237] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:10.355510  7146 consensus_queue.cc:237] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:10.411602  7424 raft_consensus.cc:697] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 14 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:10.451156  1569 raft_consensus.cc:3055] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:10.451920  1642 raft_consensus.cc:2468] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 15.
I20260709 13:01:10.392190  7419 consensus_queue.cc:1059] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.049s
I20260709 13:01:10.452244  1569 raft_consensus.cc:740] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:01:10.465821  7429 raft_consensus.cc:2804] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:10.466444  7429 raft_consensus.cc:493] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:10.466858  7429 raft_consensus.cc:3060] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:10.467849  7154 leader_election.cc:290] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:10.463630  7300 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:10.468680  7427 consensus_queue.cc:1048] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 13:01:10.469269  7403 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:01:10.475695  7329 consensus_meta.cc:287] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.743s	user 0.005s	sys 0.005s
I20260709 13:01:10.481666  7428 consensus_queue.cc:1059] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 13:01:10.493386  2326 raft_consensus.cc:2468] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 11.
I20260709 13:01:10.463807  1569 consensus_queue.cc:260] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 13:01:10.451745  6977 raft_consensus.cc:493] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:10.510118  1569 raft_consensus.cc:3060] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:10.546782  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 328240us
I20260709 13:01:10.550551  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:10.507632  7429 raft_consensus.cc:515] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:10.553067  7342 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.553690  7342 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:10.555922  7429 leader_election.cc:290] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:10.562198  1722 raft_consensus.cc:1240] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:10.564294  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:10.546516  6977 raft_consensus.cc:515] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:10.573022  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:01:10.573707  7422 log.cc:927] Time spent T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 13:01:10.574200  1717 raft_consensus.cc:2393] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 10: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 13:01:10.574456  7424 consensus_queue.cc:237] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:10.576916  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:10.505450  7376 raft_consensus.cc:2749] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:10.583431  1569 raft_consensus.cc:1275] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 13:01:10.584285  1569 pending_rounds.cc:85] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting all ops after (but not including) 7
I20260709 13:01:10.583884  2329 raft_consensus.cc:1275] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:01:10.584545  1569 pending_rounds.cc:107] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:01:10.584807  1569 raft_consensus.cc:2889] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:10.579607  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 197359us
I20260709 13:01:10.587808  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:10.588517  1717 raft_consensus.cc:2393] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 12: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 13:01:10.589313  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:10.590334  1617 leader_election.cc:304] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:10.591172  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:10.591248  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:10.591172  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:10.592882  1720 raft_consensus.cc:2393] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 10: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:01:10.593544  2327 raft_consensus.cc:2393] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 12: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 13:01:10.594125  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:10.587693  1615 leader_election.cc:304] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 13:01:10.573050  7421 log.cc:927] Time spent T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 13:01:10.597115  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:01:10.599524  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 164602us
I20260709 13:01:10.602329  1569 raft_consensus.cc:1275] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 20 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:01:10.603773  7436 consensus_queue.cc:1048] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:01:10.580976  7199 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:10.610092  6977 leader_election.cc:290] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:10.593410  7391 consensus_queue.cc:1048] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 13:01:10.617321  7261 raft_consensus.cc:3055] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:10.617159  6915 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:10.617781  7261 raft_consensus.cc:740] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:01:10.618703  7261 consensus_queue.cc:260] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:10.619414  6915 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:10.619731  7261 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:10.620337  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:01:10.595623  7269 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:01:10.624790  7324 raft_consensus.cc:3055] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:10.625222  7324 raft_consensus.cc:740] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:10.625396  1617 leader_election.cc:304] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:10.626078  7324 consensus_queue.cc:260] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:10.627306  7324 raft_consensus.cc:3060] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:10.627584  7115 raft_consensus.cc:3055] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:10.627825  7140 raft_consensus.cc:2804] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:10.628001  7115 raft_consensus.cc:740] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:10.628608  7140 raft_consensus.cc:697] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 15 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:10.629036  7115 consensus_queue.cc:260] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:10.629601  7140 consensus_queue.cc:237] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:10.630468  7115 raft_consensus.cc:3060] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:10.632887  7436 raft_consensus.cc:2804] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:10.633440  7436 raft_consensus.cc:697] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 15 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:10.634338  7436 consensus_queue.cc:237] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:10.625041  7406 consensus_queue.cc:1059] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:10.637605  7406 raft_consensus.cc:3055] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:10.637965  7406 raft_consensus.cc:740] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:01:10.638777  7406 consensus_queue.cc:260] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:10.639869  7406 raft_consensus.cc:3060] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:10.627627  1617 leader_election.cc:304] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 13:01:10.644698  6915 raft_consensus.cc:2804] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:10.645246  6915 raft_consensus.cc:697] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 11 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:10.646102  6915 consensus_queue.cc:237] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:10.652638  2331 raft_consensus.cc:3055] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:10.653154  2331 raft_consensus.cc:740] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:01:10.654052  2331 consensus_queue.cc:260] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:10.662267  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:01:10.664168  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.664172  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:10.665835  7269 consensus_queue.cc:1048] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 13:01:10.670755  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 83137us
I20260709 13:01:10.671880  7342 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:10.671761  1539 leader_election.cc:304] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:10.673368  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:10.673627  1539 leader_election.cc:304] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:10.673769  7435 raft_consensus.cc:2804] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:10.674425  7435 raft_consensus.cc:697] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 16 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:10.674573  7405 raft_consensus.cc:2749] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:10.674721  7269 consensus_queue.cc:1059] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:10.675279  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:10.675631  7269 raft_consensus.cc:2749] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:10.675359  7435 consensus_queue.cc:237] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:10.676301  7269 raft_consensus.cc:3055] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:10.676667  7269 raft_consensus.cc:740] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:01:10.677379  7269 consensus_queue.cc:260] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:10.678404  7269 raft_consensus.cc:3060] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:10.679214  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:10.681157  1539 leader_election.cc:304] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:10.655264  2331 raft_consensus.cc:3060] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:10.682090  7199 raft_consensus.cc:2804] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:10.682389  2297 leader_election.cc:304] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:10.682572  7199 raft_consensus.cc:697] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:01:10.683548  7199 consensus_queue.cc:237] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:10.684329  7443 raft_consensus.cc:2749] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:10.688553  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:10.689307  1725 raft_consensus.cc:2393] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 15: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:01:10.689540  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:10.692420  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:10.692986  1717 raft_consensus.cc:1240] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 13:01:10.694238  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:10.722730  1721 raft_consensus.cc:1275] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:10.728169  2329 raft_consensus.cc:1275] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 18 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:01:10.724246  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:10.730057  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:10.730057  1569 raft_consensus.cc:3060] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Advancing to term 13
I20260709 13:01:10.734314  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:10.735170  1571 raft_consensus.cc:3060] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:01:10.737447  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:01:10.738554  2329 raft_consensus.cc:3060] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:10.739821  1570 raft_consensus.cc:1275] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:01:10.744102  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:10.744303  1720 raft_consensus.cc:1240] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
W20260709 13:01:10.735406  1615 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.745792  1615 leader_election.cc:304] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:10.748310  1716 raft_consensus.cc:2393] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 15: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:01:10.749205  7376 consensus_queue.cc:1048] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:10.758339  1615 leader_election.cc:304] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:10.759867  2331 raft_consensus.cc:2468] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 10.
I20260709 13:01:10.757058  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:10.784441  1569 raft_consensus.cc:2468] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 13.
I20260709 13:01:10.789436  1645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:10.755512  6915 raft_consensus.cc:2804] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:01:10.785079  7428 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 13:01:10.794397  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:10.802438  1645 raft_consensus.cc:1240] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 15 LEADER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:10.790968  7140 raft_consensus.cc:2804] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:01:10.811652  1542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.814421  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:10.816190  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:10.802886  7074 consensus_queue.cc:1048] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:01:10.802335  7443 consensus_queue.cc:1048] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.027s
I20260709 13:01:10.825913  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:10.826505  1716 raft_consensus.cc:3060] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:10.828575  1571 raft_consensus.cc:2468] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 11.
I20260709 13:01:10.827394  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:10.833209  1717 raft_consensus.cc:2468] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 15.
W20260709 13:01:10.834959  1542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.836469  2329 raft_consensus.cc:2468] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 13.
I20260709 13:01:10.840480  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:10.841476  1646 raft_consensus.cc:2368] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 12. Current term is 13.
I20260709 13:01:10.842964  1716 raft_consensus.cc:2468] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 15.
I20260709 13:01:10.794747  6915 raft_consensus.cc:493] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:01:10.849606  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:10.850929  1650 raft_consensus.cc:1240] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:10.852155  1651 raft_consensus.cc:1275] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 20 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:01:10.854941  1722 raft_consensus.cc:1240] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:10.857170  1649 raft_consensus.cc:1275] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:01:10.859670  2294 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:10.861498  7204 raft_consensus.cc:2749] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:10.862455  7204 consensus_queue.cc:1048] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 13:01:10.866071  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.873358  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:10.874235  1725 raft_consensus.cc:2468] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 15.
I20260709 13:01:10.875840  1718 raft_consensus.cc:1240] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:10.797859  7115 consensus_queue.cc:1048] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.055s
I20260709 13:01:10.858031  6915 raft_consensus.cc:3060] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:10.852074  7140 raft_consensus.cc:697] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 11 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:10.895637  2295 leader_election.cc:304] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:10.891867  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:01:10.901041  1540 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.902590  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:10.903223  1718 raft_consensus.cc:2468] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 16.
I20260709 13:01:10.878371  7269 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:10.909415  7300 raft_consensus.cc:2804] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:10.909765  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:10.911075  1615 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 13:01:10.910207  7459 log.cc:927] Time spent T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 13:01:10.889629  7324 consensus_queue.cc:1048] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:01:10.930941  1539 leader_election.cc:400] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391) with higher term. Message: Invalid argument: T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 12. Current term is 13.
I20260709 13:01:10.931417  1539 leader_election.cc:403] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:10.937543  7403 consensus_queue.cc:1048] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:01:10.916666  7269 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:10.940449  7269 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:10.925442  7300 raft_consensus.cc:697] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:01:10.941741  7300 consensus_queue.cc:237] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:10.944039  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:01:10.945204  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.951095  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:10.954258  1539 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:10.950776  7267 raft_consensus.cc:493] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:10.955802  7267 raft_consensus.cc:515] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:10.957926  7267 leader_election.cc:290] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:10.959982  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:10.934803  7129 raft_consensus.cc:2804] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:10.934357  7146 raft_consensus.cc:493] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:10.945206  7154 raft_consensus.cc:2749] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391) with higher term. Message: Invalid argument: T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 12. Current term is 13.
I20260709 13:01:10.936750  7405 consensus_queue.cc:1059] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 13:01:10.967245  7129 raft_consensus.cc:697] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 13 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:10.961238  7133 consensus_queue.cc:1048] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
W20260709 13:01:10.998317  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 52674us
W20260709 13:01:11.018682  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 122466us
I20260709 13:01:10.969256  7146 raft_consensus.cc:515] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:11.027047  7199 raft_consensus.cc:2749] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 13:01:11.029927  1542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:10.992432  7405 consensus_queue.cc:1243] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer 4dbe7d47a2374afca075d3a98583b49e log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:01:10.971872  7140 consensus_queue.cc:237] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:11.048774  7129 consensus_queue.cc:237] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:01:11.079907  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:11.077143  7454 log.cc:927] Time spent T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260709 13:01:11.102413  6915 raft_consensus.cc:515] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:11.103672  1647 raft_consensus.cc:1240] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 15. Current term is 16. Ops: []
W20260709 13:01:11.111516  7456 log.cc:927] Time spent T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.294s	user 0.000s	sys 0.003s
W20260709 13:01:11.117110  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 61205.1us
I20260709 13:01:11.082176  7269 raft_consensus.cc:493] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:11.119232  7154 raft_consensus.cc:493] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.130632  7154 raft_consensus.cc:515] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:11.133215  7154 leader_election.cc:290] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:11.116798  7028 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.135200  7028 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:11.138423  7028 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:11.143502  7146 leader_election.cc:290] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:11.128011  7269 raft_consensus.cc:515] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:11.148456  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:11.149312  7269 leader_election.cc:290] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:11.152503  1689 leader_election.cc:400] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373) with higher term. Message: Invalid argument: T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 9. Current term is 10.
I20260709 13:01:11.153745  1689 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:11.157321  7408 raft_consensus.cc:2749] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 12 LEADER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:11.157541  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:11.158311  2329 raft_consensus.cc:2393] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 11: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:01:11.163115  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:11.164589  6915 leader_election.cc:290] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:11.165710  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:11.166556  1570 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 12.
I20260709 13:01:11.149356  2326 raft_consensus.cc:2468] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 10.
I20260709 13:01:11.173130  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:11.176097  1642 raft_consensus.cc:1275] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:01:11.182101  7261 raft_consensus.cc:3055] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:11.182646  7261 raft_consensus.cc:740] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:01:11.183609  7261 consensus_queue.cc:260] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:11.191685  1540 leader_election.cc:304] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:11.193029  7405 raft_consensus.cc:2804] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:11.193710  7405 raft_consensus.cc:493] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:11.194139  7405 raft_consensus.cc:3060] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:11.202975  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:11.203718  1642 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 12.
I20260709 13:01:11.209385  7300 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.209964  7300 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:11.213066  7300 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:11.230120  1648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:01:11.232792  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 69427.6us
I20260709 13:01:11.241576  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:01:11.259419  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 70369.1us
I20260709 13:01:11.263229  1572 raft_consensus.cc:1275] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 13:01:11.275241  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:11.289029  1542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.291383  1576 raft_consensus.cc:1275] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:01:11.291620  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 96267.4us
I20260709 13:01:11.292387  1575 raft_consensus.cc:1275] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:01:11.302337  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 68547.8us
W20260709 13:01:11.323457  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 89170.3us
W20260709 13:01:11.326435  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 68157.3us
I20260709 13:01:11.327724  1539 leader_election.cc:304] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
W20260709 13:01:11.334745  1542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.299016  7261 raft_consensus.cc:3060] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:11.333038  2295 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:11.341451  1570 raft_consensus.cc:1275] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 13:01:11.343276  1570 pending_rounds.cc:85] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting all ops after (but not including) 8
I20260709 13:01:11.343545  1570 pending_rounds.cc:107] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 13:01:11.343816  1570 raft_consensus.cc:2889] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:11.343992  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:01:11.344682  2327 raft_consensus.cc:3060] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:11.255950  7146 consensus_queue.cc:1048] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 13:01:11.341259  1689 leader_election.cc:304] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:11.355641  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:11.353547  7403 raft_consensus.cc:3060] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:11.471710  1542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.332238  7408 consensus_queue.cc:1048] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 13:01:11.342090  7342 consensus_queue.cc:1059] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 13:01:11.460314  7028 raft_consensus.cc:2804] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 13:01:11.466100  7464 log.cc:927] Time spent T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
W20260709 13:01:11.490731  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 149551us
I20260709 13:01:11.463847  7280 raft_consensus.cc:2749] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:11.493211  2327 raft_consensus.cc:2468] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 16.
W20260709 13:01:11.477900  7402 log.cc:927] Time spent T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
W20260709 13:01:11.500602  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:11.507259  7478 log.cc:927] Time spent T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
I20260709 13:01:11.494828  7028 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:11.517287  7028 raft_consensus.cc:3060] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:11.521133  7342 raft_consensus.cc:493] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.521654  7342 raft_consensus.cc:515] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:11.498739  6977 raft_consensus.cc:3055] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:11.522847  6977 raft_consensus.cc:740] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:01:11.523653  7342 leader_election.cc:290] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:11.523761  6977 consensus_queue.cc:260] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:11.524760  1568 raft_consensus.cc:1275] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:01:11.525095  6977 raft_consensus.cc:3060] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:11.527632  7403 raft_consensus.cc:2749] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:11.530718  1689 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:11.532802  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:01:11.539314  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.551926   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:11.575502  1647 raft_consensus.cc:1275] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 13:01:11.578282  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 49290.5us
I20260709 13:01:11.578270  1567 raft_consensus.cc:1275] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:01:11.519008  7405 raft_consensus.cc:515] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:01:11.584290  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 273440us
I20260709 13:01:11.595271  7475 consensus_queue.cc:1048] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:01:11.613207  7483 log.cc:927] Time spent T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260709 13:01:11.578369  7420 consensus_queue.cc:1048] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:01:11.578251  7146 raft_consensus.cc:2749] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:11.575953  7324 consensus_queue.cc:1048] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 13:01:11.557231  7199 raft_consensus.cc:493] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.624992  1689 leader_election.cc:304] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:11.629089  7432 raft_consensus.cc:493] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.629658  7432 raft_consensus.cc:515] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:01:11.631531  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 168699us
I20260709 13:01:11.557651  7129 consensus_queue.cc:1048] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
W20260709 13:01:11.632678  7477 log.cc:927] Time spent T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:01:11.578130  7220 consensus_queue.cc:1048] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260709 13:01:11.628432  7060 raft_consensus.cc:493] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:11.662736  1615 leader_election.cc:304] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:11.668355  7391 raft_consensus.cc:2804] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:11.638211  7199 raft_consensus.cc:515] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:11.668965  7391 raft_consensus.cc:697] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 16 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:11.669891  7391 consensus_queue.cc:237] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:11.670807  7199 leader_election.cc:290] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:11.659457  7485 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.627717  7269 consensus_queue.cc:1048] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 13:01:11.645406  7329 raft_consensus.cc:493] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:11.676606  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 51704.9us
I20260709 13:01:11.651062  7146 raft_consensus.cc:2749] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:11.681176  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:11.681095  2295 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:11.671726  7485 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:11.650972  7435 consensus_queue.cc:1048] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:01:11.675045  7060 raft_consensus.cc:515] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:11.704181  1573 raft_consensus.cc:1275] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:01:11.707790  1689 leader_election.cc:304] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:01:11.719516  1542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.715817  7140 consensus_queue.cc:1048] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
I20260709 13:01:11.683032  7329 raft_consensus.cc:515] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:01:11.784425  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 65051.1us
W20260709 13:01:11.786980  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 55718us
W20260709 13:01:11.783869  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 64565.3us
I20260709 13:01:11.727169  6703 raft_consensus.cc:2749] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:11.726359  7146 raft_consensus.cc:2749] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:11.798101  7060 leader_election.cc:290] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:11.799959  7485 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:01:11.796314  7494 log.cc:927] Time spent T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:01:11.802068  2331 raft_consensus.cc:1275] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:01:11.803908  2331 pending_rounds.cc:85] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66: Aborting all ops after (but not including) 9
I20260709 13:01:11.804147  2331 pending_rounds.cc:107] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:01:11.804363  2331 raft_consensus.cc:2889] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:01:11.813926  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:11.814872  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 107192us
I20260709 13:01:11.819203  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:11.819885  1647 raft_consensus.cc:2468] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 15.
I20260709 13:01:11.820036  1689 leader_election.cc:304] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:11.827329  7432 leader_election.cc:290] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:11.864791  7432 raft_consensus.cc:2749] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:11.874617  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 54647.8us
W20260709 13:01:11.877492  1542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.819481  7115 raft_consensus.cc:493] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:11.879786  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 91370.5us
I20260709 13:01:11.882990  1689 leader_election.cc:304] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:11.893515  1539 leader_election.cc:304] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:11.895044  1571 raft_consensus.cc:1275] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:01:11.903029  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:11.881832  7115 raft_consensus.cc:515] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:11.901253  7261 raft_consensus.cc:2804] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:11.929610  7261 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:11.929998  7261 raft_consensus.cc:3060] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:11.930986  7115 leader_election.cc:290] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:11.918234  7329 leader_election.cc:290] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:11.897755  7432 raft_consensus.cc:2749] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:11.925534  7405 leader_election.cc:290] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:11.927450  7028 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:11.932861  1689 leader_election.cc:304] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:11.959772  1689 leader_election.cc:304] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:11.938755  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:01:11.960835  2329 raft_consensus.cc:3060] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:11.951979  7436 raft_consensus.cc:493] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:11.905331  2331 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb"
dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
mode: GRACEFUL
new_leader_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:39778
I20260709 13:01:11.965046  2331 raft_consensus.cc:606] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 LEADER]: Received request to transfer leadership to TS 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:11.964861  7436 raft_consensus.cc:515] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:11.947074  7435 consensus_queue.cc:1048] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 13:01:11.967223  7436 leader_election.cc:290] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:11.968420  2327 raft_consensus.cc:1275] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 13:01:11.959985  7508 log.cc:927] Time spent T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:01:11.969283  7163 raft_consensus.cc:493] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:01:11.969839  7163 raft_consensus.cc:515] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:11.970759  2325 raft_consensus.cc:1275] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 13:01:11.971549  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:11.972044  7163 leader_election.cc:290] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:11.972132  2327 raft_consensus.cc:2468] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 14.
I20260709 13:01:11.973415  7432 raft_consensus.cc:2749] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:11.973742  7146 raft_consensus.cc:2749] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:11.973471  1689 leader_election.cc:304] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:11.987429  1689 leader_election.cc:304] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:11.988353  2329 raft_consensus.cc:2468] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 11.
I20260709 13:01:11.990005  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:11.985498  1615 leader_election.cc:304] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:12.000190  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:12.005383  1572 raft_consensus.cc:2468] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 15.
I20260709 13:01:11.945761  7115 consensus_queue.cc:1048] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 13:01:11.990247  7495 raft_consensus.cc:2749] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:12.005353  1540 leader_election.cc:304] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:12.006029  1571 raft_consensus.cc:2468] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 15.
I20260709 13:01:12.017764  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:12.021463  1615 leader_election.cc:304] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:12.022384  1576 raft_consensus.cc:2393] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 15: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:01:11.990411  7419 consensus_queue.cc:1048] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 13:01:12.026820  7028 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:12.030148  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:01:12.030604  7509 log.cc:927] Time spent T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:01:12.031037  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:12.031358  7507 consensus_queue.cc:1048] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 13:01:12.023128  7199 raft_consensus.cc:2804] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:12.037501  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:01:12.039345  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.018348  7324 raft_consensus.cc:2804] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 13:01:12.057842  1542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:12.100874  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 58601.3us
I20260709 13:01:12.103233  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:12.107443  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:12.045802  7436 raft_consensus.cc:2804] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:12.007431  7146 raft_consensus.cc:2749] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:12.096235  7324 raft_consensus.cc:493] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.134934  7408 raft_consensus.cc:493] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.136336  7436 raft_consensus.cc:493] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.150573  7324 raft_consensus.cc:3060] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:12.173211  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 185880us
I20260709 13:01:12.174292  1689 leader_election.cc:304] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:12.164631  7432 raft_consensus.cc:493] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.165289  7436 raft_consensus.cc:3060] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:12.165999  7146 raft_consensus.cc:493] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.176309  1689 leader_election.cc:304] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:12.202194  1689 leader_election.cc:304] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:12.165555  7408 raft_consensus.cc:515] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:12.180234  7437 raft_consensus.cc:2749] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:01:12.222681  7506 log.cc:927] Time spent T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:01:12.250845  2331 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "477960faa15b4001a5a6361558d69294"
dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
mode: GRACEFUL
new_leader_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:39778
I20260709 13:01:12.251683  2331 raft_consensus.cc:606] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Received request to transfer leadership to TS 0c7751452c4b46afa95251b9df7169d4
W20260709 13:01:12.251792  7514 log.cc:927] Time spent T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:01:12.203405  7146 raft_consensus.cc:515] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 13:01:12.266649  7146 leader_election.cc:290] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373)
I20260709 13:01:12.267266  7146 raft_consensus.cc:2804] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:12.267737  7146 raft_consensus.cc:697] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 10 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:01:12.271075  2331 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c"
dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
mode: GRACEFUL
new_leader_uuid: "4dbe7d47a2374afca075d3a98583b49e"
 from {username='slave'} at 127.0.0.1:39778
I20260709 13:01:12.271783  2331 raft_consensus.cc:606] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 FOLLOWER]: Received request to transfer leadership to TS 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:12.272143  2331 raft_consensus.cc:614] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:12.205232  7432 raft_consensus.cc:515] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:12.282333  7432 leader_election.cc:290] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:12.283499  7261 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:01:12.285742  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.287343  7408 leader_election.cc:290] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:12.215447  7495 consensus_queue.cc:1048] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.075s
W20260709 13:01:12.289289  7510 log.cc:927] Time spent T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.384s	user 0.002s	sys 0.000s
I20260709 13:01:12.225937  6977 raft_consensus.cc:2749] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:12.291705  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:12.292408  1567 raft_consensus.cc:3060] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:12.292883  7519 log.cc:927] Time spent T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:01:12.302198  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:12.304186  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:12.304822  1724 raft_consensus.cc:2468] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 11.
W20260709 13:01:12.311198  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.313161  1568 raft_consensus.cc:1275] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:12.323962  1567 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 13.
W20260709 13:01:12.338579  1542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.346614  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:12.300818  7408 raft_consensus.cc:493] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.412472  7496 raft_consensus.cc:493] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.413084  7496 raft_consensus.cc:515] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:01:12.415660  1542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.415915  2331 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c998894dcb744ba3825db19244f8207e"
dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
mode: GRACEFUL
new_leader_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:39778
I20260709 13:01:12.416566  2331 raft_consensus.cc:606] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Received request to transfer leadership to TS 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:12.415242  7496 leader_election.cc:290] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:12.421645  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:12.423338  1567 raft_consensus.cc:2468] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 11.
I20260709 13:01:12.424793  2295 leader_election.cc:304] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 13:01:12.423962  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 221845us
I20260709 13:01:12.353379  7261 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 16 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:12.437863  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:12.418167  6703 raft_consensus.cc:493] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.432709  7199 raft_consensus.cc:697] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
W20260709 13:01:12.439580  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 229799us
I20260709 13:01:12.347668  7329 consensus_queue.cc:1048] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.090s
I20260709 13:01:12.429339  7154 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:12.454010  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:12.454631  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:12.458922  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:12.435596  7028 raft_consensus.cc:2804] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:01:12.498291  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:12.508685  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 77189.2us
I20260709 13:01:12.327250  7146 consensus_queue.cc:237] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:12.420110  7408 raft_consensus.cc:515] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:12.516142  1575 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c"
dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
mode: GRACEFUL
new_leader_uuid: "4dbe7d47a2374afca075d3a98583b49e"
 from {username='slave'} at 127.0.0.1:49396
I20260709 13:01:12.517081  1575 raft_consensus.cc:606] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Received request to transfer leadership to TS 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:12.517654  1575 raft_consensus.cc:614] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:12.513098  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:12.520987  1721 raft_consensus.cc:3060] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:12.530166  2326 raft_consensus.cc:1275] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
W20260709 13:01:12.531072  1542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.504976  7028 raft_consensus.cc:493] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:12.540030  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 113170us
I20260709 13:01:12.451378  6703 raft_consensus.cc:515] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:12.547240  2297 leader_election.cc:304] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:12.552134  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:12.552919  1724 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:12.508513  7154 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:12.539779  7028 raft_consensus.cc:3060] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:12.561295  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:12.461966  7199 consensus_queue.cc:237] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:12.561868  1646 raft_consensus.cc:3060] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:12.563170  2297 leader_election.cc:304] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:12.558122  7163 raft_consensus.cc:2749] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:12.557914  7435 raft_consensus.cc:493] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:01:12.593197  7435 raft_consensus.cc:515] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:12.595659  7435 leader_election.cc:290] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:01:12.599797  1542 leader_election.cc:336] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.573s (SENT)
I20260709 13:01:12.574635  1721 raft_consensus.cc:2468] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 15.
I20260709 13:01:12.581669  7154 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:12.584895  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:12.585688  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:12.603302  1716 raft_consensus.cc:2468] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 14.
I20260709 13:01:12.587141  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:12.587307  7324 raft_consensus.cc:515] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:12.602809  1718 raft_consensus.cc:2468] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 16.
I20260709 13:01:12.605643  1724 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 17.
I20260709 13:01:12.599462  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:12.617499  1723 raft_consensus.cc:2393] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 12: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:01:12.619082  1716 raft_consensus.cc:1275] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
W20260709 13:01:12.625397  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 62315.2us
I20260709 13:01:12.626683  2297 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
W20260709 13:01:12.605247  7525 log.cc:927] Time spent T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 13:01:12.648021  1647 raft_consensus.cc:2368] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 15. Current term is 16.
I20260709 13:01:12.650400  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:12.653285  1716 raft_consensus.cc:1275] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:01:12.648825  7324 leader_election.cc:290] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:12.658744  1721 raft_consensus.cc:1275] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 13:01:12.661854  1542 leader_election.cc:336] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.582s (SENT)
I20260709 13:01:12.645376  7074 raft_consensus.cc:2804] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:12.650187  7496 raft_consensus.cc:2749] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:01:12.676455  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 49862.5us
W20260709 13:01:12.681419  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.702695  1721 raft_consensus.cc:1275] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:01:12.702790  1716 raft_consensus.cc:1275] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:01:12.721088  1724 raft_consensus.cc:1275] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 13:01:12.722172  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:12.723311  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:12.724102  1724 raft_consensus.cc:2393] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 12: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:01:12.730490  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:12.730718  2329 raft_consensus.cc:1240] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 15. Current term is 16. Ops: [13.11-15.12]
I20260709 13:01:12.731357  1569 raft_consensus.cc:2368] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 15. Current term is 16.
I20260709 13:01:12.734022  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:12.734691  1724 raft_consensus.cc:2468] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 15.
I20260709 13:01:12.737165  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:01:12.741026  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 110790us
I20260709 13:01:12.746559  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:12.747277  1724 raft_consensus.cc:2468] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 14.
I20260709 13:01:12.750149  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:12.754190  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:12.758561  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:12.759292  1724 raft_consensus.cc:2376] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 17. Re-sending same reply.
I20260709 13:01:12.781587  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 13:01:12.799701  1542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:12.805073  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:12.805819  1724 raft_consensus.cc:2376] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 15. Re-sending same reply.
I20260709 13:01:12.806965  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:12.757656  2329 raft_consensus.cc:1240] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:12.746707  6703 leader_election.cc:290] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:12.745337  7429 raft_consensus.cc:493] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:12.815029  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:12.836752  1649 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 17.
W20260709 13:01:12.832084  1689 connection.cc:256] RPC call timeout handler was delayed by -1.1511952029999861s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15660000000000002s for a response
I20260709 13:01:12.834904  2329 raft_consensus.cc:1240] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 LEADER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 10. Current term is 11. Ops: []
W20260709 13:01:12.838639  1689 connection.cc:256] RPC call timeout handler was delayed by -1.1025952029999644s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16200000000000003s for a response
I20260709 13:01:12.839396  1689 leader_election.cc:304] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:12.839011  1539 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:12.844141  1689 leader_election.cc:304] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:12.845630  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:12.846282  1575 raft_consensus.cc:3060] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:12.847412  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:12.848167  1567 raft_consensus.cc:2468] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 15.
W20260709 13:01:12.837703  7436 consensus_meta.cc:287] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.624s	user 0.011s	sys 0.000s
I20260709 13:01:12.813408  7408 leader_election.cc:290] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:12.859592  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:12.860991  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:01:12.861753  2324 raft_consensus.cc:3060] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Advancing to term 16
I20260709 13:01:12.876313  1646 raft_consensus.cc:2468] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 16.
I20260709 13:01:12.857512  7269 raft_consensus.cc:2804] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 13:01:12.880592  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 226878us
W20260709 13:01:12.889194  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 173657us
I20260709 13:01:12.844651  7429 raft_consensus.cc:515] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:12.923674  2324 raft_consensus.cc:2468] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 16.
I20260709 13:01:12.880344  7403 raft_consensus.cc:493] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:12.857343  7436 raft_consensus.cc:515] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:12.893848  7269 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:12.888659  6915 consensus_queue.cc:1048] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 13:01:12.956167  7028 raft_consensus.cc:515] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:12.958438  2327 raft_consensus.cc:1240] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:12.959338  7028 leader_election.cc:290] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:01:12.958449  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 61111.8us
I20260709 13:01:12.960790  7391 consensus_queue.cc:1048] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:12.963133  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:12.944363  7269 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:12.975739  1718 raft_consensus.cc:2468] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 16.
I20260709 13:01:12.976830  1724 raft_consensus.cc:1275] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:01:12.976938  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:12.978153  1718 raft_consensus.cc:2393] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 15: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:01:12.979151  7495 raft_consensus.cc:493] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:12.978952  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:12.979736  7495 raft_consensus.cc:515] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:01:12.981196  7526 log.cc:927] Time spent T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
I20260709 13:01:12.982312  7531 consensus_queue.cc:1048] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.118s
I20260709 13:01:12.986904  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:12.996055  1718 raft_consensus.cc:2393] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 12: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 13:01:13.005203  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:13.005203  1720 raft_consensus.cc:2468] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 16.
I20260709 13:01:13.007496  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:12.942272  7403 raft_consensus.cc:515] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:13.020892  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:13.021061  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:13.022038  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:13.022634  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:12.972774  7524 raft_consensus.cc:2749] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:13.023917  1723 raft_consensus.cc:1275] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 13:01:13.026468  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:13.028095  1725 raft_consensus.cc:2393] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 15: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:01:12.953648  7424 consensus_queue.cc:1048] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:01:13.031276  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86d7fe1cfa574972b0302d36ac77568b" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:13.029045  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:13.035909  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85dedac1c89a4e76846055d543df7f16" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:13.037395  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:13.039155  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:13.040403  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:13.041366  1720 raft_consensus.cc:2376] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 15. Re-sending same reply.
I20260709 13:01:13.043202  7481 consensus_queue.cc:1048] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.077s
I20260709 13:01:13.045604  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:12.986789  7541 consensus_queue.cc:1048] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.070s
I20260709 13:01:13.048183  1720 raft_consensus.cc:2468] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 14.
I20260709 13:01:13.050019  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:01:13.044414  7518 log.cc:927] Time spent T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.856s	user 0.006s	sys 0.008s
I20260709 13:01:13.057327  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:13.061108  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:13.062747  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:12.986950  7544 consensus_queue.cc:1048] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.086s
I20260709 13:01:13.044754  7495 leader_election.cc:290] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:01:13.111773  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 107227us
W20260709 13:01:13.116567  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:13.121896  7543 log.cc:927] Time spent T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:01:13.125833  1722 raft_consensus.cc:1275] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:01:13.125736  2324 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b"
dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
mode: GRACEFUL
new_leader_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:39778
I20260709 13:01:13.126602  2324 raft_consensus.cc:606] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Received request to transfer leadership to TS 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:13.126981  2324 raft_consensus.cc:614] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:13.137959  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecb8dc1ca7644ad598779a7fe5419ad5" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:13.140516  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:13.125469  1725 raft_consensus.cc:2468] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 15.
W20260709 13:01:13.129627  7518 log.cc:927] Time spent T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:01:13.263677  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:13.266117  1575 raft_consensus.cc:2468] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 16.
I20260709 13:01:13.264310  1720 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 17.
I20260709 13:01:13.275113  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:13.274317   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260709 13:01:13.276645  7540 log.cc:927] Time spent T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
I20260709 13:01:13.277135  7547 raft_consensus.cc:493] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:13.277657  7547 raft_consensus.cc:515] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:13.279693  7547 leader_election.cc:290] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:13.280419  7522 raft_consensus.cc:493] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:13.275538  1617 leader_election.cc:304] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:13.280966  7522 raft_consensus.cc:515] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:13.281987  7475 raft_consensus.cc:3060] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:13.282611  1617 leader_election.cc:304] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:13.282972  7522 leader_election.cc:290] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:13.279696  7403 leader_election.cc:290] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:13.260679  7429 leader_election.cc:290] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:13.258973  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:13.246616  7146 raft_consensus.cc:476] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 12 LEADER]: Not starting pre-election -- already a leader
I20260709 13:01:13.290781  1617 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:13.290663  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:13.292332  1643 raft_consensus.cc:2468] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 13.
W20260709 13:01:13.292901  1689 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.298969  1688 leader_election.cc:304] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:13.301829  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:13.302644  1725 raft_consensus.cc:3060] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:13.306869  1617 leader_election.cc:304] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:13.262751  7436 leader_election.cc:290] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:13.310282  1689 leader_election.cc:400] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373) with higher term. Message: Invalid argument: T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 15. Current term is 16.
I20260709 13:01:13.310686  1689 leader_election.cc:403] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:01:13.315250  7552 log.cc:927] Time spent T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.195s	user 0.000s	sys 0.000s
I20260709 13:01:13.315836  1647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57912 (request call id 1214) took 1288 ms. Trace:
I20260709 13:01:13.315992  7435 raft_consensus.cc:2764] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Leader election decision vote started in defunct term 15: won
W20260709 13:01:13.316875  7513 log.cc:927] Time spent T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 1.395s	user 0.012s	sys 0.009s
I20260709 13:01:13.316263  1647 rpcz_store.cc:276] 0709 13:01:12.027294 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.029827 (+  2533us) service_pool.cc:224] Handling call
0709 13:01:13.315588 (+1285761us) spinlock_profiling.cc:243] Waited 603 ms on lock 0x7b54001f7f54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:01:13.315755 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1386730752}
W20260709 13:01:13.318431  7534 log.cc:927] Time spent T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.674s	user 0.001s	sys 0.000s
I20260709 13:01:13.319113  2294 leader_election.cc:400] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391) with higher term. Message: Invalid argument: T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 15. Current term is 16.
I20260709 13:01:13.319449  2294 leader_election.cc:403] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:01:13.308998  7115 raft_consensus.cc:2804] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:13.346788  1725 raft_consensus.cc:2468] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 16.
I20260709 13:01:13.310362  7146 raft_consensus.cc:2804] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:13.310843  7541 raft_consensus.cc:2804] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:13.353986  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:01:13.337664  7560 log.cc:927] Time spent T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:01:13.357854  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:13.328394  7429 raft_consensus.cc:2749] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391) with higher term. Message: Invalid argument: T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 15. Current term is 16.
I20260709 13:01:13.354990  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:13.363723  1567 raft_consensus.cc:3060] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:13.365341  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 84677.5us
W20260709 13:01:13.366330  1542 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:13.367017  1542 leader_election.cc:336] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Timed out: RequestConsensusVote RPC to 127.0.107.195:45473 timed out after 1.624s (SENT)
I20260709 13:01:13.367497  1542 leader_election.cc:304] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:13.360210  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:13.356252  7561 raft_consensus.cc:3060] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:13.369781  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:13.368820  1573 raft_consensus.cc:2468] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 10.
I20260709 13:01:13.338024  7115 raft_consensus.cc:493] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
W20260709 13:01:13.361784  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 60233.2us
I20260709 13:01:13.372726  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:13.373095  1576 raft_consensus.cc:1240] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 LEADER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:13.373458  1569 raft_consensus.cc:1240] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:13.375268  1689 leader_election.cc:304] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:13.378702  2295 leader_election.cc:304] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:13.350905  7146 raft_consensus.cc:493] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:13.387569  1689 leader_election.cc:304] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:13.363628  7541 raft_consensus.cc:697] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 17 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
W20260709 13:01:13.392141  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 134264us
I20260709 13:01:13.393823  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:13.373980  7502 raft_consensus.cc:2749] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:13.381296  7115 raft_consensus.cc:3060] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:13.400377  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:13.383252  7146 raft_consensus.cc:3060] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:13.401718  1617 leader_election.cc:304] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:13.393059  7522 raft_consensus.cc:2749] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:13.404608  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:13.404623  1542 leader_election.cc:304] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:13.393803  7429 raft_consensus.cc:2804] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:13.424239  1567 raft_consensus.cc:2468] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 12.
I20260709 13:01:13.425540  1573 raft_consensus.cc:1240] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:13.427134  2295 leader_election.cc:304] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:13.427762  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ec61eb41a88487585d7738d4f5636dc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:13.399893  7495 raft_consensus.cc:2749] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:13.391914  7403 consensus_queue.cc:1059] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:01:13.400792  7493 raft_consensus.cc:493] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:13.430884  1542 leader_election.cc:304] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:13.437937  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:13.436736  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:13.442418  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:13.415723  7429 raft_consensus.cc:493] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:13.434928  7502 raft_consensus.cc:2804] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:13.450347  7429 raft_consensus.cc:3060] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:13.507093  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 76334us
I20260709 13:01:13.476853  7502 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:13.510586  1542 leader_election.cc:304] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:13.513083  1542 leader_election.cc:304] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:13.446391  7493 raft_consensus.cc:515] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:13.519400  1571 raft_consensus.cc:2410] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 13:01:13.516672  7502 raft_consensus.cc:3060] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:13.588474  7511 raft_consensus.cc:2804] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:13.513289  7551 raft_consensus.cc:493] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:13.450090  7541 consensus_queue.cc:237] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:13.587313  7521 raft_consensus.cc:493] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:13.580206  7539 raft_consensus.cc:2804] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Leader election won for term 16
W20260709 13:01:13.802325  1689 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:13.823939  2323 raft_consensus.cc:1240] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:13.785725  7436 raft_consensus.cc:493] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:13.842597  6977 raft_consensus.cc:493] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:13.843181  6977 raft_consensus.cc:515] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:13.845364  6977 leader_election.cc:290] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:13.845829  6977 raft_consensus.cc:493] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:13.846276  6977 raft_consensus.cc:515] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:13.848142  6977 leader_election.cc:290] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:13.848485  1723 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2735) took 1128 ms. Trace:
W20260709 13:01:13.808959  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 295916us
I20260709 13:01:13.852376  1723 rpcz_store.cc:276] 0709 13:01:12.719816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.723516 (+  3700us) service_pool.cc:224] Handling call
0709 13:01:13.006927 (+283411us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:13.024294 (+ 17367us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.848265 (+823971us) spinlock_profiling.cc:243] Waited 283 ms on lock 0x7b540007f150. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23ba8ad 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:01:13.848409 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":651043200}
I20260709 13:01:13.858814  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:01:13.790783  7555 log.cc:927] Time spent T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.657s	user 0.001s	sys 0.000s
I20260709 13:01:13.860638  1542 leader_election.cc:304] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:13.866218  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:13.858450  7403 raft_consensus.cc:2749] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:13.868656  7146 raft_consensus.cc:515] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:13.870867  7146 leader_election.cc:290] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:01:13.872593  7568 log.cc:927] Time spent T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.300s	user 0.000s	sys 0.009s
W20260709 13:01:13.876609  7570 log.cc:927] Time spent T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:01:13.849733  7436 raft_consensus.cc:515] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:13.878669  1574 raft_consensus.cc:1240] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:13.878872  7436 leader_election.cc:290] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:13.792812  7576 raft_consensus.cc:2749] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:13.784237  7424 raft_consensus.cc:493] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
W20260709 13:01:13.851758  7475 consensus_meta.cc:287] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.569s	user 0.008s	sys 0.008s
I20260709 13:01:13.785252  7522 raft_consensus.cc:493] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:13.887354  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:13.890656  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:13.883631  7521 raft_consensus.cc:515] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:13.853585  7493 leader_election.cc:290] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:13.888224  7280 raft_consensus.cc:493] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:13.864725  7539 raft_consensus.cc:697] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 16 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:13.906383  1542 leader_election.cc:304] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:13.912484  1542 leader_election.cc:304] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:13.894956  7475 raft_consensus.cc:2749] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:13.898383  7403 raft_consensus.cc:2749] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:13.878901  7115 raft_consensus.cc:515] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:13.915208  1542 leader_election.cc:304] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:13.968911  1719 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2721) took 1387 ms. Trace:
I20260709 13:01:13.829164  7551 raft_consensus.cc:515] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:13.969419  1719 rpcz_store.cc:276] 0709 13:01:12.581978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.586215 (+  4237us) service_pool.cc:224] Handling call
0709 13:01:12.586528 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:12.599856 (+ 13328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:12.599889 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:12.620822 (+ 20933us) log.cc:844] Serialized 26 byte log entry
0709 13:01:13.001050 (+380228us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:13.001119 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.001220 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:13.790121 (+788901us) spinlock_profiling.cc:243] Waited 8.03 ms on lock 0x7b4400022b4c. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef1f4c85 00007fa9ef1f56a2 00007fa9f1f671db 00007fa9f1f62aaf 00007fa9f1f5686e 00007fa9f1f55bb6 00007fa9f1f557d8 00007fa9f1f5f221 00007fa9f1f5f1d9 00007fa9f1f5f169
0709 13:01:13.962347 (+172226us) raft_consensus.cc:1685] finished
0709 13:01:13.962371 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:13.968840 (+  6469us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21563,"raft.queue_time_us":17720,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":10263,"spinlock_wait_cycles":18466688,"thread_start_us":343358,"threads_started":1,"wal-append.queue_time_us":400206}
I20260709 13:01:13.904625  7280 raft_consensus.cc:515] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:13.896873  7522 raft_consensus.cc:515] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:13.924749  7405 raft_consensus.cc:2749] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:13.917939  7576 raft_consensus.cc:2749] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:13.907857  7146 consensus_queue.cc:1059] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 13:01:13.909010  7424 raft_consensus.cc:515] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:13.976104  6977 raft_consensus.cc:493] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:13.999115  7539 consensus_queue.cc:237] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:13.988857  7521 leader_election.cc:290] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:01:14.014767  7561 consensus_meta.cc:287] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4: Time spent flushing consensus metadata: real 0.625s	user 0.014s	sys 0.000s
I20260709 13:01:14.020936  7561 raft_consensus.cc:2749] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373) with higher term. Message: Invalid argument: T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 15. Current term is 16.
W20260709 13:01:13.999859  7269 consensus_meta.cc:287] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Time spent flushing consensus metadata: real 1.023s	user 0.018s	sys 0.012s
W20260709 13:01:14.007449  7569 log.cc:927] Time spent T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.301s	user 0.000s	sys 0.009s
I20260709 13:01:14.027844  7585 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.029803  7280 leader_election.cc:290] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:14.049999  7585 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:01:14.030627  7575 log.cc:927] Time spent T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.207s	user 0.000s	sys 0.002s
I20260709 13:01:14.030488  7437 raft_consensus.cc:493] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.031987  7115 leader_election.cc:290] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 15 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:14.059253  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:14.041147  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:14.064647  1651 raft_consensus.cc:2468] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 16.
I20260709 13:01:14.048460  7424 leader_election.cc:290] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:01:14.054036  7429 consensus_meta.cc:287] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66: Time spent flushing consensus metadata: real 0.543s	user 0.008s	sys 0.004s
I20260709 13:01:14.095104  2294 leader_election.cc:304] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:01:14.095997  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 198396us
I20260709 13:01:14.033298  7521 raft_consensus.cc:493] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:14.099229  2294 leader_election.cc:304] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:01:14.097963  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 201736us
I20260709 13:01:14.012110  6977 raft_consensus.cc:515] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:14.091697  7115 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:14.109709  1689 leader_election.cc:304] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:14.053463  7269 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:14.101037  7403 raft_consensus.cc:2749] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:14.119266  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 204133us
I20260709 13:01:14.130851  1542 leader_election.cc:304] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:14.132259  7485 raft_consensus.cc:2749] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:14.066164  7437 raft_consensus.cc:515] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:14.136629  7420 raft_consensus.cc:493] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:01:14.137316  7437 leader_election.cc:290] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:14.137966  7437 consensus_queue.cc:1059] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:14.138811  7437 raft_consensus.cc:493] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:14.139272  7437 raft_consensus.cc:515] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:14.140779  7564 raft_consensus.cc:2749] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:14.101565  7429 raft_consensus.cc:515] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:14.120494  7511 raft_consensus.cc:697] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:01:14.147746  6977 leader_election.cc:290] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:14.148432  7530 raft_consensus.cc:993] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66: : Instructing follower 0c7751452c4b46afa95251b9df7169d4 to start an election
I20260709 13:01:14.148466  7587 raft_consensus.cc:493] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:14.149363  7587 raft_consensus.cc:515] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:01:14.149931  7536 log.cc:927] Time spent T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 1.223s	user 0.003s	sys 0.000s
I20260709 13:01:14.151607  7587 leader_election.cc:290] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:14.152500  7522 leader_election.cc:290] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:14.153767  7551 leader_election.cc:290] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:14.154476  7585 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:14.137329  7420 raft_consensus.cc:515] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:14.163213  7420 leader_election.cc:290] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:14.164414  7269 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 18 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:14.141536  7581 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:14.165553  7581 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:14.172724  1542 leader_election.cc:304] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:14.114439  7521 raft_consensus.cc:515] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:14.192108  1615 leader_election.cc:304] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:14.122123  7115 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:14.198765  1651 raft_consensus.cc:1240] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:14.116907  7598 consensus_queue.cc:1059] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 13:01:14.202373  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:14.202998  1649 raft_consensus.cc:1240] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:14.142253  7597 raft_consensus.cc:2749] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:01:14.205389  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 58195.1us
I20260709 13:01:14.202491  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:14.206130  1542 leader_election.cc:304] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:14.146474  7593 raft_consensus.cc:2749] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:14.142632  7595 raft_consensus.cc:2749] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:14.212899  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:14.213253  7437 leader_election.cc:290] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:14.214218  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:14.214823  1649 raft_consensus.cc:2376] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 16. Re-sending same reply.
W20260709 13:01:14.208851  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 99757.4us
I20260709 13:01:14.210673  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:14.199697  7530 raft_consensus.cc:1081] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Signalling peer 0c7751452c4b46afa95251b9df7169d4 to start an election
I20260709 13:01:14.197052  7602 raft_consensus.cc:3055] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:14.200984  7557 raft_consensus.cc:2804] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:14.227939  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:14.229729  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:14.230384  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:14.237210  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:01:14.223474  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 108184us
I20260709 13:01:14.199712  7269 raft_consensus.cc:2749] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:14.240973  7428 raft_consensus.cc:493] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:01:14.241654  7428 raft_consensus.cc:515] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:14.233475  7602 raft_consensus.cc:740] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:01:14.245611  7602 consensus_queue.cc:260] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:14.246886  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:14.247236  7557 raft_consensus.cc:697] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 16 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:14.248075  7557 consensus_queue.cc:237] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:14.211905  7581 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:14.246803  7602 raft_consensus.cc:3060] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:14.251794  7521 leader_election.cc:290] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:14.195617  7424 consensus_queue.cc:1048] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 13:01:14.232899  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:14.199707  7551 raft_consensus.cc:493] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
W20260709 13:01:14.253722  7571 log.cc:927] Time spent T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.429s	user 0.000s	sys 0.001s
I20260709 13:01:14.222288  7511 consensus_queue.cc:237] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:01:14.255143  1718 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49996 (request call id 2148) took 1394 ms (client timeout 1582 ms). Trace:
I20260709 13:01:14.222397  7074 raft_consensus.cc:493] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:14.255678  7074 raft_consensus.cc:3060] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:14.255543  1718 rpcz_store.cc:269] 0709 13:01:12.860337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.978697 (+118360us) service_pool.cc:224] Handling call
0709 13:01:14.254944 (+1276247us) spinlock_profiling.cc:243] Waited 15.9 ms on lock 0x7b54002aadd4. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bf2fa 00007fa9f7380b17 00007fa9f08fb6d4 00007fa9f08fb662 00007fa9f08fb591 00007fa9f08fb50c 00007fa9f08fa7c2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:01:14.255064 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36470144}
I20260709 13:01:14.211663  7598 consensus_queue.cc:1243] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer 05476b84d8f84d76a9a1f51b620a3c66 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:01:14.257316  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57e6243cbccc4e5fa84d8a5fd5a78af0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:14.253400  7551 raft_consensus.cc:515] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:14.258956  7522 raft_consensus.cc:3055] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:14.259339  7522 raft_consensus.cc:740] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:01:14.251127  7502 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:14.260094  7551 leader_election.cc:290] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:14.262538  7502 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 17 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:14.264475  1721 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "477960faa15b4001a5a6361558d69294"
dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:58782
I20260709 13:01:14.265044  1721 raft_consensus.cc:493] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:14.265209  1724 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2743) took 1542 ms. Trace:
I20260709 13:01:14.265476  1721 raft_consensus.cc:3060] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:14.265694  1724 rpcz_store.cc:276] 0709 13:01:12.722627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.839277 (+116650us) service_pool.cc:224] Handling call
0709 13:01:12.976469 (+137192us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:12.977263 (+   794us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:14.265019 (+1287756us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b54002a99d0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23ba8ad 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:01:14.265156 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":314074880}
I20260709 13:01:14.267115  7594 raft_consensus.cc:2804] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:14.267727  7594 raft_consensus.cc:697] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:01:14.268671  7594 consensus_queue.cc:237] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:14.271522  7115 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:14.272912  1570 raft_consensus.cc:1240] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 17 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:14.230554  1542 leader_election.cc:304] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:14.273559  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:01:14.273986  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 61070.1us
I20260709 13:01:14.274712  1542 leader_election.cc:304] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:14.283986  1542 leader_election.cc:304] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:14.290655  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:14.292318  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:14.277809  7060 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:14.293829  7060 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:14.294471  7074 raft_consensus.cc:515] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:14.294965  7199 raft_consensus.cc:3055] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:14.295349  7199 raft_consensus.cc:740] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:01:14.260094  7522 consensus_queue.cc:260] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:14.296500  7522 raft_consensus.cc:3060] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:14.300820  1688 leader_election.cc:304] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:14.303750  1721 raft_consensus.cc:515] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:14.306164  7074 leader_election.cc:290] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:14.308583  7428 leader_election.cc:290] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:14.309887  7538 raft_consensus.cc:993] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66: : Instructing follower 0c7751452c4b46afa95251b9df7169d4 to start an election
I20260709 13:01:14.322837  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:14.325592  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:14.379719  1719 raft_consensus.cc:2468] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 11.
I20260709 13:01:14.314194  1542 leader_election.cc:304] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:14.329452  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:14.299558  7593 raft_consensus.cc:2749] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:14.342553  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:14.386978  1720 raft_consensus.cc:3060] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:14.287293  7502 raft_consensus.cc:2804] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:14.304214  7585 raft_consensus.cc:2749] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:14.321466  7432 raft_consensus.cc:2804] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:14.352154  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "725a29842f534310a9c0bb9d5c7892a2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:14.353623  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:14.356451  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475f4ce2905344b0803209ce7b2e9386" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:14.328953  7541 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:14.296136  7199 consensus_queue.cc:260] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:14.344394  7324 raft_consensus.cc:493] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:14.350201  7140 consensus_queue.cc:1048] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 13:01:14.365576  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:14.358901  7375 raft_consensus.cc:493] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:14.371212  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 88399.4us
I20260709 13:01:14.409658  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c04bf03d764babb1a5e3b102527e5f" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:14.411356  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:01:14.415007  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:14.415673  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:14.426990  1720 raft_consensus.cc:2468] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 15.
I20260709 13:01:14.385682  7521 raft_consensus.cc:2749] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:01:14.397313  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 83320.9us
I20260709 13:01:14.401072  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:14.402441  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:14.381212  1721 leader_election.cc:290] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:14.431171  1542 leader_election.cc:304] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:14.430399  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:14.391840  7502 raft_consensus.cc:493] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:14.369737  7542 consensus_queue.cc:1048] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 13:01:14.394150  7432 raft_consensus.cc:493] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:14.438180  1542 leader_election.cc:304] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:14.438372  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:14.439352  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:14.430362  7199 raft_consensus.cc:3060] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:14.433671  7601 raft_consensus.cc:1081] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Signalling peer 0c7751452c4b46afa95251b9df7169d4 to start an election
I20260709 13:01:14.429008  7375 raft_consensus.cc:515] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:14.440209  7502 raft_consensus.cc:3060] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:14.444341  7432 raft_consensus.cc:3060] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:01:14.473587  1691 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:14.462255  7606 log.cc:927] Time spent T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260709 13:01:14.444732  7585 raft_consensus.cc:2749] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:14.405915  7541 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:14.411396  7324 raft_consensus.cc:515] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:14.474846  7375 leader_election.cc:290] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:01:14.458982  7607 log.cc:927] Time spent T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
I20260709 13:01:14.458782  7593 raft_consensus.cc:2749] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:01:14.509301  7608 log.cc:927] Time spent T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 13:01:14.497089  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:14.498494  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
W20260709 13:01:14.517078  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 151481us
I20260709 13:01:14.518489  2328 raft_consensus.cc:3055] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:14.518961  2328 raft_consensus.cc:740] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:01:14.461611  7521 consensus_queue.cc:1048] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:01:14.502568  7541 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:14.494349  7269 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:14.494668  7405 raft_consensus.cc:493] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
W20260709 13:01:14.506283  7532 log.cc:927] Time spent T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 1.863s	user 0.000s	sys 0.004s
I20260709 13:01:14.544453  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:14.523756  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:14.520640  1617 leader_election.cc:304] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:14.541020  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:14.543217  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:14.549256  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:14.507766  7432 raft_consensus.cc:515] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:01:14.552778  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.552867  1617 leader_election.cc:304] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:14.555887  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf2ade0033864199b5ced11fc9b5c6ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:14.557896  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:14.586383  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:14.543900  2328 consensus_queue.cc:260] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:14.590229  2328 raft_consensus.cc:3060] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:14.543577  7580 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:14.543423  7593 raft_consensus.cc:493] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:14.594127  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:14.600607  1572 raft_consensus.cc:2468] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 10.
I20260709 13:01:14.547145  7585 raft_consensus.cc:493] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:14.603060  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:14.609274  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:14.609933  1572 raft_consensus.cc:3060] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:14.555806  7541 raft_consensus.cc:2804] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:14.614495  1719 raft_consensus.cc:1275] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 13:01:14.628826  1719 pending_rounds.cc:85] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4: Aborting all ops after (but not including) 9
I20260709 13:01:14.629158  1719 pending_rounds.cc:107] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 13:01:14.629465  1719 raft_consensus.cc:2889] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:14.562927  7614 raft_consensus.cc:2804] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:14.551318  7405 raft_consensus.cc:515] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:14.551014  7269 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:01:14.649942  2294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.613783  7541 raft_consensus.cc:493] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:14.655145  2331 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53290 (request call id 1205) took 2130 ms. Trace:
I20260709 13:01:14.655728  2331 rpcz_store.cc:276] 0709 13:01:12.518442 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.518578 (+   136us) service_pool.cc:224] Handling call
0709 13:01:12.518872 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:12.541285 (+ 22413us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:12.541331 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:12.541833 (+   502us) log.cc:844] Serialized 26 byte log entry
0709 13:01:12.629237 (+ 87404us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:12.629282 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:12.633312 (+  4030us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:14.505552 (+1872240us) spinlock_profiling.cc:243] Waited 3.89 ms on lock 0x7b4400022b4c. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef1f4c85 00007fa9ef1f56a2 00007fa9f1f671db 00007fa9f1f62aaf 00007fa9f1f5686e 00007fa9f1f55bb6 00007fa9f1f557d8 00007fa9f1f5f221 00007fa9f1f5f1d9 00007fa9f1f5f169
0709 13:01:14.642055 (+136503us) raft_consensus.cc:1685] finished
0709 13:01:14.642087 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:14.648439 (+  6352us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25697,"raft.queue_time_us":22775,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":6440,"spinlock_wait_cycles":10740352,"thread_start_us":69450,"threads_started":1,"wal-append.queue_time_us":91519}
W20260709 13:01:14.662670  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 118223us
I20260709 13:01:14.613607  7585 raft_consensus.cc:515] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:14.666853  1572 raft_consensus.cc:2468] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 10.
I20260709 13:01:14.644819  7614 raft_consensus.cc:697] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 15 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:14.654078  7541 raft_consensus.cc:3060] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:01:14.707109  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 208649us
I20260709 13:01:14.715233  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:14.716224  1722 raft_consensus.cc:1240] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 17 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:14.717718  7405 leader_election.cc:290] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:14.717829  7432 leader_election.cc:290] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 17 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:14.718521  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:14.719198  1718 raft_consensus.cc:2468] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 15.
I20260709 13:01:14.719604  7269 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:14.721982  1722 raft_consensus.cc:1240] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:14.722393  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:14.722568  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:14.722918  1716 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:14.722952  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:14.724181  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:14.725066  1718 raft_consensus.cc:1240] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 13:01:14.725335  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:14.728587  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:14.729364  1649 raft_consensus.cc:3060] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:14.612097  7593 raft_consensus.cc:515] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:14.610013  7580 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:14.729913  1689 leader_election.cc:304] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:01:14.736594  7583 log.cc:927] Time spent T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.859s	user 0.004s	sys 0.000s
I20260709 13:01:14.744285  1576 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36642 (request call id 2801) took 1370 ms. Trace:
I20260709 13:01:14.744745  1576 rpcz_store.cc:276] 0709 13:01:13.373791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.375380 (+  1589us) service_pool.cc:224] Handling call
0709 13:01:13.389171 (+ 13791us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:13.394014 (+  4843us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:13.394058 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:13.398186 (+  4128us) log.cc:844] Serialized 26 byte log entry
0709 13:01:13.760684 (+362498us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:01:14.098402 (+337718us) log.cc:844] Serialized 14 byte log entry
0709 13:01:14.098616 (+   214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:14.098687 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:14.611310 (+512623us) spinlock_profiling.cc:243] Waited 9.11 ms on lock 0x7b4400022b4c. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef1f4c85 00007fa9ef1f56a2 00007fa9f1f671db 00007fa9f1f62aaf 00007fa9f1f5686e 00007fa9f1f55bb6 00007fa9f1f557d8 00007fa9f1f5f221 00007fa9f1f5f1d9 00007fa9f1f5f169
0709 13:01:14.743933 (+132623us) raft_consensus.cc:1685] finished
0709 13:01:14.744066 (+   133us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:14.744219 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":87974,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":25,"raft.queue_time_us":7578,"raft.run_cpu_time_us":324,"raft.run_wall_time_us":12764,"spinlock_wait_cycles":20957440,"thread_start_us":601117,"threads_started":2,"wal-append.queue_time_us":440783}
I20260709 13:01:14.746433  7593 leader_election.cc:290] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:14.731542  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:14.749408  7324 leader_election.cc:290] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:14.750247  7376 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:14.792923  7541 raft_consensus.cc:515] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:14.767016  1615 leader_election.cc:304] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:14.775540  7502 raft_consensus.cc:515] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:14.783888  2328 raft_consensus.cc:2468] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 10.
I20260709 13:01:14.788364  1568 raft_consensus.cc:2410] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 13:01:14.736671  7614 consensus_queue.cc:237] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:14.805076  7580 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:01:14.801709  7623 log.cc:927] Time spent T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:01:14.798748  7585 leader_election.cc:290] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:01:14.795120  7624 log.cc:927] Time spent T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 13:01:14.811848  1649 raft_consensus.cc:2468] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 17.
I20260709 13:01:14.800928  1689 leader_election.cc:304] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:01:14.826440  7572 log.cc:927] Time spent T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 1.001s	user 0.001s	sys 0.001s
I20260709 13:01:14.826879  1689 leader_election.cc:304] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:14.803048  7551 consensus_queue.cc:1059] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:14.802412  7408 consensus_queue.cc:1059] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:14.835635  7408 consensus_queue.cc:1243] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:01:14.835714  7551 raft_consensus.cc:3055] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:14.766793  1716 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 18.
I20260709 13:01:14.836177  7551 raft_consensus.cc:740] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:01:14.816658  6915 raft_consensus.cc:2749] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:14.820699  7502 leader_election.cc:290] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 15 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:14.811125  7376 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:01:14.815832  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 48902.7us
I20260709 13:01:14.830787  7597 raft_consensus.cc:2749] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:14.831593  1725 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2752) took 1530 ms. Trace:
I20260709 13:01:14.829624  1688 leader_election.cc:304] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:14.840149  1689 leader_election.cc:304] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:14.839601  1725 rpcz_store.cc:276] 0709 13:01:13.301359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.349196 (+ 47837us) service_pool.cc:224] Handling call
0709 13:01:13.349507 (+   311us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:01:13.364623 (+ 15116us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:13.364654 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:01:13.365188 (+   534us) log.cc:844] Serialized 52 byte log entry
0709 13:01:13.451391 (+ 86203us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:01:13.451780 (+   389us) log.cc:844] Serialized 14 byte log entry
0709 13:01:13.452155 (+   375us) log.cc:844] Serialized 14 byte log entry
0709 13:01:13.452344 (+   189us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:13.452424 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:14.825898 (+1373474us) spinlock_profiling.cc:243] Waited 5.06 ms on lock 0x7b4400022b4c. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef1f4c85 00007fa9ef1f56a2 00007fa9f1f671db 00007fa9f1f62aaf 00007fa9f1f5686e 00007fa9f1f55bb6 00007fa9f1f557d8 00007fa9f1f5f221 00007fa9f1f5f1d9 00007fa9f1f5f169
0709 13:01:14.831369 (+  5471us) raft_consensus.cc:1685] finished
0709 13:01:14.831394 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:14.831537 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":175336,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":74,"raft.queue_time_us":1781,"raft.run_cpu_time_us":368,"raft.run_wall_time_us":11113,"spinlock_wait_cycles":11646720,"thread_start_us":40387,"threads_started":1,"wal-append.queue_time_us":111587}
I20260709 13:01:14.842754  1689 leader_election.cc:304] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:14.845359  1615 leader_election.cc:304] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:14.837019  7551 consensus_queue.cc:260] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:14.846396  7129 raft_consensus.cc:2804] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:14.846781  7129 raft_consensus.cc:493] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:01:14.843849  7598 raft_consensus.cc:2804] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:14.847157  7376 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:14.847249  7129 raft_consensus.cc:3060] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:14.847455  7598 raft_consensus.cc:697] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 17 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:01:14.848660  7627 raft_consensus.cc:2749] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:14.848484  7598 consensus_queue.cc:237] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:14.844851  7408 raft_consensus.cc:2749] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:14.849879  7060 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:14.841930  7522 raft_consensus.cc:2749] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:14.851007  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:14.851541  2323 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:53306 (request call id 904) took 2009 ms. Trace:
I20260709 13:01:14.851750  1646 raft_consensus.cc:2468] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 17.
I20260709 13:01:14.851974  2323 rpcz_store.cc:276] 0709 13:01:12.842270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.842394 (+   124us) service_pool.cc:224] Handling call
0709 13:01:12.842676 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:13.830277 (+987601us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:14.851234 (+1020957us) spinlock_profiling.cc:243] Waited 957 ms on lock 0x7b5400867754. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23bbe01 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6
0709 13:01:14.851428 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2200186112}
I20260709 13:01:14.846855  7551 raft_consensus.cc:3060] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:14.856606  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:14.856842  2294 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:14.860965  1689 leader_election.cc:304] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:01:14.862027  1691 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:14.871969  1615 leader_election.cc:304] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:14.872753  7531 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:14.873656  1615 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:14.873327  7531 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:14.875197  7496 raft_consensus.cc:2804] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:14.875455  7627 raft_consensus.cc:2749] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:14.875675  7496 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:14.876202  7496 raft_consensus.cc:3060] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:14.877345  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:14.879832  1689 leader_election.cc:304] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:14.880648  6915 raft_consensus.cc:2749] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:14.883881  1689 leader_election.cc:304] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:14.887600  1615 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:14.888348  7597 raft_consensus.cc:2749] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:14.889338  6915 raft_consensus.cc:2749] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:01:14.889789  7577 log.cc:927] Time spent T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.995s	user 0.004s	sys 0.000s
I20260709 13:01:14.891817  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:14.892922  1574 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36642 (request call id 2802) took 1509 ms. Trace:
I20260709 13:01:14.893385  1574 rpcz_store.cc:276] 0709 13:01:13.383706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:13.383828 (+   122us) service_pool.cc:224] Handling call
0709 13:01:13.878463 (+494635us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:13.879149 (+   686us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:14.892708 (+1013559us) spinlock_profiling.cc:243] Waited 485 ms on lock 0x7b540017dc50. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23ba8ad 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:01:14.892862 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1114605440}
I20260709 13:01:14.881048  7539 raft_consensus.cc:2749] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:14.901621   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:14.903888  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:14.899768  1689 leader_election.cc:304] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:14.878005  7531 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:14.909423  2329 raft_consensus.cc:1240] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:14.907155  1689 leader_election.cc:304] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:14.904518  1569 raft_consensus.cc:2376] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 16. Re-sending same reply.
I20260709 13:01:14.912200  1576 raft_consensus.cc:3055] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:14.912612  1576 raft_consensus.cc:740] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:01:14.913821  1574 raft_consensus.cc:1240] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 18 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:14.914753  1689 leader_election.cc:304] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:14.916426  7531 raft_consensus.cc:2804] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:14.913811  1576 consensus_queue.cc:260] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:14.885445  7408 raft_consensus.cc:2749] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:14.917851  1576 raft_consensus.cc:3060] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:14.921730  1689 leader_election.cc:304] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:14.908942  7612 raft_consensus.cc:2804] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:14.923781  1689 leader_election.cc:304] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:14.917168  7531 raft_consensus.cc:697] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 10 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:01:14.925906  1569 raft_consensus.cc:1240] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 14. Current term is 15. Ops: []
I20260709 13:01:14.926400  7432 raft_consensus.cc:2749] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:14.927858  7429 leader_election.cc:290] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:14.920830  7408 raft_consensus.cc:2749] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:14.924986  7592 raft_consensus.cc:3055] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:14.936925  7592 raft_consensus.cc:740] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:01:14.931010  7541 leader_election.cc:290] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:14.923707  7612 raft_consensus.cc:493] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:14.939496  7612 raft_consensus.cc:3060] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:14.938205  7592 consensus_queue.cc:260] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:14.935005  7602 raft_consensus.cc:2749] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 13:01:14.928309  7146 raft_consensus.cc:2749] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:14.941843  7496 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:14.942173  7531 consensus_queue.cc:237] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:14.933142  7129 raft_consensus.cc:515] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:14.949496  7542 consensus_queue.cc:1059] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 13:01:14.944898  7557 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.006s	sys 0.007s
W20260709 13:01:14.960891  7557 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.006s	sys 0.007s
I20260709 13:01:14.959622  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:14.961709  1646 raft_consensus.cc:3060] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:14.952613  1576 raft_consensus.cc:1275] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 13:01:14.963613  1576 pending_rounds.cc:85] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting all ops after (but not including) 10
I20260709 13:01:14.963868  1576 pending_rounds.cc:107] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 13:01:14.964083  1576 raft_consensus.cc:2889] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:14.960747  7542 raft_consensus.cc:3055] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:01:14.965227  7542 raft_consensus.cc:740] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:14.966128  7542 consensus_queue.cc:260] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:14.987432  1646 raft_consensus.cc:2468] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 18.
I20260709 13:01:14.989034  7436 consensus_queue.cc:1059] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:14.990393  2294 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:14.991029  7436 consensus_queue.cc:1048] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:14.992983  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:01:14.995162  7616 raft_consensus.cc:3055] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:14.995244  7427 raft_consensus.cc:2804] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:14.995752  7616 raft_consensus.cc:740] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:14.996248  7427 raft_consensus.cc:697] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 18 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:01:14.999406  7427 consensus_queue.cc:237] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:01:15.003931  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 80057.9us
I20260709 13:01:15.003361  7598 raft_consensus.cc:493] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:15.005877  7598 raft_consensus.cc:515] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:15.009678  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:14.994441  7436 consensus_queue.cc:1059] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:01:14.984184  7496 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 18 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:15.012200  1689 leader_election.cc:304] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:15.016587  7524 raft_consensus.cc:2749] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:15.016042  1689 leader_election.cc:304] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:15.002453  7592 raft_consensus.cc:3060] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:15.020730  7436 raft_consensus.cc:3055] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:15.021205  7436 raft_consensus.cc:740] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:15.021939  7129 leader_election.cc:290] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:15.012451  7598 leader_election.cc:290] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:15.031549  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:15.032140  1576 raft_consensus.cc:3060] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:15.032320  1689 leader_election.cc:304] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:15.022083  7436 consensus_queue.cc:260] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:15.033409  7598 raft_consensus.cc:2749] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:15.040805  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e702e5dcf7541a2a4c0dc32d68625c6" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:15.040867  1542 leader_election.cc:304] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:15.002803  7616 consensus_queue.cc:260] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:15.047199  7502 consensus_queue.cc:1059] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:15.048416  7502 raft_consensus.cc:3055] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:15.048827  7502 raft_consensus.cc:740] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:01:15.049750  7502 consensus_queue.cc:260] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:15.052399  1542 leader_election.cc:304] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:15.054088  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:15.034652  7636 raft_consensus.cc:2749] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:15.053721  1542 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:15.064282  1576 raft_consensus.cc:2468] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 16.
I20260709 13:01:15.065850  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:15.066291  2332 raft_consensus.cc:1240] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260709 13:01:15.068837  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:15.067951  1615 leader_election.cc:304] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:15.059315  7612 raft_consensus.cc:515] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:15.043300  7154 consensus_queue.cc:1059] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 13:01:15.084082  7154 raft_consensus.cc:3055] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:15.084461  7154 raft_consensus.cc:740] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:01:15.056217  7502 raft_consensus.cc:3060] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:15.072441  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:15.088886  1571 raft_consensus.cc:2468] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 16.
I20260709 13:01:15.090767  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:15.092449  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:15.093451  2329 raft_consensus.cc:1275] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:01:15.093259  2328 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 13.
I20260709 13:01:15.093974  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:15.073918  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55eef501fb844a5097694ea43dc740c7" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:15.055413  7593 raft_consensus.cc:2749] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:15.082437  7614 raft_consensus.cc:2804] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:15.083124  1572 raft_consensus.cc:1275] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:01:15.087081  7154 consensus_queue.cc:260] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:15.092581  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:15.078732  7585 raft_consensus.cc:2804] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:15.095327  2331 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:15.097208  2330 raft_consensus.cc:2393] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 10: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:01:15.103590  7542 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:15.108796  7419 consensus_queue.cc:1059] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 13:01:15.055675  7436 raft_consensus.cc:3060] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:15.117362  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "608abea191d946228bed666c5560fd0a" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 13:01:15.120126  1616 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.118534  7524 raft_consensus.cc:493] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:15.125756  7524 raft_consensus.cc:515] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:15.127825  7524 leader_election.cc:290] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:15.132979  7154 raft_consensus.cc:3060] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:15.135299  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:15.135782  7557 raft_consensus.cc:3055] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:15.136157  7557 raft_consensus.cc:740] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:15.117674  7280 raft_consensus.cc:493] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:15.136999  7557 consensus_queue.cc:260] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:15.115228  7616 raft_consensus.cc:3060] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:15.139490  7280 raft_consensus.cc:515] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:15.118927  7585 raft_consensus.cc:697] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 18 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:01:15.163571  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 13:01:15.153582  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.154753  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:15.155174  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:15.156237  1651 raft_consensus.cc:1240] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 16. Current term is 17. Ops: []
W20260709 13:01:15.156948  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.166404  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:15.156934  1642 raft_consensus.cc:1240] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 18 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:15.167191  1725 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c998894dcb744ba3825db19244f8207e"
dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:58782
I20260709 13:01:15.167713  1725 raft_consensus.cc:493] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:15.168061  1725 raft_consensus.cc:3060] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:15.168510  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:15.171121  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:15.158432  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:15.159902  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:15.161867  7557 raft_consensus.cc:3060] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:01:15.174233  2294 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.174623  1719 raft_consensus.cc:2410] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 13:01:15.174616  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:15.180102  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:15.180356  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:15.180961  1570 raft_consensus.cc:3060] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:15.181927  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:15.183808  1539 leader_election.cc:304] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:15.172684  7485 raft_consensus.cc:2804] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:15.185110  1721 raft_consensus.cc:1240] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:15.187930  1723 raft_consensus.cc:1275] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 13:01:15.188303  1723 pending_rounds.cc:85] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4: Aborting all ops after (but not including) 10
I20260709 13:01:15.129511  7614 raft_consensus.cc:697] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 16 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:15.188516  1721 raft_consensus.cc:1275] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:01:15.195458  7612 leader_election.cc:290] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:15.188575  1723 pending_rounds.cc:107] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 13:01:15.196341  1723 raft_consensus.cc:2889] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:15.197813  1539 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:15.200260  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:15.180781  1572 raft_consensus.cc:2468] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 18.
I20260709 13:01:15.205029  7593 raft_consensus.cc:2804] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:15.205217  7280 leader_election.cc:290] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:15.205678  7593 raft_consensus.cc:697] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:01:15.193792  7614 consensus_queue.cc:237] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:15.206635  7593 consensus_queue.cc:237] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:15.210561  1651 raft_consensus.cc:1240] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 16 LEADER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:15.212646  2295 leader_election.cc:304] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:15.213804  1719 raft_consensus.cc:1240] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:15.217274  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:15.221828  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:15.173151  7199 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:15.226140  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:15.229827  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d74b61b1f30d43f5a2c32ade6f2b8f2a" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:15.227561  1725 raft_consensus.cc:515] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:15.232023  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:15.232750  1723 raft_consensus.cc:1240] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:15.234800  1570 raft_consensus.cc:2468] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 11.
I20260709 13:01:15.236901  1721 raft_consensus.cc:1240] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 18 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:15.237358  1539 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:15.215008  7502 raft_consensus.cc:2749] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:15.241959  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:15.255748  1576 raft_consensus.cc:1275] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:01:15.239584  2297 leader_election.cc:304] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:15.257596  2297 leader_election.cc:304] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:15.259600  1725 leader_election.cc:290] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:15.252913  7496 raft_consensus.cc:2749] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:15.261930  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 13:01:15.262459  7638 log.cc:927] Time spent T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.197s	user 0.000s	sys 0.001s
I20260709 13:01:15.269549  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06376ae55ce745738b930c75f0dcdf5e" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:15.276636  7604 raft_consensus.cc:2749] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:15.284231  1643 raft_consensus.cc:1240] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:15.286664  1540 leader_election.cc:304] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:15.296269  2295 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:15.296672  1719 raft_consensus.cc:1275] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 11. (term mismatch)
I20260709 13:01:15.297014  1719 pending_rounds.cc:85] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4: Aborting all ops after (but not including) 10
I20260709 13:01:15.297266  1719 pending_rounds.cc:107] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4: Aborting uncommitted NO_OP operation due to leader change: 10.11
I20260709 13:01:15.294898  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:15.297498  1719 raft_consensus.cc:2889] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:15.262320  7610 raft_consensus.cc:2749] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:15.292804  7154 raft_consensus.cc:2749] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:15.221796  7403 consensus_queue.cc:1059] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.044s
I20260709 13:01:15.259006  7580 raft_consensus.cc:2749] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:15.302568  1721 raft_consensus.cc:1240] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:15.295760  7542 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.306634  7542 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:15.308677  7542 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:15.311235  1617 leader_election.cc:304] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:15.312062  1567 raft_consensus.cc:1240] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:15.315598  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:15.316934  2295 leader_election.cc:304] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:15.317610  2325 raft_consensus.cc:1240] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:01:15.319900  7441 raft_consensus.cc:2804] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:15.320760  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:15.323943  1617 leader_election.cc:304] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:15.324285  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4ab0461976fc466a8162014a633d32d2" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:01:15.326903  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.327455  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:15.328018  1568 raft_consensus.cc:3060] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:15.328052  1542 leader_election.cc:304] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:15.237869  7199 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:15.332140  1542 leader_election.cc:304] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:15.317823  7301 raft_consensus.cc:2804] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:15.336380  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:01:15.345260  2323 raft_consensus.cc:1240] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 18 LEADER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:15.320402  7441 raft_consensus.cc:697] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:01:15.347468  1689 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:15.351626  2297 leader_election.cc:304] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:15.333284  7403 raft_consensus.cc:2749] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:15.357967  7403 raft_consensus.cc:2749] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:15.358707  7310 consensus_queue.cc:1048] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:15.359388  1689 leader_election.cc:304] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:15.333804  7129 raft_consensus.cc:2749] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:15.360693  7627 raft_consensus.cc:2749] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:15.333678  6703 consensus_queue.cc:1048] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 13:01:15.361362  7627 raft_consensus.cc:2749] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:15.361404  1689 leader_election.cc:304] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:15.362222  7627 consensus_queue.cc:1059] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:15.363077  7627 raft_consensus.cc:3055] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:15.363421  7627 raft_consensus.cc:740] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:01:15.304946  7565 consensus_queue.cc:1059] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.059s
I20260709 13:01:15.364679  7565 raft_consensus.cc:3055] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:15.365238  7565 raft_consensus.cc:740] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:01:15.364935  7441 consensus_queue.cc:237] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:15.299635  7502 consensus_queue.cc:1048] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260709 13:01:15.366325  7565 consensus_queue.cc:260] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:15.336788  7140 raft_consensus.cc:2749] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:15.368191  7199 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:15.331581  7154 raft_consensus.cc:3055] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:01:15.369009  7154 raft_consensus.cc:740] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:01:15.347534  7301 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:15.369670  7301 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:15.369902  7154 consensus_queue.cc:260] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:15.371160  7154 raft_consensus.cc:3060] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:15.267380  7585 consensus_queue.cc:237] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:15.379385  1689 leader_election.cc:304] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:15.381703  1568 raft_consensus.cc:2468] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 10.
I20260709 13:01:15.347066  7437 raft_consensus.cc:493] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:15.384711  7300 raft_consensus.cc:2749] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:01:15.368316  7559 consensus_queue.cc:1175] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0c7751452c4b46afa95251b9df7169d4" responder_term: 11 status { last_received { term: 11 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 11 index: 8 } }
I20260709 13:01:15.386072  7300 consensus_queue.cc:1048] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:15.387885  7300 consensus_queue.cc:1059] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:15.392735  7561 raft_consensus.cc:2749] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:01:15.394675  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 57553.5us
I20260709 13:01:15.397795  7436 consensus_queue.cc:1048] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:15.367976  7565 raft_consensus.cc:3060] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:15.400556  7561 raft_consensus.cc:2749] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:15.401859  1689 leader_election.cc:304] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:15.384246  7437 raft_consensus.cc:515] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:15.409821  1689 leader_election.cc:304] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:15.405138  1573 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36640 (request call id 2753) took 1171 ms. Trace:
I20260709 13:01:15.416850  1573 rpcz_store.cc:276] 0709 13:01:14.233881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:14.259155 (+ 25274us) service_pool.cc:224] Handling call
0709 13:01:14.322034 (+ 62879us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:01:14.322292 (+   258us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 13:01:14.346356 (+ 24064us) log.cc:844] Serialized 14 byte log entry
0709 13:01:15.129063 (+782707us) spinlock_profiling.cc:243] Waited 3.25 ms on lock 0x7b18003c2bc0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef2b0e07 00007fa9f810bab9 00007fa9ef2cd69b 00007fa9ef2cb93f 00007fa9ef2cdc02 00007fa9f1f5520b 00007fa9f1f5ad23 00007fa9f1f5b23a 00007fa9f23c5a2a
0709 13:01:15.160503 (+ 31440us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:01:15.160581 (+    78us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:15.160641 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:15.160731 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:15.404954 (+244223us) spinlock_profiling.cc:243] Waited 62.6 ms on lock 0x7b54003674d0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23ba8ad 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:01:15.405076 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":23858,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":2444,"raft.queue_time_us":107,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":83,"spinlock_wait_cycles":151440000,"thread_start_us":30905,"threads_started":1,"wal-append.queue_time_us":813803}
W20260709 13:01:15.423621  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 135745us
I20260709 13:01:15.425323  1644 raft_consensus.cc:1275] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260709 13:01:15.428706  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 101881us
I20260709 13:01:15.432425  7636 raft_consensus.cc:2749] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:15.434027  1574 raft_consensus.cc:1240] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 9. Current term is 10. Ops: []
I20260709 13:01:15.434829  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:15.437119  1540 leader_election.cc:304] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:15.440088  1689 leader_election.cc:304] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:15.444351  1540 leader_election.cc:304] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:15.435781  7544 raft_consensus.cc:493] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:15.419278  7310 consensus_queue.cc:1059] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260709 13:01:15.453305  1540 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:15.450022  1689 leader_election.cc:304] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:15.464125  1540 leader_election.cc:304] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:15.465730  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:15.467218  1689 leader_election.cc:304] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:15.466444  1724 raft_consensus.cc:2468] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 16.
I20260709 13:01:15.364231  7627 consensus_queue.cc:260] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:15.441231  7199 raft_consensus.cc:2749] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:15.447345  7522 raft_consensus.cc:2749] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:01:15.505684  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 45567.3us
I20260709 13:01:15.509054  7495 raft_consensus.cc:2749] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:01:15.508888  1617 leader_election.cc:304] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:15.455459  7612 raft_consensus.cc:2749] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:15.505089  7528 raft_consensus.cc:2804] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:01:15.454527  7403 raft_consensus.cc:2749] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:01:15.566848  7485 raft_consensus.cc:493] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:15.567335  7437 leader_election.cc:290] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:15.449144  7564 consensus_queue.cc:1059] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
W20260709 13:01:15.575323  1691 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.580768  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:15.449262  7561 consensus_queue.cc:1059] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.069s
I20260709 13:01:15.459308  7544 raft_consensus.cc:515] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:15.686636  1646 raft_consensus.cc:2468] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 17.
I20260709 13:01:15.544153  7627 raft_consensus.cc:3060] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:01:15.514845  7648 raft_consensus.cc:2749] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:15.615190  7485 raft_consensus.cc:3060] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:15.695948  7649 log.cc:927] Time spent T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
W20260709 13:01:15.688800  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 179964us
I20260709 13:01:15.616604  7199 raft_consensus.cc:2749] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:15.679250  7528 raft_consensus.cc:697] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 10 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:01:15.740562  1643 raft_consensus.cc:1240] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 16 LEADER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:15.624512  7605 consensus_queue.cc:1048] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.106s
I20260709 13:01:15.698114  7542 raft_consensus.cc:2804] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:15.705354  7595 consensus_queue.cc:1059] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
W20260709 13:01:15.758005  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 294286us
I20260709 13:01:15.747090  7614 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:01:15.754756  7542 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:15.756608  7602 raft_consensus.cc:3055] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:15.766837  7542 raft_consensus.cc:3060] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:15.774605  1574 raft_consensus.cc:1275] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 17 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:01:15.767460  7403 raft_consensus.cc:493] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
W20260709 13:01:15.787714  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.770892  7585 raft_consensus.cc:493] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:15.771178  7593 raft_consensus.cc:493] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:15.771966  7602 raft_consensus.cc:740] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
W20260709 13:01:15.784087  7616 consensus_meta.cc:287] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.628s	user 0.009s	sys 0.001s
I20260709 13:01:15.766634  7614 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:15.802495  7585 raft_consensus.cc:515] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:01:15.809612  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 345547us
I20260709 13:01:15.812721  1540 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
W20260709 13:01:15.534008  7280 consensus_queue.cc:1175] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" responder_term: 10 status { last_received { term: 9 index: 7 } last_committed_idx: 7 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 13:01:15.835410  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 90994.9us
I20260709 13:01:15.780282  7528 consensus_queue.cc:237] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:15.794675  7403 raft_consensus.cc:515] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:15.834204  7301 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:15.845752  7199 raft_consensus.cc:2749] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:15.846614  7301 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 19 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:15.847492  7199 raft_consensus.cc:493] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.849748  7614 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:15.848055  7199 raft_consensus.cc:515] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:15.819917  7593 raft_consensus.cc:515] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 13:01:15.854322  1651 raft_consensus.cc:2468] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 15.
I20260709 13:01:15.859886  7602 consensus_queue.cc:260] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:15.861436  7602 raft_consensus.cc:3060] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:15.865769  1572 raft_consensus.cc:1275] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 18 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 13:01:15.868597  1689 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:15.877351  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:15.880939  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:15.881541  1725 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 13.
W20260709 13:01:15.889922  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 77302.4us
W20260709 13:01:15.875687  7646 log.cc:927] Time spent T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.185s	user 0.001s	sys 0.001s
I20260709 13:01:15.868582  7300 raft_consensus.cc:493] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:15.894778  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:15.871171  7544 leader_election.cc:290] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:15.897394  7614 raft_consensus.cc:493] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:15.906898  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:15.911181  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:15.911906  2323 raft_consensus.cc:2468] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 13.
I20260709 13:01:15.913798  1540 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:15.918174  1574 raft_consensus.cc:2393] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 13: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 13:01:15.920735  7616 raft_consensus.cc:493] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:15.921236  7616 raft_consensus.cc:515] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:15.923264  7616 leader_election.cc:290] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:15.925825  7593 leader_election.cc:290] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:15.919641  7154 raft_consensus.cc:2804] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:15.941983  7154 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:15.942536  7154 raft_consensus.cc:3060] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:15.899572  7300 raft_consensus.cc:515] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:15.945794  7501 raft_consensus.cc:3055] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:15.946255  7501 raft_consensus.cc:740] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:01:15.947068  7501 consensus_queue.cc:260] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:01:15.957378  7653 log.cc:927] Time spent T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.172s	user 0.004s	sys 0.001s
W20260709 13:01:15.963423  7663 log.cc:927] Time spent T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:01:15.959601  7652 log.cc:927] Time spent T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 13:01:15.965930  7485 raft_consensus.cc:515] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:15.945819  7300 leader_election.cc:290] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:15.968209  7485 leader_election.cc:290] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 16 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:15.973943  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:15.976714  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:15.933348  7614 raft_consensus.cc:515] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:15.998509  7614 leader_election.cc:290] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:16.001174  7542 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:16.003471  7542 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 17 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:01:16.053512  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 124537us
I20260709 13:01:16.049192  7529 raft_consensus.cc:493] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:01:16.056420  7529 raft_consensus.cc:515] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:16.072242  7028 raft_consensus.cc:3055] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:01:16.072791  7028 raft_consensus.cc:740] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:01:16.073747  7028 consensus_queue.cc:260] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:16.075300  7028 raft_consensus.cc:3060] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:16.087451  7645 log.cc:927] Time spent T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.342s	user 0.001s	sys 0.001s
W20260709 13:01:16.085822  7651 log.cc:927] Time spent T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.287s	user 0.002s	sys 0.000s
I20260709 13:01:16.064420  7529 leader_election.cc:290] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:16.105765  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:01:16.108742  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 229895us
I20260709 13:01:16.110298  7573 raft_consensus.cc:493] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:16.110934  7612 consensus_queue.cc:1048] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 13:01:16.109543  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 44932.1us
I20260709 13:01:16.112651  7612 raft_consensus.cc:493] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:16.113193  7612 raft_consensus.cc:515] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:16.114171  7627 raft_consensus.cc:493] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:16.114737  7627 raft_consensus.cc:515] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:16.115237  7656 consensus_queue.cc:1048] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:16.110898  7573 raft_consensus.cc:515] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:16.117738  7573 leader_election.cc:290] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:16.123941  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:16.125475  1723 raft_consensus.cc:1275] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:01:16.115450  7612 leader_election.cc:290] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:16.130863  1725 raft_consensus.cc:1275] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:01:16.131383  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:16.132035  1723 raft_consensus.cc:2468] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 12.
I20260709 13:01:16.133380  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:16.134641  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:16.136431  1572 raft_consensus.cc:1275] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:01:16.138440  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:16.139206  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:16.139801  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:16.140163  1725 raft_consensus.cc:3060] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:16.139204  1567 raft_consensus.cc:2468] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 12.
I20260709 13:01:16.141275  1573 raft_consensus.cc:1275] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:01:16.147418  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:16.169250  1719 raft_consensus.cc:1275] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 18 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 13:01:16.170511  1722 raft_consensus.cc:1275] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 13:01:16.166576  7419 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.179203  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:16.189951  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:16.190832  1646 raft_consensus.cc:2393] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 15: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:01:16.193336  1615 leader_election.cc:304] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:16.202550  1725 raft_consensus.cc:2468] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 17.
I20260709 13:01:16.203739  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:16.204658  1567 raft_consensus.cc:2393] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 15: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:01:16.191079  1689 leader_election.cc:304] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:16.150255  7154 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:16.188689  7627 leader_election.cc:290] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:16.190843  7658 consensus_queue.cc:1048] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260709 13:01:16.191728  7419 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:16.224977  7660 raft_consensus.cc:2804] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:16.205534  7616 consensus_queue.cc:1048] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 13:01:16.224035  7612 raft_consensus.cc:2749] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:16.235386  7280 raft_consensus.cc:493] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:16.234992  7660 raft_consensus.cc:493] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:16.244397  1617 leader_election.cc:304] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:16.240454  7280 raft_consensus.cc:515] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:16.250154  7280 leader_election.cc:290] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:16.247534  7129 raft_consensus.cc:2804] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:16.262272  7610 raft_consensus.cc:3055] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:01:16.262920  7610 raft_consensus.cc:740] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:01:16.265558  7154 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:16.241132  7140 consensus_queue.cc:1048] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 13:01:16.245150  7660 raft_consensus.cc:3060] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:16.268185  7585 leader_election.cc:290] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:16.246948  7662 consensus_queue.cc:1048] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:01:16.293139  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:01:16.310323  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 56161.3us
I20260709 13:01:16.329552  1539 leader_election.cc:304] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:16.331063  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:16.331883  1644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:16.332171  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:16.332782  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:16.333391  1649 raft_consensus.cc:1275] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 18 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 12. (term mismatch)
I20260709 13:01:16.333729  1649 pending_rounds.cc:85] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e: Aborting all ops after (but not including) 11
I20260709 13:01:16.333922  1649 pending_rounds.cc:107] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e: Aborting uncommitted NO_OP operation due to leader change: 17.12
I20260709 13:01:16.334126  1649 raft_consensus.cc:2889] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:16.329252  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:16.264001  7610 consensus_queue.cc:260] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:16.338560  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:16.339085  1642 raft_consensus.cc:2393] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 12: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:01:16.339185  1717 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2766) took 1172 ms. Trace:
I20260709 13:01:16.342588  7580 raft_consensus.cc:2804] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:16.342864  1539 leader_election.cc:304] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:16.343183  7580 raft_consensus.cc:697] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 17 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:01:16.343838  7658 raft_consensus.cc:2804] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:16.340991  1717 rpcz_store.cc:276] 0709 13:01:15.166601 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.166737 (+   136us) service_pool.cc:224] Handling call
0709 13:01:15.179565 (+ 12828us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:15.191855 (+ 12290us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:15.191883 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:15.192298 (+   415us) log.cc:844] Serialized 26 byte log entry
0709 13:01:15.345359 (+153061us) raft_consensus.cc:1645] Marking committed up to 12
0709 13:01:15.345399 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:15.345446 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:15.517518 (+172072us) raft_consensus.cc:1685] finished
0709 13:01:15.517543 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:16.306249 (+788706us) spinlock_profiling.cc:243] Waited 12.5 ms on lock 0x7b54002a99d0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f23ba8ad 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2 00007fa9f06f648c 00007fa9f06f58c6 00007fa9f06f526f
0709 13:01:16.339125 (+ 32876us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18699,"raft.queue_time_us":12859,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":113,"spinlock_wait_cycles":28768640,"thread_start_us":152777,"threads_started":1,"wal-append.queue_time_us":240309}
I20260709 13:01:16.285207  7129 raft_consensus.cc:697] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 17 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:16.349059  7419 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:16.353048  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:16.356401  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:16.357096  1717 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 18.
I20260709 13:01:16.357990  1539 leader_election.cc:304] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:16.358209  1617 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:16.362419  7656 consensus_queue.cc:1048] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:16.365761  7604 consensus_queue.cc:1048] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:01:16.353947  7658 raft_consensus.cc:697] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:01:16.375355  7658 consensus_queue.cc:237] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:01:16.383744  2295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.387928  7542 consensus_queue.cc:1048] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:16.388487  1573 raft_consensus.cc:1240] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:16.380766  7580 consensus_queue.cc:237] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:01:16.410758  7647 log.cc:927] Time spent T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.641s	user 0.001s	sys 0.002s
I20260709 13:01:16.415092  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "66c434748d1745f7ab1d4bf5a8d9e85d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:01:16.419762  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 61629.4us
W20260709 13:01:16.436179  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 46322.5us
I20260709 13:01:16.384094  7585 raft_consensus.cc:2749] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 13:01:16.416890  7610 raft_consensus.cc:3060] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:01:16.443248  7681 consensus_queue.cc:1059] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:01:16.447624  7403 leader_election.cc:290] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:16.455346  1542 leader_election.cc:304] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:16.455394  7129 consensus_queue.cc:237] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:16.460781  7559 raft_consensus.cc:493] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:16.461428  7559 raft_consensus.cc:515] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:16.464015  7559 leader_election.cc:290] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:16.464262  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:01:16.465883  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:16.468007  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:16.471385  2330 raft_consensus.cc:1275] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:16.471879  1568 raft_consensus.cc:1240] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:16.473822  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73452eca85a147fb9d862dd08d54e340" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:16.476992  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:16.477455  1689 leader_election.cc:304] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:16.477474  1723 raft_consensus.cc:1240] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 17 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 13:01:16.477856  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88a45cba73f148359b7ac85f9f702819" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:16.481695  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:16.482515  2328 raft_consensus.cc:2468] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 12.
I20260709 13:01:16.500945  2328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:16.502126  2328 raft_consensus.cc:2393] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 13: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 13:01:16.504050  2330 raft_consensus.cc:1240] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 19 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 18. Current term is 19. Ops: []
I20260709 13:01:16.512023  1542 leader_election.cc:304] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:16.513764  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:16.515313  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6eb51aa4d3bf4882a502ada4948b2cc2" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:16.516275  1542 leader_election.cc:304] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:16.489287  7485 raft_consensus.cc:2749] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:16.488405  7573 raft_consensus.cc:3060] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:16.489598  7648 consensus_queue.cc:1048] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:01:16.503347  7616 consensus_queue.cc:1059] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:01:16.542325  1568 raft_consensus.cc:1275] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:16.523226  7403 raft_consensus.cc:2749] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:16.526494  7656 raft_consensus.cc:2749] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:16.524490  7585 consensus_queue.cc:1059] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 13:01:16.558274  1642 raft_consensus.cc:1275] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 18 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:01:16.561362  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:16.570430  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65524f4fe7be481b9f069829076b7dc3" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:16.573527  1689 leader_election.cc:304] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:16.557422  7662 raft_consensus.cc:2804] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:16.576049  1650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a5bf40aa94d24ad9b858ebb61a527c4e" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:16.554019  7528 consensus_queue.cc:1048] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 13:01:16.585605  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93e6c991440c40c8a8c8050982e85eeb" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:16.585637  7598 raft_consensus.cc:2749] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:16.563205  7199 leader_election.cc:290] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:16.589442  7682 raft_consensus.cc:3055] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:16.568068  7656 raft_consensus.cc:3055] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:16.608673  1615 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:01:16.613987  7644 log.cc:927] Time spent T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.866s	user 0.003s	sys 0.000s
W20260709 13:01:16.618765  7655 log.cc:927] Time spent T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.772s	user 0.000s	sys 0.002s
I20260709 13:01:16.621127  1718 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 1614) took 1178 ms. Trace:
I20260709 13:01:16.621492  1718 rpcz_store.cc:276] 0709 13:01:15.442904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.443035 (+   131us) service_pool.cc:224] Handling call
0709 13:01:15.443386 (+   351us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:15.449761 (+  6375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:15.449792 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:15.450243 (+   451us) log.cc:844] Serialized 26 byte log entry
0709 13:01:15.753046 (+302803us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:15.760590 (+  7544us) log.cc:844] Serialized 14 byte log entry
0709 13:01:16.099520 (+338930us) spinlock_profiling.cc:243] Waited 2.27 ms on lock 0x7b18004a3560. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef248c0a 00007fa9f8988219 00007fa9ef2d0a40 00007fa9ef2cb4e4 00007fa9ef2cb455 00007fa9f23b3060 00007fa9f23c5716 00007fa9f23d6287 00007fa9f23d6208
0709 13:01:16.099717 (+   197us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:16.099793 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:16.618200 (+518407us) spinlock_profiling.cc:243] Waited 37.3 ms on lock 0x7b4400022b4c. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef1f4c85 00007fa9ef1f56a2 00007fa9f1f671db 00007fa9f1f62aaf 00007fa9f1f5686e 00007fa9f1f55bb6 00007fa9f1f557d8 00007fa9f1f5f221 00007fa9f1f5f1d9 00007fa9f1f5f169
0709 13:01:16.620380 (+  2180us) raft_consensus.cc:1685] finished
0709 13:01:16.620403 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:16.621064 (+   661us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8890,"prepare.queue_time_us":5889,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":52,"raft.queue_time_us":350014,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":10593,"spinlock_wait_cycles":90958848,"thread_start_us":302502,"threads_started":1,"wal-append.queue_time_us":383961}
I20260709 13:01:16.632488  1615 leader_election.cc:304] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:16.634279  1615 leader_election.cc:304] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:16.606606  7682 raft_consensus.cc:740] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
W20260709 13:01:16.624733  7657 log.cc:927] Time spent T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.753s	user 0.004s	sys 0.000s
I20260709 13:01:16.608341  7656 raft_consensus.cc:740] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:01:16.627023  7616 raft_consensus.cc:3060] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:16.608011  7146 consensus_queue.cc:1048] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:01:15.905021   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:16.637804  7683 raft_consensus.cc:2749] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:16.639576  7542 raft_consensus.cc:2749] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:16.727684  1721 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:58782 (request call id 1615) took 1284 ms. Trace:
I20260709 13:01:16.730079  1721 rpcz_store.cc:276] 0709 13:01:15.443178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.443283 (+   105us) service_pool.cc:224] Handling call
0709 13:01:15.443572 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:15.462710 (+ 19138us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:15.462742 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:15.463255 (+   513us) log.cc:844] Serialized 26 byte log entry
0709 13:01:15.568689 (+105434us) spinlock_profiling.cc:243] Waited 37.2 ms on lock 0x7b18004a3620. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef2ce3f3 00007fa9ef2d07c1 00007fa9ef2d0779 00007fa9ef2d0709 00007fa9ef2d06d1 00007fa9ef2cf9cd 000000000038f354 000000000038f199 00007fa9ef2b183a
0709 13:01:15.755353 (+186664us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:01:15.755399 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:15.755466 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:16.537480 (+782014us) spinlock_profiling.cc:243] Waited 8.83 ms on lock 0x7b4400022b4c. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef1f4c85 00007fa9ef1f56a2 00007fa9f1f671db 00007fa9f1f62aaf 00007fa9f1f5686e 00007fa9f1f55bb6 00007fa9f1f557d8 00007fa9f1f5f221 00007fa9f1f5f1d9 00007fa9f1f5f169
0709 13:01:16.727432 (+189952us) raft_consensus.cc:1685] finished
0709 13:01:16.727456 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:16.727616 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18763,"raft.queue_time_us":18884,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":99,"spinlock_wait_cycles":105810688,"thread_start_us":287405,"threads_started":1,"wal-append.queue_time_us":363595}
I20260709 13:01:16.757253  7544 raft_consensus.cc:493] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:16.758054  7544 raft_consensus.cc:515] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:16.755597  7656 consensus_queue.cc:260] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:16.760159  7544 leader_election.cc:290] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:16.760749  7682 consensus_queue.cc:260] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:01:16.765221  7654 log.cc:927] Time spent T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.946s	user 0.003s	sys 0.000s
W20260709 13:01:16.766175  7650 log.cc:927] Time spent T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.967s	user 0.002s	sys 0.000s
W20260709 13:01:16.766358  7690 log.cc:927] Time spent T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:01:16.767206  7154 raft_consensus.cc:493] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:16.772020  1689 leader_election.cc:304] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:01:16.710388  7689 log.cc:927] Time spent T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 13:01:16.672079  7686 log.cc:927] Time spent T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.107s	user 0.001s	sys 0.001s
W20260709 13:01:16.693563  7687 log.cc:927] Time spent T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:01:16.737098  2296 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:01:16.682633  7688 log.cc:927] Time spent T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:01:16.711582  7220 raft_consensus.cc:3055] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:16.822595  7220 raft_consensus.cc:740] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:16.823565  7220 consensus_queue.cc:260] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:16.642444  7573 raft_consensus.cc:2749] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:01:16.802242  1469 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48478 (request call id 178) took 21135 ms (client timeout 15000 ms). Trace:
I20260709 13:01:16.825349  7662 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 18 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:16.825922  7662 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:16.829792  7622 raft_consensus.cc:493] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:16.830389  7622 raft_consensus.cc:515] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:16.804468  1689 leader_election.cc:304] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:16.834393  7437 raft_consensus.cc:2804] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:16.834806  7437 raft_consensus.cc:493] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:16.834914  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:16.835204  7437 raft_consensus.cc:3060] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:16.835702  1723 raft_consensus.cc:2393] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 14: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:01:16.836059  7573 raft_consensus.cc:493] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:16.836690  7573 raft_consensus.cc:515] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:16.838910  7573 leader_election.cc:290] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:16.812839  7682 raft_consensus.cc:3060] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:16.839582  7656 raft_consensus.cc:3060] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Advancing to term 17
W20260709 13:01:16.844635  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:16.666724  7561 raft_consensus.cc:493] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:16.681878  7280 raft_consensus.cc:493] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:16.733798  7528 raft_consensus.cc:493] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
W20260709 13:01:16.792497  7660 consensus_meta.cc:287] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.501s	user 0.005s	sys 0.007s
I20260709 13:01:16.784263  7485 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.783893  7648 raft_consensus.cc:493] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:16.734826  7199 raft_consensus.cc:493] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:16.822122  7420 raft_consensus.cc:493] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.846776  2327 raft_consensus.cc:2468] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 10.
I20260709 13:01:16.849539  7561 raft_consensus.cc:515] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:16.643378  7617 consensus_queue.cc:1059] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.174s
W20260709 13:01:16.824770  1469 rpcz_store.cc:269] 0709 13:00:55.661222 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:55.670714 (+  9492us) service_pool.cc:224] Handling call
0709 13:01:10.391187 (+14720473us) spinlock_profiling.cc:243] Waited 7.02 ms on lock 0x7b5400400028. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f72e4aa1 00007fa9f730b9b4 00007fa9f5def3dc 00007fa9f5db0e0b 00007fa9f5db0be4 00007fa9f82b12d1 00007fa9f82b1b2f 00007fa9f8170d4b 00007fa9f8278c3e 00007fa9f67392a4 00007fa9f6739232
0709 13:01:16.796314 (+6405127us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:10.484823 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:10.485700 (+   877us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:10.485836 (+   136us) write_op.cc:435] Acquired schema lock
0709 13:01:10.485863 (+    27us) tablet.cc:662] Decoding operations
0709 13:01:10.617564 (+131701us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:10.617662 (+    98us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:10.617690 (+    28us) tablet.cc:685] Acquiring locks for 20 operations
0709 13:01:10.619314 (+  1624us) tablet.cc:701] Row locks acquired
0709 13:01:10.619364 (+    50us) write_op.cc:260] PREPARE: finished
0709 13:01:10.619544 (+   180us) write_op.cc:270] Start()
0709 13:01:10.619693 (+   149us) write_op.cc:276] Timestamp: P: 1783602070619474 usec, L: 0
0709 13:01:10.619729 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 13:01:10.620426 (+   697us) log.cc:844] Serialized 7877 byte log entry
0709 13:01:10.972848 (+352422us) op_driver.cc:464] REPLICATION: finished
0709 13:01:11.076634 (+103786us) write_op.cc:301] APPLY: starting
0709 13:01:11.089319 (+ 12685us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:11.353154 (+263835us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:11.366278 (+ 13124us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:11.884370 (+518092us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:11.920957 (+ 36587us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=40,key_file_lookups=40,delta_file_lookups=40,mrs_lookups=0
0709 13:01:11.921054 (+    97us) write_op.cc:312] APPLY: finished
0709 13:01:11.921903 (+   849us) log.cc:844] Serialized 180 byte log entry
0709 13:01:12.046902 (+124999us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:12.120560 (+ 73658us) write_op.cc:454] Released schema lock
0709 13:01:12.120663 (+   103us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:12.121139 (+   476us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:12.121174 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":51990,"reported_tablets":33,"spinlock_wait_cycles":16140544,"child_traces":[["op",{"apply.queue_time_us":78667,"apply.run_cpu_time_us":73987,"apply.run_wall_time_us":1052583,"cfile_cache_hit":82,"cfile_cache_hit_bytes":87727,"mutex_wait_us":9973,"num_ops":20,"prepare.queue_time_us":65510,"prepare.run_cpu_time_us":18623,"prepare.run_wall_time_us":277464,"raft.queue_time_us":171467,"raft.run_cpu_time_us":9297,"raft.run_wall_time_us":64793,"replication_time_us":346718,"thread_start_us":313443,"threads_started":5,"wal-append.queue_time_us":254357,"wal-append.run_cpu_time_us":28298,"wal-append.run_wall_time_us":2147654}]]}
I20260709 13:01:16.816820  7598 raft_consensus.cc:2749] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:01:16.824999  7220 raft_consensus.cc:3060] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:16.881137  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 227220us
I20260709 13:01:16.896780  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:01:16.897183  1718 raft_consensus.cc:1240] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 13. Current term is 14. Ops: []
I20260709 13:01:16.849038  7622 leader_election.cc:290] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:16.905074  1643 raft_consensus.cc:1240] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 17 LEADER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:16.816319  7154 raft_consensus.cc:515] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:16.910686  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:01:16.925606  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 89957.1us
I20260709 13:01:16.927624  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:16.928352  1724 raft_consensus.cc:2468] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 12.
W20260709 13:01:16.929824  7691 log.cc:927] Time spent T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:01:16.931454  1716 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2773) took 1761 ms. Trace:
I20260709 13:01:16.867113  7660 raft_consensus.cc:515] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:16.865862  7280 raft_consensus.cc:515] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:16.931983  1716 rpcz_store.cc:276] 0709 13:01:15.169949 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:15.178686 (+  8737us) service_pool.cc:224] Handling call
0709 13:01:15.178938 (+   252us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:01:15.209108 (+ 30170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:01:15.209151 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:01:15.410969 (+201818us) spinlock_profiling.cc:243] Waited 3.74 ms on lock 0x7b2c0001ccc8. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f0cb4a11 00007fa9f0cc4372 00007fa9f23f6a01 00007fa9f23bb43a 00007fa9f23ba83e 00007fa9f737f419 00007fa9f08f6bd4 00007fa9f08f6b62 00007fa9f08f6a91 00007fa9f08f6a0c 00007fa9f08f5cc2
0709 13:01:15.411459 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 13:01:15.706682 (+295223us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:01:15.754516 (+ 47834us) log.cc:844] Serialized 14 byte log entry
0709 13:01:15.757136 (+  2620us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:01:15.757264 (+   128us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:01:16.098676 (+341412us) spinlock_profiling.cc:243] Waited 2.8 ms on lock 0x7b180044cec0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef2ce522 00007fa9ef2d07c1 00007fa9ef2d0779 00007fa9ef2d0709 00007fa9ef2d06d1 00007fa9ef2cf9cd 000000000038f354 000000000038f199 00007fa9ef2b183a
0709 13:01:16.764498 (+665822us) spinlock_profiling.cc:243] Waited 58.9 ms on lock 0x7b4400022b4c. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef1f4c85 00007fa9ef1f56a2 00007fa9f1f671db 00007fa9f1f62aaf 00007fa9f1f5686e 00007fa9f1f55bb6 00007fa9f1f557d8 00007fa9f1f5f221 00007fa9f1f5f1d9 00007fa9f1f5f169
0709 13:01:16.931252 (+166754us) raft_consensus.cc:1685] finished
0709 13:01:16.931282 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:01:16.931405 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":367985,"prepare.queue_time_us":45035,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":32727,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":11639,"spinlock_wait_cycles":150538112,"thread_start_us":294864,"threads_started":1,"wal-append.queue_time_us":358427}
I20260709 13:01:16.867048  7528 raft_consensus.cc:515] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:16.869886  7485 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:16.870077  7648 raft_consensus.cc:515] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:16.913120  7598 raft_consensus.cc:493] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:16.872393  7420 raft_consensus.cc:515] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:16.919193  7441 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.872586  7199 raft_consensus.cc:515] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:16.954497  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:16.954669  1651 raft_consensus.cc:2393] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 13: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:01:16.937358  7300 raft_consensus.cc:493] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:16.933688  7695 raft_consensus.cc:493] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:16.961089  1542 leader_election.cc:304] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 13:01:16.984107  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 46080.8us
I20260709 13:01:16.988168  1540 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:16.997509  1716 raft_consensus.cc:1275] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 13:01:16.998083  1716 pending_rounds.cc:85] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4: Aborting all ops after (but not including) 7
I20260709 13:01:16.998381  1716 pending_rounds.cc:107] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 13:01:16.998695  1716 raft_consensus.cc:2889] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:16.984956  7661 raft_consensus.cc:493] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:17.072485  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 65685.5us
W20260709 13:01:17.073555  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 65568.1us
I20260709 13:01:16.990639  7501 raft_consensus.cc:3060] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:16.992947  7403 raft_consensus.cc:2804] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:16.989200  7300 raft_consensus.cc:515] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:16.961416  7598 raft_consensus.cc:515] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:16.983491  7441 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:16.987182  7695 raft_consensus.cc:515] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:17.085052  7403 raft_consensus.cc:493] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:17.103336  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 112825us
W20260709 13:01:17.101660  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 113615us
W20260709 13:01:17.109984  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 143230us
W20260709 13:01:17.118949  7697 log.cc:927] Time spent T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 13:01:17.092514  7163 consensus_queue.cc:1048] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 13:01:17.124445  7437 raft_consensus.cc:515] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:17.135327  7598 leader_election.cc:290] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:17.136673  7702 raft_consensus.cc:493] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.138957  7441 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:17.130016  7300 leader_election.cc:290] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:17.144351  1647 raft_consensus.cc:1275] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:01:17.145007  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:17.079715  7661 raft_consensus.cc:515] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:01:17.150782  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 190036us
W20260709 13:01:17.153008  1689 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.0.107.196:34423 timed out after 1.658s (SENT) [suppressed 29 similar messages]
I20260709 13:01:17.154071  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:17.158494  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:17.113822  7580 raft_consensus.cc:2749] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 13:01:17.112964  7612 raft_consensus.cc:493] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.112128  7561 leader_election.cc:290] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:17.162082  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:17.158864  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:17.189670  1723 raft_consensus.cc:2410] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:01:17.111774  7403 raft_consensus.cc:3060] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:17.148910  7573 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
W20260709 13:01:17.187189  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 112803us
I20260709 13:01:17.194095  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
W20260709 13:01:17.201412  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 69837us
I20260709 13:01:17.204583  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:17.185000  7667 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:17.205754  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:17.184127  7154 leader_election.cc:290] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:17.205482  2330 raft_consensus.cc:2468] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 11.
I20260709 13:01:17.213632  2294 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:17.218386  2294 leader_election.cc:304] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:01:17.218513  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 65538.3us
I20260709 13:01:17.219569  2294 leader_election.cc:304] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:17.223959  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:17.224432  2294 leader_election.cc:304] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:17.225584  1723 raft_consensus.cc:2393] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 11: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:01:17.227690  7437 leader_election.cc:290] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:17.229451  1717 raft_consensus.cc:1275] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 13:01:17.230180  7199 leader_election.cc:290] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:17.206063  7300 consensus_queue.cc:1048] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.025s
I20260709 13:01:17.232246  1688 leader_election.cc:304] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:17.231226  7420 leader_election.cc:290] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:17.238196  2331 raft_consensus.cc:1275] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:01:17.243580  7280 leader_election.cc:290] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:17.246845  7695 leader_election.cc:290] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:17.247769  7441 raft_consensus.cc:2749] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:17.248911  7707 raft_consensus.cc:2749] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:17.232465  7485 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:17.181654  7702 raft_consensus.cc:515] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:01:17.231716  7701 log.cc:927] Time spent T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 13:01:17.252055  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:17.271803  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:17.255650  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:17.248356  7661 leader_election.cc:290] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:01:17.275127  1539 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.256356  1540 leader_election.cc:304] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:17.193765  7612 raft_consensus.cc:515] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:17.277195  7485 raft_consensus.cc:2804] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:01:17.277765  7485 raft_consensus.cc:493] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:17.278306  7485 raft_consensus.cc:3060] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:01:17.249925  7616 consensus_meta.cc:287] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.599s	user 0.009s	sys 0.000s
I20260709 13:01:17.265880  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:17.219292  7693 raft_consensus.cc:2749] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 13:01:17.280805  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:17.272971  2332 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 13.
I20260709 13:01:17.223064  7648 leader_election.cc:290] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:17.275017  1647 raft_consensus.cc:2393] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 12: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:01:17.279148  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:17.199505  7573 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:17.282744  1651 raft_consensus.cc:2468] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 12.
W20260709 13:01:17.280154  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 55789.7us
I20260709 13:01:17.261416  7716 raft_consensus.cc:2749] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:17.269852  7146 raft_consensus.cc:493] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.274268  7695 raft_consensus.cc:2749] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:17.285764  7616 raft_consensus.cc:2749] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:17.292906  1721 raft_consensus.cc:3060] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:17.303727  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df63a7a2acf448379066cf6e352a511e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:17.220113  7667 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:17.306665  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2f8dd5957a2647058190fd52f31ec088" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:17.292090  7146 raft_consensus.cc:515] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:17.307415  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:17.301676  7702 leader_election.cc:290] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:17.326337  1647 raft_consensus.cc:2410] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:01:17.326416  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:17.326998  7573 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:17.314334  7612 leader_election.cc:290] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:17.329183  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:01:17.329560  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:17.331415  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4bc29cd0261846b7847f38862b494d0b" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:17.332173  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:17.332883  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:17.333379  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:17.328619  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:17.335767  2332 raft_consensus.cc:2393] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 12: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 13:01:17.328984  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:17.316912  1721 raft_consensus.cc:1275] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 17 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:01:17.318831  1688 leader_election.cc:304] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:17.340963  2327 raft_consensus.cc:2468] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 12.
I20260709 13:01:17.351955  7667 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:01:17.353171  7662 consensus_meta.cc:287] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.527s	user 0.006s	sys 0.005s
I20260709 13:01:17.353621  7662 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:01:17.359004  1617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.359092  2326 raft_consensus.cc:2468] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 14.
I20260709 13:01:17.362583  7561 consensus_queue.cc:1048] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:17.363814  7695 raft_consensus.cc:2804] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:17.364269  7695 raft_consensus.cc:493] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:17.364656  7695 raft_consensus.cc:3060] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:17.369606  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:17.370381  1575 raft_consensus.cc:2468] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 11.
I20260709 13:01:17.373140  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:17.373875  1646 raft_consensus.cc:2393] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 17: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:01:17.376309  7485 raft_consensus.cc:515] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:17.377470  7528 leader_election.cc:290] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:17.379325  1689 leader_election.cc:304] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:17.381000  7403 raft_consensus.cc:515] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:17.382098  1576 raft_consensus.cc:2393] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 13: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:01:17.384913  7403 leader_election.cc:290] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:17.386502  7660 leader_election.cc:290] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:17.386714  7146 leader_election.cc:290] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:17.355777  7662 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 19 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:17.388922  7726 raft_consensus.cc:2749] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:17.395578  2294 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
W20260709 13:01:17.394747  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 291599us
I20260709 13:01:17.409004  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:01:17.395299  1689 leader_election.cc:304] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:17.427167  1689 leader_election.cc:304] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:17.427380  1576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "477960faa15b4001a5a6361558d69294" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
W20260709 13:01:17.428561  2295 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:17.416819  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:17.395066  7485 leader_election.cc:290] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:17.412039  7656 consensus_queue.cc:1048] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 13:01:17.423252  6703 raft_consensus.cc:2749] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:17.423519  7695 raft_consensus.cc:515] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:17.429596  1689 leader_election.cc:304] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:17.442618  1573 raft_consensus.cc:1275] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:01:17.436944  2330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:17.436797  1689 leader_election.cc:304] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:17.438493  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:17.444447  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:17.444772  1689 leader_election.cc:304] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:17.445415  1572 raft_consensus.cc:2468] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 11.
I20260709 13:01:17.444330  2332 raft_consensus.cc:2468] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 12.
W20260709 13:01:17.442548  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 48147.6us
I20260709 13:01:17.447543  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:17.451231  1689 leader_election.cc:304] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 13:01:17.445528  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:17.450562  2324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c998894dcb744ba3825db19244f8207e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: true dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:01:17.449009  2329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:17.448520  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:17.455780  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:17.449617  2330 raft_consensus.cc:2468] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 12.
I20260709 13:01:17.461619  1689 leader_election.cc:304] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:17.462529  2295 leader_election.cc:304] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:17.461242  1568 raft_consensus.cc:1275] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 17 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 13:01:17.464721  1568 pending_rounds.cc:85] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting all ops after (but not including) 9
I20260709 13:01:17.464941  1568 pending_rounds.cc:107] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 13:01:17.431811  7146 raft_consensus.cc:2749] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:17.465174  1568 raft_consensus.cc:2889] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:17.456386  1575 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 13.
I20260709 13:01:17.430620  7280 raft_consensus.cc:2749] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:17.469175  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ec2114c988b4a38a63b42293dcf1757" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:17.470556  1724 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:17.482774  1724 raft_consensus.cc:2393] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 11: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:01:17.471012  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7bcbc7b936b4bdca8a41d00f9ecdd5f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:17.471395  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:17.483707  1718 raft_consensus.cc:3060] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:17.473817  7437 raft_consensus.cc:2749] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:01:17.484321  1459 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 8e94ee9035214526808abfaab11799fe with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER failed with leader 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 05476b84d8f84d76a9a1f51b620a3c66 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:01:17.474444  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:17.485440  1717 raft_consensus.cc:2410] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:01:17.485985  7419 raft_consensus.cc:3055] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:01:17.486390  7419 raft_consensus.cc:740] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:17.473870  7559 raft_consensus.cc:493] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.487150  7419 consensus_queue.cc:260] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:17.487319  7559 raft_consensus.cc:515] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:17.475333  7706 raft_consensus.cc:2749] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:17.455417  7712 consensus_queue.cc:1048] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 13:01:17.436316  7648 consensus_queue.cc:1048] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 13:01:17.449407  7667 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.497798  1718 raft_consensus.cc:2468] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 13.
I20260709 13:01:17.499769  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:17.500013  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:17.500375  1718 raft_consensus.cc:2468] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 12.
I20260709 13:01:17.446957  7612 raft_consensus.cc:2749] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:17.476303  7443 consensus_queue.cc:1048] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:01:17.461489  7714 raft_consensus.cc:2749] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:17.466987  7702 raft_consensus.cc:2804] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:17.479952  2327 raft_consensus.cc:2468] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 11.
I20260709 13:01:17.441618  7561 raft_consensus.cc:2804] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:17.500819  1722 raft_consensus.cc:2393] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 13: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:01:17.502913  1542 leader_election.cc:304] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:17.503552  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:17.504413  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:17.512348  1540 leader_election.cc:304] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:17.511336  7702 raft_consensus.cc:493] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:17.525010  7561 raft_consensus.cc:697] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 12 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:01:17.526736  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:17.501960  1615 leader_election.cc:304] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:17.529978  7711 raft_consensus.cc:2749] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:17.539464  7702 raft_consensus.cc:3060] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:17.540364  7656 raft_consensus.cc:2804] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:01:17.535080  1724 raft_consensus.cc:1275] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 17 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 13:01:17.493045  7667 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:17.540583  1615 leader_election.cc:304] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:17.537750  1617 leader_election.cc:304] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:17.558779  7656 raft_consensus.cc:697] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:01:17.561241  1647 raft_consensus.cc:2468] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 12.
I20260709 13:01:17.562728  1688 leader_election.cc:304] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:17.565106  7710 raft_consensus.cc:2804] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:17.566672  1617 leader_election.cc:304] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:17.568112  1643 raft_consensus.cc:1275] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 13:01:17.570369  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:01:17.570871  1647 raft_consensus.cc:1240] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 19 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 18. Current term is 19. Ops: []
I20260709 13:01:17.571312  2326 raft_consensus.cc:2393] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 12: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 13:01:17.569868  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:17.571964  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:17.573244  1643 raft_consensus.cc:2410] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:01:17.573652  1646 raft_consensus.cc:2393] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 13: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:01:17.540946  7681 raft_consensus.cc:2749] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:17.567507  7146 raft_consensus.cc:2804] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:17.577775  1617 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:17.567759  7662 raft_consensus.cc:2804] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:17.567345  7710 raft_consensus.cc:493] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.583897  7662 raft_consensus.cc:493] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.584141  7710 raft_consensus.cc:3060] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:17.584342  7662 raft_consensus.cc:3060] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:17.543619  7695 leader_election.cc:290] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:17.588966  7561 consensus_queue.cc:237] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:17.583384  7507 raft_consensus.cc:2749] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:17.582998  7702 raft_consensus.cc:515] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:17.589499  7667 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:17.589649  7146 raft_consensus.cc:697] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 12 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:01:17.593397  7702 leader_election.cc:290] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:17.593611  7146 consensus_queue.cc:237] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:17.594980  7559 leader_election.cc:290] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:17.595263  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:01:17.576272  7544 raft_consensus.cc:2749] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 13:01:17.596714  7656 consensus_queue.cc:237] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:17.602502  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:17.608770  7419 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:17.618449  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:17.648932  7710 raft_consensus.cc:515] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:17.651232  7710 leader_election.cc:290] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:17.661823  1716 raft_consensus.cc:1240] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:17.668076  1615 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:17.673197  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:17.679886  7706 consensus_queue.cc:1059] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:01:17.684710  7731 log.cc:927] Time spent T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.102s	user 0.003s	sys 0.000s
W20260709 13:01:17.715579  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 188107us
I20260709 13:01:17.716395  1542 leader_election.cc:304] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:17.622004  7662 raft_consensus.cc:515] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:17.725119  1542 leader_election.cc:304] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:17.726341  1689 leader_election.cc:304] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 05476b84d8f84d76a9a1f51b620a3c66
I20260709 13:01:17.753839  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:17.645470  7712 consensus_queue.cc:1048] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.062s
I20260709 13:01:17.645975  7658 consensus_queue.cc:1059] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 13:01:17.763983  1689 leader_election.cc:304] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:17.701990  7710 raft_consensus.cc:2749] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 13:01:17.765872  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 50973.5us
I20260709 13:01:17.777407  1539 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:17.779150  1615 leader_election.cc:304] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:17.786718  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:01:17.787364  2332 raft_consensus.cc:3060] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:17.788096  1646 raft_consensus.cc:2393] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 13: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:01:17.759531  7154 raft_consensus.cc:2749] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:01:17.789505  7733 log.cc:927] Time spent T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.208s	user 0.004s	sys 0.000s
I20260709 13:01:17.775010  1466 catalog_manager.cc:5697] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:17.793363  7719 raft_consensus.cc:2749] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:17.762742  7280 raft_consensus.cc:2804] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:17.762917  7648 raft_consensus.cc:2804] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:17.809358  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:17.817806  2294 leader_election.cc:304] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:17.759907  7129 consensus_queue.cc:1048] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 13:01:17.821954  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:17.822937  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:17.803666  7280 raft_consensus.cc:493] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:17.844830  7280 raft_consensus.cc:3060] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:17.848870  7507 raft_consensus.cc:2804] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:17.849350  7507 raft_consensus.cc:493] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:17.849740  7507 raft_consensus.cc:3060] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:17.807297  7712 raft_consensus.cc:2749] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:01:17.842744  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 66381.2us
I20260709 13:01:17.827732  7648 raft_consensus.cc:697] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:01:17.840032  7716 raft_consensus.cc:3060] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:17.829362  7710 consensus_queue.cc:1048] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 13:01:17.866305  7436 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.895722  1615 leader_election.cc:304] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:17.920217  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
W20260709 13:01:17.910832  7737 log.cc:927] Time spent T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:01:17.927531  7658 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:17.908983  7436 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:01:17.994280  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 98668us
I20260709 13:01:17.965561  7662 leader_election.cc:290] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:17.998718  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:01:17.999675  2332 raft_consensus.cc:2468] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 13.
I20260709 13:01:17.949218  7648 consensus_queue.cc:237] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:17.966265  7658 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:18.001449  7617 raft_consensus.cc:2749] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:01:18.028697  7735 log.cc:927] Time spent T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
W20260709 13:01:18.017314  7736 log.cc:927] Time spent T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 13:01:18.036991  7734 log.cc:927] Time spent T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
W20260709 13:01:18.063755  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 69280.2us
I20260709 13:01:18.092906  7711 raft_consensus.cc:3055] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:01:18.093333  7711 raft_consensus.cc:740] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:01:18.094143  7711 consensus_queue.cc:260] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:18.101150  7280 raft_consensus.cc:515] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:18.103955  7436 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:18.106809  7610 raft_consensus.cc:3055] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:18.110174  7658 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:18.092306  7716 raft_consensus.cc:2749] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:01:18.127398  7419 consensus_meta.cc:287] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e: Time spent flushing consensus metadata: real 0.518s	user 0.007s	sys 0.003s
I20260709 13:01:18.107349  7610 raft_consensus.cc:740] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:01:18.133878  2323 raft_consensus.cc:2468] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 13.
W20260709 13:01:18.140985  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 131964us
W20260709 13:01:18.142755  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 70689.4us
I20260709 13:01:18.151953  1646 raft_consensus.cc:1240] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:18.153604  1647 raft_consensus.cc:1240] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:18.157586  2332 raft_consensus.cc:1275] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:01:18.162905  1572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:18.171022  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:18.172266  2332 raft_consensus.cc:2468] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 13.
I20260709 13:01:18.188971  1646 raft_consensus.cc:1240] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 19 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 18. Current term is 19. Ops: []
I20260709 13:01:18.191370  1615 leader_election.cc:304] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:18.163774  1572 raft_consensus.cc:2468] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 14.
I20260709 13:01:18.187186  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:18.206007  7695 consensus_queue.cc:1059] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:18.209411  7751 consensus_queue.cc:1048] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 13:01:18.210026  7573 consensus_queue.cc:1059] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:01:18.211268  7573 raft_consensus.cc:3055] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:18.211735  7610 consensus_queue.cc:260] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:18.214200  7610 raft_consensus.cc:3060] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:18.215874  1466 catalog_manager.cc:5697] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 15 to 18. New cstate: current_term: 18 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:18.201761  7749 raft_consensus.cc:2804] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:18.217558  7749 raft_consensus.cc:697] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 13 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:18.217762  1466 catalog_manager.cc:5697] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 12 to 13, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 13 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:18.218679  7749 consensus_queue.cc:237] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:18.211774  7573 raft_consensus.cc:740] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:01:18.221058  7573 consensus_queue.cc:260] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:18.222838  7573 raft_consensus.cc:3060] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:18.225553  7695 raft_consensus.cc:3055] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:18.226135  7695 raft_consensus.cc:740] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:01:18.226563  7280 leader_election.cc:290] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:18.227171  7695 consensus_queue.cc:260] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:18.236924  7507 raft_consensus.cc:515] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:01:18.237906  1541 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:18.239393  7711 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:18.219748  1466 catalog_manager.cc:5697] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 15 to 18, leader changed from 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 18 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
W20260709 13:01:18.263916  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 60371.3us
I20260709 13:01:18.262758  7696 raft_consensus.cc:493] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:18.282040  7696 raft_consensus.cc:515] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:18.282801  7507 leader_election.cc:290] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:18.288450  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:18.289129  1647 raft_consensus.cc:2468] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 16.
I20260709 13:01:18.300750  2325 raft_consensus.cc:1240] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 12. Current term is 13. Ops: []
W20260709 13:01:18.280972  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 87575.9us
I20260709 13:01:18.303987  1688 leader_election.cc:304] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:18.284327  7696 leader_election.cc:290] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:18.319489  7280 raft_consensus.cc:2804] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:18.327517  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:18.328066  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:18.328886  1569 raft_consensus.cc:2393] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 16: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:01:18.328171  1721 raft_consensus.cc:2468] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 17.
I20260709 13:01:18.331594  2331 raft_consensus.cc:1240] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Rejecting Update request from peer 0c7751452c4b46afa95251b9df7169d4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:18.331840  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:01:18.335497  1717 raft_consensus.cc:1240] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Rejecting Update request from peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 for earlier term 11. Current term is 12. Ops: []
I20260709 13:01:18.337344  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:18.268276  7695 raft_consensus.cc:3060] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:18.361673  1615 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:18.362561  7140 raft_consensus.cc:2804] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:01:18.362931  1615 leader_election.cc:304] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:18.365206  7660 raft_consensus.cc:2804] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:18.365743  7660 raft_consensus.cc:697] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 13 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:18.366623  7660 consensus_queue.cc:237] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:18.362982  7140 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:18.389026  7140 raft_consensus.cc:3060] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:18.402318  7681 raft_consensus.cc:493] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:18.402988  7681 raft_consensus.cc:515] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:18.405526  7681 leader_election.cc:290] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:18.322335  7280 raft_consensus.cc:493] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:18.406092  7280 raft_consensus.cc:3060] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:18.413249  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 70868.3us
I20260709 13:01:18.416779  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:18.417574  1718 raft_consensus.cc:2393] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 14: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:01:18.414131  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:01:18.430608  1542 leader_election.cc:304] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:18.449911  1466 catalog_manager.cc:5697] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 16 to 20. New cstate: current_term: 20 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:18.454124  7751 consensus_queue.cc:1059] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 13:01:18.468550  7751 raft_consensus.cc:3055] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:01:18.468928  7751 raft_consensus.cc:740] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:01:18.430938  1717 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:18.436926  7658 raft_consensus.cc:2804] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:18.451781  1466 catalog_manager.cc:5697] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 15 to 17, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 17 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:18.472878  7658 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:18.487847  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f964296f18474862b1eee102af9116f4" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:18.496507  2325 raft_consensus.cc:2468] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 14.
I20260709 13:01:18.509877  1615 leader_election.cc:304] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:18.495543  7658 raft_consensus.cc:3060] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:18.470908  7751 consensus_queue.cc:260] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:18.514417  1689 leader_election.cc:304] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:18.518184  7682 raft_consensus.cc:2804] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:01:18.560313  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 45968us
I20260709 13:01:18.566762  1617 leader_election.cc:304] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:18.550058  7612 raft_consensus.cc:2749] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:01:18.532390  7712 raft_consensus.cc:493] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.561863  7751 raft_consensus.cc:3060] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:18.561225  7682 raft_consensus.cc:697] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 14 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
W20260709 13:01:18.606596  1472 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55626 (request call id 257) took 80593 ms (client timeout 15000 ms). Trace:
W20260709 13:01:18.608449  1472 rpcz_store.cc:269] 0709 12:59:58.003437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:59:58.056756 (+ 53319us) service_pool.cc:224] Handling call
0709 12:59:58.499622 (+442866us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b5400002490. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef297640 00007fa9f816eb76 00007fa9f8278c3e 00007fa9f67392a4 00007fa9f6739232 00007fa9f6739161 00007fa9f67390dc 00007fa9f6738392 00007fa9f06f648c 00007fa9f06f58c6
0709 13:01:18.587344 (+80087722us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1202403,"reported_tablets":47,"spinlock_wait_cycles":26799872}
I20260709 13:01:18.582316  7660 raft_consensus.cc:2749] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:18.610323  7140 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:18.665228  7140 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 15 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
W20260709 13:01:18.662029  7750 log.cc:927] Time spent T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:01:18.558808  1466 catalog_manager.cc:5697] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 13 to 16, leader changed from 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 16 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:01:18.670234  7280 raft_consensus.cc:515] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:18.670667  1466 catalog_manager.cc:5697] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 7 to 13, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 13 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:18.586915  7712 raft_consensus.cc:515] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:18.674324  7712 leader_election.cc:290] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:18.685032  7682 consensus_queue.cc:237] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:18.690677  2325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:01:18.691295  2325 raft_consensus.cc:3060] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Advancing to term 15
I20260709 13:01:18.695272  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:18.702142  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:18.706872  1643 raft_consensus.cc:2468] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 16.
I20260709 13:01:18.708884  2325 raft_consensus.cc:2468] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 15.
I20260709 13:01:18.711200  1688 leader_election.cc:304] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:18.717921  1615 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:18.686692  7280 leader_election.cc:290] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 16 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:18.720429  7710 raft_consensus.cc:2804] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:18.721081  7710 raft_consensus.cc:697] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 15 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:18.721832  7710 consensus_queue.cc:237] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:18.725811  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:18.724977  7717 raft_consensus.cc:2804] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:18.730299  1719 raft_consensus.cc:1275] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:01:18.746263  7717 raft_consensus.cc:697] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 16 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:01:18.759622  7717 consensus_queue.cc:237] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:18.763887  7658 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:18.672433  1466 catalog_manager.cc:5697] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:01:18.813112  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 72552.1us
I20260709 13:01:18.831496  7573 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:18.832453  1576 raft_consensus.cc:1240] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 18 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 17. Current term is 18. Ops: []
I20260709 13:01:18.832820  7573 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:18.814256  7648 consensus_queue.cc:1048] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:01:18.808063  1647 raft_consensus.cc:1275] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:01:18.848220  1466 catalog_manager.cc:5697] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 10 to 11, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 11 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:18.855255  1574 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:18.858683  1574 raft_consensus.cc:2393] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 16: Already voted for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in this term.
I20260709 13:01:18.861186  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:18.860901  1466 catalog_manager.cc:5697] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 17 to 18, leader changed from 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 18 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:01:18.862321  1570 raft_consensus.cc:3060] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:01:18.883363  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 61600.4us
I20260709 13:01:18.911329  7648 consensus_queue.cc:1048] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:01:18.900465  7658 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 18 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:01:18.917438  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 44159.3us
I20260709 13:01:18.863670  1466 catalog_manager.cc:5697] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 8 to 14, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 14 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:01:18.933771  1466 catalog_manager.cc:5697] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:18.913702  7573 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:18.942406  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:18.943461  1643 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 13.
I20260709 13:01:18.968652  2325 raft_consensus.cc:1275] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:18.975440  2327 raft_consensus.cc:1275] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:01:19.000422  7683 consensus_queue.cc:1059] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:19.001482  7683 raft_consensus.cc:3055] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 17 LEADER]: Stepping down as leader of term 17
I20260709 13:01:19.001925  7683 raft_consensus.cc:740] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:19.003206  7683 consensus_queue.cc:260] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:19.007131  7706 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:19.007987  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 46321.5us
I20260709 13:01:19.007606  7683 raft_consensus.cc:3060] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:18.938062  1466 catalog_manager.cc:5697] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 14 to 15, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 15 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:19.021798  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:19.023828  1567 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 13.
I20260709 13:01:19.018519  7706 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:19.039021  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:19.039958  1646 raft_consensus.cc:2410] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:01:19.042579  7706 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:19.048113  1570 raft_consensus.cc:2468] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 15.
I20260709 13:01:19.053757  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:19.054782  1718 raft_consensus.cc:2410] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 for term 14 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 13:01:19.058218  1689 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:19.059337  2297 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:19.061055  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:19.059628  7696 raft_consensus.cc:2804] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:19.061810  2332 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 13.
I20260709 13:01:19.061968  7696 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:19.062417  7696 raft_consensus.cc:3060] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:19.058640  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:19.061148  1542 leader_election.cc:304] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:19.068233  7658 raft_consensus.cc:2749] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:19.070147  1567 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 13.
I20260709 13:01:19.071908  7706 raft_consensus.cc:2749] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:19.073513  1466 catalog_manager.cc:5697] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 10 to 11, leader changed from 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 11 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:01:19.079479  1466 catalog_manager.cc:5697] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:19.085214  1466 catalog_manager.cc:5697] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:19.086560  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:19.087404  1466 catalog_manager.cc:5697] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:19.090727  1466 catalog_manager.cc:5697] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:19.114239  7660 consensus_queue.cc:1048] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:01:19.116174  1722 raft_consensus.cc:1275] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260709 13:01:19.119656  1722 pending_rounds.cc:85] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4: Aborting all ops after (but not including) 10
I20260709 13:01:19.124321  7129 consensus_queue.cc:1048] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:01:19.122157  1722 pending_rounds.cc:107] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260709 13:01:19.128878  1722 raft_consensus.cc:2889] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:19.131361  7694 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.132004  7694 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:19.103348  1466 catalog_manager.cc:5697] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 8 to 11, leader changed from 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 11 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:01:19.146862  7694 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:19.116174  7696 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:19.150053  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:19.150818  1642 raft_consensus.cc:2468] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 19.
I20260709 13:01:19.152182  2294 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:19.153343  7584 raft_consensus.cc:2804] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:01:19.153564  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:19.153843  7584 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:19.155072  7584 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:19.154237  1642 raft_consensus.cc:3060] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:19.161748  1646 raft_consensus.cc:2468] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 18.
I20260709 13:01:19.163236  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:19.164146  1567 raft_consensus.cc:2468] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 18.
I20260709 13:01:19.168715  7711 raft_consensus.cc:493] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:19.169473  7711 raft_consensus.cc:515] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:19.175910  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:19.176620  2327 raft_consensus.cc:2468] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 12.
I20260709 13:01:19.179334  1540 leader_election.cc:304] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:19.180199  7648 raft_consensus.cc:2804] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:19.180641  7648 raft_consensus.cc:493] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:19.181035  7648 raft_consensus.cc:3060] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:19.186550  7711 leader_election.cc:290] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:19.192608  1649 raft_consensus.cc:1275] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:01:19.195570  7726 consensus_queue.cc:1048] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:19.197068  7696 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:19.196943  7648 raft_consensus.cc:515] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:19.203573  1642 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 14.
I20260709 13:01:19.211216  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:01:19.209829  7648 leader_election.cc:290] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 election: Requested vote from peers 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:19.234206   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:19.235610  7696 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:19.246058  1725 raft_consensus.cc:1275] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 9. (term mismatch)
I20260709 13:01:19.246493  1725 pending_rounds.cc:85] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4: Aborting all ops after (but not including) 8
I20260709 13:01:19.246759  1725 pending_rounds.cc:107] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4: Aborting uncommitted NO_OP operation due to leader change: 12.9
I20260709 13:01:19.246989  1725 raft_consensus.cc:2889] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:01:19.260727  7696 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:19.262992  7696 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:19.264163  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:19.264945  1647 raft_consensus.cc:2393] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 19: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:01:19.267472  2327 raft_consensus.cc:2468] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 12.
I20260709 13:01:19.268828  1540 leader_election.cc:304] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:19.272723  7648 raft_consensus.cc:2804] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:19.273499  7648 raft_consensus.cc:697] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:01:19.274556  7648 consensus_queue.cc:237] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:19.282492  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:19.297464  1718 raft_consensus.cc:1275] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:19.299968  7584 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:19.306648  7696 raft_consensus.cc:493] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.309784  1567 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:19.310037  7584 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 20 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:19.310395  1567 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 18 FOLLOWER]: Advancing to term 20
I20260709 13:01:19.307828  7696 raft_consensus.cc:515] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:19.320272  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:19.320915  1642 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:19.326375  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:19.327310  1719 raft_consensus.cc:2393] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 12: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:01:19.328411  1570 raft_consensus.cc:1275] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:01:19.330168  2323 raft_consensus.cc:1275] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:01:19.330920  7711 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:19.331508  7711 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:19.338173  1642 raft_consensus.cc:2468] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 20.
I20260709 13:01:19.345861  1539 leader_election.cc:304] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:19.348819  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:19.349776  1719 raft_consensus.cc:2393] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in current term 12: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:01:19.350512  7751 raft_consensus.cc:2804] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:19.356017  7420 consensus_queue.cc:1048] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:19.361259  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:19.361867  1569 raft_consensus.cc:3060] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:19.334774  7711 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:19.369180  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e94ee9035214526808abfaab11799fe" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:01:19.369903  2323 raft_consensus.cc:3060] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:19.373066  2327 raft_consensus.cc:1275] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 13:01:19.379016  2323 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 14.
I20260709 13:01:19.381505  2294 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:19.393739  1567 raft_consensus.cc:2468] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 20.
I20260709 13:01:19.401225  1719 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:19.402055  1719 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 18.
I20260709 13:01:19.403273  7499 raft_consensus.cc:2804] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:01:19.403890  7499 raft_consensus.cc:697] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 20 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:01:19.404855  7499 consensus_queue.cc:237] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:19.408829  1570 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:19.409502  1570 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 19.
I20260709 13:01:19.412774  7660 consensus_queue.cc:1048] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:19.414320  7220 consensus_queue.cc:1048] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:19.417399  1689 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:19.418581  1569 raft_consensus.cc:2468] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 14.
I20260709 13:01:19.436666  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:19.437374  1643 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 19.
I20260709 13:01:19.433032  7220 consensus_queue.cc:1048] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 13:01:19.441279  7710 consensus_queue.cc:1048] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 13:01:19.443202  7667 consensus_queue.cc:1048] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:19.447058  7709 raft_consensus.cc:2804] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:19.447710  7709 raft_consensus.cc:697] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 14 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:01:19.458698  7751 raft_consensus.cc:697] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 18 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:01:19.482578  1542 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:19.501457  1569 raft_consensus.cc:1275] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:01:19.504379  7696 leader_election.cc:290] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:19.507292  7648 raft_consensus.cc:2804] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:01:19.507951  7648 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:01:19.511307  1539 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 161905us
I20260709 13:01:19.448949  7709 consensus_queue.cc:237] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:19.508420  7648 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:19.565114  7648 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:19.571753  7648 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 20 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:01:19.589687  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 172348us
I20260709 13:01:19.576143  7751 consensus_queue.cc:237] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:01:19.660871  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 55182.7us
I20260709 13:01:19.690162  1689 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 4dbe7d47a2374afca075d3a98583b49e
W20260709 13:01:19.712826  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 96156.3us
I20260709 13:01:19.724654  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:19.729233  7696 raft_consensus.cc:2804] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:19.729728  7696 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:19.730134  7696 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:19.734668  7785 consensus_queue.cc:1048] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:19.750520  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:19.816416  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:19.818316  1647 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 19 FOLLOWER]: Advancing to term 20
W20260709 13:01:19.821533  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 111220us
I20260709 13:01:19.848052  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:19.853382  1567 raft_consensus.cc:1275] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 20 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:01:19.855232  7584 consensus_queue.cc:1048] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 13:01:19.825445  7696 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:19.867980  1721 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:19.872418  1647 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 20.
W20260709 13:01:19.885059  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 180730us
I20260709 13:01:19.889685  7696 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 19 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:19.922226  7163 raft_consensus.cc:493] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:19.922806  7163 raft_consensus.cc:515] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:19.926898  1539 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:19.929059  7163 leader_election.cc:290] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:19.931964  7711 raft_consensus.cc:2804] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 20 FOLLOWER]: Leader election won for term 20
W20260709 13:01:19.911751  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 204822us
I20260709 13:01:19.932672  7711 raft_consensus.cc:697] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 20 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:01:19.946446  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:19.945012  1649 raft_consensus.cc:1275] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 20 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 13:01:19.947204  1642 raft_consensus.cc:2368] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 19. Current term is 20.
I20260709 13:01:19.946908  7711 consensus_queue.cc:237] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:19.955837  1721 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 20.
I20260709 13:01:19.959270  1575 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:19.960088  1575 raft_consensus.cc:2468] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 12.
I20260709 13:01:19.983906  2327 raft_consensus.cc:1275] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:01:19.986334  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 62395.6us
I20260709 13:01:19.988293  1718 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:19.996423  1689 leader_election.cc:304] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:20.000228  1688 leader_election.cc:400] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 19 election: Vote denied by peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391) with higher term. Message: Invalid argument: T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 19. Current term is 20.
I20260709 13:01:20.000674  1688 leader_election.cc:403] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260709 13:01:20.001365  7799 raft_consensus.cc:2749] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391) with higher term. Message: Invalid argument: T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 for earlier term 19. Current term is 20.
I20260709 13:01:20.001822  1571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:20.012084  2295 leader_election.cc:304] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:20.024344  2323 raft_consensus.cc:1275] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:01:20.026750  7784 consensus_queue.cc:1048] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 13:01:20.032833  1723 raft_consensus.cc:1275] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:01:19.989974  7706 consensus_queue.cc:1048] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.048s
I20260709 13:01:20.040055  7648 consensus_queue.cc:1048] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 13:01:20.049769  7804 raft_consensus.cc:2804] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:20.050266  7658 consensus_queue.cc:1048] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:01:20.050460  7804 raft_consensus.cc:493] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:20.051306  7804 raft_consensus.cc:3060] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:20.050640  1718 raft_consensus.cc:2393] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 12: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:01:20.042701  7785 raft_consensus.cc:2749] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:20.118204  1649 raft_consensus.cc:1275] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:01:20.127264  7146 consensus_queue.cc:1048] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:20.130849  1573 raft_consensus.cc:1275] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:01:20.136260  1716 raft_consensus.cc:3060] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:20.139926  7726 consensus_queue.cc:1048] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:01:20.164842  7821 log.cc:927] Time spent T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:01:20.168947  1649 raft_consensus.cc:1275] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 18 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:01:20.176210  7787 consensus_queue.cc:1048] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:20.204327  1716 raft_consensus.cc:1275] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 18 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 13:01:20.240639  7658 consensus_queue.cc:1048] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:01:20.260317  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 248285us
I20260709 13:01:20.238700  7804 raft_consensus.cc:515] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:20.271975  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:20.272764  1720 raft_consensus.cc:2393] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 05476b84d8f84d76a9a1f51b620a3c66 in current term 12: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:01:20.270821  7804 leader_election.cc:290] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:20.289111  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:20.319787  1568 raft_consensus.cc:2468] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 12.
I20260709 13:01:20.321033  2295 leader_election.cc:304] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:20.324391  7559 raft_consensus.cc:2804] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:01:20.325232  7559 raft_consensus.cc:697] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:01:20.326264  7559 consensus_queue.cc:237] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:20.418646  2323 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c"
dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
mode: GRACEFUL
new_leader_uuid: "4dbe7d47a2374afca075d3a98583b49e"
 from {username='slave'} at 127.0.0.1:39778
I20260709 13:01:20.419498  2323 raft_consensus.cc:606] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Received request to transfer leadership to TS 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:20.419884  2323 raft_consensus.cc:614] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:20.435182  2323 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c"
dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
mode: GRACEFUL
new_leader_uuid: "4dbe7d47a2374afca075d3a98583b49e"
 from {username='slave'} at 127.0.0.1:39778
I20260709 13:01:20.435803  2323 raft_consensus.cc:606] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 18 LEADER]: Received request to transfer leadership to TS 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:20.452075  2323 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e94ee9035214526808abfaab11799fe"
dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
mode: GRACEFUL
new_leader_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:39778
I20260709 13:01:20.452759  2323 raft_consensus.cc:606] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Received request to transfer leadership to TS 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:20.453104  2323 raft_consensus.cc:614] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:20.455724  1568 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bbdad022d10c452fb5c104373d7cd035"
dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
mode: GRACEFUL
new_leader_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:49396
I20260709 13:01:20.456259  1568 raft_consensus.cc:606] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Received request to transfer leadership to TS 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:20.457039  1568 raft_consensus.cc:614] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:20.460922  2323 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260"
dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
mode: GRACEFUL
new_leader_uuid: "4dbe7d47a2374afca075d3a98583b49e"
 from {username='slave'} at 127.0.0.1:39778
I20260709 13:01:20.461467  2323 raft_consensus.cc:606] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 20 LEADER]: Received request to transfer leadership to TS 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:20.463935  2323 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b"
dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
mode: GRACEFUL
new_leader_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:39778
I20260709 13:01:20.464444  2323 raft_consensus.cc:606] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 LEADER]: Received request to transfer leadership to TS 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:20.465662   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:01:20.468544   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:20.521381  1722 raft_consensus.cc:1275] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 20 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:01:20.522845  7711 consensus_queue.cc:1048] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:01:20.539451  1646 raft_consensus.cc:1275] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 20 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 13:01:20.540920  7711 consensus_queue.cc:1048] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:20.547226  1470 catalog_manager.cc:5697] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } }
I20260709 13:01:20.550287  1470 catalog_manager.cc:5697] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:20.552816  1470 catalog_manager.cc:5697] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 9 to 14, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 14 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } }
I20260709 13:01:20.569422  1466 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48478 (request call id 179) took 4122 ms. Trace:
I20260709 13:01:20.584513  2323 consensus_queue.cc:237] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:20.602067  1470 catalog_manager.cc:5697] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 10 to 11, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 11 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } }
I20260709 13:01:20.614562  1470 catalog_manager.cc:5697] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:20.637989  1568 raft_consensus.cc:1275] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:01:20.645756  1470 catalog_manager.cc:5697] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 10 to 12, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 12 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:20.647680  1470 catalog_manager.cc:5697] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 5 to 8, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 8 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } }
I20260709 13:01:20.651196  1649 raft_consensus.cc:1275] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 13:01:20.649204  1470 catalog_manager.cc:5697] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 11 to 13, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 13 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } }
I20260709 13:01:20.655222  1470 catalog_manager.cc:5697] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 5 to 10, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 10 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } }
I20260709 13:01:20.667991  1470 catalog_manager.cc:5697] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 8 to 9, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 9 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } }
I20260709 13:01:20.569911  1466 rpcz_store.cc:276] 0709 13:01:16.447077 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:16.448910 (+  1833us) service_pool.cc:224] Handling call
0709 13:01:20.569308 (+4120398us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:19.487091 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:19.487779 (+   688us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:19.487833 (+    54us) write_op.cc:435] Acquired schema lock
0709 13:01:19.487867 (+    34us) tablet.cc:662] Decoding operations
0709 13:01:19.505125 (+ 17258us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:19.505229 (+   104us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:19.505261 (+    32us) tablet.cc:685] Acquiring locks for 20 operations
0709 13:01:19.507011 (+  1750us) tablet.cc:701] Row locks acquired
0709 13:01:19.507066 (+    55us) write_op.cc:260] PREPARE: finished
0709 13:01:19.507280 (+   214us) write_op.cc:270] Start()
0709 13:01:19.507458 (+   178us) write_op.cc:276] Timestamp: P: 1783602079507207 usec, L: 0
0709 13:01:19.507503 (+    45us) op_driver.cc:348] REPLICATION: starting
0709 13:01:19.508444 (+   941us) log.cc:844] Serialized 7877 byte log entry
0709 13:01:20.062088 (+553644us) op_driver.cc:464] REPLICATION: finished
0709 13:01:20.232995 (+170907us) write_op.cc:301] APPLY: starting
0709 13:01:20.233095 (+   100us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:20.309260 (+ 76165us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:20.309380 (+   120us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:20.388176 (+ 78796us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:20.388597 (+   421us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=40,key_file_lookups=40,delta_file_lookups=40,mrs_lookups=0
0709 13:01:20.388655 (+    58us) write_op.cc:312] APPLY: finished
0709 13:01:20.389106 (+   451us) log.cc:844] Serialized 180 byte log entry
0709 13:01:20.389318 (+   212us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:20.389499 (+   181us) write_op.cc:454] Released schema lock
0709 13:01:20.389567 (+    68us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:20.459818 (+ 70251us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:20.459853 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":802332,"reported_tablets":33,"child_traces":[["op",{"apply.queue_time_us":170585,"apply.run_cpu_time_us":25361,"apply.run_wall_time_us":226807,"cfile_cache_hit":82,"cfile_cache_hit_bytes":87727,"num_ops":20,"prepare.queue_time_us":196676,"prepare.run_cpu_time_us":20444,"prepare.run_wall_time_us":153554,"raft.queue_time_us":180229,"raft.run_cpu_time_us":12020,"raft.run_wall_time_us":236239,"replication_time_us":534991,"thread_start_us":476057,"threads_started":4,"wal-append.queue_time_us":235089}]]}
I20260709 13:01:20.669363  7716 consensus_queue.cc:1048] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 13:01:20.672509  7559 consensus_queue.cc:1048] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:20.679072  1470 catalog_manager.cc:5697] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 10 to 11, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 11 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } }
W20260709 13:01:20.694965  7839 log.cc:927] Time spent T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:01:20.722739  1568 raft_consensus.cc:1275] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:01:20.724462  7716 consensus_queue.cc:1048] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:20.744542  7559 raft_consensus.cc:2955] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 LEADER]: Committing config change with OpId 16.12: config changed from index 6 to 12, VOTER 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:01:20.754628  1571 raft_consensus.cc:2955] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 6 to 12, VOTER 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:01:20.778179  7806 raft_consensus.cc:993] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66: : Instructing follower 4dbe7d47a2374afca075d3a98583b49e to start an election
I20260709 13:01:20.778872  7806 raft_consensus.cc:1081] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 20 LEADER]: Signalling peer 4dbe7d47a2374afca075d3a98583b49e to start an election
I20260709 13:01:20.783821  1649 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260"
dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
 from {username='slave'} at 127.0.0.1:57912
I20260709 13:01:20.787900  1649 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:20.788321  1649 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:20.807929  1649 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:20.880445  1721 raft_consensus.cc:1275] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
W20260709 13:01:20.902043  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 55648us
I20260709 13:01:20.914614  1649 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 21 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:20.916869  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: true dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:20.917585  1569 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:20.925114  1569 raft_consensus.cc:2468] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 21.
I20260709 13:01:20.928016  1459 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 216561bf1aef403280c36c1e716ca3ad with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:01:20.928875  1642 raft_consensus.cc:2955] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Committing config change with OpId 16.12: config changed from index 6 to 12, VOTER 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
W20260709 13:01:20.989094  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 54796.2us
I20260709 13:01:20.973109  7559 consensus_queue.cc:1048] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.020s
W20260709 13:01:21.056208  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 143181us
I20260709 13:01:21.079475  1615 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:21.082427  7855 raft_consensus.cc:2804] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:01:21.083142  7855 raft_consensus.cc:697] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 21 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:21.094854  7845 raft_consensus.cc:493] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:21.096886  7845 raft_consensus.cc:515] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:01:21.106578  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 48298.3us
I20260709 13:01:21.084203  7855 consensus_queue.cc:237] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:21.144124  7845 leader_election.cc:290] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:21.153553  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e66a330b7dae4036b80d239969d5a260" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: true dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:01:21.154275  2323 raft_consensus.cc:3055] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 13:01:21.154600  2323 raft_consensus.cc:740] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:01:21.155328  2323 consensus_queue.cc:260] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:21.165720  2323 raft_consensus.cc:3060] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:21.200892  2326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:21.203474  1568 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091ce8e86e49437b8fffb903bd5ce2fb" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:21.203048  2323 raft_consensus.cc:2468] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 21.
W20260709 13:01:21.219110  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 109081us
W20260709 13:01:21.217756  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 121575us
W20260709 13:01:21.317759  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 97023.4us
W20260709 13:01:21.470103  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 187394us
I20260709 13:01:21.490288   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:21.505045  7851 raft_consensus.cc:993] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66: : Instructing follower 4dbe7d47a2374afca075d3a98583b49e to start an election
I20260709 13:01:21.505751  7851 raft_consensus.cc:1081] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 18 LEADER]: Signalling peer 4dbe7d47a2374afca075d3a98583b49e to start an election
W20260709 13:01:21.573146  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 90053us
I20260709 13:01:21.613597  7806 raft_consensus.cc:993] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66: : Instructing follower 0c7751452c4b46afa95251b9df7169d4 to start an election
I20260709 13:01:21.614208  7806 raft_consensus.cc:1081] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 LEADER]: Signalling peer 0c7751452c4b46afa95251b9df7169d4 to start an election
I20260709 13:01:21.629122  1722 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b"
dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:58782
I20260709 13:01:21.629762  1722 raft_consensus.cc:493] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:21.630187  1722 raft_consensus.cc:3060] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:21.654960  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 62070.5us
I20260709 13:01:21.667892  1689 leader_election.cc:304] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:21.692131  1646 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c"
dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
 from {username='slave'} at 127.0.0.1:57912
I20260709 13:01:21.692842  1646 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:21.693250  1646 raft_consensus.cc:3060] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:21.702853  1466 catalog_manager.cc:5697] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 18 to 20, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 20 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:21.709040  1466 catalog_manager.cc:5697] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 13 to 14, leader changed from 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 14 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:01:21.699627  7845 raft_consensus.cc:2749] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:21.716001  1646 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:21.716001  1722 raft_consensus.cc:515] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:21.732318  1646 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 19 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:21.736238  1722 leader_election.cc:290] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:21.765496  1649 raft_consensus.cc:1240] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 19 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 18. Current term is 19. Ops: []
I20260709 13:01:21.785063  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:21.785784  1573 raft_consensus.cc:3060] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:21.792876  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fa306a802914bb9b8d54b7bfe53009c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:01:21.793736  2332 raft_consensus.cc:3055] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:01:21.794152  2332 raft_consensus.cc:740] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:01:21.795084  2332 consensus_queue.cc:260] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:21.796324  2332 raft_consensus.cc:3060] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:21.803898  2332 raft_consensus.cc:2468] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 19.
I20260709 13:01:21.810103  2323 raft_consensus.cc:1275] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 21 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:01:21.825836  1466 catalog_manager.cc:5697] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 10 to 15, leader changed from 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 15 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:01:21.829125  1466 catalog_manager.cc:5697] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 9 to 10, leader changed from 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 10 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:01:21.830909  1466 catalog_manager.cc:5697] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 7 to 16, leader changed from 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 16 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:01:21.835042  1466 catalog_manager.cc:5697] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 9 to 10, leader changed from 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 10 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:01:21.837205  1466 catalog_manager.cc:5697] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 11 to 13, leader changed from 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 13 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:01:21.821836  1615 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:21.844182  7866 raft_consensus.cc:2804] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:01:21.844878  7873 consensus_queue.cc:1048] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:01:21.845705  7866 raft_consensus.cc:697] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 19 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:21.846730  7866 consensus_queue.cc:237] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:21.849211  1573 raft_consensus.cc:2468] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 19.
I20260709 13:01:21.894021  1716 raft_consensus.cc:1240] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Rejecting Update request from peer 05476b84d8f84d76a9a1f51b620a3c66 for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:21.895684  7806 consensus_queue.cc:1059] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:21.896790  7806 raft_consensus.cc:3055] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:21.897240  7806 raft_consensus.cc:740] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:01:21.898216  7806 consensus_queue.cc:260] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:21.899667  7806 raft_consensus.cc:3060] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:21.838852  1466 catalog_manager.cc:5697] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:01:21.909435  1574 raft_consensus.cc:1275] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 21 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 13:01:21.913873  7873 consensus_queue.cc:1048] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 13:01:21.933115  1466 catalog_manager.cc:5697] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 9 to 14, leader changed from 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 14 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:01:21.945701  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
I20260709 13:01:21.945955  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8c04e2c99384254b275d20e6d27467b" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:01:21.946445  1573 raft_consensus.cc:3060] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:21.957653  2323 raft_consensus.cc:2468] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 13.
I20260709 13:01:21.958211  1573 raft_consensus.cc:2468] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 13.
I20260709 13:01:21.936307  1466 catalog_manager.cc:5697] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 10 to 11, leader changed from 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 11 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:01:21.963052  1466 catalog_manager.cc:5697] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 9 to 12, leader changed from 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 12 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
W20260709 13:01:21.986102  1470 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55606 (request call id 273) took 28968 ms (client timeout 15000 ms). Trace:
W20260709 13:01:21.986630  1470 rpcz_store.cc:269] 0709 13:00:53.017043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:53.017308 (+   265us) service_pool.cc:224] Handling call
0709 13:01:21.985773 (+28968465us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:20.791247 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:20.910198 (+118951us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:20.914341 (+  4143us) write_op.cc:435] Acquired schema lock
0709 13:01:20.926039 (+ 11698us) tablet.cc:662] Decoding operations
0709 13:01:21.078193 (+152154us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:21.078252 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:21.078277 (+    25us) tablet.cc:685] Acquiring locks for 11 operations
0709 13:01:21.079221 (+   944us) tablet.cc:701] Row locks acquired
0709 13:01:21.079240 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:01:21.079373 (+   133us) write_op.cc:270] Start()
0709 13:01:21.079477 (+   104us) write_op.cc:276] Timestamp: P: 1783602081079330 usec, L: 0
0709 13:01:21.079495 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:01:21.080150 (+   655us) log.cc:844] Serialized 4418 byte log entry
0709 13:01:21.117945 (+ 37795us) op_driver.cc:464] REPLICATION: finished
0709 13:01:21.233350 (+115405us) write_op.cc:301] APPLY: starting
0709 13:01:21.233438 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:21.345336 (+111898us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:21.345476 (+   140us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:21.590793 (+245317us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:21.597608 (+  6815us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 13:01:21.624645 (+ 27037us) write_op.cc:312] APPLY: finished
0709 13:01:21.624991 (+   346us) log.cc:844] Serialized 105 byte log entry
0709 13:01:21.625178 (+   187us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:21.625318 (+   140us) write_op.cc:454] Released schema lock
0709 13:01:21.625368 (+    50us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:21.625809 (+   441us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:21.625840 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1100,"reported_tablets":49,"spinlock_wait_cycles":769920,"child_traces":[["op",{"apply.queue_time_us":115098,"apply.run_cpu_time_us":19729,"apply.run_wall_time_us":392408,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50107,"num_ops":11,"prepare.queue_time_us":36992,"prepare.run_cpu_time_us":5003,"prepare.run_wall_time_us":318779,"replication_time_us":38259,"thread_start_us":104895,"threads_started":2}]]}
I20260709 13:01:22.000981  1466 catalog_manager.cc:5697] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 9 to 11, leader changed from 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 11 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:01:22.005601  1466 catalog_manager.cc:5697] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 5 to 13, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 13 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:01:22.006714  1466 catalog_manager.cc:5697] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 9 to 15, leader changed from 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 15 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:01:22.009295  1689 leader_election.cc:304] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:22.010128  7887 raft_consensus.cc:2804] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:22.010659  7887 raft_consensus.cc:697] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 13 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:01:22.011720  7887 consensus_queue.cc:237] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:22.017908  1466 catalog_manager.cc:5697] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:22.143883  7887 raft_consensus.cc:493] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 05476b84d8f84d76a9a1f51b620a3c66)
I20260709 13:01:22.144570  7887 raft_consensus.cc:515] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:22.155989  7887 leader_election.cc:290] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:22.157831  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:22.158921  1573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" is_pre_election: true
I20260709 13:01:22.170572  1688 leader_election.cc:304] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:22.177091  7887 raft_consensus.cc:2749] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:22.165582  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "216561bf1aef403280c36c1e716ca3ad" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:22.314706  1466 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:48478 (request call id 180) took 1570 ms. Trace:
I20260709 13:01:22.315137  1466 rpcz_store.cc:276] 0709 13:01:20.743942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:20.744145 (+   203us) service_pool.cc:224] Handling call
0709 13:01:22.314611 (+1570466us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:22.081356 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:22.090512 (+  9156us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:22.091840 (+  1328us) write_op.cc:435] Acquired schema lock
0709 13:01:22.096569 (+  4729us) tablet.cc:662] Decoding operations
0709 13:01:22.097971 (+  1402us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:22.112653 (+ 14682us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:22.112688 (+    35us) tablet.cc:685] Acquiring locks for 15 operations
0709 13:01:22.121496 (+  8808us) tablet.cc:701] Row locks acquired
0709 13:01:22.121518 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:01:22.121690 (+   172us) write_op.cc:270] Start()
0709 13:01:22.121819 (+   129us) write_op.cc:276] Timestamp: P: 1783602082121622 usec, L: 0
0709 13:01:22.121844 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 13:01:22.122617 (+   773us) log.cc:844] Serialized 5962 byte log entry
0709 13:01:22.184211 (+ 61594us) op_driver.cc:464] REPLICATION: finished
0709 13:01:22.196897 (+ 12686us) write_op.cc:301] APPLY: starting
0709 13:01:22.196998 (+   101us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:22.222474 (+ 25476us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:22.222577 (+   103us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:22.242306 (+ 19729us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:22.242590 (+   284us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=30,mrs_lookups=0
0709 13:01:22.242635 (+    45us) write_op.cc:312] APPLY: finished
0709 13:01:22.242969 (+   334us) log.cc:844] Serialized 139 byte log entry
0709 13:01:22.243176 (+   207us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:22.243337 (+   161us) write_op.cc:454] Released schema lock
0709 13:01:22.243390 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:22.243811 (+   421us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:22.243846 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":167442,"reported_tablets":19,"spinlock_wait_cycles":1792,"child_traces":[["op",{"apply.queue_time_us":12411,"apply.run_cpu_time_us":20738,"apply.run_wall_time_us":46888,"cfile_cache_hit":62,"cfile_cache_hit_bytes":66827,"num_ops":15,"prepare.queue_time_us":44617,"prepare.run_cpu_time_us":5430,"prepare.run_wall_time_us":55488,"replication_time_us":62208,"spinlock_wait_cycles":5376,"thread_start_us":31947,"threads_started":2}]]}
I20260709 13:01:22.320037  1467 catalog_manager.cc:5697] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 11 to 12, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 12 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } }
I20260709 13:01:22.325650  1467 catalog_manager.cc:5697] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } }
I20260709 13:01:22.327937  1467 catalog_manager.cc:5697] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 4 to 12. New cstate: current_term: 12 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } }
I20260709 13:01:22.352638  1467 catalog_manager.cc:5697] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 14 to 15, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 15 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } }
I20260709 13:01:22.361613  1467 catalog_manager.cc:5697] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 12 to 15, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 15 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } }
I20260709 13:01:22.365510  1467 catalog_manager.cc:5697] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 7 to 15, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 15 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:22.369623  1467 catalog_manager.cc:5697] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:22.373456  1467 catalog_manager.cc:5697] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:22.376682  1467 catalog_manager.cc:5697] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 8 to 12, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 12 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:22.455515  2323 raft_consensus.cc:1275] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 19 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:01:22.460070  7805 consensus_queue.cc:1048] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:01:22.504060  1573 raft_consensus.cc:1275] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 19 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 13:01:22.512406  7884 consensus_queue.cc:1048] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 13:01:22.544776  1471 catalog_manager.cc:5697] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 14 to 15, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 15 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:22.547511  1471 catalog_manager.cc:5697] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 10 to 15, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 15 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } }
I20260709 13:01:22.549594  1471 catalog_manager.cc:5697] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:22.571668  1569 raft_consensus.cc:1275] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:01:22.576509  7887 consensus_queue.cc:1048] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:01:22.594637  2323 raft_consensus.cc:1275] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:01:22.601044  7844 consensus_queue.cc:1048] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:22.603071  1467 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55626 (request call id 260) took 9771 ms. Trace:
I20260709 13:01:22.602937  1471 catalog_manager.cc:5697] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:22.612936  1471 catalog_manager.cc:5697] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 10 to 16, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 16 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } }
I20260709 13:01:22.628391  1471 catalog_manager.cc:5697] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 9 to 14, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 14 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:22.603492  1467 rpcz_store.cc:276] 0709 13:01:12.831550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:12.876900 (+ 45350us) service_pool.cc:224] Handling call
0709 13:01:22.602986 (+9726086us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:22.386243 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:22.386811 (+   568us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:22.386851 (+    40us) write_op.cc:435] Acquired schema lock
0709 13:01:22.386865 (+    14us) tablet.cc:662] Decoding operations
0709 13:01:22.387807 (+   942us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:22.387862 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:22.387889 (+    27us) tablet.cc:685] Acquiring locks for 9 operations
0709 13:01:22.388632 (+   743us) tablet.cc:701] Row locks acquired
0709 13:01:22.388652 (+    20us) write_op.cc:260] PREPARE: finished
0709 13:01:22.388791 (+   139us) write_op.cc:270] Start()
0709 13:01:22.388908 (+   117us) write_op.cc:276] Timestamp: P: 1783602082388749 usec, L: 0
0709 13:01:22.388929 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:01:22.389556 (+   627us) log.cc:844] Serialized 3646 byte log entry
0709 13:01:22.400416 (+ 10860us) op_driver.cc:464] REPLICATION: finished
0709 13:01:22.400787 (+   371us) write_op.cc:301] APPLY: starting
0709 13:01:22.400890 (+   103us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:22.410246 (+  9356us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:22.410357 (+   111us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:22.419027 (+  8670us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:22.419254 (+   227us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 13:01:22.419300 (+    46us) write_op.cc:312] APPLY: finished
0709 13:01:22.419593 (+   293us) log.cc:844] Serialized 89 byte log entry
0709 13:01:22.435879 (+ 16286us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:22.436030 (+   151us) write_op.cc:454] Released schema lock
0709 13:01:22.436093 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:22.436516 (+   423us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:22.436567 (+    51us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1483273,"reported_tablets":49,"spinlock_wait_cycles":2432,"child_traces":[["op",{"apply.queue_time_us":134,"apply.run_cpu_time_us":12810,"apply.run_wall_time_us":35696,"cfile_cache_hit":36,"cfile_cache_hit_bytes":37620,"num_ops":9,"prepare.queue_time_us":866,"prepare.run_cpu_time_us":3621,"prepare.run_wall_time_us":13766,"replication_time_us":11317}]]}
I20260709 13:01:22.630671  1471 catalog_manager.cc:5697] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 10 to 14, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 14 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } }
I20260709 13:01:22.768432  1466 catalog_manager.cc:5697] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 20 to 21, leader changed from 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 21 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:01:22.770187  1466 catalog_manager.cc:5697] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: config changed from index 6 to 12, VOTER 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) evicted. New cstate: current_term: 16 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:22.827538   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:01:22.840783  1471 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55606 (request call id 274) took 11731 ms (client timeout 15000 ms). Trace:
W20260709 13:01:22.841200  1471 rpcz_store.cc:269] 0709 13:01:11.109415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:11.109662 (+   247us) service_pool.cc:224] Handling call
0709 13:01:22.840682 (+11731020us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:22.651318 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:22.651881 (+   563us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:22.651917 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:01:22.651936 (+    19us) tablet.cc:662] Decoding operations
0709 13:01:22.652794 (+   858us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:22.652849 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:22.652874 (+    25us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:01:22.653472 (+   598us) tablet.cc:701] Row locks acquired
0709 13:01:22.653491 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:01:22.653621 (+   130us) write_op.cc:270] Start()
0709 13:01:22.653733 (+   112us) write_op.cc:276] Timestamp: P: 1783602082653578 usec, L: 0
0709 13:01:22.653754 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:01:22.656958 (+  3204us) log.cc:844] Serialized 2866 byte log entry
0709 13:01:22.659001 (+  2043us) op_driver.cc:464] REPLICATION: finished
0709 13:01:22.662606 (+  3605us) write_op.cc:301] APPLY: starting
0709 13:01:22.662683 (+    77us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:22.666417 (+  3734us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:22.666534 (+   117us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:22.701435 (+ 34901us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:22.701664 (+   229us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=14,key_file_lookups=14,delta_file_lookups=14,mrs_lookups=0
0709 13:01:22.701717 (+    53us) write_op.cc:312] APPLY: finished
0709 13:01:22.701994 (+   277us) log.cc:844] Serialized 73 byte log entry
0709 13:01:22.702178 (+   184us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:22.702310 (+   132us) write_op.cc:454] Released schema lock
0709 13:01:22.702362 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:22.710321 (+  7959us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:22.710351 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":40836,"reported_tablets":49,"child_traces":[["op",{"apply.queue_time_us":1621,"apply.run_cpu_time_us":10449,"apply.run_wall_time_us":47669,"cfile_cache_hit":28,"cfile_cache_hit_bytes":29260,"num_ops":7,"prepare.queue_time_us":407,"prepare.run_cpu_time_us":3462,"prepare.run_wall_time_us":5919,"replication_time_us":5095}]]}
I20260709 13:01:22.872021  1466 catalog_manager.cc:5697] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 18 to 19, leader changed from 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 19 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:01:22.877113  1466 catalog_manager.cc:5697] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 12 to 13, leader changed from 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 13 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:01:22.931720  1706 tablet_service.cc:1558] Processing DeleteTablet for tablet 216561bf1aef403280c36c1e716ca3ad with delete_type TABLET_DATA_TOMBSTONED (TS 0c7751452c4b46afa95251b9df7169d4 not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:55718
I20260709 13:01:22.933997  1474 catalog_manager.cc:5697] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:22.941874  1473 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55620 (request call id 277) took 44241 ms (client timeout 15000 ms). Trace:
W20260709 13:01:22.948740  1473 rpcz_store.cc:269] 0709 13:00:38.700174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:38.700443 (+   269us) service_pool.cc:224] Handling call
0709 13:01:22.941663 (+44241220us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":279,"reported_tablets":47}
I20260709 13:01:22.953644  1474 catalog_manager.cc:5697] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 11 to 14, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 14 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:22.955888  7915 tablet_replica.cc:333] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4: stopping tablet replica
I20260709 13:01:22.957670  1474 catalog_manager.cc:5697] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 9 to 10, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 10 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:22.960346  1474 catalog_manager.cc:5697] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 8 to 13. New cstate: current_term: 13 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:22.964455  7915 raft_consensus.cc:2243] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:22.973331  7915 raft_consensus.cc:2272] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:22.994455  7915 ts_tablet_manager.cc:1916] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:01:23.028587  1646 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c"
dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
mode: GRACEFUL
new_leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:35470
I20260709 13:01:23.029219  1646 raft_consensus.cc:606] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 15 LEADER]: Received request to transfer leadership to TS 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:23.032325  1646 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3beb4a9a0afa4337be3366fb9ee9c2fd"
dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
mode: GRACEFUL
new_leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:35470
I20260709 13:01:23.032872  1646 raft_consensus.cc:606] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Received request to transfer leadership to TS 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:23.033187  1646 raft_consensus.cc:614] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:01:23.035838  1467 catalog_manager.cc:5697] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 16 to 17, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 17 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:23.038689  1467 catalog_manager.cc:5697] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 13 to 16, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 16 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:23.041011  1467 catalog_manager.cc:5697] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } }
I20260709 13:01:23.041656  1646 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0"
dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
mode: GRACEFUL
new_leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:35470
I20260709 13:01:23.042462  1467 catalog_manager.cc:5697] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 9 to 16, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 16 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } }
I20260709 13:01:23.042327  1646 raft_consensus.cc:606] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 12 LEADER]: Received request to transfer leadership to TS 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:23.059623  1649 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e"
dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
mode: GRACEFUL
new_leader_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:35470
I20260709 13:01:23.060246  1649 raft_consensus.cc:606] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 14 LEADER]: Received request to transfer leadership to TS 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:23.044126  1467 catalog_manager.cc:5697] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 14 to 15, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 15 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } }
I20260709 13:01:23.077229  1649 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def"
dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
mode: GRACEFUL
new_leader_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:35470
I20260709 13:01:23.077896  1649 raft_consensus.cc:606] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 13 LEADER]: Received request to transfer leadership to TS 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:23.088677   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:23.090737   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:01:23.092945  1474 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55620 (request call id 278) took 19461 ms (client timeout 15000 ms). Trace:
I20260709 13:01:23.095309  7803 raft_consensus.cc:993] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e: : Instructing follower 89ac9d5e2fbc4536b03a1ff1dd3eb226 to start an election
I20260709 13:01:23.095860  7803 raft_consensus.cc:1081] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 15 LEADER]: Signalling peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 to start an election
W20260709 13:01:23.093379  1474 rpcz_store.cc:269] 0709 13:01:03.682112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:03.689798 (+  7686us) service_pool.cc:224] Handling call
0709 13:01:23.092877 (+19403079us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:01:22.963872 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:01:22.964419 (+   547us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:01:22.964452 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:01:22.964467 (+    15us) tablet.cc:662] Decoding operations
0709 13:01:22.965068 (+   601us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:01:22.965124 (+    56us) write_op.cc:641] Partition lock acquired for write op
0709 13:01:22.965161 (+    37us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:01:22.965514 (+   353us) tablet.cc:701] Row locks acquired
0709 13:01:22.965532 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:01:22.965661 (+   129us) write_op.cc:270] Start()
0709 13:01:22.965764 (+   103us) write_op.cc:276] Timestamp: P: 1783602082965619 usec, L: 0
0709 13:01:22.965788 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 13:01:22.966406 (+   618us) log.cc:844] Serialized 1702 byte log entry
0709 13:01:22.968176 (+  1770us) op_driver.cc:464] REPLICATION: finished
0709 13:01:22.968647 (+   471us) write_op.cc:301] APPLY: starting
0709 13:01:22.968727 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 13:01:22.970807 (+  2080us) tablet.cc:1370] finished BulkCheckPresence
0709 13:01:22.970888 (+    81us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:01:22.973474 (+  2586us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:01:22.973645 (+   171us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 13:01:22.973686 (+    41us) write_op.cc:312] APPLY: finished
0709 13:01:22.973906 (+   220us) log.cc:844] Serialized 49 byte log entry
0709 13:01:22.974671 (+   765us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:22.974796 (+   125us) write_op.cc:454] Released schema lock
0709 13:01:22.974853 (+    57us) write_op.cc:341] FINISH: Updating metrics
0709 13:01:22.975188 (+   335us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:01:22.975221 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1346,"reported_tablets":47,"spinlock_wait_cycles":16640,"child_traces":[["op",{"apply.queue_time_us":233,"apply.run_cpu_time_us":5713,"apply.run_wall_time_us":6501,"cfile_cache_hit":16,"cfile_cache_hit_bytes":16720,"num_ops":4,"prepare.queue_time_us":110,"prepare.run_cpu_time_us":2779,"prepare.run_wall_time_us":2790,"replication_time_us":2266}]]}
I20260709 13:01:23.097873  1467 catalog_manager.cc:5697] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 15 to 16, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 16 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } }
I20260709 13:01:23.099431  1467 catalog_manager.cc:5697] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 14 to 15, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 15 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } }
I20260709 13:01:23.101194  1467 catalog_manager.cc:5697] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 13 to 16, leader changed from 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 16 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } }
I20260709 13:01:23.103562  1467 catalog_manager.cc:5697] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } }
I20260709 13:01:23.104923  1467 catalog_manager.cc:5697] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } }
I20260709 13:01:23.106069  1467 catalog_manager.cc:5697] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 12 to 20. New cstate: current_term: 20 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } }
I20260709 13:01:23.107470  1467 catalog_manager.cc:5697] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } }
I20260709 13:01:23.109133  7793 raft_consensus.cc:993] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e: : Instructing follower 0c7751452c4b46afa95251b9df7169d4 to start an election
I20260709 13:01:23.109615  7911 raft_consensus.cc:1081] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 13 LEADER]: Signalling peer 0c7751452c4b46afa95251b9df7169d4 to start an election
I20260709 13:01:23.114521  1720 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def"
dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:50010
I20260709 13:01:23.115211  1720 raft_consensus.cc:493] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:23.115604  1720 raft_consensus.cc:3060] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:23.108661  1467 catalog_manager.cc:5697] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } }
I20260709 13:01:23.120939  1467 catalog_manager.cc:5697] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 8 to 18, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 18 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } }
I20260709 13:01:23.122246  1467 catalog_manager.cc:5697] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 16 to 17, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 17 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } }
I20260709 13:01:23.129146  7907 raft_consensus.cc:993] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e: : Instructing follower 0c7751452c4b46afa95251b9df7169d4 to start an election
I20260709 13:01:23.129657  7907 raft_consensus.cc:1081] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 14 LEADER]: Signalling peer 0c7751452c4b46afa95251b9df7169d4 to start an election
I20260709 13:01:23.132730  1718 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e"
dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:50010
I20260709 13:01:23.133293  1718 raft_consensus.cc:493] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:23.133630  1718 raft_consensus.cc:3060] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:23.141533  1718 raft_consensus.cc:515] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:23.143558  1718 leader_election.cc:290] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:23.145005  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:01:23.145776  2327 raft_consensus.cc:3060] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:23.146931  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe7eb675393487f87b528a12f16e16e" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:23.147509  1646 raft_consensus.cc:3055] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 14 LEADER]: Stepping down as leader of term 14
I20260709 13:01:23.147822  1646 raft_consensus.cc:740] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:23.148687  7915 ts_tablet_manager.cc:1929] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 16.11
I20260709 13:01:23.149260  7915 log.cc:1199] T 216561bf1aef403280c36c1e716ca3ad P 0c7751452c4b46afa95251b9df7169d4: Deleting WAL directory at /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783601869227091-431-0/minicluster-data/ts-2-root/wals/216561bf1aef403280c36c1e716ca3ad
I20260709 13:01:23.149609  1646 consensus_queue.cc:260] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:23.152880  2327 raft_consensus.cc:2468] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 15.
I20260709 13:01:23.153070  1461 catalog_manager.cc:5028] TS 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): tablet 216561bf1aef403280c36c1e716ca3ad (table test-workload [id=2e230675e851429db50863dfed56dde5]) successfully deleted
I20260709 13:01:23.152917  1720 raft_consensus.cc:515] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:23.157070  1689 leader_election.cc:304] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 13:01:23.158644  7912 raft_consensus.cc:2804] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:01:23.159158  7912 raft_consensus.cc:697] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 15 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:01:23.159458  1720 leader_election.cc:290] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:23.160029  7912 consensus_queue.cc:237] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:23.182847  1649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:23.183720  1649 raft_consensus.cc:3055] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:01:23.184186  1649 raft_consensus.cc:740] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:23.198212  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ecf79110f7ff4e8b8bf2e0e4ea3c6def" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: true dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:01:23.198904  2327 raft_consensus.cc:3060] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:23.201861  1649 consensus_queue.cc:260] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:23.206529  2327 raft_consensus.cc:2468] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 14.
I20260709 13:01:23.249053  1646 raft_consensus.cc:3060] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:01:23.251852  1569 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c"
dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:36640
I20260709 13:01:23.203097  1649 raft_consensus.cc:3060] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:23.252393  1569 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:23.252993  1569 raft_consensus.cc:3060] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:23.277976  1646 raft_consensus.cc:2468] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 15.
I20260709 13:01:23.309830  1649 raft_consensus.cc:2468] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 14.
I20260709 13:01:23.311084  1688 leader_election.cc:304] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:23.311887  7844 raft_consensus.cc:2804] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:23.313616  7844 raft_consensus.cc:697] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 14 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:01:23.316273  7844 consensus_queue.cc:237] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:23.321460  1467 catalog_manager.cc:5697] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 14 to 15, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 15 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:23.338157  1569 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:23.391439  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:23.392040  1646 raft_consensus.cc:3055] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:23.392349  1646 raft_consensus.cc:740] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:23.393091  1646 consensus_queue.cc:260] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:23.394322  1646 raft_consensus.cc:3060] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:23.396997  1569 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 16 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:23.399681  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:01:23.400339  2327 raft_consensus.cc:3060] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:23.402751  1646 raft_consensus.cc:2468] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 16.
I20260709 13:01:23.404567  1539 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:23.408142  2327 raft_consensus.cc:2468] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 16.
I20260709 13:01:23.408932  7868 raft_consensus.cc:2804] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:23.417249  7868 raft_consensus.cc:697] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:01:23.418368  7868 consensus_queue.cc:237] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:23.462412  7911 raft_consensus.cc:993] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e: : Instructing follower 89ac9d5e2fbc4536b03a1ff1dd3eb226 to start an election
I20260709 13:01:23.462935  7911 raft_consensus.cc:1081] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 12 LEADER]: Signalling peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 to start an election
I20260709 13:01:23.472402  1569 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0"
dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:36640
I20260709 13:01:23.473038  1569 raft_consensus.cc:493] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:23.473387  1569 raft_consensus.cc:3060] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:23.504433  1706 tablet_service.cc:1558] Processing DeleteTablet for tablet 216561bf1aef403280c36c1e716ca3ad with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 6 (current committed config index is 12)) from {username='slave'} at 127.0.0.1:55718
I20260709 13:01:23.506239  1461 catalog_manager.cc:5028] TS 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): tablet 216561bf1aef403280c36c1e716ca3ad (table test-workload [id=2e230675e851429db50863dfed56dde5]) successfully deleted
I20260709 13:01:23.506938  1569 raft_consensus.cc:515] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:23.509569  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:23.510109  1642 raft_consensus.cc:3055] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:23.510372  1642 raft_consensus.cc:740] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:23.511065  1642 consensus_queue.cc:260] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:23.512250  1642 raft_consensus.cc:3060] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:23.527092  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: true dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:23.527745  1722 raft_consensus.cc:3060] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:23.530465  1468 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55626 (request call id 259) took 34530 ms (client timeout 15000 ms). Trace:
W20260709 13:01:23.537941  1468 rpcz_store.cc:269] 0709 13:00:49.000519 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:00:49.039492 (+ 38973us) service_pool.cc:224] Handling call
0709 13:00:49.505437 (+465945us) spinlock_profiling.cc:243] Waited 315 ms on lock 0x7b540041ee54. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2325090 00007fa9f23c3f3a 00007fa9f817a1cc 00007fa9f827837e 00007fa9f67392a4 00007fa9f6739232 00007fa9f6739161 00007fa9f67390dc 00007fa9f6738392 00007fa9f06f648c 00007fa9f06f58c6
0709 13:01:23.530259 (+34024822us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":49,"spinlock_wait_cycles":725058816}
I20260709 13:01:23.539672  1473 catalog_manager.cc:5697] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 15 to 16, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 16 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:23.553423  1722 raft_consensus.cc:2468] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 13.
I20260709 13:01:23.554388  1467 catalog_manager.cc:5697] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 13 to 14, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 14 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:23.555039  1569 leader_election.cc:290] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:23.557960  1542 leader_election.cc:304] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:23.559023  7879 raft_consensus.cc:2804] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:23.559504  7879 raft_consensus.cc:697] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:01:23.560196  7879 consensus_queue.cc:237] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:23.519531  1642 raft_consensus.cc:2468] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 13.
I20260709 13:01:23.577850  2327 raft_consensus.cc:1275] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:01:23.586876  7912 consensus_queue.cc:1048] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:01:23.590909  1467 catalog_manager.cc:5697] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 12 to 13, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 13 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:23.621176  1642 raft_consensus.cc:1275] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 13:01:23.622944  7912 consensus_queue.cc:1048] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 13:01:23.736555  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 46259.5us
I20260709 13:01:23.782635  1646 raft_consensus.cc:1275] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:01:23.784317  7923 consensus_queue.cc:1048] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:23.811195  1472 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:55620 (request call id 279) took 4505 ms. Trace:
I20260709 13:01:23.811627  1472 rpcz_store.cc:276] 0709 13:01:19.305507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:01:19.305805 (+   298us) service_pool.cc:224] Handling call
0709 13:01:23.810988 (+4505183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18727,"reported_tablets":47}
I20260709 13:01:23.840179  2323 raft_consensus.cc:1275] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:01:23.843396  7923 consensus_queue.cc:1048] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:23.931793  1642 raft_consensus.cc:1275] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:01:23.933231  7879 consensus_queue.cc:1048] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:01:24.000933  2323 raft_consensus.cc:1275] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 13:01:24.003553  7879 consensus_queue.cc:1048] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:01:24.065174  1642 raft_consensus.cc:1275] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:24.068495  7879 consensus_queue.cc:1048] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:24.091784   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:24.155939  1716 raft_consensus.cc:1275] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:01:24.198393  7931 consensus_queue.cc:1048] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:25.298101   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:25.410264  1646 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413"
dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
mode: GRACEFUL
new_leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:35470
I20260709 13:01:25.410948  1646 raft_consensus.cc:606] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 15 LEADER]: Received request to transfer leadership to TS 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:25.422307  1646 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "05713611987147e49a96fdf32bb28649"
dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
mode: GRACEFUL
new_leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:35470
I20260709 13:01:25.422976  1646 raft_consensus.cc:606] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 16 LEADER]: Received request to transfer leadership to TS 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:25.479936  7911 raft_consensus.cc:993] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e: : Instructing follower 89ac9d5e2fbc4536b03a1ff1dd3eb226 to start an election
I20260709 13:01:25.480516  7911 raft_consensus.cc:1081] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 15 LEADER]: Signalling peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 to start an election
I20260709 13:01:25.495563  1573 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413"
dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:36640
I20260709 13:01:25.496340  1573 raft_consensus.cc:493] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:25.496840  1573 raft_consensus.cc:3060] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:25.509493  1646 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91"
dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
mode: GRACEFUL
new_leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:35470
I20260709 13:01:25.510624  1646 raft_consensus.cc:606] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 15 LEADER]: Received request to transfer leadership to TS 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:25.516626  1646 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f"
dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
mode: GRACEFUL
new_leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:35470
I20260709 13:01:25.517357  1646 raft_consensus.cc:606] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 12 LEADER]: Received request to transfer leadership to TS 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:25.522230  1646 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a"
dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
mode: GRACEFUL
new_leader_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:35470
I20260709 13:01:25.522974  1646 raft_consensus.cc:606] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 16 LEADER]: Received request to transfer leadership to TS 0c7751452c4b46afa95251b9df7169d4
I20260709 13:01:25.525425   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:01:25.527170   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:25.539809  7938 raft_consensus.cc:993] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e: : Instructing follower 89ac9d5e2fbc4536b03a1ff1dd3eb226 to start an election
I20260709 13:01:25.540632  7938 raft_consensus.cc:1081] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 16 LEADER]: Signalling peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 to start an election
I20260709 13:01:25.550786  1574 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "05713611987147e49a96fdf32bb28649"
dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:36640
I20260709 13:01:25.551456  1574 raft_consensus.cc:493] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:25.551860  1574 raft_consensus.cc:3060] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:25.560829  1574 raft_consensus.cc:515] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:25.606151  7938 raft_consensus.cc:993] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e: : Instructing follower 89ac9d5e2fbc4536b03a1ff1dd3eb226 to start an election
I20260709 13:01:25.631912  7938 raft_consensus.cc:1081] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 15 LEADER]: Signalling peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 to start an election
I20260709 13:01:25.606935  7909 raft_consensus.cc:993] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e: : Instructing follower 89ac9d5e2fbc4536b03a1ff1dd3eb226 to start an election
I20260709 13:01:25.633404  7938 raft_consensus.cc:1081] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 12 LEADER]: Signalling peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 to start an election
I20260709 13:01:25.650348  1574 leader_election.cc:290] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 17 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:25.651887  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:01:25.659906  2327 raft_consensus.cc:3060] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:25.658706  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:25.660619  1646 raft_consensus.cc:3055] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:25.660936  1646 raft_consensus.cc:740] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:25.661734  1646 consensus_queue.cc:260] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:25.663599  1646 raft_consensus.cc:3060] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:25.698776  1646 raft_consensus.cc:2468] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 17.
W20260709 13:01:25.706175  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 46768.2us
I20260709 13:01:25.803875  1574 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91"
dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:36640
I20260709 13:01:25.804589  1574 raft_consensus.cc:493] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:25.804991  1574 raft_consensus.cc:3060] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:25.809685  1569 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f"
dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:36640
I20260709 13:01:25.810395  1569 raft_consensus.cc:493] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:25.810778  1569 raft_consensus.cc:3060] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:25.654238  1573 raft_consensus.cc:515] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:25.824914  1573 leader_election.cc:290] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 16 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:25.846181  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:25.846803  1643 raft_consensus.cc:3055] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:25.847105  1643 raft_consensus.cc:740] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:25.847954  1643 consensus_queue.cc:260] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:25.849334  1643 raft_consensus.cc:3060] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:25.877538  1617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:25.791980  2327 raft_consensus.cc:2468] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 17.
W20260709 13:01:25.954600  1617 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:25.955456  1569 raft_consensus.cc:515] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:25.958181  1540 leader_election.cc:304] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
W20260709 13:01:26.049254  1540 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 91177.2us
I20260709 13:01:26.052454  7879 raft_consensus.cc:2804] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:26.030110  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:26.054700  1722 raft_consensus.cc:3060] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:26.058568  7879 raft_consensus.cc:697] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 17 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:01:26.060333  7879 consensus_queue.cc:237] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:25.928510  1574 raft_consensus.cc:515] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:26.066226  1574 leader_election.cc:290] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 16 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:25.889513  1643 raft_consensus.cc:2468] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 16.
I20260709 13:01:26.100207  1569 leader_election.cc:290] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:26.110291  1573 raft_consensus.cc:1240] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 15. Current term is 16. Ops: []
I20260709 13:01:26.198333  1473 catalog_manager.cc:5697] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 16 to 17, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 17 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:26.218776  1539 leader_election.cc:304] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:26.221139  1722 raft_consensus.cc:2468] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 16.
I20260709 13:01:26.254060  7931 raft_consensus.cc:2804] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:26.254705  7931 raft_consensus.cc:697] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:01:26.255753  7931 consensus_queue.cc:237] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:01:26.266279  1542 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 94933.6us
I20260709 13:01:26.349165  7943 raft_consensus.cc:993] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e: : Instructing follower 0c7751452c4b46afa95251b9df7169d4 to start an election
I20260709 13:01:26.349851  7943 raft_consensus.cc:1081] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 16 LEADER]: Signalling peer 0c7751452c4b46afa95251b9df7169d4 to start an election
W20260709 13:01:26.368716  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 89829.2us
I20260709 13:01:26.371810  7938 consensus_queue.cc:1059] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:26.376770  7793 raft_consensus.cc:3055] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 15 LEADER]: Stepping down as leader of term 15
I20260709 13:01:26.377257  7793 raft_consensus.cc:740] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:26.378105  7793 consensus_queue.cc:260] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:26.379526  7793 raft_consensus.cc:3060] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:26.382346  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 103386us
I20260709 13:01:26.397791  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:26.398025  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:26.398319  1646 raft_consensus.cc:3055] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:01:26.398656  1646 raft_consensus.cc:740] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:26.402336  1646 consensus_queue.cc:260] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:26.403287  1646 raft_consensus.cc:3060] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:26.409705  1646 raft_consensus.cc:2468] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 13.
I20260709 13:01:26.421516  1643 raft_consensus.cc:2468] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 16.
W20260709 13:01:26.437454  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 50381us
I20260709 13:01:26.441488  1722 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:26.442087  1722 raft_consensus.cc:3060] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:26.442684  1568 raft_consensus.cc:1240] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:26.447954  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: true dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:26.448511  1720 raft_consensus.cc:3060] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:26.460217  1722 raft_consensus.cc:2468] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 16.
I20260709 13:01:26.458871  1539 leader_election.cc:304] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:26.470445  1720 raft_consensus.cc:2468] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 13.
I20260709 13:01:26.472013  7941 raft_consensus.cc:2804] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:26.472398  1539 leader_election.cc:304] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:26.472615  7941 raft_consensus.cc:697] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:01:26.473376  7956 raft_consensus.cc:2804] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:26.473896  7956 raft_consensus.cc:697] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:01:26.473559  7941 consensus_queue.cc:237] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:26.474771  7956 consensus_queue.cc:237] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:26.480875  1720 raft_consensus.cc:1240] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 12. Current term is 13. Ops: []
I20260709 13:01:26.500491  1720 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a"
dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
 from {username='slave'} at 127.0.0.1:50010
I20260709 13:01:26.501067  1720 raft_consensus.cc:493] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:26.501454  1720 raft_consensus.cc:3060] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:26.521240  1473 catalog_manager.cc:5697] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 15 to 16, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 16 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:26.523066  1473 catalog_manager.cc:5697] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 12 to 13, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 13 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:26.529482   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:26.524500  1473 catalog_manager.cc:5697] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 15 to 16, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 16 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:26.558544  1720 raft_consensus.cc:515] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:26.560407  1723 raft_consensus.cc:1240] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 17 FOLLOWER]: Rejecting Update request from peer 4dbe7d47a2374afca075d3a98583b49e for earlier term 16. Current term is 17. Ops: []
I20260709 13:01:26.568459  2323 raft_consensus.cc:1275] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:01:26.570179  7949 consensus_queue.cc:1048] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:01:26.574662  1646 raft_consensus.cc:1275] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:01:26.576381  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:26.576951  1646 raft_consensus.cc:3055] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 16 LEADER]: Stepping down as leader of term 16
I20260709 13:01:26.577423  1646 raft_consensus.cc:740] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:26.578217  1646 consensus_queue.cc:260] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:26.579238  1646 raft_consensus.cc:3060] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:26.580425  1720 leader_election.cc:290] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 17 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:26.576869  7941 consensus_queue.cc:1048] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.011s
I20260709 13:01:26.592317  1646 raft_consensus.cc:2468] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 17.
I20260709 13:01:26.593508  1688 leader_election.cc:304] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:26.594393  7960 raft_consensus.cc:2804] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:26.594890  7960 raft_consensus.cc:697] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 17 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:01:26.595990  7960 consensus_queue.cc:237] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:26.603822  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcb63b9010d4a77ad8748087fa07f8a" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:01:26.604382  2327 raft_consensus.cc:3060] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:26.612162  2327 raft_consensus.cc:2468] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 17.
I20260709 13:01:26.682682  1473 catalog_manager.cc:5697] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 16 to 17, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 17 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:26.828707  1643 raft_consensus.cc:1275] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:01:26.831226  7949 consensus_queue.cc:1048] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:26.845063  1720 raft_consensus.cc:1275] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:01:26.848212  7941 consensus_queue.cc:1048] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:01:26.924923  1716 raft_consensus.cc:1275] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:01:26.952287  7941 consensus_queue.cc:1048] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:01:26.961984  1716 raft_consensus.cc:1275] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:01:26.970429  7956 consensus_queue.cc:1048] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:26.991415  1646 raft_consensus.cc:1275] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:01:26.992923  7956 consensus_queue.cc:1048] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:01:27.064002  2327 raft_consensus.cc:1275] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:01:27.073915  1646 raft_consensus.cc:1275] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:01:27.075628  7956 consensus_queue.cc:1048] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:27.077373  7950 consensus_queue.cc:1048] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:01:27.144752  1643 raft_consensus.cc:1275] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:01:27.149724  7910 consensus_queue.cc:1048] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:01:27.762105   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:28.068306  1646 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991"
dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
mode: GRACEFUL
new_leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:35470
I20260709 13:01:28.068954  1646 raft_consensus.cc:606] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 18 LEADER]: Received request to transfer leadership to TS 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:28.072679   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:01:28.081807   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:01:28.427373  7980 raft_consensus.cc:993] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e: : Instructing follower 89ac9d5e2fbc4536b03a1ff1dd3eb226 to start an election
I20260709 13:01:28.427896  7980 raft_consensus.cc:1081] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 18 LEADER]: Signalling peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 to start an election
I20260709 13:01:28.431625  1568 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991"
dest_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226"
 from {username='slave'} at 127.0.0.1:36640
I20260709 13:01:28.432160  1568 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:01:28.432487  1568 raft_consensus.cc:3060] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:28.439837  1568 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:28.442463  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:28.443061  1646 raft_consensus.cc:3055] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 18 LEADER]: Stepping down as leader of term 18
I20260709 13:01:28.443380  1646 raft_consensus.cc:740] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:28.444139  1568 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 19 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:28.445122  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:01:28.453753  2323 raft_consensus.cc:3060] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:28.444191  1646 consensus_queue.cc:260] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:28.462196  1646 raft_consensus.cc:3060] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:28.468798  2323 raft_consensus.cc:2468] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 19.
I20260709 13:01:28.470269  1540 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226; no voters: 
I20260709 13:01:28.471062  7956 raft_consensus.cc:2804] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:01:28.471575  7956 raft_consensus.cc:697] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 19 LEADER]: Becoming Leader. State: Replica: 89ac9d5e2fbc4536b03a1ff1dd3eb226, State: Running, Role: LEADER
I20260709 13:01:28.472558  7956 consensus_queue.cc:237] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:28.484741  1646 raft_consensus.cc:2468] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 89ac9d5e2fbc4536b03a1ff1dd3eb226 in term 19.
W20260709 13:01:28.574146  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 60674.9us
W20260709 13:01:28.583781  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 56264us
I20260709 13:01:28.587955  1473 catalog_manager.cc:5697] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 reported cstate change: term changed from 18 to 19, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193). New cstate: current_term: 19 leader_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:28.673439  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 71840.4us
W20260709 13:01:28.678923  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 79063.1us
W20260709 13:01:28.683495  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 86042.4us
W20260709 13:01:28.701217  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 103523us
I20260709 13:01:28.901737  1643 raft_consensus.cc:1275] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 19 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:01:28.904847  7990 consensus_queue.cc:1048] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:01:28.912037  2323 raft_consensus.cc:1275] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 19 FOLLOWER]: Refusing update from remote peer 89ac9d5e2fbc4536b03a1ff1dd3eb226: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 13:01:28.913537  7990 consensus_queue.cc:1048] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:01:29.083407   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:01:29.353205   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 13:01:29.354497  1615 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:01:29.392751  1689 consensus_peers.cc:597] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:29.399914  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 45546.5us
W20260709 13:01:29.412142  1615 consensus_peers.cc:597] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:29.417182  1689 consensus_peers.cc:597] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:29.436251  1615 consensus_peers.cc:597] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:29.450389  1689 consensus_peers.cc:597] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:29.459776  1689 consensus_peers.cc:597] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:29.460479  1689 consensus_peers.cc:597] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:29.469521  1689 consensus_peers.cc:597] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:29.484555  1615 consensus_peers.cc:597] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:29.515908  1615 consensus_peers.cc:597] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:29.521211  1615 consensus_peers.cc:597] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:29.542306  1689 consensus_peers.cc:597] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:29.567004  2295 consensus_peers.cc:597] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:29.567087  1615 consensus_peers.cc:597] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:29.589087  1615 consensus_peers.cc:597] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:29.597877  1615 consensus_peers.cc:597] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:29.601913  1615 consensus_peers.cc:597] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:29.580770   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:29.608484   431 tablet_replica.cc:333] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226: stopping tablet replica
I20260709 13:01:29.609962   431 raft_consensus.cc:2243] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:29.618029   431 raft_consensus.cc:2272] T 608abea191d946228bed666c5560fd0a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:29.625392  1615 consensus_peers.cc:597] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:29.626325   431 tablet_replica.cc:333] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: stopping tablet replica
I20260709 13:01:29.627413   431 raft_consensus.cc:2243] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 20 FOLLOWER]: Raft consensus shutting down.
W20260709 13:01:29.648017  1615 consensus_peers.cc:597] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:29.649857   431 raft_consensus.cc:2272] T 725a29842f534310a9c0bb9d5c7892a2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.654415   431 tablet_replica.cc:333] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: stopping tablet replica
I20260709 13:01:29.655793   431 raft_consensus.cc:2243] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:29.656843   431 raft_consensus.cc:2272] T ecb8dc1ca7644ad598779a7fe5419ad5 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:29.660019  2295 consensus_peers.cc:597] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:29.660195   431 tablet_replica.cc:333] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: stopping tablet replica
W20260709 13:01:29.663865  2295 consensus_peers.cc:597] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:29.665386   431 raft_consensus.cc:2243] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:01:29.666728   431 raft_consensus.cc:2272] T 71e68bb03bc047dfadd595f2484ca8f8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:29.669127  1689 consensus_peers.cc:597] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:29.669859   431 tablet_replica.cc:333] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: stopping tablet replica
I20260709 13:01:29.670825   431 raft_consensus.cc:2243] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:01:29.672024   431 raft_consensus.cc:2272] T 896a5554fe0949399b16eb646b6446b8 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.675338   431 tablet_replica.cc:333] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: stopping tablet replica
I20260709 13:01:29.676257   431 raft_consensus.cc:2243] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:01:29.677560   431 raft_consensus.cc:2272] T a4e8f73323404a27b6ef964e10902d91 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.691789   431 tablet_replica.cc:333] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226: stopping tablet replica
I20260709 13:01:29.692701   431 raft_consensus.cc:2243] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:29.693926   431 raft_consensus.cc:2272] T 8e94ee9035214526808abfaab11799fe P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:29.696058  2295 consensus_peers.cc:597] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:29.700255   431 tablet_replica.cc:333] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226: stopping tablet replica
I20260709 13:01:29.701329   431 raft_consensus.cc:2243] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:29.702395   431 raft_consensus.cc:2272] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:29.709990  2295 consensus_peers.cc:597] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:29.710795  1689 consensus_peers.cc:597] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:29.713586   431 tablet_replica.cc:333] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: stopping tablet replica
I20260709 13:01:29.714623   431 raft_consensus.cc:2243] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Raft consensus shutting down.
W20260709 13:01:29.714869  2295 consensus_peers.cc:597] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:29.715322   431 raft_consensus.cc:2272] T 9ec2114c988b4a38a63b42293dcf1757 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:29.715530  2295 consensus_peers.cc:597] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:29.720670   431 tablet_replica.cc:333] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: stopping tablet replica
I20260709 13:01:29.721660   431 raft_consensus.cc:2243] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:29.727881   431 raft_consensus.cc:2272] T e66a330b7dae4036b80d239969d5a260 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.731083   431 tablet_replica.cc:333] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: stopping tablet replica
W20260709 13:01:29.731571  2295 consensus_peers.cc:597] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:29.732067   431 raft_consensus.cc:2243] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Raft consensus shutting down.
W20260709 13:01:29.748451  1615 consensus_peers.cc:597] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:29.760941   431 raft_consensus.cc:2272] T 85dedac1c89a4e76846055d543df7f16 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.764405   431 tablet_replica.cc:333] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226: stopping tablet replica
W20260709 13:01:29.780874  2295 consensus_peers.cc:597] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:29.781921  1615 consensus_peers.cc:597] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:29.765295   431 raft_consensus.cc:2243] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:01:29.785162   431 raft_consensus.cc:2272] T 1aa00507899e41f9b595f503add14c8c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:29.787689  1615 consensus_peers.cc:597] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:29.788892   431 tablet_replica.cc:333] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226: stopping tablet replica
I20260709 13:01:29.789846   431 raft_consensus.cc:2243] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:29.790531   431 raft_consensus.cc:2272] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.793510   431 tablet_replica.cc:333] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: stopping tablet replica
I20260709 13:01:29.794344   431 raft_consensus.cc:2243] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:01:29.795324   431 raft_consensus.cc:2272] T bfb3b560711b4d7eb23f2aff3e4ca991 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.798409   431 tablet_replica.cc:333] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: stopping tablet replica
I20260709 13:01:29.799221   431 raft_consensus.cc:2243] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:01:29.800407   431 raft_consensus.cc:2272] T 776886dda1a14393a13f8003a58c45d0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.803289   431 tablet_replica.cc:333] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226: stopping tablet replica
I20260709 13:01:29.804052   431 raft_consensus.cc:2243] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:01:29.805297   431 raft_consensus.cc:2272] T 589a395c6abe4eec80fca6d6210acf0d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.808616   431 tablet_replica.cc:333] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: stopping tablet replica
I20260709 13:01:29.809473   431 raft_consensus.cc:2243] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:29.810075   431 raft_consensus.cc:2272] T 55eef501fb844a5097694ea43dc740c7 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.813071   431 tablet_replica.cc:333] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: stopping tablet replica
I20260709 13:01:29.813789   431 raft_consensus.cc:2243] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:29.814440   431 raft_consensus.cc:2272] T bbdad022d10c452fb5c104373d7cd035 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.821398   431 tablet_replica.cc:333] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: stopping tablet replica
I20260709 13:01:29.822312   431 raft_consensus.cc:2243] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:29.822912   431 raft_consensus.cc:2272] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.825815   431 tablet_replica.cc:333] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: stopping tablet replica
I20260709 13:01:29.826514   431 raft_consensus.cc:2243] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:01:29.827618   431 raft_consensus.cc:2272] T 650a39124682440d83bb93bb83f15979 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:29.834511  2295 consensus_peers.cc:597] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:29.836731   431 tablet_replica.cc:333] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226: stopping tablet replica
I20260709 13:01:29.837675   431 raft_consensus.cc:2243] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:29.838680   431 raft_consensus.cc:2272] T 86d7fe1cfa574972b0302d36ac77568b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.841562   431 tablet_replica.cc:333] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226: stopping tablet replica
I20260709 13:01:29.842649   431 raft_consensus.cc:2243] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:29.843231   431 raft_consensus.cc:2272] T 4fa306a802914bb9b8d54b7bfe53009c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.846253   431 tablet_replica.cc:333] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226: stopping tablet replica
W20260709 13:01:29.859933  2295 consensus_peers.cc:597] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:29.862914   431 raft_consensus.cc:2243] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:29.871171   431 raft_consensus.cc:2272] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.882635   431 tablet_replica.cc:333] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226: stopping tablet replica
I20260709 13:01:29.883445   431 raft_consensus.cc:2243] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:29.884210   431 raft_consensus.cc:2272] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.887097   431 tablet_replica.cc:333] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226: stopping tablet replica
I20260709 13:01:29.887890   431 raft_consensus.cc:2243] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:29.888686   431 raft_consensus.cc:2272] T 2ec61eb41a88487585d7738d4f5636dc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.891662   431 tablet_replica.cc:333] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: stopping tablet replica
I20260709 13:01:29.893433   431 raft_consensus.cc:2243] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:01:29.894531   431 raft_consensus.cc:2272] T 05713611987147e49a96fdf32bb28649 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.901602   431 tablet_replica.cc:333] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: stopping tablet replica
I20260709 13:01:29.902364   431 raft_consensus.cc:2243] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:29.903223   431 raft_consensus.cc:2272] T 73452eca85a147fb9d862dd08d54e340 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.910897   431 tablet_replica.cc:333] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: stopping tablet replica
I20260709 13:01:29.912207   431 raft_consensus.cc:2243] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:01:29.913424   431 raft_consensus.cc:2272] T 566c1a1cfdfa47a2aee520e28f352064 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.916226   431 tablet_replica.cc:333] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226: stopping tablet replica
I20260709 13:01:29.917163   431 raft_consensus.cc:2243] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:29.918594   431 raft_consensus.cc:2272] T 216561bf1aef403280c36c1e716ca3ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.923187   431 tablet_replica.cc:333] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: stopping tablet replica
I20260709 13:01:29.923985   431 raft_consensus.cc:2243] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:29.924650   431 raft_consensus.cc:2272] T 2f8dd5957a2647058190fd52f31ec088 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.927553   431 tablet_replica.cc:333] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226: stopping tablet replica
I20260709 13:01:29.928270   431 raft_consensus.cc:2243] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:29.928970   431 raft_consensus.cc:2272] T 93e6c991440c40c8a8c8050982e85eeb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.973537   431 tablet_replica.cc:333] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: stopping tablet replica
I20260709 13:01:29.974349   431 raft_consensus.cc:2243] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:29.975607   431 raft_consensus.cc:2272] T 477960faa15b4001a5a6361558d69294 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:29.991683   431 tablet_replica.cc:333] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226: stopping tablet replica
I20260709 13:01:29.992547   431 raft_consensus.cc:2243] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:30.023871   431 raft_consensus.cc:2272] T 4bc29cd0261846b7847f38862b494d0b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:30.027007   431 tablet_replica.cc:333] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226: stopping tablet replica
I20260709 13:01:30.027856   431 raft_consensus.cc:2243] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:01:30.045161   431 raft_consensus.cc:2272] T df3a0b1701574816b4c9766063c65f8f P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:30.048199   431 tablet_replica.cc:333] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226: stopping tablet replica
I20260709 13:01:30.049080   431 raft_consensus.cc:2243] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:30.063783   431 raft_consensus.cc:2272] T f8c04e2c99384254b275d20e6d27467b P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:30.066919   431 tablet_replica.cc:333] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226: stopping tablet replica
I20260709 13:01:30.096954   431 raft_consensus.cc:2243] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:30.097898   431 raft_consensus.cc:2272] T 66c434748d1745f7ab1d4bf5a8d9e85d P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:30.101202   431 tablet_replica.cc:333] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: stopping tablet replica
I20260709 13:01:30.124123   431 raft_consensus.cc:2243] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:30.125290   431 raft_consensus.cc:2272] T c998894dcb744ba3825db19244f8207e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:30.128309   431 tablet_replica.cc:333] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: stopping tablet replica
I20260709 13:01:30.150971   431 raft_consensus.cc:2243] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:30.189162   431 raft_consensus.cc:2272] T 4ab0461976fc466a8162014a633d32d2 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:30.192787   431 tablet_replica.cc:333] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226: stopping tablet replica
I20260709 13:01:30.207206   431 raft_consensus.cc:2243] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:30.210083   431 raft_consensus.cc:2272] T cf2ade0033864199b5ced11fc9b5c6ad P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:30.213297   431 tablet_replica.cc:333] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: stopping tablet replica
I20260709 13:01:30.214095   431 raft_consensus.cc:2243] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:01:30.215157   431 raft_consensus.cc:2272] T 3ba8e707693e4af2b8347a4bad4dfd67 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:30.217742   431 tablet_replica.cc:333] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: stopping tablet replica
I20260709 13:01:30.218292   431 raft_consensus.cc:2243] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:30.219077   431 raft_consensus.cc:2272] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:30.235424   431 tablet_replica.cc:333] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: stopping tablet replica
I20260709 13:01:30.236199   431 raft_consensus.cc:2243] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:30.327103   431 raft_consensus.cc:2272] T 88a45cba73f148359b7ac85f9f702819 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:30.330160   431 tablet_replica.cc:333] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226: stopping tablet replica
I20260709 13:01:30.330935   431 raft_consensus.cc:2243] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:01:30.332007   431 raft_consensus.cc:2272] T 454808fe3b6f48ab9fed193478d28abc P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:30.382905   431 tablet_replica.cc:333] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: stopping tablet replica
I20260709 13:01:30.383725   431 raft_consensus.cc:2243] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:01:30.402658   431 raft_consensus.cc:2272] T 03f18dbd16bd4b9eb22229aed3da4413 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:30.416352   431 tablet_replica.cc:333] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: stopping tablet replica
I20260709 13:01:30.417213   431 raft_consensus.cc:2243] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:30.417940   431 raft_consensus.cc:2272] T a0203dcfbe4440c790f2bf709bd16179 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:30.452702   431 tablet_replica.cc:333] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226: stopping tablet replica
I20260709 13:01:30.453454   431 raft_consensus.cc:2243] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:30.454702   431 raft_consensus.cc:2272] T 091ce8e86e49437b8fffb903bd5ce2fb P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:30.467103   431 tablet_replica.cc:333] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226: stopping tablet replica
I20260709 13:01:30.467756   431 raft_consensus.cc:2243] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:30.469002   431 raft_consensus.cc:2272] T 65524f4fe7be481b9f069829076b7dc3 P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:30.495255   431 tablet_replica.cc:333] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226: stopping tablet replica
I20260709 13:01:30.495889   431 raft_consensus.cc:2243] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:30.496615   431 raft_consensus.cc:2272] T 06376ae55ce745738b930c75f0dcdf5e P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:30.499415   431 tablet_replica.cc:333] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226: stopping tablet replica
I20260709 13:01:30.500008   431 raft_consensus.cc:2243] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:01:30.525041   431 raft_consensus.cc:2272] T cb7e5d62da7842a3829b9f8247d9899c P 89ac9d5e2fbc4536b03a1ff1dd3eb226 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:30.800498  8014 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:30.801291  8014 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:30.806360  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:01:30.808843  1615 leader_election.cc:336] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:30.809434  1615 leader_election.cc:304] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:30.810427  8018 raft_consensus.cc:2749] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 13:01:30.807552  8014 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:30.824445  7989 raft_consensus.cc:493] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:30.825152  7989 raft_consensus.cc:515] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:30.830390  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
W20260709 13:01:30.843776  1689 leader_election.cc:336] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:30.844307  1689 leader_election.cc:304] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:30.845430  8015 raft_consensus.cc:2749] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:30.848048  8018 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:30.848749  8018 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:30.851326  8018 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:30.852972  7989 leader_election.cc:290] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:01:30.855597  1615 leader_election.cc:336] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:30.856046  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:30.859614  1617 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:30.862176  8014 raft_consensus.cc:2749] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:30.885305  7994 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:30.886009  7994 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:01:30.893585  2295 leader_election.cc:336] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:30.896000  7994 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:30.897653  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:30.899530  2294 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:30.900772  7994 raft_consensus.cc:2749] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:30.916867  8018 raft_consensus.cc:493] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:30.917600  8018 raft_consensus.cc:515] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:30.920812  7996 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:30.921398  7996 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:01:30.923030  1615 leader_election.cc:336] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:30.923799  7996 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:30.925216  8018 leader_election.cc:290] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:30.926117  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:01:30.926748  1615 leader_election.cc:336] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:30.927682  1617 leader_election.cc:304] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:30.929111  8018 raft_consensus.cc:2749] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:30.929105  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:30.930023  2323 raft_consensus.cc:2468] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 19.
I20260709 13:01:30.932212  7981 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:30.932788  7981 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:30.935336  7981 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:01:30.945015  2295 leader_election.cc:336] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:01:30.948081  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:30.956166  2294 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:30.957504  7994 raft_consensus.cc:2749] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:30.950448  1615 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:30.964326  7996 raft_consensus.cc:2804] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 13:01:30.965204  7996 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 19 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:30.965622  7996 raft_consensus.cc:3060] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:30.966224  7989 raft_consensus.cc:493] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:30.966928  7989 raft_consensus.cc:515] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:30.970747  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:30.972564  7989 leader_election.cc:290] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:30.987946  7996 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:30.991070  7996 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 20 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:30.995311  8018 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:30.995887  8018 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:30.998313  8018 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:31.025055  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfb3b560711b4d7eb23f2aff3e4ca991" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:01:31.025729  2332 raft_consensus.cc:3060] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 19 FOLLOWER]: Advancing to term 20
I20260709 13:01:31.025687  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:31.026551  2323 raft_consensus.cc:2468] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 16.
I20260709 13:01:31.027981  1615 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:31.030341  8018 raft_consensus.cc:2804] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:31.031025  8018 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:31.031512  8018 raft_consensus.cc:3060] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:31.062299  7989 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:31.065274  7989 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:31.069368  2332 raft_consensus.cc:2468] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 20.
I20260709 13:01:31.072958  8014 raft_consensus.cc:493] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
W20260709 13:01:31.063546  1615 leader_election.cc:336] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
W20260709 13:01:31.074644  1615 leader_election.cc:336] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
I20260709 13:01:31.075088  8015 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:31.075650  8015 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:31.078094  8015 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:31.081425  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:31.082191  1643 raft_consensus.cc:2468] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 18.
I20260709 13:01:31.084088  1688 leader_election.cc:304] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:31.085655  8013 raft_consensus.cc:2804] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 13:01:31.086097  8013 raft_consensus.cc:493] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:31.086519  8013 raft_consensus.cc:3060] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:31.073765  8014 raft_consensus.cc:515] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:31.093597  8018 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:31.098549  1615 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:31.094655  7996 raft_consensus.cc:493] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:31.095410  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:31.099275  8018 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 17 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:31.093847  7989 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:31.104183  8014 leader_election.cc:290] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:31.107965  8014 raft_consensus.cc:2804] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 20 FOLLOWER]: Leader election won for term 20
I20260709 13:01:31.108543  8014 raft_consensus.cc:697] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 20 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
W20260709 13:01:31.109333  1689 leader_election.cc:336] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
I20260709 13:01:31.109499  1721 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:31.105522  1643 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 20.
I20260709 13:01:31.110306  1721 raft_consensus.cc:2468] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 15.
I20260709 13:01:31.109882  1689 leader_election.cc:304] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:31.119102  1688 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:31.120426  7989 raft_consensus.cc:2804] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 13:01:31.120973  7989 raft_consensus.cc:493] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:31.131521  8029 raft_consensus.cc:2749] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:31.136710  7989 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:31.138360  7994 raft_consensus.cc:493] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:31.109694  8014 consensus_queue.cc:237] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:31.120999  8018 raft_consensus.cc:493] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:31.142428  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1aa00507899e41f9b595f503add14c8c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:01:31.144034  2332 raft_consensus.cc:3060] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:31.137596  8013 raft_consensus.cc:515] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:31.148054  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "650a39124682440d83bb93bb83f15979" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:31.148628  1643 raft_consensus.cc:3060] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 18 FOLLOWER]: Advancing to term 19
I20260709 13:01:31.148768  8018 raft_consensus.cc:515] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:31.151482  2332 raft_consensus.cc:2468] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 17.
I20260709 13:01:31.151654  8018 leader_election.cc:290] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:31.121830  7996 raft_consensus.cc:515] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:31.144024  7994 raft_consensus.cc:515] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:31.161772  7994 leader_election.cc:290] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:31.164072  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:31.169734  1643 raft_consensus.cc:2468] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 19.
I20260709 13:01:31.172439  1688 leader_election.cc:304] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:31.171247  1642 raft_consensus.cc:2468] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 17.
I20260709 13:01:31.159394  8013 leader_election.cc:290] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 19 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:31.174528  8018 raft_consensus.cc:493] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
W20260709 13:01:31.191200  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 81918.8us
I20260709 13:01:31.210086  2294 leader_election.cc:304] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:31.210390  8029 raft_consensus.cc:493] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:31.211292  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:31.190291  8013 raft_consensus.cc:2804] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 13:01:31.213618  1615 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
W20260709 13:01:31.244463  1615 leader_election.cc:336] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
W20260709 13:01:31.245004  1615 leader_election.cc:336] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
W20260709 13:01:31.248054  2295 leader_election.cc:336] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
I20260709 13:01:31.224196  8015 raft_consensus.cc:493] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:31.190711  8018 raft_consensus.cc:515] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:31.268661  8015 raft_consensus.cc:515] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:31.270732  8015 leader_election.cc:290] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:31.252003  8030 raft_consensus.cc:493] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
W20260709 13:01:31.256412  1689 leader_election.cc:336] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
I20260709 13:01:31.271435  7989 raft_consensus.cc:515] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:31.272274  8030 raft_consensus.cc:515] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:31.249146  8038 raft_consensus.cc:2804] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:31.273428  8038 raft_consensus.cc:697] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 17 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:31.265460  7996 leader_election.cc:290] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:31.265934  7981 raft_consensus.cc:2804] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:31.241663  8013 raft_consensus.cc:697] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 19 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:01:31.277225  7981 raft_consensus.cc:493] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:31.277910  7981 raft_consensus.cc:3060] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:31.225915  8029 raft_consensus.cc:515] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:01:31.272641  1689 leader_election.cc:336] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
W20260709 13:01:31.279763  1615 leader_election.cc:336] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
I20260709 13:01:31.255791  1473 catalog_manager.cc:5697] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 19 to 20, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 20 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:31.284574  1725 raft_consensus.cc:2468] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 13.
I20260709 13:01:31.290930  8029 leader_election.cc:290] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:01:31.293989  1617 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 92926.5us
W20260709 13:01:31.294787  2294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 84806.5us
I20260709 13:01:31.296281  8018 leader_election.cc:290] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:31.296973  8038 consensus_queue.cc:237] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:01:31.300495  1615 leader_election.cc:336] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
I20260709 13:01:31.301029  1617 leader_election.cc:304] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:31.278129  8013 consensus_queue.cc:237] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:31.310012  8036 raft_consensus.cc:2804] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:31.310510  8036 raft_consensus.cc:493] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:31.310910  8036 raft_consensus.cc:3060] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Advancing to term 16
W20260709 13:01:31.313194  1615 leader_election.cc:336] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
I20260709 13:01:31.314358  1617 leader_election.cc:304] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:31.318506  8037 raft_consensus.cc:493] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:31.319059  8037 raft_consensus.cc:515] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:31.330852  7989 leader_election.cc:290] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 21 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:31.340986  8028 raft_consensus.cc:2804] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:31.341475  8028 raft_consensus.cc:493] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:31.341832  8028 raft_consensus.cc:3060] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:31.352190  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:31.352908  1642 raft_consensus.cc:2468] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 15.
I20260709 13:01:31.354280  8041 raft_consensus.cc:493] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:31.354044  7981 raft_consensus.cc:515] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:31.354830  8041 raft_consensus.cc:515] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:31.356878  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:31.377166  8030 leader_election.cc:290] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:31.381143  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "589a395c6abe4eec80fca6d6210acf0d" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:31.381810  1646 raft_consensus.cc:3060] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 20 FOLLOWER]: Advancing to term 21
I20260709 13:01:31.383561  8037 leader_election.cc:290] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:31.384768  8030 raft_consensus.cc:493] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:31.385294  8030 raft_consensus.cc:515] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:31.389765  8030 leader_election.cc:290] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:31.391312  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:31.392076  2323 raft_consensus.cc:2393] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 18: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 13:01:31.390399  8036 raft_consensus.cc:515] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:31.392953  7981 leader_election.cc:290] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 18 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:01:31.395905  2295 leader_election.cc:336] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
W20260709 13:01:31.396584  2295 leader_election.cc:336] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
I20260709 13:01:31.405277  8041 leader_election.cc:290] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:01:31.406780  1615 leader_election.cc:336] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
W20260709 13:01:31.375555  1689 leader_election.cc:336] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
I20260709 13:01:31.416497  1615 leader_election.cc:304] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:01:31.418089  1615 leader_election.cc:336] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
I20260709 13:01:31.425675  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:31.452454  1647 raft_consensus.cc:2468] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 13.
I20260709 13:01:31.457476  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:31.452808  1688 leader_election.cc:304] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:31.457967  1646 raft_consensus.cc:2468] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 21.
I20260709 13:01:31.459121  8041 raft_consensus.cc:2804] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 13:01:31.459522  8041 raft_consensus.cc:493] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:31.459897  8041 raft_consensus.cc:3060] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:31.452117  7989 raft_consensus.cc:493] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:31.464749  7989 raft_consensus.cc:515] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:31.465791  1725 raft_consensus.cc:2468] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 11.
I20260709 13:01:31.466857  7989 leader_election.cc:290] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:31.467481  8036 leader_election.cc:290] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:31.424916  8038 raft_consensus.cc:3060] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:01:31.473791  1615 leader_election.cc:336] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
I20260709 13:01:31.478955  8038 raft_consensus.cc:2749] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:31.481130  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "05713611987147e49a96fdf32bb28649" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:31.486279  8033 raft_consensus.cc:493] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:31.486660  8028 raft_consensus.cc:515] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:31.486909  8033 raft_consensus.cc:515] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:31.487833  1643 raft_consensus.cc:2393] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 14: Already voted for candidate 4dbe7d47a2374afca075d3a98583b49e in this term.
I20260709 13:01:31.482949  1688 leader_election.cc:304] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:31.488862  8028 leader_election.cc:290] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:31.493759  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:01:31.498107  2295 leader_election.cc:336] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
W20260709 13:01:31.498333  1615 leader_election.cc:336] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
I20260709 13:01:31.500375  1688 leader_election.cc:304] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:31.489213  8033 leader_election.cc:290] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:31.500720  8013 raft_consensus.cc:2804] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:31.501361  8013 raft_consensus.cc:493] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:31.501786  8013 raft_consensus.cc:3060] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:31.502300  8032 raft_consensus.cc:2804] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 13:01:31.502909  8032 raft_consensus.cc:697] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 21 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:01:31.503798  8032 consensus_queue.cc:237] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:31.507949  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:31.508615  1725 raft_consensus.cc:2468] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 16.
I20260709 13:01:31.467955  8041 raft_consensus.cc:515] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:31.509948  1720 raft_consensus.cc:2393] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4dbe7d47a2374afca075d3a98583b49e in current term 16: Already voted for candidate 0c7751452c4b46afa95251b9df7169d4 in this term.
I20260709 13:01:31.511750  8041 leader_election.cc:290] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 16 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:31.512475  1646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71e68bb03bc047dfadd595f2484ca8f8" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:31.513397  1646 raft_consensus.cc:3060] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:31.516782  1647 raft_consensus.cc:2468] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 18.
I20260709 13:01:31.517973  2294 leader_election.cc:304] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:31.532047  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:31.532490  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:31.534730  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "896a5554fe0949399b16eb646b6446b8" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:31.535279  1725 raft_consensus.cc:3060] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Advancing to term 16
I20260709 13:01:31.535730  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df3a0b1701574816b4c9766063c65f8f" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:31.536299  1720 raft_consensus.cc:3060] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:31.520591  7981 raft_consensus.cc:2804] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 13:01:31.538861  7981 raft_consensus.cc:697] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 18 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:01:31.539831  7981 consensus_queue.cc:237] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:31.547003  2297 leader_election.cc:304] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:31.548174  8033 raft_consensus.cc:2804] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:01:31.548786  8033 raft_consensus.cc:493] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:31.549180  8033 raft_consensus.cc:3060] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:31.557638  1725 raft_consensus.cc:2468] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 16.
I20260709 13:01:31.561906  2297 leader_election.cc:304] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:31.562563  8013 raft_consensus.cc:515] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:31.563669  8037 raft_consensus.cc:2749] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:01:31.566087  8013 leader_election.cc:290] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:31.568305  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "776886dda1a14393a13f8003a58c45d0" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:31.568897  1647 raft_consensus.cc:3060] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:31.571085  2323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
I20260709 13:01:31.580261  1617 leader_election.cc:304] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:31.581779  1617 leader_election.cc:304] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:31.582746  8030 raft_consensus.cc:2804] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:31.583155  8030 raft_consensus.cc:493] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:31.583499  8030 raft_consensus.cc:3060] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:31.586922  8032 raft_consensus.cc:493] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:31.587484  8032 raft_consensus.cc:515] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:31.590042  8032 leader_election.cc:290] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:31.590997  1643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:31.592832  1643 raft_consensus.cc:2468] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 16.
I20260709 13:01:31.591078  1467 catalog_manager.cc:5697] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 18 to 19, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 19 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:31.593256  2332 raft_consensus.cc:1275] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 20 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 13:01:31.594064  1688 leader_election.cc:304] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:31.595255  8013 raft_consensus.cc:2804] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 13:01:31.595656  8013 raft_consensus.cc:493] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:31.596032  8013 raft_consensus.cc:3060] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:31.600281  8028 consensus_queue.cc:1048] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:01:31.606855  1647 raft_consensus.cc:2468] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 14.
I20260709 13:01:31.607903  1688 leader_election.cc:304] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:31.612799  8032 raft_consensus.cc:2804] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:31.613555  8032 raft_consensus.cc:697] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 14 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:01:31.614615  8032 consensus_queue.cc:237] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:31.627974  1646 raft_consensus.cc:2468] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 16.
I20260709 13:01:31.628593  8036 raft_consensus.cc:2749] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:31.628351  8030 raft_consensus.cc:515] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:31.628012  8033 raft_consensus.cc:515] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:31.632941  1688 leader_election.cc:304] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:31.634142  2323 raft_consensus.cc:2393] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c7751452c4b46afa95251b9df7169d4 in current term 12: Already voted for candidate 05476b84d8f84d76a9a1f51b620a3c66 in this term.
I20260709 13:01:31.636258  1617 leader_election.cc:304] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:31.637992  1720 raft_consensus.cc:2468] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 14.
W20260709 13:01:31.641050  2295 leader_election.cc:336] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
I20260709 13:01:31.643776  1617 leader_election.cc:304] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:31.642220  8036 raft_consensus.cc:2749] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:31.644937  8031 raft_consensus.cc:2804] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:31.645576  8041 raft_consensus.cc:493] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:31.645871  8030 leader_election.cc:290] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 17 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:31.646124  8041 raft_consensus.cc:515] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:31.647516  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "566c1a1cfdfa47a2aee520e28f352064" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:31.648056  1725 raft_consensus.cc:3060] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:01:31.649955  8041 leader_election.cc:290] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:01:31.652041  1689 leader_election.cc:336] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
W20260709 13:01:31.652771  1689 leader_election.cc:336] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
I20260709 13:01:31.654266  1647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:31.651036  8039 raft_consensus.cc:2804] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Leader election won for term 16
I20260709 13:01:31.655236  1725 raft_consensus.cc:2468] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 12.
I20260709 13:01:31.653016  8031 raft_consensus.cc:697] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 16 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:01:31.656875  2297 leader_election.cc:304] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:31.657382  8031 consensus_queue.cc:237] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:31.657972  8037 raft_consensus.cc:2804] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 13:01:31.659379  1689 leader_election.cc:336] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
W20260709 13:01:31.660136  1689 leader_election.cc:336] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
I20260709 13:01:31.660472  1689 leader_election.cc:304] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:31.661254  7989 raft_consensus.cc:2749] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:31.658560  8037 raft_consensus.cc:697] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:01:31.665064  8039 raft_consensus.cc:697] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 16 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:31.665997  8037 consensus_queue.cc:237] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:01:31.669580  1615 leader_election.cc:336] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
I20260709 13:01:31.666045  8039 consensus_queue.cc:237] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:31.653482  8033 leader_election.cc:290] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:31.676343  8035 raft_consensus.cc:493] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:31.676955  8035 raft_consensus.cc:515] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:31.680022  1723 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4e8f73323404a27b6ef964e10902d91" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:31.680649  1723 raft_consensus.cc:3060] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:31.681489  1617 leader_election.cc:304] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:01:31.681597  1689 leader_election.cc:336] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
I20260709 13:01:31.686065  8018 raft_consensus.cc:2804] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:31.686645  8018 raft_consensus.cc:697] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 14 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:31.687541  8018 consensus_queue.cc:237] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:31.688871  8035 leader_election.cc:290] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:31.694433  1723 raft_consensus.cc:2468] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 17.
I20260709 13:01:31.708721  2332 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 13:01:31.709440  1689 leader_election.cc:336] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
I20260709 13:01:31.709585  2332 raft_consensus.cc:2468] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 12.
I20260709 13:01:31.713912  8036 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:31.714224  8038 raft_consensus.cc:493] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:31.714709  8036 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:31.714811  8038 raft_consensus.cc:515] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:31.710167  1689 leader_election.cc:304] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:01:31.731810  1689 leader_election.cc:336] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
I20260709 13:01:31.735214  1617 leader_election.cc:304] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:01:31.744865  1615 consensus_peers.cc:597] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:31.747074  8036 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:31.733392  8031 raft_consensus.cc:2749] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:31.750679  8028 raft_consensus.cc:2804] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:31.751317  8028 raft_consensus.cc:697] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 17 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:31.756263  8038 leader_election.cc:290] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:31.736265  1689 leader_election.cc:304] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
W20260709 13:01:31.762677  1615 consensus_peers.cc:597] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:31.766250  1689 consensus_peers.cc:597] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:31.752372  8028 consensus_queue.cc:237] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:31.766790  1472 catalog_manager.cc:5697] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 17 to 18, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 18 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:31.765988  8032 raft_consensus.cc:2804] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:01:31.768134  8032 raft_consensus.cc:493] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:31.768505  8032 raft_consensus.cc:3060] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:01:31.778004  1689 leader_election.cc:336] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
W20260709 13:01:31.779116  1689 leader_election.cc:336] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
I20260709 13:01:31.779597  1689 leader_election.cc:304] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:31.785874  1647 raft_consensus.cc:1275] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 19 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 13:01:31.787680  8031 consensus_queue.cc:1048] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:31.789295  1720 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:31.790092  1725 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
W20260709 13:01:31.791188  1689 consensus_peers.cc:597] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:31.781375  8041 raft_consensus.cc:2749] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:01:31.793325  1689 leader_election.cc:336] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
I20260709 13:01:31.777577  8032 raft_consensus.cc:515] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:01:31.872362  1615 leader_election.cc:336] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
W20260709 13:01:31.873049  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 69203.7us
W20260709 13:01:31.874851  1615 leader_election.cc:336] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
W20260709 13:01:31.873714  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 69192.2us
I20260709 13:01:31.888285  1725 raft_consensus.cc:2468] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 13.
I20260709 13:01:31.890888  8013 raft_consensus.cc:515] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:31.913698  8013 leader_election.cc:290] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 17 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:31.916822  1617 leader_election.cc:304] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4dbe7d47a2374afca075d3a98583b49e; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:31.926676  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03f18dbd16bd4b9eb22229aed3da4413" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:31.927485  1651 raft_consensus.cc:3060] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Advancing to term 17
I20260709 13:01:31.934809  1617 leader_election.cc:304] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:31.945916  8039 raft_consensus.cc:2804] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:31.946419  8039 raft_consensus.cc:493] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:31.946815  8039 raft_consensus.cc:3060] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:31.936666  8014 raft_consensus.cc:2749] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:31.957864  8032 leader_election.cc:290] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:31.961104  1467 catalog_manager.cc:5697] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 20 to 21, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 21 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:31.963085  1467 catalog_manager.cc:5697] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 13 to 14, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 14 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:31.965771  1651 raft_consensus.cc:2468] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 17.
W20260709 13:01:31.974349   431 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 1597)
I20260709 13:01:31.981280  1467 catalog_manager.cc:5697] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 15 to 16, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 16 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
W20260709 13:01:31.983666  1688 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37391, user_credentials={real_user=slave}} blocked reactor thread for 46435.5us
I20260709 13:01:31.985910  8039 raft_consensus.cc:515] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:31.988075  8039 leader_election.cc:290] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:31.995738  1688 leader_election.cc:304] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
W20260709 13:01:31.996831  2295 consensus_peers.cc:597] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:31.997025  1473 catalog_manager.cc:5697] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 16 to 17, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 17 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:32.000950  8031 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:32.001540  8031 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:32.003720  8031 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:01:32.004993  1689 leader_election.cc:336] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
W20260709 13:01:32.005529  1689 leader_election.cc:336] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
I20260709 13:01:32.007777  8013 raft_consensus.cc:2804] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 13:01:32.007856  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "454808fe3b6f48ab9fed193478d28abc" candidate_uuid: "4dbe7d47a2374afca075d3a98583b49e" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:32.008649  1716 raft_consensus.cc:3060] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:32.008594  8013 raft_consensus.cc:697] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 17 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
I20260709 13:01:32.010385  8013 consensus_queue.cc:237] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:32.014539  1472 catalog_manager.cc:5697] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 11 to 12, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 12 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:32.016206  1651 raft_consensus.cc:1275] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 21 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
W20260709 13:01:32.019112  1689 consensus_peers.cc:597] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:32.019994  1689 consensus_peers.cc:597] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:32.022413  8035 consensus_queue.cc:1048] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 13:01:32.000941  1473 catalog_manager.cc:5697] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 15 to 16, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 16 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:32.031870  1689 leader_election.cc:336] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
I20260709 13:01:32.033241  1642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e" is_pre_election: true
I20260709 13:01:32.034114  1642 raft_consensus.cc:2468] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 17.
W20260709 13:01:32.034732  1689 consensus_peers.cc:597] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:32.036438  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3ba8e707693e4af2b8347a4bad4dfd67" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66"
I20260709 13:01:32.037070  2327 raft_consensus.cc:3060] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:01:32.035167  1473 catalog_manager.cc:5697] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 13 to 14, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 14 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:32.026727  1716 raft_consensus.cc:2468] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4dbe7d47a2374afca075d3a98583b49e in term 14.
I20260709 13:01:32.042300  1617 leader_election.cc:304] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:32.043103  8030 raft_consensus.cc:2804] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:01:32.046093  2323 raft_consensus.cc:1275] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 13:01:32.046957  2327 raft_consensus.cc:2468] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 13.
W20260709 13:01:32.050148  1615 consensus_peers.cc:597] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:32.051390  1615 consensus_peers.cc:597] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:32.049954  1688 leader_election.cc:304] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:32.057755  1643 raft_consensus.cc:1275] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 18 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 13:01:32.057816  8030 raft_consensus.cc:697] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 14 LEADER]: Becoming Leader. State: Replica: 4dbe7d47a2374afca075d3a98583b49e, State: Running, Role: LEADER
I20260709 13:01:32.043066  1473 catalog_manager.cc:5697] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 16 to 17, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 17 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:32.063158  8030 consensus_queue.cc:237] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:01:32.065150  2295 consensus_peers.cc:597] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:32.067853  8035 raft_consensus.cc:2804] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 13:01:32.073047  8035 raft_consensus.cc:493] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 89ac9d5e2fbc4536b03a1ff1dd3eb226)
I20260709 13:01:32.073516  8035 raft_consensus.cc:3060] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 17 FOLLOWER]: Advancing to term 18
I20260709 13:01:32.079805  8040 consensus_queue.cc:1048] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 13:01:32.083159  1689 leader_election.cc:304] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:32.086257  8032 raft_consensus.cc:2804] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:01:32.086892  8032 raft_consensus.cc:697] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 13 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
W20260709 13:01:32.087723  2295 consensus_peers.cc:597] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:32.087968  8032 consensus_queue.cc:237] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:01:32.091377  2295 consensus_peers.cc:597] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:32.099155  1643 raft_consensus.cc:1275] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 13:01:32.115574  1615 leader_election.cc:336] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
W20260709 13:01:32.116489  1615 consensus_peers.cc:597] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:32.125140  8064 consensus_queue.cc:1048] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.004s
I20260709 13:01:32.141599  1651 raft_consensus.cc:1275] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 13:01:32.140420  1473 catalog_manager.cc:5697] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 16 to 17, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 17 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:32.144892  1720 raft_consensus.cc:1275] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 13:01:32.166302  8061 consensus_queue.cc:1048] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260709 13:01:32.159106  8013 consensus_queue.cc:1048] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
W20260709 13:01:32.176668  1689 consensus_peers.cc:597] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:32.190843  1725 raft_consensus.cc:1275] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 17 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 13:01:32.178766  8066 consensus_queue.cc:1048] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
W20260709 13:01:32.193502  2295 consensus_peers.cc:597] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:32.194319  1725 raft_consensus.cc:1275] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Refusing update from remote peer 05476b84d8f84d76a9a1f51b620a3c66: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
W20260709 13:01:32.200043  2295 consensus_peers.cc:597] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:32.200515  2295 consensus_peers.cc:597] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:32.211223  8040 consensus_queue.cc:1048] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:01:32.212217  8035 raft_consensus.cc:515] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:32.234485  8035 leader_election.cc:290] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 18 election: Requested vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:32.236202  1651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb7e5d62da7842a3829b9f8247d9899c" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "4dbe7d47a2374afca075d3a98583b49e"
I20260709 13:01:32.236902  1651 raft_consensus.cc:3060] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Advancing to term 18
W20260709 13:01:32.241019  1615 consensus_peers.cc:597] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:32.242777  1689 consensus_peers.cc:597] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:32.246192  1615 consensus_peers.cc:597] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:32.246676  1615 consensus_peers.cc:597] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:32.248651  1716 raft_consensus.cc:1275] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:01:32.272616  1651 raft_consensus.cc:2468] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c7751452c4b46afa95251b9df7169d4 in term 18.
I20260709 13:01:32.274144  1688 leader_election.cc:304] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e; no voters: 
I20260709 13:01:32.275655  8032 raft_consensus.cc:2804] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 13:01:32.280329  1615 consensus_peers.cc:597] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:32.280843  8032 raft_consensus.cc:697] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 18 LEADER]: Becoming Leader. State: Replica: 0c7751452c4b46afa95251b9df7169d4, State: Running, Role: LEADER
W20260709 13:01:32.281999  2295 consensus_peers.cc:597] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:32.281859  8032 consensus_queue.cc:237] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:32.268149  8061 consensus_queue.cc:1048] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
W20260709 13:01:32.287525  1615 consensus_peers.cc:597] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:32.288264  1615 consensus_peers.cc:597] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:32.251020  8064 consensus_queue.cc:1048] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.055s
I20260709 13:01:32.310679  1473 catalog_manager.cc:5697] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e reported cstate change: term changed from 13 to 14, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194). New cstate: current_term: 14 leader_uuid: "4dbe7d47a2374afca075d3a98583b49e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:32.385950  2295 consensus_peers.cc:597] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:32.397231  1615 consensus_peers.cc:597] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:32.399181  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 110351us
W20260709 13:01:32.414197  1689 leader_election.cc:336] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
W20260709 13:01:32.425592  1689 consensus_peers.cc:597] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:32.428853  1689 consensus_peers.cc:597] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:32.429375  1689 consensus_peers.cc:597] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:32.437399  1689 consensus_peers.cc:597] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:32.457414  1615 consensus_peers.cc:597] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:32.468287  2295 consensus_peers.cc:597] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:32.468869  2295 consensus_peers.cc:597] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:01:32.497377  1473 catalog_manager.cc:5697] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 12 to 13, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 13 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:01:32.504323  1689 consensus_peers.cc:597] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:32.505044  1689 consensus_peers.cc:597] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:32.486104  1615 consensus_peers.cc:597] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:32.506162  1689 consensus_peers.cc:597] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:32.510599  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 194545us
W20260709 13:01:32.538242  1615 consensus_peers.cc:597] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:32.539351  1615 consensus_peers.cc:597] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:32.539824  2295 consensus_peers.cc:597] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:32.539855  1615 consensus_peers.cc:597] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:32.540580  1615 consensus_peers.cc:597] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:32.551307  1615 consensus_peers.cc:597] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:32.573974  2295 consensus_peers.cc:597] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:32.593421  1615 consensus_peers.cc:597] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:32.639061  1642 raft_consensus.cc:1275] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 13:01:32.640573  8029 consensus_queue.cc:1048] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:01:32.687404  1473 catalog_manager.cc:5697] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: term changed from 17 to 18, leader changed from 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) to 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195). New cstate: current_term: 18 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:32.704061  2327 raft_consensus.cc:1275] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 13:01:32.707294  1723 raft_consensus.cc:1275] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Refusing update from remote peer 4dbe7d47a2374afca075d3a98583b49e: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:01:32.725677  8065 consensus_queue.cc:1048] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:01:32.732441  8061 consensus_queue.cc:1048] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 13:01:32.755235  1689 consensus_peers.cc:597] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:32.867285  1643 raft_consensus.cc:1275] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 18 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 13:01:32.868995  8066 consensus_queue.cc:1048] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.008s
W20260709 13:01:32.889901  1689 consensus_peers.cc:597] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:32.974857   431 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 1597)
W20260709 13:01:33.975407   431 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 1597)
W20260709 13:01:34.124323  1689 consensus_peers.cc:597] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:34.267438  1689 consensus_peers.cc:597] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:34.273407  2295 consensus_peers.cc:597] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:34.387660  1689 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111) [suppressed 441 similar messages]
W20260709 13:01:34.402644  2295 consensus_peers.cc:597] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:34.466284  1689 consensus_peers.cc:597] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:34.466845  1689 consensus_peers.cc:597] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:34.493770  1689 consensus_peers.cc:597] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:34.551365  1689 consensus_peers.cc:597] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:34.562480  2295 consensus_peers.cc:597] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:34.611809  2295 consensus_peers.cc:597] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:34.630460  1689 consensus_peers.cc:597] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:34.633553  2295 consensus_peers.cc:597] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:34.698401  1689 consensus_peers.cc:597] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:34.699671  2295 consensus_peers.cc:597] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:34.708662  2295 consensus_peers.cc:597] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:34.726943  2295 consensus_peers.cc:597] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:34.743683  1689 consensus_peers.cc:597] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:34.783705  2295 consensus_peers.cc:597] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:34.852737  1689 consensus_peers.cc:597] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:34.895183  2295 consensus_peers.cc:597] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:34.925477  2295 consensus_peers.cc:597] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:34.926437  1689 consensus_peers.cc:597] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:34.932256  1689 consensus_peers.cc:597] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:34.975797   431 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 1597)
W20260709 13:01:35.010456  2295 consensus_peers.cc:597] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:35.077001  2295 consensus_peers.cc:597] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:35.128432  1689 consensus_peers.cc:597] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:35.172868  1615 consensus_peers.cc:597] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:35.173399  1615 consensus_peers.cc:597] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:35.176949  1615 consensus_peers.cc:597] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:35.177446  1615 consensus_peers.cc:597] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:35.177928  1615 consensus_peers.cc:597] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:35.178330  1615 consensus_peers.cc:597] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:35.288704  1689 consensus_peers.cc:597] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:35.289259  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 108638us
W20260709 13:01:35.304863  1615 consensus_peers.cc:597] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:35.339624  1615 consensus_peers.cc:597] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:35.340238  1615 consensus_peers.cc:597] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:35.340806  1615 consensus_peers.cc:597] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:35.331506  1689 consensus_peers.cc:597] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:35.380916  1615 consensus_peers.cc:597] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:35.382396  1615 consensus_peers.cc:597] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:35.414667  1615 consensus_peers.cc:597] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:35.418208  1689 consensus_peers.cc:597] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:35.462205  1615 consensus_peers.cc:597] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:35.476024  1615 consensus_peers.cc:597] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:35.484413  1615 consensus_peers.cc:597] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:35.551298  1615 consensus_peers.cc:597] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:35.707682  1615 consensus_peers.cc:597] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:35.905962  1615 consensus_peers.cc:597] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:35.976346   431 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 1597)
W20260709 13:01:35.992568  1615 consensus_peers.cc:597] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:36.585602  1689 consensus_peers.cc:597] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:36.667821  1689 consensus_peers.cc:597] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:36.806391  1689 consensus_peers.cc:597] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:36.842545  1689 consensus_peers.cc:597] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:36.912092  1689 consensus_peers.cc:597] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:36.931046  1689 consensus_peers.cc:597] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:36.977487   431 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 1597)
W20260709 13:01:36.991412  2295 consensus_peers.cc:597] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:37.024286  2295 consensus_peers.cc:597] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:37.051926  2295 consensus_peers.cc:597] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:37.055019  1689 consensus_peers.cc:597] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:37.124316  2295 consensus_peers.cc:597] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:37.172233  2295 consensus_peers.cc:597] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:37.173308  1689 consensus_peers.cc:597] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:37.205333  1615 consensus_peers.cc:597] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:37.254442  1615 consensus_peers.cc:597] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:37.294920  2295 consensus_peers.cc:597] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:37.392647  1689 consensus_peers.cc:597] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:37.395110  2295 consensus_peers.cc:597] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:37.409222  2295 consensus_peers.cc:597] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:37.415134  1689 consensus_peers.cc:597] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:37.447454  1615 consensus_peers.cc:597] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:37.483783  2295 consensus_peers.cc:597] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:37.497570  1615 consensus_peers.cc:597] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:37.500999  1689 consensus_peers.cc:597] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:37.535010  1615 consensus_peers.cc:597] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:37.536815  2295 consensus_peers.cc:597] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:37.550323  1689 consensus_peers.cc:597] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:37.562500  2295 consensus_peers.cc:597] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:37.572002  1615 consensus_peers.cc:597] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:37.582072  1689 consensus_peers.cc:597] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:37.590117  1615 consensus_peers.cc:597] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:37.621218  1615 consensus_peers.cc:597] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:37.661899  2295 consensus_peers.cc:597] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:37.667239  2295 consensus_peers.cc:597] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:37.677897  1615 consensus_peers.cc:597] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:37.696648  1615 consensus_peers.cc:597] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:37.701733  1689 consensus_peers.cc:597] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:37.714249  1689 consensus_peers.cc:597] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:37.910754  1689 consensus_peers.cc:597] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:37.909765  1615 consensus_peers.cc:597] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:37.936094  1615 consensus_peers.cc:597] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:37.977957   431 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 1597)
W20260709 13:01:38.000931  1615 consensus_peers.cc:597] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:38.001451  1615 consensus_peers.cc:597] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:38.006348  1615 consensus_peers.cc:597] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:38.026978  1615 consensus_peers.cc:597] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:38.308616  1615 consensus_peers.cc:597] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:38.600570  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 85937.1us
W20260709 13:01:38.609488  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 82506.5us
W20260709 13:01:38.658041  1615 consensus_peers.cc:597] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:38.688938  1615 consensus_peers.cc:597] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:38.813436  1615 consensus_peers.cc:597] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:01:38.978479   431 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 1597)
W20260709 13:01:39.294603  1689 consensus_peers.cc:597] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:39.304625  1689 consensus_peers.cc:597] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:39.341499  1689 consensus_peers.cc:597] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:39.342228  1689 consensus_peers.cc:597] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:39.347905  1689 consensus_peers.cc:597] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:39.388926  1672 debug-util.cc:398] Leaking SignalData structure 0x7b0800347040 after lost signal to thread 434
W20260709 13:01:39.390846  1672 debug-util.cc:398] Leaking SignalData structure 0x7b08003a67e0 after lost signal to thread 1508
W20260709 13:01:39.393040  1672 debug-util.cc:398] Leaking SignalData structure 0x7b08002adbe0 after lost signal to thread 1675
W20260709 13:01:39.395295  1672 debug-util.cc:398] Leaking SignalData structure 0x7b08003f0660 after lost signal to thread 1749
W20260709 13:01:39.397536  1672 debug-util.cc:398] Leaking SignalData structure 0x7b08001ea840 after lost signal to thread 2356
W20260709 13:01:39.404467  1689 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111) [suppressed 469 similar messages]
W20260709 13:01:39.406831  1689 consensus_peers.cc:597] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:39.513708  2295 consensus_peers.cc:597] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:39.548059  2295 consensus_peers.cc:597] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:39.560112  1689 consensus_peers.cc:597] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:39.567138  2295 consensus_peers.cc:597] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:39.653576  1615 consensus_peers.cc:597] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:39.663046  1615 consensus_peers.cc:597] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:39.667979  2295 consensus_peers.cc:597] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:39.757742  1615 consensus_peers.cc:597] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:39.773530  1615 consensus_peers.cc:597] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:39.776575  1689 consensus_peers.cc:597] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:39.810948  2295 consensus_peers.cc:597] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:39.881919  2295 consensus_peers.cc:597] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:39.882968  1689 consensus_peers.cc:597] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:39.917161  2295 consensus_peers.cc:597] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:39.919914  1615 consensus_peers.cc:597] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:39.940303  2295 consensus_peers.cc:597] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:39.979197   431 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 1597)
W20260709 13:01:40.014910  1615 consensus_peers.cc:597] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:40.033617  2295 consensus_peers.cc:597] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:40.054872  1615 consensus_peers.cc:597] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:40.068894  2295 consensus_peers.cc:597] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:40.100695  1615 consensus_peers.cc:597] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:40.134960  1689 consensus_peers.cc:597] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:40.135718  1689 consensus_peers.cc:597] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:40.167163  1615 consensus_peers.cc:597] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:40.175273  2295 consensus_peers.cc:597] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:40.187453  2295 consensus_peers.cc:597] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:40.236001  1689 consensus_peers.cc:597] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:40.289009  1689 consensus_peers.cc:597] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:40.327025  2295 consensus_peers.cc:597] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:40.349373  1615 consensus_peers.cc:597] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:40.370224  1689 consensus_peers.cc:597] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:40.382285  1615 consensus_peers.cc:597] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:40.382882  1615 consensus_peers.cc:597] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:40.428668  1689 consensus_peers.cc:597] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:40.457849  1689 consensus_peers.cc:597] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:40.480139  1615 consensus_peers.cc:597] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:40.624884  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:34423, user_credentials={real_user=slave}} blocked reactor thread for 44604.6us
W20260709 13:01:40.651233  1615 consensus_peers.cc:597] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:40.686858  1615 consensus_peers.cc:597] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:40.927556  1615 consensus_peers.cc:597] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:40.953289  1615 consensus_peers.cc:597] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:40.979708   431 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 1597)
W20260709 13:01:41.037000  1615 consensus_peers.cc:597] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:41.164428  1615 consensus_peers.cc:597] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:41.279953  1615 consensus_peers.cc:597] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:01:41.777263  1689 consensus_peers.cc:597] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:41.878981  1689 consensus_peers.cc:597] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:41.885133  2295 consensus_peers.cc:597] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:41.892988  1689 consensus_peers.cc:597] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:41.905903  1689 consensus_peers.cc:597] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:41.906379  1689 consensus_peers.cc:597] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:41.918517  1689 consensus_peers.cc:597] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:41.951556  2295 consensus_peers.cc:597] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:41.955291  1615 consensus_peers.cc:597] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:41.980197   431 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 1597)
W20260709 13:01:41.987252  1615 consensus_peers.cc:597] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:42.047430  1689 consensus_peers.cc:597] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:42.071725  1615 consensus_peers.cc:597] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:42.114391  2295 consensus_peers.cc:597] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:42.130116  2295 consensus_peers.cc:597] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:42.144611  2295 consensus_peers.cc:597] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:42.147063  1615 consensus_peers.cc:597] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:42.239271  1615 consensus_peers.cc:597] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:42.237172  1689 consensus_peers.cc:597] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:42.273913  1615 consensus_peers.cc:597] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:42.305935  2295 consensus_peers.cc:597] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:42.382792  1689 consensus_peers.cc:597] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:42.408805  2295 consensus_peers.cc:597] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:42.464207  1689 consensus_peers.cc:597] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:42.493659  2295 consensus_peers.cc:597] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:42.553468  2295 consensus_peers.cc:597] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:42.553951  2295 consensus_peers.cc:597] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:42.574582  2295 consensus_peers.cc:597] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:42.576972  2295 consensus_peers.cc:597] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:42.614043  2295 consensus_peers.cc:597] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:42.614780  1615 consensus_peers.cc:597] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:42.680757  1689 consensus_peers.cc:597] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:42.698717  1615 consensus_peers.cc:597] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:42.704267  1689 consensus_peers.cc:597] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:42.746791  1689 consensus_peers.cc:597] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:42.842031  1615 consensus_peers.cc:597] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:42.848896  1615 consensus_peers.cc:597] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:42.849500  1689 consensus_peers.cc:597] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:42.872653  1615 consensus_peers.cc:597] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:42.892937  1689 consensus_peers.cc:597] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:42.953416  1689 consensus_peers.cc:597] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:42.980765   431 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 1597)
W20260709 13:01:43.023170  1615 consensus_peers.cc:597] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:43.023883  1615 consensus_peers.cc:597] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:43.270931  1615 consensus_peers.cc:597] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:43.280875  1615 consensus_peers.cc:597] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:43.327991  1615 consensus_peers.cc:597] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:43.367796  1615 consensus_peers.cc:597] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:43.443461  1615 consensus_peers.cc:597] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:01:43.678220  1615 consensus_peers.cc:597] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:43.720427  1615 consensus_peers.cc:597] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:43.981366   431 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 1597)
W20260709 13:01:44.089409  1689 consensus_peers.cc:597] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:44.164213  1689 consensus_peers.cc:597] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:44.276978  2295 consensus_peers.cc:597] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:44.295006  1615 consensus_peers.cc:597] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:44.302331  1689 consensus_peers.cc:597] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:44.375166  1689 consensus_peers.cc:597] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:44.376499  1615 consensus_peers.cc:597] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:44.400372  1689 consensus_peers.cc:597] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:44.404716  1689 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111) [suppressed 490 similar messages]
W20260709 13:01:44.419427  2295 consensus_peers.cc:597] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:44.423381  2295 consensus_peers.cc:597] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:44.429522  1689 consensus_peers.cc:597] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:44.435016  1615 consensus_peers.cc:597] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:44.470121  1615 consensus_peers.cc:597] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:44.512063  1689 consensus_peers.cc:597] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:44.519531  2295 consensus_peers.cc:597] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:44.561625  2295 consensus_peers.cc:597] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:44.610309  1689 consensus_peers.cc:597] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:44.654047  1615 consensus_peers.cc:597] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:44.786744  1615 consensus_peers.cc:597] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:44.797468  2295 consensus_peers.cc:597] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:44.810210  1689 consensus_peers.cc:597] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:44.917151  1689 consensus_peers.cc:597] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:44.933504  2295 consensus_peers.cc:597] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:44.982336   431 thread.cc:527] Waited for 14000ms trying to join with diag-logger (tid 1597)
W20260709 13:01:45.059427  2295 consensus_peers.cc:597] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:45.070922  1689 consensus_peers.cc:597] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:45.123615  2295 consensus_peers.cc:597] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:45.202411  2295 consensus_peers.cc:597] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:45.218030  1689 consensus_peers.cc:597] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:45.244676  2295 consensus_peers.cc:597] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:45.263201  1615 consensus_peers.cc:597] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:45.296140  2295 consensus_peers.cc:597] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:45.368748  1615 consensus_peers.cc:597] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:45.379420  1689 consensus_peers.cc:597] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:45.380084  1689 consensus_peers.cc:597] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:45.403266  1615 consensus_peers.cc:597] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:45.425084  1615 consensus_peers.cc:597] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:45.450603  2295 consensus_peers.cc:597] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:45.467020  1615 consensus_peers.cc:597] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:45.490531  1615 consensus_peers.cc:597] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:45.516439  1615 consensus_peers.cc:597] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:45.572350  1689 consensus_peers.cc:597] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:45.599285  1615 consensus_peers.cc:597] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:45.615988  1689 consensus_peers.cc:597] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:45.624505  1615 consensus_peers.cc:597] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:45.649884  1615 consensus_peers.cc:597] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:45.893575  1615 consensus_peers.cc:597] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:45.954967  1615 consensus_peers.cc:597] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 13:01:45.983026   431 thread.cc:527] Waited for 15000ms trying to join with diag-logger (tid 1597)
W20260709 13:01:46.176590  1615 consensus_peers.cc:597] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:46.193641  1615 consensus_peers.cc:597] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:46.516188  1689 consensus_peers.cc:597] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:46.575022  1615 consensus_peers.cc:597] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:46.642071  1689 consensus_peers.cc:597] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:46.716073  2295 consensus_peers.cc:597] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:46.717080  1689 consensus_peers.cc:597] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:46.755487  1615 consensus_peers.cc:597] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:46.756141  1689 consensus_peers.cc:597] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:46.757642  1689 consensus_peers.cc:597] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:46.825541  1689 consensus_peers.cc:597] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:46.880067  1615 consensus_peers.cc:597] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:46.884300  1689 consensus_peers.cc:597] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:46.957572  2295 consensus_peers.cc:597] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:46.966820  1615 consensus_peers.cc:597] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:46.983980   431 thread.cc:527] Waited for 16000ms trying to join with diag-logger (tid 1597)
W20260709 13:01:46.975930  1615 consensus_peers.cc:597] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:47.007551  1615 consensus_peers.cc:597] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:47.099027  1689 consensus_peers.cc:597] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:47.190711  2295 consensus_peers.cc:597] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:47.191767  2295 consensus_peers.cc:597] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:47.206872  2295 consensus_peers.cc:597] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:47.207504  2295 consensus_peers.cc:597] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:47.306507  1689 consensus_peers.cc:597] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:47.391923  1689 consensus_peers.cc:597] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:47.460090  1689 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 59454us
W20260709 13:01:47.471763  2295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 70189.3us
W20260709 13:01:47.494892  2295 consensus_peers.cc:597] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:47.514922  1689 consensus_peers.cc:597] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:47.566316  2295 consensus_peers.cc:597] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:47.593904  1689 consensus_peers.cc:597] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:47.643263  1689 consensus_peers.cc:597] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:47.655951  1615 consensus_peers.cc:597] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:47.700600  2295 consensus_peers.cc:597] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:47.809329  2295 consensus_peers.cc:597] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:47.819648  2295 consensus_peers.cc:597] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:47.834014  2295 consensus_peers.cc:597] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:47.879112  1615 consensus_peers.cc:597] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:47.901454  2295 consensus_peers.cc:597] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:47.936510  1615 consensus_peers.cc:597] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:47.939018  1615 consensus_peers.cc:597] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:47.945998  1689 consensus_peers.cc:597] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:48.027647  1615 consensus_peers.cc:597] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:48.042992  1615 consensus_peers.cc:597] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:48.064028  1689 consensus_peers.cc:597] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:48.153277  1615 consensus_peers.cc:597] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:48.158581  1615 consensus_peers.cc:597] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:48.162293  1615 consensus_peers.cc:597] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:48.198590  1615 consensus_peers.cc:597] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:48.263278  1689 consensus_peers.cc:597] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:48.401075  1615 consensus_peers.cc:597] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:48.408831  1615 consensus_peers.cc:597] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 13:01:48.951711  1615 consensus_peers.cc:597] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:48.977826  1615 consensus_peers.cc:597] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:49.026297  1689 consensus_peers.cc:597] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:49.067025  1689 consensus_peers.cc:597] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:49.104689  1689 consensus_peers.cc:597] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:49.378456  1689 consensus_peers.cc:597] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:49.407694  1689 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111) [suppressed 476 similar messages]
W20260709 13:01:49.442921  1689 consensus_peers.cc:597] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:49.455659  2295 consensus_peers.cc:597] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:49.487897  2295 consensus_peers.cc:597] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:49.500138  1615 consensus_peers.cc:597] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:49.530274  2295 consensus_peers.cc:597] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:49.546988  2295 consensus_peers.cc:597] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:49.572111  1615 consensus_peers.cc:597] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:49.566159  1689 consensus_peers.cc:597] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:49.607226  2295 consensus_peers.cc:597] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:49.637426  2295 consensus_peers.cc:597] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:49.643735  1615 consensus_peers.cc:597] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:49.644505  1615 consensus_peers.cc:597] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:49.645149  1615 consensus_peers.cc:597] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:49.660173  1615 consensus_peers.cc:597] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:49.675488  1689 consensus_peers.cc:597] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:49.694474  1505 debug-util.cc:398] Leaking SignalData structure 0x7b08001776a0 after lost signal to thread 434
W20260709 13:01:49.696247  1505 debug-util.cc:398] Leaking SignalData structure 0x7b0800218c40 after lost signal to thread 1508
W20260709 13:01:49.695205  1689 consensus_peers.cc:597] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:49.698297  1505 debug-util.cc:398] Leaking SignalData structure 0x7b08003e0c00 after lost signal to thread 1675
W20260709 13:01:49.700012  1505 debug-util.cc:398] Leaking SignalData structure 0x7b08001cca40 after lost signal to thread 1749
W20260709 13:01:49.701969  1505 debug-util.cc:398] Leaking SignalData structure 0x7b08002903a0 after lost signal to thread 2356
W20260709 13:01:49.745440  1689 consensus_peers.cc:597] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:01:49.767751   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:01:49.983807  1689 consensus_peers.cc:597] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:01:50.076313   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:01:50.092095  1688 consensus_peers.cc:597] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Couldn't send request to peer 4dbe7d47a2374afca075d3a98583b49e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:50.092893  1688 consensus_peers.cc:597] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 -> Peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Couldn't send request to peer 4dbe7d47a2374afca075d3a98583b49e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:50.096266  1688 consensus_peers.cc:597] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Couldn't send request to peer 4dbe7d47a2374afca075d3a98583b49e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:50.119223  2295 consensus_peers.cc:597] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:50.128813  2294 consensus_peers.cc:597] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Couldn't send request to peer 4dbe7d47a2374afca075d3a98583b49e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:50.133800  1688 consensus_peers.cc:597] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 -> Peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Couldn't send request to peer 4dbe7d47a2374afca075d3a98583b49e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:50.179039  1688 consensus_peers.cc:597] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Couldn't send request to peer 4dbe7d47a2374afca075d3a98583b49e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:50.193317  1689 consensus_peers.cc:597] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:50.194133  1689 consensus_peers.cc:597] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:50.203799  1688 consensus_peers.cc:597] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Couldn't send request to peer 4dbe7d47a2374afca075d3a98583b49e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:50.204588  1688 consensus_peers.cc:597] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Couldn't send request to peer 4dbe7d47a2374afca075d3a98583b49e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:50.206627  2294 consensus_peers.cc:597] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Couldn't send request to peer 4dbe7d47a2374afca075d3a98583b49e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:50.214553  1688 consensus_peers.cc:597] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Couldn't send request to peer 4dbe7d47a2374afca075d3a98583b49e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:50.234288  1688 consensus_peers.cc:597] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 -> Peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Couldn't send request to peer 4dbe7d47a2374afca075d3a98583b49e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:50.237030  1689 consensus_peers.cc:597] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:01:50.258582   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:01:50.263397  2294 consensus_peers.cc:597] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Couldn't send request to peer 4dbe7d47a2374afca075d3a98583b49e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:50.264178   431 tablet_replica.cc:333] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e: stopping tablet replica
W20260709 13:01:50.269244  2294 consensus_peers.cc:597] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Couldn't send request to peer 4dbe7d47a2374afca075d3a98583b49e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:50.269924   431 raft_consensus.cc:2243] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:50.275902   431 raft_consensus.cc:2272] T 71e68bb03bc047dfadd595f2484ca8f8 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:50.279876   431 tablet_replica.cc:333] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e: stopping tablet replica
W20260709 13:01:50.283605  1688 consensus_peers.cc:597] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 -> Peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Couldn't send request to peer 4dbe7d47a2374afca075d3a98583b49e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:50.283681   431 raft_consensus.cc:2243] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:50.285051   431 raft_consensus.cc:2272] T 03f18dbd16bd4b9eb22229aed3da4413 P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:50.288378   431 tablet_replica.cc:333] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e: stopping tablet replica
I20260709 13:01:50.289333   431 raft_consensus.cc:2243] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:01:50.290555   431 raft_consensus.cc:2272] T ecb8dc1ca7644ad598779a7fe5419ad5 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:50.295213   431 tablet_replica.cc:333] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e: stopping tablet replica
I20260709 13:01:50.295989   431 raft_consensus.cc:2243] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:50.297228   431 raft_consensus.cc:2272] T 725a29842f534310a9c0bb9d5c7892a2 P 4dbe7d47a2374afca075d3a98583b49e [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:50.300323   431 tablet_replica.cc:333] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e: stopping tablet replica
I20260709 13:01:50.301247   431 raft_consensus.cc:2243] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:50.302181   431 raft_consensus.cc:2272] T 85dedac1c89a4e76846055d543df7f16 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:50.310405   431 tablet_replica.cc:333] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e: stopping tablet replica
I20260709 13:01:50.311381   431 raft_consensus.cc:2243] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:50.312021   431 raft_consensus.cc:2272] T cfe7eb675393487f87b528a12f16e16e P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:50.308285  1725 consensus_queue.cc:237] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:50.321754   431 tablet_replica.cc:333] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e: stopping tablet replica
I20260709 13:01:50.327653   431 raft_consensus.cc:2243] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:50.328668   431 raft_consensus.cc:2272] T 8e94ee9035214526808abfaab11799fe P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:50.331857   431 tablet_replica.cc:333] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e: stopping tablet replica
I20260709 13:01:50.332708   431 raft_consensus.cc:2243] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:01:50.333850   431 raft_consensus.cc:2272] T a4e8f73323404a27b6ef964e10902d91 P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:50.348624  2323 raft_consensus.cc:1275] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Refusing update from remote peer 0c7751452c4b46afa95251b9df7169d4: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:01:50.350980   431 tablet_replica.cc:333] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e: stopping tablet replica
I20260709 13:01:50.350883  8154 consensus_queue.cc:1048] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:01:50.352077   431 raft_consensus.cc:2243] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:50.352911   431 raft_consensus.cc:2272] T df63a7a2acf448379066cf6e352a511e P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:50.353314  1688 consensus_peers.cc:597] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 -> Peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Couldn't send request to peer 4dbe7d47a2374afca075d3a98583b49e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:50.355782  2295 consensus_peers.cc:597] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:50.362074  1615 consensus_peers.cc:597] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:01:50.368079   431 tablet_replica.cc:333] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e: stopping tablet replica
I20260709 13:01:50.369038   431 raft_consensus.cc:2243] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:01:50.370404   431 raft_consensus.cc:2272] T e66a330b7dae4036b80d239969d5a260 P 4dbe7d47a2374afca075d3a98583b49e [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:50.378149  1688 consensus_peers.cc:597] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 -> Peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Couldn't send request to peer 4dbe7d47a2374afca075d3a98583b49e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:50.379243   431 tablet_replica.cc:333] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e: stopping tablet replica
I20260709 13:01:50.380081   431 raft_consensus.cc:2243] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:01:50.381295   431 raft_consensus.cc:2272] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:50.378808  8152 raft_consensus.cc:2955] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index 6 to 11, VOTER 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:01:50.381575  2323 raft_consensus.cc:2955] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 6 to 11, VOTER 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } } }
I20260709 13:01:50.384127   431 tablet_replica.cc:333] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e: stopping tablet replica
I20260709 13:01:50.386592   431 raft_consensus.cc:2243] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 16 LEADER]: Raft consensus shutting down.
W20260709 13:01:50.412575  2294 consensus_peers.cc:597] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Couldn't send request to peer 4dbe7d47a2374afca075d3a98583b49e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:50.455461  1689 consensus_peers.cc:597] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:01:50.462514  1461 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8e94ee9035214526808abfaab11799fe with cas_config_opid_index 6: ChangeConfig:REMOVE_PEER succeeded (attempt 13)
W20260709 13:01:50.464074  1615 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:34373, user_credentials={real_user=slave}} blocked reactor thread for 51262.8us
W20260709 13:01:50.464768  2295 consensus_peers.cc:597] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:50.465791  2294 consensus_peers.cc:597] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Couldn't send request to peer 4dbe7d47a2374afca075d3a98583b49e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:50.467185  1615 consensus_peers.cc:597] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:50.469640  2294 consensus_peers.cc:597] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Couldn't send request to peer 4dbe7d47a2374afca075d3a98583b49e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:50.472891   431 raft_consensus.cc:2272] T 896a5554fe0949399b16eb646b6446b8 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:50.474346  1615 consensus_peers.cc:597] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:01:50.475695   431 tablet_replica.cc:333] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e: stopping tablet replica
I20260709 13:01:50.476325   431 raft_consensus.cc:2243] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 13 LEADER]: Raft consensus shutting down.
W20260709 13:01:50.473871  2295 consensus_peers.cc:597] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:01:50.477478   431 raft_consensus.cc:2272] T d5eec36d47dc40c5a83cc72207d9c310 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:50.480221   431 tablet_replica.cc:333] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e: stopping tablet replica
I20260709 13:01:50.481057   431 raft_consensus.cc:2243] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:01:50.482123   431 raft_consensus.cc:2272] T bfb3b560711b4d7eb23f2aff3e4ca991 P 4dbe7d47a2374afca075d3a98583b49e [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:50.482550  1688 consensus_peers.cc:597] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Couldn't send request to peer 4dbe7d47a2374afca075d3a98583b49e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:50.485092   431 tablet_replica.cc:333] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e: stopping tablet replica
I20260709 13:01:50.485953   431 raft_consensus.cc:2243] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Raft consensus shutting down.
W20260709 13:01:50.488636  1615 consensus_peers.cc:597] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:01:50.491794   431 raft_consensus.cc:2272] T bbdad022d10c452fb5c104373d7cd035 P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:50.494755   431 tablet_replica.cc:333] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e: stopping tablet replica
I20260709 13:01:50.495568   431 raft_consensus.cc:2243] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:50.496414   431 raft_consensus.cc:2272] T 776886dda1a14393a13f8003a58c45d0 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:50.499282  1473 catalog_manager.cc:5697] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 reported cstate change: config changed from index 6 to 11, VOTER 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193) evicted. New cstate: current_term: 14 leader_uuid: "0c7751452c4b46afa95251b9df7169d4" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:01:50.503166   431 tablet_replica.cc:333] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e: stopping tablet replica
I20260709 13:01:50.505342   431 raft_consensus.cc:2243] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:50.507498   431 raft_consensus.cc:2272] T 589a395c6abe4eec80fca6d6210acf0d P 4dbe7d47a2374afca075d3a98583b49e [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:50.510253   431 tablet_replica.cc:333] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e: stopping tablet replica
I20260709 13:01:50.511123   431 raft_consensus.cc:2243] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:01:50.512570   431 raft_consensus.cc:2272] T 55eef501fb844a5097694ea43dc740c7 P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:50.515367   431 tablet_replica.cc:333] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e: stopping tablet replica
I20260709 13:01:50.516206   431 raft_consensus.cc:2243] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:01:50.517410   431 raft_consensus.cc:2272] T 1aa00507899e41f9b595f503add14c8c P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:50.520421   431 tablet_replica.cc:333] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e: stopping tablet replica
I20260709 13:01:50.521214   431 raft_consensus.cc:2243] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:50.521827   431 raft_consensus.cc:2272] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:50.523993  1688 consensus_peers.cc:597] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 -> Peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Couldn't send request to peer 4dbe7d47a2374afca075d3a98583b49e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:50.524487   431 tablet_replica.cc:333] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e: stopping tablet replica
I20260709 13:01:50.525379   431 raft_consensus.cc:2243] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:50.525915   431 raft_consensus.cc:2272] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:50.528748   431 tablet_replica.cc:333] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e: stopping tablet replica
W20260709 13:01:50.529026  2295 consensus_peers.cc:597] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:01:50.529539   431 raft_consensus.cc:2243] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:50.530616   431 raft_consensus.cc:2272] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:50.532639  1688 consensus_peers.cc:597] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 -> Peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Couldn't send request to peer 4dbe7d47a2374afca075d3a98583b49e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:50.533464   431 tablet_replica.cc:333] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e: stopping tablet replica
I20260709 13:01:50.534409   431 raft_consensus.cc:2243] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 19 FOLLOWER]: Raft consensus shutting down.
W20260709 13:01:50.542532  1615 consensus_peers.cc:597] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:01:50.543439   431 raft_consensus.cc:2272] T 650a39124682440d83bb93bb83f15979 P 4dbe7d47a2374afca075d3a98583b49e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:50.546334   431 tablet_replica.cc:333] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e: stopping tablet replica
I20260709 13:01:50.547250   431 raft_consensus.cc:2243] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:50.547941   431 raft_consensus.cc:2272] T 86d7fe1cfa574972b0302d36ac77568b P 4dbe7d47a2374afca075d3a98583b49e [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:50.549778  2295 consensus_peers.cc:597] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:01:50.550765   431 tablet_replica.cc:333] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e: stopping tablet replica
I20260709 13:01:50.557163   431 raft_consensus.cc:2243] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:01:50.558398   431 raft_consensus.cc:2272] T 4fa306a802914bb9b8d54b7bfe53009c P 4dbe7d47a2374afca075d3a98583b49e [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:50.562695   431 tablet_replica.cc:333] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e: stopping tablet replica
I20260709 13:01:50.563527   431 raft_consensus.cc:2243] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:01:50.567543   431 raft_consensus.cc:2272] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:50.571053   431 tablet_replica.cc:333] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e: stopping tablet replica
I20260709 13:01:50.571779   431 raft_consensus.cc:2243] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:01:50.578630   431 raft_consensus.cc:2272] T 2ec61eb41a88487585d7738d4f5636dc P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:50.581544   431 tablet_replica.cc:333] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e: stopping tablet replica
I20260709 13:01:50.582325   431 raft_consensus.cc:2243] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:50.582938   431 raft_consensus.cc:2272] T a5bf40aa94d24ad9b858ebb61a527c4e P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:50.585765   431 tablet_replica.cc:333] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e: stopping tablet replica
I20260709 13:01:50.586536   431 raft_consensus.cc:2243] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:50.588292   431 raft_consensus.cc:2272] T 62c04bf03d764babb1a5e3b102527e5f P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:50.591122  1688 consensus_peers.cc:597] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 -> Peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Couldn't send request to peer 4dbe7d47a2374afca075d3a98583b49e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:50.591470   431 tablet_replica.cc:333] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e: stopping tablet replica
I20260709 13:01:50.592280   431 raft_consensus.cc:2243] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:50.592873   431 raft_consensus.cc:2272] T dfcb63b9010d4a77ad8748087fa07f8a P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:50.595854   431 tablet_replica.cc:333] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e: stopping tablet replica
I20260709 13:01:50.596623   431 raft_consensus.cc:2243] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:50.598409   431 raft_consensus.cc:2272] T 216561bf1aef403280c36c1e716ca3ad P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:50.602409   431 tablet_replica.cc:333] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e: stopping tablet replica
I20260709 13:01:50.603150   431 raft_consensus.cc:2243] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:01:50.608042   431 raft_consensus.cc:2272] T df3a0b1701574816b4c9766063c65f8f P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:50.610677   431 tablet_replica.cc:333] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e: stopping tablet replica
I20260709 13:01:50.611424   431 raft_consensus.cc:2243] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:01:50.612540   431 raft_consensus.cc:2272] T 93e6c991440c40c8a8c8050982e85eeb P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:50.619612   431 tablet_replica.cc:333] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e: stopping tablet replica
I20260709 13:01:50.620440   431 raft_consensus.cc:2243] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:50.621336   431 raft_consensus.cc:2272] T 4bc29cd0261846b7847f38862b494d0b P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:50.624276   431 tablet_replica.cc:333] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e: stopping tablet replica
I20260709 13:01:50.625146   431 raft_consensus.cc:2243] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:50.625838   431 raft_consensus.cc:2272] T 05713611987147e49a96fdf32bb28649 P 4dbe7d47a2374afca075d3a98583b49e [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:50.629670   431 tablet_replica.cc:333] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e: stopping tablet replica
I20260709 13:01:50.630525   431 raft_consensus.cc:2243] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:01:50.631811   431 raft_consensus.cc:2272] T 66c434748d1745f7ab1d4bf5a8d9e85d P 4dbe7d47a2374afca075d3a98583b49e [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:50.633328  2295 consensus_peers.cc:597] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 13:01:50.635087   431 tablet_replica.cc:333] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e: stopping tablet replica
I20260709 13:01:50.636034   431 raft_consensus.cc:2243] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:50.636838   431 raft_consensus.cc:2272] T f964296f18474862b1eee102af9116f4 P 4dbe7d47a2374afca075d3a98583b49e [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:50.641024   431 tablet_replica.cc:333] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e: stopping tablet replica
I20260709 13:01:50.641892   431 raft_consensus.cc:2243] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:01:50.643083   431 raft_consensus.cc:2272] T 4ab0461976fc466a8162014a633d32d2 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:50.645958   431 tablet_replica.cc:333] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e: stopping tablet replica
I20260709 13:01:50.646799   431 raft_consensus.cc:2243] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:01:50.648012   431 raft_consensus.cc:2272] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:50.651868   431 tablet_replica.cc:333] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e: stopping tablet replica
I20260709 13:01:50.652676   431 raft_consensus.cc:2243] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:01:50.653630   431 raft_consensus.cc:2272] T 88a45cba73f148359b7ac85f9f702819 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:50.656262   431 tablet_replica.cc:333] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e: stopping tablet replica
I20260709 13:01:50.657064   431 raft_consensus.cc:2243] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:01:50.658474   431 raft_consensus.cc:2272] T 454808fe3b6f48ab9fed193478d28abc P 4dbe7d47a2374afca075d3a98583b49e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:50.663018   431 tablet_replica.cc:333] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e: stopping tablet replica
I20260709 13:01:50.663925   431 raft_consensus.cc:2243] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:50.665035   431 raft_consensus.cc:2272] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 4dbe7d47a2374afca075d3a98583b49e [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:50.667634  1688 consensus_peers.cc:597] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Couldn't send request to peer 4dbe7d47a2374afca075d3a98583b49e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:50.668104   431 tablet_replica.cc:333] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e: stopping tablet replica
I20260709 13:01:50.669059   431 raft_consensus.cc:2243] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:50.669984   431 raft_consensus.cc:2272] T 475f4ce2905344b0803209ce7b2e9386 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:50.672889   431 tablet_replica.cc:333] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e: stopping tablet replica
I20260709 13:01:50.673660   431 raft_consensus.cc:2243] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:50.674562   431 raft_consensus.cc:2272] T a0203dcfbe4440c790f2bf709bd16179 P 4dbe7d47a2374afca075d3a98583b49e [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:50.677469   431 tablet_replica.cc:333] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e: stopping tablet replica
I20260709 13:01:50.678248   431 raft_consensus.cc:2243] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:01:50.679450   431 raft_consensus.cc:2272] T 65524f4fe7be481b9f069829076b7dc3 P 4dbe7d47a2374afca075d3a98583b49e [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:50.682253   431 tablet_replica.cc:333] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e: stopping tablet replica
I20260709 13:01:50.683048   431 raft_consensus.cc:2243] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:01:50.684306   431 raft_consensus.cc:2272] T 06376ae55ce745738b930c75f0dcdf5e P 4dbe7d47a2374afca075d3a98583b49e [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:50.687110   431 tablet_replica.cc:333] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e: stopping tablet replica
I20260709 13:01:50.687883   431 raft_consensus.cc:2243] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:50.688571   431 raft_consensus.cc:2272] T cb7e5d62da7842a3829b9f8247d9899c P 4dbe7d47a2374afca075d3a98583b49e [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:50.725044  2294 consensus_peers.cc:597] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Couldn't send request to peer 4dbe7d47a2374afca075d3a98583b49e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:50.763964  1689 consensus_peers.cc:597] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:50.767155  1688 consensus_peers.cc:597] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 -> Peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Couldn't send request to peer 4dbe7d47a2374afca075d3a98583b49e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:50.800596  1689 consensus_peers.cc:597] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 13:01:50.813793  1459 catalog_manager.cc:4755] TS 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 8e94ee9035214526808abfaab11799fe: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
W20260709 13:01:50.840842  1614 connection.cc:466] server connection from 127.0.0.1:57912 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 1810) could send its response
W20260709 13:01:50.844273   431 connection.cc:466] server connection from 127.0.0.1:57912 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:57912 (request call id 1809) could send its response
W20260709 13:01:51.434439  2297 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45473, user_credentials={real_user=slave}} blocked reactor thread for 85304.9us
W20260709 13:01:51.485553  1689 consensus_peers.cc:597] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:01:51.486124  1689 consensus_peers.cc:597] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:01:51.525190  8152 raft_consensus.cc:493] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:51.525836  8152 raft_consensus.cc:515] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:51.528160  8152 leader_election.cc:290] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:01:51.533658  1689 leader_election.cc:336] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
W20260709 13:01:51.534778  1688 leader_election.cc:336] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Network error: Client connection negotiation failed: client connection to 127.0.107.194:37391: connect: Connection refused (error 111)
I20260709 13:01:51.535185  1688 leader_election.cc:304] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:51.535933  8152 raft_consensus.cc:2749] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:01:51.538594  1689 consensus_peers.cc:597] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:01:51.557027  8152 raft_consensus.cc:493] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:51.557680  8152 raft_consensus.cc:515] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:51.559979  8152 leader_election.cc:290] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423)
I20260709 13:01:51.561656  2327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "0c7751452c4b46afa95251b9df7169d4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "05476b84d8f84d76a9a1f51b620a3c66" is_pre_election: true
W20260709 13:01:51.566704  1688 leader_election.cc:336] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Network error: Client connection negotiation failed: client connection to 127.0.107.194:37391: connect: Connection refused (error 111)
I20260709 13:01:51.567183  1688 leader_election.cc:304] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 05476b84d8f84d76a9a1f51b620a3c66, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:51.568411  8152 raft_consensus.cc:2749] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:51.609894  8166 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:51.611317  8183 raft_consensus.cc:493] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:51.611917  8183 raft_consensus.cc:515] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:51.616596  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4" is_pre_election: true
I20260709 13:01:51.610499  8166 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:51.617265  1716 raft_consensus.cc:2468] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 13.
I20260709 13:01:51.618628  2297 leader_election.cc:304] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 
I20260709 13:01:51.619609  8159 raft_consensus.cc:2804] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:01:51.620484  8159 raft_consensus.cc:493] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:51.621483  8159 raft_consensus.cc:3060] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:01:51.623394  8183 leader_election.cc:290] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:51.624986  8166 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:01:51.630661  2295 leader_election.cc:336] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
I20260709 13:01:51.636974  8183 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:51.637581  8183 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
W20260709 13:01:51.643952  2295 leader_election.cc:336] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
I20260709 13:01:51.645238  8152 raft_consensus.cc:493] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:51.645784  8152 raft_consensus.cc:515] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:51.647857  8152 leader_election.cc:290] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:01:51.650710  2294 leader_election.cc:336] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Network error: Client connection negotiation failed: client connection to 127.0.107.194:37391: connect: Connection refused (error 111)
W20260709 13:01:51.651459  2294 leader_election.cc:336] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Network error: Client connection negotiation failed: client connection to 127.0.107.194:37391: connect: Connection refused (error 111)
I20260709 13:01:51.651741  8154 raft_consensus.cc:493] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:51.651839  2294 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:51.650022  8183 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:51.652352  8154 raft_consensus.cc:515] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } }
I20260709 13:01:51.654383  8154 leader_election.cc:290] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373)
W20260709 13:01:51.666298  1688 leader_election.cc:336] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Network error: Client connection negotiation failed: client connection to 127.0.107.194:37391: connect: Connection refused (error 111)
W20260709 13:01:51.670140  1688 leader_election.cc:336] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Network error: Client connection negotiation failed: client connection to 127.0.107.194:37391: connect: Connection refused (error 111)
I20260709 13:01:51.630889  8159 raft_consensus.cc:515] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:51.679342  8166 raft_consensus.cc:2749] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:01:51.680779  8159 leader_election.cc:290] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 14 election: Requested vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:51.681803  1716 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5eec36d47dc40c5a83cc72207d9c310" candidate_uuid: "05476b84d8f84d76a9a1f51b620a3c66" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0c7751452c4b46afa95251b9df7169d4"
I20260709 13:01:51.682396  1716 raft_consensus.cc:3060] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:01:51.688102  2294 leader_election.cc:336] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Network error: Client connection negotiation failed: client connection to 127.0.107.194:37391: connect: Connection refused (error 111)
I20260709 13:01:51.688603  2294 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:01:51.689462  2294 leader_election.cc:336] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Network error: Client connection negotiation failed: client connection to 127.0.107.194:37391: connect: Connection refused (error 111)
I20260709 13:01:51.690188  8159 raft_consensus.cc:2749] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:51.690493  1716 raft_consensus.cc:2468] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 05476b84d8f84d76a9a1f51b620a3c66 in term 14.
I20260709 13:01:51.691742  2297 leader_election.cc:304] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66, 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e
W20260709 13:01:51.691881  1689 leader_election.cc:336] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
I20260709 13:01:51.692387  1689 leader_election.cc:304] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:51.693120  8178 raft_consensus.cc:2749] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:51.694039  8152 raft_consensus.cc:493] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:51.694547  8152 raft_consensus.cc:515] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:51.696743  8152 leader_election.cc:290] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:51.701231  8159 raft_consensus.cc:2804] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Leader election won for term 14
W20260709 13:01:51.702101  1689 leader_election.cc:336] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
W20260709 13:01:51.703946  1688 leader_election.cc:336] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Network error: Client connection negotiation failed: client connection to 127.0.107.194:37391: connect: Connection refused (error 111)
I20260709 13:01:51.704568  1689 leader_election.cc:304] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:51.708738  8154 raft_consensus.cc:493] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:51.709273  8154 raft_consensus.cc:515] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:51.711380  8154 leader_election.cc:290] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:01:51.715294  1689 consensus_peers.cc:597] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:01:51.715730  1689 leader_election.cc:336] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
I20260709 13:01:51.716107  1689 leader_election.cc:304] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:51.717062  8169 raft_consensus.cc:2749] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:51.718019  8178 raft_consensus.cc:2749] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:01:51.719588  1689 consensus_peers.cc:597] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:51.720134  1689 leader_election.cc:336] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
W20260709 13:01:51.727569  1688 leader_election.cc:336] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Network error: Client connection negotiation failed: client connection to 127.0.107.194:37391: connect: Connection refused (error 111)
I20260709 13:01:51.728072  1688 leader_election.cc:304] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:51.728775  8159 raft_consensus.cc:697] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 LEADER]: Becoming Leader. State: Replica: 05476b84d8f84d76a9a1f51b620a3c66, State: Running, Role: LEADER
I20260709 13:01:51.730007  8159 consensus_queue.cc:237] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:51.731930  8154 raft_consensus.cc:2749] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:51.732641  8178 raft_consensus.cc:493] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:51.733507  8178 raft_consensus.cc:515] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:51.736121  8178 leader_election.cc:290] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:51.737759  8183 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:51.738329  8183 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:51.740504  8183 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:01:51.743270  1688 leader_election.cc:336] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Network error: Client connection negotiation failed: client connection to 127.0.107.194:37391: connect: Connection refused (error 111)
W20260709 13:01:51.756398  1689 leader_election.cc:336] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
I20260709 13:01:51.756880  1689 leader_election.cc:304] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:51.757647  8178 raft_consensus.cc:2749] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:01:51.758675  2294 leader_election.cc:336] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Network error: Client connection negotiation failed: client connection to 127.0.107.194:37391: connect: Connection refused (error 111)
W20260709 13:01:51.762701  2295 leader_election.cc:336] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
I20260709 13:01:51.765156  8178 raft_consensus.cc:493] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:51.765733  8178 raft_consensus.cc:515] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:51.767727  8178 leader_election.cc:290] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:51.767827  2295 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:01:51.773381  1688 leader_election.cc:336] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Network error: Client connection negotiation failed: client connection to 127.0.107.194:37391: connect: Connection refused (error 111)
W20260709 13:01:51.780701  1689 leader_election.cc:336] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
I20260709 13:01:51.781373  1689 leader_election.cc:304] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:51.780228  8159 raft_consensus.cc:2749] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:51.782678  8178 raft_consensus.cc:2749] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:51.788147  1473 catalog_manager.cc:5697] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 reported cstate change: term changed from 13 to 14, leader changed from 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194) to 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196). New cstate: current_term: 14 leader_uuid: "05476b84d8f84d76a9a1f51b620a3c66" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:01:51.803809  1521 auto_rebalancer.cc:629] Failed to schedule move for tablet 66c434748d1745f7ab1d4bf5a8d9e85d: Network error: Client connection negotiation failed: client connection to 127.0.107.194:37391: connect: Connection refused (error 111)
I20260709 13:01:51.826085  8159 raft_consensus.cc:493] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:51.826814  8159 raft_consensus.cc:515] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:51.831246  8159 leader_election.cc:290] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:01:51.834554  2295 consensus_peers.cc:597] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:51.835693  2294 leader_election.cc:336] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Network error: Client connection negotiation failed: client connection to 127.0.107.194:37391: connect: Connection refused (error 111)
W20260709 13:01:51.835784  1689 consensus_peers.cc:597] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:51.837368  2295 leader_election.cc:336] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
I20260709 13:01:51.837911  2295 leader_election.cc:304] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:51.838759  8159 raft_consensus.cc:2749] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 13:01:51.877691  2295 consensus_peers.cc:597] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:01:51.889546  8152 raft_consensus.cc:493] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:51.890168  8152 raft_consensus.cc:515] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
W20260709 13:01:51.890591  2295 consensus_peers.cc:597] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:01:51.892609  8152 leader_election.cc:290] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:01:51.902415  1689 leader_election.cc:336] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
I20260709 13:01:51.902807  8154 raft_consensus.cc:493] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:51.903982  8154 raft_consensus.cc:515] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:51.907617  1716 consensus_queue.cc:237] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } }
I20260709 13:01:51.915551  8154 leader_election.cc:290] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:01:51.919299  2295 consensus_peers.cc:597] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:01:51.920106  1688 leader_election.cc:336] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Network error: Client connection negotiation failed: client connection to 127.0.107.194:37391: connect: Connection refused (error 111)
W20260709 13:01:51.921316  1689 leader_election.cc:336] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
I20260709 13:01:51.921341  1688 leader_election.cc:304] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:51.923200  8178 raft_consensus.cc:2749] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:01:51.927290  1689 consensus_peers.cc:597] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 -> Peer 05476b84d8f84d76a9a1f51b620a3c66 (127.0.107.196:34423): Couldn't send request to peer 05476b84d8f84d76a9a1f51b620a3c66. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 86d7fe1cfa574972b0302d36ac77568b. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:51.930084  1689 consensus_peers.cc:597] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:51.933604  1688 leader_election.cc:336] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Network error: Client connection negotiation failed: client connection to 127.0.107.194:37391: connect: Connection refused (error 111)
I20260709 13:01:51.934136  1688 leader_election.cc:304] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:51.934860  8154 raft_consensus.cc:2749] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:01:51.939904  1688 consensus_peers.cc:597] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 -> Peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Couldn't send request to peer 4dbe7d47a2374afca075d3a98583b49e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:37391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:51.950997  8154 raft_consensus.cc:493] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:51.951691  8154 raft_consensus.cc:515] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:51.954082  8154 leader_election.cc:290] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:01:51.954789  2295 consensus_peers.cc:597] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:01:51.959333  1688 leader_election.cc:336] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Network error: Client connection negotiation failed: client connection to 127.0.107.194:37391: connect: Connection refused (error 111)
W20260709 13:01:51.962160  1689 leader_election.cc:336] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
I20260709 13:01:51.962637  1689 leader_election.cc:304] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:51.963471  8154 raft_consensus.cc:2749] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:51.980739  8178 raft_consensus.cc:493] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:51.981048  8154 raft_consensus.cc:493] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:51.981360  8178 raft_consensus.cc:515] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:51.981742  8154 raft_consensus.cc:515] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:51.983680  8178 leader_election.cc:290] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:51.984084  8154 leader_election.cc:290] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:01:51.988706  1688 leader_election.cc:336] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Network error: Client connection negotiation failed: client connection to 127.0.107.194:37391: connect: Connection refused (error 111)
W20260709 13:01:51.989202  1688 leader_election.cc:336] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Network error: Client connection negotiation failed: client connection to 127.0.107.194:37391: connect: Connection refused (error 111)
W20260709 13:01:51.991282  1689 leader_election.cc:336] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
I20260709 13:01:51.991802  1689 leader_election.cc:304] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:51.992604  8154 raft_consensus.cc:2749] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 13:01:51.992815  1689 leader_election.cc:336] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
I20260709 13:01:51.993307  1689 leader_election.cc:304] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:51.994040  8154 raft_consensus.cc:2749] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:52.006265  8159 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:52.006814  8159 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:52.008965  8159 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:01:52.014132  2294 leader_election.cc:336] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Network error: Client connection negotiation failed: client connection to 127.0.107.194:37391: connect: Connection refused (error 111)
W20260709 13:01:52.014820  2295 leader_election.cc:336] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
I20260709 13:01:52.015249  2295 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:52.016512  8159 raft_consensus.cc:2749] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 13:01:52.049873  2295 consensus_peers.cc:597] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260709 13:01:52.057065   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 13:01:52.060866  8159 raft_consensus.cc:493] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:52.061511  8159 raft_consensus.cc:515] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:52.063850  8159 leader_election.cc:290] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:01:52.070626  2294 leader_election.cc:336] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Network error: Client connection negotiation failed: client connection to 127.0.107.194:37391: connect: Connection refused (error 111)
W20260709 13:01:52.072003  2295 leader_election.cc:336] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
I20260709 13:01:52.072475  2295 leader_election.cc:304] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:52.073733  8159 raft_consensus.cc:2749] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:52.076107  8154 raft_consensus.cc:493] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:52.076726  8154 raft_consensus.cc:515] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:52.078949  8154 leader_election.cc:290] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:01:52.083977  1689 leader_election.cc:336] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
W20260709 13:01:52.085831  1688 leader_election.cc:336] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Network error: Client connection negotiation failed: client connection to 127.0.107.194:37391: connect: Connection refused (error 111)
I20260709 13:01:52.087735  1688 leader_election.cc:304] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:52.091312  8154 raft_consensus.cc:2749] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:52.149202  8154 raft_consensus.cc:493] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:52.149828  8154 raft_consensus.cc:515] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } }
I20260709 13:01:52.152081  8154 leader_election.cc:290] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:01:52.153229  1746 debug-util.cc:398] Leaking SignalData structure 0x7b0800369760 after lost signal to thread 434
W20260709 13:01:52.154438  1746 debug-util.cc:398] Leaking SignalData structure 0x7b0800384c00 after lost signal to thread 1508
W20260709 13:01:52.156071  1746 debug-util.cc:398] Leaking SignalData structure 0x7b08000b7560 after lost signal to thread 1749
W20260709 13:01:52.156592  1689 leader_election.cc:336] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
W20260709 13:01:52.157478  1746 debug-util.cc:398] Leaking SignalData structure 0x7b08001229c0 after lost signal to thread 2356
W20260709 13:01:52.168272  1688 leader_election.cc:336] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Network error: Client connection negotiation failed: client connection to 127.0.107.194:37391: connect: Connection refused (error 111)
I20260709 13:01:52.169078  1688 leader_election.cc:304] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0c7751452c4b46afa95251b9df7169d4; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:52.170583  8154 raft_consensus.cc:2749] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:52.177191   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
W20260709 13:01:52.242074  1459 catalog_manager.cc:4755] TS 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 8e94ee9035214526808abfaab11799fe: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
W20260709 13:01:52.246735  1689 consensus_peers.cc:597] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 13:01:52.247859   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:52.248966   431 tablet_replica.cc:333] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4: stopping tablet replica
I20260709 13:01:52.249998   431 raft_consensus.cc:2243] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:52.250675   431 raft_consensus.cc:2272] T ecb8dc1ca7644ad598779a7fe5419ad5 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.253093   431 tablet_replica.cc:333] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4: stopping tablet replica
I20260709 13:01:52.253705   431 raft_consensus.cc:2243] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:52.254271   431 raft_consensus.cc:2272] T 608abea191d946228bed666c5560fd0a P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.256420   431 tablet_replica.cc:333] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4: stopping tablet replica
I20260709 13:01:52.257123   431 raft_consensus.cc:2243] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:01:52.258312   431 raft_consensus.cc:2272] T 71e68bb03bc047dfadd595f2484ca8f8 P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.260579   431 tablet_replica.cc:333] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4: stopping tablet replica
I20260709 13:01:52.261433   431 raft_consensus.cc:2243] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:52.262069   431 raft_consensus.cc:2272] T d74b61b1f30d43f5a2c32ade6f2b8f2a P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.264430   431 tablet_replica.cc:333] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4: stopping tablet replica
I20260709 13:01:52.265326   431 raft_consensus.cc:2243] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:52.265970   431 raft_consensus.cc:2272] T a4e8f73323404a27b6ef964e10902d91 P 0c7751452c4b46afa95251b9df7169d4 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.267982   431 tablet_replica.cc:333] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4: stopping tablet replica
I20260709 13:01:52.268599   431 raft_consensus.cc:2243] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:01:52.269402   431 raft_consensus.cc:2272] T 8e94ee9035214526808abfaab11799fe P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.271165   431 tablet_replica.cc:333] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4: stopping tablet replica
I20260709 13:01:52.271728   431 raft_consensus.cc:2243] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:52.272199   431 raft_consensus.cc:2272] T df63a7a2acf448379066cf6e352a511e P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.274240   431 tablet_replica.cc:333] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4: stopping tablet replica
I20260709 13:01:52.274763   431 raft_consensus.cc:2243] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:01:52.275544   431 raft_consensus.cc:2272] T 85dedac1c89a4e76846055d543df7f16 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.277562   431 tablet_replica.cc:333] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4: stopping tablet replica
I20260709 13:01:52.278276   431 raft_consensus.cc:2243] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:01:52.279289   431 raft_consensus.cc:2272] T cfe7eb675393487f87b528a12f16e16e P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.281219   431 tablet_replica.cc:333] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4: stopping tablet replica
I20260709 13:01:52.281744   431 raft_consensus.cc:2243] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:52.282419   431 raft_consensus.cc:2272] T 896a5554fe0949399b16eb646b6446b8 P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.284264   431 tablet_replica.cc:333] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4: stopping tablet replica
I20260709 13:01:52.284865   431 raft_consensus.cc:2243] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:52.285367   431 raft_consensus.cc:2272] T d5eec36d47dc40c5a83cc72207d9c310 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.287240   431 tablet_replica.cc:333] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4: stopping tablet replica
I20260709 13:01:52.287823   431 raft_consensus.cc:2243] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:52.288355   431 raft_consensus.cc:2272] T 9ec2114c988b4a38a63b42293dcf1757 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.290383   431 tablet_replica.cc:333] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4: stopping tablet replica
I20260709 13:01:52.291018   431 raft_consensus.cc:2243] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:01:52.291819   431 raft_consensus.cc:2272] T 3beb4a9a0afa4337be3366fb9ee9c2fd P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.294375   431 tablet_replica.cc:333] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4: stopping tablet replica
I20260709 13:01:52.295125   431 raft_consensus.cc:2243] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:01:52.296205   431 raft_consensus.cc:2272] T 776886dda1a14393a13f8003a58c45d0 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.298962   431 tablet_replica.cc:333] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4: stopping tablet replica
I20260709 13:01:52.299613   431 raft_consensus.cc:2243] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 21 LEADER]: Raft consensus shutting down.
I20260709 13:01:52.301074   431 raft_consensus.cc:2272] T 589a395c6abe4eec80fca6d6210acf0d P 0c7751452c4b46afa95251b9df7169d4 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:52.301816  2294 consensus_peers.cc:597] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Couldn't send request to peer 4dbe7d47a2374afca075d3a98583b49e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:37391: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:52.303328   431 tablet_replica.cc:333] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4: stopping tablet replica
I20260709 13:01:52.304111   431 raft_consensus.cc:2243] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:52.304749   431 raft_consensus.cc:2272] T 55eef501fb844a5097694ea43dc740c7 P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.306736   431 tablet_replica.cc:333] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4: stopping tablet replica
I20260709 13:01:52.307323   431 raft_consensus.cc:2243] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:01:52.308092   431 raft_consensus.cc:2272] T bbdad022d10c452fb5c104373d7cd035 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.310283   431 tablet_replica.cc:333] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4: stopping tablet replica
I20260709 13:01:52.311014   431 raft_consensus.cc:2243] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:01:52.311925   431 raft_consensus.cc:2272] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.314307   431 tablet_replica.cc:333] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4: stopping tablet replica
I20260709 13:01:52.315133   431 raft_consensus.cc:2243] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:01:52.316278   431 raft_consensus.cc:2272] T 3e702e5dcf7541a2a4c0dc32d68625c6 P 0c7751452c4b46afa95251b9df7169d4 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.319164   431 tablet_replica.cc:333] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4: stopping tablet replica
I20260709 13:01:52.319962   431 raft_consensus.cc:2243] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 19 LEADER]: Raft consensus shutting down.
I20260709 13:01:52.321033   431 raft_consensus.cc:2272] T 650a39124682440d83bb93bb83f15979 P 0c7751452c4b46afa95251b9df7169d4 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.323784   431 tablet_replica.cc:333] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4: stopping tablet replica
I20260709 13:01:52.324515   431 raft_consensus.cc:2243] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:01:52.325706   431 pending_rounds.cc:70] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4: Trying to abort 1 pending ops.
W20260709 13:01:52.326122  2297 consensus_peers.cc:597] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Couldn't send request to peer 0c7751452c4b46afa95251b9df7169d4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:52.325961   431 pending_rounds.cc:77] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4: Aborting op as it isn't in flight: id { term: 10 index: 7 } timestamp: 7305634250368667648 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "86d7fe1cfa574972b0302d36ac77568b" old_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } } new_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } attrs { replace: true } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } } }
I20260709 13:01:52.327008   431 raft_consensus.cc:2917] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 10 LEADER]: Aborting config change with OpId 10.7: Aborted: Op aborted
I20260709 13:01:52.327430   431 raft_consensus.cc:2889] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 10 LEADER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:01:52.328344   431 raft_consensus.cc:2272] T 86d7fe1cfa574972b0302d36ac77568b P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:52.330068  1521 auto_rebalancer.cc:629] Failed to schedule move for tablet 86d7fe1cfa574972b0302d36ac77568b: Aborted: Op aborted
W20260709 13:01:52.339214  1521 auto_rebalancer.cc:629] Failed to schedule move for tablet dfdb9ea6c3bf4001aeecb5c37e0d6baf: Network error: Client connection negotiation failed: client connection to 127.0.107.194:37391: connect: Connection refused (error 111)
W20260709 13:01:52.339473  2297 consensus_peers.cc:597] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Couldn't send request to peer 0c7751452c4b46afa95251b9df7169d4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:52.342990  1521 auto_rebalancer.cc:629] Failed to schedule move for tablet 06376ae55ce745738b930c75f0dcdf5e: Network error: Client connection negotiation failed: client connection to 127.0.107.194:37391: connect: Connection refused (error 111)
I20260709 13:01:52.347900   431 tablet_replica.cc:333] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4: stopping tablet replica
I20260709 13:01:52.348858   431 raft_consensus.cc:2243] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Raft consensus shutting down.
W20260709 13:01:52.349037  2297 consensus_peers.cc:597] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Couldn't send request to peer 0c7751452c4b46afa95251b9df7169d4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:52.349538   431 raft_consensus.cc:2272] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.351553   431 tablet_replica.cc:333] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4: stopping tablet replica
I20260709 13:01:52.352309   431 raft_consensus.cc:2243] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:52.353060   431 raft_consensus.cc:2272] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.355412   431 tablet_replica.cc:333] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4: stopping tablet replica
I20260709 13:01:52.356178   431 raft_consensus.cc:2243] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:52.356698   431 raft_consensus.cc:2272] T 57e6243cbccc4e5fa84d8a5fd5a78af0 P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.359017   431 tablet_replica.cc:333] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4: stopping tablet replica
I20260709 13:01:52.359767   431 raft_consensus.cc:2243] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:52.360491   431 raft_consensus.cc:2272] T 2ec61eb41a88487585d7738d4f5636dc P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.364275   431 tablet_replica.cc:333] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4: stopping tablet replica
I20260709 13:01:52.364971   431 raft_consensus.cc:2243] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:01:52.366073   431 raft_consensus.cc:2272] T a5bf40aa94d24ad9b858ebb61a527c4e P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.368016   431 tablet_replica.cc:333] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4: stopping tablet replica
I20260709 13:01:52.368630   431 raft_consensus.cc:2243] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:52.369199   431 raft_consensus.cc:2272] T 2f8dd5957a2647058190fd52f31ec088 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.371188   431 tablet_replica.cc:333] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4: stopping tablet replica
I20260709 13:01:52.371701   431 raft_consensus.cc:2243] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:52.372187   431 raft_consensus.cc:2272] T 73452eca85a147fb9d862dd08d54e340 P 0c7751452c4b46afa95251b9df7169d4 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.374364   431 tablet_replica.cc:333] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4: stopping tablet replica
I20260709 13:01:52.375018   431 raft_consensus.cc:2243] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:52.375568   431 raft_consensus.cc:2272] T 566c1a1cfdfa47a2aee520e28f352064 P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.378111   431 tablet_replica.cc:333] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4: stopping tablet replica
I20260709 13:01:52.378850   431 raft_consensus.cc:2243] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:01:52.379650   431 raft_consensus.cc:2272] T 62c04bf03d764babb1a5e3b102527e5f P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.381646   431 tablet_replica.cc:333] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4: stopping tablet replica
I20260709 13:01:52.382210   431 raft_consensus.cc:2243] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:01:52.383013   431 raft_consensus.cc:2272] T dfcb63b9010d4a77ad8748087fa07f8a P 0c7751452c4b46afa95251b9df7169d4 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.384966   431 tablet_replica.cc:333] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4: stopping tablet replica
I20260709 13:01:52.385581   431 raft_consensus.cc:2243] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:52.386062   431 raft_consensus.cc:2272] T 66c434748d1745f7ab1d4bf5a8d9e85d P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.387941   431 tablet_replica.cc:333] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4: stopping tablet replica
I20260709 13:01:52.388495   431 raft_consensus.cc:2243] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:01:52.389374   431 raft_consensus.cc:2272] T c998894dcb744ba3825db19244f8207e P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.391606   431 tablet_replica.cc:333] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4: stopping tablet replica
I20260709 13:01:52.392234   431 raft_consensus.cc:2243] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:52.392951   431 raft_consensus.cc:2272] T df3a0b1701574816b4c9766063c65f8f P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.395181   431 tablet_replica.cc:333] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4: stopping tablet replica
I20260709 13:01:52.395943   431 raft_consensus.cc:2243] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:01:52.396993   431 raft_consensus.cc:2272] T f8c04e2c99384254b275d20e6d27467b P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.399088   431 tablet_replica.cc:333] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4: stopping tablet replica
I20260709 13:01:52.399641   431 raft_consensus.cc:2243] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:52.400182   431 raft_consensus.cc:2272] T f964296f18474862b1eee102af9116f4 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.402227   431 tablet_replica.cc:333] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4: stopping tablet replica
I20260709 13:01:52.402798   431 raft_consensus.cc:2243] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:52.403276   431 raft_consensus.cc:2272] T 091ce8e86e49437b8fffb903bd5ce2fb P 0c7751452c4b46afa95251b9df7169d4 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.405329   431 tablet_replica.cc:333] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4: stopping tablet replica
I20260709 13:01:52.405925   431 raft_consensus.cc:2243] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 17 LEADER]: Raft consensus shutting down.
W20260709 13:01:52.406417  1688 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:01:52.406883   431 raft_consensus.cc:2272] T 03f18dbd16bd4b9eb22229aed3da4413 P 0c7751452c4b46afa95251b9df7169d4 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.409219   431 tablet_replica.cc:333] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4: stopping tablet replica
I20260709 13:01:52.409744   431 raft_consensus.cc:2243] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:01:52.410521   431 raft_consensus.cc:2272] T 475f4ce2905344b0803209ce7b2e9386 P 0c7751452c4b46afa95251b9df7169d4 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.412806   431 tablet_replica.cc:333] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4: stopping tablet replica
I20260709 13:01:52.413391   431 raft_consensus.cc:2243] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:52.414093   431 raft_consensus.cc:2272] T cf2ade0033864199b5ced11fc9b5c6ad P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.416759   431 tablet_replica.cc:333] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4: stopping tablet replica
I20260709 13:01:52.417443   431 raft_consensus.cc:2243] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:01:52.418567   431 raft_consensus.cc:2272] T 3ba8e707693e4af2b8347a4bad4dfd67 P 0c7751452c4b46afa95251b9df7169d4 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.420830   431 tablet_replica.cc:333] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4: stopping tablet replica
I20260709 13:01:52.421381   431 raft_consensus.cc:2243] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:52.421816   431 raft_consensus.cc:2272] T 4ab0461976fc466a8162014a633d32d2 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.424090   431 tablet_replica.cc:333] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4: stopping tablet replica
I20260709 13:01:52.424651   431 raft_consensus.cc:2243] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:52.425156   431 raft_consensus.cc:2272] T 88a45cba73f148359b7ac85f9f702819 P 0c7751452c4b46afa95251b9df7169d4 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.427047   431 tablet_replica.cc:333] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4: stopping tablet replica
I20260709 13:01:52.427531   431 raft_consensus.cc:2243] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:52.428113   431 raft_consensus.cc:2272] T 454808fe3b6f48ab9fed193478d28abc P 0c7751452c4b46afa95251b9df7169d4 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.429924   431 tablet_replica.cc:333] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4: stopping tablet replica
I20260709 13:01:52.430380   431 raft_consensus.cc:2243] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:52.430799   431 raft_consensus.cc:2272] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 0c7751452c4b46afa95251b9df7169d4 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.432510   431 tablet_replica.cc:333] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4: stopping tablet replica
I20260709 13:01:52.433002   431 raft_consensus.cc:2243] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:52.433472   431 raft_consensus.cc:2272] T 06376ae55ce745738b930c75f0dcdf5e P 0c7751452c4b46afa95251b9df7169d4 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.435535   431 tablet_replica.cc:333] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4: stopping tablet replica
I20260709 13:01:52.436129   431 raft_consensus.cc:2243] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:01:52.437252   431 raft_consensus.cc:2272] T cb7e5d62da7842a3829b9f8247d9899c P 0c7751452c4b46afa95251b9df7169d4 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:52.439495   431 tablet_replica.cc:333] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4: stopping tablet replica
I20260709 13:01:52.440021   431 raft_consensus.cc:2243] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:01:52.441035   431 raft_consensus.cc:2272] T 477960faa15b4001a5a6361558d69294 P 0c7751452c4b46afa95251b9df7169d4 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:52.446857  2297 consensus_peers.cc:597] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Couldn't send request to peer 0c7751452c4b46afa95251b9df7169d4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:52.447576  2297 consensus_peers.cc:597] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Couldn't send request to peer 0c7751452c4b46afa95251b9df7169d4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:52.501374  2297 consensus_peers.cc:597] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Couldn't send request to peer 0c7751452c4b46afa95251b9df7169d4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:52.509682  2297 consensus_peers.cc:597] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Couldn't send request to peer 0c7751452c4b46afa95251b9df7169d4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:52.524950  2297 consensus_peers.cc:597] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Couldn't send request to peer 0c7751452c4b46afa95251b9df7169d4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:45473: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:52.574434  2297 consensus_peers.cc:597] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Couldn't send request to peer 0c7751452c4b46afa95251b9df7169d4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:45473: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:52.580121  2295 consensus_peers.cc:597] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:01:52.582481  2297 consensus_peers.cc:597] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Couldn't send request to peer 0c7751452c4b46afa95251b9df7169d4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:45473: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:52.628063  2294 consensus_peers.cc:597] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Couldn't send request to peer 4dbe7d47a2374afca075d3a98583b49e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:37391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:52.657480  2297 consensus_peers.cc:597] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Couldn't send request to peer 0c7751452c4b46afa95251b9df7169d4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:45473: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:52.696827  2294 consensus_peers.cc:597] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Couldn't send request to peer 4dbe7d47a2374afca075d3a98583b49e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:37391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:52.738353  2297 consensus_peers.cc:597] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Couldn't send request to peer 0c7751452c4b46afa95251b9df7169d4. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:45473: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:01:52.785177  2295 consensus_peers.cc:597] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:01:52.853683  2294 consensus_peers.cc:597] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Couldn't send request to peer 4dbe7d47a2374afca075d3a98583b49e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:37391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:52.892645  2294 consensus_peers.cc:597] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Couldn't send request to peer 4dbe7d47a2374afca075d3a98583b49e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:37391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:52.908663  2294 consensus_peers.cc:597] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Couldn't send request to peer 4dbe7d47a2374afca075d3a98583b49e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:37391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:52.947404  2294 consensus_peers.cc:597] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Couldn't send request to peer 4dbe7d47a2374afca075d3a98583b49e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:37391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:52.967195  2295 consensus_peers.cc:597] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:01:52.970686  2295 consensus_peers.cc:597] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:01:52.974664  2295 consensus_peers.cc:597] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 13:01:52.978940  2295 consensus_peers.cc:597] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:01:53.003326  2294 consensus_peers.cc:597] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Couldn't send request to peer 4dbe7d47a2374afca075d3a98583b49e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:37391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:53.056394  2294 consensus_peers.cc:597] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Couldn't send request to peer 4dbe7d47a2374afca075d3a98583b49e. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:37391: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:01:53.265120  2295 consensus_peers.cc:597] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 -> Peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Couldn't send request to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260709 13:01:53.272011  1459 catalog_manager.cc:4755] TS 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 8e94ee9035214526808abfaab11799fe: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
I20260709 13:01:53.313105  8183 raft_consensus.cc:493] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:01:53.313683  8183 raft_consensus.cc:515] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:53.315647  8183 leader_election.cc:290] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
I20260709 13:01:53.316295  8183 raft_consensus.cc:493] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:53.316764  8183 raft_consensus.cc:515] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:53.319762  8183 leader_election.cc:290] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:01:53.321676  2294 leader_election.cc:336] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Network error: Client connection negotiation failed: client connection to 127.0.107.194:37391: connect: Connection refused (error 111)
W20260709 13:01:53.323305  2295 leader_election.cc:336] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
W20260709 13:01:53.325168  2297 leader_election.cc:336] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Network error: Client connection negotiation failed: client connection to 127.0.107.195:45473: connect: Connection refused (error 111)
I20260709 13:01:53.325783  2297 leader_election.cc:304] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
W20260709 13:01:53.326381  2294 leader_election.cc:336] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Network error: Client connection negotiation failed: client connection to 127.0.107.194:37391: connect: Connection refused (error 111)
I20260709 13:01:53.326867  8183 raft_consensus.cc:2749] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:01:53.326817  2294 leader_election.cc:304] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:53.327709  8194 raft_consensus.cc:2749] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 13:01:53.361717  8194 raft_consensus.cc:493] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:01:53.362294  8194 raft_consensus.cc:515] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:53.364571  8194 leader_election.cc:290] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:01:53.372581  2297 leader_election.cc:336] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Network error: Client connection negotiation failed: client connection to 127.0.107.195:45473: connect: Connection refused (error 111)
W20260709 13:01:53.373869  2294 leader_election.cc:336] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Network error: Client connection negotiation failed: client connection to 127.0.107.194:37391: connect: Connection refused (error 111)
I20260709 13:01:53.374349  2294 leader_election.cc:304] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:53.375067  8194 raft_consensus.cc:2749] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:53.411919  8194 raft_consensus.cc:493] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:01:53.412496  8194 raft_consensus.cc:515] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:53.414721  8194 leader_election.cc:290] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:01:53.419797  2295 leader_election.cc:336] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
W20260709 13:01:53.420780  1521 auto_rebalancer.cc:629] Failed to schedule move for tablet ecb8dc1ca7644ad598779a7fe5419ad5: Network error: Client connection negotiation failed: client connection to 127.0.107.194:37391: connect: Connection refused (error 111)
W20260709 13:01:53.420912  2297 leader_election.cc:336] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Network error: Client connection negotiation failed: client connection to 127.0.107.195:45473: connect: Connection refused (error 111)
I20260709 13:01:53.421415  2297 leader_election.cc:304] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:53.422179  8194 raft_consensus.cc:2749] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:01:53.424780  1521 auto_rebalancer.cc:629] Failed to schedule move for tablet 650a39124682440d83bb93bb83f15979: Network error: Client connection negotiation failed: client connection to 127.0.107.195:45473: connect: Connection refused (error 111)
W20260709 13:01:53.428272  1521 auto_rebalancer.cc:629] Failed to schedule move for tablet bbdad022d10c452fb5c104373d7cd035: Network error: Client connection negotiation failed: client connection to 127.0.107.195:45473: connect: Connection refused (error 111)
W20260709 13:01:53.431710  1521 auto_rebalancer.cc:629] Failed to schedule move for tablet 71e68bb03bc047dfadd595f2484ca8f8: Network error: Client connection negotiation failed: client connection to 127.0.107.195:45473: connect: Connection refused (error 111)
I20260709 13:01:53.467523  8194 raft_consensus.cc:493] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:01:53.468180  8194 raft_consensus.cc:515] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:53.471287  8194 leader_election.cc:290] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:01:53.473632  2295 leader_election.cc:336] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
W20260709 13:01:53.476153  2297 leader_election.cc:336] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Network error: Client connection negotiation failed: client connection to 127.0.107.195:45473: connect: Connection refused (error 111)
I20260709 13:01:53.476620  2297 leader_election.cc:304] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:53.477370  8194 raft_consensus.cc:2749] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:01:53.498936  8183 raft_consensus.cc:493] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:53.499728  8194 raft_consensus.cc:493] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:01:53.499511  8183 raft_consensus.cc:515] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:53.500396  8194 raft_consensus.cc:515] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:53.501811  8183 leader_election.cc:290] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
I20260709 13:01:53.502504  8194 leader_election.cc:290] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:01:53.507886  2294 leader_election.cc:336] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Network error: Client connection negotiation failed: client connection to 127.0.107.194:37391: connect: Connection refused (error 111)
W20260709 13:01:53.508002  2297 leader_election.cc:336] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Network error: Client connection negotiation failed: client connection to 127.0.107.195:45473: connect: Connection refused (error 111)
W20260709 13:01:53.509467  2294 leader_election.cc:336] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Network error: Client connection negotiation failed: client connection to 127.0.107.194:37391: connect: Connection refused (error 111)
I20260709 13:01:53.510295  2294 leader_election.cc:304] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:53.511044  8194 raft_consensus.cc:2749] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 13:01:53.511475  2295 leader_election.cc:336] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
I20260709 13:01:53.511917  2295 leader_election.cc:304] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:53.512678  8194 raft_consensus.cc:2749] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 13:01:53.522310  8194 raft_consensus.cc:493] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:53.522900  8194 raft_consensus.cc:515] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:53.524907  8194 leader_election.cc:290] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:01:53.530768  2294 leader_election.cc:336] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Network error: Client connection negotiation failed: client connection to 127.0.107.194:37391: connect: Connection refused (error 111)
W20260709 13:01:53.531715  2295 leader_election.cc:336] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
I20260709 13:01:53.532151  2295 leader_election.cc:304] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
W20260709 13:01:53.532955   431 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 1746)
I20260709 13:01:53.532960  8195 raft_consensus.cc:2749] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 13:01:53.596686  8195 raft_consensus.cc:493] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:53.597339  8195 raft_consensus.cc:515] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:53.600594  8195 leader_election.cc:290] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:01:53.603649  2295 leader_election.cc:336] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
W20260709 13:01:53.604259  2294 leader_election.cc:336] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Network error: Client connection negotiation failed: client connection to 127.0.107.194:37391: connect: Connection refused (error 111)
I20260709 13:01:53.604700  2294 leader_election.cc:304] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:53.605383  8195 raft_consensus.cc:2749] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:53.647718  8195 raft_consensus.cc:493] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:01:53.648285  8195 raft_consensus.cc:515] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:53.650244  8195 leader_election.cc:290] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:01:53.654145  2294 leader_election.cc:336] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Network error: Client connection negotiation failed: client connection to 127.0.107.194:37391: connect: Connection refused (error 111)
W20260709 13:01:53.654618  2297 leader_election.cc:336] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Network error: Client connection negotiation failed: client connection to 127.0.107.195:45473: connect: Connection refused (error 111)
I20260709 13:01:53.655083  2297 leader_election.cc:304] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:53.655759  8195 raft_consensus.cc:2749] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:53.665500  8195 raft_consensus.cc:493] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:01:53.666138  8195 raft_consensus.cc:515] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:53.668146  8195 leader_election.cc:290] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:01:53.671357  2294 leader_election.cc:336] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Network error: Client connection negotiation failed: client connection to 127.0.107.194:37391: connect: Connection refused (error 111)
W20260709 13:01:53.672611  2297 leader_election.cc:336] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Network error: Client connection negotiation failed: client connection to 127.0.107.195:45473: connect: Connection refused (error 111)
I20260709 13:01:53.672947  8195 raft_consensus.cc:493] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:53.672987  2297 leader_election.cc:304] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:53.673873  8194 raft_consensus.cc:2749] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 13:01:53.673617  8195 raft_consensus.cc:515] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:53.676136  8195 leader_election.cc:290] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:01:53.679530  2295 leader_election.cc:336] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
W20260709 13:01:53.681632  2294 leader_election.cc:336] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Network error: Client connection negotiation failed: client connection to 127.0.107.194:37391: connect: Connection refused (error 111)
I20260709 13:01:53.682000  2294 leader_election.cc:304] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:53.682606  8195 raft_consensus.cc:2749] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:53.707087  8195 raft_consensus.cc:493] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:01:53.707602  8195 raft_consensus.cc:515] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:53.709913  8195 leader_election.cc:290] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:01:53.713299  2294 leader_election.cc:336] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Network error: Client connection negotiation failed: client connection to 127.0.107.194:37391: connect: Connection refused (error 111)
W20260709 13:01:53.713778  2297 leader_election.cc:336] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Network error: Client connection negotiation failed: client connection to 127.0.107.195:45473: connect: Connection refused (error 111)
I20260709 13:01:53.714184  2297 leader_election.cc:304] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:53.714771  8195 raft_consensus.cc:2749] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 13:01:53.766870  8194 raft_consensus.cc:493] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:01:53.767393  8194 raft_consensus.cc:515] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:53.769390  8194 leader_election.cc:290] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:01:53.776217  2295 leader_election.cc:336] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
W20260709 13:01:53.776840  2297 leader_election.cc:336] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Network error: Client connection negotiation failed: client connection to 127.0.107.195:45473: connect: Connection refused (error 111)
I20260709 13:01:53.777247  2297 leader_election.cc:304] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:53.778021  8194 raft_consensus.cc:2749] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:53.831382  8194 raft_consensus.cc:493] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:01:53.831868  8194 raft_consensus.cc:515] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:53.833791  8194 leader_election.cc:290] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:01:53.837064  2295 leader_election.cc:336] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
W20260709 13:01:53.837558  2297 leader_election.cc:336] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Network error: Client connection negotiation failed: client connection to 127.0.107.195:45473: connect: Connection refused (error 111)
I20260709 13:01:53.837942  2297 leader_election.cc:304] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:53.838521  8194 raft_consensus.cc:2749] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:01:53.864921  8194 raft_consensus.cc:493] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0c7751452c4b46afa95251b9df7169d4)
I20260709 13:01:53.865454  8194 raft_consensus.cc:515] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:53.867280  8194 leader_election.cc:290] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391), 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473)
W20260709 13:01:53.870501  2294 leader_election.cc:336] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Network error: Client connection negotiation failed: client connection to 127.0.107.194:37391: connect: Connection refused (error 111)
W20260709 13:01:53.870955  2297 leader_election.cc:336] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0c7751452c4b46afa95251b9df7169d4 (127.0.107.195:45473): Network error: Client connection negotiation failed: client connection to 127.0.107.195:45473: connect: Connection refused (error 111)
I20260709 13:01:53.871351  2297 leader_election.cc:304] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 0c7751452c4b46afa95251b9df7169d4, 4dbe7d47a2374afca075d3a98583b49e
I20260709 13:01:53.871935  8194 raft_consensus.cc:2749] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:01:53.925251   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:01:54.021415   431 tablet_server.cc:179] TabletServer@127.0.107.196:0 shutting down...
I20260709 13:01:54.030772  8195 raft_consensus.cc:493] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 4dbe7d47a2374afca075d3a98583b49e)
I20260709 13:01:54.031409  8195 raft_consensus.cc:515] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: false } }
I20260709 13:01:54.034166  8195 leader_election.cc:290] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373), 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391)
W20260709 13:01:54.040588  2295 leader_election.cc:336] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
W20260709 13:01:54.041079  2294 leader_election.cc:336] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 4dbe7d47a2374afca075d3a98583b49e (127.0.107.194:37391): Network error: Client connection negotiation failed: client connection to 127.0.107.194:37391: connect: Connection refused (error 111)
I20260709 13:01:54.041558  2294 leader_election.cc:304] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 05476b84d8f84d76a9a1f51b620a3c66; no voters: 4dbe7d47a2374afca075d3a98583b49e, 89ac9d5e2fbc4536b03a1ff1dd3eb226
I20260709 13:01:54.042292  8195 raft_consensus.cc:2749] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 13:01:54.061772   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:01:54.062600   431 tablet_replica.cc:333] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66: stopping tablet replica
I20260709 13:01:54.063308   431 raft_consensus.cc:2243] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:01:54.064263   431 raft_consensus.cc:2272] T 6eb51aa4d3bf4882a502ada4948b2cc2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:54.066354   431 tablet_replica.cc:333] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66: stopping tablet replica
I20260709 13:01:54.066937   431 raft_consensus.cc:2243] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:54.067428   431 raft_consensus.cc:2272] T 3ba8e707693e4af2b8347a4bad4dfd67 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:54.069388   431 tablet_replica.cc:333] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66: stopping tablet replica
I20260709 13:01:54.069964   431 raft_consensus.cc:2243] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:54.070488   431 raft_consensus.cc:2272] T f8c04e2c99384254b275d20e6d27467b P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:54.073486   431 tablet_replica.cc:333] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66: stopping tablet replica
I20260709 13:01:54.074295   431 raft_consensus.cc:2243] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:54.074869   431 raft_consensus.cc:2272] T 62c04bf03d764babb1a5e3b102527e5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:54.077206   431 tablet_replica.cc:333] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66: stopping tablet replica
I20260709 13:01:54.077739   431 raft_consensus.cc:2243] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:54.078112   431 raft_consensus.cc:2272] T 475f4ce2905344b0803209ce7b2e9386 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:54.079947   431 tablet_replica.cc:333] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 05476b84d8f84d76a9a1f51b620a3c66: stopping tablet replica
I20260709 13:01:54.080470   431 raft_consensus.cc:2243] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 LEARNER]: Raft consensus shutting down.
I20260709 13:01:54.080881   431 pending_rounds.cc:70] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 05476b84d8f84d76a9a1f51b620a3c66: Trying to abort 1 pending ops.
I20260709 13:01:54.081023   431 pending_rounds.cc:77] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 05476b84d8f84d76a9a1f51b620a3c66: Aborting op as it isn't in flight: id { term: 1 index: 2 } timestamp: 7305633568396718080 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "dfdb9ea6c3bf4001aeecb5c37e0d6baf" old_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } } } new_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "89ac9d5e2fbc4536b03a1ff1dd3eb226" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 34373 } } peers { permanent_uuid: "4dbe7d47a2374afca075d3a98583b49e" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37391 } } peers { permanent_uuid: "0c7751452c4b46afa95251b9df7169d4" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "05476b84d8f84d76a9a1f51b620a3c66" member_type: NON_VOTER last_known_addr { host: "127.0.107.196" port: 34423 } attrs { promote: true } } } }
I20260709 13:01:54.081606   431 raft_consensus.cc:2917] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 LEARNER]: Aborting config change with OpId 1.2: Aborted: Op aborted
I20260709 13:01:54.081879   431 raft_consensus.cc:2889] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 NON_PARTICIPANT]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:01:54.082157   431 raft_consensus.cc:2272] T dfdb9ea6c3bf4001aeecb5c37e0d6baf P 05476b84d8f84d76a9a1f51b620a3c66 [term 2 NON_PARTICIPANT]: Raft consensus is shut down!
I20260709 13:01:54.083930   431 tablet_replica.cc:333] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66: stopping tablet replica
I20260709 13:01:54.084410   431 raft_consensus.cc:2243] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:01:54.085165   431 raft_consensus.cc:2272] T a7bcbc7b936b4bdca8a41d00f9ecdd5f P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:54.086869   431 tablet_replica.cc:333] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66: stopping tablet replica
I20260709 13:01:54.087353   431 raft_consensus.cc:2243] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:54.087726   431 raft_consensus.cc:2272] T 65524f4fe7be481b9f069829076b7dc3 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:54.089632   431 tablet_replica.cc:333] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66: stopping tablet replica
I20260709 13:01:54.090106   431 raft_consensus.cc:2243] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 20 LEADER]: Raft consensus shutting down.
I20260709 13:01:54.090829   431 raft_consensus.cc:2272] T 725a29842f534310a9c0bb9d5c7892a2 P 05476b84d8f84d76a9a1f51b620a3c66 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:54.092722   431 tablet_replica.cc:333] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66: stopping tablet replica
I20260709 13:01:54.093240   431 raft_consensus.cc:2243] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:01:54.093969   431 raft_consensus.cc:2272] T 9ec2114c988b4a38a63b42293dcf1757 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:54.095677   431 tablet_replica.cc:333] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66: stopping tablet replica
I20260709 13:01:54.096160   431 raft_consensus.cc:2243] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:01:54.097011   431 raft_consensus.cc:2272] T 091ce8e86e49437b8fffb903bd5ce2fb P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:54.099038   431 tablet_replica.cc:333] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66: stopping tablet replica
I20260709 13:01:54.099556   431 raft_consensus.cc:2243] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:01:54.100255   431 raft_consensus.cc:2272] T a0203dcfbe4440c790f2bf709bd16179 P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:54.102164   431 tablet_replica.cc:333] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66: stopping tablet replica
I20260709 13:01:54.102653   431 raft_consensus.cc:2243] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:54.103108   431 raft_consensus.cc:2272] T a5bf40aa94d24ad9b858ebb61a527c4e P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:54.105726   431 tablet_replica.cc:333] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66: stopping tablet replica
I20260709 13:01:54.106456   431 raft_consensus.cc:2243] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:54.107139   431 raft_consensus.cc:2272] T dfcb63b9010d4a77ad8748087fa07f8a P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:54.109177   431 tablet_replica.cc:333] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66: stopping tablet replica
I20260709 13:01:54.109719   431 raft_consensus.cc:2243] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:54.110188   431 raft_consensus.cc:2272] T 1aa00507899e41f9b595f503add14c8c P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:54.111992   431 tablet_replica.cc:333] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66: stopping tablet replica
I20260709 13:01:54.112512   431 raft_consensus.cc:2243] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:54.112984   431 raft_consensus.cc:2272] T cfe7eb675393487f87b528a12f16e16e P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:54.114742   431 tablet_replica.cc:333] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66: stopping tablet replica
I20260709 13:01:54.115283   431 raft_consensus.cc:2243] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:54.115711   431 raft_consensus.cc:2272] T e66a330b7dae4036b80d239969d5a260 P 05476b84d8f84d76a9a1f51b620a3c66 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:54.117569   431 tablet_replica.cc:333] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66: stopping tablet replica
I20260709 13:01:54.118104   431 raft_consensus.cc:2243] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:01:54.118888   431 raft_consensus.cc:2272] T 2f8dd5957a2647058190fd52f31ec088 P 05476b84d8f84d76a9a1f51b620a3c66 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:54.120764   431 tablet_replica.cc:333] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66: stopping tablet replica
I20260709 13:01:54.121253   431 raft_consensus.cc:2243] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:01:54.122023   431 raft_consensus.cc:2272] T cf2ade0033864199b5ced11fc9b5c6ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:54.123799   431 tablet_replica.cc:333] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66: stopping tablet replica
I20260709 13:01:54.124327   431 raft_consensus.cc:2243] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 LEADER]: Raft consensus shutting down.
I20260709 13:01:54.125121   431 raft_consensus.cc:2272] T 216561bf1aef403280c36c1e716ca3ad P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:54.126957   431 tablet_replica.cc:333] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66: stopping tablet replica
I20260709 13:01:54.127429   431 raft_consensus.cc:2243] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:01:54.128129   431 raft_consensus.cc:2272] T 73452eca85a147fb9d862dd08d54e340 P 05476b84d8f84d76a9a1f51b620a3c66 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:54.129952   431 tablet_replica.cc:333] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66: stopping tablet replica
I20260709 13:01:54.130388   431 raft_consensus.cc:2243] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:54.130745   431 raft_consensus.cc:2272] T 4fa306a802914bb9b8d54b7bfe53009c P 05476b84d8f84d76a9a1f51b620a3c66 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:54.132555   431 tablet_replica.cc:333] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66: stopping tablet replica
I20260709 13:01:54.133204   431 raft_consensus.cc:2243] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:01:54.134159   431 raft_consensus.cc:2272] T f964296f18474862b1eee102af9116f4 P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:54.136616   431 tablet_replica.cc:333] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66: stopping tablet replica
I20260709 13:01:54.137180   431 raft_consensus.cc:2243] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:54.137737   431 raft_consensus.cc:2272] T 8e94ee9035214526808abfaab11799fe P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:54.139987   431 tablet_replica.cc:333] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66: stopping tablet replica
I20260709 13:01:54.140679   431 raft_consensus.cc:2243] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:01:54.141551   431 raft_consensus.cc:2272] T df63a7a2acf448379066cf6e352a511e P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:54.143639   431 tablet_replica.cc:333] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66: stopping tablet replica
I20260709 13:01:54.144214   431 raft_consensus.cc:2243] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:54.144761   431 raft_consensus.cc:2272] T ecf79110f7ff4e8b8bf2e0e4ea3c6def P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:54.146729   431 tablet_replica.cc:333] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66: stopping tablet replica
I20260709 13:01:54.147272   431 raft_consensus.cc:2243] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:01:54.148145   431 raft_consensus.cc:2272] T 608abea191d946228bed666c5560fd0a P 05476b84d8f84d76a9a1f51b620a3c66 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:54.150357   431 tablet_replica.cc:333] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66: stopping tablet replica
I20260709 13:01:54.150949   431 raft_consensus.cc:2243] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:54.151402   431 raft_consensus.cc:2272] T c998894dcb744ba3825db19244f8207e P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:54.153301   431 tablet_replica.cc:333] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66: stopping tablet replica
I20260709 13:01:54.153843   431 raft_consensus.cc:2243] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:54.154356   431 raft_consensus.cc:2272] T bfb3b560711b4d7eb23f2aff3e4ca991 P 05476b84d8f84d76a9a1f51b620a3c66 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:54.156263   431 tablet_replica.cc:333] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66: stopping tablet replica
I20260709 13:01:54.156878   431 raft_consensus.cc:2243] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 18 LEADER]: Raft consensus shutting down.
I20260709 13:01:54.157779   431 raft_consensus.cc:2272] T 05713611987147e49a96fdf32bb28649 P 05476b84d8f84d76a9a1f51b620a3c66 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:54.159775   431 tablet_replica.cc:333] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66: stopping tablet replica
I20260709 13:01:54.160368   431 raft_consensus.cc:2243] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:01:54.161285   431 pending_rounds.cc:70] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66: Trying to abort 1 pending ops.
I20260709 13:01:54.161458   431 pending_rounds.cc:77] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66: Aborting op as it isn't in flight: id { term: 14 index: 12 } timestamp: 7305634249703378944 op_type: NO_OP noop_request { }
I20260709 13:01:54.161819   431 raft_consensus.cc:2889] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:01:54.162133   431 raft_consensus.cc:2272] T d5eec36d47dc40c5a83cc72207d9c310 P 05476b84d8f84d76a9a1f51b620a3c66 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:54.163983   431 tablet_replica.cc:333] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66: stopping tablet replica
I20260709 13:01:54.164518   431 raft_consensus.cc:2243] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:01:54.165416   431 raft_consensus.cc:2272] T 566c1a1cfdfa47a2aee520e28f352064 P 05476b84d8f84d76a9a1f51b620a3c66 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:54.167321   431 tablet_replica.cc:333] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66: stopping tablet replica
I20260709 13:01:54.167872   431 raft_consensus.cc:2243] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:54.168334   431 raft_consensus.cc:2272] T 93e6c991440c40c8a8c8050982e85eeb P 05476b84d8f84d76a9a1f51b620a3c66 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:54.170342   431 tablet_replica.cc:333] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66: stopping tablet replica
I20260709 13:01:54.170894   431 raft_consensus.cc:2243] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:01:54.171363   431 raft_consensus.cc:2272] T 477960faa15b4001a5a6361558d69294 P 05476b84d8f84d76a9a1f51b620a3c66 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:54.173408   431 tablet_replica.cc:333] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66: stopping tablet replica
I20260709 13:01:54.173928   431 raft_consensus.cc:2243] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 LEADER]: Raft consensus shutting down.
I20260709 13:01:54.175024   431 raft_consensus.cc:2272] T 4bc29cd0261846b7847f38862b494d0b P 05476b84d8f84d76a9a1f51b620a3c66 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 13:01:54.493168  1521 auto_rebalancer.cc:629] Failed to schedule move for tablet d74b61b1f30d43f5a2c32ade6f2b8f2a: Network error: Client connection negotiation failed: client connection to 127.0.107.194:37391: connect: Connection refused (error 111)
W20260709 13:01:54.497094  1521 auto_rebalancer.cc:629] Failed to schedule move for tablet 85dedac1c89a4e76846055d543df7f16: Network error: Client connection negotiation failed: client connection to 127.0.107.195:45473: connect: Connection refused (error 111)
W20260709 13:01:54.500283  1521 auto_rebalancer.cc:629] Failed to schedule move for tablet 3beb4a9a0afa4337be3366fb9ee9c2fd: Network error: Client connection negotiation failed: client connection to 127.0.107.195:45473: connect: Connection refused (error 111)
W20260709 13:01:54.503381  1521 auto_rebalancer.cc:629] Failed to schedule move for tablet dfdb9ea6c3bf4001aeecb5c37e0d6baf: Network error: Client connection negotiation failed: client connection to 127.0.107.194:37391: connect: Connection refused (error 111)
I20260709 13:01:54.746244   431 tablet_server.cc:196] TabletServer@127.0.107.196:0 shutdown complete.
I20260709 13:01:54.797845   431 master.cc:562] Master@127.0.107.254:42827 shutting down...
W20260709 13:01:55.358824  1459 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111) [suppressed 539 similar messages]
W20260709 13:01:55.362337  1459 catalog_manager.cc:4755] TS 89ac9d5e2fbc4536b03a1ff1dd3eb226 (127.0.107.193:34373): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 8e94ee9035214526808abfaab11799fe: Network error: Client connection negotiation failed: client connection to 127.0.107.193:34373: connect: Connection refused (error 111)
I20260709 13:01:55.444810   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P fcfaa17e55ae48e194c5d95ca24a659f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:01:55.445422   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P fcfaa17e55ae48e194c5d95ca24a659f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:01:55.445706   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P fcfaa17e55ae48e194c5d95ca24a659f: stopping tablet replica
I20260709 13:01:55.637645   431 master.cc:584] Master@127.0.107.254:42827 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (221506 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:01:55.733381   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:37501
I20260709 13:01:55.734489   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:55.740196  8204 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:55.740286  8203 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:55.741992  8206 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:55.742956   431 server_base.cc:1061] running on GCE node
I20260709 13:01:55.746065   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:55.746308   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:55.746433   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602115746421 us; error 0 us; skew 500 ppm
I20260709 13:01:55.746948   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:55.749486   431 webserver.cc:533] Webserver started at http://127.0.107.254:42737/ using document root <none> and password file <none>
I20260709 13:01:55.749933   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:55.750083   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:55.750298   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:55.751380   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601869227091-431-0/minicluster-data/master-0-root/instance:
uuid: "147a2ee5cb4e4faf937f44519f6ebd75"
format_stamp: "Formatted at 2026-07-09 13:01:55 on dist-test-slave-5mzn"
I20260709 13:01:55.755695   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:01:55.759130  8211 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:55.759896   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:01:55.760210   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601869227091-431-0/minicluster-data/master-0-root
uuid: "147a2ee5cb4e4faf937f44519f6ebd75"
format_stamp: "Formatted at 2026-07-09 13:01:55 on dist-test-slave-5mzn"
I20260709 13:01:55.760468   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601869227091-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601869227091-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601869227091-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:55.774096   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:55.775378   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:55.813789   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:37501
I20260709 13:01:55.813881  8262 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:37501 every 8 connection(s)
I20260709 13:01:55.817730  8263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:55.827683  8263 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 147a2ee5cb4e4faf937f44519f6ebd75: Bootstrap starting.
I20260709 13:01:55.832851  8263 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 147a2ee5cb4e4faf937f44519f6ebd75: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:55.837169  8263 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 147a2ee5cb4e4faf937f44519f6ebd75: No bootstrap required, opened a new log
I20260709 13:01:55.839305  8263 raft_consensus.cc:359] T 00000000000000000000000000000000 P 147a2ee5cb4e4faf937f44519f6ebd75 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "147a2ee5cb4e4faf937f44519f6ebd75" member_type: VOTER }
I20260709 13:01:55.839725  8263 raft_consensus.cc:385] T 00000000000000000000000000000000 P 147a2ee5cb4e4faf937f44519f6ebd75 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:55.839972  8263 raft_consensus.cc:740] T 00000000000000000000000000000000 P 147a2ee5cb4e4faf937f44519f6ebd75 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 147a2ee5cb4e4faf937f44519f6ebd75, State: Initialized, Role: FOLLOWER
I20260709 13:01:55.840574  8263 consensus_queue.cc:260] T 00000000000000000000000000000000 P 147a2ee5cb4e4faf937f44519f6ebd75 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "147a2ee5cb4e4faf937f44519f6ebd75" member_type: VOTER }
I20260709 13:01:55.841037  8263 raft_consensus.cc:399] T 00000000000000000000000000000000 P 147a2ee5cb4e4faf937f44519f6ebd75 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:01:55.841279  8263 raft_consensus.cc:493] T 00000000000000000000000000000000 P 147a2ee5cb4e4faf937f44519f6ebd75 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:01:55.841563  8263 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 147a2ee5cb4e4faf937f44519f6ebd75 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:55.845947  8263 raft_consensus.cc:515] T 00000000000000000000000000000000 P 147a2ee5cb4e4faf937f44519f6ebd75 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "147a2ee5cb4e4faf937f44519f6ebd75" member_type: VOTER }
I20260709 13:01:55.846475  8263 leader_election.cc:304] T 00000000000000000000000000000000 P 147a2ee5cb4e4faf937f44519f6ebd75 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 147a2ee5cb4e4faf937f44519f6ebd75; no voters: 
I20260709 13:01:55.847661  8263 leader_election.cc:290] T 00000000000000000000000000000000 P 147a2ee5cb4e4faf937f44519f6ebd75 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:01:55.848007  8266 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 147a2ee5cb4e4faf937f44519f6ebd75 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:55.849460  8266 raft_consensus.cc:697] T 00000000000000000000000000000000 P 147a2ee5cb4e4faf937f44519f6ebd75 [term 1 LEADER]: Becoming Leader. State: Replica: 147a2ee5cb4e4faf937f44519f6ebd75, State: Running, Role: LEADER
I20260709 13:01:55.850162  8266 consensus_queue.cc:237] T 00000000000000000000000000000000 P 147a2ee5cb4e4faf937f44519f6ebd75 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "147a2ee5cb4e4faf937f44519f6ebd75" member_type: VOTER }
I20260709 13:01:55.850723  8263 sys_catalog.cc:565] T 00000000000000000000000000000000 P 147a2ee5cb4e4faf937f44519f6ebd75 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:01:55.854635  8268 sys_catalog.cc:455] T 00000000000000000000000000000000 P 147a2ee5cb4e4faf937f44519f6ebd75 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 147a2ee5cb4e4faf937f44519f6ebd75. Latest consensus state: current_term: 1 leader_uuid: "147a2ee5cb4e4faf937f44519f6ebd75" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "147a2ee5cb4e4faf937f44519f6ebd75" member_type: VOTER } }
I20260709 13:01:55.855196  8268 sys_catalog.cc:458] T 00000000000000000000000000000000 P 147a2ee5cb4e4faf937f44519f6ebd75 [sys.catalog]: This master's current role is: LEADER
I20260709 13:01:55.857201  8267 sys_catalog.cc:455] T 00000000000000000000000000000000 P 147a2ee5cb4e4faf937f44519f6ebd75 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "147a2ee5cb4e4faf937f44519f6ebd75" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "147a2ee5cb4e4faf937f44519f6ebd75" member_type: VOTER } }
I20260709 13:01:55.858074  8274 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:01:55.858026  8267 sys_catalog.cc:458] T 00000000000000000000000000000000 P 147a2ee5cb4e4faf937f44519f6ebd75 [sys.catalog]: This master's current role is: LEADER
I20260709 13:01:55.863446  8274 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:01:55.866945   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:01:55.872030  8274 catalog_manager.cc:1383] Generated new cluster ID: 1afaeb78653c4dfe92f3c05b9f8c9b81
I20260709 13:01:55.872354  8274 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:01:55.891654  8274 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:01:55.892953  8274 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:01:55.906147  8274 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 147a2ee5cb4e4faf937f44519f6ebd75: Generated new TSK 0
I20260709 13:01:55.906798  8274 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:01:55.933776   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:55.940250  8284 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:55.941417  8285 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:55.942781  8287 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:55.943943   431 server_base.cc:1061] running on GCE node
I20260709 13:01:55.946197   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:55.946388   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:55.946589   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602115946574 us; error 0 us; skew 500 ppm
I20260709 13:01:55.947180   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:55.949649   431 webserver.cc:533] Webserver started at http://127.0.107.193:45605/ using document root <none> and password file <none>
I20260709 13:01:55.950135   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:55.950340   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:55.950627   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:55.951823   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601869227091-431-0/minicluster-data/ts-0-root/instance:
uuid: "590ee39ce5734876b94d91fc3931b807"
format_stamp: "Formatted at 2026-07-09 13:01:55 on dist-test-slave-5mzn"
I20260709 13:01:55.956212   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 13:01:55.959522  8292 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:55.960413   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:01:55.960799   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601869227091-431-0/minicluster-data/ts-0-root
uuid: "590ee39ce5734876b94d91fc3931b807"
format_stamp: "Formatted at 2026-07-09 13:01:55 on dist-test-slave-5mzn"
I20260709 13:01:55.961163   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601869227091-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601869227091-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601869227091-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:55.986883   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:55.988009   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:55.989490   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:55.991706   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:55.991875   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:55.992175   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:55.992357   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:56.034685   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:40837
I20260709 13:01:56.034797  8354 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:40837 every 8 connection(s)
I20260709 13:01:56.040481   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:56.047607  8359 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:56.048184  8360 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:56.051167  8362 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:56.051843   431 server_base.cc:1061] running on GCE node
I20260709 13:01:56.053908   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:56.054104   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:56.054230   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602116054219 us; error 0 us; skew 500 ppm
I20260709 13:01:56.054688   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:56.057078   431 webserver.cc:533] Webserver started at http://127.0.107.194:45443/ using document root <none> and password file <none>
I20260709 13:01:56.057564   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:56.057823   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:56.058142   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:56.059288   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601869227091-431-0/minicluster-data/ts-1-root/instance:
uuid: "53a66c851dc74c70b94c65d464a391f6"
format_stamp: "Formatted at 2026-07-09 13:01:56 on dist-test-slave-5mzn"
I20260709 13:01:56.061599  8355 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37501
I20260709 13:01:56.062036  8355 heartbeater.cc:461] Registering TS with master...
I20260709 13:01:56.062911  8355 heartbeater.cc:507] Master 127.0.107.254:37501 requested a full tablet report, sending...
I20260709 13:01:56.064986   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.007s
I20260709 13:01:56.065107  8228 ts_manager.cc:194] Registered new tserver with Master: 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:01:56.067057  8228 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41904
I20260709 13:01:56.069031  8367 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:56.070030   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:01:56.070286   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601869227091-431-0/minicluster-data/ts-1-root
uuid: "53a66c851dc74c70b94c65d464a391f6"
format_stamp: "Formatted at 2026-07-09 13:01:56 on dist-test-slave-5mzn"
I20260709 13:01:56.070519   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601869227091-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601869227091-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601869227091-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:56.083552   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:56.084841   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:56.086290   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:56.088673   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:56.088867   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:56.089167   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:56.089341   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:56.130925   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:37751
I20260709 13:01:56.131047  8429 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:37751 every 8 connection(s)
I20260709 13:01:56.135928   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:56.143560  8433 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:56.145604  8434 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:56.146919  8436 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:56.149163  8430 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37501
I20260709 13:01:56.149295   431 server_base.cc:1061] running on GCE node
I20260709 13:01:56.149678  8430 heartbeater.cc:461] Registering TS with master...
I20260709 13:01:56.150328   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:01:56.150471  8430 heartbeater.cc:507] Master 127.0.107.254:37501 requested a full tablet report, sending...
W20260709 13:01:56.150552   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:56.151046   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602116151021 us; error 0 us; skew 500 ppm
I20260709 13:01:56.151822   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:56.153057  8228 ts_manager.cc:194] Registered new tserver with Master: 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:01:56.154529   431 webserver.cc:533] Webserver started at http://127.0.107.195:33787/ using document root <none> and password file <none>
I20260709 13:01:56.154748  8228 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41916
I20260709 13:01:56.155109   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:56.155375   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:56.155689   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:56.157223   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601869227091-431-0/minicluster-data/ts-2-root/instance:
uuid: "7b3ea460d1294b8a82672d7c21475cb5"
format_stamp: "Formatted at 2026-07-09 13:01:56 on dist-test-slave-5mzn"
I20260709 13:01:56.161804   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:01:56.165475  8441 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:56.166251   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:01:56.166571   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601869227091-431-0/minicluster-data/ts-2-root
uuid: "7b3ea460d1294b8a82672d7c21475cb5"
format_stamp: "Formatted at 2026-07-09 13:01:56 on dist-test-slave-5mzn"
I20260709 13:01:56.166850   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601869227091-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601869227091-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601869227091-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:56.186761   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:56.188328   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:56.190142   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:56.192502   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:56.192786   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:56.193084   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:56.193259   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:56.234288   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:45429
I20260709 13:01:56.234402  8503 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:45429 every 8 connection(s)
I20260709 13:01:56.239383   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:01:56.247517  8507 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:01:56.247671  8508 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:56.257200  8504 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37501
I20260709 13:01:56.257823  8504 heartbeater.cc:461] Registering TS with master...
W20260709 13:01:56.258119  8510 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:01:56.258668   431 server_base.cc:1061] running on GCE node
I20260709 13:01:56.258903  8504 heartbeater.cc:507] Master 127.0.107.254:37501 requested a full tablet report, sending...
I20260709 13:01:56.259537   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:01:56.259815   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:01:56.260036   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602116260020 us; error 0 us; skew 500 ppm
I20260709 13:01:56.260876   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:01:56.261251  8228 ts_manager.cc:194] Registered new tserver with Master: 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:01:56.263123  8228 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41930
I20260709 13:01:56.264065   431 webserver.cc:533] Webserver started at http://127.0.107.196:41339/ using document root <none> and password file <none>
I20260709 13:01:56.264756   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:01:56.264976   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:01:56.265254   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:01:56.266428   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601869227091-431-0/minicluster-data/ts-3-root/instance:
uuid: "b560e9aaec7a4c78b9123b38e73519a3"
format_stamp: "Formatted at 2026-07-09 13:01:56 on dist-test-slave-5mzn"
I20260709 13:01:56.271014   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:01:56.274256  8515 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:56.275076   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:01:56.275435   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601869227091-431-0/minicluster-data/ts-3-root
uuid: "b560e9aaec7a4c78b9123b38e73519a3"
format_stamp: "Formatted at 2026-07-09 13:01:56 on dist-test-slave-5mzn"
I20260709 13:01:56.275748   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601869227091-431-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601869227091-431-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601869227091-431-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:01:56.297288   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:01:56.298692   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:01:56.300151   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:01:56.302405   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:01:56.302646   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:56.302914   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:01:56.303102   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:01:56.347771   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.196:42503
I20260709 13:01:56.347929  8577 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.196:42503 every 8 connection(s)
I20260709 13:01:56.362638  8578 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37501
I20260709 13:01:56.363152  8578 heartbeater.cc:461] Registering TS with master...
I20260709 13:01:56.363937  8578 heartbeater.cc:507] Master 127.0.107.254:37501 requested a full tablet report, sending...
I20260709 13:01:56.365952  8228 ts_manager.cc:194] Registered new tserver with Master: b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503)
I20260709 13:01:56.366178   431 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.015221892s
I20260709 13:01:56.367884  8228 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41944
I20260709 13:01:56.393990  8228 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41954:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:01:56.634184  8395 tablet_service.cc:1511] Processing CreateTablet for tablet c66f53044d784114970ae5061755da40 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:01:56.634872  8394 tablet_service.cc:1511] Processing CreateTablet for tablet cd24f768f33e40bba3406e8dde3f45cc (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:01:56.635702  8395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c66f53044d784114970ae5061755da40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:56.636389  8394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd24f768f33e40bba3406e8dde3f45cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:56.639063  8393 tablet_service.cc:1511] Processing CreateTablet for tablet 40926724afa743899b7ab0af312dc717 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:01:56.640461  8393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40926724afa743899b7ab0af312dc717. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:56.654429  8392 tablet_service.cc:1511] Processing CreateTablet for tablet 5527a2aef01d45cebcfad8a1b0a5273d (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:01:56.655891  8392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5527a2aef01d45cebcfad8a1b0a5273d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:56.663164  8391 tablet_service.cc:1511] Processing CreateTablet for tablet cea53371e56d4a668406dcd8f5a93dcb (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:01:56.664695  8391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cea53371e56d4a668406dcd8f5a93dcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:56.677872  8542 tablet_service.cc:1511] Processing CreateTablet for tablet 52f213b355c14b45a13d7cf5b3e76efe (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:01:56.679401  8542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52f213b355c14b45a13d7cf5b3e76efe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:56.679939  8320 tablet_service.cc:1511] Processing CreateTablet for tablet c66f53044d784114970ae5061755da40 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:01:56.681313  8320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c66f53044d784114970ae5061755da40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:56.681738  8541 tablet_service.cc:1511] Processing CreateTablet for tablet 40926724afa743899b7ab0af312dc717 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:01:56.683094  8541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40926724afa743899b7ab0af312dc717. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:56.685742  8319 tablet_service.cc:1511] Processing CreateTablet for tablet cd24f768f33e40bba3406e8dde3f45cc (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:01:56.686789  8543 tablet_service.cc:1511] Processing CreateTablet for tablet cd24f768f33e40bba3406e8dde3f45cc (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:01:56.688174  8543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd24f768f33e40bba3406e8dde3f45cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:56.685751  8540 tablet_service.cc:1511] Processing CreateTablet for tablet cea53371e56d4a668406dcd8f5a93dcb (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:01:56.688722  8317 tablet_service.cc:1511] Processing CreateTablet for tablet 5527a2aef01d45cebcfad8a1b0a5273d (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:01:56.687191  8319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd24f768f33e40bba3406e8dde3f45cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:56.690840  8316 tablet_service.cc:1511] Processing CreateTablet for tablet cea53371e56d4a668406dcd8f5a93dcb (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:01:56.692203  8316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cea53371e56d4a668406dcd8f5a93dcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:56.693783  8598 tablet_bootstrap.cc:492] T cd24f768f33e40bba3406e8dde3f45cc P 53a66c851dc74c70b94c65d464a391f6: Bootstrap starting.
I20260709 13:01:56.696905  8540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cea53371e56d4a668406dcd8f5a93dcb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:56.697825  8318 tablet_service.cc:1511] Processing CreateTablet for tablet 52f213b355c14b45a13d7cf5b3e76efe (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:01:56.699273  8318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52f213b355c14b45a13d7cf5b3e76efe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:56.701790  8317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5527a2aef01d45cebcfad8a1b0a5273d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:56.704875  8598 tablet_bootstrap.cc:654] T cd24f768f33e40bba3406e8dde3f45cc P 53a66c851dc74c70b94c65d464a391f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:56.720497  8469 tablet_service.cc:1511] Processing CreateTablet for tablet c66f53044d784114970ae5061755da40 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:01:56.721988  8469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c66f53044d784114970ae5061755da40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:56.725751  8468 tablet_service.cc:1511] Processing CreateTablet for tablet 52f213b355c14b45a13d7cf5b3e76efe (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:01:56.727140  8468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52f213b355c14b45a13d7cf5b3e76efe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:56.729759  8467 tablet_service.cc:1511] Processing CreateTablet for tablet 40926724afa743899b7ab0af312dc717 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:01:56.731160  8467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40926724afa743899b7ab0af312dc717. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:56.733700  8466 tablet_service.cc:1511] Processing CreateTablet for tablet 5527a2aef01d45cebcfad8a1b0a5273d (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:01:56.735111  8466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5527a2aef01d45cebcfad8a1b0a5273d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:56.737665  8465 tablet_service.cc:1511] Processing CreateTablet for tablet e8bdd44ba5144cadada8b14a380f995a (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:01:56.739004  8465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8bdd44ba5144cadada8b14a380f995a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:56.741755  8539 tablet_service.cc:1511] Processing CreateTablet for tablet e8bdd44ba5144cadada8b14a380f995a (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:01:56.743142  8539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8bdd44ba5144cadada8b14a380f995a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:56.749961  8392 tablet_service.cc:1511] Processing CreateTablet for tablet dbe23b457e664c298f0f2f6c41af32f8 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:01:56.751821  8392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbe23b457e664c298f0f2f6c41af32f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:56.754156  8315 tablet_service.cc:1511] Processing CreateTablet for tablet e8bdd44ba5144cadada8b14a380f995a (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:01:56.756050  8315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8bdd44ba5144cadada8b14a380f995a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:56.764138  8464 tablet_service.cc:1511] Processing CreateTablet for tablet dbe23b457e664c298f0f2f6c41af32f8 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:01:56.765583  8464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbe23b457e664c298f0f2f6c41af32f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:56.793625  8314 tablet_service.cc:1511] Processing CreateTablet for tablet a1946cc2deaa4799be02943612a39b16 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:01:56.794497  8538 tablet_service.cc:1511] Processing CreateTablet for tablet dbe23b457e664c298f0f2f6c41af32f8 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:01:56.795184  8314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1946cc2deaa4799be02943612a39b16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:56.795017  8393 tablet_service.cc:1511] Processing CreateTablet for tablet a1946cc2deaa4799be02943612a39b16 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:01:56.795956  8538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbe23b457e664c298f0f2f6c41af32f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:56.796357  8393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1946cc2deaa4799be02943612a39b16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:56.824183  8600 tablet_bootstrap.cc:492] T c66f53044d784114970ae5061755da40 P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:01:56.835973  8463 tablet_service.cc:1511] Processing CreateTablet for tablet a1946cc2deaa4799be02943612a39b16 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:01:56.838275  8463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1946cc2deaa4799be02943612a39b16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:56.842170  8320 tablet_service.cc:1511] Processing CreateTablet for tablet f8ec593f6c894c24a5bc727cfed4190a (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:01:56.843592  8320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8ec593f6c894c24a5bc727cfed4190a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:56.852718  8464 tablet_service.cc:1511] Processing CreateTablet for tablet da5b0b01a880412896838e8eb658db7a (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
W20260709 13:01:56.864051  8276 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:56.865407  8391 tablet_service.cc:1511] Processing CreateTablet for tablet f8ec593f6c894c24a5bc727cfed4190a (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:01:56.861573  8464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da5b0b01a880412896838e8eb658db7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:56.866746  8391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8ec593f6c894c24a5bc727cfed4190a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:56.874581  8540 tablet_service.cc:1511] Processing CreateTablet for tablet f8ec593f6c894c24a5bc727cfed4190a (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:01:56.875929  8540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8ec593f6c894c24a5bc727cfed4190a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:56.892832  8542 tablet_service.cc:1511] Processing CreateTablet for tablet da5b0b01a880412896838e8eb658db7a (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:01:56.894263  8542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da5b0b01a880412896838e8eb658db7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:56.894719  8600 tablet_bootstrap.cc:654] T c66f53044d784114970ae5061755da40 P 590ee39ce5734876b94d91fc3931b807: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:56.896322  8393 tablet_service.cc:1511] Processing CreateTablet for tablet 1dcf623b1e5f47ec9cf4b5d9f00d4c1b (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:01:56.897787  8393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dcf623b1e5f47ec9cf4b5d9f00d4c1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:56.904762  8466 tablet_service.cc:1511] Processing CreateTablet for tablet 1dcf623b1e5f47ec9cf4b5d9f00d4c1b (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:01:56.905287  8543 tablet_service.cc:1511] Processing CreateTablet for tablet 1dcf623b1e5f47ec9cf4b5d9f00d4c1b (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:01:56.906605  8543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dcf623b1e5f47ec9cf4b5d9f00d4c1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:56.906647  8466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1dcf623b1e5f47ec9cf4b5d9f00d4c1b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:56.922741  8601 tablet_bootstrap.cc:492] T 52f213b355c14b45a13d7cf5b3e76efe P b560e9aaec7a4c78b9123b38e73519a3: Bootstrap starting.
I20260709 13:01:56.924103  8318 tablet_service.cc:1511] Processing CreateTablet for tablet 6540f8b1e5df49f698558db1af45038b (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:01:56.925462  8318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6540f8b1e5df49f698558db1af45038b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:56.931202  8601 tablet_bootstrap.cc:654] T 52f213b355c14b45a13d7cf5b3e76efe P b560e9aaec7a4c78b9123b38e73519a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:56.932745  8602 tablet_bootstrap.cc:492] T 40926724afa743899b7ab0af312dc717 P 7b3ea460d1294b8a82672d7c21475cb5: Bootstrap starting.
I20260709 13:01:56.934572  8598 tablet_bootstrap.cc:492] T cd24f768f33e40bba3406e8dde3f45cc P 53a66c851dc74c70b94c65d464a391f6: No bootstrap required, opened a new log
I20260709 13:01:56.937427  8395 tablet_service.cc:1511] Processing CreateTablet for tablet 6540f8b1e5df49f698558db1af45038b (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:01:56.937366  8317 tablet_service.cc:1511] Processing CreateTablet for tablet da5b0b01a880412896838e8eb658db7a (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:01:56.946202  8317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da5b0b01a880412896838e8eb658db7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:56.945904  8467 tablet_service.cc:1511] Processing CreateTablet for tablet 6540f8b1e5df49f698558db1af45038b (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:01:56.947212  8467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6540f8b1e5df49f698558db1af45038b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:56.948937  8602 tablet_bootstrap.cc:654] T 40926724afa743899b7ab0af312dc717 P 7b3ea460d1294b8a82672d7c21475cb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:56.949225  8395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6540f8b1e5df49f698558db1af45038b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:56.962492  8598 ts_tablet_manager.cc:1403] T cd24f768f33e40bba3406e8dde3f45cc P 53a66c851dc74c70b94c65d464a391f6: Time spent bootstrapping tablet: real 0.269s	user 0.037s	sys 0.060s
I20260709 13:01:56.969939  8540 tablet_service.cc:1511] Processing CreateTablet for tablet e1f344d27b0b44819ef6d23574175c26 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:01:56.972563  8540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1f344d27b0b44819ef6d23574175c26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:56.977638  8316 tablet_service.cc:1511] Processing CreateTablet for tablet e1f344d27b0b44819ef6d23574175c26 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:01:56.980044  8316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1f344d27b0b44819ef6d23574175c26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:56.984862  8601 tablet_bootstrap.cc:492] T 52f213b355c14b45a13d7cf5b3e76efe P b560e9aaec7a4c78b9123b38e73519a3: No bootstrap required, opened a new log
I20260709 13:01:56.985417  8601 ts_tablet_manager.cc:1403] T 52f213b355c14b45a13d7cf5b3e76efe P b560e9aaec7a4c78b9123b38e73519a3: Time spent bootstrapping tablet: real 0.063s	user 0.005s	sys 0.014s
I20260709 13:01:56.985633  8600 tablet_bootstrap.cc:492] T c66f53044d784114970ae5061755da40 P 590ee39ce5734876b94d91fc3931b807: No bootstrap required, opened a new log
I20260709 13:01:56.986182  8600 ts_tablet_manager.cc:1403] T c66f53044d784114970ae5061755da40 P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.162s	user 0.013s	sys 0.033s
I20260709 13:01:56.980664  8598 raft_consensus.cc:359] T cd24f768f33e40bba3406e8dde3f45cc P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:01:56.988468  8601 raft_consensus.cc:359] T 52f213b355c14b45a13d7cf5b3e76efe P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:01:56.988608  8468 tablet_service.cc:1511] Processing CreateTablet for tablet 4a8bd38b8a2e4bbd9d07dcf2f1cea143 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:01:56.989390  8601 raft_consensus.cc:385] T 52f213b355c14b45a13d7cf5b3e76efe P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:56.988945  8598 raft_consensus.cc:385] T cd24f768f33e40bba3406e8dde3f45cc P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:56.989732  8601 raft_consensus.cc:740] T 52f213b355c14b45a13d7cf5b3e76efe P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:56.990110  8468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a8bd38b8a2e4bbd9d07dcf2f1cea143. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:56.990578  8601 consensus_queue.cc:260] T 52f213b355c14b45a13d7cf5b3e76efe P b560e9aaec7a4c78b9123b38e73519a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:01:56.992506  8598 raft_consensus.cc:740] T cd24f768f33e40bba3406e8dde3f45cc P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Initialized, Role: FOLLOWER
I20260709 13:01:56.995888  8318 tablet_service.cc:1511] Processing CreateTablet for tablet 4a8bd38b8a2e4bbd9d07dcf2f1cea143 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:01:56.996750  8598 consensus_queue.cc:260] T cd24f768f33e40bba3406e8dde3f45cc P 53a66c851dc74c70b94c65d464a391f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:01:56.997486  8318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a8bd38b8a2e4bbd9d07dcf2f1cea143. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:56.998155  8600 raft_consensus.cc:359] T c66f53044d784114970ae5061755da40 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:01:56.998893  8600 raft_consensus.cc:385] T c66f53044d784114970ae5061755da40 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:56.999183  8600 raft_consensus.cc:740] T c66f53044d784114970ae5061755da40 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:01:57.000007  8600 consensus_queue.cc:260] T c66f53044d784114970ae5061755da40 P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:01:57.004420  8598 ts_tablet_manager.cc:1434] T cd24f768f33e40bba3406e8dde3f45cc P 53a66c851dc74c70b94c65d464a391f6: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.002s
I20260709 13:01:57.005426  8430 heartbeater.cc:499] Master 127.0.107.254:37501 was elected leader, sending a full tablet report...
I20260709 13:01:57.005565  8391 tablet_service.cc:1511] Processing CreateTablet for tablet e1f344d27b0b44819ef6d23574175c26 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:01:57.007376  8391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1f344d27b0b44819ef6d23574175c26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:57.005776  8542 tablet_service.cc:1511] Processing CreateTablet for tablet 4a8bd38b8a2e4bbd9d07dcf2f1cea143 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:01:57.009488  8542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a8bd38b8a2e4bbd9d07dcf2f1cea143. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:57.010798  8598 tablet_bootstrap.cc:492] T 40926724afa743899b7ab0af312dc717 P 53a66c851dc74c70b94c65d464a391f6: Bootstrap starting.
I20260709 13:01:57.012266  8395 tablet_service.cc:1511] Processing CreateTablet for tablet 5095fba09faf47dd939329e762fbc663 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:01:57.017395  8355 heartbeater.cc:499] Master 127.0.107.254:37501 was elected leader, sending a full tablet report...
I20260709 13:01:57.018601  8600 ts_tablet_manager.cc:1434] T c66f53044d784114970ae5061755da40 P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.032s	user 0.003s	sys 0.005s
I20260709 13:01:57.019814  8600 tablet_bootstrap.cc:492] T cd24f768f33e40bba3406e8dde3f45cc P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:01:57.027732  8395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5095fba09faf47dd939329e762fbc663. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:57.031270  8543 tablet_service.cc:1511] Processing CreateTablet for tablet 5095fba09faf47dd939329e762fbc663 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:01:57.029361  8467 tablet_service.cc:1511] Processing CreateTablet for tablet 5095fba09faf47dd939329e762fbc663 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:01:57.033691  8314 tablet_service.cc:1511] Processing CreateTablet for tablet c63211d1d13a4736adb18dee69b400a3 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:01:57.034458  8543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5095fba09faf47dd939329e762fbc663. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:57.034931  8314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c63211d1d13a4736adb18dee69b400a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:57.037792  8393 tablet_service.cc:1511] Processing CreateTablet for tablet c63211d1d13a4736adb18dee69b400a3 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:01:57.039237  8393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c63211d1d13a4736adb18dee69b400a3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:01:57.040207  8356 tablet.cc:2406] T c66f53044d784114970ae5061755da40 P 590ee39ce5734876b94d91fc3931b807: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:01:57.034448  8467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5095fba09faf47dd939329e762fbc663. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:57.046535  8607 raft_consensus.cc:493] T cd24f768f33e40bba3406e8dde3f45cc P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.047346  8578 heartbeater.cc:499] Master 127.0.107.254:37501 was elected leader, sending a full tablet report...
I20260709 13:01:57.048020  8601 ts_tablet_manager.cc:1434] T 52f213b355c14b45a13d7cf5b3e76efe P b560e9aaec7a4c78b9123b38e73519a3: Time spent starting tablet: real 0.062s	user 0.008s	sys 0.010s
I20260709 13:01:57.064352  8602 tablet_bootstrap.cc:492] T 40926724afa743899b7ab0af312dc717 P 7b3ea460d1294b8a82672d7c21475cb5: No bootstrap required, opened a new log
I20260709 13:01:57.064942  8602 ts_tablet_manager.cc:1403] T 40926724afa743899b7ab0af312dc717 P 7b3ea460d1294b8a82672d7c21475cb5: Time spent bootstrapping tablet: real 0.133s	user 0.009s	sys 0.016s
I20260709 13:01:57.068002  8602 raft_consensus.cc:359] T 40926724afa743899b7ab0af312dc717 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:01:57.069058  8602 raft_consensus.cc:385] T 40926724afa743899b7ab0af312dc717 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:57.069399  8602 raft_consensus.cc:740] T 40926724afa743899b7ab0af312dc717 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Initialized, Role: FOLLOWER
I20260709 13:01:57.070176  8607 raft_consensus.cc:515] T cd24f768f33e40bba3406e8dde3f45cc P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:01:57.070788  8601 tablet_bootstrap.cc:492] T cea53371e56d4a668406dcd8f5a93dcb P b560e9aaec7a4c78b9123b38e73519a3: Bootstrap starting.
I20260709 13:01:57.071199  8600 tablet_bootstrap.cc:654] T cd24f768f33e40bba3406e8dde3f45cc P 590ee39ce5734876b94d91fc3931b807: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:57.049520  8466 tablet_service.cc:1511] Processing CreateTablet for tablet c63211d1d13a4736adb18dee69b400a3 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:01:57.073333  8466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c63211d1d13a4736adb18dee69b400a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:57.053699  8598 tablet_bootstrap.cc:654] T 40926724afa743899b7ab0af312dc717 P 53a66c851dc74c70b94c65d464a391f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:57.078634  8607 leader_election.cc:290] T cd24f768f33e40bba3406e8dde3f45cc P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:01:57.089980  8543 tablet_service.cc:1511] Processing CreateTablet for tablet 45171bd0207f452f9884a58c225ddb72 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:01:57.091506  8543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45171bd0207f452f9884a58c225ddb72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:57.106170  8317 tablet_service.cc:1511] Processing CreateTablet for tablet 45171bd0207f452f9884a58c225ddb72 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:01:57.107563  8317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45171bd0207f452f9884a58c225ddb72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:57.070257  8602 consensus_queue.cc:260] T 40926724afa743899b7ab0af312dc717 P 7b3ea460d1294b8a82672d7c21475cb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:01:57.146613  8393 tablet_service.cc:1511] Processing CreateTablet for tablet 45171bd0207f452f9884a58c225ddb72 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:01:57.148052  8468 tablet_service.cc:1511] Processing CreateTablet for tablet 6433163abeff4ee0b011d159ca454a6a (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:01:57.149510  8468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6433163abeff4ee0b011d159ca454a6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:57.150871  8553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd24f768f33e40bba3406e8dde3f45cc" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3" is_pre_election: true
I20260709 13:01:57.148056  8393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 45171bd0207f452f9884a58c225ddb72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:57.152781  8601 tablet_bootstrap.cc:654] T cea53371e56d4a668406dcd8f5a93dcb P b560e9aaec7a4c78b9123b38e73519a3: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:57.152873  8369 leader_election.cc:343] T cd24f768f33e40bba3406e8dde3f45cc P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:57.161906  8608 raft_consensus.cc:493] T c66f53044d784114970ae5061755da40 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.162705  8608 raft_consensus.cc:515] T c66f53044d784114970ae5061755da40 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:01:57.183471  8316 tablet_service.cc:1511] Processing CreateTablet for tablet 6433163abeff4ee0b011d159ca454a6a (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:01:57.169564  8542 tablet_service.cc:1511] Processing CreateTablet for tablet 6433163abeff4ee0b011d159ca454a6a (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:01:57.187716  8316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6433163abeff4ee0b011d159ca454a6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:57.188632  8542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6433163abeff4ee0b011d159ca454a6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:57.190891  8608 leader_election.cc:290] T c66f53044d784114970ae5061755da40 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:01:57.198212  8598 tablet_bootstrap.cc:492] T 40926724afa743899b7ab0af312dc717 P 53a66c851dc74c70b94c65d464a391f6: No bootstrap required, opened a new log
I20260709 13:01:57.199569  8598 ts_tablet_manager.cc:1403] T 40926724afa743899b7ab0af312dc717 P 53a66c851dc74c70b94c65d464a391f6: Time spent bootstrapping tablet: real 0.189s	user 0.015s	sys 0.011s
I20260709 13:01:57.204600  8391 tablet_service.cc:1511] Processing CreateTablet for tablet ae8659e834df408ab36dd56103f10ae4 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:01:57.206035  8391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae8659e834df408ab36dd56103f10ae4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:57.223167  8504 heartbeater.cc:499] Master 127.0.107.254:37501 was elected leader, sending a full tablet report...
I20260709 13:01:57.243360  8600 tablet_bootstrap.cc:492] T cd24f768f33e40bba3406e8dde3f45cc P 590ee39ce5734876b94d91fc3931b807: No bootstrap required, opened a new log
I20260709 13:01:57.247917  8602 ts_tablet_manager.cc:1434] T 40926724afa743899b7ab0af312dc717 P 7b3ea460d1294b8a82672d7c21475cb5: Time spent starting tablet: real 0.183s	user 0.003s	sys 0.010s
I20260709 13:01:57.253537  8598 raft_consensus.cc:359] T 40926724afa743899b7ab0af312dc717 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:01:57.254946  8598 raft_consensus.cc:385] T 40926724afa743899b7ab0af312dc717 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:57.255875  8598 raft_consensus.cc:740] T 40926724afa743899b7ab0af312dc717 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Initialized, Role: FOLLOWER
I20260709 13:01:57.259258  8601 tablet_bootstrap.cc:492] T cea53371e56d4a668406dcd8f5a93dcb P b560e9aaec7a4c78b9123b38e73519a3: No bootstrap required, opened a new log
I20260709 13:01:57.259804  8601 ts_tablet_manager.cc:1403] T cea53371e56d4a668406dcd8f5a93dcb P b560e9aaec7a4c78b9123b38e73519a3: Time spent bootstrapping tablet: real 0.189s	user 0.029s	sys 0.015s
I20260709 13:01:57.265067  8613 raft_consensus.cc:493] T 40926724afa743899b7ab0af312dc717 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:01:57.265360  8214 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.107.194:37751, user_credentials={real_user=slave}} blocked reactor thread for 48108.6us
I20260709 13:01:57.265653  8613 raft_consensus.cc:515] T 40926724afa743899b7ab0af312dc717 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:01:57.264804  8601 raft_consensus.cc:359] T cea53371e56d4a668406dcd8f5a93dcb P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:01:57.245307  8600 ts_tablet_manager.cc:1403] T cd24f768f33e40bba3406e8dde3f45cc P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.226s	user 0.014s	sys 0.006s
I20260709 13:01:57.266889  8601 raft_consensus.cc:385] T cea53371e56d4a668406dcd8f5a93dcb P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:57.266680  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd24f768f33e40bba3406e8dde3f45cc" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
I20260709 13:01:57.268748  8601 raft_consensus.cc:740] T cea53371e56d4a668406dcd8f5a93dcb P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Initialized, Role: FOLLOWER
W20260709 13:01:57.268986  8371 leader_election.cc:343] T cd24f768f33e40bba3406e8dde3f45cc P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:57.269461  8371 leader_election.cc:304] T cd24f768f33e40bba3406e8dde3f45cc P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6; no voters: 590ee39ce5734876b94d91fc3931b807, b560e9aaec7a4c78b9123b38e73519a3
I20260709 13:01:57.270255  8607 raft_consensus.cc:2749] T cd24f768f33e40bba3406e8dde3f45cc P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:57.269866  8467 tablet_service.cc:1511] Processing CreateTablet for tablet ae8659e834df408ab36dd56103f10ae4 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:01:57.269780  8601 consensus_queue.cc:260] T cea53371e56d4a668406dcd8f5a93dcb P b560e9aaec7a4c78b9123b38e73519a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:01:57.271531  8467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae8659e834df408ab36dd56103f10ae4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:57.272518  8601 ts_tablet_manager.cc:1434] T cea53371e56d4a668406dcd8f5a93dcb P b560e9aaec7a4c78b9123b38e73519a3: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 13:01:57.278944  8601 tablet_bootstrap.cc:492] T 40926724afa743899b7ab0af312dc717 P b560e9aaec7a4c78b9123b38e73519a3: Bootstrap starting.
I20260709 13:01:57.267308  8602 tablet_bootstrap.cc:492] T dbe23b457e664c298f0f2f6c41af32f8 P 7b3ea460d1294b8a82672d7c21475cb5: Bootstrap starting.
I20260709 13:01:57.280987  8598 consensus_queue.cc:260] T 40926724afa743899b7ab0af312dc717 P 53a66c851dc74c70b94c65d464a391f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:01:57.295025  8543 tablet_service.cc:1511] Processing CreateTablet for tablet ae8659e834df408ab36dd56103f10ae4 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:01:57.297514  8613 leader_election.cc:290] T 40926724afa743899b7ab0af312dc717 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751), b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503)
I20260709 13:01:57.300383  8543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae8659e834df408ab36dd56103f10ae4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:57.300220  8317 tablet_service.cc:1511] Processing CreateTablet for tablet 8b0d84add64c4f5db82c90e98b7f4b74 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:01:57.301678  8317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b0d84add64c4f5db82c90e98b7f4b74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:57.275585  8600 raft_consensus.cc:359] T cd24f768f33e40bba3406e8dde3f45cc P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:01:57.306733  8605 raft_consensus.cc:493] T 52f213b355c14b45a13d7cf5b3e76efe P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.312850  8605 raft_consensus.cc:515] T 52f213b355c14b45a13d7cf5b3e76efe P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:01:57.313040  8391 tablet_service.cc:1511] Processing CreateTablet for tablet 8b0d84add64c4f5db82c90e98b7f4b74 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:01:57.314306  8391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b0d84add64c4f5db82c90e98b7f4b74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:57.318548  8605 leader_election.cc:290] T 52f213b355c14b45a13d7cf5b3e76efe P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:01:57.320822  8466 tablet_service.cc:1511] Processing CreateTablet for tablet 8b0d84add64c4f5db82c90e98b7f4b74 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:01:57.322866  8466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b0d84add64c4f5db82c90e98b7f4b74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:57.335227  8600 raft_consensus.cc:385] T cd24f768f33e40bba3406e8dde3f45cc P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:57.335836  8600 raft_consensus.cc:740] T cd24f768f33e40bba3406e8dde3f45cc P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:01:57.309450  8598 ts_tablet_manager.cc:1434] T 40926724afa743899b7ab0af312dc717 P 53a66c851dc74c70b94c65d464a391f6: Time spent starting tablet: real 0.105s	user 0.003s	sys 0.005s
I20260709 13:01:57.359565  8540 tablet_service.cc:1511] Processing CreateTablet for tablet 5a94bf713e4848879b9e2a1bbec03def (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:01:57.362331  8598 tablet_bootstrap.cc:492] T 5527a2aef01d45cebcfad8a1b0a5273d P 53a66c851dc74c70b94c65d464a391f6: Bootstrap starting.
I20260709 13:01:57.362581  8540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a94bf713e4848879b9e2a1bbec03def. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:57.363121  8601 tablet_bootstrap.cc:654] T 40926724afa743899b7ab0af312dc717 P b560e9aaec7a4c78b9123b38e73519a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:57.363351  8318 tablet_service.cc:1511] Processing CreateTablet for tablet 5a94bf713e4848879b9e2a1bbec03def (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:01:57.364851  8318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a94bf713e4848879b9e2a1bbec03def. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:57.380312  8393 tablet_service.cc:1511] Processing CreateTablet for tablet 5a94bf713e4848879b9e2a1bbec03def (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:01:57.381742  8393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a94bf713e4848879b9e2a1bbec03def. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:57.404626  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66f53044d784114970ae5061755da40" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:01:57.405217  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66f53044d784114970ae5061755da40" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
I20260709 13:01:57.405417  8538 tablet_service.cc:1511] Processing CreateTablet for tablet 7c9804c61fdb47a7958574869d381b72 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
W20260709 13:01:57.406416  8295 leader_election.cc:343] T c66f53044d784114970ae5061755da40 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:57.406728  8538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c9804c61fdb47a7958574869d381b72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:57.407033  8602 tablet_bootstrap.cc:654] T dbe23b457e664c298f0f2f6c41af32f8 P 7b3ea460d1294b8a82672d7c21475cb5: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:57.407222  8295 leader_election.cc:343] T c66f53044d784114970ae5061755da40 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:57.407644  8295 leader_election.cc:304] T c66f53044d784114970ae5061755da40 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807; no voters: 53a66c851dc74c70b94c65d464a391f6, 7b3ea460d1294b8a82672d7c21475cb5
I20260709 13:01:57.408849  8608 raft_consensus.cc:2749] T c66f53044d784114970ae5061755da40 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:57.411957  8463 tablet_service.cc:1511] Processing CreateTablet for tablet 7c9804c61fdb47a7958574869d381b72 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:01:57.413313  8463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c9804c61fdb47a7958574869d381b72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:57.433185  8314 tablet_service.cc:1511] Processing CreateTablet for tablet a3a46de7366f4683a88d19d25ad04901 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:01:57.435037  8314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3a46de7366f4683a88d19d25ad04901. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:57.396045  8468 tablet_service.cc:1511] Processing CreateTablet for tablet a79ccdf7d9cf4be7bf8b0c69bf90538a (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:01:57.437045  8468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a79ccdf7d9cf4be7bf8b0c69bf90538a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:57.437865  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f213b355c14b45a13d7cf5b3e76efe" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
I20260709 13:01:57.439472  8542 tablet_service.cc:1511] Processing CreateTablet for tablet a79ccdf7d9cf4be7bf8b0c69bf90538a (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
W20260709 13:01:57.439749  8519 leader_election.cc:343] T 52f213b355c14b45a13d7cf5b3e76efe P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:57.440913  8542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a79ccdf7d9cf4be7bf8b0c69bf90538a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:57.355096  8600 consensus_queue.cc:260] T cd24f768f33e40bba3406e8dde3f45cc P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:01:57.441432  8608 raft_consensus.cc:493] T cd24f768f33e40bba3406e8dde3f45cc P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.444375  8608 raft_consensus.cc:515] T cd24f768f33e40bba3406e8dde3f45cc P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:01:57.444855  8317 tablet_service.cc:1511] Processing CreateTablet for tablet a79ccdf7d9cf4be7bf8b0c69bf90538a (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:01:57.445755  8601 tablet_bootstrap.cc:492] T 40926724afa743899b7ab0af312dc717 P b560e9aaec7a4c78b9123b38e73519a3: No bootstrap required, opened a new log
I20260709 13:01:57.446318  8601 ts_tablet_manager.cc:1403] T 40926724afa743899b7ab0af312dc717 P b560e9aaec7a4c78b9123b38e73519a3: Time spent bootstrapping tablet: real 0.168s	user 0.039s	sys 0.032s
I20260709 13:01:57.448366  8598 tablet_bootstrap.cc:654] T 5527a2aef01d45cebcfad8a1b0a5273d P 53a66c851dc74c70b94c65d464a391f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:57.453044  8317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a79ccdf7d9cf4be7bf8b0c69bf90538a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:57.453706  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f213b355c14b45a13d7cf5b3e76efe" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
W20260709 13:01:57.455222  8518 leader_election.cc:343] T 52f213b355c14b45a13d7cf5b3e76efe P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:57.455688  8518 leader_election.cc:304] T 52f213b355c14b45a13d7cf5b3e76efe P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b560e9aaec7a4c78b9123b38e73519a3; no voters: 590ee39ce5734876b94d91fc3931b807, 7b3ea460d1294b8a82672d7c21475cb5
I20260709 13:01:57.456656  8395 tablet_service.cc:1511] Processing CreateTablet for tablet a3a46de7366f4683a88d19d25ad04901 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:01:57.458518  8395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3a46de7366f4683a88d19d25ad04901. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:57.461630  8608 leader_election.cc:290] T cd24f768f33e40bba3406e8dde3f45cc P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:01:57.462821  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd24f768f33e40bba3406e8dde3f45cc" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:01:57.463562  8405 raft_consensus.cc:2468] T cd24f768f33e40bba3406e8dde3f45cc P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 590ee39ce5734876b94d91fc3931b807 in term 0.
I20260709 13:01:57.471026  8295 leader_election.cc:304] T cd24f768f33e40bba3406e8dde3f45cc P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, 590ee39ce5734876b94d91fc3931b807; no voters: 
I20260709 13:01:57.457122  8464 tablet_service.cc:1511] Processing CreateTablet for tablet a3a46de7366f4683a88d19d25ad04901 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:01:57.473053  8464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a3a46de7366f4683a88d19d25ad04901. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:57.476030  8553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40926724afa743899b7ab0af312dc717" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3" is_pre_election: true
I20260709 13:01:57.480988  8543 tablet_service.cc:1511] Processing CreateTablet for tablet 73b7ef1c3ead4480b17e7ce7da20f5f5 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:01:57.482426  8543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73b7ef1c3ead4480b17e7ce7da20f5f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:57.489563  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40926724afa743899b7ab0af312dc717" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:01:57.490371  8405 raft_consensus.cc:2468] T 40926724afa743899b7ab0af312dc717 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b3ea460d1294b8a82672d7c21475cb5 in term 0.
I20260709 13:01:57.491406  8605 raft_consensus.cc:2749] T 52f213b355c14b45a13d7cf5b3e76efe P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:57.449441  8601 raft_consensus.cc:359] T 40926724afa743899b7ab0af312dc717 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:01:57.485697  8608 raft_consensus.cc:2804] T cd24f768f33e40bba3406e8dde3f45cc P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:57.501358  8608 raft_consensus.cc:493] T cd24f768f33e40bba3406e8dde3f45cc P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:57.501773  8608 raft_consensus.cc:3060] T cd24f768f33e40bba3406e8dde3f45cc P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:57.491808  8444 leader_election.cc:304] T 40926724afa743899b7ab0af312dc717 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, 7b3ea460d1294b8a82672d7c21475cb5; no voters: 
I20260709 13:01:57.497510  8316 tablet_service.cc:1511] Processing CreateTablet for tablet 73b7ef1c3ead4480b17e7ce7da20f5f5 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:01:57.505053  8613 raft_consensus.cc:2804] T 40926724afa743899b7ab0af312dc717 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:57.505427  8613 raft_consensus.cc:493] T 40926724afa743899b7ab0af312dc717 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:57.505533  8316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73b7ef1c3ead4480b17e7ce7da20f5f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:57.505829  8613 raft_consensus.cc:3060] T 40926724afa743899b7ab0af312dc717 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:57.512683  8613 raft_consensus.cc:515] T 40926724afa743899b7ab0af312dc717 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:01:57.515357  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40926724afa743899b7ab0af312dc717" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6"
I20260709 13:01:57.516021  8405 raft_consensus.cc:3060] T 40926724afa743899b7ab0af312dc717 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:57.516356  8552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40926724afa743899b7ab0af312dc717" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3"
I20260709 13:01:57.518162  8613 leader_election.cc:290] T 40926724afa743899b7ab0af312dc717 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 election: Requested vote from peers 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751), b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503)
I20260709 13:01:57.519312  8393 tablet_service.cc:1511] Processing CreateTablet for tablet 7c9804c61fdb47a7958574869d381b72 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:01:57.520669  8393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c9804c61fdb47a7958574869d381b72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:57.495266  8601 raft_consensus.cc:385] T 40926724afa743899b7ab0af312dc717 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:57.528903  8601 raft_consensus.cc:740] T 40926724afa743899b7ab0af312dc717 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:57.531533  8405 raft_consensus.cc:2468] T 40926724afa743899b7ab0af312dc717 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b3ea460d1294b8a82672d7c21475cb5 in term 1.
I20260709 13:01:57.532809  8444 leader_election.cc:304] T 40926724afa743899b7ab0af312dc717 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, 7b3ea460d1294b8a82672d7c21475cb5; no voters: b560e9aaec7a4c78b9123b38e73519a3
I20260709 13:01:57.534107  8613 raft_consensus.cc:2804] T 40926724afa743899b7ab0af312dc717 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:57.534147  8608 raft_consensus.cc:515] T cd24f768f33e40bba3406e8dde3f45cc P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:01:57.538058  8608 leader_election.cc:290] T cd24f768f33e40bba3406e8dde3f45cc P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 election: Requested vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:01:57.541085  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd24f768f33e40bba3406e8dde3f45cc" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6"
I20260709 13:01:57.541021  8601 consensus_queue.cc:260] T 40926724afa743899b7ab0af312dc717 P b560e9aaec7a4c78b9123b38e73519a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:01:57.541862  8404 raft_consensus.cc:3060] T cd24f768f33e40bba3406e8dde3f45cc P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:57.542155  8553 raft_consensus.cc:2468] T 40926724afa743899b7ab0af312dc717 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b3ea460d1294b8a82672d7c21475cb5 in term 0.
I20260709 13:01:57.546829  8601 ts_tablet_manager.cc:1434] T 40926724afa743899b7ab0af312dc717 P b560e9aaec7a4c78b9123b38e73519a3: Time spent starting tablet: real 0.100s	user 0.008s	sys 0.000s
I20260709 13:01:57.549355  8404 raft_consensus.cc:2468] T cd24f768f33e40bba3406e8dde3f45cc P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 590ee39ce5734876b94d91fc3931b807 in term 1.
I20260709 13:01:57.550616  8295 leader_election.cc:304] T cd24f768f33e40bba3406e8dde3f45cc P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, 590ee39ce5734876b94d91fc3931b807; no voters: 
I20260709 13:01:57.551510  8608 raft_consensus.cc:2804] T cd24f768f33e40bba3406e8dde3f45cc P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:57.551993  8608 raft_consensus.cc:697] T cd24f768f33e40bba3406e8dde3f45cc P 590ee39ce5734876b94d91fc3931b807 [term 1 LEADER]: Becoming Leader. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Running, Role: LEADER
I20260709 13:01:57.552932  8608 consensus_queue.cc:237] T cd24f768f33e40bba3406e8dde3f45cc P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:01:57.554204  8601 tablet_bootstrap.cc:492] T cd24f768f33e40bba3406e8dde3f45cc P b560e9aaec7a4c78b9123b38e73519a3: Bootstrap starting.
I20260709 13:01:57.561568  8601 tablet_bootstrap.cc:654] T cd24f768f33e40bba3406e8dde3f45cc P b560e9aaec7a4c78b9123b38e73519a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:57.562546  8605 raft_consensus.cc:493] T cea53371e56d4a668406dcd8f5a93dcb P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.564280  8605 raft_consensus.cc:515] T cea53371e56d4a668406dcd8f5a93dcb P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:01:57.578202  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cea53371e56d4a668406dcd8f5a93dcb" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
I20260709 13:01:57.579316  8552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd24f768f33e40bba3406e8dde3f45cc" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3"
W20260709 13:01:57.581844  8294 leader_election.cc:343] T cd24f768f33e40bba3406e8dde3f45cc P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:57.582780  8553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd24f768f33e40bba3406e8dde3f45cc" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3" is_pre_election: true
I20260709 13:01:57.584154  8605 leader_election.cc:290] T cea53371e56d4a668406dcd8f5a93dcb P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:01:57.585575  8392 tablet_service.cc:1511] Processing CreateTablet for tablet 73b7ef1c3ead4480b17e7ce7da20f5f5 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:01:57.587584  8392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73b7ef1c3ead4480b17e7ce7da20f5f5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:01:57.590140  8519 leader_election.cc:343] T cea53371e56d4a668406dcd8f5a93dcb P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:57.590906  8602 tablet_bootstrap.cc:492] T dbe23b457e664c298f0f2f6c41af32f8 P 7b3ea460d1294b8a82672d7c21475cb5: No bootstrap required, opened a new log
I20260709 13:01:57.591449  8602 ts_tablet_manager.cc:1403] T dbe23b457e664c298f0f2f6c41af32f8 P 7b3ea460d1294b8a82672d7c21475cb5: Time spent bootstrapping tablet: real 0.324s	user 0.019s	sys 0.033s
I20260709 13:01:57.597568  8600 ts_tablet_manager.cc:1434] T cd24f768f33e40bba3406e8dde3f45cc P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.325s	user 0.017s	sys 0.027s
I20260709 13:01:57.599409  8600 tablet_bootstrap.cc:492] T e8bdd44ba5144cadada8b14a380f995a P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:01:57.599128  8602 raft_consensus.cc:359] T dbe23b457e664c298f0f2f6c41af32f8 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:01:57.599944  8602 raft_consensus.cc:385] T dbe23b457e664c298f0f2f6c41af32f8 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:57.602782  8466 tablet_service.cc:1511] Processing CreateTablet for tablet 62a3aed976de4d62a1d4dc7bc5252328 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:01:57.604146  8466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62a3aed976de4d62a1d4dc7bc5252328. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:01:57.604612  8294 leader_election.cc:343] T cd24f768f33e40bba3406e8dde3f45cc P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:57.607120  8600 tablet_bootstrap.cc:654] T e8bdd44ba5144cadada8b14a380f995a P 590ee39ce5734876b94d91fc3931b807: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:57.600286  8602 raft_consensus.cc:740] T dbe23b457e664c298f0f2f6c41af32f8 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Initialized, Role: FOLLOWER
I20260709 13:01:57.610996  8613 raft_consensus.cc:697] T 40926724afa743899b7ab0af312dc717 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 LEADER]: Becoming Leader. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Running, Role: LEADER
I20260709 13:01:57.618355  8613 consensus_queue.cc:237] T 40926724afa743899b7ab0af312dc717 P 7b3ea460d1294b8a82672d7c21475cb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:01:57.619580  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cea53371e56d4a668406dcd8f5a93dcb" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
W20260709 13:01:57.621127  8518 leader_election.cc:343] T cea53371e56d4a668406dcd8f5a93dcb P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:57.621599  8518 leader_election.cc:304] T cea53371e56d4a668406dcd8f5a93dcb P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b560e9aaec7a4c78b9123b38e73519a3; no voters: 53a66c851dc74c70b94c65d464a391f6, 590ee39ce5734876b94d91fc3931b807
I20260709 13:01:57.622457  8605 raft_consensus.cc:2749] T cea53371e56d4a668406dcd8f5a93dcb P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:57.630771  8602 consensus_queue.cc:260] T dbe23b457e664c298f0f2f6c41af32f8 P 7b3ea460d1294b8a82672d7c21475cb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:01:57.635984  8602 ts_tablet_manager.cc:1434] T dbe23b457e664c298f0f2f6c41af32f8 P 7b3ea460d1294b8a82672d7c21475cb5: Time spent starting tablet: real 0.044s	user 0.004s	sys 0.004s
I20260709 13:01:57.638670  8598 tablet_bootstrap.cc:492] T 5527a2aef01d45cebcfad8a1b0a5273d P 53a66c851dc74c70b94c65d464a391f6: No bootstrap required, opened a new log
I20260709 13:01:57.641072  8598 ts_tablet_manager.cc:1403] T 5527a2aef01d45cebcfad8a1b0a5273d P 53a66c851dc74c70b94c65d464a391f6: Time spent bootstrapping tablet: real 0.279s	user 0.011s	sys 0.014s
I20260709 13:01:57.645434  8598 raft_consensus.cc:359] T 5527a2aef01d45cebcfad8a1b0a5273d P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:01:57.646459  8598 raft_consensus.cc:385] T 5527a2aef01d45cebcfad8a1b0a5273d P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:57.646867  8598 raft_consensus.cc:740] T 5527a2aef01d45cebcfad8a1b0a5273d P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Initialized, Role: FOLLOWER
I20260709 13:01:57.658694  8317 tablet_service.cc:1511] Processing CreateTablet for tablet 62a3aed976de4d62a1d4dc7bc5252328 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:01:57.647866  8598 consensus_queue.cc:260] T 5527a2aef01d45cebcfad8a1b0a5273d P 53a66c851dc74c70b94c65d464a391f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:01:57.662060  8601 tablet_bootstrap.cc:492] T cd24f768f33e40bba3406e8dde3f45cc P b560e9aaec7a4c78b9123b38e73519a3: No bootstrap required, opened a new log
I20260709 13:01:57.660750  8317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62a3aed976de4d62a1d4dc7bc5252328. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:57.665525  8598 ts_tablet_manager.cc:1434] T 5527a2aef01d45cebcfad8a1b0a5273d P 53a66c851dc74c70b94c65d464a391f6: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.003s
I20260709 13:01:57.666462  8601 ts_tablet_manager.cc:1403] T cd24f768f33e40bba3406e8dde3f45cc P b560e9aaec7a4c78b9123b38e73519a3: Time spent bootstrapping tablet: real 0.113s	user 0.021s	sys 0.013s
I20260709 13:01:57.669688  8601 raft_consensus.cc:359] T cd24f768f33e40bba3406e8dde3f45cc P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:01:57.670387  8601 raft_consensus.cc:385] T cd24f768f33e40bba3406e8dde3f45cc P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:57.670735  8601 raft_consensus.cc:740] T cd24f768f33e40bba3406e8dde3f45cc P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:57.671669  8601 consensus_queue.cc:260] T cd24f768f33e40bba3406e8dde3f45cc P b560e9aaec7a4c78b9123b38e73519a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:01:57.676508  8314 tablet_service.cc:1511] Processing CreateTablet for tablet 3921dc7d601b4e4ea05f40ca34d69819 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:01:57.681389  8605 raft_consensus.cc:493] T cd24f768f33e40bba3406e8dde3f45cc P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.682889  8314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3921dc7d601b4e4ea05f40ca34d69819. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:57.682578  8605 raft_consensus.cc:515] T cd24f768f33e40bba3406e8dde3f45cc P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:01:57.683504  8464 tablet_service.cc:1511] Processing CreateTablet for tablet 3921dc7d601b4e4ea05f40ca34d69819 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:01:57.684808  8605 leader_election.cc:290] T cd24f768f33e40bba3406e8dde3f45cc P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:01:57.686462  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd24f768f33e40bba3406e8dde3f45cc" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
I20260709 13:01:57.686826  8601 ts_tablet_manager.cc:1434] T cd24f768f33e40bba3406e8dde3f45cc P b560e9aaec7a4c78b9123b38e73519a3: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 13:01:57.687994  8601 tablet_bootstrap.cc:492] T e8bdd44ba5144cadada8b14a380f995a P b560e9aaec7a4c78b9123b38e73519a3: Bootstrap starting.
I20260709 13:01:57.689894  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd24f768f33e40bba3406e8dde3f45cc" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:01:57.690716  8405 raft_consensus.cc:2393] T cd24f768f33e40bba3406e8dde3f45cc P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b560e9aaec7a4c78b9123b38e73519a3 in current term 1: Already voted for candidate 590ee39ce5734876b94d91fc3931b807 in this term.
I20260709 13:01:57.690405  8542 tablet_service.cc:1511] Processing CreateTablet for tablet 7ed73594956241f4b3e6e456bae82964 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:01:57.691994  8542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ed73594956241f4b3e6e456bae82964. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:57.694978  8518 leader_election.cc:304] T cd24f768f33e40bba3406e8dde3f45cc P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b560e9aaec7a4c78b9123b38e73519a3; no voters: 53a66c851dc74c70b94c65d464a391f6, 590ee39ce5734876b94d91fc3931b807
I20260709 13:01:57.670872  8391 tablet_service.cc:1511] Processing CreateTablet for tablet 7ed73594956241f4b3e6e456bae82964 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:01:57.695731  8538 tablet_service.cc:1511] Processing CreateTablet for tablet cb85497b295d4b3f8cda882af3676c65 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:01:57.674889  8602 tablet_bootstrap.cc:492] T c66f53044d784114970ae5061755da40 P 7b3ea460d1294b8a82672d7c21475cb5: Bootstrap starting.
I20260709 13:01:57.684840  8395 tablet_service.cc:1511] Processing CreateTablet for tablet 3921dc7d601b4e4ea05f40ca34d69819 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:01:57.697566  8538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb85497b295d4b3f8cda882af3676c65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:57.684840  8464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3921dc7d601b4e4ea05f40ca34d69819. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:57.675933  8467 tablet_service.cc:1511] Processing CreateTablet for tablet 7ed73594956241f4b3e6e456bae82964 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:01:57.687390  8226 catalog_manager.cc:5697] T cd24f768f33e40bba3406e8dde3f45cc P 590ee39ce5734876b94d91fc3931b807 reported cstate change: term changed from 0 to 1, leader changed from <none> to 590ee39ce5734876b94d91fc3931b807 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "590ee39ce5734876b94d91fc3931b807" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:57.707628  8467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ed73594956241f4b3e6e456bae82964. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:57.709409  8598 tablet_bootstrap.cc:492] T c66f53044d784114970ae5061755da40 P 53a66c851dc74c70b94c65d464a391f6: Bootstrap starting.
I20260709 13:01:57.713508  8228 catalog_manager.cc:5697] T 40926724afa743899b7ab0af312dc717 P 7b3ea460d1294b8a82672d7c21475cb5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "7b3ea460d1294b8a82672d7c21475cb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:57.715716  8543 tablet_service.cc:1511] Processing CreateTablet for tablet 62a3aed976de4d62a1d4dc7bc5252328 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:01:57.717684  8543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62a3aed976de4d62a1d4dc7bc5252328. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:57.696627  8391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ed73594956241f4b3e6e456bae82964. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:57.721211  8395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3921dc7d601b4e4ea05f40ca34d69819. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:57.722083  8316 tablet_service.cc:1511] Processing CreateTablet for tablet cb85497b295d4b3f8cda882af3676c65 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:01:57.723469  8316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb85497b295d4b3f8cda882af3676c65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:57.706187  8605 raft_consensus.cc:3060] T cd24f768f33e40bba3406e8dde3f45cc P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:57.705039  8602 tablet_bootstrap.cc:654] T c66f53044d784114970ae5061755da40 P 7b3ea460d1294b8a82672d7c21475cb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:57.735008  8607 raft_consensus.cc:493] T 5527a2aef01d45cebcfad8a1b0a5273d P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.739925  8607 raft_consensus.cc:515] T 5527a2aef01d45cebcfad8a1b0a5273d P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:01:57.743184  8607 leader_election.cc:290] T 5527a2aef01d45cebcfad8a1b0a5273d P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:01:57.743916  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5527a2aef01d45cebcfad8a1b0a5273d" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
W20260709 13:01:57.747844  8371 leader_election.cc:343] T 5527a2aef01d45cebcfad8a1b0a5273d P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:57.782177  8467 tablet_service.cc:1511] Processing CreateTablet for tablet 6fffc940549b445c973a289ba1bebcb3 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:01:57.783829  8540 tablet_service.cc:1511] Processing CreateTablet for tablet 6fffc940549b445c973a289ba1bebcb3 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:01:57.785238  8540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fffc940549b445c973a289ba1bebcb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:57.785321  8316 tablet_service.cc:1511] Processing CreateTablet for tablet 6fffc940549b445c973a289ba1bebcb3 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:01:57.786612  8316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fffc940549b445c973a289ba1bebcb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:57.798602  8598 tablet_bootstrap.cc:654] T c66f53044d784114970ae5061755da40 P 53a66c851dc74c70b94c65d464a391f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:57.799214  8467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6fffc940549b445c973a289ba1bebcb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:57.806180  8601 tablet_bootstrap.cc:654] T e8bdd44ba5144cadada8b14a380f995a P b560e9aaec7a4c78b9123b38e73519a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:57.814668  8391 tablet_service.cc:1511] Processing CreateTablet for tablet cb85497b295d4b3f8cda882af3676c65 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:01:57.816256  8391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb85497b295d4b3f8cda882af3676c65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:57.815125  8600 tablet_bootstrap.cc:492] T e8bdd44ba5144cadada8b14a380f995a P 590ee39ce5734876b94d91fc3931b807: No bootstrap required, opened a new log
I20260709 13:01:57.817724  8600 ts_tablet_manager.cc:1403] T e8bdd44ba5144cadada8b14a380f995a P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.219s	user 0.020s	sys 0.047s
I20260709 13:01:57.820901  8600 raft_consensus.cc:359] T e8bdd44ba5144cadada8b14a380f995a P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:01:57.821660  8600 raft_consensus.cc:385] T e8bdd44ba5144cadada8b14a380f995a P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:57.821961  8600 raft_consensus.cc:740] T e8bdd44ba5144cadada8b14a380f995a P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:01:57.828181  8393 tablet_service.cc:1511] Processing CreateTablet for tablet d4791a5544bd4cbf8f7e3a05f62a9370 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:01:57.829480  8613 raft_consensus.cc:493] T dbe23b457e664c298f0f2f6c41af32f8 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.830006  8613 raft_consensus.cc:515] T dbe23b457e664c298f0f2f6c41af32f8 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:01:57.831179  8540 tablet_service.cc:1511] Processing CreateTablet for tablet d4791a5544bd4cbf8f7e3a05f62a9370 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:01:57.832154  8613 leader_election.cc:290] T dbe23b457e664c298f0f2f6c41af32f8 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751), b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503)
I20260709 13:01:57.836545  8553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe23b457e664c298f0f2f6c41af32f8" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3" is_pre_election: true
I20260709 13:01:57.833901  8466 tablet_service.cc:1511] Processing CreateTablet for tablet d4791a5544bd4cbf8f7e3a05f62a9370 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:01:57.836731  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe23b457e664c298f0f2f6c41af32f8" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
W20260709 13:01:57.845286  8443 leader_election.cc:343] T dbe23b457e664c298f0f2f6c41af32f8 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:57.846022  8466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4791a5544bd4cbf8f7e3a05f62a9370. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:01:57.846186  8444 leader_election.cc:343] T dbe23b457e664c298f0f2f6c41af32f8 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:57.846843  8444 leader_election.cc:304] T dbe23b457e664c298f0f2f6c41af32f8 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b3ea460d1294b8a82672d7c21475cb5; no voters: 53a66c851dc74c70b94c65d464a391f6, b560e9aaec7a4c78b9123b38e73519a3
I20260709 13:01:57.848415  8613 raft_consensus.cc:2749] T dbe23b457e664c298f0f2f6c41af32f8 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:57.843333  8602 tablet_bootstrap.cc:492] T c66f53044d784114970ae5061755da40 P 7b3ea460d1294b8a82672d7c21475cb5: No bootstrap required, opened a new log
I20260709 13:01:57.849774  8602 ts_tablet_manager.cc:1403] T c66f53044d784114970ae5061755da40 P 7b3ea460d1294b8a82672d7c21475cb5: Time spent bootstrapping tablet: real 0.197s	user 0.013s	sys 0.007s
I20260709 13:01:57.832465  8540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4791a5544bd4cbf8f7e3a05f62a9370. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:57.837011  8605 raft_consensus.cc:2749] T cd24f768f33e40bba3406e8dde3f45cc P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:57.852867  8393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4791a5544bd4cbf8f7e3a05f62a9370. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:57.872215  8602 raft_consensus.cc:359] T c66f53044d784114970ae5061755da40 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:01:57.873169  8602 raft_consensus.cc:385] T c66f53044d784114970ae5061755da40 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:57.873500  8602 raft_consensus.cc:740] T c66f53044d784114970ae5061755da40 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Initialized, Role: FOLLOWER
I20260709 13:01:57.874275  8602 consensus_queue.cc:260] T c66f53044d784114970ae5061755da40 P 7b3ea460d1294b8a82672d7c21475cb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:01:57.878629  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5527a2aef01d45cebcfad8a1b0a5273d" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
I20260709 13:01:57.881134  8392 tablet_service.cc:1511] Processing CreateTablet for tablet 30e220d65bed42489b2af858d3a60981 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:01:57.883006  8392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30e220d65bed42489b2af858d3a60981. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:57.884577  8602 ts_tablet_manager.cc:1434] T c66f53044d784114970ae5061755da40 P 7b3ea460d1294b8a82672d7c21475cb5: Time spent starting tablet: real 0.034s	user 0.002s	sys 0.003s
I20260709 13:01:57.885622  8602 tablet_bootstrap.cc:492] T 52f213b355c14b45a13d7cf5b3e76efe P 7b3ea460d1294b8a82672d7c21475cb5: Bootstrap starting.
I20260709 13:01:57.885964  8317 tablet_service.cc:1511] Processing CreateTablet for tablet 5db51a6d67e6461a98e669fa2b1e59c8 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:01:57.887816  8317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5db51a6d67e6461a98e669fa2b1e59c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:57.887889  8538 tablet_service.cc:1511] Processing CreateTablet for tablet 69ef277bbcbd41d8a10ae92d9a63145e (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:01:57.889353  8538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69ef277bbcbd41d8a10ae92d9a63145e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:57.889504  8539 tablet_service.cc:1511] Processing CreateTablet for tablet 5db51a6d67e6461a98e669fa2b1e59c8 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:01:57.890959  8539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5db51a6d67e6461a98e669fa2b1e59c8. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:01:57.895010  8370 leader_election.cc:343] T 5527a2aef01d45cebcfad8a1b0a5273d P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:57.895700  8370 leader_election.cc:304] T 5527a2aef01d45cebcfad8a1b0a5273d P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6; no voters: 590ee39ce5734876b94d91fc3931b807, 7b3ea460d1294b8a82672d7c21475cb5
I20260709 13:01:57.897092  8607 raft_consensus.cc:2749] T 5527a2aef01d45cebcfad8a1b0a5273d P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:57.872893  8316 tablet_service.cc:1511] Processing CreateTablet for tablet 30e220d65bed42489b2af858d3a60981 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:01:57.865947  8600 consensus_queue.cc:260] T e8bdd44ba5144cadada8b14a380f995a P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
W20260709 13:01:57.904481  8276 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:57.904305  8467 tablet_service.cc:1511] Processing CreateTablet for tablet 69ef277bbcbd41d8a10ae92d9a63145e (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:01:57.909245  8464 tablet_service.cc:1511] Processing CreateTablet for tablet 30e220d65bed42489b2af858d3a60981 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:01:57.910424  8467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69ef277bbcbd41d8a10ae92d9a63145e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:57.908349  8394 tablet_service.cc:1511] Processing CreateTablet for tablet 5db51a6d67e6461a98e669fa2b1e59c8 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:01:57.913642  8394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5db51a6d67e6461a98e669fa2b1e59c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:57.921411  8316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30e220d65bed42489b2af858d3a60981. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:57.923141  8598 tablet_bootstrap.cc:492] T c66f53044d784114970ae5061755da40 P 53a66c851dc74c70b94c65d464a391f6: No bootstrap required, opened a new log
I20260709 13:01:57.923837  8598 ts_tablet_manager.cc:1403] T c66f53044d784114970ae5061755da40 P 53a66c851dc74c70b94c65d464a391f6: Time spent bootstrapping tablet: real 0.215s	user 0.015s	sys 0.000s
I20260709 13:01:57.926614  8598 raft_consensus.cc:359] T c66f53044d784114970ae5061755da40 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:01:57.927206  8598 raft_consensus.cc:385] T c66f53044d784114970ae5061755da40 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:57.927465  8598 raft_consensus.cc:740] T c66f53044d784114970ae5061755da40 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Initialized, Role: FOLLOWER
I20260709 13:01:57.937798  8314 tablet_service.cc:1511] Processing CreateTablet for tablet 69ef277bbcbd41d8a10ae92d9a63145e (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:01:57.939260  8314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 69ef277bbcbd41d8a10ae92d9a63145e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:57.942708  8613 raft_consensus.cc:493] T c66f53044d784114970ae5061755da40 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:57.945261  8464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30e220d65bed42489b2af858d3a60981. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:57.953876  8391 tablet_service.cc:1511] Processing CreateTablet for tablet 435da692a6474cb697066524d4f5216e (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:01:57.947105  8613 raft_consensus.cc:515] T c66f53044d784114970ae5061755da40 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:01:57.954726  8468 tablet_service.cc:1511] Processing CreateTablet for tablet 435da692a6474cb697066524d4f5216e (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:01:57.955343  8391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 435da692a6474cb697066524d4f5216e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:57.958029  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66f53044d784114970ae5061755da40" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:01:57.928406  8598 consensus_queue.cc:260] T c66f53044d784114970ae5061755da40 P 53a66c851dc74c70b94c65d464a391f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:01:57.961549  8405 raft_consensus.cc:2468] T c66f53044d784114970ae5061755da40 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b3ea460d1294b8a82672d7c21475cb5 in term 0.
I20260709 13:01:57.963862  8444 leader_election.cc:304] T c66f53044d784114970ae5061755da40 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, 7b3ea460d1294b8a82672d7c21475cb5; no voters: 
I20260709 13:01:57.963929  8598 ts_tablet_manager.cc:1434] T c66f53044d784114970ae5061755da40 P 53a66c851dc74c70b94c65d464a391f6: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.004s
I20260709 13:01:57.967967  8627 raft_consensus.cc:2804] T c66f53044d784114970ae5061755da40 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:57.968444  8627 raft_consensus.cc:493] T c66f53044d784114970ae5061755da40 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:57.968921  8627 raft_consensus.cc:3060] T c66f53044d784114970ae5061755da40 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:57.969075  8600 ts_tablet_manager.cc:1434] T e8bdd44ba5144cadada8b14a380f995a P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.151s	user 0.006s	sys 0.002s
I20260709 13:01:57.958007  8613 leader_election.cc:290] T c66f53044d784114970ae5061755da40 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:01:57.970381  8600 tablet_bootstrap.cc:492] T f8ec593f6c894c24a5bc727cfed4190a P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:01:57.978926  8468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 435da692a6474cb697066524d4f5216e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:57.988926  8598 tablet_bootstrap.cc:492] T cea53371e56d4a668406dcd8f5a93dcb P 53a66c851dc74c70b94c65d464a391f6: Bootstrap starting.
I20260709 13:01:57.996078  8598 tablet_bootstrap.cc:654] T cea53371e56d4a668406dcd8f5a93dcb P 53a66c851dc74c70b94c65d464a391f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:58.001089  8543 tablet_service.cc:1511] Processing CreateTablet for tablet 435da692a6474cb697066524d4f5216e (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:01:58.003098  8543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 435da692a6474cb697066524d4f5216e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.008173  8395 tablet_service.cc:1511] Processing CreateTablet for tablet 53842ab4d1d748bda0c7f0d933e5a785 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:01:58.009709  8395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53842ab4d1d748bda0c7f0d933e5a785. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.013756  8318 tablet_service.cc:1511] Processing CreateTablet for tablet 4d5829b9233a48fea0290d9bb023f97e (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:01:58.015266  8318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d5829b9233a48fea0290d9bb023f97e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.013756  8542 tablet_service.cc:1511] Processing CreateTablet for tablet 4d5829b9233a48fea0290d9bb023f97e (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:01:58.017055  8542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d5829b9233a48fea0290d9bb023f97e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.013756  8468 tablet_service.cc:1511] Processing CreateTablet for tablet 53842ab4d1d748bda0c7f0d933e5a785 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:01:58.018678  8468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53842ab4d1d748bda0c7f0d933e5a785. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.021755  8602 tablet_bootstrap.cc:654] T 52f213b355c14b45a13d7cf5b3e76efe P 7b3ea460d1294b8a82672d7c21475cb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:58.025941  8627 raft_consensus.cc:515] T c66f53044d784114970ae5061755da40 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:01:58.028347  8627 leader_election.cc:290] T c66f53044d784114970ae5061755da40 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 election: Requested vote from peers 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:01:58.034463  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66f53044d784114970ae5061755da40" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6"
I20260709 13:01:58.055884  8405 raft_consensus.cc:3060] T c66f53044d784114970ae5061755da40 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:58.035660  8391 tablet_service.cc:1511] Processing CreateTablet for tablet 4d5829b9233a48fea0290d9bb023f97e (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:01:58.037946  8600 tablet_bootstrap.cc:654] T f8ec593f6c894c24a5bc727cfed4190a P 590ee39ce5734876b94d91fc3931b807: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:58.006839  8316 tablet_service.cc:1511] Processing CreateTablet for tablet 53842ab4d1d748bda0c7f0d933e5a785 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:01:58.050566  8613 consensus_queue.cc:1048] T 40926724afa743899b7ab0af312dc717 P 7b3ea460d1294b8a82672d7c21475cb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:58.057819  8391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d5829b9233a48fea0290d9bb023f97e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.056944  8601 tablet_bootstrap.cc:492] T e8bdd44ba5144cadada8b14a380f995a P b560e9aaec7a4c78b9123b38e73519a3: No bootstrap required, opened a new log
I20260709 13:01:58.059834  8463 tablet_service.cc:1511] Processing CreateTablet for tablet e8353e508def43e5a8008bb63ff1a84a (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:01:58.075953  8463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8353e508def43e5a8008bb63ff1a84a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.062245  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66f53044d784114970ae5061755da40" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
I20260709 13:01:58.062842  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66f53044d784114970ae5061755da40" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807"
I20260709 13:01:58.069687  8317 tablet_service.cc:1511] Processing CreateTablet for tablet e8353e508def43e5a8008bb63ff1a84a (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:01:58.083532  8330 raft_consensus.cc:2468] T c66f53044d784114970ae5061755da40 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b3ea460d1294b8a82672d7c21475cb5 in term 0.
I20260709 13:01:58.086292  8601 ts_tablet_manager.cc:1403] T e8bdd44ba5144cadada8b14a380f995a P b560e9aaec7a4c78b9123b38e73519a3: Time spent bootstrapping tablet: real 0.398s	user 0.029s	sys 0.024s
I20260709 13:01:58.088405  8393 tablet_service.cc:1511] Processing CreateTablet for tablet 1fe73d50e76147ebace9610e09de74a5 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:01:58.089201  8316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53842ab4d1d748bda0c7f0d933e5a785. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.090034  8393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fe73d50e76147ebace9610e09de74a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.077584  8542 tablet_service.cc:1511] Processing CreateTablet for tablet e8353e508def43e5a8008bb63ff1a84a (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:01:58.098080  8542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8353e508def43e5a8008bb63ff1a84a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.098222  8601 raft_consensus.cc:359] T e8bdd44ba5144cadada8b14a380f995a P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:01:58.099875  8601 raft_consensus.cc:385] T e8bdd44ba5144cadada8b14a380f995a P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:58.100188  8601 raft_consensus.cc:740] T e8bdd44ba5144cadada8b14a380f995a P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:58.101070  8601 consensus_queue.cc:260] T e8bdd44ba5144cadada8b14a380f995a P b560e9aaec7a4c78b9123b38e73519a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:01:58.098716  8467 tablet_service.cc:1511] Processing CreateTablet for tablet 1fe73d50e76147ebace9610e09de74a5 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:01:58.111719  8317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8353e508def43e5a8008bb63ff1a84a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.104120  8601 ts_tablet_manager.cc:1434] T e8bdd44ba5144cadada8b14a380f995a P b560e9aaec7a4c78b9123b38e73519a3: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 13:01:58.114815  8601 tablet_bootstrap.cc:492] T f8ec593f6c894c24a5bc727cfed4190a P b560e9aaec7a4c78b9123b38e73519a3: Bootstrap starting.
I20260709 13:01:58.111800  8467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fe73d50e76147ebace9610e09de74a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.116106  8539 tablet_service.cc:1511] Processing CreateTablet for tablet 1fe73d50e76147ebace9610e09de74a5 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:01:58.096374  8405 raft_consensus.cc:2468] T c66f53044d784114970ae5061755da40 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b3ea460d1294b8a82672d7c21475cb5 in term 1.
I20260709 13:01:58.128131  8539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fe73d50e76147ebace9610e09de74a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.134431  8608 consensus_queue.cc:1048] T cd24f768f33e40bba3406e8dde3f45cc P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:58.144412  8391 tablet_service.cc:1511] Processing CreateTablet for tablet 610562885f5849d083ac5f7a85011891 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:01:58.145846  8391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 610562885f5849d083ac5f7a85011891. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.148764  8444 leader_election.cc:304] T c66f53044d784114970ae5061755da40 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, 7b3ea460d1294b8a82672d7c21475cb5; no voters: 590ee39ce5734876b94d91fc3931b807
I20260709 13:01:58.160372  8598 tablet_bootstrap.cc:492] T cea53371e56d4a668406dcd8f5a93dcb P 53a66c851dc74c70b94c65d464a391f6: No bootstrap required, opened a new log
I20260709 13:01:58.161147  8598 ts_tablet_manager.cc:1403] T cea53371e56d4a668406dcd8f5a93dcb P 53a66c851dc74c70b94c65d464a391f6: Time spent bootstrapping tablet: real 0.172s	user 0.005s	sys 0.028s
I20260709 13:01:58.163789  8602 tablet_bootstrap.cc:492] T 52f213b355c14b45a13d7cf5b3e76efe P 7b3ea460d1294b8a82672d7c21475cb5: No bootstrap required, opened a new log
I20260709 13:01:58.164494  8602 ts_tablet_manager.cc:1403] T 52f213b355c14b45a13d7cf5b3e76efe P 7b3ea460d1294b8a82672d7c21475cb5: Time spent bootstrapping tablet: real 0.279s	user 0.020s	sys 0.005s
I20260709 13:01:58.165663  8613 raft_consensus.cc:2804] T c66f53044d784114970ae5061755da40 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:58.166329  8613 raft_consensus.cc:697] T c66f53044d784114970ae5061755da40 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 LEADER]: Becoming Leader. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Running, Role: LEADER
I20260709 13:01:58.161949  8314 tablet_service.cc:1511] Processing CreateTablet for tablet 610562885f5849d083ac5f7a85011891 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:01:58.167502  8613 consensus_queue.cc:237] T c66f53044d784114970ae5061755da40 P 7b3ea460d1294b8a82672d7c21475cb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:01:58.173188  8600 tablet_bootstrap.cc:492] T f8ec593f6c894c24a5bc727cfed4190a P 590ee39ce5734876b94d91fc3931b807: No bootstrap required, opened a new log
I20260709 13:01:58.173735  8600 ts_tablet_manager.cc:1403] T f8ec593f6c894c24a5bc727cfed4190a P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.204s	user 0.012s	sys 0.007s
I20260709 13:01:58.186681  8608 consensus_queue.cc:1048] T cd24f768f33e40bba3406e8dde3f45cc P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:58.168150  8602 raft_consensus.cc:359] T 52f213b355c14b45a13d7cf5b3e76efe P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:01:58.193099  8602 raft_consensus.cc:385] T 52f213b355c14b45a13d7cf5b3e76efe P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:58.193527  8602 raft_consensus.cc:740] T 52f213b355c14b45a13d7cf5b3e76efe P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Initialized, Role: FOLLOWER
I20260709 13:01:58.195252  8602 consensus_queue.cc:260] T 52f213b355c14b45a13d7cf5b3e76efe P 7b3ea460d1294b8a82672d7c21475cb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:01:58.206346  8602 ts_tablet_manager.cc:1434] T 52f213b355c14b45a13d7cf5b3e76efe P 7b3ea460d1294b8a82672d7c21475cb5: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.000s
I20260709 13:01:58.207510  8602 tablet_bootstrap.cc:492] T e8bdd44ba5144cadada8b14a380f995a P 7b3ea460d1294b8a82672d7c21475cb5: Bootstrap starting.
I20260709 13:01:58.164460  8598 raft_consensus.cc:359] T cea53371e56d4a668406dcd8f5a93dcb P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:01:58.208253  8598 raft_consensus.cc:385] T cea53371e56d4a668406dcd8f5a93dcb P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:58.208732  8598 raft_consensus.cc:740] T cea53371e56d4a668406dcd8f5a93dcb P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Initialized, Role: FOLLOWER
I20260709 13:01:58.209792  8598 consensus_queue.cc:260] T cea53371e56d4a668406dcd8f5a93dcb P 53a66c851dc74c70b94c65d464a391f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:01:58.204351  8601 tablet_bootstrap.cc:654] T f8ec593f6c894c24a5bc727cfed4190a P b560e9aaec7a4c78b9123b38e73519a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:58.234515  8314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 610562885f5849d083ac5f7a85011891. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.249864  8598 ts_tablet_manager.cc:1434] T cea53371e56d4a668406dcd8f5a93dcb P 53a66c851dc74c70b94c65d464a391f6: Time spent starting tablet: real 0.088s	user 0.004s	sys 0.005s
I20260709 13:01:58.259886  8467 tablet_service.cc:1511] Processing CreateTablet for tablet 610562885f5849d083ac5f7a85011891 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:01:58.262312  8467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 610562885f5849d083ac5f7a85011891. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.218633  8600 raft_consensus.cc:359] T f8ec593f6c894c24a5bc727cfed4190a P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:01:58.282011  8600 raft_consensus.cc:385] T f8ec593f6c894c24a5bc727cfed4190a P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:58.282440  8600 raft_consensus.cc:740] T f8ec593f6c894c24a5bc727cfed4190a P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:01:58.283507  8552 raft_consensus.cc:3060] T 40926724afa743899b7ab0af312dc717 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:58.283245  8600 consensus_queue.cc:260] T f8ec593f6c894c24a5bc727cfed4190a P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:01:58.284811  8317 tablet_service.cc:1511] Processing CreateTablet for tablet da02fa98f6de48a7baefadf6e69d2046 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:01:58.286463  8317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da02fa98f6de48a7baefadf6e69d2046. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.300617  8607 raft_consensus.cc:493] T cea53371e56d4a668406dcd8f5a93dcb P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.301167  8607 raft_consensus.cc:515] T cea53371e56d4a668406dcd8f5a93dcb P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:01:58.301299  8542 tablet_service.cc:1511] Processing CreateTablet for tablet da02fa98f6de48a7baefadf6e69d2046 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:01:58.302783  8542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da02fa98f6de48a7baefadf6e69d2046. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.303386  8607 leader_election.cc:290] T cea53371e56d4a668406dcd8f5a93dcb P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:01:58.305780  8394 tablet_service.cc:1511] Processing CreateTablet for tablet da02fa98f6de48a7baefadf6e69d2046 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:01:58.307036  8394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da02fa98f6de48a7baefadf6e69d2046. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.312948  8551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cea53371e56d4a668406dcd8f5a93dcb" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3" is_pre_election: true
I20260709 13:01:58.313699  8551 raft_consensus.cc:2468] T cea53371e56d4a668406dcd8f5a93dcb P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53a66c851dc74c70b94c65d464a391f6 in term 0.
I20260709 13:01:58.317399  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cea53371e56d4a668406dcd8f5a93dcb" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
I20260709 13:01:58.312978  8391 tablet_service.cc:1511] Processing CreateTablet for tablet 6a82728feb4f4f1094191c0e30d748dd (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:01:58.319687  8391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a82728feb4f4f1094191c0e30d748dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.329099  8467 tablet_service.cc:1511] Processing CreateTablet for tablet b574d11894634755bd89c530b4155f1e (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:01:58.330219  8467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b574d11894634755bd89c530b4155f1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.326858  8369 leader_election.cc:304] T cea53371e56d4a668406dcd8f5a93dcb P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, b560e9aaec7a4c78b9123b38e73519a3; no voters: 
I20260709 13:01:58.332145  8598 tablet_bootstrap.cc:492] T a1946cc2deaa4799be02943612a39b16 P 53a66c851dc74c70b94c65d464a391f6: Bootstrap starting.
I20260709 13:01:58.343268  8317 tablet_service.cc:1511] Processing CreateTablet for tablet b574d11894634755bd89c530b4155f1e (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:01:58.348572  8317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b574d11894634755bd89c530b4155f1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.354935  8607 raft_consensus.cc:2804] T cea53371e56d4a668406dcd8f5a93dcb P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:58.355370  8607 raft_consensus.cc:493] T cea53371e56d4a668406dcd8f5a93dcb P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.355691  8607 raft_consensus.cc:3060] T cea53371e56d4a668406dcd8f5a93dcb P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:58.358160  8225 catalog_manager.cc:5697] T c66f53044d784114970ae5061755da40 P 7b3ea460d1294b8a82672d7c21475cb5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "7b3ea460d1294b8a82672d7c21475cb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:58.363279  8607 raft_consensus.cc:515] T cea53371e56d4a668406dcd8f5a93dcb P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:01:58.364194  8601 tablet_bootstrap.cc:492] T f8ec593f6c894c24a5bc727cfed4190a P b560e9aaec7a4c78b9123b38e73519a3: No bootstrap required, opened a new log
I20260709 13:01:58.364817  8601 ts_tablet_manager.cc:1403] T f8ec593f6c894c24a5bc727cfed4190a P b560e9aaec7a4c78b9123b38e73519a3: Time spent bootstrapping tablet: real 0.250s	user 0.015s	sys 0.002s
I20260709 13:01:58.365943  8607 leader_election.cc:290] T cea53371e56d4a668406dcd8f5a93dcb P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 election: Requested vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:01:58.368839  8627 consensus_queue.cc:1048] T 40926724afa743899b7ab0af312dc717 P 7b3ea460d1294b8a82672d7c21475cb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:58.370934  8316 tablet_service.cc:1511] Processing CreateTablet for tablet b1d8e928d8444f77ac2950eab2115f65 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:01:58.376807  8316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1d8e928d8444f77ac2950eab2115f65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.373172  8601 raft_consensus.cc:359] T f8ec593f6c894c24a5bc727cfed4190a P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
W20260709 13:01:58.345908  8371 leader_election.cc:343] T cea53371e56d4a668406dcd8f5a93dcb P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:58.392071  8654 raft_consensus.cc:493] T e8bdd44ba5144cadada8b14a380f995a P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.392716  8654 raft_consensus.cc:515] T e8bdd44ba5144cadada8b14a380f995a P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:01:58.393308  8539 tablet_service.cc:1511] Processing CreateTablet for tablet b574d11894634755bd89c530b4155f1e (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:01:58.395190  8539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b574d11894634755bd89c530b4155f1e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.396463  8552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8bdd44ba5144cadada8b14a380f995a" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3" is_pre_election: true
I20260709 13:01:58.397233  8552 raft_consensus.cc:2468] T e8bdd44ba5144cadada8b14a380f995a P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 590ee39ce5734876b94d91fc3931b807 in term 0.
I20260709 13:01:58.398614  8294 leader_election.cc:304] T e8bdd44ba5144cadada8b14a380f995a P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807, b560e9aaec7a4c78b9123b38e73519a3; no voters: 
I20260709 13:01:58.395146  8654 leader_election.cc:290] T e8bdd44ba5144cadada8b14a380f995a P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429), b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503)
I20260709 13:01:58.381496  8601 raft_consensus.cc:385] T f8ec593f6c894c24a5bc727cfed4190a P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:58.407634  8552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cea53371e56d4a668406dcd8f5a93dcb" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3"
I20260709 13:01:58.405679  8608 raft_consensus.cc:2804] T e8bdd44ba5144cadada8b14a380f995a P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:58.409246  8538 tablet_service.cc:1511] Processing CreateTablet for tablet f1fec8d4948d45bbbe39d0f3e73c3992 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:01:58.411170  8463 tablet_service.cc:1511] Processing CreateTablet for tablet b1d8e928d8444f77ac2950eab2115f65 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:01:58.411669  8468 tablet_service.cc:1511] Processing CreateTablet for tablet d4cd925acef04f3c8910aa1903b760c7 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:01:58.412952  8395 tablet_service.cc:1511] Processing CreateTablet for tablet b1d8e928d8444f77ac2950eab2115f65 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
W20260709 13:01:58.414100  8371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40837, user_credentials={real_user=slave}} blocked reactor thread for 82244.1us
I20260709 13:01:58.414690  8392 tablet_service.cc:1511] Processing CreateTablet for tablet f1fec8d4948d45bbbe39d0f3e73c3992 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:01:58.416402  8318 tablet_service.cc:1511] Processing CreateTablet for tablet f1fec8d4948d45bbbe39d0f3e73c3992 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:01:58.418169  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8bdd44ba5144cadada8b14a380f995a" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
I20260709 13:01:58.421511  8602 tablet_bootstrap.cc:654] T e8bdd44ba5144cadada8b14a380f995a P 7b3ea460d1294b8a82672d7c21475cb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:58.423360  8542 tablet_service.cc:1511] Processing CreateTablet for tablet 6a82728feb4f4f1094191c0e30d748dd (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:01:58.426260  8467 tablet_service.cc:1511] Processing CreateTablet for tablet 6a82728feb4f4f1094191c0e30d748dd (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:01:58.424078  8552 raft_consensus.cc:3060] T cea53371e56d4a668406dcd8f5a93dcb P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:58.423956  8608 raft_consensus.cc:493] T e8bdd44ba5144cadada8b14a380f995a P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.421981  8601 raft_consensus.cc:740] T f8ec593f6c894c24a5bc727cfed4190a P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:58.431339  8467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a82728feb4f4f1094191c0e30d748dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.432430  8318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1fec8d4948d45bbbe39d0f3e73c3992. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.434026  8601 consensus_queue.cc:260] T f8ec593f6c894c24a5bc727cfed4190a P b560e9aaec7a4c78b9123b38e73519a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:01:58.436582  8598 tablet_bootstrap.cc:654] T a1946cc2deaa4799be02943612a39b16 P 53a66c851dc74c70b94c65d464a391f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:58.442335  8543 tablet_service.cc:1511] Processing CreateTablet for tablet d4cd925acef04f3c8910aa1903b760c7 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:01:58.442332  8395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1d8e928d8444f77ac2950eab2115f65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.444416  8463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1d8e928d8444f77ac2950eab2115f65. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.446363  8608 raft_consensus.cc:3060] T e8bdd44ba5144cadada8b14a380f995a P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:58.449079  8538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1fec8d4948d45bbbe39d0f3e73c3992. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.449878  8542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a82728feb4f4f1094191c0e30d748dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.450785  8543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4cd925acef04f3c8910aa1903b760c7. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:01:58.469482  8295 leader_election.cc:343] T e8bdd44ba5144cadada8b14a380f995a P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:58.473261  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cea53371e56d4a668406dcd8f5a93dcb" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807"
W20260709 13:01:58.474990  8371 leader_election.cc:343] T cea53371e56d4a668406dcd8f5a93dcb P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:58.475003  8392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1fec8d4948d45bbbe39d0f3e73c3992. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.481312  8468 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4cd925acef04f3c8910aa1903b760c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.501932  8552 raft_consensus.cc:2468] T cea53371e56d4a668406dcd8f5a93dcb P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53a66c851dc74c70b94c65d464a391f6 in term 1.
I20260709 13:01:58.503934  8369 leader_election.cc:304] T cea53371e56d4a668406dcd8f5a93dcb P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, b560e9aaec7a4c78b9123b38e73519a3; no voters: 590ee39ce5734876b94d91fc3931b807
I20260709 13:01:58.505909  8660 raft_consensus.cc:2804] T cea53371e56d4a668406dcd8f5a93dcb P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:58.506284  8627 raft_consensus.cc:493] T 52f213b355c14b45a13d7cf5b3e76efe P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.506500  8660 raft_consensus.cc:697] T cea53371e56d4a668406dcd8f5a93dcb P 53a66c851dc74c70b94c65d464a391f6 [term 1 LEADER]: Becoming Leader. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Running, Role: LEADER
I20260709 13:01:58.506852  8627 raft_consensus.cc:515] T 52f213b355c14b45a13d7cf5b3e76efe P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:01:58.507489  8660 consensus_queue.cc:237] T cea53371e56d4a668406dcd8f5a93dcb P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:01:58.510195  8553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f213b355c14b45a13d7cf5b3e76efe" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3" is_pre_election: true
I20260709 13:01:58.510932  8553 raft_consensus.cc:2468] T 52f213b355c14b45a13d7cf5b3e76efe P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b3ea460d1294b8a82672d7c21475cb5 in term 0.
I20260709 13:01:58.513479  8627 leader_election.cc:290] T 52f213b355c14b45a13d7cf5b3e76efe P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:01:58.515547  8443 leader_election.cc:304] T 52f213b355c14b45a13d7cf5b3e76efe P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b3ea460d1294b8a82672d7c21475cb5, b560e9aaec7a4c78b9123b38e73519a3; no voters: 
I20260709 13:01:58.516986  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f213b355c14b45a13d7cf5b3e76efe" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
W20260709 13:01:58.518790  8445 leader_election.cc:343] T 52f213b355c14b45a13d7cf5b3e76efe P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:58.519798  8627 raft_consensus.cc:2804] T 52f213b355c14b45a13d7cf5b3e76efe P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:58.520231  8627 raft_consensus.cc:493] T 52f213b355c14b45a13d7cf5b3e76efe P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.520731  8627 raft_consensus.cc:3060] T 52f213b355c14b45a13d7cf5b3e76efe P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:58.526115  8316 tablet_service.cc:1511] Processing CreateTablet for tablet d4cd925acef04f3c8910aa1903b760c7 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:01:58.527624  8316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4cd925acef04f3c8910aa1903b760c7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.515605  8608 raft_consensus.cc:515] T e8bdd44ba5144cadada8b14a380f995a P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:01:58.544896  8317 tablet_service.cc:1511] Processing CreateTablet for tablet a1667ac154454613a9047f56ee087405 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:01:58.563391  8317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1667ac154454613a9047f56ee087405. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.548050  8467 tablet_service.cc:1511] Processing CreateTablet for tablet 308f98e21e714cea8c363eb315d72e27 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:01:58.564538  8542 tablet_service.cc:1511] Processing CreateTablet for tablet 308f98e21e714cea8c363eb315d72e27 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:01:58.565450  8467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 308f98e21e714cea8c363eb315d72e27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.565761  8542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 308f98e21e714cea8c363eb315d72e27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.546485  8394 tablet_service.cc:1511] Processing CreateTablet for tablet 308f98e21e714cea8c363eb315d72e27 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:01:58.543402  8601 ts_tablet_manager.cc:1434] T f8ec593f6c894c24a5bc727cfed4190a P b560e9aaec7a4c78b9123b38e73519a3: Time spent starting tablet: real 0.178s	user 0.010s	sys 0.007s
I20260709 13:01:58.572789  8394 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 308f98e21e714cea8c363eb315d72e27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.573203  8601 tablet_bootstrap.cc:492] T dbe23b457e664c298f0f2f6c41af32f8 P b560e9aaec7a4c78b9123b38e73519a3: Bootstrap starting.
I20260709 13:01:58.574858  8224 catalog_manager.cc:5697] T cea53371e56d4a668406dcd8f5a93dcb P 53a66c851dc74c70b94c65d464a391f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "53a66c851dc74c70b94c65d464a391f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:58.577771  8391 tablet_service.cc:1511] Processing CreateTablet for tablet a1667ac154454613a9047f56ee087405 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:01:58.579123  8391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1667ac154454613a9047f56ee087405. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.550443  8600 ts_tablet_manager.cc:1434] T f8ec593f6c894c24a5bc727cfed4190a P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.376s	user 0.006s	sys 0.021s
I20260709 13:01:58.589327  8543 tablet_service.cc:1511] Processing CreateTablet for tablet 4f93b4088ce1421cb59ed9a917919b22 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:01:58.590478  8543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f93b4088ce1421cb59ed9a917919b22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.593889  8602 tablet_bootstrap.cc:492] T e8bdd44ba5144cadada8b14a380f995a P 7b3ea460d1294b8a82672d7c21475cb5: No bootstrap required, opened a new log
I20260709 13:01:58.609484  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8bdd44ba5144cadada8b14a380f995a" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5"
I20260709 13:01:58.612588  8600 tablet_bootstrap.cc:492] T 52f213b355c14b45a13d7cf5b3e76efe P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
W20260709 13:01:58.613205  8295 leader_election.cc:343] T e8bdd44ba5144cadada8b14a380f995a P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:58.614226  8602 ts_tablet_manager.cc:1403] T e8bdd44ba5144cadada8b14a380f995a P 7b3ea460d1294b8a82672d7c21475cb5: Time spent bootstrapping tablet: real 0.407s	user 0.018s	sys 0.013s
I20260709 13:01:58.617265  8598 tablet_bootstrap.cc:492] T a1946cc2deaa4799be02943612a39b16 P 53a66c851dc74c70b94c65d464a391f6: No bootstrap required, opened a new log
I20260709 13:01:58.617920  8598 ts_tablet_manager.cc:1403] T a1946cc2deaa4799be02943612a39b16 P 53a66c851dc74c70b94c65d464a391f6: Time spent bootstrapping tablet: real 0.296s	user 0.045s	sys 0.037s
I20260709 13:01:58.619565  8661 raft_consensus.cc:493] T f8ec593f6c894c24a5bc727cfed4190a P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.620080  8661 raft_consensus.cc:515] T f8ec593f6c894c24a5bc727cfed4190a P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:01:58.626324  8661 leader_election.cc:290] T f8ec593f6c894c24a5bc727cfed4190a P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:01:58.632866  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ec593f6c894c24a5bc727cfed4190a" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
I20260709 13:01:58.628582  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ec593f6c894c24a5bc727cfed4190a" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:01:58.634954  8601 tablet_bootstrap.cc:654] T dbe23b457e664c298f0f2f6c41af32f8 P b560e9aaec7a4c78b9123b38e73519a3: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:58.635105  8518 leader_election.cc:343] T f8ec593f6c894c24a5bc727cfed4190a P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:58.633580  8330 raft_consensus.cc:2468] T f8ec593f6c894c24a5bc727cfed4190a P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 0.
I20260709 13:01:58.636848  8519 leader_election.cc:304] T f8ec593f6c894c24a5bc727cfed4190a P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807, b560e9aaec7a4c78b9123b38e73519a3; no voters: 53a66c851dc74c70b94c65d464a391f6
I20260709 13:01:58.637595  8608 leader_election.cc:290] T e8bdd44ba5144cadada8b14a380f995a P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 election: Requested vote from peers 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429), b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503)
I20260709 13:01:58.639243  8552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8bdd44ba5144cadada8b14a380f995a" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3"
I20260709 13:01:58.639936  8552 raft_consensus.cc:3060] T e8bdd44ba5144cadada8b14a380f995a P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:58.641999  8317 tablet_service.cc:1511] Processing CreateTablet for tablet 4f93b4088ce1421cb59ed9a917919b22 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:01:58.644734  8467 tablet_service.cc:1511] Processing CreateTablet for tablet a1667ac154454613a9047f56ee087405 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:01:58.646488  8467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1667ac154454613a9047f56ee087405. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.646179  8317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f93b4088ce1421cb59ed9a917919b22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.647636  8661 raft_consensus.cc:2804] T f8ec593f6c894c24a5bc727cfed4190a P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:58.661751  8463 tablet_service.cc:1511] Processing CreateTablet for tablet ef35fbe0cee64967ab342c52aa0b1ac1 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:01:58.662523  8395 tablet_service.cc:1511] Processing CreateTablet for tablet 4f93b4088ce1421cb59ed9a917919b22 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:01:58.663057  8463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef35fbe0cee64967ab342c52aa0b1ac1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.662945  8538 tablet_service.cc:1511] Processing CreateTablet for tablet ef35fbe0cee64967ab342c52aa0b1ac1 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:01:58.664358  8538 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef35fbe0cee64967ab342c52aa0b1ac1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.671466  8318 tablet_service.cc:1511] Processing CreateTablet for tablet ef35fbe0cee64967ab342c52aa0b1ac1 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:01:58.671136  8598 raft_consensus.cc:359] T a1946cc2deaa4799be02943612a39b16 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:01:58.653383  8661 raft_consensus.cc:493] T f8ec593f6c894c24a5bc727cfed4190a P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:58.673676  8395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f93b4088ce1421cb59ed9a917919b22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.674379  8391 tablet_service.cc:1511] Processing CreateTablet for tablet 19fa9442e72f4d4697a919590110cc68 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:01:58.676403  8391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19fa9442e72f4d4697a919590110cc68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.675455  8661 raft_consensus.cc:3060] T f8ec593f6c894c24a5bc727cfed4190a P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:58.679589  8330 raft_consensus.cc:3060] T c66f53044d784114970ae5061755da40 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:58.679996  8318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef35fbe0cee64967ab342c52aa0b1ac1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.684229  8543 tablet_service.cc:1511] Processing CreateTablet for tablet 19fa9442e72f4d4697a919590110cc68 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:01:58.685549  8543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19fa9442e72f4d4697a919590110cc68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.686561  8392 tablet_service.cc:1511] Processing CreateTablet for tablet 8e53899e04fe4f58b666f67ac07bbf79 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:01:58.687811  8392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e53899e04fe4f58b666f67ac07bbf79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.689306  8316 tablet_service.cc:1511] Processing CreateTablet for tablet d97df5fdb12a439080fa6edc391ebd82 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:01:58.690405  8316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d97df5fdb12a439080fa6edc391ebd82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.691212  8539 tablet_service.cc:1511] Processing CreateTablet for tablet d97df5fdb12a439080fa6edc391ebd82 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:01:58.691424  8314 tablet_service.cc:1511] Processing CreateTablet for tablet c6245fdde2e4422581bc418d4840b580 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:01:58.692647  8314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6245fdde2e4422581bc418d4840b580. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.693418  8542 tablet_service.cc:1511] Processing CreateTablet for tablet c6245fdde2e4422581bc418d4840b580 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:01:58.694218  8464 tablet_service.cc:1511] Processing CreateTablet for tablet 8e53899e04fe4f58b666f67ac07bbf79 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:01:58.695461  8464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e53899e04fe4f58b666f67ac07bbf79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.696187  8393 tablet_service.cc:1511] Processing CreateTablet for tablet d97df5fdb12a439080fa6edc391ebd82 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:01:58.696425  8540 tablet_service.cc:1511] Processing CreateTablet for tablet cca6412bb2df45b4880e711fe56d2f8d (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:01:58.697299  8393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d97df5fdb12a439080fa6edc391ebd82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.697860  8539 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d97df5fdb12a439080fa6edc391ebd82. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.698763  8600 tablet_bootstrap.cc:654] T 52f213b355c14b45a13d7cf5b3e76efe P 590ee39ce5734876b94d91fc3931b807: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:58.700840  8542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6245fdde2e4422581bc418d4840b580. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.700598  8390 tablet_service.cc:1511] Processing CreateTablet for tablet cca6412bb2df45b4880e711fe56d2f8d (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:01:58.701920  8390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cca6412bb2df45b4880e711fe56d2f8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.704871  8540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cca6412bb2df45b4880e711fe56d2f8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.706452  8466 tablet_service.cc:1511] Processing CreateTablet for tablet c6245fdde2e4422581bc418d4840b580 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:01:58.707701  8466 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6245fdde2e4422581bc418d4840b580. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.708362  8320 tablet_service.cc:1511] Processing CreateTablet for tablet fcc07b65535048fca9045891e1ae0153 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:01:58.709779  8320 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcc07b65535048fca9045891e1ae0153. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.710247  8315 tablet_service.cc:1511] Processing CreateTablet for tablet 1162036be6064d5c821df6a7aa486bab (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:01:58.711618  8315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1162036be6064d5c821df6a7aa486bab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.709482  8465 tablet_service.cc:1511] Processing CreateTablet for tablet cca6412bb2df45b4880e711fe56d2f8d (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:01:58.675154  8598 raft_consensus.cc:385] T a1946cc2deaa4799be02943612a39b16 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:58.716900  8465 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cca6412bb2df45b4880e711fe56d2f8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.716856  8598 raft_consensus.cc:740] T a1946cc2deaa4799be02943612a39b16 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Initialized, Role: FOLLOWER
I20260709 13:01:58.717912  8598 consensus_queue.cc:260] T a1946cc2deaa4799be02943612a39b16 P 53a66c851dc74c70b94c65d464a391f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:01:58.721731  8388 tablet_service.cc:1511] Processing CreateTablet for tablet 1162036be6064d5c821df6a7aa486bab (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:01:58.722575  8319 tablet_service.cc:1511] Processing CreateTablet for tablet ca262e71501a4ae4a89152ec6771ffb9 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:01:58.723560  8388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1162036be6064d5c821df6a7aa486bab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.724013  8319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca262e71501a4ae4a89152ec6771ffb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.720238  8389 tablet_service.cc:1511] Processing CreateTablet for tablet fcc07b65535048fca9045891e1ae0153 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:01:58.726289  8389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcc07b65535048fca9045891e1ae0153. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.729645  8317 tablet_service.cc:1511] Processing CreateTablet for tablet 8e53899e04fe4f58b666f67ac07bbf79 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:01:58.730958  8317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e53899e04fe4f58b666f67ac07bbf79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.730629  8469 tablet_service.cc:1511] Processing CreateTablet for tablet fcc07b65535048fca9045891e1ae0153 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:01:58.732288  8469 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcc07b65535048fca9045891e1ae0153. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.734140  8541 tablet_service.cc:1511] Processing CreateTablet for tablet 1162036be6064d5c821df6a7aa486bab (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:01:58.734663  8537 tablet_service.cc:1511] Processing CreateTablet for tablet ca262e71501a4ae4a89152ec6771ffb9 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:01:58.735224  8651 consensus_queue.cc:1048] T c66f53044d784114970ae5061755da40 P 7b3ea460d1294b8a82672d7c21475cb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:58.735672  8541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1162036be6064d5c821df6a7aa486bab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.736595  8537 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca262e71501a4ae4a89152ec6771ffb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.747170  8552 raft_consensus.cc:2468] T e8bdd44ba5144cadada8b14a380f995a P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 590ee39ce5734876b94d91fc3931b807 in term 1.
I20260709 13:01:58.748878  8294 leader_election.cc:304] T e8bdd44ba5144cadada8b14a380f995a P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807, b560e9aaec7a4c78b9123b38e73519a3; no voters: 7b3ea460d1294b8a82672d7c21475cb5
I20260709 13:01:58.750514  8608 raft_consensus.cc:2804] T e8bdd44ba5144cadada8b14a380f995a P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:58.751055  8608 raft_consensus.cc:697] T e8bdd44ba5144cadada8b14a380f995a P 590ee39ce5734876b94d91fc3931b807 [term 1 LEADER]: Becoming Leader. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Running, Role: LEADER
I20260709 13:01:58.750697  8602 raft_consensus.cc:359] T e8bdd44ba5144cadada8b14a380f995a P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:01:58.751612  8602 raft_consensus.cc:385] T e8bdd44ba5144cadada8b14a380f995a P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:58.751938  8608 consensus_queue.cc:237] T e8bdd44ba5144cadada8b14a380f995a P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:01:58.751959  8602 raft_consensus.cc:740] T e8bdd44ba5144cadada8b14a380f995a P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Initialized, Role: FOLLOWER
I20260709 13:01:58.755123  8602 consensus_queue.cc:260] T e8bdd44ba5144cadada8b14a380f995a P 7b3ea460d1294b8a82672d7c21475cb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:01:58.755447  8651 consensus_queue.cc:1048] T c66f53044d784114970ae5061755da40 P 7b3ea460d1294b8a82672d7c21475cb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:58.756891  8627 raft_consensus.cc:515] T 52f213b355c14b45a13d7cf5b3e76efe P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:01:58.759212  8462 tablet_service.cc:1511] Processing CreateTablet for tablet ca262e71501a4ae4a89152ec6771ffb9 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:01:58.760746  8462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca262e71501a4ae4a89152ec6771ffb9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.766975  8602 ts_tablet_manager.cc:1434] T e8bdd44ba5144cadada8b14a380f995a P 7b3ea460d1294b8a82672d7c21475cb5: Time spent starting tablet: real 0.152s	user 0.001s	sys 0.006s
I20260709 13:01:58.768975  8598 ts_tablet_manager.cc:1434] T a1946cc2deaa4799be02943612a39b16 P 53a66c851dc74c70b94c65d464a391f6: Time spent starting tablet: real 0.151s	user 0.004s	sys 0.005s
I20260709 13:01:58.770201  8598 tablet_bootstrap.cc:492] T dbe23b457e664c298f0f2f6c41af32f8 P 53a66c851dc74c70b94c65d464a391f6: Bootstrap starting.
I20260709 13:01:58.788021  8553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f213b355c14b45a13d7cf5b3e76efe" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3"
I20260709 13:01:58.788727  8553 raft_consensus.cc:3060] T 52f213b355c14b45a13d7cf5b3e76efe P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:58.811993  8467 tablet_service.cc:1511] Processing CreateTablet for tablet 19fa9442e72f4d4697a919590110cc68 (DEFAULT_TABLE table=test-workload [id=2c30386512dc4d0ead2059bcb5d6f355]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:01:58.813401  8467 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19fa9442e72f4d4697a919590110cc68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:01:58.818648  8601 tablet_bootstrap.cc:492] T dbe23b457e664c298f0f2f6c41af32f8 P b560e9aaec7a4c78b9123b38e73519a3: No bootstrap required, opened a new log
I20260709 13:01:58.819253  8601 ts_tablet_manager.cc:1403] T dbe23b457e664c298f0f2f6c41af32f8 P b560e9aaec7a4c78b9123b38e73519a3: Time spent bootstrapping tablet: real 0.246s	user 0.014s	sys 0.005s
I20260709 13:01:58.810278  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f213b355c14b45a13d7cf5b3e76efe" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807"
W20260709 13:01:58.828730  8445 leader_election.cc:343] T 52f213b355c14b45a13d7cf5b3e76efe P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:58.795092  8627 leader_election.cc:290] T 52f213b355c14b45a13d7cf5b3e76efe P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 election: Requested vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:01:58.844780  8627 raft_consensus.cc:493] T e8bdd44ba5144cadada8b14a380f995a P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.845302  8627 raft_consensus.cc:515] T e8bdd44ba5144cadada8b14a380f995a P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:01:58.846351  8598 tablet_bootstrap.cc:654] T dbe23b457e664c298f0f2f6c41af32f8 P 53a66c851dc74c70b94c65d464a391f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:58.847522  8627 leader_election.cc:290] T e8bdd44ba5144cadada8b14a380f995a P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:01:58.849326  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8bdd44ba5144cadada8b14a380f995a" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
I20260709 13:01:58.852926  8551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8bdd44ba5144cadada8b14a380f995a" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3" is_pre_election: true
I20260709 13:01:58.853777  8551 raft_consensus.cc:2393] T e8bdd44ba5144cadada8b14a380f995a P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7b3ea460d1294b8a82672d7c21475cb5 in current term 1: Already voted for candidate 590ee39ce5734876b94d91fc3931b807 in this term.
I20260709 13:01:58.856573  8445 leader_election.cc:304] T e8bdd44ba5144cadada8b14a380f995a P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b3ea460d1294b8a82672d7c21475cb5; no voters: 590ee39ce5734876b94d91fc3931b807, b560e9aaec7a4c78b9123b38e73519a3
I20260709 13:01:58.861019  8651 raft_consensus.cc:3060] T e8bdd44ba5144cadada8b14a380f995a P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:58.824901  8661 raft_consensus.cc:515] T f8ec593f6c894c24a5bc727cfed4190a P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:01:58.871167  8602 tablet_bootstrap.cc:492] T 5527a2aef01d45cebcfad8a1b0a5273d P 7b3ea460d1294b8a82672d7c21475cb5: Bootstrap starting.
I20260709 13:01:58.882573  8224 catalog_manager.cc:5697] T e8bdd44ba5144cadada8b14a380f995a P 590ee39ce5734876b94d91fc3931b807 reported cstate change: term changed from 0 to 1, leader changed from <none> to 590ee39ce5734876b94d91fc3931b807 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "590ee39ce5734876b94d91fc3931b807" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: HEALTHY } } }
I20260709 13:01:58.898353  8553 raft_consensus.cc:2468] T 52f213b355c14b45a13d7cf5b3e76efe P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b3ea460d1294b8a82672d7c21475cb5 in term 1.
I20260709 13:01:58.899624  8443 leader_election.cc:304] T 52f213b355c14b45a13d7cf5b3e76efe P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b3ea460d1294b8a82672d7c21475cb5, b560e9aaec7a4c78b9123b38e73519a3; no voters: 590ee39ce5734876b94d91fc3931b807
I20260709 13:01:58.900781  8627 raft_consensus.cc:2804] T 52f213b355c14b45a13d7cf5b3e76efe P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:58.915021  8627 raft_consensus.cc:697] T 52f213b355c14b45a13d7cf5b3e76efe P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 LEADER]: Becoming Leader. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Running, Role: LEADER
I20260709 13:01:58.917551  8601 raft_consensus.cc:359] T dbe23b457e664c298f0f2f6c41af32f8 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:01:58.918222  8601 raft_consensus.cc:385] T dbe23b457e664c298f0f2f6c41af32f8 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:58.918467  8601 raft_consensus.cc:740] T dbe23b457e664c298f0f2f6c41af32f8 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:58.919133  8601 consensus_queue.cc:260] T dbe23b457e664c298f0f2f6c41af32f8 P b560e9aaec7a4c78b9123b38e73519a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:01:58.924479  8601 ts_tablet_manager.cc:1434] T dbe23b457e664c298f0f2f6c41af32f8 P b560e9aaec7a4c78b9123b38e73519a3: Time spent starting tablet: real 0.105s	user 0.009s	sys 0.001s
I20260709 13:01:58.925536  8601 tablet_bootstrap.cc:492] T da5b0b01a880412896838e8eb658db7a P b560e9aaec7a4c78b9123b38e73519a3: Bootstrap starting.
I20260709 13:01:58.931546  8601 tablet_bootstrap.cc:654] T da5b0b01a880412896838e8eb658db7a P b560e9aaec7a4c78b9123b38e73519a3: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:58.935879  8276 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:01:58.948160  8627 consensus_queue.cc:237] T 52f213b355c14b45a13d7cf5b3e76efe P 7b3ea460d1294b8a82672d7c21475cb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:01:58.952304  8660 raft_consensus.cc:493] T a1946cc2deaa4799be02943612a39b16 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:58.955291  8660 raft_consensus.cc:515] T a1946cc2deaa4799be02943612a39b16 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:01:58.956418  8598 tablet_bootstrap.cc:492] T dbe23b457e664c298f0f2f6c41af32f8 P 53a66c851dc74c70b94c65d464a391f6: No bootstrap required, opened a new log
I20260709 13:01:58.956593  8602 tablet_bootstrap.cc:654] T 5527a2aef01d45cebcfad8a1b0a5273d P 7b3ea460d1294b8a82672d7c21475cb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:58.956961  8598 ts_tablet_manager.cc:1403] T dbe23b457e664c298f0f2f6c41af32f8 P 53a66c851dc74c70b94c65d464a391f6: Time spent bootstrapping tablet: real 0.187s	user 0.028s	sys 0.027s
I20260709 13:01:58.957437  8660 leader_election.cc:290] T a1946cc2deaa4799be02943612a39b16 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:01:58.959153  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1946cc2deaa4799be02943612a39b16" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
I20260709 13:01:58.960722  8598 raft_consensus.cc:359] T dbe23b457e664c298f0f2f6c41af32f8 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
W20260709 13:01:58.961324  8370 leader_election.cc:343] T a1946cc2deaa4799be02943612a39b16 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:58.961593  8598 raft_consensus.cc:385] T dbe23b457e664c298f0f2f6c41af32f8 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:58.962011  8598 raft_consensus.cc:740] T dbe23b457e664c298f0f2f6c41af32f8 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Initialized, Role: FOLLOWER
I20260709 13:01:58.962301  8600 tablet_bootstrap.cc:492] T 52f213b355c14b45a13d7cf5b3e76efe P 590ee39ce5734876b94d91fc3931b807: No bootstrap required, opened a new log
I20260709 13:01:58.962838  8600 ts_tablet_manager.cc:1403] T 52f213b355c14b45a13d7cf5b3e76efe P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.355s	user 0.007s	sys 0.028s
I20260709 13:01:58.962723  8598 consensus_queue.cc:260] T dbe23b457e664c298f0f2f6c41af32f8 P 53a66c851dc74c70b94c65d464a391f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:01:58.965071  8598 ts_tablet_manager.cc:1434] T dbe23b457e664c298f0f2f6c41af32f8 P 53a66c851dc74c70b94c65d464a391f6: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:01:58.966037  8598 tablet_bootstrap.cc:492] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P 53a66c851dc74c70b94c65d464a391f6: Bootstrap starting.
I20260709 13:01:58.971465  8651 raft_consensus.cc:2749] T e8bdd44ba5144cadada8b14a380f995a P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:58.972424  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1946cc2deaa4799be02943612a39b16" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
I20260709 13:01:58.973925  8598 tablet_bootstrap.cc:654] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P 53a66c851dc74c70b94c65d464a391f6: Neither blocks nor log segments found. Creating new log.
W20260709 13:01:58.981046  8371 leader_election.cc:343] T a1946cc2deaa4799be02943612a39b16 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:58.981611  8371 leader_election.cc:304] T a1946cc2deaa4799be02943612a39b16 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6; no voters: 590ee39ce5734876b94d91fc3931b807, 7b3ea460d1294b8a82672d7c21475cb5
I20260709 13:01:58.982524  8607 raft_consensus.cc:2749] T a1946cc2deaa4799be02943612a39b16 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:58.994481  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ec593f6c894c24a5bc727cfed4190a" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807"
I20260709 13:01:58.995416  8329 raft_consensus.cc:3060] T f8ec593f6c894c24a5bc727cfed4190a P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:58.997841  8661 leader_election.cc:290] T f8ec593f6c894c24a5bc727cfed4190a P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 election: Requested vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:01:59.004170  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ec593f6c894c24a5bc727cfed4190a" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6"
I20260709 13:01:59.005302  8601 tablet_bootstrap.cc:492] T da5b0b01a880412896838e8eb658db7a P b560e9aaec7a4c78b9123b38e73519a3: No bootstrap required, opened a new log
I20260709 13:01:59.006053  8601 ts_tablet_manager.cc:1403] T da5b0b01a880412896838e8eb658db7a P b560e9aaec7a4c78b9123b38e73519a3: Time spent bootstrapping tablet: real 0.081s	user 0.009s	sys 0.006s
I20260709 13:01:59.006299  8607 consensus_queue.cc:1048] T cea53371e56d4a668406dcd8f5a93dcb P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:01:59.006044  8518 leader_election.cc:343] T f8ec593f6c894c24a5bc727cfed4190a P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:59.011653  8329 raft_consensus.cc:2468] T f8ec593f6c894c24a5bc727cfed4190a P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 1.
I20260709 13:01:59.016724  8519 leader_election.cc:304] T f8ec593f6c894c24a5bc727cfed4190a P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807, b560e9aaec7a4c78b9123b38e73519a3; no voters: 53a66c851dc74c70b94c65d464a391f6
I20260709 13:01:59.018275  8605 raft_consensus.cc:2804] T f8ec593f6c894c24a5bc727cfed4190a P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:59.022004  8600 raft_consensus.cc:359] T 52f213b355c14b45a13d7cf5b3e76efe P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
W20260709 13:01:59.022742  8371 consensus_peers.cc:597] T cea53371e56d4a668406dcd8f5a93dcb P 53a66c851dc74c70b94c65d464a391f6 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:01:59.023396  8598 tablet_bootstrap.cc:492] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P 53a66c851dc74c70b94c65d464a391f6: No bootstrap required, opened a new log
I20260709 13:01:59.013255  8601 raft_consensus.cc:359] T da5b0b01a880412896838e8eb658db7a P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:01:59.023866  8601 raft_consensus.cc:385] T da5b0b01a880412896838e8eb658db7a P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:59.023994  8598 ts_tablet_manager.cc:1403] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P 53a66c851dc74c70b94c65d464a391f6: Time spent bootstrapping tablet: real 0.058s	user 0.021s	sys 0.001s
I20260709 13:01:59.024175  8601 raft_consensus.cc:740] T da5b0b01a880412896838e8eb658db7a P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:59.022841  8600 raft_consensus.cc:385] T 52f213b355c14b45a13d7cf5b3e76efe P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:59.025050  8600 raft_consensus.cc:740] T 52f213b355c14b45a13d7cf5b3e76efe P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:01:59.025887  8600 consensus_queue.cc:260] T 52f213b355c14b45a13d7cf5b3e76efe P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:01:59.026633  8601 consensus_queue.cc:260] T da5b0b01a880412896838e8eb658db7a P b560e9aaec7a4c78b9123b38e73519a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:01:59.027143  8598 raft_consensus.cc:359] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:01:59.027904  8598 raft_consensus.cc:385] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:59.028153  8600 ts_tablet_manager.cc:1434] T 52f213b355c14b45a13d7cf5b3e76efe P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.065s	user 0.006s	sys 0.001s
I20260709 13:01:59.028291  8598 raft_consensus.cc:740] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Initialized, Role: FOLLOWER
I20260709 13:01:59.029405  8600 tablet_bootstrap.cc:492] T 5527a2aef01d45cebcfad8a1b0a5273d P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:01:59.030519  8601 ts_tablet_manager.cc:1434] T da5b0b01a880412896838e8eb658db7a P b560e9aaec7a4c78b9123b38e73519a3: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:01:59.031682  8601 tablet_bootstrap.cc:492] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P b560e9aaec7a4c78b9123b38e73519a3: Bootstrap starting.
I20260709 13:01:59.031476  8598 consensus_queue.cc:260] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P 53a66c851dc74c70b94c65d464a391f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:01:59.033814  8598 ts_tablet_manager.cc:1434] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P 53a66c851dc74c70b94c65d464a391f6: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:01:59.034799  8605 raft_consensus.cc:697] T f8ec593f6c894c24a5bc727cfed4190a P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Becoming Leader. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Running, Role: LEADER
I20260709 13:01:59.036036  8605 consensus_queue.cc:237] T f8ec593f6c894c24a5bc727cfed4190a P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:01:59.043581  8600 tablet_bootstrap.cc:654] T 5527a2aef01d45cebcfad8a1b0a5273d P 590ee39ce5734876b94d91fc3931b807: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:59.043984  8227 catalog_manager.cc:5697] T 52f213b355c14b45a13d7cf5b3e76efe P 7b3ea460d1294b8a82672d7c21475cb5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "7b3ea460d1294b8a82672d7c21475cb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:59.045444  8598 tablet_bootstrap.cc:492] T f8ec593f6c894c24a5bc727cfed4190a P 53a66c851dc74c70b94c65d464a391f6: Bootstrap starting.
I20260709 13:01:59.045464  8601 tablet_bootstrap.cc:654] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P b560e9aaec7a4c78b9123b38e73519a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:59.057394  8601 tablet_bootstrap.cc:492] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P b560e9aaec7a4c78b9123b38e73519a3: No bootstrap required, opened a new log
I20260709 13:01:59.058179  8601 ts_tablet_manager.cc:1403] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P b560e9aaec7a4c78b9123b38e73519a3: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.000s
I20260709 13:01:59.060039  8602 tablet_bootstrap.cc:492] T 5527a2aef01d45cebcfad8a1b0a5273d P 7b3ea460d1294b8a82672d7c21475cb5: No bootstrap required, opened a new log
I20260709 13:01:59.060627  8602 ts_tablet_manager.cc:1403] T 5527a2aef01d45cebcfad8a1b0a5273d P 7b3ea460d1294b8a82672d7c21475cb5: Time spent bootstrapping tablet: real 0.220s	user 0.019s	sys 0.000s
I20260709 13:01:59.060897  8601 raft_consensus.cc:359] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:01:59.061658  8601 raft_consensus.cc:385] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:59.062080  8601 raft_consensus.cc:740] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:59.062791  8601 consensus_queue.cc:260] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P b560e9aaec7a4c78b9123b38e73519a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:01:59.064723  8601 ts_tablet_manager.cc:1434] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P b560e9aaec7a4c78b9123b38e73519a3: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:01:59.065622  8601 tablet_bootstrap.cc:492] T e1f344d27b0b44819ef6d23574175c26 P b560e9aaec7a4c78b9123b38e73519a3: Bootstrap starting.
I20260709 13:01:59.061692  8598 tablet_bootstrap.cc:654] T f8ec593f6c894c24a5bc727cfed4190a P 53a66c851dc74c70b94c65d464a391f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:59.070037  8225 catalog_manager.cc:5697] T f8ec593f6c894c24a5bc727cfed4190a P b560e9aaec7a4c78b9123b38e73519a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "b560e9aaec7a4c78b9123b38e73519a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:59.074388  8601 tablet_bootstrap.cc:654] T e1f344d27b0b44819ef6d23574175c26 P b560e9aaec7a4c78b9123b38e73519a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:59.080775  8600 tablet_bootstrap.cc:492] T 5527a2aef01d45cebcfad8a1b0a5273d P 590ee39ce5734876b94d91fc3931b807: No bootstrap required, opened a new log
I20260709 13:01:59.081367  8600 ts_tablet_manager.cc:1403] T 5527a2aef01d45cebcfad8a1b0a5273d P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.052s	user 0.017s	sys 0.006s
I20260709 13:01:59.083304  8602 raft_consensus.cc:359] T 5527a2aef01d45cebcfad8a1b0a5273d P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:01:59.084441  8602 raft_consensus.cc:385] T 5527a2aef01d45cebcfad8a1b0a5273d P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:59.084335  8600 raft_consensus.cc:359] T 5527a2aef01d45cebcfad8a1b0a5273d P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:01:59.085273  8600 raft_consensus.cc:385] T 5527a2aef01d45cebcfad8a1b0a5273d P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:59.085108  8602 raft_consensus.cc:740] T 5527a2aef01d45cebcfad8a1b0a5273d P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Initialized, Role: FOLLOWER
I20260709 13:01:59.085752  8600 raft_consensus.cc:740] T 5527a2aef01d45cebcfad8a1b0a5273d P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:01:59.086593  8600 consensus_queue.cc:260] T 5527a2aef01d45cebcfad8a1b0a5273d P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:01:59.088754  8600 ts_tablet_manager.cc:1434] T 5527a2aef01d45cebcfad8a1b0a5273d P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:01:59.090056  8600 tablet_bootstrap.cc:492] T a1946cc2deaa4799be02943612a39b16 P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:01:59.096882  8600 tablet_bootstrap.cc:654] T a1946cc2deaa4799be02943612a39b16 P 590ee39ce5734876b94d91fc3931b807: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:59.101044  8602 consensus_queue.cc:260] T 5527a2aef01d45cebcfad8a1b0a5273d P 7b3ea460d1294b8a82672d7c21475cb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:01:59.106098  8602 ts_tablet_manager.cc:1434] T 5527a2aef01d45cebcfad8a1b0a5273d P 7b3ea460d1294b8a82672d7c21475cb5: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.000s
I20260709 13:01:59.106676  8600 tablet_bootstrap.cc:492] T a1946cc2deaa4799be02943612a39b16 P 590ee39ce5734876b94d91fc3931b807: No bootstrap required, opened a new log
I20260709 13:01:59.107211  8600 ts_tablet_manager.cc:1403] T a1946cc2deaa4799be02943612a39b16 P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.005s
I20260709 13:01:59.107295  8601 tablet_bootstrap.cc:492] T e1f344d27b0b44819ef6d23574175c26 P b560e9aaec7a4c78b9123b38e73519a3: No bootstrap required, opened a new log
I20260709 13:01:59.107511  8602 tablet_bootstrap.cc:492] T da5b0b01a880412896838e8eb658db7a P 7b3ea460d1294b8a82672d7c21475cb5: Bootstrap starting.
I20260709 13:01:59.107827  8601 ts_tablet_manager.cc:1403] T e1f344d27b0b44819ef6d23574175c26 P b560e9aaec7a4c78b9123b38e73519a3: Time spent bootstrapping tablet: real 0.042s	user 0.014s	sys 0.007s
I20260709 13:01:59.108700  8598 tablet_bootstrap.cc:492] T f8ec593f6c894c24a5bc727cfed4190a P 53a66c851dc74c70b94c65d464a391f6: No bootstrap required, opened a new log
I20260709 13:01:59.109169  8598 ts_tablet_manager.cc:1403] T f8ec593f6c894c24a5bc727cfed4190a P 53a66c851dc74c70b94c65d464a391f6: Time spent bootstrapping tablet: real 0.064s	user 0.014s	sys 0.011s
I20260709 13:01:59.110320  8600 raft_consensus.cc:359] T a1946cc2deaa4799be02943612a39b16 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:01:59.111161  8600 raft_consensus.cc:385] T a1946cc2deaa4799be02943612a39b16 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:59.111488  8600 raft_consensus.cc:740] T a1946cc2deaa4799be02943612a39b16 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:01:59.110415  8601 raft_consensus.cc:359] T e1f344d27b0b44819ef6d23574175c26 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:01:59.111701  8598 raft_consensus.cc:359] T f8ec593f6c894c24a5bc727cfed4190a P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:01:59.112263  8601 raft_consensus.cc:385] T e1f344d27b0b44819ef6d23574175c26 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:59.112497  8598 raft_consensus.cc:385] T f8ec593f6c894c24a5bc727cfed4190a P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:59.112634  8601 raft_consensus.cc:740] T e1f344d27b0b44819ef6d23574175c26 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:59.112932  8598 raft_consensus.cc:740] T f8ec593f6c894c24a5bc727cfed4190a P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Initialized, Role: FOLLOWER
I20260709 13:01:59.113453  8601 consensus_queue.cc:260] T e1f344d27b0b44819ef6d23574175c26 P b560e9aaec7a4c78b9123b38e73519a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:01:59.114516  8600 consensus_queue.cc:260] T a1946cc2deaa4799be02943612a39b16 P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:01:59.115470  8602 tablet_bootstrap.cc:654] T da5b0b01a880412896838e8eb658db7a P 7b3ea460d1294b8a82672d7c21475cb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:59.116750  8600 ts_tablet_manager.cc:1434] T a1946cc2deaa4799be02943612a39b16 P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.004s
I20260709 13:01:59.117998  8600 tablet_bootstrap.cc:492] T cea53371e56d4a668406dcd8f5a93dcb P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:01:59.113816  8598 consensus_queue.cc:260] T f8ec593f6c894c24a5bc727cfed4190a P 53a66c851dc74c70b94c65d464a391f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:01:59.122912  8601 ts_tablet_manager.cc:1434] T e1f344d27b0b44819ef6d23574175c26 P b560e9aaec7a4c78b9123b38e73519a3: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:01:59.123991  8601 tablet_bootstrap.cc:492] T 5095fba09faf47dd939329e762fbc663 P b560e9aaec7a4c78b9123b38e73519a3: Bootstrap starting.
I20260709 13:01:59.124250  8600 tablet_bootstrap.cc:654] T cea53371e56d4a668406dcd8f5a93dcb P 590ee39ce5734876b94d91fc3931b807: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:59.127696  8605 raft_consensus.cc:493] T e1f344d27b0b44819ef6d23574175c26 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.128221  8605 raft_consensus.cc:515] T e1f344d27b0b44819ef6d23574175c26 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:01:59.131021  8605 leader_election.cc:290] T e1f344d27b0b44819ef6d23574175c26 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:01:59.133056  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f344d27b0b44819ef6d23574175c26" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:01:59.134266  8601 tablet_bootstrap.cc:654] T 5095fba09faf47dd939329e762fbc663 P b560e9aaec7a4c78b9123b38e73519a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:59.134363  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f344d27b0b44819ef6d23574175c26" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
W20260709 13:01:59.134649  8518 leader_election.cc:343] T e1f344d27b0b44819ef6d23574175c26 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:01:59.136587  8519 leader_election.cc:343] T e1f344d27b0b44819ef6d23574175c26 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:59.137044  8519 leader_election.cc:304] T e1f344d27b0b44819ef6d23574175c26 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b560e9aaec7a4c78b9123b38e73519a3; no voters: 53a66c851dc74c70b94c65d464a391f6, 590ee39ce5734876b94d91fc3931b807
I20260709 13:01:59.138705  8605 raft_consensus.cc:2749] T e1f344d27b0b44819ef6d23574175c26 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:59.141762  8598 ts_tablet_manager.cc:1434] T f8ec593f6c894c24a5bc727cfed4190a P 53a66c851dc74c70b94c65d464a391f6: Time spent starting tablet: real 0.032s	user 0.004s	sys 0.002s
I20260709 13:01:59.142259  8600 tablet_bootstrap.cc:492] T cea53371e56d4a668406dcd8f5a93dcb P 590ee39ce5734876b94d91fc3931b807: No bootstrap required, opened a new log
I20260709 13:01:59.142315  8602 tablet_bootstrap.cc:492] T da5b0b01a880412896838e8eb658db7a P 7b3ea460d1294b8a82672d7c21475cb5: No bootstrap required, opened a new log
I20260709 13:01:59.142737  8598 tablet_bootstrap.cc:492] T 6540f8b1e5df49f698558db1af45038b P 53a66c851dc74c70b94c65d464a391f6: Bootstrap starting.
I20260709 13:01:59.143172  8602 ts_tablet_manager.cc:1403] T da5b0b01a880412896838e8eb658db7a P 7b3ea460d1294b8a82672d7c21475cb5: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.005s
I20260709 13:01:59.143244  8600 ts_tablet_manager.cc:1403] T cea53371e56d4a668406dcd8f5a93dcb P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.025s	user 0.006s	sys 0.006s
I20260709 13:01:59.146414  8602 raft_consensus.cc:359] T da5b0b01a880412896838e8eb658db7a P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:01:59.147212  8602 raft_consensus.cc:385] T da5b0b01a880412896838e8eb658db7a P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:59.147518  8602 raft_consensus.cc:740] T da5b0b01a880412896838e8eb658db7a P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Initialized, Role: FOLLOWER
I20260709 13:01:59.147778  8600 raft_consensus.cc:359] T cea53371e56d4a668406dcd8f5a93dcb P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:01:59.148233  8602 consensus_queue.cc:260] T da5b0b01a880412896838e8eb658db7a P 7b3ea460d1294b8a82672d7c21475cb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:01:59.150698  8602 ts_tablet_manager.cc:1434] T da5b0b01a880412896838e8eb658db7a P 7b3ea460d1294b8a82672d7c21475cb5: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:01:59.149125  8600 raft_consensus.cc:385] T cea53371e56d4a668406dcd8f5a93dcb P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:59.151407  8600 raft_consensus.cc:740] T cea53371e56d4a668406dcd8f5a93dcb P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:01:59.151871  8601 tablet_bootstrap.cc:492] T 5095fba09faf47dd939329e762fbc663 P b560e9aaec7a4c78b9123b38e73519a3: No bootstrap required, opened a new log
I20260709 13:01:59.152412  8601 ts_tablet_manager.cc:1403] T 5095fba09faf47dd939329e762fbc663 P b560e9aaec7a4c78b9123b38e73519a3: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.004s
I20260709 13:01:59.153044  8602 tablet_bootstrap.cc:492] T a1946cc2deaa4799be02943612a39b16 P 7b3ea460d1294b8a82672d7c21475cb5: Bootstrap starting.
I20260709 13:01:59.152446  8600 consensus_queue.cc:260] T cea53371e56d4a668406dcd8f5a93dcb P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:01:59.155054  8600 ts_tablet_manager.cc:1434] T cea53371e56d4a668406dcd8f5a93dcb P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:01:59.156188  8600 tablet_bootstrap.cc:492] T 6540f8b1e5df49f698558db1af45038b P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:01:59.157032  8627 raft_consensus.cc:493] T da5b0b01a880412896838e8eb658db7a P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.157620  8627 raft_consensus.cc:515] T da5b0b01a880412896838e8eb658db7a P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:01:59.160060  8602 tablet_bootstrap.cc:654] T a1946cc2deaa4799be02943612a39b16 P 7b3ea460d1294b8a82672d7c21475cb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:59.167423  8598 tablet_bootstrap.cc:654] T 6540f8b1e5df49f698558db1af45038b P 53a66c851dc74c70b94c65d464a391f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:59.168284  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5b0b01a880412896838e8eb658db7a" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
I20260709 13:01:59.170540  8601 raft_consensus.cc:359] T 5095fba09faf47dd939329e762fbc663 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:01:59.171368  8601 raft_consensus.cc:385] T 5095fba09faf47dd939329e762fbc663 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:59.171656  8601 raft_consensus.cc:740] T 5095fba09faf47dd939329e762fbc663 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:59.172482  8601 consensus_queue.cc:260] T 5095fba09faf47dd939329e762fbc663 P b560e9aaec7a4c78b9123b38e73519a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:01:59.173669  8553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5b0b01a880412896838e8eb658db7a" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3" is_pre_election: true
I20260709 13:01:59.174350  8553 raft_consensus.cc:2468] T da5b0b01a880412896838e8eb658db7a P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b3ea460d1294b8a82672d7c21475cb5 in term 0.
I20260709 13:01:59.174993  8601 ts_tablet_manager.cc:1434] T 5095fba09faf47dd939329e762fbc663 P b560e9aaec7a4c78b9123b38e73519a3: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:01:59.176029  8601 tablet_bootstrap.cc:492] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P b560e9aaec7a4c78b9123b38e73519a3: Bootstrap starting.
I20260709 13:01:59.179207  8443 leader_election.cc:304] T da5b0b01a880412896838e8eb658db7a P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b3ea460d1294b8a82672d7c21475cb5, b560e9aaec7a4c78b9123b38e73519a3; no voters: 
I20260709 13:01:59.180554  8675 raft_consensus.cc:2804] T da5b0b01a880412896838e8eb658db7a P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:59.181006  8675 raft_consensus.cc:493] T da5b0b01a880412896838e8eb658db7a P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.181373  8675 raft_consensus.cc:3060] T da5b0b01a880412896838e8eb658db7a P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:59.182332  8598 tablet_bootstrap.cc:492] T 6540f8b1e5df49f698558db1af45038b P 53a66c851dc74c70b94c65d464a391f6: No bootstrap required, opened a new log
I20260709 13:01:59.182631  8601 tablet_bootstrap.cc:654] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P b560e9aaec7a4c78b9123b38e73519a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:59.182811  8598 ts_tablet_manager.cc:1403] T 6540f8b1e5df49f698558db1af45038b P 53a66c851dc74c70b94c65d464a391f6: Time spent bootstrapping tablet: real 0.040s	user 0.009s	sys 0.004s
W20260709 13:01:59.185400  8445 leader_election.cc:343] T da5b0b01a880412896838e8eb658db7a P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:59.172684  8654 consensus_queue.cc:1048] T e8bdd44ba5144cadada8b14a380f995a P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:59.190979  8601 tablet_bootstrap.cc:492] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P b560e9aaec7a4c78b9123b38e73519a3: No bootstrap required, opened a new log
I20260709 13:01:59.191515  8601 ts_tablet_manager.cc:1403] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P b560e9aaec7a4c78b9123b38e73519a3: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 13:01:59.192656  8627 leader_election.cc:290] T da5b0b01a880412896838e8eb658db7a P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:01:59.194646  8602 tablet_bootstrap.cc:492] T a1946cc2deaa4799be02943612a39b16 P 7b3ea460d1294b8a82672d7c21475cb5: No bootstrap required, opened a new log
I20260709 13:01:59.194576  8601 raft_consensus.cc:359] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:01:59.195366  8602 ts_tablet_manager.cc:1403] T a1946cc2deaa4799be02943612a39b16 P 7b3ea460d1294b8a82672d7c21475cb5: Time spent bootstrapping tablet: real 0.043s	user 0.013s	sys 0.006s
I20260709 13:01:59.195585  8601 raft_consensus.cc:385] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:59.195914  8601 raft_consensus.cc:740] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:59.196848  8660 raft_consensus.cc:493] T dbe23b457e664c298f0f2f6c41af32f8 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.197407  8660 raft_consensus.cc:515] T dbe23b457e664c298f0f2f6c41af32f8 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:01:59.198446  8602 raft_consensus.cc:359] T a1946cc2deaa4799be02943612a39b16 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:01:59.199055  8602 raft_consensus.cc:385] T a1946cc2deaa4799be02943612a39b16 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:59.199290  8602 raft_consensus.cc:740] T a1946cc2deaa4799be02943612a39b16 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Initialized, Role: FOLLOWER
I20260709 13:01:59.199398  8660 leader_election.cc:290] T dbe23b457e664c298f0f2f6c41af32f8 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429), b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503)
I20260709 13:01:59.199872  8602 consensus_queue.cc:260] T a1946cc2deaa4799be02943612a39b16 P 7b3ea460d1294b8a82672d7c21475cb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:01:59.196647  8601 consensus_queue.cc:260] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P b560e9aaec7a4c78b9123b38e73519a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:01:59.201599  8551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe23b457e664c298f0f2f6c41af32f8" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3" is_pre_election: true
I20260709 13:01:59.202262  8551 raft_consensus.cc:2468] T dbe23b457e664c298f0f2f6c41af32f8 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53a66c851dc74c70b94c65d464a391f6 in term 0.
I20260709 13:01:59.202497  8602 ts_tablet_manager.cc:1434] T a1946cc2deaa4799be02943612a39b16 P 7b3ea460d1294b8a82672d7c21475cb5: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:01:59.202605  8601 ts_tablet_manager.cc:1434] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P b560e9aaec7a4c78b9123b38e73519a3: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:01:59.203039  8598 raft_consensus.cc:359] T 6540f8b1e5df49f698558db1af45038b P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:01:59.203706  8598 raft_consensus.cc:385] T 6540f8b1e5df49f698558db1af45038b P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:59.203840  8601 tablet_bootstrap.cc:492] T 45171bd0207f452f9884a58c225ddb72 P b560e9aaec7a4c78b9123b38e73519a3: Bootstrap starting.
I20260709 13:01:59.203996  8598 raft_consensus.cc:740] T 6540f8b1e5df49f698558db1af45038b P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Initialized, Role: FOLLOWER
I20260709 13:01:59.204106  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe23b457e664c298f0f2f6c41af32f8" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
I20260709 13:01:59.205000  8602 tablet_bootstrap.cc:492] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P 7b3ea460d1294b8a82672d7c21475cb5: Bootstrap starting.
I20260709 13:01:59.204842  8598 consensus_queue.cc:260] T 6540f8b1e5df49f698558db1af45038b P 53a66c851dc74c70b94c65d464a391f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:01:59.205675  8369 leader_election.cc:304] T dbe23b457e664c298f0f2f6c41af32f8 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, b560e9aaec7a4c78b9123b38e73519a3; no voters: 
I20260709 13:01:59.206753  8607 raft_consensus.cc:2804] T dbe23b457e664c298f0f2f6c41af32f8 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:59.206874  8598 ts_tablet_manager.cc:1434] T 6540f8b1e5df49f698558db1af45038b P 53a66c851dc74c70b94c65d464a391f6: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.000s
I20260709 13:01:59.207165  8607 raft_consensus.cc:493] T dbe23b457e664c298f0f2f6c41af32f8 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.207579  8607 raft_consensus.cc:3060] T dbe23b457e664c298f0f2f6c41af32f8 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:59.208019  8598 tablet_bootstrap.cc:492] T 5095fba09faf47dd939329e762fbc663 P 53a66c851dc74c70b94c65d464a391f6: Bootstrap starting.
I20260709 13:01:59.209930  8601 tablet_bootstrap.cc:654] T 45171bd0207f452f9884a58c225ddb72 P b560e9aaec7a4c78b9123b38e73519a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:59.214601  8598 tablet_bootstrap.cc:654] T 5095fba09faf47dd939329e762fbc663 P 53a66c851dc74c70b94c65d464a391f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:59.215353  8600 tablet_bootstrap.cc:654] T 6540f8b1e5df49f698558db1af45038b P 590ee39ce5734876b94d91fc3931b807: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:59.217760  8675 raft_consensus.cc:515] T da5b0b01a880412896838e8eb658db7a P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:01:59.220131  8675 leader_election.cc:290] T da5b0b01a880412896838e8eb658db7a P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 election: Requested vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:01:59.223328  8551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5b0b01a880412896838e8eb658db7a" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3"
I20260709 13:01:59.223760  8602 tablet_bootstrap.cc:654] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P 7b3ea460d1294b8a82672d7c21475cb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:59.223975  8551 raft_consensus.cc:3060] T da5b0b01a880412896838e8eb658db7a P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:59.229897  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5b0b01a880412896838e8eb658db7a" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807"
I20260709 13:01:59.231709  8654 raft_consensus.cc:493] T 52f213b355c14b45a13d7cf5b3e76efe P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.233306  8660 raft_consensus.cc:493] T f8ec593f6c894c24a5bc727cfed4190a P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.233919  8660 raft_consensus.cc:515] T f8ec593f6c894c24a5bc727cfed4190a P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:01:59.237635  8552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ec593f6c894c24a5bc727cfed4190a" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3" is_pre_election: true
W20260709 13:01:59.240377  8445 leader_election.cc:343] T da5b0b01a880412896838e8eb658db7a P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:59.204883  8479 raft_consensus.cc:2468] T dbe23b457e664c298f0f2f6c41af32f8 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53a66c851dc74c70b94c65d464a391f6 in term 0.
I20260709 13:01:59.248831  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8ec593f6c894c24a5bc727cfed4190a" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
I20260709 13:01:59.249915  8329 raft_consensus.cc:2393] T f8ec593f6c894c24a5bc727cfed4190a P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 53a66c851dc74c70b94c65d464a391f6 in current term 1: Already voted for candidate b560e9aaec7a4c78b9123b38e73519a3 in this term.
I20260709 13:01:59.251240  8371 leader_election.cc:304] T f8ec593f6c894c24a5bc727cfed4190a P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6; no voters: 590ee39ce5734876b94d91fc3931b807, b560e9aaec7a4c78b9123b38e73519a3
I20260709 13:01:59.232368  8654 raft_consensus.cc:515] T 52f213b355c14b45a13d7cf5b3e76efe P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:01:59.256086  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f213b355c14b45a13d7cf5b3e76efe" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
I20260709 13:01:59.259519  8654 leader_election.cc:290] T 52f213b355c14b45a13d7cf5b3e76efe P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429), b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503)
I20260709 13:01:59.261445  8552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52f213b355c14b45a13d7cf5b3e76efe" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3" is_pre_election: true
I20260709 13:01:59.266865  8552 raft_consensus.cc:2393] T 52f213b355c14b45a13d7cf5b3e76efe P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 590ee39ce5734876b94d91fc3931b807 in current term 1: Already voted for candidate 7b3ea460d1294b8a82672d7c21475cb5 in this term.
I20260709 13:01:59.268687  8294 leader_election.cc:304] T 52f213b355c14b45a13d7cf5b3e76efe P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807; no voters: 7b3ea460d1294b8a82672d7c21475cb5, b560e9aaec7a4c78b9123b38e73519a3
I20260709 13:01:59.269802  8608 raft_consensus.cc:3060] T 52f213b355c14b45a13d7cf5b3e76efe P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:59.265441  8660 leader_election.cc:290] T f8ec593f6c894c24a5bc727cfed4190a P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:01:59.281160  8660 raft_consensus.cc:3060] T f8ec593f6c894c24a5bc727cfed4190a P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:59.318193  8654 consensus_queue.cc:1048] T e8bdd44ba5144cadada8b14a380f995a P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:59.321342  8608 raft_consensus.cc:2749] T 52f213b355c14b45a13d7cf5b3e76efe P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:59.323315  8608 raft_consensus.cc:493] T a1946cc2deaa4799be02943612a39b16 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.361470  8608 raft_consensus.cc:515] T a1946cc2deaa4799be02943612a39b16 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:01:59.364607  8608 leader_election.cc:290] T a1946cc2deaa4799be02943612a39b16 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:01:59.356707  8627 consensus_queue.cc:1048] T 52f213b355c14b45a13d7cf5b3e76efe P 7b3ea460d1294b8a82672d7c21475cb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:01:59.329080  8607 raft_consensus.cc:515] T dbe23b457e664c298f0f2f6c41af32f8 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:01:59.367221  8605 raft_consensus.cc:493] T 5095fba09faf47dd939329e762fbc663 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.392486  8605 raft_consensus.cc:515] T 5095fba09faf47dd939329e762fbc663 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:01:59.394783  8605 leader_election.cc:290] T 5095fba09faf47dd939329e762fbc663 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:01:59.397310  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5095fba09faf47dd939329e762fbc663" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
W20260709 13:01:59.399416  8518 leader_election.cc:343] T 5095fba09faf47dd939329e762fbc663 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:59.400266  8605 raft_consensus.cc:493] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.400947  8605 raft_consensus.cc:515] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:01:59.405264  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcf623b1e5f47ec9cf4b5d9f00d4c1b" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
W20260709 13:01:59.407233  8518 leader_election.cc:343] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:59.407984  8605 leader_election.cc:290] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:01:59.411221  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe23b457e664c298f0f2f6c41af32f8" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5"
I20260709 13:01:59.411983  8479 raft_consensus.cc:3060] T dbe23b457e664c298f0f2f6c41af32f8 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:59.432796  8552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe23b457e664c298f0f2f6c41af32f8" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3"
I20260709 13:01:59.434126  8552 raft_consensus.cc:3060] T dbe23b457e664c298f0f2f6c41af32f8 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:59.446341  8607 leader_election.cc:290] T dbe23b457e664c298f0f2f6c41af32f8 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 election: Requested vote from peers 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429), b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503)
I20260709 13:01:59.448129  8607 raft_consensus.cc:493] T 5527a2aef01d45cebcfad8a1b0a5273d P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.450423  8607 raft_consensus.cc:515] T 5527a2aef01d45cebcfad8a1b0a5273d P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:01:59.307355  8551 raft_consensus.cc:2468] T da5b0b01a880412896838e8eb658db7a P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b3ea460d1294b8a82672d7c21475cb5 in term 1.
I20260709 13:01:59.464272  8602 tablet_bootstrap.cc:492] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P 7b3ea460d1294b8a82672d7c21475cb5: No bootstrap required, opened a new log
I20260709 13:01:59.371134  8701 raft_consensus.cc:493] T 6540f8b1e5df49f698558db1af45038b P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.464838  8602 ts_tablet_manager.cc:1403] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P 7b3ea460d1294b8a82672d7c21475cb5: Time spent bootstrapping tablet: real 0.260s	user 0.047s	sys 0.073s
I20260709 13:01:59.465214  8701 raft_consensus.cc:515] T 6540f8b1e5df49f698558db1af45038b P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:01:59.467473  8701 leader_election.cc:290] T 6540f8b1e5df49f698558db1af45038b P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:01:59.467582  8602 raft_consensus.cc:359] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:01:59.469946  8602 raft_consensus.cc:385] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:59.470261  8602 raft_consensus.cc:740] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Initialized, Role: FOLLOWER
I20260709 13:01:59.456171  8552 raft_consensus.cc:2468] T dbe23b457e664c298f0f2f6c41af32f8 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53a66c851dc74c70b94c65d464a391f6 in term 1.
I20260709 13:01:59.473572  8607 leader_election.cc:290] T 5527a2aef01d45cebcfad8a1b0a5273d P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:01:59.471838  8602 consensus_queue.cc:260] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P 7b3ea460d1294b8a82672d7c21475cb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:01:59.473603  8600 tablet_bootstrap.cc:492] T 6540f8b1e5df49f698558db1af45038b P 590ee39ce5734876b94d91fc3931b807: No bootstrap required, opened a new log
I20260709 13:01:59.474650  8660 raft_consensus.cc:2749] T f8ec593f6c894c24a5bc727cfed4190a P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:59.477634  8598 tablet_bootstrap.cc:492] T 5095fba09faf47dd939329e762fbc663 P 53a66c851dc74c70b94c65d464a391f6: No bootstrap required, opened a new log
I20260709 13:01:59.477067  8602 ts_tablet_manager.cc:1434] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P 7b3ea460d1294b8a82672d7c21475cb5: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.002s
I20260709 13:01:59.479979  8598 ts_tablet_manager.cc:1403] T 5095fba09faf47dd939329e762fbc663 P 53a66c851dc74c70b94c65d464a391f6: Time spent bootstrapping tablet: real 0.272s	user 0.080s	sys 0.154s
I20260709 13:01:59.476893  8600 ts_tablet_manager.cc:1403] T 6540f8b1e5df49f698558db1af45038b P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.321s	user 0.053s	sys 0.071s
I20260709 13:01:59.480772  8602 tablet_bootstrap.cc:492] T 6540f8b1e5df49f698558db1af45038b P 7b3ea460d1294b8a82672d7c21475cb5: Bootstrap starting.
I20260709 13:01:59.482331  8601 tablet_bootstrap.cc:492] T 45171bd0207f452f9884a58c225ddb72 P b560e9aaec7a4c78b9123b38e73519a3: No bootstrap required, opened a new log
I20260709 13:01:59.482926  8601 ts_tablet_manager.cc:1403] T 45171bd0207f452f9884a58c225ddb72 P b560e9aaec7a4c78b9123b38e73519a3: Time spent bootstrapping tablet: real 0.279s	user 0.100s	sys 0.137s
I20260709 13:01:59.483035  8598 raft_consensus.cc:359] T 5095fba09faf47dd939329e762fbc663 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:01:59.483268  8600 raft_consensus.cc:359] T 6540f8b1e5df49f698558db1af45038b P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:01:59.483786  8598 raft_consensus.cc:385] T 5095fba09faf47dd939329e762fbc663 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:59.483997  8600 raft_consensus.cc:385] T 6540f8b1e5df49f698558db1af45038b P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:59.484131  8598 raft_consensus.cc:740] T 5095fba09faf47dd939329e762fbc663 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Initialized, Role: FOLLOWER
I20260709 13:01:59.484459  8600 raft_consensus.cc:740] T 6540f8b1e5df49f698558db1af45038b P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:01:59.484968  8598 consensus_queue.cc:260] T 5095fba09faf47dd939329e762fbc663 P 53a66c851dc74c70b94c65d464a391f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:01:59.485318  8600 consensus_queue.cc:260] T 6540f8b1e5df49f698558db1af45038b P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:01:59.485843  8601 raft_consensus.cc:359] T 45171bd0207f452f9884a58c225ddb72 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:01:59.486487  8601 raft_consensus.cc:385] T 45171bd0207f452f9884a58c225ddb72 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:59.486745  8601 raft_consensus.cc:740] T 45171bd0207f452f9884a58c225ddb72 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:59.487004  8598 ts_tablet_manager.cc:1434] T 5095fba09faf47dd939329e762fbc663 P 53a66c851dc74c70b94c65d464a391f6: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:01:59.487455  8600 ts_tablet_manager.cc:1434] T 6540f8b1e5df49f698558db1af45038b P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:01:59.487339  8601 consensus_queue.cc:260] T 45171bd0207f452f9884a58c225ddb72 P b560e9aaec7a4c78b9123b38e73519a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:01:59.487915  8598 tablet_bootstrap.cc:492] T c63211d1d13a4736adb18dee69b400a3 P 53a66c851dc74c70b94c65d464a391f6: Bootstrap starting.
I20260709 13:01:59.488422  8600 tablet_bootstrap.cc:492] T da5b0b01a880412896838e8eb658db7a P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:01:59.488853  8602 tablet_bootstrap.cc:654] T 6540f8b1e5df49f698558db1af45038b P 7b3ea460d1294b8a82672d7c21475cb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:59.489374  8601 ts_tablet_manager.cc:1434] T 45171bd0207f452f9884a58c225ddb72 P b560e9aaec7a4c78b9123b38e73519a3: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:01:59.490272  8601 tablet_bootstrap.cc:492] T 6433163abeff4ee0b011d159ca454a6a P b560e9aaec7a4c78b9123b38e73519a3: Bootstrap starting.
W20260709 13:01:59.376837  8295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45429, user_credentials={real_user=slave}} blocked reactor thread for 83944.2us
W20260709 13:01:59.379976  8371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40837, user_credentials={real_user=slave}} blocked reactor thread for 128859us
I20260709 13:01:59.536204  8369 leader_election.cc:304] T dbe23b457e664c298f0f2f6c41af32f8 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, b560e9aaec7a4c78b9123b38e73519a3; no voters: 
I20260709 13:01:59.539511  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1946cc2deaa4799be02943612a39b16" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:01:59.539260  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6540f8b1e5df49f698558db1af45038b" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
I20260709 13:01:59.540686  8404 raft_consensus.cc:2468] T a1946cc2deaa4799be02943612a39b16 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 590ee39ce5734876b94d91fc3931b807 in term 0.
I20260709 13:01:59.540791  8330 raft_consensus.cc:2468] T 6540f8b1e5df49f698558db1af45038b P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53a66c851dc74c70b94c65d464a391f6 in term 0.
I20260709 13:01:59.541616  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5527a2aef01d45cebcfad8a1b0a5273d" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
I20260709 13:01:59.542613  8329 raft_consensus.cc:2468] T 5527a2aef01d45cebcfad8a1b0a5273d P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53a66c851dc74c70b94c65d464a391f6 in term 0.
I20260709 13:01:59.543459  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcf623b1e5f47ec9cf4b5d9f00d4c1b" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:01:59.543749  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5095fba09faf47dd939329e762fbc663" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:01:59.544379  8403 raft_consensus.cc:2468] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 0.
I20260709 13:01:59.544483  8404 raft_consensus.cc:2468] T 5095fba09faf47dd939329e762fbc663 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 0.
I20260709 13:01:59.547946  8443 leader_election.cc:304] T da5b0b01a880412896838e8eb658db7a P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b3ea460d1294b8a82672d7c21475cb5, b560e9aaec7a4c78b9123b38e73519a3; no voters: 590ee39ce5734876b94d91fc3931b807
I20260709 13:01:59.553624  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1946cc2deaa4799be02943612a39b16" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
I20260709 13:01:59.555022  8478 raft_consensus.cc:2468] T a1946cc2deaa4799be02943612a39b16 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 590ee39ce5734876b94d91fc3931b807 in term 0.
I20260709 13:01:59.556821  8295 leader_election.cc:304] T a1946cc2deaa4799be02943612a39b16 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, 590ee39ce5734876b94d91fc3931b807; no voters: 
I20260709 13:01:59.559583  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6540f8b1e5df49f698558db1af45038b" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
I20260709 13:01:59.561712  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5527a2aef01d45cebcfad8a1b0a5273d" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
I20260709 13:01:59.562547  8518 leader_election.cc:304] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, b560e9aaec7a4c78b9123b38e73519a3; no voters: 7b3ea460d1294b8a82672d7c21475cb5
I20260709 13:01:59.562975  8476 raft_consensus.cc:2468] T 5527a2aef01d45cebcfad8a1b0a5273d P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53a66c851dc74c70b94c65d464a391f6 in term 0.
I20260709 13:01:59.569593  8371 leader_election.cc:304] T 6540f8b1e5df49f698558db1af45038b P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, 590ee39ce5734876b94d91fc3931b807; no voters: 
I20260709 13:01:59.571099  8371 leader_election.cc:304] T 5527a2aef01d45cebcfad8a1b0a5273d P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, 590ee39ce5734876b94d91fc3931b807; no voters: 
I20260709 13:01:59.572616  8518 leader_election.cc:304] T 5095fba09faf47dd939329e762fbc663 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, b560e9aaec7a4c78b9123b38e73519a3; no voters: 7b3ea460d1294b8a82672d7c21475cb5
W20260709 13:01:59.573076  8370 leader_election.cc:343] T 6540f8b1e5df49f698558db1af45038b P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:59.575652  8598 tablet_bootstrap.cc:654] T c63211d1d13a4736adb18dee69b400a3 P 53a66c851dc74c70b94c65d464a391f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:59.575799  8479 raft_consensus.cc:2468] T dbe23b457e664c298f0f2f6c41af32f8 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53a66c851dc74c70b94c65d464a391f6 in term 1.
I20260709 13:01:59.584646  8600 tablet_bootstrap.cc:654] T da5b0b01a880412896838e8eb658db7a P 590ee39ce5734876b94d91fc3931b807: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:59.586617  8605 raft_consensus.cc:2804] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:59.587126  8605 raft_consensus.cc:493] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.587599  8605 raft_consensus.cc:3060] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:59.596755  8607 raft_consensus.cc:493] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.597530  8607 raft_consensus.cc:515] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:01:59.598413  8608 raft_consensus.cc:493] T cea53371e56d4a668406dcd8f5a93dcb P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.601588  8701 raft_consensus.cc:2804] T 6540f8b1e5df49f698558db1af45038b P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:59.602067  8701 raft_consensus.cc:493] T 6540f8b1e5df49f698558db1af45038b P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.602423  8701 raft_consensus.cc:3060] T 6540f8b1e5df49f698558db1af45038b P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:59.605624  8710 raft_consensus.cc:493] T 5527a2aef01d45cebcfad8a1b0a5273d P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.606330  8710 raft_consensus.cc:515] T 5527a2aef01d45cebcfad8a1b0a5273d P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:01:59.609978  8601 tablet_bootstrap.cc:654] T 6433163abeff4ee0b011d159ca454a6a P b560e9aaec7a4c78b9123b38e73519a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:59.612134  8710 leader_election.cc:290] T 5527a2aef01d45cebcfad8a1b0a5273d P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:01:59.618569  8654 raft_consensus.cc:2804] T a1946cc2deaa4799be02943612a39b16 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:59.618755  8708 raft_consensus.cc:2804] T 5527a2aef01d45cebcfad8a1b0a5273d P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:59.619163  8654 raft_consensus.cc:493] T a1946cc2deaa4799be02943612a39b16 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.619212  8708 raft_consensus.cc:493] T 5527a2aef01d45cebcfad8a1b0a5273d P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.619755  8708 raft_consensus.cc:3060] T 5527a2aef01d45cebcfad8a1b0a5273d P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:59.614315  8605 raft_consensus.cc:515] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:01:59.623777  8605 leader_election.cc:290] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 election: Requested vote from peers 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:01:59.619567  8627 raft_consensus.cc:2804] T da5b0b01a880412896838e8eb658db7a P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:59.624905  8627 raft_consensus.cc:697] T da5b0b01a880412896838e8eb658db7a P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 LEADER]: Becoming Leader. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Running, Role: LEADER
I20260709 13:01:59.624975  8661 raft_consensus.cc:2804] T 5095fba09faf47dd939329e762fbc663 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:59.619683  8654 raft_consensus.cc:3060] T a1946cc2deaa4799be02943612a39b16 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:59.625579  8661 raft_consensus.cc:493] T 5095fba09faf47dd939329e762fbc663 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.625782  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcf623b1e5f47ec9cf4b5d9f00d4c1b" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6"
I20260709 13:01:59.626151  8661 raft_consensus.cc:3060] T 5095fba09faf47dd939329e762fbc663 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:59.626535  8404 raft_consensus.cc:3060] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:59.626487  8627 consensus_queue.cc:237] T da5b0b01a880412896838e8eb658db7a P 7b3ea460d1294b8a82672d7c21475cb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:01:59.628878  8660 raft_consensus.cc:2804] T dbe23b457e664c298f0f2f6c41af32f8 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:59.599135  8608 raft_consensus.cc:515] T cea53371e56d4a668406dcd8f5a93dcb P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:01:59.653139  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcf623b1e5f47ec9cf4b5d9f00d4c1b" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5"
I20260709 13:01:59.654107  8479 raft_consensus.cc:3060] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:59.658684  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5527a2aef01d45cebcfad8a1b0a5273d" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
I20260709 13:01:59.659700  8329 raft_consensus.cc:2468] T 5527a2aef01d45cebcfad8a1b0a5273d P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b3ea460d1294b8a82672d7c21475cb5 in term 0.
W20260709 13:01:59.659688  8444 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37751, user_credentials={real_user=slave}} blocked reactor thread for 48171.6us
I20260709 13:01:59.662565  8607 leader_election.cc:290] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429), b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503)
I20260709 13:01:59.663592  8608 leader_election.cc:290] T cea53371e56d4a668406dcd8f5a93dcb P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:01:59.664888  8553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcf623b1e5f47ec9cf4b5d9f00d4c1b" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3" is_pre_election: true
I20260709 13:01:59.667848  8553 raft_consensus.cc:2393] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 53a66c851dc74c70b94c65d464a391f6 in current term 1: Already voted for candidate b560e9aaec7a4c78b9123b38e73519a3 in this term.
I20260709 13:01:59.668354  8330 raft_consensus.cc:3060] T cea53371e56d4a668406dcd8f5a93dcb P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:59.636881  8682 consensus_queue.cc:1048] T f8ec593f6c894c24a5bc727cfed4190a P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.036s
I20260709 13:01:59.669303  8701 raft_consensus.cc:515] T 6540f8b1e5df49f698558db1af45038b P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:01:59.670207  8682 raft_consensus.cc:493] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.670960  8682 raft_consensus.cc:515] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:01:59.665197  8552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cea53371e56d4a668406dcd8f5a93dcb" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3" is_pre_election: true
I20260709 13:01:59.664901  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cea53371e56d4a668406dcd8f5a93dcb" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:01:59.664201  8445 leader_election.cc:304] T 5527a2aef01d45cebcfad8a1b0a5273d P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807, 7b3ea460d1294b8a82672d7c21475cb5; no voters: 
W20260709 13:01:59.633360  8443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42503, user_credentials={real_user=slave}} blocked reactor thread for 82308.3us
I20260709 13:01:59.685524  8294 leader_election.cc:304] T cea53371e56d4a668406dcd8f5a93dcb P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807; no voters: 53a66c851dc74c70b94c65d464a391f6, b560e9aaec7a4c78b9123b38e73519a3
I20260709 13:01:59.685665  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1dcf623b1e5f47ec9cf4b5d9f00d4c1b" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
I20260709 13:01:59.687384  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6540f8b1e5df49f698558db1af45038b" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807"
I20260709 13:01:59.688012  8701 leader_election.cc:290] T 6540f8b1e5df49f698558db1af45038b P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 election: Requested vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:01:59.687394  8660 raft_consensus.cc:697] T dbe23b457e664c298f0f2f6c41af32f8 P 53a66c851dc74c70b94c65d464a391f6 [term 1 LEADER]: Becoming Leader. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Running, Role: LEADER
I20260709 13:01:59.706534  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6540f8b1e5df49f698558db1af45038b" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5"
I20260709 13:01:59.699331  8329 raft_consensus.cc:3060] T 6540f8b1e5df49f698558db1af45038b P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:59.690652  8654 raft_consensus.cc:515] T a1946cc2deaa4799be02943612a39b16 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:01:59.712764  8600 tablet_bootstrap.cc:492] T da5b0b01a880412896838e8eb658db7a P 590ee39ce5734876b94d91fc3931b807: No bootstrap required, opened a new log
I20260709 13:01:59.706328  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8bd38b8a2e4bbd9d07dcf2f1cea143" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
I20260709 13:01:59.713629  8600 ts_tablet_manager.cc:1403] T da5b0b01a880412896838e8eb658db7a P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.225s	user 0.024s	sys 0.014s
I20260709 13:01:59.715559  8602 tablet_bootstrap.cc:492] T 6540f8b1e5df49f698558db1af45038b P 7b3ea460d1294b8a82672d7c21475cb5: No bootstrap required, opened a new log
W20260709 13:01:59.716771  8370 leader_election.cc:343] T 6540f8b1e5df49f698558db1af45038b P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:59.716454  8602 ts_tablet_manager.cc:1403] T 6540f8b1e5df49f698558db1af45038b P 7b3ea460d1294b8a82672d7c21475cb5: Time spent bootstrapping tablet: real 0.236s	user 0.009s	sys 0.009s
I20260709 13:01:59.700317  8718 raft_consensus.cc:2804] T 5527a2aef01d45cebcfad8a1b0a5273d P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:01:59.719748  8718 raft_consensus.cc:493] T 5527a2aef01d45cebcfad8a1b0a5273d P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:01:59.728930  8479 raft_consensus.cc:2468] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 1.
I20260709 13:01:59.731858  8598 tablet_bootstrap.cc:492] T c63211d1d13a4736adb18dee69b400a3 P 53a66c851dc74c70b94c65d464a391f6: No bootstrap required, opened a new log
I20260709 13:01:59.730732  8600 raft_consensus.cc:359] T da5b0b01a880412896838e8eb658db7a P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:01:59.732631  8598 ts_tablet_manager.cc:1403] T c63211d1d13a4736adb18dee69b400a3 P 53a66c851dc74c70b94c65d464a391f6: Time spent bootstrapping tablet: real 0.245s	user 0.020s	sys 0.010s
I20260709 13:01:59.733480  8660 consensus_queue.cc:237] T dbe23b457e664c298f0f2f6c41af32f8 P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:01:59.725263  8718 raft_consensus.cc:3060] T 5527a2aef01d45cebcfad8a1b0a5273d P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:59.735760  8370 leader_election.cc:304] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6; no voters: 7b3ea460d1294b8a82672d7c21475cb5, b560e9aaec7a4c78b9123b38e73519a3
I20260709 13:01:59.736003  8598 raft_consensus.cc:359] T c63211d1d13a4736adb18dee69b400a3 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
W20260709 13:01:59.736805  8518 leader_election.cc:343] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:59.738366  8605 consensus_queue.cc:1048] T f8ec593f6c894c24a5bc727cfed4190a P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:01:59.738509  8518 leader_election.cc:304] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b3ea460d1294b8a82672d7c21475cb5, b560e9aaec7a4c78b9123b38e73519a3; no voters: 
I20260709 13:01:59.738893  8601 tablet_bootstrap.cc:492] T 6433163abeff4ee0b011d159ca454a6a P b560e9aaec7a4c78b9123b38e73519a3: No bootstrap required, opened a new log
I20260709 13:01:59.739462  8601 ts_tablet_manager.cc:1403] T 6433163abeff4ee0b011d159ca454a6a P b560e9aaec7a4c78b9123b38e73519a3: Time spent bootstrapping tablet: real 0.249s	user 0.009s	sys 0.012s
I20260709 13:01:59.739720  8717 raft_consensus.cc:2804] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:59.740310  8717 raft_consensus.cc:697] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Becoming Leader. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Running, Role: LEADER
I20260709 13:01:59.732583  8600 raft_consensus.cc:385] T da5b0b01a880412896838e8eb658db7a P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:59.741479  8600 raft_consensus.cc:740] T da5b0b01a880412896838e8eb658db7a P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:01:59.741410  8717 consensus_queue.cc:237] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:01:59.742533  8601 raft_consensus.cc:359] T 6433163abeff4ee0b011d159ca454a6a P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:01:59.743455  8601 raft_consensus.cc:385] T 6433163abeff4ee0b011d159ca454a6a P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:59.743803  8601 raft_consensus.cc:740] T 6433163abeff4ee0b011d159ca454a6a P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:59.742479  8600 consensus_queue.cc:260] T da5b0b01a880412896838e8eb658db7a P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:01:59.736953  8598 raft_consensus.cc:385] T c63211d1d13a4736adb18dee69b400a3 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:59.747998  8598 raft_consensus.cc:740] T c63211d1d13a4736adb18dee69b400a3 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Initialized, Role: FOLLOWER
I20260709 13:01:59.754035  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8bd38b8a2e4bbd9d07dcf2f1cea143" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
I20260709 13:01:59.753720  8227 catalog_manager.cc:5697] T da5b0b01a880412896838e8eb658db7a P 7b3ea460d1294b8a82672d7c21475cb5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "7b3ea460d1294b8a82672d7c21475cb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:59.756251  8600 ts_tablet_manager.cc:1434] T da5b0b01a880412896838e8eb658db7a P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.042s	user 0.009s	sys 0.000s
W20260709 13:01:59.756125  8519 leader_election.cc:343] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:59.756897  8519 leader_election.cc:304] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b560e9aaec7a4c78b9123b38e73519a3; no voters: 590ee39ce5734876b94d91fc3931b807, 7b3ea460d1294b8a82672d7c21475cb5
I20260709 13:01:59.757903  8605 raft_consensus.cc:2749] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:59.758951  8600 tablet_bootstrap.cc:492] T c63211d1d13a4736adb18dee69b400a3 P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:01:59.759644  8329 raft_consensus.cc:2468] T 6540f8b1e5df49f698558db1af45038b P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53a66c851dc74c70b94c65d464a391f6 in term 1.
I20260709 13:01:59.718806  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5527a2aef01d45cebcfad8a1b0a5273d" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:01:59.761106  8371 leader_election.cc:304] T 6540f8b1e5df49f698558db1af45038b P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, 590ee39ce5734876b94d91fc3931b807; no voters: 7b3ea460d1294b8a82672d7c21475cb5
I20260709 13:01:59.760076  8601 consensus_queue.cc:260] T 6433163abeff4ee0b011d159ca454a6a P b560e9aaec7a4c78b9123b38e73519a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:01:59.768028  8600 tablet_bootstrap.cc:654] T c63211d1d13a4736adb18dee69b400a3 P 590ee39ce5734876b94d91fc3931b807: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:59.772265  8607 raft_consensus.cc:2804] T 6540f8b1e5df49f698558db1af45038b P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:59.772802  8607 raft_consensus.cc:697] T 6540f8b1e5df49f698558db1af45038b P 53a66c851dc74c70b94c65d464a391f6 [term 1 LEADER]: Becoming Leader. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Running, Role: LEADER
I20260709 13:01:59.773783  8654 leader_election.cc:290] T a1946cc2deaa4799be02943612a39b16 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 election: Requested vote from peers 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:01:59.776476  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1946cc2deaa4799be02943612a39b16" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6"
I20260709 13:01:59.777169  8403 raft_consensus.cc:3060] T a1946cc2deaa4799be02943612a39b16 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:59.761842  8682 leader_election.cc:290] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:01:59.779583  8709 consensus_queue.cc:1048] T 52f213b355c14b45a13d7cf5b3e76efe P 7b3ea460d1294b8a82672d7c21475cb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:01:59.751245  8598 consensus_queue.cc:260] T c63211d1d13a4736adb18dee69b400a3 P 53a66c851dc74c70b94c65d464a391f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:01:59.773833  8607 consensus_queue.cc:237] T 6540f8b1e5df49f698558db1af45038b P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:01:59.789495  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1946cc2deaa4799be02943612a39b16" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5"
I20260709 13:01:59.790378  8476 raft_consensus.cc:3060] T a1946cc2deaa4799be02943612a39b16 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:59.790957  8598 ts_tablet_manager.cc:1434] T c63211d1d13a4736adb18dee69b400a3 P 53a66c851dc74c70b94c65d464a391f6: Time spent starting tablet: real 0.058s	user 0.008s	sys 0.001s
I20260709 13:01:59.748853  8708 raft_consensus.cc:515] T 5527a2aef01d45cebcfad8a1b0a5273d P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:01:59.793928  8598 tablet_bootstrap.cc:492] T e1f344d27b0b44819ef6d23574175c26 P 53a66c851dc74c70b94c65d464a391f6: Bootstrap starting.
I20260709 13:01:59.794230  8601 ts_tablet_manager.cc:1434] T 6433163abeff4ee0b011d159ca454a6a P b560e9aaec7a4c78b9123b38e73519a3: Time spent starting tablet: real 0.054s	user 0.010s	sys 0.002s
I20260709 13:01:59.794865  8661 raft_consensus.cc:515] T 5095fba09faf47dd939329e762fbc663 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:01:59.795971  8405 raft_consensus.cc:2393] T 5527a2aef01d45cebcfad8a1b0a5273d P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7b3ea460d1294b8a82672d7c21475cb5 in current term 1: Already voted for candidate 53a66c851dc74c70b94c65d464a391f6 in this term.
I20260709 13:01:59.796995  8661 leader_election.cc:290] T 5095fba09faf47dd939329e762fbc663 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 election: Requested vote from peers 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:01:59.792141  8403 raft_consensus.cc:2468] T a1946cc2deaa4799be02943612a39b16 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 590ee39ce5734876b94d91fc3931b807 in term 1.
I20260709 13:01:59.810768  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5527a2aef01d45cebcfad8a1b0a5273d" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807"
I20260709 13:01:59.811476  8328 raft_consensus.cc:3060] T 5527a2aef01d45cebcfad8a1b0a5273d P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:59.816787  8598 tablet_bootstrap.cc:654] T e1f344d27b0b44819ef6d23574175c26 P 53a66c851dc74c70b94c65d464a391f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:59.818670  8404 raft_consensus.cc:2468] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 1.
I20260709 13:01:59.819178  8608 raft_consensus.cc:2749] T cea53371e56d4a668406dcd8f5a93dcb P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:59.819314  8701 raft_consensus.cc:2749] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:01:59.819999  8295 leader_election.cc:304] T a1946cc2deaa4799be02943612a39b16 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, 590ee39ce5734876b94d91fc3931b807; no voters: 
I20260709 13:01:59.820824  8705 raft_consensus.cc:2804] T a1946cc2deaa4799be02943612a39b16 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:59.820897  8708 leader_election.cc:290] T 5527a2aef01d45cebcfad8a1b0a5273d P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 election: Requested vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:01:59.821344  8705 raft_consensus.cc:697] T a1946cc2deaa4799be02943612a39b16 P 590ee39ce5734876b94d91fc3931b807 [term 1 LEADER]: Becoming Leader. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Running, Role: LEADER
I20260709 13:01:59.822490  8705 consensus_queue.cc:237] T a1946cc2deaa4799be02943612a39b16 P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:01:59.801911  8718 raft_consensus.cc:515] T 5527a2aef01d45cebcfad8a1b0a5273d P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:01:59.826376  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5095fba09faf47dd939329e762fbc663" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5"
I20260709 13:01:59.826604  8718 leader_election.cc:290] T 5527a2aef01d45cebcfad8a1b0a5273d P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 election: Requested vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:01:59.829375  8477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5527a2aef01d45cebcfad8a1b0a5273d" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5"
I20260709 13:01:59.830215  8477 raft_consensus.cc:2393] T 5527a2aef01d45cebcfad8a1b0a5273d P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 53a66c851dc74c70b94c65d464a391f6 in current term 1: Already voted for candidate 7b3ea460d1294b8a82672d7c21475cb5 in this term.
W20260709 13:01:59.830432  8518 leader_election.cc:343] T 5095fba09faf47dd939329e762fbc663 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:59.829031  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5095fba09faf47dd939329e762fbc663" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6"
I20260709 13:01:59.831257  8404 raft_consensus.cc:3060] T 5095fba09faf47dd939329e762fbc663 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:01:59.831328  8401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5527a2aef01d45cebcfad8a1b0a5273d" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6"
I20260709 13:01:59.833039  8601 tablet_bootstrap.cc:492] T ae8659e834df408ab36dd56103f10ae4 P b560e9aaec7a4c78b9123b38e73519a3: Bootstrap starting.
I20260709 13:01:59.834306  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5527a2aef01d45cebcfad8a1b0a5273d" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807"
I20260709 13:01:59.837284  8444 leader_election.cc:304] T 5527a2aef01d45cebcfad8a1b0a5273d P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b3ea460d1294b8a82672d7c21475cb5; no voters: 53a66c851dc74c70b94c65d464a391f6, 590ee39ce5734876b94d91fc3931b807
I20260709 13:01:59.838443  8627 raft_consensus.cc:2749] T 5527a2aef01d45cebcfad8a1b0a5273d P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:01:59.841706  8602 raft_consensus.cc:359] T 6540f8b1e5df49f698558db1af45038b P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:01:59.844224  8602 raft_consensus.cc:385] T 6540f8b1e5df49f698558db1af45038b P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:59.850044  8404 raft_consensus.cc:2468] T 5095fba09faf47dd939329e762fbc663 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 1.
I20260709 13:01:59.851317  8518 leader_election.cc:304] T 5095fba09faf47dd939329e762fbc663 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, b560e9aaec7a4c78b9123b38e73519a3; no voters: 7b3ea460d1294b8a82672d7c21475cb5
I20260709 13:01:59.852116  8661 raft_consensus.cc:2804] T 5095fba09faf47dd939329e762fbc663 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:59.844506  8602 raft_consensus.cc:740] T 6540f8b1e5df49f698558db1af45038b P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Initialized, Role: FOLLOWER
I20260709 13:01:59.852993  8661 raft_consensus.cc:697] T 5095fba09faf47dd939329e762fbc663 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Becoming Leader. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Running, Role: LEADER
I20260709 13:01:59.853403  8602 consensus_queue.cc:260] T 6540f8b1e5df49f698558db1af45038b P 7b3ea460d1294b8a82672d7c21475cb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:01:59.854151  8600 tablet_bootstrap.cc:492] T c63211d1d13a4736adb18dee69b400a3 P 590ee39ce5734876b94d91fc3931b807: No bootstrap required, opened a new log
I20260709 13:01:59.854067  8661 consensus_queue.cc:237] T 5095fba09faf47dd939329e762fbc663 P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:01:59.854839  8600 ts_tablet_manager.cc:1403] T c63211d1d13a4736adb18dee69b400a3 P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.097s	user 0.020s	sys 0.021s
I20260709 13:01:59.855356  8476 raft_consensus.cc:2468] T a1946cc2deaa4799be02943612a39b16 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 590ee39ce5734876b94d91fc3931b807 in term 1.
I20260709 13:01:59.859273  8600 raft_consensus.cc:359] T c63211d1d13a4736adb18dee69b400a3 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:01:59.860291  8600 raft_consensus.cc:385] T c63211d1d13a4736adb18dee69b400a3 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:59.860671  8600 raft_consensus.cc:740] T c63211d1d13a4736adb18dee69b400a3 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:01:59.861093  8602 ts_tablet_manager.cc:1434] T 6540f8b1e5df49f698558db1af45038b P 7b3ea460d1294b8a82672d7c21475cb5: Time spent starting tablet: real 0.142s	user 0.005s	sys 0.003s
I20260709 13:01:59.861583  8600 consensus_queue.cc:260] T c63211d1d13a4736adb18dee69b400a3 P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:01:59.862485  8602 tablet_bootstrap.cc:492] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P 7b3ea460d1294b8a82672d7c21475cb5: Bootstrap starting.
I20260709 13:01:59.866452  8601 tablet_bootstrap.cc:654] T ae8659e834df408ab36dd56103f10ae4 P b560e9aaec7a4c78b9123b38e73519a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:59.867427  8328 raft_consensus.cc:2468] T 5527a2aef01d45cebcfad8a1b0a5273d P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53a66c851dc74c70b94c65d464a391f6 in term 1.
I20260709 13:01:59.872977  8371 leader_election.cc:304] T 5527a2aef01d45cebcfad8a1b0a5273d P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, 590ee39ce5734876b94d91fc3931b807; no voters: 7b3ea460d1294b8a82672d7c21475cb5
I20260709 13:01:59.881496  8602 tablet_bootstrap.cc:654] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P 7b3ea460d1294b8a82672d7c21475cb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:01:59.875015  8701 raft_consensus.cc:2804] T 5527a2aef01d45cebcfad8a1b0a5273d P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:01:59.884058  8701 raft_consensus.cc:697] T 5527a2aef01d45cebcfad8a1b0a5273d P 53a66c851dc74c70b94c65d464a391f6 [term 1 LEADER]: Becoming Leader. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Running, Role: LEADER
I20260709 13:01:59.885417  8701 consensus_queue.cc:237] T 5527a2aef01d45cebcfad8a1b0a5273d P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:01:59.893563  8661 raft_consensus.cc:493] T 45171bd0207f452f9884a58c225ddb72 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.894344  8661 raft_consensus.cc:515] T 45171bd0207f452f9884a58c225ddb72 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:01:59.898391  8600 ts_tablet_manager.cc:1434] T c63211d1d13a4736adb18dee69b400a3 P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.000s
I20260709 13:01:59.966459  8675 raft_consensus.cc:493] T 6540f8b1e5df49f698558db1af45038b P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:01:59.967204  8675 raft_consensus.cc:515] T 6540f8b1e5df49f698558db1af45038b P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:01:59.967754  8224 catalog_manager.cc:5697] T dbe23b457e664c298f0f2f6c41af32f8 P 53a66c851dc74c70b94c65d464a391f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "53a66c851dc74c70b94c65d464a391f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: UNKNOWN } } }
I20260709 13:01:59.978770  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45171bd0207f452f9884a58c225ddb72" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:01:59.973469  8675 leader_election.cc:290] T 6540f8b1e5df49f698558db1af45038b P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:01:59.980618  8598 tablet_bootstrap.cc:492] T e1f344d27b0b44819ef6d23574175c26 P 53a66c851dc74c70b94c65d464a391f6: No bootstrap required, opened a new log
I20260709 13:01:59.981288  8598 ts_tablet_manager.cc:1403] T e1f344d27b0b44819ef6d23574175c26 P 53a66c851dc74c70b94c65d464a391f6: Time spent bootstrapping tablet: real 0.189s	user 0.015s	sys 0.018s
I20260709 13:01:59.981423  8601 tablet_bootstrap.cc:492] T ae8659e834df408ab36dd56103f10ae4 P b560e9aaec7a4c78b9123b38e73519a3: No bootstrap required, opened a new log
I20260709 13:01:59.981922  8601 ts_tablet_manager.cc:1403] T ae8659e834df408ab36dd56103f10ae4 P b560e9aaec7a4c78b9123b38e73519a3: Time spent bootstrapping tablet: real 0.181s	user 0.009s	sys 0.010s
W20260709 13:01:59.984862  8444 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37751, user_credentials={real_user=slave}} blocked reactor thread for 86606.7us
I20260709 13:01:59.989383  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45171bd0207f452f9884a58c225ddb72" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
I20260709 13:01:59.989825  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6540f8b1e5df49f698558db1af45038b" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
I20260709 13:01:59.990669  8329 raft_consensus.cc:2393] T 6540f8b1e5df49f698558db1af45038b P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7b3ea460d1294b8a82672d7c21475cb5 in current term 1: Already voted for candidate 53a66c851dc74c70b94c65d464a391f6 in this term.
W20260709 13:01:59.990701  8519 leader_election.cc:343] T 45171bd0207f452f9884a58c225ddb72 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:59.976322  8661 leader_election.cc:290] T 45171bd0207f452f9884a58c225ddb72 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:01:59.992463  8601 raft_consensus.cc:359] T ae8659e834df408ab36dd56103f10ae4 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:01:59.993351  8601 raft_consensus.cc:385] T ae8659e834df408ab36dd56103f10ae4 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:59.993634  8601 raft_consensus.cc:740] T ae8659e834df408ab36dd56103f10ae4 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Initialized, Role: FOLLOWER
I20260709 13:01:59.984171  8598 raft_consensus.cc:359] T e1f344d27b0b44819ef6d23574175c26 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:01:59.994638  8598 raft_consensus.cc:385] T e1f344d27b0b44819ef6d23574175c26 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:01:59.994956  8598 raft_consensus.cc:740] T e1f344d27b0b44819ef6d23574175c26 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Initialized, Role: FOLLOWER
I20260709 13:01:59.995756  8598 consensus_queue.cc:260] T e1f344d27b0b44819ef6d23574175c26 P 53a66c851dc74c70b94c65d464a391f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
W20260709 13:01:59.998497  8518 leader_election.cc:343] T 45171bd0207f452f9884a58c225ddb72 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:01:59.998420  8601 consensus_queue.cc:260] T ae8659e834df408ab36dd56103f10ae4 P b560e9aaec7a4c78b9123b38e73519a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:01:59.999075  8518 leader_election.cc:304] T 45171bd0207f452f9884a58c225ddb72 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b560e9aaec7a4c78b9123b38e73519a3; no voters: 53a66c851dc74c70b94c65d464a391f6, 590ee39ce5734876b94d91fc3931b807
I20260709 13:02:00.001446  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6540f8b1e5df49f698558db1af45038b" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:02:00.008649  8735 raft_consensus.cc:2749] T 45171bd0207f452f9884a58c225ddb72 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:00.013352  8600 tablet_bootstrap.cc:492] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:00.014029  8598 ts_tablet_manager.cc:1434] T e1f344d27b0b44819ef6d23574175c26 P 53a66c851dc74c70b94c65d464a391f6: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:02:00.013866  8226 catalog_manager.cc:5697] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P b560e9aaec7a4c78b9123b38e73519a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "b560e9aaec7a4c78b9123b38e73519a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:00.015123  8598 tablet_bootstrap.cc:492] T 45171bd0207f452f9884a58c225ddb72 P 53a66c851dc74c70b94c65d464a391f6: Bootstrap starting.
I20260709 13:02:00.020797  8601 ts_tablet_manager.cc:1434] T ae8659e834df408ab36dd56103f10ae4 P b560e9aaec7a4c78b9123b38e73519a3: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.003s
I20260709 13:02:00.021451  8444 leader_election.cc:304] T 6540f8b1e5df49f698558db1af45038b P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b3ea460d1294b8a82672d7c21475cb5; no voters: 53a66c851dc74c70b94c65d464a391f6, 590ee39ce5734876b94d91fc3931b807
I20260709 13:02:00.025405  8675 raft_consensus.cc:3060] T 6540f8b1e5df49f698558db1af45038b P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:00.028798  8600 tablet_bootstrap.cc:654] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P 590ee39ce5734876b94d91fc3931b807: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:00.033011  8602 tablet_bootstrap.cc:492] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P 7b3ea460d1294b8a82672d7c21475cb5: No bootstrap required, opened a new log
I20260709 13:02:00.033656  8602 ts_tablet_manager.cc:1403] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P 7b3ea460d1294b8a82672d7c21475cb5: Time spent bootstrapping tablet: real 0.171s	user 0.012s	sys 0.011s
I20260709 13:02:00.043496  8598 tablet_bootstrap.cc:654] T 45171bd0207f452f9884a58c225ddb72 P 53a66c851dc74c70b94c65d464a391f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:00.048247  8602 raft_consensus.cc:359] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:00.049048  8602 raft_consensus.cc:385] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:00.049324  8602 raft_consensus.cc:740] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Initialized, Role: FOLLOWER
W20260709 13:02:00.050912  8276 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:00.051894  8602 consensus_queue.cc:260] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P 7b3ea460d1294b8a82672d7c21475cb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:00.052397  8675 raft_consensus.cc:2749] T 6540f8b1e5df49f698558db1af45038b P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:00.057090  8602 ts_tablet_manager.cc:1434] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P 7b3ea460d1294b8a82672d7c21475cb5: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260709 13:02:00.058207  8601 tablet_bootstrap.cc:492] T 5a94bf713e4848879b9e2a1bbec03def P b560e9aaec7a4c78b9123b38e73519a3: Bootstrap starting.
I20260709 13:02:00.058357  8602 tablet_bootstrap.cc:492] T c63211d1d13a4736adb18dee69b400a3 P 7b3ea460d1294b8a82672d7c21475cb5: Bootstrap starting.
I20260709 13:02:00.076859  8598 tablet_bootstrap.cc:492] T 45171bd0207f452f9884a58c225ddb72 P 53a66c851dc74c70b94c65d464a391f6: No bootstrap required, opened a new log
I20260709 13:02:00.077438  8598 ts_tablet_manager.cc:1403] T 45171bd0207f452f9884a58c225ddb72 P 53a66c851dc74c70b94c65d464a391f6: Time spent bootstrapping tablet: real 0.063s	user 0.013s	sys 0.005s
I20260709 13:02:00.082348  8675 raft_consensus.cc:493] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.082916  8675 raft_consensus.cc:515] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:00.085938  8552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8bd38b8a2e4bbd9d07dcf2f1cea143" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3" is_pre_election: true
I20260709 13:02:00.086629  8552 raft_consensus.cc:2468] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b3ea460d1294b8a82672d7c21475cb5 in term 0.
I20260709 13:02:00.085744  8225 catalog_manager.cc:5697] T 6540f8b1e5df49f698558db1af45038b P 53a66c851dc74c70b94c65d464a391f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "53a66c851dc74c70b94c65d464a391f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:00.088097  8443 leader_election.cc:304] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b3ea460d1294b8a82672d7c21475cb5, b560e9aaec7a4c78b9123b38e73519a3; no voters: 
I20260709 13:02:00.088960  8709 raft_consensus.cc:2804] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:00.093219  8709 raft_consensus.cc:493] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:00.093590  8709 raft_consensus.cc:3060] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:00.088418  8225 catalog_manager.cc:5697] T 5527a2aef01d45cebcfad8a1b0a5273d P 53a66c851dc74c70b94c65d464a391f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "53a66c851dc74c70b94c65d464a391f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:00.090605  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8bd38b8a2e4bbd9d07dcf2f1cea143" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
I20260709 13:02:00.097154  8601 tablet_bootstrap.cc:654] T 5a94bf713e4848879b9e2a1bbec03def P b560e9aaec7a4c78b9123b38e73519a3: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:00.098203  8445 leader_election.cc:343] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:00.100118  8602 tablet_bootstrap.cc:654] T c63211d1d13a4736adb18dee69b400a3 P 7b3ea460d1294b8a82672d7c21475cb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:00.090679  8675 leader_election.cc:290] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:02:00.108009  8627 consensus_queue.cc:1048] T da5b0b01a880412896838e8eb658db7a P 7b3ea460d1294b8a82672d7c21475cb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:02:00.100381  8598 raft_consensus.cc:359] T 45171bd0207f452f9884a58c225ddb72 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:00.113551  8598 raft_consensus.cc:385] T 45171bd0207f452f9884a58c225ddb72 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:00.113906  8598 raft_consensus.cc:740] T 45171bd0207f452f9884a58c225ddb72 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.115041  8598 consensus_queue.cc:260] T 45171bd0207f452f9884a58c225ddb72 P 53a66c851dc74c70b94c65d464a391f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:00.118295  8598 ts_tablet_manager.cc:1434] T 45171bd0207f452f9884a58c225ddb72 P 53a66c851dc74c70b94c65d464a391f6: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.000s
I20260709 13:02:00.119689  8598 tablet_bootstrap.cc:492] T ae8659e834df408ab36dd56103f10ae4 P 53a66c851dc74c70b94c65d464a391f6: Bootstrap starting.
I20260709 13:02:00.126091  8227 catalog_manager.cc:5697] T 5095fba09faf47dd939329e762fbc663 P b560e9aaec7a4c78b9123b38e73519a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "b560e9aaec7a4c78b9123b38e73519a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:00.140501  8600 tablet_bootstrap.cc:492] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P 590ee39ce5734876b94d91fc3931b807: No bootstrap required, opened a new log
I20260709 13:02:00.141196  8600 ts_tablet_manager.cc:1403] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.128s	user 0.012s	sys 0.015s
I20260709 13:02:00.131496  8709 raft_consensus.cc:515] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:00.147219  8709 leader_election.cc:290] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 election: Requested vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:02:00.148104  8553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8bd38b8a2e4bbd9d07dcf2f1cea143" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3"
I20260709 13:02:00.148416  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a8bd38b8a2e4bbd9d07dcf2f1cea143" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807"
I20260709 13:02:00.148968  8553 raft_consensus.cc:3060] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:00.151234  8602 tablet_bootstrap.cc:492] T c63211d1d13a4736adb18dee69b400a3 P 7b3ea460d1294b8a82672d7c21475cb5: No bootstrap required, opened a new log
I20260709 13:02:00.144411  8600 raft_consensus.cc:359] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:00.151795  8602 ts_tablet_manager.cc:1403] T c63211d1d13a4736adb18dee69b400a3 P 7b3ea460d1294b8a82672d7c21475cb5: Time spent bootstrapping tablet: real 0.094s	user 0.029s	sys 0.006s
I20260709 13:02:00.152627  8600 raft_consensus.cc:385] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:00.153111  8600 raft_consensus.cc:740] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.154129  8598 tablet_bootstrap.cc:654] T ae8659e834df408ab36dd56103f10ae4 P 53a66c851dc74c70b94c65d464a391f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:00.158007  8735 raft_consensus.cc:493] T 6433163abeff4ee0b011d159ca454a6a P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.158624  8735 raft_consensus.cc:515] T 6433163abeff4ee0b011d159ca454a6a P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:00.165071  8224 catalog_manager.cc:5697] T a1946cc2deaa4799be02943612a39b16 P 590ee39ce5734876b94d91fc3931b807 reported cstate change: term changed from 0 to 1, leader changed from <none> to 590ee39ce5734876b94d91fc3931b807 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "590ee39ce5734876b94d91fc3931b807" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:00.166402  8735 leader_election.cc:290] T 6433163abeff4ee0b011d159ca454a6a P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:02:00.167979  8600 consensus_queue.cc:260] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:00.168928  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6433163abeff4ee0b011d159ca454a6a" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
I20260709 13:02:00.169548  8328 raft_consensus.cc:3060] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:00.170601  8600 ts_tablet_manager.cc:1434] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
W20260709 13:02:00.170528  8518 leader_election.cc:343] T 6433163abeff4ee0b011d159ca454a6a P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:00.171938  8600 tablet_bootstrap.cc:492] T e1f344d27b0b44819ef6d23574175c26 P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:00.172999  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6433163abeff4ee0b011d159ca454a6a" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
I20260709 13:02:00.169222  8601 tablet_bootstrap.cc:492] T 5a94bf713e4848879b9e2a1bbec03def P b560e9aaec7a4c78b9123b38e73519a3: No bootstrap required, opened a new log
W20260709 13:02:00.174485  8519 leader_election.cc:343] T 6433163abeff4ee0b011d159ca454a6a P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:00.174947  8601 ts_tablet_manager.cc:1403] T 5a94bf713e4848879b9e2a1bbec03def P b560e9aaec7a4c78b9123b38e73519a3: Time spent bootstrapping tablet: real 0.117s	user 0.009s	sys 0.010s
I20260709 13:02:00.174978  8519 leader_election.cc:304] T 6433163abeff4ee0b011d159ca454a6a P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b560e9aaec7a4c78b9123b38e73519a3; no voters: 590ee39ce5734876b94d91fc3931b807, 7b3ea460d1294b8a82672d7c21475cb5
I20260709 13:02:00.180315  8600 tablet_bootstrap.cc:654] T e1f344d27b0b44819ef6d23574175c26 P 590ee39ce5734876b94d91fc3931b807: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:00.182924  8735 raft_consensus.cc:2749] T 6433163abeff4ee0b011d159ca454a6a P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:00.188308  8601 raft_consensus.cc:359] T 5a94bf713e4848879b9e2a1bbec03def P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:00.189133  8601 raft_consensus.cc:385] T 5a94bf713e4848879b9e2a1bbec03def P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:00.189417  8601 raft_consensus.cc:740] T 5a94bf713e4848879b9e2a1bbec03def P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.190307  8328 raft_consensus.cc:2468] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b3ea460d1294b8a82672d7c21475cb5 in term 1.
I20260709 13:02:00.190161  8601 consensus_queue.cc:260] T 5a94bf713e4848879b9e2a1bbec03def P b560e9aaec7a4c78b9123b38e73519a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:00.192955  8601 ts_tablet_manager.cc:1434] T 5a94bf713e4848879b9e2a1bbec03def P b560e9aaec7a4c78b9123b38e73519a3: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 13:02:00.193163  8445 leader_election.cc:304] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807, 7b3ea460d1294b8a82672d7c21475cb5; no voters: 
I20260709 13:02:00.194083  8709 raft_consensus.cc:2804] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:00.194643  8709 raft_consensus.cc:697] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 LEADER]: Becoming Leader. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Running, Role: LEADER
I20260709 13:02:00.195199  8660 consensus_queue.cc:1048] T dbe23b457e664c298f0f2f6c41af32f8 P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:00.195573  8709 consensus_queue.cc:237] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P 7b3ea460d1294b8a82672d7c21475cb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:00.200654  8602 raft_consensus.cc:359] T c63211d1d13a4736adb18dee69b400a3 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:00.202586  8602 raft_consensus.cc:385] T c63211d1d13a4736adb18dee69b400a3 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:00.203696  8602 raft_consensus.cc:740] T c63211d1d13a4736adb18dee69b400a3 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.194226  8601 tablet_bootstrap.cc:492] T 7c9804c61fdb47a7958574869d381b72 P b560e9aaec7a4c78b9123b38e73519a3: Bootstrap starting.
I20260709 13:02:00.204493  8602 consensus_queue.cc:260] T c63211d1d13a4736adb18dee69b400a3 P 7b3ea460d1294b8a82672d7c21475cb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:00.188174  8553 raft_consensus.cc:2468] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b3ea460d1294b8a82672d7c21475cb5 in term 1.
I20260709 13:02:00.209148  8602 ts_tablet_manager.cc:1434] T c63211d1d13a4736adb18dee69b400a3 P 7b3ea460d1294b8a82672d7c21475cb5: Time spent starting tablet: real 0.056s	user 0.004s	sys 0.003s
I20260709 13:02:00.230002  8702 consensus_queue.cc:1048] T a1946cc2deaa4799be02943612a39b16 P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:00.230752  8602 tablet_bootstrap.cc:492] T 5095fba09faf47dd939329e762fbc663 P 7b3ea460d1294b8a82672d7c21475cb5: Bootstrap starting.
I20260709 13:02:00.211395  8601 tablet_bootstrap.cc:654] T 7c9804c61fdb47a7958574869d381b72 P b560e9aaec7a4c78b9123b38e73519a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:00.215567  8328 raft_consensus.cc:3060] T da5b0b01a880412896838e8eb658db7a P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:00.227909  8660 consensus_queue.cc:1048] T dbe23b457e664c298f0f2f6c41af32f8 P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:00.229409  8598 tablet_bootstrap.cc:492] T ae8659e834df408ab36dd56103f10ae4 P 53a66c851dc74c70b94c65d464a391f6: No bootstrap required, opened a new log
I20260709 13:02:00.235756  8598 ts_tablet_manager.cc:1403] T ae8659e834df408ab36dd56103f10ae4 P 53a66c851dc74c70b94c65d464a391f6: Time spent bootstrapping tablet: real 0.116s	user 0.012s	sys 0.001s
I20260709 13:02:00.238677  8598 raft_consensus.cc:359] T ae8659e834df408ab36dd56103f10ae4 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:00.239508  8598 raft_consensus.cc:385] T ae8659e834df408ab36dd56103f10ae4 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:00.239907  8598 raft_consensus.cc:740] T ae8659e834df408ab36dd56103f10ae4 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.240938  8598 consensus_queue.cc:260] T ae8659e834df408ab36dd56103f10ae4 P 53a66c851dc74c70b94c65d464a391f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:00.243891  8709 raft_consensus.cc:493] T c63211d1d13a4736adb18dee69b400a3 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.248121  8709 raft_consensus.cc:515] T c63211d1d13a4736adb18dee69b400a3 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:00.250566  8709 leader_election.cc:290] T c63211d1d13a4736adb18dee69b400a3 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:02:00.251562  8598 ts_tablet_manager.cc:1434] T ae8659e834df408ab36dd56103f10ae4 P 53a66c851dc74c70b94c65d464a391f6: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 13:02:00.252825  8598 tablet_bootstrap.cc:492] T 5a94bf713e4848879b9e2a1bbec03def P 53a66c851dc74c70b94c65d464a391f6: Bootstrap starting.
I20260709 13:02:00.252732  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63211d1d13a4736adb18dee69b400a3" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
I20260709 13:02:00.253621  8327 raft_consensus.cc:2468] T c63211d1d13a4736adb18dee69b400a3 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b3ea460d1294b8a82672d7c21475cb5 in term 0.
I20260709 13:02:00.253713  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63211d1d13a4736adb18dee69b400a3" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:02:00.255062  8445 leader_election.cc:304] T c63211d1d13a4736adb18dee69b400a3 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807, 7b3ea460d1294b8a82672d7c21475cb5; no voters: 
I20260709 13:02:00.244902  8660 raft_consensus.cc:493] T c63211d1d13a4736adb18dee69b400a3 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.256708  8709 raft_consensus.cc:2804] T c63211d1d13a4736adb18dee69b400a3 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:00.256125  8660 raft_consensus.cc:515] T c63211d1d13a4736adb18dee69b400a3 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:00.260006  8405 raft_consensus.cc:2468] T c63211d1d13a4736adb18dee69b400a3 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b3ea460d1294b8a82672d7c21475cb5 in term 0.
I20260709 13:02:00.257953  8709 raft_consensus.cc:493] T c63211d1d13a4736adb18dee69b400a3 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:00.262006  8709 raft_consensus.cc:3060] T c63211d1d13a4736adb18dee69b400a3 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:00.262586  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63211d1d13a4736adb18dee69b400a3" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
I20260709 13:02:00.263253  8327 raft_consensus.cc:2468] T c63211d1d13a4736adb18dee69b400a3 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53a66c851dc74c70b94c65d464a391f6 in term 0.
I20260709 13:02:00.264408  8371 leader_election.cc:304] T c63211d1d13a4736adb18dee69b400a3 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, 590ee39ce5734876b94d91fc3931b807; no voters: 
I20260709 13:02:00.265640  8607 raft_consensus.cc:2804] T c63211d1d13a4736adb18dee69b400a3 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:00.266027  8607 raft_consensus.cc:493] T c63211d1d13a4736adb18dee69b400a3 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:00.266391  8607 raft_consensus.cc:3060] T c63211d1d13a4736adb18dee69b400a3 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:00.270677  8735 consensus_queue.cc:1048] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:00.247521  8602 tablet_bootstrap.cc:654] T 5095fba09faf47dd939329e762fbc663 P 7b3ea460d1294b8a82672d7c21475cb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:00.270987  8709 raft_consensus.cc:515] T c63211d1d13a4736adb18dee69b400a3 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:00.273061  8600 tablet_bootstrap.cc:492] T e1f344d27b0b44819ef6d23574175c26 P 590ee39ce5734876b94d91fc3931b807: No bootstrap required, opened a new log
I20260709 13:02:00.273597  8600 ts_tablet_manager.cc:1403] T e1f344d27b0b44819ef6d23574175c26 P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.102s	user 0.012s	sys 0.008s
I20260709 13:02:00.275640  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63211d1d13a4736adb18dee69b400a3" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807"
I20260709 13:02:00.276314  8330 raft_consensus.cc:3060] T c63211d1d13a4736adb18dee69b400a3 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:00.281178  8660 leader_election.cc:290] T c63211d1d13a4736adb18dee69b400a3 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:02:00.282941  8477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63211d1d13a4736adb18dee69b400a3" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
I20260709 13:02:00.282923  8600 raft_consensus.cc:359] T e1f344d27b0b44819ef6d23574175c26 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:00.283500  8607 raft_consensus.cc:515] T c63211d1d13a4736adb18dee69b400a3 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:00.284003  8477 raft_consensus.cc:2393] T c63211d1d13a4736adb18dee69b400a3 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 53a66c851dc74c70b94c65d464a391f6 in current term 1: Already voted for candidate 7b3ea460d1294b8a82672d7c21475cb5 in this term.
I20260709 13:02:00.284034  8600 raft_consensus.cc:385] T e1f344d27b0b44819ef6d23574175c26 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:00.288031  8600 raft_consensus.cc:740] T e1f344d27b0b44819ef6d23574175c26 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.293557  8651 consensus_queue.cc:1048] T da5b0b01a880412896838e8eb658db7a P 7b3ea460d1294b8a82672d7c21475cb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:00.296940  8705 raft_consensus.cc:493] T da5b0b01a880412896838e8eb658db7a P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.297783  8607 leader_election.cc:290] T c63211d1d13a4736adb18dee69b400a3 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 election: Requested vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:02:00.297575  8705 raft_consensus.cc:515] T da5b0b01a880412896838e8eb658db7a P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:00.298734  8709 leader_election.cc:290] T c63211d1d13a4736adb18dee69b400a3 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 election: Requested vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:02:00.275637  8225 catalog_manager.cc:5697] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P 7b3ea460d1294b8a82672d7c21475cb5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "7b3ea460d1294b8a82672d7c21475cb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:00.302549  8602 tablet_bootstrap.cc:492] T 5095fba09faf47dd939329e762fbc663 P 7b3ea460d1294b8a82672d7c21475cb5: No bootstrap required, opened a new log
I20260709 13:02:00.301009  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63211d1d13a4736adb18dee69b400a3" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807"
I20260709 13:02:00.303068  8602 ts_tablet_manager.cc:1403] T 5095fba09faf47dd939329e762fbc663 P 7b3ea460d1294b8a82672d7c21475cb5: Time spent bootstrapping tablet: real 0.073s	user 0.015s	sys 0.005s
I20260709 13:02:00.306098  8602 raft_consensus.cc:359] T 5095fba09faf47dd939329e762fbc663 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:00.306828  8602 raft_consensus.cc:385] T 5095fba09faf47dd939329e762fbc663 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:00.307119  8602 raft_consensus.cc:740] T 5095fba09faf47dd939329e762fbc663 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.307840  8602 consensus_queue.cc:260] T 5095fba09faf47dd939329e762fbc663 P 7b3ea460d1294b8a82672d7c21475cb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:00.310148  8602 ts_tablet_manager.cc:1434] T 5095fba09faf47dd939329e762fbc663 P 7b3ea460d1294b8a82672d7c21475cb5: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:02:00.310731  8477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63211d1d13a4736adb18dee69b400a3" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5"
I20260709 13:02:00.311388  8602 tablet_bootstrap.cc:492] T 6433163abeff4ee0b011d159ca454a6a P 7b3ea460d1294b8a82672d7c21475cb5: Bootstrap starting.
I20260709 13:02:00.311591  8477 raft_consensus.cc:2393] T c63211d1d13a4736adb18dee69b400a3 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 53a66c851dc74c70b94c65d464a391f6 in current term 1: Already voted for candidate 7b3ea460d1294b8a82672d7c21475cb5 in this term.
I20260709 13:02:00.312744  8682 consensus_queue.cc:1048] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:00.319700  8602 tablet_bootstrap.cc:654] T 6433163abeff4ee0b011d159ca454a6a P 7b3ea460d1294b8a82672d7c21475cb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:00.320845  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c63211d1d13a4736adb18dee69b400a3" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6"
I20260709 13:02:00.321868  8402 raft_consensus.cc:2393] T c63211d1d13a4736adb18dee69b400a3 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7b3ea460d1294b8a82672d7c21475cb5 in current term 1: Already voted for candidate 53a66c851dc74c70b94c65d464a391f6 in this term.
I20260709 13:02:00.323348  8600 consensus_queue.cc:260] T e1f344d27b0b44819ef6d23574175c26 P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:00.324409  8598 tablet_bootstrap.cc:654] T 5a94bf713e4848879b9e2a1bbec03def P 53a66c851dc74c70b94c65d464a391f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:00.331542  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5b0b01a880412896838e8eb658db7a" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
I20260709 13:02:00.332716  8371 leader_election.cc:304] T c63211d1d13a4736adb18dee69b400a3 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6; no voters: 590ee39ce5734876b94d91fc3931b807, 7b3ea460d1294b8a82672d7c21475cb5
I20260709 13:02:00.301254  8330 raft_consensus.cc:2468] T c63211d1d13a4736adb18dee69b400a3 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b3ea460d1294b8a82672d7c21475cb5 in term 1.
I20260709 13:02:00.336275  8445 leader_election.cc:304] T c63211d1d13a4736adb18dee69b400a3 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807, 7b3ea460d1294b8a82672d7c21475cb5; no voters: 53a66c851dc74c70b94c65d464a391f6
I20260709 13:02:00.337119  8705 leader_election.cc:290] T da5b0b01a880412896838e8eb658db7a P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429), b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503)
I20260709 13:02:00.338699  8705 consensus_queue.cc:1048] T a1946cc2deaa4799be02943612a39b16 P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:00.344376  8682 raft_consensus.cc:493] T ae8659e834df408ab36dd56103f10ae4 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.347896  8551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5b0b01a880412896838e8eb658db7a" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3" is_pre_election: true
I20260709 13:02:00.348242  8682 raft_consensus.cc:515] T ae8659e834df408ab36dd56103f10ae4 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:00.350677  8682 leader_election.cc:290] T ae8659e834df408ab36dd56103f10ae4 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:02:00.346873  8709 raft_consensus.cc:2804] T c63211d1d13a4736adb18dee69b400a3 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:00.344965  8607 raft_consensus.cc:2749] T c63211d1d13a4736adb18dee69b400a3 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:02:00.351636  8709 raft_consensus.cc:697] T c63211d1d13a4736adb18dee69b400a3 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 LEADER]: Becoming Leader. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Running, Role: LEADER
I20260709 13:02:00.352591  8294 leader_election.cc:304] T da5b0b01a880412896838e8eb658db7a P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807; no voters: 7b3ea460d1294b8a82672d7c21475cb5, b560e9aaec7a4c78b9123b38e73519a3
I20260709 13:02:00.352883  8709 consensus_queue.cc:237] T c63211d1d13a4736adb18dee69b400a3 P 7b3ea460d1294b8a82672d7c21475cb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:00.357852  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae8659e834df408ab36dd56103f10ae4" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
W20260709 13:02:00.359756  8518 leader_election.cc:343] T ae8659e834df408ab36dd56103f10ae4 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:00.361411  8479 raft_consensus.cc:3060] T 5095fba09faf47dd939329e762fbc663 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:00.367592  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae8659e834df408ab36dd56103f10ae4" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:02:00.368887  8405 raft_consensus.cc:2468] T ae8659e834df408ab36dd56103f10ae4 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 0.
I20260709 13:02:00.369868  8608 raft_consensus.cc:2749] T da5b0b01a880412896838e8eb658db7a P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:00.372881  8607 raft_consensus.cc:493] T e1f344d27b0b44819ef6d23574175c26 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.373415  8607 raft_consensus.cc:515] T e1f344d27b0b44819ef6d23574175c26 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:00.378401  8607 leader_election.cc:290] T e1f344d27b0b44819ef6d23574175c26 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:02:00.380160  8600 ts_tablet_manager.cc:1434] T e1f344d27b0b44819ef6d23574175c26 P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.106s	user 0.010s	sys 0.000s
I20260709 13:02:00.382225  8551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f344d27b0b44819ef6d23574175c26" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3" is_pre_election: true
I20260709 13:02:00.382951  8551 raft_consensus.cc:2468] T e1f344d27b0b44819ef6d23574175c26 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53a66c851dc74c70b94c65d464a391f6 in term 0.
I20260709 13:02:00.383162  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f344d27b0b44819ef6d23574175c26" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
I20260709 13:02:00.383811  8330 raft_consensus.cc:2468] T e1f344d27b0b44819ef6d23574175c26 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53a66c851dc74c70b94c65d464a391f6 in term 0.
I20260709 13:02:00.384213  8369 leader_election.cc:304] T e1f344d27b0b44819ef6d23574175c26 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, b560e9aaec7a4c78b9123b38e73519a3; no voters: 
I20260709 13:02:00.385149  8518 leader_election.cc:304] T ae8659e834df408ab36dd56103f10ae4 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, b560e9aaec7a4c78b9123b38e73519a3; no voters: 7b3ea460d1294b8a82672d7c21475cb5
I20260709 13:02:00.385532  8607 raft_consensus.cc:2804] T e1f344d27b0b44819ef6d23574175c26 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:00.386003  8607 raft_consensus.cc:493] T e1f344d27b0b44819ef6d23574175c26 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:00.387806  8607 raft_consensus.cc:3060] T e1f344d27b0b44819ef6d23574175c26 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:00.390762  8682 raft_consensus.cc:2804] T ae8659e834df408ab36dd56103f10ae4 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:00.391366  8682 raft_consensus.cc:493] T ae8659e834df408ab36dd56103f10ae4 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:00.391873  8682 raft_consensus.cc:3060] T ae8659e834df408ab36dd56103f10ae4 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:00.392133  8660 consensus_queue.cc:1048] T 6540f8b1e5df49f698558db1af45038b P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:00.395196  8607 raft_consensus.cc:515] T e1f344d27b0b44819ef6d23574175c26 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:00.399506  8717 consensus_queue.cc:1048] T 5095fba09faf47dd939329e762fbc663 P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:00.406424  8553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f344d27b0b44819ef6d23574175c26" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3"
I20260709 13:02:00.407047  8553 raft_consensus.cc:3060] T e1f344d27b0b44819ef6d23574175c26 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:00.412550  8601 tablet_bootstrap.cc:492] T 7c9804c61fdb47a7958574869d381b72 P b560e9aaec7a4c78b9123b38e73519a3: No bootstrap required, opened a new log
I20260709 13:02:00.413074  8601 ts_tablet_manager.cc:1403] T 7c9804c61fdb47a7958574869d381b72 P b560e9aaec7a4c78b9123b38e73519a3: Time spent bootstrapping tablet: real 0.219s	user 0.013s	sys 0.021s
I20260709 13:02:00.430045  8601 raft_consensus.cc:359] T 7c9804c61fdb47a7958574869d381b72 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:00.430790  8601 raft_consensus.cc:385] T 7c9804c61fdb47a7958574869d381b72 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:00.431069  8601 raft_consensus.cc:740] T 7c9804c61fdb47a7958574869d381b72 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.431748  8601 consensus_queue.cc:260] T 7c9804c61fdb47a7958574869d381b72 P b560e9aaec7a4c78b9123b38e73519a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:00.435395  8601 ts_tablet_manager.cc:1434] T 7c9804c61fdb47a7958574869d381b72 P b560e9aaec7a4c78b9123b38e73519a3: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:02:00.435113  8682 raft_consensus.cc:515] T ae8659e834df408ab36dd56103f10ae4 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:00.436841  8601 tablet_bootstrap.cc:492] T a79ccdf7d9cf4be7bf8b0c69bf90538a P b560e9aaec7a4c78b9123b38e73519a3: Bootstrap starting.
I20260709 13:02:00.433041  8717 raft_consensus.cc:493] T 5a94bf713e4848879b9e2a1bbec03def P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.439702  8607 leader_election.cc:290] T e1f344d27b0b44819ef6d23574175c26 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 election: Requested vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:02:00.440409  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae8659e834df408ab36dd56103f10ae4" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6"
I20260709 13:02:00.441018  8405 raft_consensus.cc:3060] T ae8659e834df408ab36dd56103f10ae4 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:00.441227  8553 raft_consensus.cc:2468] T e1f344d27b0b44819ef6d23574175c26 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53a66c851dc74c70b94c65d464a391f6 in term 1.
I20260709 13:02:00.441923  8607 consensus_queue.cc:1048] T 6540f8b1e5df49f698558db1af45038b P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:00.445462  8369 leader_election.cc:304] T e1f344d27b0b44819ef6d23574175c26 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, b560e9aaec7a4c78b9123b38e73519a3; no voters: 
I20260709 13:02:00.446476  8607 raft_consensus.cc:2804] T e1f344d27b0b44819ef6d23574175c26 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:00.447213  8607 raft_consensus.cc:697] T e1f344d27b0b44819ef6d23574175c26 P 53a66c851dc74c70b94c65d464a391f6 [term 1 LEADER]: Becoming Leader. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Running, Role: LEADER
I20260709 13:02:00.449230  8600 tablet_bootstrap.cc:492] T 45171bd0207f452f9884a58c225ddb72 P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
W20260709 13:02:00.453931  8757 log.cc:927] Time spent T da5b0b01a880412896838e8eb658db7a P 590ee39ce5734876b94d91fc3931b807: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 13:02:00.449150  8717 raft_consensus.cc:515] T 5a94bf713e4848879b9e2a1bbec03def P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:00.462950  8598 tablet_bootstrap.cc:492] T 5a94bf713e4848879b9e2a1bbec03def P 53a66c851dc74c70b94c65d464a391f6: No bootstrap required, opened a new log
I20260709 13:02:00.463203  8660 raft_consensus.cc:493] T 45171bd0207f452f9884a58c225ddb72 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.463478  8598 ts_tablet_manager.cc:1403] T 5a94bf713e4848879b9e2a1bbec03def P 53a66c851dc74c70b94c65d464a391f6: Time spent bootstrapping tablet: real 0.211s	user 0.025s	sys 0.020s
I20260709 13:02:00.463672  8660 raft_consensus.cc:515] T 45171bd0207f452f9884a58c225ddb72 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:00.466358  8598 raft_consensus.cc:359] T 5a94bf713e4848879b9e2a1bbec03def P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:00.467123  8598 raft_consensus.cc:385] T 5a94bf713e4848879b9e2a1bbec03def P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:00.467397  8598 raft_consensus.cc:740] T 5a94bf713e4848879b9e2a1bbec03def P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.468277  8598 consensus_queue.cc:260] T 5a94bf713e4848879b9e2a1bbec03def P 53a66c851dc74c70b94c65d464a391f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:00.468839  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a94bf713e4848879b9e2a1bbec03def" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:02:00.452037  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1f344d27b0b44819ef6d23574175c26" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807"
I20260709 13:02:00.469509  8402 raft_consensus.cc:2468] T 5a94bf713e4848879b9e2a1bbec03def P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 0.
I20260709 13:02:00.469830  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a94bf713e4848879b9e2a1bbec03def" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
W20260709 13:02:00.471585  8519 leader_election.cc:343] T 5a94bf713e4848879b9e2a1bbec03def P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:00.473609  8598 ts_tablet_manager.cc:1434] T 5a94bf713e4848879b9e2a1bbec03def P 53a66c851dc74c70b94c65d464a391f6: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:02:00.474205  8602 tablet_bootstrap.cc:492] T 6433163abeff4ee0b011d159ca454a6a P 7b3ea460d1294b8a82672d7c21475cb5: No bootstrap required, opened a new log
I20260709 13:02:00.464247  8717 leader_election.cc:290] T 5a94bf713e4848879b9e2a1bbec03def P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:02:00.474710  8602 ts_tablet_manager.cc:1403] T 6433163abeff4ee0b011d159ca454a6a P 7b3ea460d1294b8a82672d7c21475cb5: Time spent bootstrapping tablet: real 0.164s	user 0.015s	sys 0.006s
I20260709 13:02:00.474640  8660 leader_election.cc:290] T 45171bd0207f452f9884a58c225ddb72 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:02:00.474673  8598 tablet_bootstrap.cc:492] T a3a46de7366f4683a88d19d25ad04901 P 53a66c851dc74c70b94c65d464a391f6: Bootstrap starting.
I20260709 13:02:00.480180  8602 raft_consensus.cc:359] T 6433163abeff4ee0b011d159ca454a6a P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:00.480921  8602 raft_consensus.cc:385] T 6433163abeff4ee0b011d159ca454a6a P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:00.481184  8602 raft_consensus.cc:740] T 6433163abeff4ee0b011d159ca454a6a P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.481465  8553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45171bd0207f452f9884a58c225ddb72" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3" is_pre_election: true
I20260709 13:02:00.481865  8602 consensus_queue.cc:260] T 6433163abeff4ee0b011d159ca454a6a P 7b3ea460d1294b8a82672d7c21475cb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:00.484030  8602 ts_tablet_manager.cc:1434] T 6433163abeff4ee0b011d159ca454a6a P 7b3ea460d1294b8a82672d7c21475cb5: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:02:00.485025  8602 tablet_bootstrap.cc:492] T 7c9804c61fdb47a7958574869d381b72 P 7b3ea460d1294b8a82672d7c21475cb5: Bootstrap starting.
I20260709 13:02:00.487202  8405 raft_consensus.cc:2468] T ae8659e834df408ab36dd56103f10ae4 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 1.
I20260709 13:02:00.482344  8600 tablet_bootstrap.cc:654] T 45171bd0207f452f9884a58c225ddb72 P 590ee39ce5734876b94d91fc3931b807: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:00.482168  8553 raft_consensus.cc:2468] T 45171bd0207f452f9884a58c225ddb72 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53a66c851dc74c70b94c65d464a391f6 in term 0.
I20260709 13:02:00.469928  8327 raft_consensus.cc:3060] T e1f344d27b0b44819ef6d23574175c26 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:00.490670  8682 leader_election.cc:290] T ae8659e834df408ab36dd56103f10ae4 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 election: Requested vote from peers 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:02:00.490926  8602 tablet_bootstrap.cc:654] T 7c9804c61fdb47a7958574869d381b72 P 7b3ea460d1294b8a82672d7c21475cb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:00.495210  8518 leader_election.cc:304] T 5a94bf713e4848879b9e2a1bbec03def P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, b560e9aaec7a4c78b9123b38e73519a3; no voters: 590ee39ce5734876b94d91fc3931b807
I20260709 13:02:00.497428  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45171bd0207f452f9884a58c225ddb72" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
W20260709 13:02:00.499430  8371 leader_election.cc:343] T 45171bd0207f452f9884a58c225ddb72 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:00.500936  8369 leader_election.cc:304] T 45171bd0207f452f9884a58c225ddb72 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, b560e9aaec7a4c78b9123b38e73519a3; no voters: 590ee39ce5734876b94d91fc3931b807
I20260709 13:02:00.502403  8660 raft_consensus.cc:2804] T 45171bd0207f452f9884a58c225ddb72 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:00.502780  8660 raft_consensus.cc:493] T 45171bd0207f452f9884a58c225ddb72 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:00.503144  8660 raft_consensus.cc:3060] T 45171bd0207f452f9884a58c225ddb72 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:00.502986  8708 consensus_queue.cc:1048] T 5527a2aef01d45cebcfad8a1b0a5273d P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:00.509831  8607 consensus_queue.cc:237] T e1f344d27b0b44819ef6d23574175c26 P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:00.495203  8601 tablet_bootstrap.cc:654] T a79ccdf7d9cf4be7bf8b0c69bf90538a P b560e9aaec7a4c78b9123b38e73519a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:00.559893  8708 consensus_queue.cc:1048] T 5527a2aef01d45cebcfad8a1b0a5273d P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:00.561267  8682 raft_consensus.cc:2804] T 5a94bf713e4848879b9e2a1bbec03def P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:00.561899  8682 raft_consensus.cc:493] T 5a94bf713e4848879b9e2a1bbec03def P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:00.562354  8682 raft_consensus.cc:3060] T 5a94bf713e4848879b9e2a1bbec03def P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:00.569772  8518 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37751, user_credentials={real_user=slave}} blocked reactor thread for 75386us
I20260709 13:02:00.571641  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae8659e834df408ab36dd56103f10ae4" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5"
I20260709 13:02:00.568091  8227 catalog_manager.cc:5697] T c63211d1d13a4736adb18dee69b400a3 P 7b3ea460d1294b8a82672d7c21475cb5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "7b3ea460d1294b8a82672d7c21475cb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:00.589056  8600 tablet_bootstrap.cc:492] T 45171bd0207f452f9884a58c225ddb72 P 590ee39ce5734876b94d91fc3931b807: No bootstrap required, opened a new log
I20260709 13:02:00.589852  8600 ts_tablet_manager.cc:1403] T 45171bd0207f452f9884a58c225ddb72 P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.152s	user 0.020s	sys 0.000s
I20260709 13:02:00.591115  8712 consensus_queue.cc:1048] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P 7b3ea460d1294b8a82672d7c21475cb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:00.591392  8327 raft_consensus.cc:2468] T e1f344d27b0b44819ef6d23574175c26 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53a66c851dc74c70b94c65d464a391f6 in term 1.
I20260709 13:02:00.598345  8598 tablet_bootstrap.cc:654] T a3a46de7366f4683a88d19d25ad04901 P 53a66c851dc74c70b94c65d464a391f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:00.599179  8602 tablet_bootstrap.cc:492] T 7c9804c61fdb47a7958574869d381b72 P 7b3ea460d1294b8a82672d7c21475cb5: No bootstrap required, opened a new log
I20260709 13:02:00.599754  8602 ts_tablet_manager.cc:1403] T 7c9804c61fdb47a7958574869d381b72 P 7b3ea460d1294b8a82672d7c21475cb5: Time spent bootstrapping tablet: real 0.115s	user 0.021s	sys 0.030s
I20260709 13:02:00.601248  8600 raft_consensus.cc:359] T 45171bd0207f452f9884a58c225ddb72 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:00.601985  8600 raft_consensus.cc:385] T 45171bd0207f452f9884a58c225ddb72 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:00.602257  8600 raft_consensus.cc:740] T 45171bd0207f452f9884a58c225ddb72 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.603052  8600 consensus_queue.cc:260] T 45171bd0207f452f9884a58c225ddb72 P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:00.605378  8600 ts_tablet_manager.cc:1434] T 45171bd0207f452f9884a58c225ddb72 P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:02:00.604895  8682 raft_consensus.cc:515] T 5a94bf713e4848879b9e2a1bbec03def P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:00.611816  8602 raft_consensus.cc:359] T 7c9804c61fdb47a7958574869d381b72 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:00.612649  8602 raft_consensus.cc:385] T 7c9804c61fdb47a7958574869d381b72 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:00.612933  8602 raft_consensus.cc:740] T 7c9804c61fdb47a7958574869d381b72 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.615549  8682 leader_election.cc:290] T 5a94bf713e4848879b9e2a1bbec03def P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 election: Requested vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:02:00.613636  8602 consensus_queue.cc:260] T 7c9804c61fdb47a7958574869d381b72 P 7b3ea460d1294b8a82672d7c21475cb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:00.606547  8600 tablet_bootstrap.cc:492] T 8b0d84add64c4f5db82c90e98b7f4b74 P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:00.620045  8602 ts_tablet_manager.cc:1434] T 7c9804c61fdb47a7958574869d381b72 P 7b3ea460d1294b8a82672d7c21475cb5: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.004s
I20260709 13:02:00.621284  8602 tablet_bootstrap.cc:492] T a79ccdf7d9cf4be7bf8b0c69bf90538a P 7b3ea460d1294b8a82672d7c21475cb5: Bootstrap starting.
I20260709 13:02:00.625322  8600 tablet_bootstrap.cc:654] T 8b0d84add64c4f5db82c90e98b7f4b74 P 590ee39ce5734876b94d91fc3931b807: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:00.627987  8627 consensus_queue.cc:1048] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P 7b3ea460d1294b8a82672d7c21475cb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 13:02:00.575336  8518 leader_election.cc:343] T ae8659e834df408ab36dd56103f10ae4 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:00.633260  8602 tablet_bootstrap.cc:654] T a79ccdf7d9cf4be7bf8b0c69bf90538a P 7b3ea460d1294b8a82672d7c21475cb5: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:00.634107  8518 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45429, user_credentials={real_user=slave}} blocked reactor thread for 58318us
I20260709 13:02:00.639611  8518 leader_election.cc:304] T ae8659e834df408ab36dd56103f10ae4 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, b560e9aaec7a4c78b9123b38e73519a3; no voters: 7b3ea460d1294b8a82672d7c21475cb5
I20260709 13:02:00.637809  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a94bf713e4848879b9e2a1bbec03def" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807"
W20260709 13:02:00.647514  8519 leader_election.cc:343] T 5a94bf713e4848879b9e2a1bbec03def P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:00.648175  8717 consensus_queue.cc:1048] T 5095fba09faf47dd939329e762fbc663 P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:00.645275  8682 raft_consensus.cc:2804] T ae8659e834df408ab36dd56103f10ae4 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:00.649794  8682 raft_consensus.cc:697] T ae8659e834df408ab36dd56103f10ae4 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Becoming Leader. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Running, Role: LEADER
I20260709 13:02:00.650738  8682 consensus_queue.cc:237] T ae8659e834df408ab36dd56103f10ae4 P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:00.655468  8660 raft_consensus.cc:515] T 45171bd0207f452f9884a58c225ddb72 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:00.658730  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a94bf713e4848879b9e2a1bbec03def" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6"
I20260709 13:02:00.659289  8402 raft_consensus.cc:3060] T 5a94bf713e4848879b9e2a1bbec03def P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:00.658546  8224 catalog_manager.cc:5697] T e1f344d27b0b44819ef6d23574175c26 P 53a66c851dc74c70b94c65d464a391f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "53a66c851dc74c70b94c65d464a391f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:00.661106  8550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45171bd0207f452f9884a58c225ddb72" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3"
I20260709 13:02:00.662029  8550 raft_consensus.cc:3060] T 45171bd0207f452f9884a58c225ddb72 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:00.675261  8608 raft_consensus.cc:493] T 45171bd0207f452f9884a58c225ddb72 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.675866  8608 raft_consensus.cc:515] T 45171bd0207f452f9884a58c225ddb72 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:00.678117  8608 leader_election.cc:290] T 45171bd0207f452f9884a58c225ddb72 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:02:00.686973  8550 raft_consensus.cc:2468] T 45171bd0207f452f9884a58c225ddb72 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53a66c851dc74c70b94c65d464a391f6 in term 1.
I20260709 13:02:00.687975  8551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45171bd0207f452f9884a58c225ddb72" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3" is_pre_election: true
I20260709 13:02:00.688999  8551 raft_consensus.cc:2393] T 45171bd0207f452f9884a58c225ddb72 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 590ee39ce5734876b94d91fc3931b807 in current term 1: Already voted for candidate 53a66c851dc74c70b94c65d464a391f6 in this term.
I20260709 13:02:00.690379  8369 leader_election.cc:304] T 45171bd0207f452f9884a58c225ddb72 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, b560e9aaec7a4c78b9123b38e73519a3; no voters: 
I20260709 13:02:00.687080  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45171bd0207f452f9884a58c225ddb72" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:02:00.691236  8607 raft_consensus.cc:2804] T 45171bd0207f452f9884a58c225ddb72 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:00.691859  8607 raft_consensus.cc:697] T 45171bd0207f452f9884a58c225ddb72 P 53a66c851dc74c70b94c65d464a391f6 [term 1 LEADER]: Becoming Leader. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Running, Role: LEADER
I20260709 13:02:00.693536  8402 raft_consensus.cc:2468] T 5a94bf713e4848879b9e2a1bbec03def P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 1.
I20260709 13:02:00.693069  8607 consensus_queue.cc:237] T 45171bd0207f452f9884a58c225ddb72 P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:00.695444  8518 leader_election.cc:304] T 5a94bf713e4848879b9e2a1bbec03def P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, b560e9aaec7a4c78b9123b38e73519a3; no voters: 590ee39ce5734876b94d91fc3931b807
I20260709 13:02:00.697341  8660 leader_election.cc:290] T 45171bd0207f452f9884a58c225ddb72 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 election: Requested vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:02:00.698429  8717 raft_consensus.cc:2804] T 5a94bf713e4848879b9e2a1bbec03def P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:00.698529  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45171bd0207f452f9884a58c225ddb72" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807"
I20260709 13:02:00.699048  8717 raft_consensus.cc:697] T 5a94bf713e4848879b9e2a1bbec03def P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Becoming Leader. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Running, Role: LEADER
I20260709 13:02:00.699407  8329 raft_consensus.cc:3060] T 45171bd0207f452f9884a58c225ddb72 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:00.700045  8717 consensus_queue.cc:237] T 5a94bf713e4848879b9e2a1bbec03def P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:00.705040  8601 tablet_bootstrap.cc:492] T a79ccdf7d9cf4be7bf8b0c69bf90538a P b560e9aaec7a4c78b9123b38e73519a3: No bootstrap required, opened a new log
I20260709 13:02:00.705605  8601 ts_tablet_manager.cc:1403] T a79ccdf7d9cf4be7bf8b0c69bf90538a P b560e9aaec7a4c78b9123b38e73519a3: Time spent bootstrapping tablet: real 0.269s	user 0.013s	sys 0.005s
I20260709 13:02:00.708156  8598 tablet_bootstrap.cc:492] T a3a46de7366f4683a88d19d25ad04901 P 53a66c851dc74c70b94c65d464a391f6: No bootstrap required, opened a new log
I20260709 13:02:00.708735  8598 ts_tablet_manager.cc:1403] T a3a46de7366f4683a88d19d25ad04901 P 53a66c851dc74c70b94c65d464a391f6: Time spent bootstrapping tablet: real 0.234s	user 0.021s	sys 0.012s
I20260709 13:02:00.708441  8601 raft_consensus.cc:359] T a79ccdf7d9cf4be7bf8b0c69bf90538a P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:00.709160  8601 raft_consensus.cc:385] T a79ccdf7d9cf4be7bf8b0c69bf90538a P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:00.709467  8601 raft_consensus.cc:740] T a79ccdf7d9cf4be7bf8b0c69bf90538a P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.710152  8601 consensus_queue.cc:260] T a79ccdf7d9cf4be7bf8b0c69bf90538a P b560e9aaec7a4c78b9123b38e73519a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:00.712347  8601 ts_tablet_manager.cc:1434] T a79ccdf7d9cf4be7bf8b0c69bf90538a P b560e9aaec7a4c78b9123b38e73519a3: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:02:00.714619  8600 tablet_bootstrap.cc:492] T 8b0d84add64c4f5db82c90e98b7f4b74 P 590ee39ce5734876b94d91fc3931b807: No bootstrap required, opened a new log
I20260709 13:02:00.715116  8600 ts_tablet_manager.cc:1403] T 8b0d84add64c4f5db82c90e98b7f4b74 P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.109s	user 0.007s	sys 0.004s
I20260709 13:02:00.715973  8598 raft_consensus.cc:359] T a3a46de7366f4683a88d19d25ad04901 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:00.716710  8598 raft_consensus.cc:385] T a3a46de7366f4683a88d19d25ad04901 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:00.716969  8598 raft_consensus.cc:740] T a3a46de7366f4683a88d19d25ad04901 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.717865  8600 raft_consensus.cc:359] T 8b0d84add64c4f5db82c90e98b7f4b74 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:00.718585  8600 raft_consensus.cc:385] T 8b0d84add64c4f5db82c90e98b7f4b74 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:00.718835  8600 raft_consensus.cc:740] T 8b0d84add64c4f5db82c90e98b7f4b74 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.720150  8600 consensus_queue.cc:260] T 8b0d84add64c4f5db82c90e98b7f4b74 P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:00.720996  8598 consensus_queue.cc:260] T a3a46de7366f4683a88d19d25ad04901 P 53a66c851dc74c70b94c65d464a391f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:00.722256  8600 ts_tablet_manager.cc:1434] T 8b0d84add64c4f5db82c90e98b7f4b74 P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:02:00.723390  8600 tablet_bootstrap.cc:492] T 6433163abeff4ee0b011d159ca454a6a P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:00.723840  8601 tablet_bootstrap.cc:492] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P b560e9aaec7a4c78b9123b38e73519a3: Bootstrap starting.
I20260709 13:02:00.726830  8598 ts_tablet_manager.cc:1434] T a3a46de7366f4683a88d19d25ad04901 P 53a66c851dc74c70b94c65d464a391f6: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 13:02:00.727965  8598 tablet_bootstrap.cc:492] T 8b0d84add64c4f5db82c90e98b7f4b74 P 53a66c851dc74c70b94c65d464a391f6: Bootstrap starting.
I20260709 13:02:00.721489  8329 raft_consensus.cc:2468] T 45171bd0207f452f9884a58c225ddb72 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53a66c851dc74c70b94c65d464a391f6 in term 1.
I20260709 13:02:00.733517  8600 tablet_bootstrap.cc:654] T 6433163abeff4ee0b011d159ca454a6a P 590ee39ce5734876b94d91fc3931b807: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:00.733676  8602 tablet_bootstrap.cc:492] T a79ccdf7d9cf4be7bf8b0c69bf90538a P 7b3ea460d1294b8a82672d7c21475cb5: No bootstrap required, opened a new log
I20260709 13:02:00.741111  8602 ts_tablet_manager.cc:1403] T a79ccdf7d9cf4be7bf8b0c69bf90538a P 7b3ea460d1294b8a82672d7c21475cb5: Time spent bootstrapping tablet: real 0.120s	user 0.025s	sys 0.013s
I20260709 13:02:00.738461  8295 leader_election.cc:304] T 45171bd0207f452f9884a58c225ddb72 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807; no voters: 53a66c851dc74c70b94c65d464a391f6, b560e9aaec7a4c78b9123b38e73519a3
I20260709 13:02:00.743136  8608 raft_consensus.cc:2749] T 45171bd0207f452f9884a58c225ddb72 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:00.749099  8598 tablet_bootstrap.cc:654] T 8b0d84add64c4f5db82c90e98b7f4b74 P 53a66c851dc74c70b94c65d464a391f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:00.750808  8602 raft_consensus.cc:359] T a79ccdf7d9cf4be7bf8b0c69bf90538a P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:00.756840  8602 raft_consensus.cc:385] T a79ccdf7d9cf4be7bf8b0c69bf90538a P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:00.757153  8602 raft_consensus.cc:740] T a79ccdf7d9cf4be7bf8b0c69bf90538a P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.757954  8602 consensus_queue.cc:260] T a79ccdf7d9cf4be7bf8b0c69bf90538a P 7b3ea460d1294b8a82672d7c21475cb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:00.760828  8601 tablet_bootstrap.cc:654] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P b560e9aaec7a4c78b9123b38e73519a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:00.761016  8602 ts_tablet_manager.cc:1434] T a79ccdf7d9cf4be7bf8b0c69bf90538a P 7b3ea460d1294b8a82672d7c21475cb5: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.002s
I20260709 13:02:00.754878  8600 tablet_bootstrap.cc:492] T 6433163abeff4ee0b011d159ca454a6a P 590ee39ce5734876b94d91fc3931b807: No bootstrap required, opened a new log
I20260709 13:02:00.763458  8600 ts_tablet_manager.cc:1403] T 6433163abeff4ee0b011d159ca454a6a P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.040s	user 0.014s	sys 0.010s
I20260709 13:02:00.762833  8602 tablet_bootstrap.cc:492] T 8b0d84add64c4f5db82c90e98b7f4b74 P 7b3ea460d1294b8a82672d7c21475cb5: Bootstrap starting.
I20260709 13:02:00.776656  8600 raft_consensus.cc:359] T 6433163abeff4ee0b011d159ca454a6a P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:00.777956  8600 raft_consensus.cc:385] T 6433163abeff4ee0b011d159ca454a6a P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:00.782092  8600 raft_consensus.cc:740] T 6433163abeff4ee0b011d159ca454a6a P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.783036  8600 consensus_queue.cc:260] T 6433163abeff4ee0b011d159ca454a6a P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:00.759852  8225 catalog_manager.cc:5697] T 45171bd0207f452f9884a58c225ddb72 P 53a66c851dc74c70b94c65d464a391f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "53a66c851dc74c70b94c65d464a391f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:00.795197  8600 ts_tablet_manager.cc:1434] T 6433163abeff4ee0b011d159ca454a6a P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.002s
I20260709 13:02:00.796845  8600 tablet_bootstrap.cc:492] T a3a46de7366f4683a88d19d25ad04901 P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:00.806711  8600 tablet_bootstrap.cc:654] T a3a46de7366f4683a88d19d25ad04901 P 590ee39ce5734876b94d91fc3931b807: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:00.781787  8602 tablet_bootstrap.cc:654] T 8b0d84add64c4f5db82c90e98b7f4b74 P 7b3ea460d1294b8a82672d7c21475cb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:00.811348  8598 tablet_bootstrap.cc:492] T 8b0d84add64c4f5db82c90e98b7f4b74 P 53a66c851dc74c70b94c65d464a391f6: No bootstrap required, opened a new log
I20260709 13:02:00.812443  8598 ts_tablet_manager.cc:1403] T 8b0d84add64c4f5db82c90e98b7f4b74 P 53a66c851dc74c70b94c65d464a391f6: Time spent bootstrapping tablet: real 0.085s	user 0.025s	sys 0.025s
I20260709 13:02:00.816448  8598 raft_consensus.cc:359] T 8b0d84add64c4f5db82c90e98b7f4b74 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:00.817443  8598 raft_consensus.cc:385] T 8b0d84add64c4f5db82c90e98b7f4b74 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:00.817785  8598 raft_consensus.cc:740] T 8b0d84add64c4f5db82c90e98b7f4b74 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.818797  8598 consensus_queue.cc:260] T 8b0d84add64c4f5db82c90e98b7f4b74 P 53a66c851dc74c70b94c65d464a391f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:00.825731  8598 ts_tablet_manager.cc:1434] T 8b0d84add64c4f5db82c90e98b7f4b74 P 53a66c851dc74c70b94c65d464a391f6: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 13:02:00.830592  8598 tablet_bootstrap.cc:492] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 53a66c851dc74c70b94c65d464a391f6: Bootstrap starting.
I20260709 13:02:00.830430  8226 catalog_manager.cc:5697] T 5a94bf713e4848879b9e2a1bbec03def P b560e9aaec7a4c78b9123b38e73519a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "b560e9aaec7a4c78b9123b38e73519a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:00.835979  8598 tablet_bootstrap.cc:654] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 53a66c851dc74c70b94c65d464a391f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:00.846333  8602 tablet_bootstrap.cc:492] T 8b0d84add64c4f5db82c90e98b7f4b74 P 7b3ea460d1294b8a82672d7c21475cb5: No bootstrap required, opened a new log
I20260709 13:02:00.846903  8602 ts_tablet_manager.cc:1403] T 8b0d84add64c4f5db82c90e98b7f4b74 P 7b3ea460d1294b8a82672d7c21475cb5: Time spent bootstrapping tablet: real 0.084s	user 0.011s	sys 0.009s
I20260709 13:02:00.846040  8226 catalog_manager.cc:5697] T ae8659e834df408ab36dd56103f10ae4 P b560e9aaec7a4c78b9123b38e73519a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "b560e9aaec7a4c78b9123b38e73519a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:00.850751  8602 raft_consensus.cc:359] T 8b0d84add64c4f5db82c90e98b7f4b74 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:00.851436  8602 raft_consensus.cc:385] T 8b0d84add64c4f5db82c90e98b7f4b74 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:00.851675  8602 raft_consensus.cc:740] T 8b0d84add64c4f5db82c90e98b7f4b74 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.852427  8602 consensus_queue.cc:260] T 8b0d84add64c4f5db82c90e98b7f4b74 P 7b3ea460d1294b8a82672d7c21475cb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:00.854553  8602 ts_tablet_manager.cc:1434] T 8b0d84add64c4f5db82c90e98b7f4b74 P 7b3ea460d1294b8a82672d7c21475cb5: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:02:00.855549  8602 tablet_bootstrap.cc:492] T a3a46de7366f4683a88d19d25ad04901 P 7b3ea460d1294b8a82672d7c21475cb5: Bootstrap starting.
I20260709 13:02:00.868786  8602 tablet_bootstrap.cc:654] T a3a46de7366f4683a88d19d25ad04901 P 7b3ea460d1294b8a82672d7c21475cb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:00.869029  8600 tablet_bootstrap.cc:492] T a3a46de7366f4683a88d19d25ad04901 P 590ee39ce5734876b94d91fc3931b807: No bootstrap required, opened a new log
I20260709 13:02:00.869524  8600 ts_tablet_manager.cc:1403] T a3a46de7366f4683a88d19d25ad04901 P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.073s	user 0.009s	sys 0.003s
I20260709 13:02:00.870983  8601 tablet_bootstrap.cc:492] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P b560e9aaec7a4c78b9123b38e73519a3: No bootstrap required, opened a new log
I20260709 13:02:00.871464  8601 ts_tablet_manager.cc:1403] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P b560e9aaec7a4c78b9123b38e73519a3: Time spent bootstrapping tablet: real 0.148s	user 0.021s	sys 0.051s
I20260709 13:02:00.872743  8600 raft_consensus.cc:359] T a3a46de7366f4683a88d19d25ad04901 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:00.873515  8600 raft_consensus.cc:385] T a3a46de7366f4683a88d19d25ad04901 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:00.873857  8600 raft_consensus.cc:740] T a3a46de7366f4683a88d19d25ad04901 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.874284  8601 raft_consensus.cc:359] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:00.875020  8601 raft_consensus.cc:385] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:00.874687  8600 consensus_queue.cc:260] T a3a46de7366f4683a88d19d25ad04901 P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:00.880877  8709 consensus_queue.cc:1048] T c63211d1d13a4736adb18dee69b400a3 P 7b3ea460d1294b8a82672d7c21475cb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:00.875305  8601 raft_consensus.cc:740] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.884443  8601 consensus_queue.cc:260] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P b560e9aaec7a4c78b9123b38e73519a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:00.887120  8601 ts_tablet_manager.cc:1434] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P b560e9aaec7a4c78b9123b38e73519a3: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:02:00.889127  8602 tablet_bootstrap.cc:492] T a3a46de7366f4683a88d19d25ad04901 P 7b3ea460d1294b8a82672d7c21475cb5: No bootstrap required, opened a new log
I20260709 13:02:00.889753  8602 ts_tablet_manager.cc:1403] T a3a46de7366f4683a88d19d25ad04901 P 7b3ea460d1294b8a82672d7c21475cb5: Time spent bootstrapping tablet: real 0.034s	user 0.014s	sys 0.003s
I20260709 13:02:00.892935  8602 raft_consensus.cc:359] T a3a46de7366f4683a88d19d25ad04901 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:00.894368  8682 raft_consensus.cc:493] T 7c9804c61fdb47a7958574869d381b72 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.895232  8682 raft_consensus.cc:515] T 7c9804c61fdb47a7958574869d381b72 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:00.896687  8598 tablet_bootstrap.cc:492] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 53a66c851dc74c70b94c65d464a391f6: No bootstrap required, opened a new log
I20260709 13:02:00.897183  8598 ts_tablet_manager.cc:1403] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 53a66c851dc74c70b94c65d464a391f6: Time spent bootstrapping tablet: real 0.067s	user 0.029s	sys 0.006s
I20260709 13:02:00.897377  8682 leader_election.cc:290] T 7c9804c61fdb47a7958574869d381b72 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:02:00.898478  8601 tablet_bootstrap.cc:492] T 6fffc940549b445c973a289ba1bebcb3 P b560e9aaec7a4c78b9123b38e73519a3: Bootstrap starting.
I20260709 13:02:00.899621  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9804c61fdb47a7958574869d381b72" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
I20260709 13:02:00.900277  8479 raft_consensus.cc:2468] T 7c9804c61fdb47a7958574869d381b72 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 0.
I20260709 13:02:00.900038  8598 raft_consensus.cc:359] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:00.901119  8598 raft_consensus.cc:385] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:00.901449  8598 raft_consensus.cc:740] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.902026  8598 consensus_queue.cc:260] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 53a66c851dc74c70b94c65d464a391f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:00.903671  8602 raft_consensus.cc:385] T a3a46de7366f4683a88d19d25ad04901 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:00.904106  8602 raft_consensus.cc:740] T a3a46de7366f4683a88d19d25ad04901 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Initialized, Role: FOLLOWER
I20260709 13:02:00.904038  8660 consensus_queue.cc:1048] T e1f344d27b0b44819ef6d23574175c26 P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:00.905184  8602 consensus_queue.cc:260] T a3a46de7366f4683a88d19d25ad04901 P 7b3ea460d1294b8a82672d7c21475cb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:00.906268  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9804c61fdb47a7958574869d381b72" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:02:00.907475  8598 ts_tablet_manager.cc:1434] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 53a66c851dc74c70b94c65d464a391f6: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:02:00.908542  8598 tablet_bootstrap.cc:492] T 7c9804c61fdb47a7958574869d381b72 P 53a66c851dc74c70b94c65d464a391f6: Bootstrap starting.
I20260709 13:02:00.912997  8600 ts_tablet_manager.cc:1434] T a3a46de7366f4683a88d19d25ad04901 P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.002s
I20260709 13:02:00.918438  8600 tablet_bootstrap.cc:492] T 5a94bf713e4848879b9e2a1bbec03def P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:00.916555  8717 raft_consensus.cc:493] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.921758  8601 tablet_bootstrap.cc:654] T 6fffc940549b445c973a289ba1bebcb3 P b560e9aaec7a4c78b9123b38e73519a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:00.921537  8717 raft_consensus.cc:515] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
W20260709 13:02:00.923360  8518 leader_election.cc:343] T 7c9804c61fdb47a7958574869d381b72 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:00.924302  8518 leader_election.cc:304] T 7c9804c61fdb47a7958574869d381b72 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b3ea460d1294b8a82672d7c21475cb5, b560e9aaec7a4c78b9123b38e73519a3; no voters: 53a66c851dc74c70b94c65d464a391f6
I20260709 13:02:00.925410  8682 raft_consensus.cc:2804] T 7c9804c61fdb47a7958574869d381b72 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:00.925880  8682 raft_consensus.cc:493] T 7c9804c61fdb47a7958574869d381b72 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:00.926285  8682 raft_consensus.cc:3060] T 7c9804c61fdb47a7958574869d381b72 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:00.928668  8709 consensus_queue.cc:1048] T c63211d1d13a4736adb18dee69b400a3 P 7b3ea460d1294b8a82672d7c21475cb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:00.938467  8709 raft_consensus.cc:493] T 6433163abeff4ee0b011d159ca454a6a P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.948005  8602 ts_tablet_manager.cc:1434] T a3a46de7366f4683a88d19d25ad04901 P 7b3ea460d1294b8a82672d7c21475cb5: Time spent starting tablet: real 0.058s	user 0.007s	sys 0.000s
I20260709 13:02:00.952953  8600 tablet_bootstrap.cc:654] T 5a94bf713e4848879b9e2a1bbec03def P 590ee39ce5734876b94d91fc3931b807: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:00.948632  8709 raft_consensus.cc:515] T 6433163abeff4ee0b011d159ca454a6a P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:00.958863  8709 leader_election.cc:290] T 6433163abeff4ee0b011d159ca454a6a P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:02:00.960059  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6433163abeff4ee0b011d159ca454a6a" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
I20260709 13:02:00.960412  8551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6433163abeff4ee0b011d159ca454a6a" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3" is_pre_election: true
I20260709 13:02:00.960814  8330 raft_consensus.cc:2468] T 6433163abeff4ee0b011d159ca454a6a P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b3ea460d1294b8a82672d7c21475cb5 in term 0.
I20260709 13:02:00.962236  8445 leader_election.cc:304] T 6433163abeff4ee0b011d159ca454a6a P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807, 7b3ea460d1294b8a82672d7c21475cb5; no voters: 
I20260709 13:02:00.964058  8602 tablet_bootstrap.cc:492] T ae8659e834df408ab36dd56103f10ae4 P 7b3ea460d1294b8a82672d7c21475cb5: Bootstrap starting.
I20260709 13:02:00.961143  8551 raft_consensus.cc:2468] T 6433163abeff4ee0b011d159ca454a6a P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b3ea460d1294b8a82672d7c21475cb5 in term 0.
I20260709 13:02:00.968515  8627 raft_consensus.cc:2804] T 6433163abeff4ee0b011d159ca454a6a P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:00.968961  8627 raft_consensus.cc:493] T 6433163abeff4ee0b011d159ca454a6a P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:00.969316  8627 raft_consensus.cc:3060] T 6433163abeff4ee0b011d159ca454a6a P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:00.975819  8651 raft_consensus.cc:493] T 8b0d84add64c4f5db82c90e98b7f4b74 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:00.976508  8651 raft_consensus.cc:515] T 8b0d84add64c4f5db82c90e98b7f4b74 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:00.978456  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b7ef1c3ead4480b17e7ce7da20f5f5" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
I20260709 13:02:00.978737  8651 leader_election.cc:290] T 8b0d84add64c4f5db82c90e98b7f4b74 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
W20260709 13:02:00.980026  8519 leader_election.cc:343] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:00.975914  8601 tablet_bootstrap.cc:492] T 6fffc940549b445c973a289ba1bebcb3 P b560e9aaec7a4c78b9123b38e73519a3: No bootstrap required, opened a new log
I20260709 13:02:01.017969  8600 tablet_bootstrap.cc:492] T 5a94bf713e4848879b9e2a1bbec03def P 590ee39ce5734876b94d91fc3931b807: No bootstrap required, opened a new log
I20260709 13:02:00.987447  8660 consensus_queue.cc:1048] T e1f344d27b0b44819ef6d23574175c26 P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.075s
I20260709 13:02:01.009109  8605 raft_consensus.cc:493] T a79ccdf7d9cf4be7bf8b0c69bf90538a P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.062256  8600 ts_tablet_manager.cc:1403] T 5a94bf713e4848879b9e2a1bbec03def P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.144s	user 0.019s	sys 0.004s
I20260709 13:02:00.995110  8627 raft_consensus.cc:515] T 6433163abeff4ee0b011d159ca454a6a P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:01.062839  8605 raft_consensus.cc:515] T a79ccdf7d9cf4be7bf8b0c69bf90538a P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:01.065433  8551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6433163abeff4ee0b011d159ca454a6a" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3"
I20260709 13:02:01.066039  8551 raft_consensus.cc:3060] T 6433163abeff4ee0b011d159ca454a6a P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.066473  8605 leader_election.cc:290] T a79ccdf7d9cf4be7bf8b0c69bf90538a P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:02:00.988049  8682 raft_consensus.cc:515] T 7c9804c61fdb47a7958574869d381b72 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:01.067201  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6433163abeff4ee0b011d159ca454a6a" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807"
I20260709 13:02:01.015882  8602 tablet_bootstrap.cc:654] T ae8659e834df408ab36dd56103f10ae4 P 7b3ea460d1294b8a82672d7c21475cb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:01.067866  8329 raft_consensus.cc:3060] T 6433163abeff4ee0b011d159ca454a6a P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.068887  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79ccdf7d9cf4be7bf8b0c69bf90538a" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
I20260709 13:02:01.069610  8475 raft_consensus.cc:2468] T a79ccdf7d9cf4be7bf8b0c69bf90538a P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 0.
I20260709 13:02:01.067572  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79ccdf7d9cf4be7bf8b0c69bf90538a" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
I20260709 13:02:01.072001  8518 leader_election.cc:304] T a79ccdf7d9cf4be7bf8b0c69bf90538a P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b3ea460d1294b8a82672d7c21475cb5, b560e9aaec7a4c78b9123b38e73519a3; no voters: 
I20260709 13:02:01.026329  8720 raft_consensus.cc:493] T a3a46de7366f4683a88d19d25ad04901 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.074136  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9804c61fdb47a7958574869d381b72" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6"
I20260709 13:02:01.078540  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9804c61fdb47a7958574869d381b72" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5"
I20260709 13:02:01.011519  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b0d84add64c4f5db82c90e98b7f4b74" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:02:01.078812  8682 leader_election.cc:290] T 7c9804c61fdb47a7958574869d381b72 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 election: Requested vote from peers 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:02:01.084128  8605 raft_consensus.cc:2804] T a79ccdf7d9cf4be7bf8b0c69bf90538a P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:01.084627  8605 raft_consensus.cc:493] T a79ccdf7d9cf4be7bf8b0c69bf90538a P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:00.976995  8717 leader_election.cc:290] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:02:01.084990  8605 raft_consensus.cc:3060] T a79ccdf7d9cf4be7bf8b0c69bf90538a P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.079991  8475 raft_consensus.cc:3060] T 7c9804c61fdb47a7958574869d381b72 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.079453  8708 raft_consensus.cc:493] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.079165  8720 raft_consensus.cc:515] T a3a46de7366f4683a88d19d25ad04901 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:01.088542  8551 raft_consensus.cc:2468] T 6433163abeff4ee0b011d159ca454a6a P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b3ea460d1294b8a82672d7c21475cb5 in term 1.
I20260709 13:02:01.088816  8708 raft_consensus.cc:515] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
W20260709 13:02:01.079640  8518 leader_election.cc:343] T 7c9804c61fdb47a7958574869d381b72 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:01.072646  8519 leader_election.cc:343] T a79ccdf7d9cf4be7bf8b0c69bf90538a P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:01.091812  8720 leader_election.cc:290] T a3a46de7366f4683a88d19d25ad04901 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:02:01.092079  8553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b7ef1c3ead4480b17e7ce7da20f5f5" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3" is_pre_election: true
I20260709 13:02:01.081290  8627 leader_election.cc:290] T 6433163abeff4ee0b011d159ca454a6a P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 election: Requested vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:02:01.092799  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3a46de7366f4683a88d19d25ad04901" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
I20260709 13:02:01.092924  8553 raft_consensus.cc:2468] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53a66c851dc74c70b94c65d464a391f6 in term 0.
I20260709 13:02:01.093448  8479 raft_consensus.cc:2468] T a3a46de7366f4683a88d19d25ad04901 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53a66c851dc74c70b94c65d464a391f6 in term 0.
I20260709 13:02:01.094545  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3a46de7366f4683a88d19d25ad04901" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
I20260709 13:02:01.094734  8370 leader_election.cc:304] T a3a46de7366f4683a88d19d25ad04901 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, 7b3ea460d1294b8a82672d7c21475cb5; no voters: 
I20260709 13:02:01.095266  8327 raft_consensus.cc:2468] T a3a46de7366f4683a88d19d25ad04901 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53a66c851dc74c70b94c65d464a391f6 in term 0.
I20260709 13:02:01.095711  8443 leader_election.cc:304] T 6433163abeff4ee0b011d159ca454a6a P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b3ea460d1294b8a82672d7c21475cb5, b560e9aaec7a4c78b9123b38e73519a3; no voters: 
I20260709 13:02:01.096676  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b7ef1c3ead4480b17e7ce7da20f5f5" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
I20260709 13:02:00.987076  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b0d84add64c4f5db82c90e98b7f4b74" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
I20260709 13:02:01.095615  8720 raft_consensus.cc:2804] T a3a46de7366f4683a88d19d25ad04901 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:01.097993  8369 leader_election.cc:304] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, b560e9aaec7a4c78b9123b38e73519a3; no voters: 
I20260709 13:02:01.100072  8720 raft_consensus.cc:493] T a3a46de7366f4683a88d19d25ad04901 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:01.100513  8720 raft_consensus.cc:3060] T a3a46de7366f4683a88d19d25ad04901 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.096676  8627 raft_consensus.cc:2804] T 6433163abeff4ee0b011d159ca454a6a P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:01.105613  8607 raft_consensus.cc:2804] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:01.105747  8627 raft_consensus.cc:697] T 6433163abeff4ee0b011d159ca454a6a P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 LEADER]: Becoming Leader. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Running, Role: LEADER
I20260709 13:02:01.106082  8607 raft_consensus.cc:493] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:01.106554  8607 raft_consensus.cc:3060] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.106864  8627 consensus_queue.cc:237] T 6433163abeff4ee0b011d159ca454a6a P 7b3ea460d1294b8a82672d7c21475cb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
W20260709 13:02:01.108023  8371 leader_election.cc:343] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:01.098449  8605 raft_consensus.cc:515] T a79ccdf7d9cf4be7bf8b0c69bf90538a P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:01.112906  8720 raft_consensus.cc:515] T a3a46de7366f4683a88d19d25ad04901 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:01.114105  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79ccdf7d9cf4be7bf8b0c69bf90538a" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807"
I20260709 13:02:01.114606  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79ccdf7d9cf4be7bf8b0c69bf90538a" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5"
I20260709 13:02:01.114981  8720 leader_election.cc:290] T a3a46de7366f4683a88d19d25ad04901 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 election: Requested vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:02:01.081951  8601 ts_tablet_manager.cc:1403] T 6fffc940549b445c973a289ba1bebcb3 P b560e9aaec7a4c78b9123b38e73519a3: Time spent bootstrapping tablet: real 0.184s	user 0.017s	sys 0.005s
I20260709 13:02:01.115406  8479 raft_consensus.cc:3060] T a79ccdf7d9cf4be7bf8b0c69bf90538a P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:01.115557  8519 leader_election.cc:343] T a79ccdf7d9cf4be7bf8b0c69bf90538a P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:01.030385  8598 tablet_bootstrap.cc:654] T 7c9804c61fdb47a7958574869d381b72 P 53a66c851dc74c70b94c65d464a391f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:01.079707  8404 raft_consensus.cc:2468] T 8b0d84add64c4f5db82c90e98b7f4b74 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b3ea460d1294b8a82672d7c21475cb5 in term 0.
I20260709 13:02:01.116062  8477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3a46de7366f4683a88d19d25ad04901" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5"
I20260709 13:02:01.116699  8477 raft_consensus.cc:3060] T a3a46de7366f4683a88d19d25ad04901 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.118191  8601 raft_consensus.cc:359] T 6fffc940549b445c973a289ba1bebcb3 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:01.114573  8330 raft_consensus.cc:2468] T 8b0d84add64c4f5db82c90e98b7f4b74 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b3ea460d1294b8a82672d7c21475cb5 in term 0.
I20260709 13:02:01.105096  8600 raft_consensus.cc:359] T 5a94bf713e4848879b9e2a1bbec03def P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:01.091836  8708 leader_election.cc:290] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:02:01.125826  8600 raft_consensus.cc:385] T 5a94bf713e4848879b9e2a1bbec03def P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:01.126274  8600 raft_consensus.cc:740] T 5a94bf713e4848879b9e2a1bbec03def P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.078873  8329 raft_consensus.cc:2468] T 6433163abeff4ee0b011d159ca454a6a P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b3ea460d1294b8a82672d7c21475cb5 in term 1.
I20260709 13:02:01.125958  8444 leader_election.cc:304] T 8b0d84add64c4f5db82c90e98b7f4b74 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, 7b3ea460d1294b8a82672d7c21475cb5; no voters: 
I20260709 13:02:01.010221  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b7ef1c3ead4480b17e7ce7da20f5f5" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:02:01.127511  8600 consensus_queue.cc:260] T 5a94bf713e4848879b9e2a1bbec03def P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:01.127933  8651 raft_consensus.cc:2804] T 8b0d84add64c4f5db82c90e98b7f4b74 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:01.128635  8651 raft_consensus.cc:493] T 8b0d84add64c4f5db82c90e98b7f4b74 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:01.129014  8651 raft_consensus.cc:3060] T 8b0d84add64c4f5db82c90e98b7f4b74 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.128039  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3a46de7366f4683a88d19d25ad04901" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807"
I20260709 13:02:01.131675  8327 raft_consensus.cc:3060] T a3a46de7366f4683a88d19d25ad04901 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.118933  8601 raft_consensus.cc:385] T 6fffc940549b445c973a289ba1bebcb3 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:01.136807  8601 raft_consensus.cc:740] T 6fffc940549b445c973a289ba1bebcb3 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.145727  8601 consensus_queue.cc:260] T 6fffc940549b445c973a289ba1bebcb3 P b560e9aaec7a4c78b9123b38e73519a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:01.140295  8605 leader_election.cc:290] T a79ccdf7d9cf4be7bf8b0c69bf90538a P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 election: Requested vote from peers 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:02:01.144838  8717 consensus_queue.cc:1048] T ae8659e834df408ab36dd56103f10ae4 P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:02:01.157534  8600 ts_tablet_manager.cc:1434] T 5a94bf713e4848879b9e2a1bbec03def P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.095s	user 0.008s	sys 0.000s
I20260709 13:02:01.144907  8479 raft_consensus.cc:2468] T a79ccdf7d9cf4be7bf8b0c69bf90538a P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 1.
I20260709 13:02:01.161518  8601 ts_tablet_manager.cc:1434] T 6fffc940549b445c973a289ba1bebcb3 P b560e9aaec7a4c78b9123b38e73519a3: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.001s
I20260709 13:02:01.151665  8607 raft_consensus.cc:515] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:01.169111  8551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b7ef1c3ead4480b17e7ce7da20f5f5" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3"
I20260709 13:02:01.169798  8551 raft_consensus.cc:3060] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.169457  8227 catalog_manager.cc:5697] T 6433163abeff4ee0b011d159ca454a6a P 7b3ea460d1294b8a82672d7c21475cb5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "7b3ea460d1294b8a82672d7c21475cb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:01.169982  8651 raft_consensus.cc:515] T 8b0d84add64c4f5db82c90e98b7f4b74 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
W20260709 13:02:01.171236  8276 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:01.172569  8651 leader_election.cc:290] T 8b0d84add64c4f5db82c90e98b7f4b74 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 election: Requested vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:02:01.172842  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b0d84add64c4f5db82c90e98b7f4b74" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807"
I20260709 13:02:01.173372  8600 tablet_bootstrap.cc:492] T a79ccdf7d9cf4be7bf8b0c69bf90538a P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:01.173504  8330 raft_consensus.cc:3060] T 8b0d84add64c4f5db82c90e98b7f4b74 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.178102  8682 raft_consensus.cc:493] T 6fffc940549b445c973a289ba1bebcb3 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.178627  8682 raft_consensus.cc:515] T 6fffc940549b445c973a289ba1bebcb3 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:01.179742  8607 leader_election.cc:290] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 election: Requested vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:02:01.179033  8601 tablet_bootstrap.cc:492] T cb85497b295d4b3f8cda882af3676c65 P b560e9aaec7a4c78b9123b38e73519a3: Bootstrap starting.
I20260709 13:02:01.181250  8682 leader_election.cc:290] T 6fffc940549b445c973a289ba1bebcb3 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:02:01.181763  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b7ef1c3ead4480b17e7ce7da20f5f5" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807"
I20260709 13:02:01.181774  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fffc940549b445c973a289ba1bebcb3" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
I20260709 13:02:01.183009  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fffc940549b445c973a289ba1bebcb3" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
W20260709 13:02:01.183336  8518 leader_election.cc:343] T 6fffc940549b445c973a289ba1bebcb3 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:01.185765  8477 raft_consensus.cc:2468] T a3a46de7366f4683a88d19d25ad04901 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53a66c851dc74c70b94c65d464a391f6 in term 1.
W20260709 13:02:01.186326  8519 leader_election.cc:343] T 6fffc940549b445c973a289ba1bebcb3 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:01.188827  8598 tablet_bootstrap.cc:492] T 7c9804c61fdb47a7958574869d381b72 P 53a66c851dc74c70b94c65d464a391f6: No bootstrap required, opened a new log
I20260709 13:02:01.188815  8519 leader_election.cc:304] T 6fffc940549b445c973a289ba1bebcb3 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b560e9aaec7a4c78b9123b38e73519a3; no voters: 590ee39ce5734876b94d91fc3931b807, 7b3ea460d1294b8a82672d7c21475cb5
I20260709 13:02:01.187721  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b0d84add64c4f5db82c90e98b7f4b74" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6"
I20260709 13:02:01.189538  8598 ts_tablet_manager.cc:1403] T 7c9804c61fdb47a7958574869d381b72 P 53a66c851dc74c70b94c65d464a391f6: Time spent bootstrapping tablet: real 0.281s	user 0.014s	sys 0.016s
I20260709 13:02:01.190668  8405 raft_consensus.cc:2393] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b560e9aaec7a4c78b9123b38e73519a3 in current term 1: Already voted for candidate 53a66c851dc74c70b94c65d464a391f6 in this term.
I20260709 13:02:01.191033  8370 leader_election.cc:304] T a3a46de7366f4683a88d19d25ad04901 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, 7b3ea460d1294b8a82672d7c21475cb5; no voters: 
I20260709 13:02:01.191963  8660 raft_consensus.cc:2804] T a3a46de7366f4683a88d19d25ad04901 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:01.193560  8660 raft_consensus.cc:697] T a3a46de7366f4683a88d19d25ad04901 P 53a66c851dc74c70b94c65d464a391f6 [term 1 LEADER]: Becoming Leader. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Running, Role: LEADER
I20260709 13:02:01.194530  8660 consensus_queue.cc:237] T a3a46de7366f4683a88d19d25ad04901 P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:01.193974  8598 raft_consensus.cc:359] T 7c9804c61fdb47a7958574869d381b72 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
W20260709 13:02:01.192163  8371 leader_election.cc:343] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:01.186645  8518 leader_election.cc:304] T a79ccdf7d9cf4be7bf8b0c69bf90538a P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b3ea460d1294b8a82672d7c21475cb5, b560e9aaec7a4c78b9123b38e73519a3; no voters: 590ee39ce5734876b94d91fc3931b807
I20260709 13:02:01.189839  8404 raft_consensus.cc:3060] T 8b0d84add64c4f5db82c90e98b7f4b74 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.187927  8602 tablet_bootstrap.cc:492] T ae8659e834df408ab36dd56103f10ae4 P 7b3ea460d1294b8a82672d7c21475cb5: No bootstrap required, opened a new log
I20260709 13:02:01.189924  8682 raft_consensus.cc:2749] T 6fffc940549b445c973a289ba1bebcb3 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:01.196012  8598 raft_consensus.cc:385] T 7c9804c61fdb47a7958574869d381b72 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:01.204645  8598 raft_consensus.cc:740] T 7c9804c61fdb47a7958574869d381b72 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.196369  8601 tablet_bootstrap.cc:654] T cb85497b295d4b3f8cda882af3676c65 P b560e9aaec7a4c78b9123b38e73519a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:01.185366  8330 raft_consensus.cc:2468] T 8b0d84add64c4f5db82c90e98b7f4b74 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b3ea460d1294b8a82672d7c21475cb5 in term 1.
I20260709 13:02:01.198166  8327 raft_consensus.cc:2468] T a3a46de7366f4683a88d19d25ad04901 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53a66c851dc74c70b94c65d464a391f6 in term 1.
I20260709 13:02:01.159502  8475 raft_consensus.cc:2468] T 7c9804c61fdb47a7958574869d381b72 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 1.
I20260709 13:02:01.202903  8602 ts_tablet_manager.cc:1403] T ae8659e834df408ab36dd56103f10ae4 P 7b3ea460d1294b8a82672d7c21475cb5: Time spent bootstrapping tablet: real 0.239s	user 0.033s	sys 0.010s
I20260709 13:02:01.209209  8600 tablet_bootstrap.cc:654] T a79ccdf7d9cf4be7bf8b0c69bf90538a P 590ee39ce5734876b94d91fc3931b807: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:01.207101  8605 raft_consensus.cc:2804] T a79ccdf7d9cf4be7bf8b0c69bf90538a P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:01.211221  8605 raft_consensus.cc:697] T a79ccdf7d9cf4be7bf8b0c69bf90538a P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Becoming Leader. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Running, Role: LEADER
I20260709 13:02:01.212350  8605 consensus_queue.cc:237] T a79ccdf7d9cf4be7bf8b0c69bf90538a P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:01.205657  8598 consensus_queue.cc:260] T 7c9804c61fdb47a7958574869d381b72 P 53a66c851dc74c70b94c65d464a391f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:01.213469  8551 raft_consensus.cc:2468] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53a66c851dc74c70b94c65d464a391f6 in term 1.
I20260709 13:02:01.221366  8369 leader_election.cc:304] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, b560e9aaec7a4c78b9123b38e73519a3; no voters: 590ee39ce5734876b94d91fc3931b807
I20260709 13:02:01.220144  8445 leader_election.cc:304] T 8b0d84add64c4f5db82c90e98b7f4b74 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807, 7b3ea460d1294b8a82672d7c21475cb5; no voters: 
I20260709 13:02:01.224289  8518 leader_election.cc:304] T 7c9804c61fdb47a7958574869d381b72 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b3ea460d1294b8a82672d7c21475cb5, b560e9aaec7a4c78b9123b38e73519a3; no voters: 53a66c851dc74c70b94c65d464a391f6
I20260709 13:02:01.225209  8661 raft_consensus.cc:2804] T 7c9804c61fdb47a7958574869d381b72 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:01.225724  8661 raft_consensus.cc:697] T 7c9804c61fdb47a7958574869d381b72 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Becoming Leader. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Running, Role: LEADER
I20260709 13:02:01.226289  8602 raft_consensus.cc:359] T ae8659e834df408ab36dd56103f10ae4 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:01.227057  8602 raft_consensus.cc:385] T ae8659e834df408ab36dd56103f10ae4 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:01.226564  8661 consensus_queue.cc:237] T 7c9804c61fdb47a7958574869d381b72 P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:01.227339  8602 raft_consensus.cc:740] T ae8659e834df408ab36dd56103f10ae4 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.228097  8602 consensus_queue.cc:260] T ae8659e834df408ab36dd56103f10ae4 P 7b3ea460d1294b8a82672d7c21475cb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
W20260709 13:02:01.227802  8518 consensus_peers.cc:597] T ae8659e834df408ab36dd56103f10ae4 P b560e9aaec7a4c78b9123b38e73519a3 -> Peer 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429): Couldn't send request to peer 7b3ea460d1294b8a82672d7c21475cb5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:01.230700  8598 ts_tablet_manager.cc:1434] T 7c9804c61fdb47a7958574869d381b72 P 53a66c851dc74c70b94c65d464a391f6: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.000s
I20260709 13:02:01.241540  8607 consensus_queue.cc:1048] T 45171bd0207f452f9884a58c225ddb72 P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:01.241914  8404 raft_consensus.cc:2468] T 8b0d84add64c4f5db82c90e98b7f4b74 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b3ea460d1294b8a82672d7c21475cb5 in term 1.
I20260709 13:02:01.242988  8327 raft_consensus.cc:3060] T 5a94bf713e4848879b9e2a1bbec03def P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.248165  8602 ts_tablet_manager.cc:1434] T ae8659e834df408ab36dd56103f10ae4 P 7b3ea460d1294b8a82672d7c21475cb5: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.000s
I20260709 13:02:01.234162  8651 raft_consensus.cc:2804] T 8b0d84add64c4f5db82c90e98b7f4b74 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:01.249711  8602 tablet_bootstrap.cc:492] T 62a3aed976de4d62a1d4dc7bc5252328 P 7b3ea460d1294b8a82672d7c21475cb5: Bootstrap starting.
I20260709 13:02:01.263990  8598 tablet_bootstrap.cc:492] T 7ed73594956241f4b3e6e456bae82964 P 53a66c851dc74c70b94c65d464a391f6: Bootstrap starting.
I20260709 13:02:01.251395  8660 raft_consensus.cc:2804] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:01.256394  8651 raft_consensus.cc:697] T 8b0d84add64c4f5db82c90e98b7f4b74 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 LEADER]: Becoming Leader. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Running, Role: LEADER
I20260709 13:02:01.279633  8651 consensus_queue.cc:237] T 8b0d84add64c4f5db82c90e98b7f4b74 P 7b3ea460d1294b8a82672d7c21475cb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:01.282198  8518 leader_election.cc:304] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b560e9aaec7a4c78b9123b38e73519a3; no voters: 53a66c851dc74c70b94c65d464a391f6, 590ee39ce5734876b94d91fc3931b807
W20260709 13:02:01.285020  8796 log.cc:927] Time spent T e1f344d27b0b44819ef6d23574175c26 P 590ee39ce5734876b94d91fc3931b807: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 13:02:01.284512  8661 raft_consensus.cc:2749] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:01.294119  8601 tablet_bootstrap.cc:492] T cb85497b295d4b3f8cda882af3676c65 P b560e9aaec7a4c78b9123b38e73519a3: No bootstrap required, opened a new log
I20260709 13:02:01.294716  8601 ts_tablet_manager.cc:1403] T cb85497b295d4b3f8cda882af3676c65 P b560e9aaec7a4c78b9123b38e73519a3: Time spent bootstrapping tablet: real 0.116s	user 0.012s	sys 0.018s
I20260709 13:02:01.276151  8660 raft_consensus.cc:697] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 53a66c851dc74c70b94c65d464a391f6 [term 1 LEADER]: Becoming Leader. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Running, Role: LEADER
I20260709 13:02:01.313300  8660 consensus_queue.cc:237] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:01.328364  8661 consensus_queue.cc:1048] T 5a94bf713e4848879b9e2a1bbec03def P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:01.329789  8720 consensus_queue.cc:1048] T 45171bd0207f452f9884a58c225ddb72 P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:01.344136  8602 tablet_bootstrap.cc:654] T 62a3aed976de4d62a1d4dc7bc5252328 P 7b3ea460d1294b8a82672d7c21475cb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:01.353597  8608 raft_consensus.cc:493] T 5a94bf713e4848879b9e2a1bbec03def P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.354184  8608 raft_consensus.cc:515] T 5a94bf713e4848879b9e2a1bbec03def P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:01.359560  8605 consensus_queue.cc:1048] T 5a94bf713e4848879b9e2a1bbec03def P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:01.374722  8608 leader_election.cc:290] T 5a94bf713e4848879b9e2a1bbec03def P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:02:01.375700  8551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a94bf713e4848879b9e2a1bbec03def" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3" is_pre_election: true
I20260709 13:02:01.378973  8600 tablet_bootstrap.cc:492] T a79ccdf7d9cf4be7bf8b0c69bf90538a P 590ee39ce5734876b94d91fc3931b807: No bootstrap required, opened a new log
I20260709 13:02:01.381639  8600 ts_tablet_manager.cc:1403] T a79ccdf7d9cf4be7bf8b0c69bf90538a P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.219s	user 0.016s	sys 0.001s
I20260709 13:02:01.379313  8660 raft_consensus.cc:493] T 7c9804c61fdb47a7958574869d381b72 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.387164  8601 raft_consensus.cc:359] T cb85497b295d4b3f8cda882af3676c65 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:01.387746  8601 raft_consensus.cc:385] T cb85497b295d4b3f8cda882af3676c65 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:01.387977  8601 raft_consensus.cc:740] T cb85497b295d4b3f8cda882af3676c65 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.389328  8600 raft_consensus.cc:359] T a79ccdf7d9cf4be7bf8b0c69bf90538a P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:01.389868  8600 raft_consensus.cc:385] T a79ccdf7d9cf4be7bf8b0c69bf90538a P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:01.390087  8600 raft_consensus.cc:740] T a79ccdf7d9cf4be7bf8b0c69bf90538a P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.395556  8600 consensus_queue.cc:260] T a79ccdf7d9cf4be7bf8b0c69bf90538a P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:01.397462  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a94bf713e4848879b9e2a1bbec03def" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:02:01.385409  8660 raft_consensus.cc:515] T 7c9804c61fdb47a7958574869d381b72 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:01.397823  8601 consensus_queue.cc:260] T cb85497b295d4b3f8cda882af3676c65 P b560e9aaec7a4c78b9123b38e73519a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:01.411033  8598 tablet_bootstrap.cc:654] T 7ed73594956241f4b3e6e456bae82964 P 53a66c851dc74c70b94c65d464a391f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:01.412068  8601 ts_tablet_manager.cc:1434] T cb85497b295d4b3f8cda882af3676c65 P b560e9aaec7a4c78b9123b38e73519a3: Time spent starting tablet: real 0.117s	user 0.005s	sys 0.002s
I20260709 13:02:01.413151  8601 tablet_bootstrap.cc:492] T 7ed73594956241f4b3e6e456bae82964 P b560e9aaec7a4c78b9123b38e73519a3: Bootstrap starting.
I20260709 13:02:01.410079  8477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9804c61fdb47a7958574869d381b72" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
I20260709 13:02:01.417462  8477 raft_consensus.cc:2393] T 7c9804c61fdb47a7958574869d381b72 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 53a66c851dc74c70b94c65d464a391f6 in current term 1: Already voted for candidate b560e9aaec7a4c78b9123b38e73519a3 in this term.
I20260709 13:02:01.410207  8295 leader_election.cc:304] T 5a94bf713e4848879b9e2a1bbec03def P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807; no voters: 53a66c851dc74c70b94c65d464a391f6, b560e9aaec7a4c78b9123b38e73519a3
I20260709 13:02:01.400174  8600 ts_tablet_manager.cc:1434] T a79ccdf7d9cf4be7bf8b0c69bf90538a P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:02:01.420634  8608 raft_consensus.cc:2749] T 5a94bf713e4848879b9e2a1bbec03def P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:01.421123  8600 tablet_bootstrap.cc:492] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:01.424861  8226 catalog_manager.cc:5697] T a79ccdf7d9cf4be7bf8b0c69bf90538a P b560e9aaec7a4c78b9123b38e73519a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "b560e9aaec7a4c78b9123b38e73519a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:01.433169  8227 catalog_manager.cc:5697] T 8b0d84add64c4f5db82c90e98b7f4b74 P 7b3ea460d1294b8a82672d7c21475cb5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "7b3ea460d1294b8a82672d7c21475cb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:01.442931  8600 tablet_bootstrap.cc:654] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 590ee39ce5734876b94d91fc3931b807: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:01.458282  8601 tablet_bootstrap.cc:654] T 7ed73594956241f4b3e6e456bae82964 P b560e9aaec7a4c78b9123b38e73519a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:01.437259  8226 catalog_manager.cc:5697] T 7c9804c61fdb47a7958574869d381b72 P b560e9aaec7a4c78b9123b38e73519a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "b560e9aaec7a4c78b9123b38e73519a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:01.466594  8553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9804c61fdb47a7958574869d381b72" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3" is_pre_election: true
I20260709 13:02:01.468271  8369 leader_election.cc:304] T 7c9804c61fdb47a7958574869d381b72 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6; no voters: 7b3ea460d1294b8a82672d7c21475cb5, b560e9aaec7a4c78b9123b38e73519a3
I20260709 13:02:01.469306  8701 raft_consensus.cc:3060] T 7c9804c61fdb47a7958574869d381b72 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.462271  8660 leader_election.cc:290] T 7c9804c61fdb47a7958574869d381b72 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429), b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503)
I20260709 13:02:01.484776  8602 tablet_bootstrap.cc:492] T 62a3aed976de4d62a1d4dc7bc5252328 P 7b3ea460d1294b8a82672d7c21475cb5: No bootstrap required, opened a new log
I20260709 13:02:01.485396  8602 ts_tablet_manager.cc:1403] T 62a3aed976de4d62a1d4dc7bc5252328 P 7b3ea460d1294b8a82672d7c21475cb5: Time spent bootstrapping tablet: real 0.236s	user 0.021s	sys 0.010s
I20260709 13:02:01.488653  8602 raft_consensus.cc:359] T 62a3aed976de4d62a1d4dc7bc5252328 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:01.489431  8602 raft_consensus.cc:385] T 62a3aed976de4d62a1d4dc7bc5252328 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:01.489748  8602 raft_consensus.cc:740] T 62a3aed976de4d62a1d4dc7bc5252328 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.490456  8602 consensus_queue.cc:260] T 62a3aed976de4d62a1d4dc7bc5252328 P 7b3ea460d1294b8a82672d7c21475cb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:01.492911  8602 ts_tablet_manager.cc:1434] T 62a3aed976de4d62a1d4dc7bc5252328 P 7b3ea460d1294b8a82672d7c21475cb5: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 13:02:01.492215  8701 raft_consensus.cc:2749] T 7c9804c61fdb47a7958574869d381b72 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:01.494874  8602 tablet_bootstrap.cc:492] T 7ed73594956241f4b3e6e456bae82964 P 7b3ea460d1294b8a82672d7c21475cb5: Bootstrap starting.
I20260709 13:02:01.498888  8598 tablet_bootstrap.cc:492] T 7ed73594956241f4b3e6e456bae82964 P 53a66c851dc74c70b94c65d464a391f6: No bootstrap required, opened a new log
I20260709 13:02:01.499516  8598 ts_tablet_manager.cc:1403] T 7ed73594956241f4b3e6e456bae82964 P 53a66c851dc74c70b94c65d464a391f6: Time spent bootstrapping tablet: real 0.244s	user 0.026s	sys 0.011s
I20260709 13:02:01.506107  8598 raft_consensus.cc:359] T 7ed73594956241f4b3e6e456bae82964 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:01.505940  8225 catalog_manager.cc:5697] T a3a46de7366f4683a88d19d25ad04901 P 53a66c851dc74c70b94c65d464a391f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "53a66c851dc74c70b94c65d464a391f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:01.506932  8598 raft_consensus.cc:385] T 7ed73594956241f4b3e6e456bae82964 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:01.507321  8598 raft_consensus.cc:740] T 7ed73594956241f4b3e6e456bae82964 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.508193  8598 consensus_queue.cc:260] T 7ed73594956241f4b3e6e456bae82964 P 53a66c851dc74c70b94c65d464a391f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:01.508491  8225 catalog_manager.cc:5697] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 53a66c851dc74c70b94c65d464a391f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "53a66c851dc74c70b94c65d464a391f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:01.510763  8598 ts_tablet_manager.cc:1434] T 7ed73594956241f4b3e6e456bae82964 P 53a66c851dc74c70b94c65d464a391f6: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:02:01.511992  8598 tablet_bootstrap.cc:492] T cb85497b295d4b3f8cda882af3676c65 P 53a66c851dc74c70b94c65d464a391f6: Bootstrap starting.
I20260709 13:02:01.519570  8600 tablet_bootstrap.cc:492] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 590ee39ce5734876b94d91fc3931b807: No bootstrap required, opened a new log
I20260709 13:02:01.520100  8600 ts_tablet_manager.cc:1403] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.099s	user 0.016s	sys 0.008s
I20260709 13:02:01.522580  8602 tablet_bootstrap.cc:654] T 7ed73594956241f4b3e6e456bae82964 P 7b3ea460d1294b8a82672d7c21475cb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:01.522866  8600 raft_consensus.cc:359] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:01.523595  8600 raft_consensus.cc:385] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:01.523869  8600 raft_consensus.cc:740] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.524641  8600 consensus_queue.cc:260] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:01.529043  8598 tablet_bootstrap.cc:654] T cb85497b295d4b3f8cda882af3676c65 P 53a66c851dc74c70b94c65d464a391f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:01.530319  8608 raft_consensus.cc:493] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.531047  8608 raft_consensus.cc:515] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:01.534185  8608 leader_election.cc:290] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:02:01.535068  8553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b7ef1c3ead4480b17e7ce7da20f5f5" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3" is_pre_election: true
I20260709 13:02:01.535413  8600 ts_tablet_manager.cc:1434] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:02:01.535905  8553 raft_consensus.cc:2393] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 590ee39ce5734876b94d91fc3931b807 in current term 1: Already voted for candidate 53a66c851dc74c70b94c65d464a391f6 in this term.
I20260709 13:02:01.536581  8600 tablet_bootstrap.cc:492] T cb85497b295d4b3f8cda882af3676c65 P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:01.536923  8401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "73b7ef1c3ead4480b17e7ce7da20f5f5" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:02:01.539243  8294 leader_election.cc:304] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807; no voters: 53a66c851dc74c70b94c65d464a391f6, b560e9aaec7a4c78b9123b38e73519a3
I20260709 13:02:01.540436  8608 raft_consensus.cc:3060] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.543525  8600 tablet_bootstrap.cc:654] T cb85497b295d4b3f8cda882af3676c65 P 590ee39ce5734876b94d91fc3931b807: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:01.549285  8608 raft_consensus.cc:2749] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:01.595338  8601 tablet_bootstrap.cc:492] T 7ed73594956241f4b3e6e456bae82964 P b560e9aaec7a4c78b9123b38e73519a3: No bootstrap required, opened a new log
I20260709 13:02:01.595897  8601 ts_tablet_manager.cc:1403] T 7ed73594956241f4b3e6e456bae82964 P b560e9aaec7a4c78b9123b38e73519a3: Time spent bootstrapping tablet: real 0.183s	user 0.060s	sys 0.007s
I20260709 13:02:01.597898  8608 raft_consensus.cc:493] T a79ccdf7d9cf4be7bf8b0c69bf90538a P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.598445  8608 raft_consensus.cc:515] T a79ccdf7d9cf4be7bf8b0c69bf90538a P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:01.599288  8601 raft_consensus.cc:359] T 7ed73594956241f4b3e6e456bae82964 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:01.600199  8601 raft_consensus.cc:385] T 7ed73594956241f4b3e6e456bae82964 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:01.600670  8608 leader_election.cc:290] T a79ccdf7d9cf4be7bf8b0c69bf90538a P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429), b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503)
I20260709 13:02:01.601810  8553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79ccdf7d9cf4be7bf8b0c69bf90538a" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3" is_pre_election: true
I20260709 13:02:01.602174  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a79ccdf7d9cf4be7bf8b0c69bf90538a" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
I20260709 13:02:01.603377  8475 raft_consensus.cc:2393] T a79ccdf7d9cf4be7bf8b0c69bf90538a P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 590ee39ce5734876b94d91fc3931b807 in current term 1: Already voted for candidate b560e9aaec7a4c78b9123b38e73519a3 in this term.
I20260709 13:02:01.600466  8601 raft_consensus.cc:740] T 7ed73594956241f4b3e6e456bae82964 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.604730  8601 consensus_queue.cc:260] T 7ed73594956241f4b3e6e456bae82964 P b560e9aaec7a4c78b9123b38e73519a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:01.604898  8295 leader_election.cc:304] T a79ccdf7d9cf4be7bf8b0c69bf90538a P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807; no voters: 7b3ea460d1294b8a82672d7c21475cb5, b560e9aaec7a4c78b9123b38e73519a3
I20260709 13:02:01.609993  8598 tablet_bootstrap.cc:492] T cb85497b295d4b3f8cda882af3676c65 P 53a66c851dc74c70b94c65d464a391f6: No bootstrap required, opened a new log
I20260709 13:02:01.610544  8598 ts_tablet_manager.cc:1403] T cb85497b295d4b3f8cda882af3676c65 P 53a66c851dc74c70b94c65d464a391f6: Time spent bootstrapping tablet: real 0.099s	user 0.021s	sys 0.026s
I20260709 13:02:01.614128  8651 consensus_queue.cc:1048] T 6433163abeff4ee0b011d159ca454a6a P 7b3ea460d1294b8a82672d7c21475cb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:01.613902  8598 raft_consensus.cc:359] T cb85497b295d4b3f8cda882af3676c65 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:01.615212  8598 raft_consensus.cc:385] T cb85497b295d4b3f8cda882af3676c65 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:01.615430  8608 raft_consensus.cc:3060] T a79ccdf7d9cf4be7bf8b0c69bf90538a P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.615526  8598 raft_consensus.cc:740] T cb85497b295d4b3f8cda882af3676c65 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.608615  8627 raft_consensus.cc:493] T ae8659e834df408ab36dd56103f10ae4 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.617265  8627 raft_consensus.cc:515] T ae8659e834df408ab36dd56103f10ae4 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:01.617463  8598 consensus_queue.cc:260] T cb85497b295d4b3f8cda882af3676c65 P 53a66c851dc74c70b94c65d464a391f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:01.620107  8598 ts_tablet_manager.cc:1434] T cb85497b295d4b3f8cda882af3676c65 P 53a66c851dc74c70b94c65d464a391f6: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:02:01.620781  8627 leader_election.cc:290] T ae8659e834df408ab36dd56103f10ae4 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751), b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503)
I20260709 13:02:01.621371  8598 tablet_bootstrap.cc:492] T 3921dc7d601b4e4ea05f40ca34d69819 P 53a66c851dc74c70b94c65d464a391f6: Bootstrap starting.
I20260709 13:02:01.623242  8401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae8659e834df408ab36dd56103f10ae4" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:02:01.624516  8551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae8659e834df408ab36dd56103f10ae4" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3" is_pre_election: true
I20260709 13:02:01.627393  8444 leader_election.cc:304] T ae8659e834df408ab36dd56103f10ae4 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b3ea460d1294b8a82672d7c21475cb5; no voters: 53a66c851dc74c70b94c65d464a391f6, b560e9aaec7a4c78b9123b38e73519a3
I20260709 13:02:01.631197  8598 tablet_bootstrap.cc:654] T 3921dc7d601b4e4ea05f40ca34d69819 P 53a66c851dc74c70b94c65d464a391f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:01.635284  8651 raft_consensus.cc:2749] T ae8659e834df408ab36dd56103f10ae4 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:01.643349  8608 raft_consensus.cc:2749] T a79ccdf7d9cf4be7bf8b0c69bf90538a P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:01.658361  8651 consensus_queue.cc:1048] T 6433163abeff4ee0b011d159ca454a6a P 7b3ea460d1294b8a82672d7c21475cb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:02:01.665177  8602 tablet_bootstrap.cc:492] T 7ed73594956241f4b3e6e456bae82964 P 7b3ea460d1294b8a82672d7c21475cb5: No bootstrap required, opened a new log
I20260709 13:02:01.665727  8602 ts_tablet_manager.cc:1403] T 7ed73594956241f4b3e6e456bae82964 P 7b3ea460d1294b8a82672d7c21475cb5: Time spent bootstrapping tablet: real 0.171s	user 0.020s	sys 0.029s
I20260709 13:02:01.667300  8601 ts_tablet_manager.cc:1434] T 7ed73594956241f4b3e6e456bae82964 P b560e9aaec7a4c78b9123b38e73519a3: Time spent starting tablet: real 0.071s	user 0.009s	sys 0.001s
I20260709 13:02:01.656832  8605 consensus_queue.cc:1048] T 7c9804c61fdb47a7958574869d381b72 P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:02:01.668440  8601 tablet_bootstrap.cc:492] T d4791a5544bd4cbf8f7e3a05f62a9370 P b560e9aaec7a4c78b9123b38e73519a3: Bootstrap starting.
I20260709 13:02:01.669298  8602 raft_consensus.cc:359] T 7ed73594956241f4b3e6e456bae82964 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:01.670030  8602 raft_consensus.cc:385] T 7ed73594956241f4b3e6e456bae82964 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:01.670292  8602 raft_consensus.cc:740] T 7ed73594956241f4b3e6e456bae82964 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.671178  8602 consensus_queue.cc:260] T 7ed73594956241f4b3e6e456bae82964 P 7b3ea460d1294b8a82672d7c21475cb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:01.672444  8660 consensus_queue.cc:1048] T a3a46de7366f4683a88d19d25ad04901 P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:01.675691  8661 consensus_queue.cc:1048] T 7c9804c61fdb47a7958574869d381b72 P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:01.677577  8602 ts_tablet_manager.cc:1434] T 7ed73594956241f4b3e6e456bae82964 P 7b3ea460d1294b8a82672d7c21475cb5: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:02:01.679524  8602 tablet_bootstrap.cc:492] T 6fffc940549b445c973a289ba1bebcb3 P 7b3ea460d1294b8a82672d7c21475cb5: Bootstrap starting.
I20260709 13:02:01.684741  8601 tablet_bootstrap.cc:654] T d4791a5544bd4cbf8f7e3a05f62a9370 P b560e9aaec7a4c78b9123b38e73519a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:01.688840  8701 consensus_queue.cc:1048] T a3a46de7366f4683a88d19d25ad04901 P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 13:02:01.680893  8443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42503, user_credentials={real_user=slave}} blocked reactor thread for 51174.1us
I20260709 13:02:01.688810  8661 raft_consensus.cc:493] T cb85497b295d4b3f8cda882af3676c65 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.693408  8600 tablet_bootstrap.cc:492] T cb85497b295d4b3f8cda882af3676c65 P 590ee39ce5734876b94d91fc3931b807: No bootstrap required, opened a new log
I20260709 13:02:01.693892  8600 ts_tablet_manager.cc:1403] T cb85497b295d4b3f8cda882af3676c65 P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.158s	user 0.039s	sys 0.026s
I20260709 13:02:01.690860  8720 raft_consensus.cc:493] T 7ed73594956241f4b3e6e456bae82964 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.695688  8720 raft_consensus.cc:515] T 7ed73594956241f4b3e6e456bae82964 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:01.692428  8661 raft_consensus.cc:515] T cb85497b295d4b3f8cda882af3676c65 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:01.704552  8598 tablet_bootstrap.cc:492] T 3921dc7d601b4e4ea05f40ca34d69819 P 53a66c851dc74c70b94c65d464a391f6: No bootstrap required, opened a new log
I20260709 13:02:01.705134  8598 ts_tablet_manager.cc:1403] T 3921dc7d601b4e4ea05f40ca34d69819 P 53a66c851dc74c70b94c65d464a391f6: Time spent bootstrapping tablet: real 0.084s	user 0.016s	sys 0.016s
I20260709 13:02:01.708377  8661 leader_election.cc:290] T cb85497b295d4b3f8cda882af3676c65 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:02:01.717420  8551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed73594956241f4b3e6e456bae82964" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3" is_pre_election: true
I20260709 13:02:01.709285  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb85497b295d4b3f8cda882af3676c65" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
I20260709 13:02:01.718276  8551 raft_consensus.cc:2468] T 7ed73594956241f4b3e6e456bae82964 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53a66c851dc74c70b94c65d464a391f6 in term 0.
I20260709 13:02:01.716269  8720 leader_election.cc:290] T 7ed73594956241f4b3e6e456bae82964 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429), b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503)
I20260709 13:02:01.709924  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb85497b295d4b3f8cda882af3676c65" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:02:01.719837  8402 raft_consensus.cc:2468] T cb85497b295d4b3f8cda882af3676c65 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 0.
I20260709 13:02:01.719736  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed73594956241f4b3e6e456bae82964" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
I20260709 13:02:01.720978  8479 raft_consensus.cc:2468] T 7ed73594956241f4b3e6e456bae82964 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53a66c851dc74c70b94c65d464a391f6 in term 0.
I20260709 13:02:01.721424  8518 leader_election.cc:304] T cb85497b295d4b3f8cda882af3676c65 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, b560e9aaec7a4c78b9123b38e73519a3; no voters: 
I20260709 13:02:01.722777  8370 leader_election.cc:304] T 7ed73594956241f4b3e6e456bae82964 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, 7b3ea460d1294b8a82672d7c21475cb5; no voters: 
W20260709 13:02:01.724202  8519 leader_election.cc:343] T cb85497b295d4b3f8cda882af3676c65 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:01.725978  8720 raft_consensus.cc:2804] T 7ed73594956241f4b3e6e456bae82964 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:01.726733  8600 raft_consensus.cc:359] T cb85497b295d4b3f8cda882af3676c65 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:01.727465  8600 raft_consensus.cc:385] T cb85497b295d4b3f8cda882af3676c65 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:01.727767  8600 raft_consensus.cc:740] T cb85497b295d4b3f8cda882af3676c65 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.708410  8598 raft_consensus.cc:359] T 3921dc7d601b4e4ea05f40ca34d69819 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:01.732784  8598 raft_consensus.cc:385] T 3921dc7d601b4e4ea05f40ca34d69819 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:01.733328  8598 raft_consensus.cc:740] T 3921dc7d601b4e4ea05f40ca34d69819 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.734388  8598 consensus_queue.cc:260] T 3921dc7d601b4e4ea05f40ca34d69819 P 53a66c851dc74c70b94c65d464a391f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:01.728672  8661 raft_consensus.cc:2804] T cb85497b295d4b3f8cda882af3676c65 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:01.736840  8600 consensus_queue.cc:260] T cb85497b295d4b3f8cda882af3676c65 P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:01.726588  8720 raft_consensus.cc:493] T 7ed73594956241f4b3e6e456bae82964 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:01.743392  8598 ts_tablet_manager.cc:1434] T 3921dc7d601b4e4ea05f40ca34d69819 P 53a66c851dc74c70b94c65d464a391f6: Time spent starting tablet: real 0.038s	user 0.012s	sys 0.003s
I20260709 13:02:01.745954  8602 tablet_bootstrap.cc:654] T 6fffc940549b445c973a289ba1bebcb3 P 7b3ea460d1294b8a82672d7c21475cb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:01.749706  8600 ts_tablet_manager.cc:1434] T cb85497b295d4b3f8cda882af3676c65 P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.056s	user 0.005s	sys 0.003s
I20260709 13:02:01.738338  8661 raft_consensus.cc:493] T cb85497b295d4b3f8cda882af3676c65 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:01.754889  8598 tablet_bootstrap.cc:492] T d4791a5544bd4cbf8f7e3a05f62a9370 P 53a66c851dc74c70b94c65d464a391f6: Bootstrap starting.
I20260709 13:02:01.753185  8720 raft_consensus.cc:3060] T 7ed73594956241f4b3e6e456bae82964 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.755772  8661 raft_consensus.cc:3060] T cb85497b295d4b3f8cda882af3676c65 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.768476  8605 consensus_queue.cc:1048] T a79ccdf7d9cf4be7bf8b0c69bf90538a P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:01.793118  8600 tablet_bootstrap.cc:492] T 3921dc7d601b4e4ea05f40ca34d69819 P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:01.803740  8661 raft_consensus.cc:515] T cb85497b295d4b3f8cda882af3676c65 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:01.815558  8479 raft_consensus.cc:3060] T ae8659e834df408ab36dd56103f10ae4 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.816315  8627 consensus_queue.cc:1048] T 8b0d84add64c4f5db82c90e98b7f4b74 P 7b3ea460d1294b8a82672d7c21475cb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:01.818871  8661 leader_election.cc:290] T cb85497b295d4b3f8cda882af3676c65 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 election: Requested vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:02:01.825169  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb85497b295d4b3f8cda882af3676c65" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807"
I20260709 13:02:01.825902  8326 raft_consensus.cc:3060] T cb85497b295d4b3f8cda882af3676c65 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.838610  8601 tablet_bootstrap.cc:492] T d4791a5544bd4cbf8f7e3a05f62a9370 P b560e9aaec7a4c78b9123b38e73519a3: No bootstrap required, opened a new log
I20260709 13:02:01.839347  8601 ts_tablet_manager.cc:1403] T d4791a5544bd4cbf8f7e3a05f62a9370 P b560e9aaec7a4c78b9123b38e73519a3: Time spent bootstrapping tablet: real 0.171s	user 0.013s	sys 0.005s
I20260709 13:02:01.840090  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb85497b295d4b3f8cda882af3676c65" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6"
I20260709 13:02:01.840756  8402 raft_consensus.cc:3060] T cb85497b295d4b3f8cda882af3676c65 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.844394  8601 raft_consensus.cc:359] T d4791a5544bd4cbf8f7e3a05f62a9370 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:01.845188  8601 raft_consensus.cc:385] T d4791a5544bd4cbf8f7e3a05f62a9370 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:01.845461  8601 raft_consensus.cc:740] T d4791a5544bd4cbf8f7e3a05f62a9370 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.845863  8708 consensus_queue.cc:1048] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:01.846122  8601 consensus_queue.cc:260] T d4791a5544bd4cbf8f7e3a05f62a9370 P b560e9aaec7a4c78b9123b38e73519a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:01.859246  8600 tablet_bootstrap.cc:654] T 3921dc7d601b4e4ea05f40ca34d69819 P 590ee39ce5734876b94d91fc3931b807: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:01.815593  8720 raft_consensus.cc:515] T 7ed73594956241f4b3e6e456bae82964 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:01.870319  8602 tablet_bootstrap.cc:492] T 6fffc940549b445c973a289ba1bebcb3 P 7b3ea460d1294b8a82672d7c21475cb5: No bootstrap required, opened a new log
I20260709 13:02:01.870889  8602 ts_tablet_manager.cc:1403] T 6fffc940549b445c973a289ba1bebcb3 P 7b3ea460d1294b8a82672d7c21475cb5: Time spent bootstrapping tablet: real 0.192s	user 0.022s	sys 0.034s
I20260709 13:02:01.870028  8402 raft_consensus.cc:2468] T cb85497b295d4b3f8cda882af3676c65 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 1.
I20260709 13:02:01.881934  8660 consensus_queue.cc:1048] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:01.883417  8518 leader_election.cc:304] T cb85497b295d4b3f8cda882af3676c65 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, b560e9aaec7a4c78b9123b38e73519a3; no voters: 
I20260709 13:02:01.884478  8799 raft_consensus.cc:2804] T cb85497b295d4b3f8cda882af3676c65 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:01.885013  8799 raft_consensus.cc:697] T cb85497b295d4b3f8cda882af3676c65 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Becoming Leader. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Running, Role: LEADER
I20260709 13:02:01.886143  8720 leader_election.cc:290] T 7ed73594956241f4b3e6e456bae82964 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 election: Requested vote from peers 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429), b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503)
I20260709 13:02:01.885895  8799 consensus_queue.cc:237] T cb85497b295d4b3f8cda882af3676c65 P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:01.888784  8551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed73594956241f4b3e6e456bae82964" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3"
I20260709 13:02:01.889400  8551 raft_consensus.cc:3060] T 7ed73594956241f4b3e6e456bae82964 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.877413  8326 raft_consensus.cc:2468] T cb85497b295d4b3f8cda882af3676c65 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 1.
I20260709 13:02:01.891156  8661 consensus_queue.cc:1048] T a79ccdf7d9cf4be7bf8b0c69bf90538a P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:01.892273  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed73594956241f4b3e6e456bae82964" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5"
I20260709 13:02:01.893388  8476 raft_consensus.cc:3060] T 7ed73594956241f4b3e6e456bae82964 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:01.901443  8551 raft_consensus.cc:2468] T 7ed73594956241f4b3e6e456bae82964 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53a66c851dc74c70b94c65d464a391f6 in term 1.
I20260709 13:02:01.902597  8601 ts_tablet_manager.cc:1434] T d4791a5544bd4cbf8f7e3a05f62a9370 P b560e9aaec7a4c78b9123b38e73519a3: Time spent starting tablet: real 0.063s	user 0.008s	sys 0.000s
I20260709 13:02:01.902833  8369 leader_election.cc:304] T 7ed73594956241f4b3e6e456bae82964 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, b560e9aaec7a4c78b9123b38e73519a3; no voters: 
I20260709 13:02:01.903719  8601 tablet_bootstrap.cc:492] T 62a3aed976de4d62a1d4dc7bc5252328 P b560e9aaec7a4c78b9123b38e73519a3: Bootstrap starting.
I20260709 13:02:01.904690  8720 raft_consensus.cc:2804] T 7ed73594956241f4b3e6e456bae82964 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:01.905177  8720 raft_consensus.cc:697] T 7ed73594956241f4b3e6e456bae82964 P 53a66c851dc74c70b94c65d464a391f6 [term 1 LEADER]: Becoming Leader. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Running, Role: LEADER
I20260709 13:02:01.907910  8720 consensus_queue.cc:237] T 7ed73594956241f4b3e6e456bae82964 P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:01.910079  8602 raft_consensus.cc:359] T 6fffc940549b445c973a289ba1bebcb3 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:01.910807  8602 raft_consensus.cc:385] T 6fffc940549b445c973a289ba1bebcb3 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:01.911075  8602 raft_consensus.cc:740] T 6fffc940549b445c973a289ba1bebcb3 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Initialized, Role: FOLLOWER
I20260709 13:02:01.914588  8602 consensus_queue.cc:260] T 6fffc940549b445c973a289ba1bebcb3 P 7b3ea460d1294b8a82672d7c21475cb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:01.915395  8819 consensus_queue.cc:1048] T 8b0d84add64c4f5db82c90e98b7f4b74 P 7b3ea460d1294b8a82672d7c21475cb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:01.916981  8602 ts_tablet_manager.cc:1434] T 6fffc940549b445c973a289ba1bebcb3 P 7b3ea460d1294b8a82672d7c21475cb5: Time spent starting tablet: real 0.046s	user 0.004s	sys 0.004s
I20260709 13:02:01.903054  8476 raft_consensus.cc:2468] T 7ed73594956241f4b3e6e456bae82964 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53a66c851dc74c70b94c65d464a391f6 in term 1.
I20260709 13:02:01.938936  8598 tablet_bootstrap.cc:654] T d4791a5544bd4cbf8f7e3a05f62a9370 P 53a66c851dc74c70b94c65d464a391f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:01.957342  8601 tablet_bootstrap.cc:654] T 62a3aed976de4d62a1d4dc7bc5252328 P b560e9aaec7a4c78b9123b38e73519a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:01.971604  8602 tablet_bootstrap.cc:492] T 3921dc7d601b4e4ea05f40ca34d69819 P 7b3ea460d1294b8a82672d7c21475cb5: Bootstrap starting.
I20260709 13:02:01.955235  8660 raft_consensus.cc:493] T 3921dc7d601b4e4ea05f40ca34d69819 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.987428  8821 raft_consensus.cc:493] T 62a3aed976de4d62a1d4dc7bc5252328 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:01.987690  8660 raft_consensus.cc:515] T 3921dc7d601b4e4ea05f40ca34d69819 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:02.016692  8660 leader_election.cc:290] T 3921dc7d601b4e4ea05f40ca34d69819 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:02:02.051802  8598 tablet_bootstrap.cc:492] T d4791a5544bd4cbf8f7e3a05f62a9370 P 53a66c851dc74c70b94c65d464a391f6: No bootstrap required, opened a new log
I20260709 13:02:02.052382  8598 ts_tablet_manager.cc:1403] T d4791a5544bd4cbf8f7e3a05f62a9370 P 53a66c851dc74c70b94c65d464a391f6: Time spent bootstrapping tablet: real 0.308s	user 0.029s	sys 0.014s
I20260709 13:02:02.052884  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3921dc7d601b4e4ea05f40ca34d69819" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
I20260709 13:02:02.019695  8821 raft_consensus.cc:515] T 62a3aed976de4d62a1d4dc7bc5252328 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
W20260709 13:02:02.062943  8370 leader_election.cc:343] T 3921dc7d601b4e4ea05f40ca34d69819 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:02.064579  8226 catalog_manager.cc:5697] T 7ed73594956241f4b3e6e456bae82964 P 53a66c851dc74c70b94c65d464a391f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "53a66c851dc74c70b94c65d464a391f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:02.066749  8821 leader_election.cc:290] T 62a3aed976de4d62a1d4dc7bc5252328 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
W20260709 13:02:02.070474  8835 log.cc:927] Time spent T 73b7ef1c3ead4480b17e7ce7da20f5f5 P b560e9aaec7a4c78b9123b38e73519a3: Append to log took a long time: real 0.067s	user 0.001s	sys 0.000s
I20260709 13:02:02.070570  8598 raft_consensus.cc:359] T d4791a5544bd4cbf8f7e3a05f62a9370 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:02.071497  8598 raft_consensus.cc:385] T d4791a5544bd4cbf8f7e3a05f62a9370 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:02.071761  8598 raft_consensus.cc:740] T d4791a5544bd4cbf8f7e3a05f62a9370 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Initialized, Role: FOLLOWER
I20260709 13:02:02.072449  8598 consensus_queue.cc:260] T d4791a5544bd4cbf8f7e3a05f62a9370 P 53a66c851dc74c70b94c65d464a391f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
W20260709 13:02:02.061898  8371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40837, user_credentials={real_user=slave}} blocked reactor thread for 97502.1us
I20260709 13:02:02.083736  8224 catalog_manager.cc:5697] T cb85497b295d4b3f8cda882af3676c65 P b560e9aaec7a4c78b9123b38e73519a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "b560e9aaec7a4c78b9123b38e73519a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:02.086881  8598 ts_tablet_manager.cc:1434] T d4791a5544bd4cbf8f7e3a05f62a9370 P 53a66c851dc74c70b94c65d464a391f6: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.000s
I20260709 13:02:02.092639  8600 tablet_bootstrap.cc:492] T 3921dc7d601b4e4ea05f40ca34d69819 P 590ee39ce5734876b94d91fc3931b807: No bootstrap required, opened a new log
I20260709 13:02:02.093261  8600 ts_tablet_manager.cc:1403] T 3921dc7d601b4e4ea05f40ca34d69819 P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.306s	user 0.014s	sys 0.008s
I20260709 13:02:02.095335  8598 tablet_bootstrap.cc:492] T 435da692a6474cb697066524d4f5216e P 53a66c851dc74c70b94c65d464a391f6: Bootstrap starting.
I20260709 13:02:02.102974  8551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a3aed976de4d62a1d4dc7bc5252328" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3" is_pre_election: true
W20260709 13:02:02.106952  8443 leader_election.cc:343] T 62a3aed976de4d62a1d4dc7bc5252328 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:02.108475  8445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40837, user_credentials={real_user=slave}} blocked reactor thread for 45041.3us
I20260709 13:02:02.108862  8598 tablet_bootstrap.cc:654] T 435da692a6474cb697066524d4f5216e P 53a66c851dc74c70b94c65d464a391f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:02.116786  8600 raft_consensus.cc:359] T 3921dc7d601b4e4ea05f40ca34d69819 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:02.117587  8600 raft_consensus.cc:385] T 3921dc7d601b4e4ea05f40ca34d69819 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:02.117853  8600 raft_consensus.cc:740] T 3921dc7d601b4e4ea05f40ca34d69819 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:02.118518  8600 consensus_queue.cc:260] T 3921dc7d601b4e4ea05f40ca34d69819 P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:02.120035  8600 ts_tablet_manager.cc:1434] T 3921dc7d601b4e4ea05f40ca34d69819 P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.026s	user 0.001s	sys 0.001s
I20260709 13:02:02.124465  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a3aed976de4d62a1d4dc7bc5252328" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
I20260709 13:02:02.125284  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3921dc7d601b4e4ea05f40ca34d69819" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
I20260709 13:02:02.126031  8329 raft_consensus.cc:2468] T 3921dc7d601b4e4ea05f40ca34d69819 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53a66c851dc74c70b94c65d464a391f6 in term 0.
W20260709 13:02:02.131120  8445 leader_election.cc:343] T 62a3aed976de4d62a1d4dc7bc5252328 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:02.131837  8445 leader_election.cc:304] T 62a3aed976de4d62a1d4dc7bc5252328 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b3ea460d1294b8a82672d7c21475cb5; no voters: 590ee39ce5734876b94d91fc3931b807, b560e9aaec7a4c78b9123b38e73519a3
I20260709 13:02:02.133031  8627 raft_consensus.cc:2749] T 62a3aed976de4d62a1d4dc7bc5252328 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:02.148702  8605 raft_consensus.cc:493] T d4791a5544bd4cbf8f7e3a05f62a9370 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.149372  8605 raft_consensus.cc:515] T d4791a5544bd4cbf8f7e3a05f62a9370 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:02.151623  8605 leader_election.cc:290] T d4791a5544bd4cbf8f7e3a05f62a9370 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:02:02.154707  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4791a5544bd4cbf8f7e3a05f62a9370" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:02:02.155426  8404 raft_consensus.cc:2468] T d4791a5544bd4cbf8f7e3a05f62a9370 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 0.
I20260709 13:02:02.155524  8371 leader_election.cc:304] T 3921dc7d601b4e4ea05f40ca34d69819 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, 590ee39ce5734876b94d91fc3931b807; no voters: 7b3ea460d1294b8a82672d7c21475cb5
I20260709 13:02:02.159529  8708 raft_consensus.cc:2804] T 3921dc7d601b4e4ea05f40ca34d69819 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:02.159976  8708 raft_consensus.cc:493] T 3921dc7d601b4e4ea05f40ca34d69819 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:02.160362  8708 raft_consensus.cc:3060] T 3921dc7d601b4e4ea05f40ca34d69819 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:02.161571  8518 leader_election.cc:304] T d4791a5544bd4cbf8f7e3a05f62a9370 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, b560e9aaec7a4c78b9123b38e73519a3; no voters: 
I20260709 13:02:02.163645  8661 raft_consensus.cc:2804] T d4791a5544bd4cbf8f7e3a05f62a9370 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:02.165180  8661 raft_consensus.cc:493] T d4791a5544bd4cbf8f7e3a05f62a9370 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:02.167359  8661 raft_consensus.cc:3060] T d4791a5544bd4cbf8f7e3a05f62a9370 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:02.171975  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4791a5544bd4cbf8f7e3a05f62a9370" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
I20260709 13:02:02.179675  8661 raft_consensus.cc:515] T d4791a5544bd4cbf8f7e3a05f62a9370 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:02.182232  8661 leader_election.cc:290] T d4791a5544bd4cbf8f7e3a05f62a9370 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 election: Requested vote from peers 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:02:02.183256  8600 tablet_bootstrap.cc:492] T 62a3aed976de4d62a1d4dc7bc5252328 P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:02.186692  8708 raft_consensus.cc:515] T 3921dc7d601b4e4ea05f40ca34d69819 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:02.199433  8708 leader_election.cc:290] T 3921dc7d601b4e4ea05f40ca34d69819 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 election: Requested vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:02:02.199919  8600 tablet_bootstrap.cc:654] T 62a3aed976de4d62a1d4dc7bc5252328 P 590ee39ce5734876b94d91fc3931b807: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:02.200850  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3921dc7d601b4e4ea05f40ca34d69819" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5"
W20260709 13:02:02.202750  8518 leader_election.cc:343] T d4791a5544bd4cbf8f7e3a05f62a9370 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:02.203361  8370 leader_election.cc:343] T 3921dc7d601b4e4ea05f40ca34d69819 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:02.202193  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4791a5544bd4cbf8f7e3a05f62a9370" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6"
I20260709 13:02:02.207515  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3921dc7d601b4e4ea05f40ca34d69819" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807"
I20260709 13:02:02.212707  8330 raft_consensus.cc:3060] T 3921dc7d601b4e4ea05f40ca34d69819 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:02.204298  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4791a5544bd4cbf8f7e3a05f62a9370" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5"
I20260709 13:02:02.201974  8602 tablet_bootstrap.cc:654] T 3921dc7d601b4e4ea05f40ca34d69819 P 7b3ea460d1294b8a82672d7c21475cb5: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:02.214756  8518 leader_election.cc:343] T d4791a5544bd4cbf8f7e3a05f62a9370 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:02.205168  8601 tablet_bootstrap.cc:492] T 62a3aed976de4d62a1d4dc7bc5252328 P b560e9aaec7a4c78b9123b38e73519a3: No bootstrap required, opened a new log
I20260709 13:02:02.218926  8601 ts_tablet_manager.cc:1403] T 62a3aed976de4d62a1d4dc7bc5252328 P b560e9aaec7a4c78b9123b38e73519a3: Time spent bootstrapping tablet: real 0.315s	user 0.024s	sys 0.039s
I20260709 13:02:02.219359  8330 raft_consensus.cc:2468] T 3921dc7d601b4e4ea05f40ca34d69819 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53a66c851dc74c70b94c65d464a391f6 in term 1.
I20260709 13:02:02.220674  8371 leader_election.cc:304] T 3921dc7d601b4e4ea05f40ca34d69819 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, 590ee39ce5734876b94d91fc3931b807; no voters: 7b3ea460d1294b8a82672d7c21475cb5
I20260709 13:02:02.221781  8708 raft_consensus.cc:2804] T 3921dc7d601b4e4ea05f40ca34d69819 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:02.221803  8601 raft_consensus.cc:359] T 62a3aed976de4d62a1d4dc7bc5252328 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:02.223078  8601 raft_consensus.cc:385] T 62a3aed976de4d62a1d4dc7bc5252328 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:02.223330  8601 raft_consensus.cc:740] T 62a3aed976de4d62a1d4dc7bc5252328 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Initialized, Role: FOLLOWER
I20260709 13:02:02.224042  8601 consensus_queue.cc:260] T 62a3aed976de4d62a1d4dc7bc5252328 P b560e9aaec7a4c78b9123b38e73519a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:02.226119  8601 ts_tablet_manager.cc:1434] T 62a3aed976de4d62a1d4dc7bc5252328 P b560e9aaec7a4c78b9123b38e73519a3: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:02:02.227146  8601 tablet_bootstrap.cc:492] T 5db51a6d67e6461a98e669fa2b1e59c8 P b560e9aaec7a4c78b9123b38e73519a3: Bootstrap starting.
I20260709 13:02:02.228791  8708 raft_consensus.cc:697] T 3921dc7d601b4e4ea05f40ca34d69819 P 53a66c851dc74c70b94c65d464a391f6 [term 1 LEADER]: Becoming Leader. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Running, Role: LEADER
I20260709 13:02:02.229439  8600 tablet_bootstrap.cc:492] T 62a3aed976de4d62a1d4dc7bc5252328 P 590ee39ce5734876b94d91fc3931b807: No bootstrap required, opened a new log
I20260709 13:02:02.205071  8402 raft_consensus.cc:3060] T d4791a5544bd4cbf8f7e3a05f62a9370 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:02.229961  8600 ts_tablet_manager.cc:1403] T 62a3aed976de4d62a1d4dc7bc5252328 P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.065s	user 0.009s	sys 0.004s
I20260709 13:02:02.233991  8600 raft_consensus.cc:359] T 62a3aed976de4d62a1d4dc7bc5252328 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:02.234671  8600 raft_consensus.cc:385] T 62a3aed976de4d62a1d4dc7bc5252328 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:02.234956  8600 raft_consensus.cc:740] T 62a3aed976de4d62a1d4dc7bc5252328 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:02.235772  8600 consensus_queue.cc:260] T 62a3aed976de4d62a1d4dc7bc5252328 P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:02.238139  8600 ts_tablet_manager.cc:1434] T 62a3aed976de4d62a1d4dc7bc5252328 P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:02:02.238528  8601 tablet_bootstrap.cc:654] T 5db51a6d67e6461a98e669fa2b1e59c8 P b560e9aaec7a4c78b9123b38e73519a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:02.239284  8600 tablet_bootstrap.cc:492] T 6fffc940549b445c973a289ba1bebcb3 P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:02.229877  8708 consensus_queue.cc:237] T 3921dc7d601b4e4ea05f40ca34d69819 P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:02.248247  8402 raft_consensus.cc:2468] T d4791a5544bd4cbf8f7e3a05f62a9370 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 1.
I20260709 13:02:02.251212  8600 tablet_bootstrap.cc:654] T 6fffc940549b445c973a289ba1bebcb3 P 590ee39ce5734876b94d91fc3931b807: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:02.257192  8518 leader_election.cc:304] T d4791a5544bd4cbf8f7e3a05f62a9370 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, b560e9aaec7a4c78b9123b38e73519a3; no voters: 7b3ea460d1294b8a82672d7c21475cb5
I20260709 13:02:02.258883  8605 raft_consensus.cc:2804] T d4791a5544bd4cbf8f7e3a05f62a9370 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:02.259513  8605 raft_consensus.cc:697] T d4791a5544bd4cbf8f7e3a05f62a9370 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Becoming Leader. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Running, Role: LEADER
I20260709 13:02:02.260449  8605 consensus_queue.cc:237] T d4791a5544bd4cbf8f7e3a05f62a9370 P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:02.261863  8601 tablet_bootstrap.cc:492] T 5db51a6d67e6461a98e669fa2b1e59c8 P b560e9aaec7a4c78b9123b38e73519a3: No bootstrap required, opened a new log
I20260709 13:02:02.262398  8601 ts_tablet_manager.cc:1403] T 5db51a6d67e6461a98e669fa2b1e59c8 P b560e9aaec7a4c78b9123b38e73519a3: Time spent bootstrapping tablet: real 0.036s	user 0.008s	sys 0.004s
I20260709 13:02:02.265489  8601 raft_consensus.cc:359] T 5db51a6d67e6461a98e669fa2b1e59c8 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:02.266155  8601 raft_consensus.cc:385] T 5db51a6d67e6461a98e669fa2b1e59c8 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:02.266464  8601 raft_consensus.cc:740] T 5db51a6d67e6461a98e669fa2b1e59c8 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Initialized, Role: FOLLOWER
I20260709 13:02:02.267248  8601 consensus_queue.cc:260] T 5db51a6d67e6461a98e669fa2b1e59c8 P b560e9aaec7a4c78b9123b38e73519a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:02.274665  8601 ts_tablet_manager.cc:1434] T 5db51a6d67e6461a98e669fa2b1e59c8 P b560e9aaec7a4c78b9123b38e73519a3: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:02:02.274739  8600 tablet_bootstrap.cc:492] T 6fffc940549b445c973a289ba1bebcb3 P 590ee39ce5734876b94d91fc3931b807: No bootstrap required, opened a new log
I20260709 13:02:02.275378  8600 ts_tablet_manager.cc:1403] T 6fffc940549b445c973a289ba1bebcb3 P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.036s	user 0.008s	sys 0.004s
I20260709 13:02:02.275641  8601 tablet_bootstrap.cc:492] T 4d5829b9233a48fea0290d9bb023f97e P b560e9aaec7a4c78b9123b38e73519a3: Bootstrap starting.
I20260709 13:02:02.278688  8600 raft_consensus.cc:359] T 6fffc940549b445c973a289ba1bebcb3 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:02.279443  8600 raft_consensus.cc:385] T 6fffc940549b445c973a289ba1bebcb3 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:02.279757  8600 raft_consensus.cc:740] T 6fffc940549b445c973a289ba1bebcb3 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:02.280592  8600 consensus_queue.cc:260] T 6fffc940549b445c973a289ba1bebcb3 P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:02.282305  8601 tablet_bootstrap.cc:654] T 4d5829b9233a48fea0290d9bb023f97e P b560e9aaec7a4c78b9123b38e73519a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:02.283156  8600 ts_tablet_manager.cc:1434] T 6fffc940549b445c973a289ba1bebcb3 P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:02:02.284322  8600 tablet_bootstrap.cc:492] T 30e220d65bed42489b2af858d3a60981 P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:02.285748  8598 tablet_bootstrap.cc:492] T 435da692a6474cb697066524d4f5216e P 53a66c851dc74c70b94c65d464a391f6: No bootstrap required, opened a new log
I20260709 13:02:02.287024  8598 ts_tablet_manager.cc:1403] T 435da692a6474cb697066524d4f5216e P 53a66c851dc74c70b94c65d464a391f6: Time spent bootstrapping tablet: real 0.193s	user 0.014s	sys 0.007s
I20260709 13:02:02.288157  8602 tablet_bootstrap.cc:492] T 3921dc7d601b4e4ea05f40ca34d69819 P 7b3ea460d1294b8a82672d7c21475cb5: No bootstrap required, opened a new log
I20260709 13:02:02.288744  8602 ts_tablet_manager.cc:1403] T 3921dc7d601b4e4ea05f40ca34d69819 P 7b3ea460d1294b8a82672d7c21475cb5: Time spent bootstrapping tablet: real 0.351s	user 0.016s	sys 0.000s
I20260709 13:02:02.290889  8598 raft_consensus.cc:359] T 435da692a6474cb697066524d4f5216e P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:02.291994  8598 raft_consensus.cc:385] T 435da692a6474cb697066524d4f5216e P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:02.291718  8602 raft_consensus.cc:359] T 3921dc7d601b4e4ea05f40ca34d69819 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:02.292412  8598 raft_consensus.cc:740] T 435da692a6474cb697066524d4f5216e P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Initialized, Role: FOLLOWER
I20260709 13:02:02.292649  8602 raft_consensus.cc:385] T 3921dc7d601b4e4ea05f40ca34d69819 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:02.293432  8602 raft_consensus.cc:740] T 3921dc7d601b4e4ea05f40ca34d69819 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Initialized, Role: FOLLOWER
I20260709 13:02:02.294456  8601 tablet_bootstrap.cc:492] T 4d5829b9233a48fea0290d9bb023f97e P b560e9aaec7a4c78b9123b38e73519a3: No bootstrap required, opened a new log
I20260709 13:02:02.294235  8602 consensus_queue.cc:260] T 3921dc7d601b4e4ea05f40ca34d69819 P 7b3ea460d1294b8a82672d7c21475cb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:02.294967  8601 ts_tablet_manager.cc:1403] T 4d5829b9233a48fea0290d9bb023f97e P b560e9aaec7a4c78b9123b38e73519a3: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.004s
I20260709 13:02:02.296556  8602 ts_tablet_manager.cc:1434] T 3921dc7d601b4e4ea05f40ca34d69819 P 7b3ea460d1294b8a82672d7c21475cb5: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:02:02.296998  8819 raft_consensus.cc:493] T 6fffc940549b445c973a289ba1bebcb3 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.298241  8819 raft_consensus.cc:515] T 6fffc940549b445c973a289ba1bebcb3 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:02.298799  8602 tablet_bootstrap.cc:492] T 435da692a6474cb697066524d4f5216e P 7b3ea460d1294b8a82672d7c21475cb5: Bootstrap starting.
I20260709 13:02:02.301616  8550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fffc940549b445c973a289ba1bebcb3" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3" is_pre_election: true
I20260709 13:02:02.301839  8601 raft_consensus.cc:359] T 4d5829b9233a48fea0290d9bb023f97e P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:02.302356  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fffc940549b445c973a289ba1bebcb3" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
I20260709 13:02:02.297092  8598 consensus_queue.cc:260] T 435da692a6474cb697066524d4f5216e P 53a66c851dc74c70b94c65d464a391f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:02.297574  8600 tablet_bootstrap.cc:654] T 30e220d65bed42489b2af858d3a60981 P 590ee39ce5734876b94d91fc3931b807: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:02.302968  8550 raft_consensus.cc:2468] T 6fffc940549b445c973a289ba1bebcb3 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b3ea460d1294b8a82672d7c21475cb5 in term 0.
I20260709 13:02:02.303061  8819 leader_election.cc:290] T 6fffc940549b445c973a289ba1bebcb3 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:02:02.303150  8330 raft_consensus.cc:2468] T 6fffc940549b445c973a289ba1bebcb3 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b3ea460d1294b8a82672d7c21475cb5 in term 0.
I20260709 13:02:02.304453  8598 ts_tablet_manager.cc:1434] T 435da692a6474cb697066524d4f5216e P 53a66c851dc74c70b94c65d464a391f6: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 13:02:02.304618  8443 leader_election.cc:304] T 6fffc940549b445c973a289ba1bebcb3 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b3ea460d1294b8a82672d7c21475cb5, b560e9aaec7a4c78b9123b38e73519a3; no voters: 
I20260709 13:02:02.305613  8598 tablet_bootstrap.cc:492] T 4d5829b9233a48fea0290d9bb023f97e P 53a66c851dc74c70b94c65d464a391f6: Bootstrap starting.
I20260709 13:02:02.305843  8819 raft_consensus.cc:2804] T 6fffc940549b445c973a289ba1bebcb3 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:02.306319  8819 raft_consensus.cc:493] T 6fffc940549b445c973a289ba1bebcb3 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:02.306732  8819 raft_consensus.cc:3060] T 6fffc940549b445c973a289ba1bebcb3 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:02.309494  8602 tablet_bootstrap.cc:654] T 435da692a6474cb697066524d4f5216e P 7b3ea460d1294b8a82672d7c21475cb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:02.309541  8600 tablet_bootstrap.cc:492] T 30e220d65bed42489b2af858d3a60981 P 590ee39ce5734876b94d91fc3931b807: No bootstrap required, opened a new log
I20260709 13:02:02.310366  8600 ts_tablet_manager.cc:1403] T 30e220d65bed42489b2af858d3a60981 P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.000s
I20260709 13:02:02.302639  8601 raft_consensus.cc:385] T 4d5829b9233a48fea0290d9bb023f97e P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:02.311722  8601 raft_consensus.cc:740] T 4d5829b9233a48fea0290d9bb023f97e P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Initialized, Role: FOLLOWER
I20260709 13:02:02.312088  8598 tablet_bootstrap.cc:654] T 4d5829b9233a48fea0290d9bb023f97e P 53a66c851dc74c70b94c65d464a391f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:02.312788  8601 consensus_queue.cc:260] T 4d5829b9233a48fea0290d9bb023f97e P b560e9aaec7a4c78b9123b38e73519a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:02.313913  8600 raft_consensus.cc:359] T 30e220d65bed42489b2af858d3a60981 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:02.314785  8600 raft_consensus.cc:385] T 30e220d65bed42489b2af858d3a60981 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:02.315256  8601 ts_tablet_manager.cc:1434] T 4d5829b9233a48fea0290d9bb023f97e P b560e9aaec7a4c78b9123b38e73519a3: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.002s
I20260709 13:02:02.316319  8600 raft_consensus.cc:740] T 30e220d65bed42489b2af858d3a60981 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:02.317080  8601 tablet_bootstrap.cc:492] T 435da692a6474cb697066524d4f5216e P b560e9aaec7a4c78b9123b38e73519a3: Bootstrap starting.
I20260709 13:02:02.317474  8600 consensus_queue.cc:260] T 30e220d65bed42489b2af858d3a60981 P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:02.320514  8600 ts_tablet_manager.cc:1434] T 30e220d65bed42489b2af858d3a60981 P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:02:02.321725  8600 tablet_bootstrap.cc:492] T 5db51a6d67e6461a98e669fa2b1e59c8 P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:02.323814  8601 tablet_bootstrap.cc:654] T 435da692a6474cb697066524d4f5216e P b560e9aaec7a4c78b9123b38e73519a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:02.328208  8600 tablet_bootstrap.cc:654] T 5db51a6d67e6461a98e669fa2b1e59c8 P 590ee39ce5734876b94d91fc3931b807: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:02.329186  8598 tablet_bootstrap.cc:492] T 4d5829b9233a48fea0290d9bb023f97e P 53a66c851dc74c70b94c65d464a391f6: No bootstrap required, opened a new log
I20260709 13:02:02.329653  8598 ts_tablet_manager.cc:1403] T 4d5829b9233a48fea0290d9bb023f97e P 53a66c851dc74c70b94c65d464a391f6: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.002s
I20260709 13:02:02.333710  8602 tablet_bootstrap.cc:492] T 435da692a6474cb697066524d4f5216e P 7b3ea460d1294b8a82672d7c21475cb5: No bootstrap required, opened a new log
I20260709 13:02:02.334446  8602 ts_tablet_manager.cc:1403] T 435da692a6474cb697066524d4f5216e P 7b3ea460d1294b8a82672d7c21475cb5: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.000s
I20260709 13:02:02.340061  8602 raft_consensus.cc:359] T 435da692a6474cb697066524d4f5216e P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:02.335381  8598 raft_consensus.cc:359] T 4d5829b9233a48fea0290d9bb023f97e P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:02.341697  8602 raft_consensus.cc:385] T 435da692a6474cb697066524d4f5216e P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:02.341837  8598 raft_consensus.cc:385] T 4d5829b9233a48fea0290d9bb023f97e P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:02.342096  8602 raft_consensus.cc:740] T 435da692a6474cb697066524d4f5216e P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Initialized, Role: FOLLOWER
I20260709 13:02:02.342265  8598 raft_consensus.cc:740] T 4d5829b9233a48fea0290d9bb023f97e P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Initialized, Role: FOLLOWER
I20260709 13:02:02.342996  8602 consensus_queue.cc:260] T 435da692a6474cb697066524d4f5216e P 7b3ea460d1294b8a82672d7c21475cb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:02.343210  8598 consensus_queue.cc:260] T 4d5829b9233a48fea0290d9bb023f97e P 53a66c851dc74c70b94c65d464a391f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:02.345264  8602 ts_tablet_manager.cc:1434] T 435da692a6474cb697066524d4f5216e P 7b3ea460d1294b8a82672d7c21475cb5: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:02:02.345542  8598 ts_tablet_manager.cc:1434] T 4d5829b9233a48fea0290d9bb023f97e P 53a66c851dc74c70b94c65d464a391f6: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.004s
I20260709 13:02:02.346259  8602 tablet_bootstrap.cc:492] T d4791a5544bd4cbf8f7e3a05f62a9370 P 7b3ea460d1294b8a82672d7c21475cb5: Bootstrap starting.
I20260709 13:02:02.346997  8598 tablet_bootstrap.cc:492] T 1fe73d50e76147ebace9610e09de74a5 P 53a66c851dc74c70b94c65d464a391f6: Bootstrap starting.
I20260709 13:02:02.349213  8601 tablet_bootstrap.cc:492] T 435da692a6474cb697066524d4f5216e P b560e9aaec7a4c78b9123b38e73519a3: No bootstrap required, opened a new log
I20260709 13:02:02.352169  8601 ts_tablet_manager.cc:1403] T 435da692a6474cb697066524d4f5216e P b560e9aaec7a4c78b9123b38e73519a3: Time spent bootstrapping tablet: real 0.035s	user 0.003s	sys 0.017s
I20260709 13:02:02.353341  8602 tablet_bootstrap.cc:654] T d4791a5544bd4cbf8f7e3a05f62a9370 P 7b3ea460d1294b8a82672d7c21475cb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:02.355439  8601 raft_consensus.cc:359] T 435da692a6474cb697066524d4f5216e P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:02.362586  8601 raft_consensus.cc:385] T 435da692a6474cb697066524d4f5216e P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:02.362967  8601 raft_consensus.cc:740] T 435da692a6474cb697066524d4f5216e P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Initialized, Role: FOLLOWER
I20260709 13:02:02.363752  8601 consensus_queue.cc:260] T 435da692a6474cb697066524d4f5216e P b560e9aaec7a4c78b9123b38e73519a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:02.364558  8602 tablet_bootstrap.cc:492] T d4791a5544bd4cbf8f7e3a05f62a9370 P 7b3ea460d1294b8a82672d7c21475cb5: No bootstrap required, opened a new log
I20260709 13:02:02.365041  8602 ts_tablet_manager.cc:1403] T d4791a5544bd4cbf8f7e3a05f62a9370 P 7b3ea460d1294b8a82672d7c21475cb5: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.002s
I20260709 13:02:02.366032  8601 ts_tablet_manager.cc:1434] T 435da692a6474cb697066524d4f5216e P b560e9aaec7a4c78b9123b38e73519a3: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:02:02.367169  8601 tablet_bootstrap.cc:492] T 69ef277bbcbd41d8a10ae92d9a63145e P b560e9aaec7a4c78b9123b38e73519a3: Bootstrap starting.
I20260709 13:02:02.368326  8602 raft_consensus.cc:359] T d4791a5544bd4cbf8f7e3a05f62a9370 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:02.369038  8602 raft_consensus.cc:385] T d4791a5544bd4cbf8f7e3a05f62a9370 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:02.369320  8602 raft_consensus.cc:740] T d4791a5544bd4cbf8f7e3a05f62a9370 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Initialized, Role: FOLLOWER
I20260709 13:02:02.370056  8602 consensus_queue.cc:260] T d4791a5544bd4cbf8f7e3a05f62a9370 P 7b3ea460d1294b8a82672d7c21475cb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:02.372092  8602 ts_tablet_manager.cc:1434] T d4791a5544bd4cbf8f7e3a05f62a9370 P 7b3ea460d1294b8a82672d7c21475cb5: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:02:02.373049  8602 tablet_bootstrap.cc:492] T 69ef277bbcbd41d8a10ae92d9a63145e P 7b3ea460d1294b8a82672d7c21475cb5: Bootstrap starting.
I20260709 13:02:02.379335  8602 tablet_bootstrap.cc:654] T 69ef277bbcbd41d8a10ae92d9a63145e P 7b3ea460d1294b8a82672d7c21475cb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:02.383100  8605 raft_consensus.cc:493] T 435da692a6474cb697066524d4f5216e P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.371057  8598 tablet_bootstrap.cc:654] T 1fe73d50e76147ebace9610e09de74a5 P 53a66c851dc74c70b94c65d464a391f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:02.383692  8605 raft_consensus.cc:515] T 435da692a6474cb697066524d4f5216e P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:02.383625  8708 consensus_queue.cc:1048] T 7ed73594956241f4b3e6e456bae82964 P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:02.385922  8605 leader_election.cc:290] T 435da692a6474cb697066524d4f5216e P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:02:02.394609  8602 tablet_bootstrap.cc:492] T 69ef277bbcbd41d8a10ae92d9a63145e P 7b3ea460d1294b8a82672d7c21475cb5: No bootstrap required, opened a new log
I20260709 13:02:02.396559  8602 ts_tablet_manager.cc:1403] T 69ef277bbcbd41d8a10ae92d9a63145e P 7b3ea460d1294b8a82672d7c21475cb5: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.004s
I20260709 13:02:02.398020  8819 raft_consensus.cc:515] T 6fffc940549b445c973a289ba1bebcb3 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:02.400887  8602 raft_consensus.cc:359] T 69ef277bbcbd41d8a10ae92d9a63145e P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:02.401826  8602 raft_consensus.cc:385] T 69ef277bbcbd41d8a10ae92d9a63145e P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:02.402153  8602 raft_consensus.cc:740] T 69ef277bbcbd41d8a10ae92d9a63145e P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Initialized, Role: FOLLOWER
I20260709 13:02:02.402292  8601 tablet_bootstrap.cc:654] T 69ef277bbcbd41d8a10ae92d9a63145e P b560e9aaec7a4c78b9123b38e73519a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:02.403195  8605 raft_consensus.cc:493] T 4d5829b9233a48fea0290d9bb023f97e P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.403101  8551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fffc940549b445c973a289ba1bebcb3" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3"
I20260709 13:02:02.404151  8551 raft_consensus.cc:3060] T 6fffc940549b445c973a289ba1bebcb3 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:02.402849  8602 consensus_queue.cc:260] T 69ef277bbcbd41d8a10ae92d9a63145e P 7b3ea460d1294b8a82672d7c21475cb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:02.407132  8602 ts_tablet_manager.cc:1434] T 69ef277bbcbd41d8a10ae92d9a63145e P 7b3ea460d1294b8a82672d7c21475cb5: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:02:02.408154  8602 tablet_bootstrap.cc:492] T 30e220d65bed42489b2af858d3a60981 P 7b3ea460d1294b8a82672d7c21475cb5: Bootstrap starting.
I20260709 13:02:02.403915  8605 raft_consensus.cc:515] T 4d5829b9233a48fea0290d9bb023f97e P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:02.408471  8598 tablet_bootstrap.cc:492] T 1fe73d50e76147ebace9610e09de74a5 P 53a66c851dc74c70b94c65d464a391f6: No bootstrap required, opened a new log
I20260709 13:02:02.409098  8598 ts_tablet_manager.cc:1403] T 1fe73d50e76147ebace9610e09de74a5 P 53a66c851dc74c70b94c65d464a391f6: Time spent bootstrapping tablet: real 0.062s	user 0.012s	sys 0.002s
I20260709 13:02:02.409530  8225 catalog_manager.cc:5697] T d4791a5544bd4cbf8f7e3a05f62a9370 P b560e9aaec7a4c78b9123b38e73519a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "b560e9aaec7a4c78b9123b38e73519a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:02.410820  8605 leader_election.cc:290] T 4d5829b9233a48fea0290d9bb023f97e P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:02:02.412025  8598 raft_consensus.cc:359] T 1fe73d50e76147ebace9610e09de74a5 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:02.412793  8598 raft_consensus.cc:385] T 1fe73d50e76147ebace9610e09de74a5 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:02.413096  8598 raft_consensus.cc:740] T 1fe73d50e76147ebace9610e09de74a5 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Initialized, Role: FOLLOWER
I20260709 13:02:02.413802  8602 tablet_bootstrap.cc:654] T 30e220d65bed42489b2af858d3a60981 P 7b3ea460d1294b8a82672d7c21475cb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:02.413932  8598 consensus_queue.cc:260] T 1fe73d50e76147ebace9610e09de74a5 P 53a66c851dc74c70b94c65d464a391f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:02.416028  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5829b9233a48fea0290d9bb023f97e" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
I20260709 13:02:02.419195  8601 tablet_bootstrap.cc:492] T 69ef277bbcbd41d8a10ae92d9a63145e P b560e9aaec7a4c78b9123b38e73519a3: No bootstrap required, opened a new log
I20260709 13:02:02.419736  8601 ts_tablet_manager.cc:1403] T 69ef277bbcbd41d8a10ae92d9a63145e P b560e9aaec7a4c78b9123b38e73519a3: Time spent bootstrapping tablet: real 0.053s	user 0.007s	sys 0.006s
I20260709 13:02:02.420264  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5829b9233a48fea0290d9bb023f97e" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:02:02.421053  8405 raft_consensus.cc:2468] T 4d5829b9233a48fea0290d9bb023f97e P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 0.
I20260709 13:02:02.423950  8598 ts_tablet_manager.cc:1434] T 1fe73d50e76147ebace9610e09de74a5 P 53a66c851dc74c70b94c65d464a391f6: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 13:02:02.426839  8601 raft_consensus.cc:359] T 69ef277bbcbd41d8a10ae92d9a63145e P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:02.427441  8601 raft_consensus.cc:385] T 69ef277bbcbd41d8a10ae92d9a63145e P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:02.427662  8601 raft_consensus.cc:740] T 69ef277bbcbd41d8a10ae92d9a63145e P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Initialized, Role: FOLLOWER
I20260709 13:02:02.430619  8601 consensus_queue.cc:260] T 69ef277bbcbd41d8a10ae92d9a63145e P b560e9aaec7a4c78b9123b38e73519a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:02.433408  8598 tablet_bootstrap.cc:492] T 5db51a6d67e6461a98e669fa2b1e59c8 P 53a66c851dc74c70b94c65d464a391f6: Bootstrap starting.
W20260709 13:02:02.431816  8276 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:02.435902  8661 consensus_queue.cc:1048] T cb85497b295d4b3f8cda882af3676c65 P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:02.442474  8601 ts_tablet_manager.cc:1434] T 69ef277bbcbd41d8a10ae92d9a63145e P b560e9aaec7a4c78b9123b38e73519a3: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.001s
I20260709 13:02:02.437534  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435da692a6474cb697066524d4f5216e" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:02:02.443503  8402 raft_consensus.cc:2468] T 435da692a6474cb697066524d4f5216e P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 0.
W20260709 13:02:02.432245  8519 leader_election.cc:343] T 4d5829b9233a48fea0290d9bb023f97e P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:02.447144  8819 leader_election.cc:290] T 6fffc940549b445c973a289ba1bebcb3 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 election: Requested vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:02:02.443872  8601 tablet_bootstrap.cc:492] T e8353e508def43e5a8008bb63ff1a84a P b560e9aaec7a4c78b9123b38e73519a3: Bootstrap starting.
I20260709 13:02:02.438934  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435da692a6474cb697066524d4f5216e" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
I20260709 13:02:02.453935  8834 raft_consensus.cc:493] T 62a3aed976de4d62a1d4dc7bc5252328 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.457129  8834 raft_consensus.cc:515] T 62a3aed976de4d62a1d4dc7bc5252328 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:02.458266  8518 leader_election.cc:304] T 4d5829b9233a48fea0290d9bb023f97e P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, b560e9aaec7a4c78b9123b38e73519a3; no voters: 590ee39ce5734876b94d91fc3931b807
I20260709 13:02:02.460704  8661 raft_consensus.cc:2804] T 4d5829b9233a48fea0290d9bb023f97e P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:02.461120  8661 raft_consensus.cc:493] T 4d5829b9233a48fea0290d9bb023f97e P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:02.461483  8661 raft_consensus.cc:3060] T 4d5829b9233a48fea0290d9bb023f97e P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:02.460724  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a3aed976de4d62a1d4dc7bc5252328" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
I20260709 13:02:02.462539  8478 raft_consensus.cc:2468] T 62a3aed976de4d62a1d4dc7bc5252328 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 590ee39ce5734876b94d91fc3931b807 in term 0.
I20260709 13:02:02.463830  8295 leader_election.cc:304] T 62a3aed976de4d62a1d4dc7bc5252328 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807, 7b3ea460d1294b8a82672d7c21475cb5; no voters: 
I20260709 13:02:02.464682  8837 raft_consensus.cc:2804] T 62a3aed976de4d62a1d4dc7bc5252328 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:02.465031  8837 raft_consensus.cc:493] T 62a3aed976de4d62a1d4dc7bc5252328 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:02.465337  8837 raft_consensus.cc:3060] T 62a3aed976de4d62a1d4dc7bc5252328 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:02.465451  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fffc940549b445c973a289ba1bebcb3" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807"
I20260709 13:02:02.466068  8330 raft_consensus.cc:3060] T 6fffc940549b445c973a289ba1bebcb3 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:02.469147  8600 tablet_bootstrap.cc:492] T 5db51a6d67e6461a98e669fa2b1e59c8 P 590ee39ce5734876b94d91fc3931b807: No bootstrap required, opened a new log
I20260709 13:02:02.469839  8600 ts_tablet_manager.cc:1403] T 5db51a6d67e6461a98e669fa2b1e59c8 P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.148s	user 0.029s	sys 0.026s
I20260709 13:02:02.470734  8479 raft_consensus.cc:2468] T 435da692a6474cb697066524d4f5216e P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 0.
I20260709 13:02:02.460440  8518 leader_election.cc:304] T 435da692a6474cb697066524d4f5216e P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, b560e9aaec7a4c78b9123b38e73519a3; no voters: 
I20260709 13:02:02.472359  8605 raft_consensus.cc:2804] T 435da692a6474cb697066524d4f5216e P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:02.472795  8605 raft_consensus.cc:493] T 435da692a6474cb697066524d4f5216e P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:02.473155  8605 raft_consensus.cc:3060] T 435da692a6474cb697066524d4f5216e P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:02.473325  8600 raft_consensus.cc:359] T 5db51a6d67e6461a98e669fa2b1e59c8 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:02.474133  8600 raft_consensus.cc:385] T 5db51a6d67e6461a98e669fa2b1e59c8 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:02.474412  8600 raft_consensus.cc:740] T 5db51a6d67e6461a98e669fa2b1e59c8 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:02.475088  8600 consensus_queue.cc:260] T 5db51a6d67e6461a98e669fa2b1e59c8 P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:02.475984  8799 raft_consensus.cc:493] T 69ef277bbcbd41d8a10ae92d9a63145e P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.476476  8799 raft_consensus.cc:515] T 69ef277bbcbd41d8a10ae92d9a63145e P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:02.477409  8600 ts_tablet_manager.cc:1434] T 5db51a6d67e6461a98e669fa2b1e59c8 P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:02:02.478463  8600 tablet_bootstrap.cc:492] T 69ef277bbcbd41d8a10ae92d9a63145e P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:02.478613  8799 leader_election.cc:290] T 69ef277bbcbd41d8a10ae92d9a63145e P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:02:02.469779  8552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a3aed976de4d62a1d4dc7bc5252328" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3" is_pre_election: true
I20260709 13:02:02.485680  8552 raft_consensus.cc:2468] T 62a3aed976de4d62a1d4dc7bc5252328 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 590ee39ce5734876b94d91fc3931b807 in term 0.
I20260709 13:02:02.485546  8708 consensus_queue.cc:1048] T 7ed73594956241f4b3e6e456bae82964 P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:02.461303  8834 leader_election.cc:290] T 62a3aed976de4d62a1d4dc7bc5252328 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429), b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503)
I20260709 13:02:02.498164  8551 raft_consensus.cc:2468] T 6fffc940549b445c973a289ba1bebcb3 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b3ea460d1294b8a82672d7c21475cb5 in term 1.
I20260709 13:02:02.501654  8661 raft_consensus.cc:515] T 4d5829b9233a48fea0290d9bb023f97e P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:02.502341  8443 leader_election.cc:304] T 6fffc940549b445c973a289ba1bebcb3 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b3ea460d1294b8a82672d7c21475cb5, b560e9aaec7a4c78b9123b38e73519a3; no voters: 
I20260709 13:02:02.504078  8661 leader_election.cc:290] T 4d5829b9233a48fea0290d9bb023f97e P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 election: Requested vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:02:02.507578  8846 raft_consensus.cc:2804] T 6fffc940549b445c973a289ba1bebcb3 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:02.513463  8846 raft_consensus.cc:697] T 6fffc940549b445c973a289ba1bebcb3 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 LEADER]: Becoming Leader. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Running, Role: LEADER
I20260709 13:02:02.514322  8846 consensus_queue.cc:237] T 6fffc940549b445c973a289ba1bebcb3 P 7b3ea460d1294b8a82672d7c21475cb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:02.520130  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ef277bbcbd41d8a10ae92d9a63145e" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
W20260709 13:02:02.528206  8519 leader_election.cc:343] T 69ef277bbcbd41d8a10ae92d9a63145e P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:02.527343  8837 raft_consensus.cc:515] T 62a3aed976de4d62a1d4dc7bc5252328 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:02.529767  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5829b9233a48fea0290d9bb023f97e" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807"
W20260709 13:02:02.531414  8519 leader_election.cc:343] T 4d5829b9233a48fea0290d9bb023f97e P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:02.531566  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ef277bbcbd41d8a10ae92d9a63145e" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
I20260709 13:02:02.536005  8601 tablet_bootstrap.cc:654] T e8353e508def43e5a8008bb63ff1a84a P b560e9aaec7a4c78b9123b38e73519a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:02.545058  8602 tablet_bootstrap.cc:492] T 30e220d65bed42489b2af858d3a60981 P 7b3ea460d1294b8a82672d7c21475cb5: No bootstrap required, opened a new log
I20260709 13:02:02.537130  8837 leader_election.cc:290] T 62a3aed976de4d62a1d4dc7bc5252328 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 election: Requested vote from peers 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429), b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503)
I20260709 13:02:02.538621  8477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a3aed976de4d62a1d4dc7bc5252328" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5"
I20260709 13:02:02.545591  8602 ts_tablet_manager.cc:1403] T 30e220d65bed42489b2af858d3a60981 P 7b3ea460d1294b8a82672d7c21475cb5: Time spent bootstrapping tablet: real 0.138s	user 0.011s	sys 0.027s
I20260709 13:02:02.545717  8477 raft_consensus.cc:3060] T 62a3aed976de4d62a1d4dc7bc5252328 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:02.548578  8598 tablet_bootstrap.cc:654] T 5db51a6d67e6461a98e669fa2b1e59c8 P 53a66c851dc74c70b94c65d464a391f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:02.548729  8602 raft_consensus.cc:359] T 30e220d65bed42489b2af858d3a60981 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:02.549691  8602 raft_consensus.cc:385] T 30e220d65bed42489b2af858d3a60981 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:02.549965  8602 raft_consensus.cc:740] T 30e220d65bed42489b2af858d3a60981 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Initialized, Role: FOLLOWER
I20260709 13:02:02.542073  8600 tablet_bootstrap.cc:654] T 69ef277bbcbd41d8a10ae92d9a63145e P 590ee39ce5734876b94d91fc3931b807: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:02.542434  8661 consensus_queue.cc:1048] T cb85497b295d4b3f8cda882af3676c65 P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:02.540266  8224 catalog_manager.cc:5697] T 3921dc7d601b4e4ea05f40ca34d69819 P 53a66c851dc74c70b94c65d464a391f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "53a66c851dc74c70b94c65d464a391f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:02.550669  8602 consensus_queue.cc:260] T 30e220d65bed42489b2af858d3a60981 P 7b3ea460d1294b8a82672d7c21475cb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:02.561386  8602 ts_tablet_manager.cc:1434] T 30e220d65bed42489b2af858d3a60981 P 7b3ea460d1294b8a82672d7c21475cb5: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:02:02.562489  8330 raft_consensus.cc:2468] T 6fffc940549b445c973a289ba1bebcb3 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b3ea460d1294b8a82672d7c21475cb5 in term 1.
I20260709 13:02:02.564682  8819 raft_consensus.cc:493] T d4791a5544bd4cbf8f7e3a05f62a9370 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.565243  8819 raft_consensus.cc:515] T d4791a5544bd4cbf8f7e3a05f62a9370 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:02.567334  8477 raft_consensus.cc:2468] T 62a3aed976de4d62a1d4dc7bc5252328 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 590ee39ce5734876b94d91fc3931b807 in term 1.
I20260709 13:02:02.568715  8552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4791a5544bd4cbf8f7e3a05f62a9370" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3" is_pre_election: true
I20260709 13:02:02.570422  8602 tablet_bootstrap.cc:492] T 53842ab4d1d748bda0c7f0d933e5a785 P 7b3ea460d1294b8a82672d7c21475cb5: Bootstrap starting.
I20260709 13:02:02.532291  8479 raft_consensus.cc:2468] T 69ef277bbcbd41d8a10ae92d9a63145e P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 0.
I20260709 13:02:02.540158  8605 raft_consensus.cc:515] T 435da692a6474cb697066524d4f5216e P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:02.575804  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5829b9233a48fea0290d9bb023f97e" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6"
I20260709 13:02:02.580145  8405 raft_consensus.cc:3060] T 4d5829b9233a48fea0290d9bb023f97e P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:02.571203  8819 leader_election.cc:290] T d4791a5544bd4cbf8f7e3a05f62a9370 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751), b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503)
I20260709 13:02:02.594195  8295 leader_election.cc:304] T 62a3aed976de4d62a1d4dc7bc5252328 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807, 7b3ea460d1294b8a82672d7c21475cb5; no voters: 
I20260709 13:02:02.595109  8654 raft_consensus.cc:2804] T 62a3aed976de4d62a1d4dc7bc5252328 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:02.595583  8654 raft_consensus.cc:697] T 62a3aed976de4d62a1d4dc7bc5252328 P 590ee39ce5734876b94d91fc3931b807 [term 1 LEADER]: Becoming Leader. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Running, Role: LEADER
I20260709 13:02:02.596396  8654 consensus_queue.cc:237] T 62a3aed976de4d62a1d4dc7bc5252328 P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:02.598577  8605 leader_election.cc:290] T 435da692a6474cb697066524d4f5216e P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 election: Requested vote from peers 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:02:02.588953  8834 raft_consensus.cc:493] T 30e220d65bed42489b2af858d3a60981 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.608897  8834 raft_consensus.cc:515] T 30e220d65bed42489b2af858d3a60981 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:02.614707  8834 leader_election.cc:290] T 30e220d65bed42489b2af858d3a60981 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:02:02.615756  8405 raft_consensus.cc:2468] T 4d5829b9233a48fea0290d9bb023f97e P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 1.
I20260709 13:02:02.619233  8601 tablet_bootstrap.cc:492] T e8353e508def43e5a8008bb63ff1a84a P b560e9aaec7a4c78b9123b38e73519a3: No bootstrap required, opened a new log
I20260709 13:02:02.619581  8228 catalog_manager.cc:5697] T 6fffc940549b445c973a289ba1bebcb3 P 7b3ea460d1294b8a82672d7c21475cb5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "7b3ea460d1294b8a82672d7c21475cb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:02.621630  8598 tablet_bootstrap.cc:492] T 5db51a6d67e6461a98e669fa2b1e59c8 P 53a66c851dc74c70b94c65d464a391f6: No bootstrap required, opened a new log
I20260709 13:02:02.621829  8552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a3aed976de4d62a1d4dc7bc5252328" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3"
I20260709 13:02:02.622520  8552 raft_consensus.cc:3060] T 62a3aed976de4d62a1d4dc7bc5252328 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:02.623867  8598 ts_tablet_manager.cc:1403] T 5db51a6d67e6461a98e669fa2b1e59c8 P 53a66c851dc74c70b94c65d464a391f6: Time spent bootstrapping tablet: real 0.194s	user 0.014s	sys 0.022s
I20260709 13:02:02.624445  8401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435da692a6474cb697066524d4f5216e" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6"
I20260709 13:02:02.625093  8401 raft_consensus.cc:3060] T 435da692a6474cb697066524d4f5216e P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:02.625610  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e220d65bed42489b2af858d3a60981" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:02:02.622534  8601 ts_tablet_manager.cc:1403] T e8353e508def43e5a8008bb63ff1a84a P b560e9aaec7a4c78b9123b38e73519a3: Time spent bootstrapping tablet: real 0.179s	user 0.014s	sys 0.000s
I20260709 13:02:02.641230  8518 leader_election.cc:304] T 69ef277bbcbd41d8a10ae92d9a63145e P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b3ea460d1294b8a82672d7c21475cb5, b560e9aaec7a4c78b9123b38e73519a3; no voters: 590ee39ce5734876b94d91fc3931b807
I20260709 13:02:02.642138  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435da692a6474cb697066524d4f5216e" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5"
I20260709 13:02:02.642844  8479 raft_consensus.cc:3060] T 435da692a6474cb697066524d4f5216e P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:02.646067  8226 catalog_manager.cc:5697] T 62a3aed976de4d62a1d4dc7bc5252328 P 590ee39ce5734876b94d91fc3931b807 reported cstate change: term changed from 0 to 1, leader changed from <none> to 590ee39ce5734876b94d91fc3931b807 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "590ee39ce5734876b94d91fc3931b807" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:02.652014  8479 raft_consensus.cc:2468] T 435da692a6474cb697066524d4f5216e P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 1.
I20260709 13:02:02.652990  8605 raft_consensus.cc:2804] T 69ef277bbcbd41d8a10ae92d9a63145e P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:02.659610  8605 raft_consensus.cc:493] T 69ef277bbcbd41d8a10ae92d9a63145e P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:02.659999  8605 raft_consensus.cc:3060] T 69ef277bbcbd41d8a10ae92d9a63145e P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:02.653342  8661 raft_consensus.cc:493] T 5db51a6d67e6461a98e669fa2b1e59c8 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.660867  8661 raft_consensus.cc:515] T 5db51a6d67e6461a98e669fa2b1e59c8 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:02.662889  8661 leader_election.cc:290] T 5db51a6d67e6461a98e669fa2b1e59c8 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:02:02.653944  8518 leader_election.cc:304] T 4d5829b9233a48fea0290d9bb023f97e P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, b560e9aaec7a4c78b9123b38e73519a3; no voters: 590ee39ce5734876b94d91fc3931b807
I20260709 13:02:02.654871  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e220d65bed42489b2af858d3a60981" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
I20260709 13:02:02.658982  8552 raft_consensus.cc:2468] T 62a3aed976de4d62a1d4dc7bc5252328 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 590ee39ce5734876b94d91fc3931b807 in term 1.
I20260709 13:02:02.670526  8476 raft_consensus.cc:2468] T 30e220d65bed42489b2af858d3a60981 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 590ee39ce5734876b94d91fc3931b807 in term 0.
I20260709 13:02:02.672597  8661 raft_consensus.cc:2804] T 4d5829b9233a48fea0290d9bb023f97e P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:02.673257  8661 raft_consensus.cc:697] T 4d5829b9233a48fea0290d9bb023f97e P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Becoming Leader. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Running, Role: LEADER
I20260709 13:02:02.674379  8661 consensus_queue.cc:237] T 4d5829b9233a48fea0290d9bb023f97e P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:02.676039  8602 tablet_bootstrap.cc:654] T 53842ab4d1d748bda0c7f0d933e5a785 P 7b3ea460d1294b8a82672d7c21475cb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:02.678303  8600 tablet_bootstrap.cc:492] T 69ef277bbcbd41d8a10ae92d9a63145e P 590ee39ce5734876b94d91fc3931b807: No bootstrap required, opened a new log
I20260709 13:02:02.678797  8600 ts_tablet_manager.cc:1403] T 69ef277bbcbd41d8a10ae92d9a63145e P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.201s	user 0.017s	sys 0.014s
I20260709 13:02:02.669621  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51a6d67e6461a98e669fa2b1e59c8" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
I20260709 13:02:02.680881  8330 raft_consensus.cc:2468] T 5db51a6d67e6461a98e669fa2b1e59c8 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 0.
I20260709 13:02:02.679242  8401 raft_consensus.cc:2468] T 435da692a6474cb697066524d4f5216e P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 1.
W20260709 13:02:02.683590  8295 leader_election.cc:343] T 30e220d65bed42489b2af858d3a60981 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:02.675463  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4791a5544bd4cbf8f7e3a05f62a9370" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:02:02.687485  8405 raft_consensus.cc:2393] T d4791a5544bd4cbf8f7e3a05f62a9370 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7b3ea460d1294b8a82672d7c21475cb5 in current term 1: Already voted for candidate b560e9aaec7a4c78b9123b38e73519a3 in this term.
I20260709 13:02:02.688721  8598 raft_consensus.cc:359] T 5db51a6d67e6461a98e669fa2b1e59c8 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:02.689527  8598 raft_consensus.cc:385] T 5db51a6d67e6461a98e669fa2b1e59c8 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:02.689810  8598 raft_consensus.cc:740] T 5db51a6d67e6461a98e669fa2b1e59c8 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Initialized, Role: FOLLOWER
I20260709 13:02:02.691867  8519 leader_election.cc:304] T 5db51a6d67e6461a98e669fa2b1e59c8 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807, b560e9aaec7a4c78b9123b38e73519a3; no voters: 
I20260709 13:02:02.692891  8295 leader_election.cc:304] T 30e220d65bed42489b2af858d3a60981 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807, 7b3ea460d1294b8a82672d7c21475cb5; no voters: 53a66c851dc74c70b94c65d464a391f6
I20260709 13:02:02.690510  8601 raft_consensus.cc:359] T e8353e508def43e5a8008bb63ff1a84a P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:02.694520  8601 raft_consensus.cc:385] T e8353e508def43e5a8008bb63ff1a84a P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:02.694021  8598 consensus_queue.cc:260] T 5db51a6d67e6461a98e669fa2b1e59c8 P 53a66c851dc74c70b94c65d464a391f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:02.694981  8837 raft_consensus.cc:2804] T 30e220d65bed42489b2af858d3a60981 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:02.694885  8601 raft_consensus.cc:740] T e8353e508def43e5a8008bb63ff1a84a P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Initialized, Role: FOLLOWER
I20260709 13:02:02.694314  8802 raft_consensus.cc:2804] T 5db51a6d67e6461a98e669fa2b1e59c8 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:02.696043  8802 raft_consensus.cc:493] T 5db51a6d67e6461a98e669fa2b1e59c8 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:02.693470  8600 raft_consensus.cc:359] T 69ef277bbcbd41d8a10ae92d9a63145e P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:02.696501  8802 raft_consensus.cc:3060] T 5db51a6d67e6461a98e669fa2b1e59c8 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:02.696894  8598 ts_tablet_manager.cc:1434] T 5db51a6d67e6461a98e669fa2b1e59c8 P 53a66c851dc74c70b94c65d464a391f6: Time spent starting tablet: real 0.070s	user 0.007s	sys 0.000s
I20260709 13:02:02.696772  8600 raft_consensus.cc:385] T 69ef277bbcbd41d8a10ae92d9a63145e P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:02.700944  8600 raft_consensus.cc:740] T 69ef277bbcbd41d8a10ae92d9a63145e P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:02.695463  8837 raft_consensus.cc:493] T 30e220d65bed42489b2af858d3a60981 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:02.696161  8601 consensus_queue.cc:260] T e8353e508def43e5a8008bb63ff1a84a P b560e9aaec7a4c78b9123b38e73519a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:02.715160  8598 tablet_bootstrap.cc:492] T 30e220d65bed42489b2af858d3a60981 P 53a66c851dc74c70b94c65d464a391f6: Bootstrap starting.
I20260709 13:02:02.701743  8837 raft_consensus.cc:3060] T 30e220d65bed42489b2af858d3a60981 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:02.715094  8600 consensus_queue.cc:260] T 69ef277bbcbd41d8a10ae92d9a63145e P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:02.723647  8444 leader_election.cc:304] T d4791a5544bd4cbf8f7e3a05f62a9370 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b3ea460d1294b8a82672d7c21475cb5; no voters: 53a66c851dc74c70b94c65d464a391f6, b560e9aaec7a4c78b9123b38e73519a3
I20260709 13:02:02.725025  8846 raft_consensus.cc:3060] T d4791a5544bd4cbf8f7e3a05f62a9370 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:02.735963  8605 raft_consensus.cc:515] T 69ef277bbcbd41d8a10ae92d9a63145e P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:02.739594  8600 ts_tablet_manager.cc:1434] T 69ef277bbcbd41d8a10ae92d9a63145e P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.061s	user 0.010s	sys 0.000s
I20260709 13:02:02.744910  8601 ts_tablet_manager.cc:1434] T e8353e508def43e5a8008bb63ff1a84a P b560e9aaec7a4c78b9123b38e73519a3: Time spent starting tablet: real 0.117s	user 0.006s	sys 0.002s
I20260709 13:02:02.747735  8518 leader_election.cc:304] T 435da692a6474cb697066524d4f5216e P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b3ea460d1294b8a82672d7c21475cb5, b560e9aaec7a4c78b9123b38e73519a3; no voters: 
I20260709 13:02:02.752204  8600 tablet_bootstrap.cc:492] T 4d5829b9233a48fea0290d9bb023f97e P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:02.752803  8802 raft_consensus.cc:515] T 5db51a6d67e6461a98e669fa2b1e59c8 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:02.755381  8821 raft_consensus.cc:493] T 3921dc7d601b4e4ea05f40ca34d69819 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.755883  8821 raft_consensus.cc:515] T 3921dc7d601b4e4ea05f40ca34d69819 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:02.758018  8821 leader_election.cc:290] T 3921dc7d601b4e4ea05f40ca34d69819 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:02:02.762024  8661 raft_consensus.cc:2804] T 435da692a6474cb697066524d4f5216e P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:02.766397  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3921dc7d601b4e4ea05f40ca34d69819" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
I20260709 13:02:02.766609  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51a6d67e6461a98e669fa2b1e59c8" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:02:02.767422  8327 raft_consensus.cc:2393] T 3921dc7d601b4e4ea05f40ca34d69819 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7b3ea460d1294b8a82672d7c21475cb5 in current term 1: Already voted for candidate 53a66c851dc74c70b94c65d464a391f6 in this term.
I20260709 13:02:02.767462  8405 raft_consensus.cc:2468] T 5db51a6d67e6461a98e669fa2b1e59c8 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 0.
I20260709 13:02:02.765430  8661 raft_consensus.cc:697] T 435da692a6474cb697066524d4f5216e P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Becoming Leader. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Running, Role: LEADER
I20260709 13:02:02.769562  8802 leader_election.cc:290] T 5db51a6d67e6461a98e669fa2b1e59c8 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 election: Requested vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:02:02.770238  8661 consensus_queue.cc:237] T 435da692a6474cb697066524d4f5216e P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:02.773729  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51a6d67e6461a98e669fa2b1e59c8" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807"
I20260709 13:02:02.774560  8328 raft_consensus.cc:3060] T 5db51a6d67e6461a98e669fa2b1e59c8 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:02.775777  8602 tablet_bootstrap.cc:492] T 53842ab4d1d748bda0c7f0d933e5a785 P 7b3ea460d1294b8a82672d7c21475cb5: No bootstrap required, opened a new log
I20260709 13:02:02.776322  8602 ts_tablet_manager.cc:1403] T 53842ab4d1d748bda0c7f0d933e5a785 P 7b3ea460d1294b8a82672d7c21475cb5: Time spent bootstrapping tablet: real 0.214s	user 0.010s	sys 0.023s
I20260709 13:02:02.777104  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ef277bbcbd41d8a10ae92d9a63145e" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807"
I20260709 13:02:02.777927  8329 raft_consensus.cc:3060] T 69ef277bbcbd41d8a10ae92d9a63145e P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:02.780786  8605 leader_election.cc:290] T 69ef277bbcbd41d8a10ae92d9a63145e P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 election: Requested vote from peers 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:02:02.785326  8846 raft_consensus.cc:2749] T d4791a5544bd4cbf8f7e3a05f62a9370 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:02.786235  8701 consensus_queue.cc:1048] T 3921dc7d601b4e4ea05f40ca34d69819 P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:02.787040  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3921dc7d601b4e4ea05f40ca34d69819" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:02:02.779856  8602 raft_consensus.cc:359] T 53842ab4d1d748bda0c7f0d933e5a785 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:02.788875  8602 raft_consensus.cc:385] T 53842ab4d1d748bda0c7f0d933e5a785 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:02.789230  8602 raft_consensus.cc:740] T 53842ab4d1d748bda0c7f0d933e5a785 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Initialized, Role: FOLLOWER
I20260709 13:02:02.795977  8598 tablet_bootstrap.cc:654] T 30e220d65bed42489b2af858d3a60981 P 53a66c851dc74c70b94c65d464a391f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:02.796765  8601 tablet_bootstrap.cc:492] T 1fe73d50e76147ebace9610e09de74a5 P b560e9aaec7a4c78b9123b38e73519a3: Bootstrap starting.
I20260709 13:02:02.772730  8837 raft_consensus.cc:515] T 30e220d65bed42489b2af858d3a60981 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:02.811774  8837 leader_election.cc:290] T 30e220d65bed42489b2af858d3a60981 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 election: Requested vote from peers 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:02:02.803756  8602 consensus_queue.cc:260] T 53842ab4d1d748bda0c7f0d933e5a785 P 7b3ea460d1294b8a82672d7c21475cb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:02.823184  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e220d65bed42489b2af858d3a60981" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6"
W20260709 13:02:02.825387  8295 leader_election.cc:343] T 30e220d65bed42489b2af858d3a60981 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:02.825841  8600 tablet_bootstrap.cc:654] T 4d5829b9233a48fea0290d9bb023f97e P 590ee39ce5734876b94d91fc3931b807: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:02.829999  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "69ef277bbcbd41d8a10ae92d9a63145e" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5"
I20260709 13:02:02.830932  8476 raft_consensus.cc:3060] T 69ef277bbcbd41d8a10ae92d9a63145e P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:02.831918  8401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51a6d67e6461a98e669fa2b1e59c8" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6"
I20260709 13:02:02.832803  8401 raft_consensus.cc:3060] T 5db51a6d67e6461a98e669fa2b1e59c8 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:02.841413  8476 raft_consensus.cc:2468] T 69ef277bbcbd41d8a10ae92d9a63145e P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 1.
I20260709 13:02:02.848489  8886 consensus_queue.cc:1048] T d4791a5544bd4cbf8f7e3a05f62a9370 P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:02.818183  8329 raft_consensus.cc:2468] T 69ef277bbcbd41d8a10ae92d9a63145e P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 1.
W20260709 13:02:02.851382  8444 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37751, user_credentials={real_user=slave}} blocked reactor thread for 86387.2us
I20260709 13:02:02.868707  8602 ts_tablet_manager.cc:1434] T 53842ab4d1d748bda0c7f0d933e5a785 P 7b3ea460d1294b8a82672d7c21475cb5: Time spent starting tablet: real 0.092s	user 0.005s	sys 0.004s
I20260709 13:02:02.874184  8519 leader_election.cc:304] T 69ef277bbcbd41d8a10ae92d9a63145e P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807, b560e9aaec7a4c78b9123b38e73519a3; no voters: 
I20260709 13:02:02.883705  8601 tablet_bootstrap.cc:654] T 1fe73d50e76147ebace9610e09de74a5 P b560e9aaec7a4c78b9123b38e73519a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:02.883980  8885 raft_consensus.cc:2804] T 69ef277bbcbd41d8a10ae92d9a63145e P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:02.884611  8885 raft_consensus.cc:697] T 69ef277bbcbd41d8a10ae92d9a63145e P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Becoming Leader. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Running, Role: LEADER
I20260709 13:02:02.885463  8885 consensus_queue.cc:237] T 69ef277bbcbd41d8a10ae92d9a63145e P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:02.888358  8328 raft_consensus.cc:2468] T 5db51a6d67e6461a98e669fa2b1e59c8 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 1.
I20260709 13:02:02.889747  8602 tablet_bootstrap.cc:492] T e8353e508def43e5a8008bb63ff1a84a P 7b3ea460d1294b8a82672d7c21475cb5: Bootstrap starting.
I20260709 13:02:02.889165  8401 raft_consensus.cc:2468] T 5db51a6d67e6461a98e669fa2b1e59c8 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 1.
I20260709 13:02:02.896005  8479 raft_consensus.cc:3060] T 3921dc7d601b4e4ea05f40ca34d69819 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:02.894541  8799 consensus_queue.cc:1048] T d4791a5544bd4cbf8f7e3a05f62a9370 P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:02:02.902474  8519 leader_election.cc:304] T 5db51a6d67e6461a98e669fa2b1e59c8 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807, b560e9aaec7a4c78b9123b38e73519a3; no voters: 
I20260709 13:02:02.903738  8886 raft_consensus.cc:2804] T 5db51a6d67e6461a98e669fa2b1e59c8 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:02.904381  8886 raft_consensus.cc:697] T 5db51a6d67e6461a98e669fa2b1e59c8 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Becoming Leader. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Running, Role: LEADER
I20260709 13:02:02.904958  8598 tablet_bootstrap.cc:492] T 30e220d65bed42489b2af858d3a60981 P 53a66c851dc74c70b94c65d464a391f6: No bootstrap required, opened a new log
I20260709 13:02:02.905462  8598 ts_tablet_manager.cc:1403] T 30e220d65bed42489b2af858d3a60981 P 53a66c851dc74c70b94c65d464a391f6: Time spent bootstrapping tablet: real 0.193s	user 0.024s	sys 0.015s
I20260709 13:02:02.905490  8886 consensus_queue.cc:237] T 5db51a6d67e6461a98e669fa2b1e59c8 P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:02.908211  8598 raft_consensus.cc:359] T 30e220d65bed42489b2af858d3a60981 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:02.909440  8598 raft_consensus.cc:385] T 30e220d65bed42489b2af858d3a60981 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:02.909715  8598 raft_consensus.cc:740] T 30e220d65bed42489b2af858d3a60981 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Initialized, Role: FOLLOWER
I20260709 13:02:02.910377  8598 consensus_queue.cc:260] T 30e220d65bed42489b2af858d3a60981 P 53a66c851dc74c70b94c65d464a391f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:02.917531  8708 raft_consensus.cc:493] T 1fe73d50e76147ebace9610e09de74a5 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.919385  8598 ts_tablet_manager.cc:1434] T 30e220d65bed42489b2af858d3a60981 P 53a66c851dc74c70b94c65d464a391f6: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 13:02:02.950646  8598 tablet_bootstrap.cc:492] T 610562885f5849d083ac5f7a85011891 P 53a66c851dc74c70b94c65d464a391f6: Bootstrap starting.
I20260709 13:02:02.924154  8708 raft_consensus.cc:515] T 1fe73d50e76147ebace9610e09de74a5 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
W20260709 13:02:02.965567  8892 log.cc:927] Time spent T 69ef277bbcbd41d8a10ae92d9a63145e P b560e9aaec7a4c78b9123b38e73519a3: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:02:02.971480  8444 leader_election.cc:304] T 3921dc7d601b4e4ea05f40ca34d69819 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b3ea460d1294b8a82672d7c21475cb5; no voters: 53a66c851dc74c70b94c65d464a391f6, 590ee39ce5734876b94d91fc3931b807
I20260709 13:02:02.971531  8477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e220d65bed42489b2af858d3a60981" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5"
I20260709 13:02:02.972834  8477 raft_consensus.cc:3060] T 30e220d65bed42489b2af858d3a60981 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:02.975700  8887 raft_consensus.cc:2749] T 3921dc7d601b4e4ea05f40ca34d69819 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:02.978735  8708 leader_election.cc:290] T 1fe73d50e76147ebace9610e09de74a5 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429), b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503)
I20260709 13:02:02.982383  8228 catalog_manager.cc:5697] T 4d5829b9233a48fea0290d9bb023f97e P b560e9aaec7a4c78b9123b38e73519a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "b560e9aaec7a4c78b9123b38e73519a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:02.984632  8550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe73d50e76147ebace9610e09de74a5" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3" is_pre_election: true
I20260709 13:02:02.985400  8819 raft_consensus.cc:493] T 53842ab4d1d748bda0c7f0d933e5a785 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:02.984951  8228 catalog_manager.cc:5697] T 435da692a6474cb697066524d4f5216e P b560e9aaec7a4c78b9123b38e73519a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "b560e9aaec7a4c78b9123b38e73519a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:02.986217  8601 tablet_bootstrap.cc:492] T 1fe73d50e76147ebace9610e09de74a5 P b560e9aaec7a4c78b9123b38e73519a3: No bootstrap required, opened a new log
I20260709 13:02:02.985929  8819 raft_consensus.cc:515] T 53842ab4d1d748bda0c7f0d933e5a785 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:02.986712  8601 ts_tablet_manager.cc:1403] T 1fe73d50e76147ebace9610e09de74a5 P b560e9aaec7a4c78b9123b38e73519a3: Time spent bootstrapping tablet: real 0.194s	user 0.016s	sys 0.015s
W20260709 13:02:02.994136  8369 leader_election.cc:343] T 1fe73d50e76147ebace9610e09de74a5 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:02.995626  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842ab4d1d748bda0c7f0d933e5a785" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
I20260709 13:02:02.999238  8600 tablet_bootstrap.cc:492] T 4d5829b9233a48fea0290d9bb023f97e P 590ee39ce5734876b94d91fc3931b807: No bootstrap required, opened a new log
I20260709 13:02:02.999995  8600 ts_tablet_manager.cc:1403] T 4d5829b9233a48fea0290d9bb023f97e P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.248s	user 0.028s	sys 0.004s
I20260709 13:02:02.988193  8819 leader_election.cc:290] T 53842ab4d1d748bda0c7f0d933e5a785 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
W20260709 13:02:03.000910  8370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45429, user_credentials={real_user=slave}} blocked reactor thread for 75403.5us
W20260709 13:02:03.014621  8445 leader_election.cc:343] T 53842ab4d1d748bda0c7f0d933e5a785 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:03.017179  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe73d50e76147ebace9610e09de74a5" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
W20260709 13:02:03.019093  8370 leader_election.cc:343] T 1fe73d50e76147ebace9610e09de74a5 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:03.019624  8370 leader_election.cc:304] T 1fe73d50e76147ebace9610e09de74a5 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6; no voters: 7b3ea460d1294b8a82672d7c21475cb5, b560e9aaec7a4c78b9123b38e73519a3
I20260709 13:02:03.020787  8701 consensus_queue.cc:1048] T 3921dc7d601b4e4ea05f40ca34d69819 P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:03.021592  8896 raft_consensus.cc:2749] T 1fe73d50e76147ebace9610e09de74a5 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:03.022430  8602 tablet_bootstrap.cc:654] T e8353e508def43e5a8008bb63ff1a84a P 7b3ea460d1294b8a82672d7c21475cb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:03.028183  8601 raft_consensus.cc:359] T 1fe73d50e76147ebace9610e09de74a5 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:03.029059  8601 raft_consensus.cc:385] T 1fe73d50e76147ebace9610e09de74a5 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:03.029433  8601 raft_consensus.cc:740] T 1fe73d50e76147ebace9610e09de74a5 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Initialized, Role: FOLLOWER
I20260709 13:02:03.029547  8477 raft_consensus.cc:2468] T 30e220d65bed42489b2af858d3a60981 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 590ee39ce5734876b94d91fc3931b807 in term 1.
I20260709 13:02:03.030326  8601 consensus_queue.cc:260] T 1fe73d50e76147ebace9610e09de74a5 P b560e9aaec7a4c78b9123b38e73519a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:03.033989  8601 ts_tablet_manager.cc:1434] T 1fe73d50e76147ebace9610e09de74a5 P b560e9aaec7a4c78b9123b38e73519a3: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.001s
I20260709 13:02:03.035269  8601 tablet_bootstrap.cc:492] T da02fa98f6de48a7baefadf6e69d2046 P b560e9aaec7a4c78b9123b38e73519a3: Bootstrap starting.
I20260709 13:02:03.041793  8601 tablet_bootstrap.cc:654] T da02fa98f6de48a7baefadf6e69d2046 P b560e9aaec7a4c78b9123b38e73519a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:03.044847  8661 raft_consensus.cc:493] T e8353e508def43e5a8008bb63ff1a84a P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.045468  8661 raft_consensus.cc:515] T e8353e508def43e5a8008bb63ff1a84a P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:03.051131  8598 tablet_bootstrap.cc:654] T 610562885f5849d083ac5f7a85011891 P 53a66c851dc74c70b94c65d464a391f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:03.061231  8837 consensus_queue.cc:1048] T 62a3aed976de4d62a1d4dc7bc5252328 P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:02:03.075166  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8353e508def43e5a8008bb63ff1a84a" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
I20260709 13:02:03.070052  8661 leader_election.cc:290] T e8353e508def43e5a8008bb63ff1a84a P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:02:03.066450  8600 raft_consensus.cc:359] T 4d5829b9233a48fea0290d9bb023f97e P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:03.078439  8600 raft_consensus.cc:385] T 4d5829b9233a48fea0290d9bb023f97e P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:03.078819  8600 raft_consensus.cc:740] T 4d5829b9233a48fea0290d9bb023f97e P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:03.080013  8600 consensus_queue.cc:260] T 4d5829b9233a48fea0290d9bb023f97e P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:03.082881  8600 ts_tablet_manager.cc:1434] T 4d5829b9233a48fea0290d9bb023f97e P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.082s	user 0.009s	sys 0.000s
I20260709 13:02:03.085922  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8353e508def43e5a8008bb63ff1a84a" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
I20260709 13:02:03.086489  8600 tablet_bootstrap.cc:492] T e8353e508def43e5a8008bb63ff1a84a P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
W20260709 13:02:03.090517  8518 leader_election.cc:343] T e8353e508def43e5a8008bb63ff1a84a P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:03.095659  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842ab4d1d748bda0c7f0d933e5a785" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
W20260709 13:02:03.096493  8519 leader_election.cc:343] T e8353e508def43e5a8008bb63ff1a84a P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:03.097060  8519 leader_election.cc:304] T e8353e508def43e5a8008bb63ff1a84a P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b560e9aaec7a4c78b9123b38e73519a3; no voters: 590ee39ce5734876b94d91fc3931b807, 7b3ea460d1294b8a82672d7c21475cb5
I20260709 13:02:03.104766  8897 raft_consensus.cc:493] T 30e220d65bed42489b2af858d3a60981 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.102057  8799 raft_consensus.cc:2749] T e8353e508def43e5a8008bb63ff1a84a P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:03.112802  8601 tablet_bootstrap.cc:492] T da02fa98f6de48a7baefadf6e69d2046 P b560e9aaec7a4c78b9123b38e73519a3: No bootstrap required, opened a new log
W20260709 13:02:03.106197  8444 leader_election.cc:343] T 53842ab4d1d748bda0c7f0d933e5a785 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:03.113345  8601 ts_tablet_manager.cc:1403] T da02fa98f6de48a7baefadf6e69d2046 P b560e9aaec7a4c78b9123b38e73519a3: Time spent bootstrapping tablet: real 0.078s	user 0.019s	sys 0.001s
I20260709 13:02:03.115515  8598 tablet_bootstrap.cc:492] T 610562885f5849d083ac5f7a85011891 P 53a66c851dc74c70b94c65d464a391f6: No bootstrap required, opened a new log
I20260709 13:02:03.116385  8598 ts_tablet_manager.cc:1403] T 610562885f5849d083ac5f7a85011891 P 53a66c851dc74c70b94c65d464a391f6: Time spent bootstrapping tablet: real 0.166s	user 0.008s	sys 0.008s
I20260709 13:02:03.111281  8897 raft_consensus.cc:515] T 30e220d65bed42489b2af858d3a60981 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:03.125223  8601 raft_consensus.cc:359] T da02fa98f6de48a7baefadf6e69d2046 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:03.125815  8601 raft_consensus.cc:385] T da02fa98f6de48a7baefadf6e69d2046 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:03.126085  8601 raft_consensus.cc:740] T da02fa98f6de48a7baefadf6e69d2046 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Initialized, Role: FOLLOWER
I20260709 13:02:03.128305  8228 catalog_manager.cc:5697] T 69ef277bbcbd41d8a10ae92d9a63145e P b560e9aaec7a4c78b9123b38e73519a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "b560e9aaec7a4c78b9123b38e73519a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:03.129822  8228 catalog_manager.cc:5697] T 5db51a6d67e6461a98e669fa2b1e59c8 P b560e9aaec7a4c78b9123b38e73519a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "b560e9aaec7a4c78b9123b38e73519a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:03.137311  8602 tablet_bootstrap.cc:492] T e8353e508def43e5a8008bb63ff1a84a P 7b3ea460d1294b8a82672d7c21475cb5: No bootstrap required, opened a new log
I20260709 13:02:03.137758  8897 leader_election.cc:290] T 30e220d65bed42489b2af858d3a60981 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:02:03.137913  8602 ts_tablet_manager.cc:1403] T e8353e508def43e5a8008bb63ff1a84a P 7b3ea460d1294b8a82672d7c21475cb5: Time spent bootstrapping tablet: real 0.262s	user 0.009s	sys 0.022s
I20260709 13:02:03.139389  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e220d65bed42489b2af858d3a60981" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
I20260709 13:02:03.140290  8326 raft_consensus.cc:2393] T 30e220d65bed42489b2af858d3a60981 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 53a66c851dc74c70b94c65d464a391f6 in current term 1: Already voted for candidate 590ee39ce5734876b94d91fc3931b807 in this term.
I20260709 13:02:03.116050  8444 leader_election.cc:304] T 53842ab4d1d748bda0c7f0d933e5a785 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b3ea460d1294b8a82672d7c21475cb5; no voters: 53a66c851dc74c70b94c65d464a391f6, 590ee39ce5734876b94d91fc3931b807
I20260709 13:02:03.141744  8888 raft_consensus.cc:2749] T 53842ab4d1d748bda0c7f0d933e5a785 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:03.144578  8602 raft_consensus.cc:359] T e8353e508def43e5a8008bb63ff1a84a P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:03.145251  8602 raft_consensus.cc:385] T e8353e508def43e5a8008bb63ff1a84a P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:03.145553  8602 raft_consensus.cc:740] T e8353e508def43e5a8008bb63ff1a84a P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Initialized, Role: FOLLOWER
I20260709 13:02:03.145360  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e220d65bed42489b2af858d3a60981" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
I20260709 13:02:03.146284  8600 tablet_bootstrap.cc:654] T e8353e508def43e5a8008bb63ff1a84a P 590ee39ce5734876b94d91fc3931b807: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:03.146553  8476 raft_consensus.cc:2393] T 30e220d65bed42489b2af858d3a60981 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 53a66c851dc74c70b94c65d464a391f6 in current term 1: Already voted for candidate 590ee39ce5734876b94d91fc3931b807 in this term.
I20260709 13:02:03.148550  8370 leader_election.cc:304] T 30e220d65bed42489b2af858d3a60981 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6; no voters: 590ee39ce5734876b94d91fc3931b807, 7b3ea460d1294b8a82672d7c21475cb5
I20260709 13:02:03.149576  8888 consensus_queue.cc:1048] T 6fffc940549b445c973a289ba1bebcb3 P 7b3ea460d1294b8a82672d7c21475cb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:03.149801  8897 raft_consensus.cc:3060] T 30e220d65bed42489b2af858d3a60981 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:03.147274  8602 consensus_queue.cc:260] T e8353e508def43e5a8008bb63ff1a84a P 7b3ea460d1294b8a82672d7c21475cb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:03.150790  8601 consensus_queue.cc:260] T da02fa98f6de48a7baefadf6e69d2046 P b560e9aaec7a4c78b9123b38e73519a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:03.161666  8897 raft_consensus.cc:2749] T 30e220d65bed42489b2af858d3a60981 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:03.178342  8602 ts_tablet_manager.cc:1434] T e8353e508def43e5a8008bb63ff1a84a P 7b3ea460d1294b8a82672d7c21475cb5: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.000s
I20260709 13:02:03.189754  8598 raft_consensus.cc:359] T 610562885f5849d083ac5f7a85011891 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:03.190536  8598 raft_consensus.cc:385] T 610562885f5849d083ac5f7a85011891 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:03.190835  8598 raft_consensus.cc:740] T 610562885f5849d083ac5f7a85011891 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Initialized, Role: FOLLOWER
I20260709 13:02:03.191493  8598 consensus_queue.cc:260] T 610562885f5849d083ac5f7a85011891 P 53a66c851dc74c70b94c65d464a391f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:03.193192  8601 ts_tablet_manager.cc:1434] T da02fa98f6de48a7baefadf6e69d2046 P b560e9aaec7a4c78b9123b38e73519a3: Time spent starting tablet: real 0.080s	user 0.005s	sys 0.003s
I20260709 13:02:03.194058  8602 tablet_bootstrap.cc:492] T 1fe73d50e76147ebace9610e09de74a5 P 7b3ea460d1294b8a82672d7c21475cb5: Bootstrap starting.
W20260709 13:02:03.186702  8295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37751, user_credentials={real_user=slave}} blocked reactor thread for 55085us
I20260709 13:02:03.198611  8654 raft_consensus.cc:493] T 4d5829b9233a48fea0290d9bb023f97e P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.199200  8654 raft_consensus.cc:515] T 4d5829b9233a48fea0290d9bb023f97e P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:03.200179  8887 consensus_queue.cc:1048] T 6fffc940549b445c973a289ba1bebcb3 P 7b3ea460d1294b8a82672d7c21475cb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:03.200314  8598 ts_tablet_manager.cc:1434] T 610562885f5849d083ac5f7a85011891 P 53a66c851dc74c70b94c65d464a391f6: Time spent starting tablet: real 0.083s	user 0.006s	sys 0.000s
I20260709 13:02:03.201998  8598 tablet_bootstrap.cc:492] T 53842ab4d1d748bda0c7f0d933e5a785 P 53a66c851dc74c70b94c65d464a391f6: Bootstrap starting.
I20260709 13:02:03.202032  8654 leader_election.cc:290] T 4d5829b9233a48fea0290d9bb023f97e P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:02:03.211359  8551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5829b9233a48fea0290d9bb023f97e" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3" is_pre_election: true
I20260709 13:02:03.212570  8295 leader_election.cc:304] T 30e220d65bed42489b2af858d3a60981 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807, 7b3ea460d1294b8a82672d7c21475cb5; no voters: 53a66c851dc74c70b94c65d464a391f6
I20260709 13:02:03.211892  8328 raft_consensus.cc:3060] T 4d5829b9233a48fea0290d9bb023f97e P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:03.213456  8654 raft_consensus.cc:2804] T 30e220d65bed42489b2af858d3a60981 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:03.214576  8654 raft_consensus.cc:697] T 30e220d65bed42489b2af858d3a60981 P 590ee39ce5734876b94d91fc3931b807 [term 1 LEADER]: Becoming Leader. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Running, Role: LEADER
I20260709 13:02:03.215487  8602 tablet_bootstrap.cc:654] T 1fe73d50e76147ebace9610e09de74a5 P 7b3ea460d1294b8a82672d7c21475cb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:03.215523  8654 consensus_queue.cc:237] T 30e220d65bed42489b2af858d3a60981 P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:03.217397  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d5829b9233a48fea0290d9bb023f97e" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:02:03.218298  8404 raft_consensus.cc:2393] T 4d5829b9233a48fea0290d9bb023f97e P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 590ee39ce5734876b94d91fc3931b807 in current term 1: Already voted for candidate b560e9aaec7a4c78b9123b38e73519a3 in this term.
I20260709 13:02:03.219514  8295 leader_election.cc:304] T 4d5829b9233a48fea0290d9bb023f97e P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807; no voters: 53a66c851dc74c70b94c65d464a391f6, b560e9aaec7a4c78b9123b38e73519a3
I20260709 13:02:03.234930  8708 raft_consensus.cc:493] T 610562885f5849d083ac5f7a85011891 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.235673  8708 raft_consensus.cc:515] T 610562885f5849d083ac5f7a85011891 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:03.239878  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610562885f5849d083ac5f7a85011891" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
W20260709 13:02:03.241760  8371 leader_election.cc:343] T 610562885f5849d083ac5f7a85011891 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:03.242653  8601 tablet_bootstrap.cc:492] T d4cd925acef04f3c8910aa1903b760c7 P b560e9aaec7a4c78b9123b38e73519a3: Bootstrap starting.
I20260709 13:02:03.242928  8886 consensus_queue.cc:1048] T 435da692a6474cb697066524d4f5216e P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:03.247071  8708 leader_election.cc:290] T 610562885f5849d083ac5f7a85011891 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:02:03.248992  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610562885f5849d083ac5f7a85011891" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
I20260709 13:02:03.210740  8598 tablet_bootstrap.cc:654] T 53842ab4d1d748bda0c7f0d933e5a785 P 53a66c851dc74c70b94c65d464a391f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:03.264909  8837 raft_consensus.cc:2749] T 4d5829b9233a48fea0290d9bb023f97e P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:02:03.285523  8370 leader_election.cc:343] T 610562885f5849d083ac5f7a85011891 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:03.249223  8908 consensus_queue.cc:1048] T 62a3aed976de4d62a1d4dc7bc5252328 P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260709 13:02:03.298287  8370 leader_election.cc:304] T 610562885f5849d083ac5f7a85011891 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6; no voters: 590ee39ce5734876b94d91fc3931b807, 7b3ea460d1294b8a82672d7c21475cb5
I20260709 13:02:03.303051  8899 raft_consensus.cc:2749] T 610562885f5849d083ac5f7a85011891 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:03.304584  8601 tablet_bootstrap.cc:654] T d4cd925acef04f3c8910aa1903b760c7 P b560e9aaec7a4c78b9123b38e73519a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:03.306624  8661 consensus_queue.cc:1048] T 4d5829b9233a48fea0290d9bb023f97e P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:03.309250  8661 consensus_queue.cc:1048] T 435da692a6474cb697066524d4f5216e P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:03.312875  8602 tablet_bootstrap.cc:492] T 1fe73d50e76147ebace9610e09de74a5 P 7b3ea460d1294b8a82672d7c21475cb5: No bootstrap required, opened a new log
I20260709 13:02:03.313423  8602 ts_tablet_manager.cc:1403] T 1fe73d50e76147ebace9610e09de74a5 P 7b3ea460d1294b8a82672d7c21475cb5: Time spent bootstrapping tablet: real 0.131s	user 0.010s	sys 0.004s
I20260709 13:02:03.317471  8602 raft_consensus.cc:359] T 1fe73d50e76147ebace9610e09de74a5 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:03.318226  8602 raft_consensus.cc:385] T 1fe73d50e76147ebace9610e09de74a5 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:03.318535  8602 raft_consensus.cc:740] T 1fe73d50e76147ebace9610e09de74a5 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Initialized, Role: FOLLOWER
I20260709 13:02:03.319307  8602 consensus_queue.cc:260] T 1fe73d50e76147ebace9610e09de74a5 P 7b3ea460d1294b8a82672d7c21475cb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:03.322431  8602 ts_tablet_manager.cc:1434] T 1fe73d50e76147ebace9610e09de74a5 P 7b3ea460d1294b8a82672d7c21475cb5: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:02:03.323530  8602 tablet_bootstrap.cc:492] T 610562885f5849d083ac5f7a85011891 P 7b3ea460d1294b8a82672d7c21475cb5: Bootstrap starting.
W20260709 13:02:03.295578  8295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45429, user_credentials={real_user=slave}} blocked reactor thread for 63928.7us
I20260709 13:02:03.349185  8602 tablet_bootstrap.cc:654] T 610562885f5849d083ac5f7a85011891 P 7b3ea460d1294b8a82672d7c21475cb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:03.351303  8802 consensus_queue.cc:1048] T 4d5829b9233a48fea0290d9bb023f97e P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:03.361661  8602 tablet_bootstrap.cc:492] T 610562885f5849d083ac5f7a85011891 P 7b3ea460d1294b8a82672d7c21475cb5: No bootstrap required, opened a new log
I20260709 13:02:03.362187  8602 ts_tablet_manager.cc:1403] T 610562885f5849d083ac5f7a85011891 P 7b3ea460d1294b8a82672d7c21475cb5: Time spent bootstrapping tablet: real 0.039s	user 0.014s	sys 0.001s
I20260709 13:02:03.364583  8602 raft_consensus.cc:359] T 610562885f5849d083ac5f7a85011891 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:03.366788  8602 raft_consensus.cc:385] T 610562885f5849d083ac5f7a85011891 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:03.367072  8602 raft_consensus.cc:740] T 610562885f5849d083ac5f7a85011891 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Initialized, Role: FOLLOWER
I20260709 13:02:03.368691  8602 consensus_queue.cc:260] T 610562885f5849d083ac5f7a85011891 P 7b3ea460d1294b8a82672d7c21475cb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:03.373966  8602 ts_tablet_manager.cc:1434] T 610562885f5849d083ac5f7a85011891 P 7b3ea460d1294b8a82672d7c21475cb5: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:02:03.374203  8598 tablet_bootstrap.cc:492] T 53842ab4d1d748bda0c7f0d933e5a785 P 53a66c851dc74c70b94c65d464a391f6: No bootstrap required, opened a new log
I20260709 13:02:03.374797  8598 ts_tablet_manager.cc:1403] T 53842ab4d1d748bda0c7f0d933e5a785 P 53a66c851dc74c70b94c65d464a391f6: Time spent bootstrapping tablet: real 0.173s	user 0.011s	sys 0.000s
I20260709 13:02:03.375111  8602 tablet_bootstrap.cc:492] T b574d11894634755bd89c530b4155f1e P 7b3ea460d1294b8a82672d7c21475cb5: Bootstrap starting.
I20260709 13:02:03.393527  8602 tablet_bootstrap.cc:654] T b574d11894634755bd89c530b4155f1e P 7b3ea460d1294b8a82672d7c21475cb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:03.394169  8885 consensus_queue.cc:1048] T 69ef277bbcbd41d8a10ae92d9a63145e P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:03.395867  8601 tablet_bootstrap.cc:492] T d4cd925acef04f3c8910aa1903b760c7 P b560e9aaec7a4c78b9123b38e73519a3: No bootstrap required, opened a new log
I20260709 13:02:03.396397  8601 ts_tablet_manager.cc:1403] T d4cd925acef04f3c8910aa1903b760c7 P b560e9aaec7a4c78b9123b38e73519a3: Time spent bootstrapping tablet: real 0.154s	user 0.015s	sys 0.023s
I20260709 13:02:03.391214  8886 consensus_queue.cc:1048] T 5db51a6d67e6461a98e669fa2b1e59c8 P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 13:02:03.410579  8661 consensus_queue.cc:1048] T 69ef277bbcbd41d8a10ae92d9a63145e P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:03.411098  8799 consensus_queue.cc:1048] T 5db51a6d67e6461a98e669fa2b1e59c8 P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:03.420163  8887 raft_consensus.cc:493] T 1fe73d50e76147ebace9610e09de74a5 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.421653  8887 raft_consensus.cc:515] T 1fe73d50e76147ebace9610e09de74a5 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:03.423799  8887 leader_election.cc:290] T 1fe73d50e76147ebace9610e09de74a5 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751), b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503)
I20260709 13:02:03.425022  8552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe73d50e76147ebace9610e09de74a5" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3" is_pre_election: true
I20260709 13:02:03.425325  8401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe73d50e76147ebace9610e09de74a5" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:02:03.425803  8552 raft_consensus.cc:2468] T 1fe73d50e76147ebace9610e09de74a5 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b3ea460d1294b8a82672d7c21475cb5 in term 0.
I20260709 13:02:03.425976  8401 raft_consensus.cc:2468] T 1fe73d50e76147ebace9610e09de74a5 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b3ea460d1294b8a82672d7c21475cb5 in term 0.
I20260709 13:02:03.427366  8443 leader_election.cc:304] T 1fe73d50e76147ebace9610e09de74a5 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b3ea460d1294b8a82672d7c21475cb5, b560e9aaec7a4c78b9123b38e73519a3; no voters: 
I20260709 13:02:03.430094  8887 raft_consensus.cc:2804] T 1fe73d50e76147ebace9610e09de74a5 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:03.430534  8887 raft_consensus.cc:493] T 1fe73d50e76147ebace9610e09de74a5 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:03.430897  8887 raft_consensus.cc:3060] T 1fe73d50e76147ebace9610e09de74a5 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:03.450465  8600 tablet_bootstrap.cc:492] T e8353e508def43e5a8008bb63ff1a84a P 590ee39ce5734876b94d91fc3931b807: No bootstrap required, opened a new log
I20260709 13:02:03.450979  8600 ts_tablet_manager.cc:1403] T e8353e508def43e5a8008bb63ff1a84a P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.365s	user 0.018s	sys 0.004s
I20260709 13:02:03.454375  8598 raft_consensus.cc:359] T 53842ab4d1d748bda0c7f0d933e5a785 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:03.461524  8598 raft_consensus.cc:385] T 53842ab4d1d748bda0c7f0d933e5a785 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:03.461936  8598 raft_consensus.cc:740] T 53842ab4d1d748bda0c7f0d933e5a785 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Initialized, Role: FOLLOWER
I20260709 13:02:03.463205  8598 consensus_queue.cc:260] T 53842ab4d1d748bda0c7f0d933e5a785 P 53a66c851dc74c70b94c65d464a391f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:03.470389  8228 catalog_manager.cc:5697] T 30e220d65bed42489b2af858d3a60981 P 590ee39ce5734876b94d91fc3931b807 reported cstate change: term changed from 0 to 1, leader changed from <none> to 590ee39ce5734876b94d91fc3931b807 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "590ee39ce5734876b94d91fc3931b807" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:03.467018  8601 raft_consensus.cc:359] T d4cd925acef04f3c8910aa1903b760c7 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:03.474565  8601 raft_consensus.cc:385] T d4cd925acef04f3c8910aa1903b760c7 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:03.475030  8601 raft_consensus.cc:740] T d4cd925acef04f3c8910aa1903b760c7 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Initialized, Role: FOLLOWER
I20260709 13:02:03.489965  8708 raft_consensus.cc:493] T 53842ab4d1d748bda0c7f0d933e5a785 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.490744  8708 raft_consensus.cc:515] T 53842ab4d1d748bda0c7f0d933e5a785 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:03.460279  8885 raft_consensus.cc:493] T da02fa98f6de48a7baefadf6e69d2046 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.493811  8598 ts_tablet_manager.cc:1434] T 53842ab4d1d748bda0c7f0d933e5a785 P 53a66c851dc74c70b94c65d464a391f6: Time spent starting tablet: real 0.119s	user 0.009s	sys 0.000s
I20260709 13:02:03.496470  8601 consensus_queue.cc:260] T d4cd925acef04f3c8910aa1903b760c7 P b560e9aaec7a4c78b9123b38e73519a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:03.500982  8598 tablet_bootstrap.cc:492] T 6a82728feb4f4f1094191c0e30d748dd P 53a66c851dc74c70b94c65d464a391f6: Bootstrap starting.
I20260709 13:02:03.495661  8885 raft_consensus.cc:515] T da02fa98f6de48a7baefadf6e69d2046 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:03.505056  8885 leader_election.cc:290] T da02fa98f6de48a7baefadf6e69d2046 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:02:03.509838  8401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da02fa98f6de48a7baefadf6e69d2046" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:02:03.513651  8601 ts_tablet_manager.cc:1434] T d4cd925acef04f3c8910aa1903b760c7 P b560e9aaec7a4c78b9123b38e73519a3: Time spent starting tablet: real 0.117s	user 0.007s	sys 0.001s
I20260709 13:02:03.514895  8601 tablet_bootstrap.cc:492] T 6a82728feb4f4f1094191c0e30d748dd P b560e9aaec7a4c78b9123b38e73519a3: Bootstrap starting.
W20260709 13:02:03.515506  8518 leader_election.cc:343] T da02fa98f6de48a7baefadf6e69d2046 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:03.535509  8799 raft_consensus.cc:493] T d4cd925acef04f3c8910aa1903b760c7 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.536275  8799 raft_consensus.cc:515] T d4cd925acef04f3c8910aa1903b760c7 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:03.538870  8799 leader_election.cc:290] T d4cd925acef04f3c8910aa1903b760c7 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:02:03.539300  8600 raft_consensus.cc:359] T e8353e508def43e5a8008bb63ff1a84a P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:03.541409  8600 raft_consensus.cc:385] T e8353e508def43e5a8008bb63ff1a84a P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:03.542536  8888 raft_consensus.cc:493] T e8353e508def43e5a8008bb63ff1a84a P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.543038  8888 raft_consensus.cc:515] T e8353e508def43e5a8008bb63ff1a84a P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:03.541764  8600 raft_consensus.cc:740] T e8353e508def43e5a8008bb63ff1a84a P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:03.545876  8598 tablet_bootstrap.cc:654] T 6a82728feb4f4f1094191c0e30d748dd P 53a66c851dc74c70b94c65d464a391f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:03.545375  8600 consensus_queue.cc:260] T e8353e508def43e5a8008bb63ff1a84a P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:03.547220  8888 leader_election.cc:290] T e8353e508def43e5a8008bb63ff1a84a P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:02:03.548895  8552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8353e508def43e5a8008bb63ff1a84a" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3" is_pre_election: true
I20260709 13:02:03.549602  8552 raft_consensus.cc:2468] T e8353e508def43e5a8008bb63ff1a84a P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b3ea460d1294b8a82672d7c21475cb5 in term 0.
I20260709 13:02:03.549639  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8353e508def43e5a8008bb63ff1a84a" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
I20260709 13:02:03.550405  8328 raft_consensus.cc:2468] T e8353e508def43e5a8008bb63ff1a84a P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b3ea460d1294b8a82672d7c21475cb5 in term 0.
I20260709 13:02:03.550590  8887 raft_consensus.cc:515] T 1fe73d50e76147ebace9610e09de74a5 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:03.559314  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842ab4d1d748bda0c7f0d933e5a785" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
I20260709 13:02:03.551412  8443 leader_election.cc:304] T e8353e508def43e5a8008bb63ff1a84a P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b3ea460d1294b8a82672d7c21475cb5, b560e9aaec7a4c78b9123b38e73519a3; no voters: 
I20260709 13:02:03.553967  8708 leader_election.cc:290] T 53842ab4d1d748bda0c7f0d933e5a785 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:02:03.562239  8601 tablet_bootstrap.cc:654] T 6a82728feb4f4f1094191c0e30d748dd P b560e9aaec7a4c78b9123b38e73519a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:03.562978  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842ab4d1d748bda0c7f0d933e5a785" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
I20260709 13:02:03.563644  8476 raft_consensus.cc:2468] T 53842ab4d1d748bda0c7f0d933e5a785 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53a66c851dc74c70b94c65d464a391f6 in term 0.
I20260709 13:02:03.563892  8888 raft_consensus.cc:2804] T e8353e508def43e5a8008bb63ff1a84a P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:03.564404  8888 raft_consensus.cc:493] T e8353e508def43e5a8008bb63ff1a84a P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:03.564836  8888 raft_consensus.cc:3060] T e8353e508def43e5a8008bb63ff1a84a P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:03.565193  8370 leader_election.cc:304] T 53842ab4d1d748bda0c7f0d933e5a785 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, 7b3ea460d1294b8a82672d7c21475cb5; no voters: 
I20260709 13:02:03.566109  8708 raft_consensus.cc:2804] T 53842ab4d1d748bda0c7f0d933e5a785 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:03.566502  8708 raft_consensus.cc:493] T 53842ab4d1d748bda0c7f0d933e5a785 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:03.566856  8708 raft_consensus.cc:3060] T 53842ab4d1d748bda0c7f0d933e5a785 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:03.568261  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe73d50e76147ebace9610e09de74a5" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6"
I20260709 13:02:03.566869  8887 leader_election.cc:290] T 1fe73d50e76147ebace9610e09de74a5 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 election: Requested vote from peers 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751), b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503)
I20260709 13:02:03.569075  8405 raft_consensus.cc:3060] T 1fe73d50e76147ebace9610e09de74a5 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:03.570838  8552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1fe73d50e76147ebace9610e09de74a5" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3"
W20260709 13:02:03.571405  8371 leader_election.cc:343] T 53842ab4d1d748bda0c7f0d933e5a785 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:03.571630  8552 raft_consensus.cc:3060] T 1fe73d50e76147ebace9610e09de74a5 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:03.575664  8600 ts_tablet_manager.cc:1434] T e8353e508def43e5a8008bb63ff1a84a P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.124s	user 0.005s	sys 0.003s
I20260709 13:02:03.576828  8600 tablet_bootstrap.cc:492] T 53842ab4d1d748bda0c7f0d933e5a785 P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:03.577616  8405 raft_consensus.cc:2468] T 1fe73d50e76147ebace9610e09de74a5 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b3ea460d1294b8a82672d7c21475cb5 in term 1.
I20260709 13:02:03.579268  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da02fa98f6de48a7baefadf6e69d2046" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
I20260709 13:02:03.580924  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4cd925acef04f3c8910aa1903b760c7" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
I20260709 13:02:03.583783  8601 tablet_bootstrap.cc:492] T 6a82728feb4f4f1094191c0e30d748dd P b560e9aaec7a4c78b9123b38e73519a3: No bootstrap required, opened a new log
I20260709 13:02:03.602859  8601 ts_tablet_manager.cc:1403] T 6a82728feb4f4f1094191c0e30d748dd P b560e9aaec7a4c78b9123b38e73519a3: Time spent bootstrapping tablet: real 0.088s	user 0.011s	sys 0.002s
I20260709 13:02:03.607795  8601 raft_consensus.cc:359] T 6a82728feb4f4f1094191c0e30d748dd P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:03.608585  8601 raft_consensus.cc:385] T 6a82728feb4f4f1094191c0e30d748dd P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:03.583330  8602 tablet_bootstrap.cc:492] T b574d11894634755bd89c530b4155f1e P 7b3ea460d1294b8a82672d7c21475cb5: No bootstrap required, opened a new log
I20260709 13:02:03.577234  8708 raft_consensus.cc:515] T 53842ab4d1d748bda0c7f0d933e5a785 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:03.599424  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4cd925acef04f3c8910aa1903b760c7" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
I20260709 13:02:03.608888  8601 raft_consensus.cc:740] T 6a82728feb4f4f1094191c0e30d748dd P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Initialized, Role: FOLLOWER
I20260709 13:02:03.612387  8602 ts_tablet_manager.cc:1403] T b574d11894634755bd89c530b4155f1e P 7b3ea460d1294b8a82672d7c21475cb5: Time spent bootstrapping tablet: real 0.238s	user 0.033s	sys 0.027s
I20260709 13:02:03.617534  8601 consensus_queue.cc:260] T 6a82728feb4f4f1094191c0e30d748dd P b560e9aaec7a4c78b9123b38e73519a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:03.626096  8601 ts_tablet_manager.cc:1434] T 6a82728feb4f4f1094191c0e30d748dd P b560e9aaec7a4c78b9123b38e73519a3: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
W20260709 13:02:03.633775  8519 leader_election.cc:343] T da02fa98f6de48a7baefadf6e69d2046 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:03.634346  8519 leader_election.cc:304] T da02fa98f6de48a7baefadf6e69d2046 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b560e9aaec7a4c78b9123b38e73519a3; no voters: 53a66c851dc74c70b94c65d464a391f6, 590ee39ce5734876b94d91fc3931b807
W20260709 13:02:03.635510  8519 leader_election.cc:343] T d4cd925acef04f3c8910aa1903b760c7 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:03.636428  8605 raft_consensus.cc:2749] T da02fa98f6de48a7baefadf6e69d2046 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:03.637106  8708 leader_election.cc:290] T 53842ab4d1d748bda0c7f0d933e5a785 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 election: Requested vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:02:03.620721  8444 leader_election.cc:304] T 1fe73d50e76147ebace9610e09de74a5 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, 7b3ea460d1294b8a82672d7c21475cb5; no voters: 
I20260709 13:02:03.641696  8477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842ab4d1d748bda0c7f0d933e5a785" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5"
I20260709 13:02:03.642357  8477 raft_consensus.cc:3060] T 53842ab4d1d748bda0c7f0d933e5a785 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:03.643044  8600 tablet_bootstrap.cc:654] T 53842ab4d1d748bda0c7f0d933e5a785 P 590ee39ce5734876b94d91fc3931b807: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:03.639823  8602 raft_consensus.cc:359] T b574d11894634755bd89c530b4155f1e P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:03.643988  8602 raft_consensus.cc:385] T b574d11894634755bd89c530b4155f1e P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:02:03.644109  8518 leader_election.cc:343] T d4cd925acef04f3c8910aa1903b760c7 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:03.644351  8602 raft_consensus.cc:740] T b574d11894634755bd89c530b4155f1e P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Initialized, Role: FOLLOWER
I20260709 13:02:03.644654  8518 leader_election.cc:304] T d4cd925acef04f3c8910aa1903b760c7 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b560e9aaec7a4c78b9123b38e73519a3; no voters: 590ee39ce5734876b94d91fc3931b807, 7b3ea460d1294b8a82672d7c21475cb5
I20260709 13:02:03.645429  8802 raft_consensus.cc:2749] T d4cd925acef04f3c8910aa1903b760c7 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:03.645212  8602 consensus_queue.cc:260] T b574d11894634755bd89c530b4155f1e P 7b3ea460d1294b8a82672d7c21475cb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:03.645772  8887 raft_consensus.cc:2804] T 1fe73d50e76147ebace9610e09de74a5 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:03.646373  8887 raft_consensus.cc:697] T 1fe73d50e76147ebace9610e09de74a5 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 LEADER]: Becoming Leader. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Running, Role: LEADER
I20260709 13:02:03.647468  8602 ts_tablet_manager.cc:1434] T b574d11894634755bd89c530b4155f1e P 7b3ea460d1294b8a82672d7c21475cb5: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 13:02:03.647217  8887 consensus_queue.cc:237] T 1fe73d50e76147ebace9610e09de74a5 P 7b3ea460d1294b8a82672d7c21475cb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:03.648697  8602 tablet_bootstrap.cc:492] T 6a82728feb4f4f1094191c0e30d748dd P 7b3ea460d1294b8a82672d7c21475cb5: Bootstrap starting.
I20260709 13:02:03.648954  8601 tablet_bootstrap.cc:492] T 308f98e21e714cea8c363eb315d72e27 P b560e9aaec7a4c78b9123b38e73519a3: Bootstrap starting.
I20260709 13:02:03.652036  8477 raft_consensus.cc:2468] T 53842ab4d1d748bda0c7f0d933e5a785 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53a66c851dc74c70b94c65d464a391f6 in term 1.
I20260709 13:02:03.658237  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842ab4d1d748bda0c7f0d933e5a785" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807"
I20260709 13:02:03.664741  8552 raft_consensus.cc:2468] T 1fe73d50e76147ebace9610e09de74a5 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b3ea460d1294b8a82672d7c21475cb5 in term 1.
I20260709 13:02:03.667445  8888 raft_consensus.cc:515] T e8353e508def43e5a8008bb63ff1a84a P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:03.669617  8888 leader_election.cc:290] T e8353e508def43e5a8008bb63ff1a84a P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 election: Requested vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:02:03.670320  8552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8353e508def43e5a8008bb63ff1a84a" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3"
I20260709 13:02:03.671015  8552 raft_consensus.cc:3060] T e8353e508def43e5a8008bb63ff1a84a P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:03.674614  8601 tablet_bootstrap.cc:654] T 308f98e21e714cea8c363eb315d72e27 P b560e9aaec7a4c78b9123b38e73519a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:03.674659  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8353e508def43e5a8008bb63ff1a84a" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807"
I20260709 13:02:03.677084  8326 raft_consensus.cc:3060] T e8353e508def43e5a8008bb63ff1a84a P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:03.678972  8598 tablet_bootstrap.cc:492] T 6a82728feb4f4f1094191c0e30d748dd P 53a66c851dc74c70b94c65d464a391f6: No bootstrap required, opened a new log
I20260709 13:02:03.692301  8598 ts_tablet_manager.cc:1403] T 6a82728feb4f4f1094191c0e30d748dd P 53a66c851dc74c70b94c65d464a391f6: Time spent bootstrapping tablet: real 0.195s	user 0.019s	sys 0.013s
I20260709 13:02:03.695319  8598 raft_consensus.cc:359] T 6a82728feb4f4f1094191c0e30d748dd P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:03.682778  8370 leader_election.cc:304] T 53842ab4d1d748bda0c7f0d933e5a785 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, 7b3ea460d1294b8a82672d7c21475cb5; no voters: 
I20260709 13:02:03.700645  8708 raft_consensus.cc:2804] T 53842ab4d1d748bda0c7f0d933e5a785 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:03.701512  8598 raft_consensus.cc:385] T 6a82728feb4f4f1094191c0e30d748dd P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:03.698558  8605 raft_consensus.cc:493] T 6a82728feb4f4f1094191c0e30d748dd P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.703172  8605 raft_consensus.cc:515] T 6a82728feb4f4f1094191c0e30d748dd P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:03.707906  8477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a82728feb4f4f1094191c0e30d748dd" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
W20260709 13:02:03.709782  8518 leader_election.cc:343] T 6a82728feb4f4f1094191c0e30d748dd P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:03.710501  8605 leader_election.cc:290] T 6a82728feb4f4f1094191c0e30d748dd P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:02:03.682015  8602 tablet_bootstrap.cc:654] T 6a82728feb4f4f1094191c0e30d748dd P 7b3ea460d1294b8a82672d7c21475cb5: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:03.700659  8371 leader_election.cc:343] T 53842ab4d1d748bda0c7f0d933e5a785 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:03.701385  8708 raft_consensus.cc:697] T 53842ab4d1d748bda0c7f0d933e5a785 P 53a66c851dc74c70b94c65d464a391f6 [term 1 LEADER]: Becoming Leader. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Running, Role: LEADER
I20260709 13:02:03.702719  8600 tablet_bootstrap.cc:492] T 53842ab4d1d748bda0c7f0d933e5a785 P 590ee39ce5734876b94d91fc3931b807: No bootstrap required, opened a new log
I20260709 13:02:03.720455  8600 ts_tablet_manager.cc:1403] T 53842ab4d1d748bda0c7f0d933e5a785 P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.144s	user 0.013s	sys 0.001s
I20260709 13:02:03.720749  8708 consensus_queue.cc:237] T 53842ab4d1d748bda0c7f0d933e5a785 P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:03.723251  8600 raft_consensus.cc:359] T 53842ab4d1d748bda0c7f0d933e5a785 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:03.723992  8600 raft_consensus.cc:385] T 53842ab4d1d748bda0c7f0d933e5a785 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:03.724293  8600 raft_consensus.cc:740] T 53842ab4d1d748bda0c7f0d933e5a785 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:03.724885  8600 consensus_queue.cc:260] T 53842ab4d1d748bda0c7f0d933e5a785 P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:03.727835  8600 ts_tablet_manager.cc:1434] T 53842ab4d1d748bda0c7f0d933e5a785 P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:02:03.728884  8600 tablet_bootstrap.cc:492] T da02fa98f6de48a7baefadf6e69d2046 P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:03.730705  8819 raft_consensus.cc:493] T b574d11894634755bd89c530b4155f1e P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.731222  8819 raft_consensus.cc:515] T b574d11894634755bd89c530b4155f1e P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:03.734899  8326 raft_consensus.cc:2468] T e8353e508def43e5a8008bb63ff1a84a P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b3ea460d1294b8a82672d7c21475cb5 in term 1.
I20260709 13:02:03.736487  8445 leader_election.cc:304] T e8353e508def43e5a8008bb63ff1a84a P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807, 7b3ea460d1294b8a82672d7c21475cb5; no voters: 
I20260709 13:02:03.735167  8600 tablet_bootstrap.cc:654] T da02fa98f6de48a7baefadf6e69d2046 P 590ee39ce5734876b94d91fc3931b807: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:03.738595  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b574d11894634755bd89c530b4155f1e" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
I20260709 13:02:03.738807  8550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b574d11894634755bd89c530b4155f1e" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3" is_pre_election: true
I20260709 13:02:03.739383  8888 raft_consensus.cc:2804] T e8353e508def43e5a8008bb63ff1a84a P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:03.740212  8888 raft_consensus.cc:697] T e8353e508def43e5a8008bb63ff1a84a P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 LEADER]: Becoming Leader. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Running, Role: LEADER
W20260709 13:02:03.740387  8445 leader_election.cc:343] T b574d11894634755bd89c530b4155f1e P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:03.741153  8443 leader_election.cc:343] T b574d11894634755bd89c530b4155f1e P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:03.741659  8443 leader_election.cc:304] T b574d11894634755bd89c530b4155f1e P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b3ea460d1294b8a82672d7c21475cb5; no voters: 590ee39ce5734876b94d91fc3931b807, b560e9aaec7a4c78b9123b38e73519a3
I20260709 13:02:03.742604  8821 raft_consensus.cc:2749] T b574d11894634755bd89c530b4155f1e P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:03.746557  8888 consensus_queue.cc:237] T e8353e508def43e5a8008bb63ff1a84a P 7b3ea460d1294b8a82672d7c21475cb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:03.748021  8908 consensus_queue.cc:1048] T 30e220d65bed42489b2af858d3a60981 P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:03.736356  8819 leader_election.cc:290] T b574d11894634755bd89c530b4155f1e P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:02:03.691498  8552 raft_consensus.cc:2468] T e8353e508def43e5a8008bb63ff1a84a P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b3ea460d1294b8a82672d7c21475cb5 in term 1.
I20260709 13:02:03.750579  8908 consensus_queue.cc:1048] T 30e220d65bed42489b2af858d3a60981 P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:03.752867  8598 raft_consensus.cc:740] T 6a82728feb4f4f1094191c0e30d748dd P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Initialized, Role: FOLLOWER
I20260709 13:02:03.759706  8598 consensus_queue.cc:260] T 6a82728feb4f4f1094191c0e30d748dd P 53a66c851dc74c70b94c65d464a391f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:03.770648  8602 tablet_bootstrap.cc:492] T 6a82728feb4f4f1094191c0e30d748dd P 7b3ea460d1294b8a82672d7c21475cb5: No bootstrap required, opened a new log
I20260709 13:02:03.771282  8602 ts_tablet_manager.cc:1403] T 6a82728feb4f4f1094191c0e30d748dd P 7b3ea460d1294b8a82672d7c21475cb5: Time spent bootstrapping tablet: real 0.123s	user 0.012s	sys 0.002s
I20260709 13:02:03.774510  8602 raft_consensus.cc:359] T 6a82728feb4f4f1094191c0e30d748dd P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:03.775305  8602 raft_consensus.cc:385] T 6a82728feb4f4f1094191c0e30d748dd P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:03.774966  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a82728feb4f4f1094191c0e30d748dd" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:02:03.775657  8602 raft_consensus.cc:740] T 6a82728feb4f4f1094191c0e30d748dd P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Initialized, Role: FOLLOWER
I20260709 13:02:03.776451  8602 consensus_queue.cc:260] T 6a82728feb4f4f1094191c0e30d748dd P 7b3ea460d1294b8a82672d7c21475cb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:03.766762  8228 catalog_manager.cc:5697] T 1fe73d50e76147ebace9610e09de74a5 P 7b3ea460d1294b8a82672d7c21475cb5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "7b3ea460d1294b8a82672d7c21475cb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:03.781591  8602 ts_tablet_manager.cc:1434] T 6a82728feb4f4f1094191c0e30d748dd P 7b3ea460d1294b8a82672d7c21475cb5: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:02:03.782733  8602 tablet_bootstrap.cc:492] T b1d8e928d8444f77ac2950eab2115f65 P 7b3ea460d1294b8a82672d7c21475cb5: Bootstrap starting.
I20260709 13:02:03.776073  8405 raft_consensus.cc:2468] T 6a82728feb4f4f1094191c0e30d748dd P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 0.
I20260709 13:02:03.796353  8598 ts_tablet_manager.cc:1434] T 6a82728feb4f4f1094191c0e30d748dd P 53a66c851dc74c70b94c65d464a391f6: Time spent starting tablet: real 0.103s	user 0.007s	sys 0.001s
I20260709 13:02:03.797794  8598 tablet_bootstrap.cc:492] T da02fa98f6de48a7baefadf6e69d2046 P 53a66c851dc74c70b94c65d464a391f6: Bootstrap starting.
I20260709 13:02:03.800314  8888 raft_consensus.cc:493] T 610562885f5849d083ac5f7a85011891 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.800971  8888 raft_consensus.cc:515] T 610562885f5849d083ac5f7a85011891 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
W20260709 13:02:03.806701  8276 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:03.808774  8518 leader_election.cc:304] T 6a82728feb4f4f1094191c0e30d748dd P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, b560e9aaec7a4c78b9123b38e73519a3; no voters: 7b3ea460d1294b8a82672d7c21475cb5
I20260709 13:02:03.811813  8605 raft_consensus.cc:2804] T 6a82728feb4f4f1094191c0e30d748dd P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:03.812264  8605 raft_consensus.cc:493] T 6a82728feb4f4f1094191c0e30d748dd P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:03.812661  8605 raft_consensus.cc:3060] T 6a82728feb4f4f1094191c0e30d748dd P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:03.822013  8888 leader_election.cc:290] T 610562885f5849d083ac5f7a85011891 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:02:03.822592  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610562885f5849d083ac5f7a85011891" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
I20260709 13:02:03.823025  8224 catalog_manager.cc:5697] T e8353e508def43e5a8008bb63ff1a84a P 7b3ea460d1294b8a82672d7c21475cb5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "7b3ea460d1294b8a82672d7c21475cb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:03.824317  8445 leader_election.cc:343] T 610562885f5849d083ac5f7a85011891 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:03.830879  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610562885f5849d083ac5f7a85011891" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:02:03.831653  8405 raft_consensus.cc:2468] T 610562885f5849d083ac5f7a85011891 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b3ea460d1294b8a82672d7c21475cb5 in term 0.
I20260709 13:02:03.834620  8228 catalog_manager.cc:5697] T 53842ab4d1d748bda0c7f0d933e5a785 P 53a66c851dc74c70b94c65d464a391f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "53a66c851dc74c70b94c65d464a391f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:03.844730  8444 leader_election.cc:304] T 610562885f5849d083ac5f7a85011891 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, 7b3ea460d1294b8a82672d7c21475cb5; no voters: 590ee39ce5734876b94d91fc3931b807
I20260709 13:02:03.847361  8605 raft_consensus.cc:515] T 6a82728feb4f4f1094191c0e30d748dd P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:03.853238  8605 leader_election.cc:290] T 6a82728feb4f4f1094191c0e30d748dd P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 election: Requested vote from peers 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:02:03.849567  8888 raft_consensus.cc:2804] T 610562885f5849d083ac5f7a85011891 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:03.856058  8888 raft_consensus.cc:493] T 610562885f5849d083ac5f7a85011891 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:03.856447  8888 raft_consensus.cc:3060] T 610562885f5849d083ac5f7a85011891 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:03.857928  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a82728feb4f4f1094191c0e30d748dd" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5"
I20260709 13:02:03.858665  8478 raft_consensus.cc:3060] T 6a82728feb4f4f1094191c0e30d748dd P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:03.863807  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a82728feb4f4f1094191c0e30d748dd" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6"
I20260709 13:02:03.866474  8400 raft_consensus.cc:3060] T 6a82728feb4f4f1094191c0e30d748dd P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:03.867400  8602 tablet_bootstrap.cc:654] T b1d8e928d8444f77ac2950eab2115f65 P 7b3ea460d1294b8a82672d7c21475cb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:03.870110  8601 tablet_bootstrap.cc:492] T 308f98e21e714cea8c363eb315d72e27 P b560e9aaec7a4c78b9123b38e73519a3: No bootstrap required, opened a new log
I20260709 13:02:03.870599  8601 ts_tablet_manager.cc:1403] T 308f98e21e714cea8c363eb315d72e27 P b560e9aaec7a4c78b9123b38e73519a3: Time spent bootstrapping tablet: real 0.222s	user 0.024s	sys 0.036s
I20260709 13:02:03.885596  8601 raft_consensus.cc:359] T 308f98e21e714cea8c363eb315d72e27 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:03.886387  8601 raft_consensus.cc:385] T 308f98e21e714cea8c363eb315d72e27 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:03.886703  8601 raft_consensus.cc:740] T 308f98e21e714cea8c363eb315d72e27 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Initialized, Role: FOLLOWER
I20260709 13:02:03.895777  8601 consensus_queue.cc:260] T 308f98e21e714cea8c363eb315d72e27 P b560e9aaec7a4c78b9123b38e73519a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:03.900517  8478 raft_consensus.cc:2468] T 6a82728feb4f4f1094191c0e30d748dd P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 1.
I20260709 13:02:03.902007  8518 leader_election.cc:304] T 6a82728feb4f4f1094191c0e30d748dd P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b3ea460d1294b8a82672d7c21475cb5, b560e9aaec7a4c78b9123b38e73519a3; no voters: 
I20260709 13:02:03.903461  8885 raft_consensus.cc:2804] T 6a82728feb4f4f1094191c0e30d748dd P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:03.903175  8888 raft_consensus.cc:515] T 610562885f5849d083ac5f7a85011891 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:03.904322  8885 raft_consensus.cc:697] T 6a82728feb4f4f1094191c0e30d748dd P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Becoming Leader. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Running, Role: LEADER
I20260709 13:02:03.905689  8888 leader_election.cc:290] T 610562885f5849d083ac5f7a85011891 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 election: Requested vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:02:03.906459  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610562885f5849d083ac5f7a85011891" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807"
I20260709 13:02:03.907434  8601 ts_tablet_manager.cc:1434] T 308f98e21e714cea8c363eb315d72e27 P b560e9aaec7a4c78b9123b38e73519a3: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
W20260709 13:02:03.908188  8445 leader_election.cc:343] T 610562885f5849d083ac5f7a85011891 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:03.909224  8885 consensus_queue.cc:237] T 6a82728feb4f4f1094191c0e30d748dd P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:03.910796  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610562885f5849d083ac5f7a85011891" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6"
I20260709 13:02:03.911715  8405 raft_consensus.cc:3060] T 610562885f5849d083ac5f7a85011891 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:03.916949  8600 tablet_bootstrap.cc:492] T da02fa98f6de48a7baefadf6e69d2046 P 590ee39ce5734876b94d91fc3931b807: No bootstrap required, opened a new log
I20260709 13:02:03.917554  8600 ts_tablet_manager.cc:1403] T da02fa98f6de48a7baefadf6e69d2046 P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.189s	user 0.024s	sys 0.028s
I20260709 13:02:03.921931  8400 raft_consensus.cc:2468] T 6a82728feb4f4f1094191c0e30d748dd P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 1.
I20260709 13:02:03.923647  8600 raft_consensus.cc:359] T da02fa98f6de48a7baefadf6e69d2046 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:03.924791  8600 raft_consensus.cc:385] T da02fa98f6de48a7baefadf6e69d2046 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:03.924808  8601 tablet_bootstrap.cc:492] T b574d11894634755bd89c530b4155f1e P b560e9aaec7a4c78b9123b38e73519a3: Bootstrap starting.
I20260709 13:02:03.925169  8600 raft_consensus.cc:740] T da02fa98f6de48a7baefadf6e69d2046 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:03.926131  8600 consensus_queue.cc:260] T da02fa98f6de48a7baefadf6e69d2046 P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:03.927589  8598 tablet_bootstrap.cc:654] T da02fa98f6de48a7baefadf6e69d2046 P 53a66c851dc74c70b94c65d464a391f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:03.928623  8600 ts_tablet_manager.cc:1434] T da02fa98f6de48a7baefadf6e69d2046 P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:02:03.930554  8600 tablet_bootstrap.cc:492] T 610562885f5849d083ac5f7a85011891 P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:03.931689  8601 tablet_bootstrap.cc:654] T b574d11894634755bd89c530b4155f1e P b560e9aaec7a4c78b9123b38e73519a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:03.938330  8600 tablet_bootstrap.cc:654] T 610562885f5849d083ac5f7a85011891 P 590ee39ce5734876b94d91fc3931b807: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:03.940972  8654 raft_consensus.cc:493] T 53842ab4d1d748bda0c7f0d933e5a785 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.941581  8654 raft_consensus.cc:515] T 53842ab4d1d748bda0c7f0d933e5a785 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:03.943925  8654 leader_election.cc:290] T 53842ab4d1d748bda0c7f0d933e5a785 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:02:03.946604  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842ab4d1d748bda0c7f0d933e5a785" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:02:03.948055  8477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842ab4d1d748bda0c7f0d933e5a785" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
I20260709 13:02:03.954887  8601 tablet_bootstrap.cc:492] T b574d11894634755bd89c530b4155f1e P b560e9aaec7a4c78b9123b38e73519a3: No bootstrap required, opened a new log
I20260709 13:02:03.955715  8601 ts_tablet_manager.cc:1403] T b574d11894634755bd89c530b4155f1e P b560e9aaec7a4c78b9123b38e73519a3: Time spent bootstrapping tablet: real 0.037s	user 0.017s	sys 0.011s
I20260709 13:02:03.958132  8477 raft_consensus.cc:2393] T 53842ab4d1d748bda0c7f0d933e5a785 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 590ee39ce5734876b94d91fc3931b807 in current term 1: Already voted for candidate 53a66c851dc74c70b94c65d464a391f6 in this term.
I20260709 13:02:03.954932  8654 raft_consensus.cc:493] T da02fa98f6de48a7baefadf6e69d2046 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:03.959790  8654 raft_consensus.cc:515] T da02fa98f6de48a7baefadf6e69d2046 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:03.962224  8654 leader_election.cc:290] T da02fa98f6de48a7baefadf6e69d2046 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:02:03.966921  8602 tablet_bootstrap.cc:492] T b1d8e928d8444f77ac2950eab2115f65 P 7b3ea460d1294b8a82672d7c21475cb5: No bootstrap required, opened a new log
I20260709 13:02:03.966804  8552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da02fa98f6de48a7baefadf6e69d2046" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3" is_pre_election: true
I20260709 13:02:03.967581  8602 ts_tablet_manager.cc:1403] T b1d8e928d8444f77ac2950eab2115f65 P 7b3ea460d1294b8a82672d7c21475cb5: Time spent bootstrapping tablet: real 0.185s	user 0.029s	sys 0.004s
I20260709 13:02:03.967697  8552 raft_consensus.cc:2468] T da02fa98f6de48a7baefadf6e69d2046 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 590ee39ce5734876b94d91fc3931b807 in term 0.
I20260709 13:02:03.969528  8295 leader_election.cc:304] T 53842ab4d1d748bda0c7f0d933e5a785 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807; no voters: 53a66c851dc74c70b94c65d464a391f6, 7b3ea460d1294b8a82672d7c21475cb5
I20260709 13:02:03.969573  8294 leader_election.cc:304] T da02fa98f6de48a7baefadf6e69d2046 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807, b560e9aaec7a4c78b9123b38e73519a3; no voters: 
I20260709 13:02:03.970758  8837 raft_consensus.cc:3060] T 53842ab4d1d748bda0c7f0d933e5a785 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:03.971385  8602 raft_consensus.cc:359] T b1d8e928d8444f77ac2950eab2115f65 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:03.972189  8602 raft_consensus.cc:385] T b1d8e928d8444f77ac2950eab2115f65 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:03.972492  8602 raft_consensus.cc:740] T b1d8e928d8444f77ac2950eab2115f65 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Initialized, Role: FOLLOWER
I20260709 13:02:03.973415  8602 consensus_queue.cc:260] T b1d8e928d8444f77ac2950eab2115f65 P 7b3ea460d1294b8a82672d7c21475cb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:03.975143  8602 ts_tablet_manager.cc:1434] T b1d8e928d8444f77ac2950eab2115f65 P 7b3ea460d1294b8a82672d7c21475cb5: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:02:03.975989  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da02fa98f6de48a7baefadf6e69d2046" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:02:03.976501  8602 tablet_bootstrap.cc:492] T 308f98e21e714cea8c363eb315d72e27 P 7b3ea460d1294b8a82672d7c21475cb5: Bootstrap starting.
I20260709 13:02:03.977231  8908 raft_consensus.cc:2804] T da02fa98f6de48a7baefadf6e69d2046 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:03.977706  8908 raft_consensus.cc:493] T da02fa98f6de48a7baefadf6e69d2046 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:03.978080  8908 raft_consensus.cc:3060] T da02fa98f6de48a7baefadf6e69d2046 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:03.983482  8602 tablet_bootstrap.cc:654] T 308f98e21e714cea8c363eb315d72e27 P 7b3ea460d1294b8a82672d7c21475cb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:03.987854  8837 raft_consensus.cc:2749] T 53842ab4d1d748bda0c7f0d933e5a785 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:02:03.990163  8295 leader_election.cc:343] T da02fa98f6de48a7baefadf6e69d2046 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:03.999678  8888 raft_consensus.cc:493] T b1d8e928d8444f77ac2950eab2115f65 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.000334  8888 raft_consensus.cc:515] T b1d8e928d8444f77ac2950eab2115f65 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:04.007359  8888 leader_election.cc:290] T b1d8e928d8444f77ac2950eab2115f65 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:02:04.008231  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d8e928d8444f77ac2950eab2115f65" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
I20260709 13:02:04.009513  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d8e928d8444f77ac2950eab2115f65" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
W20260709 13:02:04.010982  8445 leader_election.cc:343] T b1d8e928d8444f77ac2950eab2115f65 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:04.013933  8938 log.cc:927] Time spent T 30e220d65bed42489b2af858d3a60981 P 53a66c851dc74c70b94c65d464a391f6: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
W20260709 13:02:04.015337  8444 leader_election.cc:343] T b1d8e928d8444f77ac2950eab2115f65 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:04.015861  8444 leader_election.cc:304] T b1d8e928d8444f77ac2950eab2115f65 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b3ea460d1294b8a82672d7c21475cb5; no voters: 53a66c851dc74c70b94c65d464a391f6, 590ee39ce5734876b94d91fc3931b807
I20260709 13:02:04.016683  8888 raft_consensus.cc:2749] T b1d8e928d8444f77ac2950eab2115f65 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:04.019326  8908 raft_consensus.cc:515] T da02fa98f6de48a7baefadf6e69d2046 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:04.022637  8598 tablet_bootstrap.cc:492] T da02fa98f6de48a7baefadf6e69d2046 P 53a66c851dc74c70b94c65d464a391f6: No bootstrap required, opened a new log
I20260709 13:02:04.023768  8598 ts_tablet_manager.cc:1403] T da02fa98f6de48a7baefadf6e69d2046 P 53a66c851dc74c70b94c65d464a391f6: Time spent bootstrapping tablet: real 0.226s	user 0.019s	sys 0.010s
I20260709 13:02:04.034425  8405 raft_consensus.cc:2468] T 610562885f5849d083ac5f7a85011891 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b3ea460d1294b8a82672d7c21475cb5 in term 1.
I20260709 13:02:04.035418  8600 tablet_bootstrap.cc:492] T 610562885f5849d083ac5f7a85011891 P 590ee39ce5734876b94d91fc3931b807: No bootstrap required, opened a new log
I20260709 13:02:04.035995  8600 ts_tablet_manager.cc:1403] T 610562885f5849d083ac5f7a85011891 P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.106s	user 0.016s	sys 0.005s
I20260709 13:02:04.035835  8444 leader_election.cc:304] T 610562885f5849d083ac5f7a85011891 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, 7b3ea460d1294b8a82672d7c21475cb5; no voters: 590ee39ce5734876b94d91fc3931b807
I20260709 13:02:04.037554  8888 raft_consensus.cc:2804] T 610562885f5849d083ac5f7a85011891 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:04.038075  8888 raft_consensus.cc:697] T 610562885f5849d083ac5f7a85011891 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 LEADER]: Becoming Leader. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Running, Role: LEADER
I20260709 13:02:04.038874  8888 consensus_queue.cc:237] T 610562885f5849d083ac5f7a85011891 P 7b3ea460d1294b8a82672d7c21475cb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:04.042980  8600 raft_consensus.cc:359] T 610562885f5849d083ac5f7a85011891 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:04.043725  8600 raft_consensus.cc:385] T 610562885f5849d083ac5f7a85011891 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:04.043942  8600 raft_consensus.cc:740] T 610562885f5849d083ac5f7a85011891 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:04.046836  8550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da02fa98f6de48a7baefadf6e69d2046" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3"
I20260709 13:02:04.047559  8550 raft_consensus.cc:3060] T da02fa98f6de48a7baefadf6e69d2046 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:04.044499  8600 consensus_queue.cc:260] T 610562885f5849d083ac5f7a85011891 P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:04.048264  8401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da02fa98f6de48a7baefadf6e69d2046" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6"
I20260709 13:02:04.049141  8598 raft_consensus.cc:359] T da02fa98f6de48a7baefadf6e69d2046 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:04.050410  8598 raft_consensus.cc:385] T da02fa98f6de48a7baefadf6e69d2046 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:04.050828  8598 raft_consensus.cc:740] T da02fa98f6de48a7baefadf6e69d2046 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Initialized, Role: FOLLOWER
I20260709 13:02:04.049731  8602 tablet_bootstrap.cc:492] T 308f98e21e714cea8c363eb315d72e27 P 7b3ea460d1294b8a82672d7c21475cb5: No bootstrap required, opened a new log
I20260709 13:02:04.050494  8908 leader_election.cc:290] T da02fa98f6de48a7baefadf6e69d2046 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 election: Requested vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:02:04.051926  8602 ts_tablet_manager.cc:1403] T 308f98e21e714cea8c363eb315d72e27 P 7b3ea460d1294b8a82672d7c21475cb5: Time spent bootstrapping tablet: real 0.076s	user 0.023s	sys 0.026s
I20260709 13:02:04.051929  8600 ts_tablet_manager.cc:1434] T 610562885f5849d083ac5f7a85011891 P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.016s	user 0.000s	sys 0.008s
I20260709 13:02:04.052802  8598 consensus_queue.cc:260] T da02fa98f6de48a7baefadf6e69d2046 P 53a66c851dc74c70b94c65d464a391f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:04.054436  8401 raft_consensus.cc:3060] T da02fa98f6de48a7baefadf6e69d2046 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:04.054628  8600 tablet_bootstrap.cc:492] T b574d11894634755bd89c530b4155f1e P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:04.058041  8601 raft_consensus.cc:359] T b574d11894634755bd89c530b4155f1e P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:04.059304  8601 raft_consensus.cc:385] T b574d11894634755bd89c530b4155f1e P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:04.059634  8601 raft_consensus.cc:740] T b574d11894634755bd89c530b4155f1e P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Initialized, Role: FOLLOWER
I20260709 13:02:04.060967  8601 consensus_queue.cc:260] T b574d11894634755bd89c530b4155f1e P b560e9aaec7a4c78b9123b38e73519a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:04.074153  8401 raft_consensus.cc:2468] T da02fa98f6de48a7baefadf6e69d2046 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 590ee39ce5734876b94d91fc3931b807 in term 1.
I20260709 13:02:04.078078  8602 raft_consensus.cc:359] T 308f98e21e714cea8c363eb315d72e27 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:04.079408  8602 raft_consensus.cc:385] T 308f98e21e714cea8c363eb315d72e27 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:04.079842  8602 raft_consensus.cc:740] T 308f98e21e714cea8c363eb315d72e27 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Initialized, Role: FOLLOWER
I20260709 13:02:04.083997  8602 consensus_queue.cc:260] T 308f98e21e714cea8c363eb315d72e27 P 7b3ea460d1294b8a82672d7c21475cb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:04.091271  8601 ts_tablet_manager.cc:1434] T b574d11894634755bd89c530b4155f1e P b560e9aaec7a4c78b9123b38e73519a3: Time spent starting tablet: real 0.135s	user 0.006s	sys 0.001s
I20260709 13:02:04.093155  8601 tablet_bootstrap.cc:492] T 4f93b4088ce1421cb59ed9a917919b22 P b560e9aaec7a4c78b9123b38e73519a3: Bootstrap starting.
I20260709 13:02:04.091302  8224 catalog_manager.cc:5697] T 6a82728feb4f4f1094191c0e30d748dd P b560e9aaec7a4c78b9123b38e73519a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "b560e9aaec7a4c78b9123b38e73519a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:04.095960  8602 ts_tablet_manager.cc:1434] T 308f98e21e714cea8c363eb315d72e27 P 7b3ea460d1294b8a82672d7c21475cb5: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 13:02:04.098906  8600 tablet_bootstrap.cc:654] T b574d11894634755bd89c530b4155f1e P 590ee39ce5734876b94d91fc3931b807: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:04.106597  8550 raft_consensus.cc:2468] T da02fa98f6de48a7baefadf6e69d2046 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 590ee39ce5734876b94d91fc3931b807 in term 1.
I20260709 13:02:04.108189  8294 leader_election.cc:304] T da02fa98f6de48a7baefadf6e69d2046 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807, b560e9aaec7a4c78b9123b38e73519a3; no voters: 
I20260709 13:02:04.109164  8908 raft_consensus.cc:2804] T da02fa98f6de48a7baefadf6e69d2046 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:04.109728  8908 raft_consensus.cc:697] T da02fa98f6de48a7baefadf6e69d2046 P 590ee39ce5734876b94d91fc3931b807 [term 1 LEADER]: Becoming Leader. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Running, Role: LEADER
I20260709 13:02:04.113307  8602 tablet_bootstrap.cc:492] T a1667ac154454613a9047f56ee087405 P 7b3ea460d1294b8a82672d7c21475cb5: Bootstrap starting.
I20260709 13:02:04.116552  8598 ts_tablet_manager.cc:1434] T da02fa98f6de48a7baefadf6e69d2046 P 53a66c851dc74c70b94c65d464a391f6: Time spent starting tablet: real 0.092s	user 0.000s	sys 0.009s
I20260709 13:02:04.121770  8226 catalog_manager.cc:5697] T 610562885f5849d083ac5f7a85011891 P 7b3ea460d1294b8a82672d7c21475cb5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "7b3ea460d1294b8a82672d7c21475cb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:04.110737  8908 consensus_queue.cc:237] T da02fa98f6de48a7baefadf6e69d2046 P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:04.123243  8888 consensus_queue.cc:1048] T 1fe73d50e76147ebace9610e09de74a5 P 7b3ea460d1294b8a82672d7c21475cb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:02:04.128239  8602 tablet_bootstrap.cc:654] T a1667ac154454613a9047f56ee087405 P 7b3ea460d1294b8a82672d7c21475cb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:04.132341  8598 tablet_bootstrap.cc:492] T f1fec8d4948d45bbbe39d0f3e73c3992 P 53a66c851dc74c70b94c65d464a391f6: Bootstrap starting.
I20260709 13:02:04.135694  8601 tablet_bootstrap.cc:654] T 4f93b4088ce1421cb59ed9a917919b22 P b560e9aaec7a4c78b9123b38e73519a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:04.141384  8600 tablet_bootstrap.cc:492] T b574d11894634755bd89c530b4155f1e P 590ee39ce5734876b94d91fc3931b807: No bootstrap required, opened a new log
I20260709 13:02:04.141963  8600 ts_tablet_manager.cc:1403] T b574d11894634755bd89c530b4155f1e P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.088s	user 0.011s	sys 0.004s
I20260709 13:02:04.144982  8600 raft_consensus.cc:359] T b574d11894634755bd89c530b4155f1e P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:04.145613  8600 raft_consensus.cc:385] T b574d11894634755bd89c530b4155f1e P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:04.145861  8600 raft_consensus.cc:740] T b574d11894634755bd89c530b4155f1e P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:04.146368  8799 raft_consensus.cc:493] T 308f98e21e714cea8c363eb315d72e27 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.146972  8799 raft_consensus.cc:515] T 308f98e21e714cea8c363eb315d72e27 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:04.147269  8600 consensus_queue.cc:260] T b574d11894634755bd89c530b4155f1e P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:04.149691  8600 ts_tablet_manager.cc:1434] T b574d11894634755bd89c530b4155f1e P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:02:04.150627  8600 tablet_bootstrap.cc:492] T b1d8e928d8444f77ac2950eab2115f65 P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:04.153086  8477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "308f98e21e714cea8c363eb315d72e27" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
I20260709 13:02:04.153832  8477 raft_consensus.cc:2468] T 308f98e21e714cea8c363eb315d72e27 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 0.
I20260709 13:02:04.154477  8799 leader_election.cc:290] T 308f98e21e714cea8c363eb315d72e27 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:02:04.154930  8601 tablet_bootstrap.cc:492] T 4f93b4088ce1421cb59ed9a917919b22 P b560e9aaec7a4c78b9123b38e73519a3: No bootstrap required, opened a new log
I20260709 13:02:04.155449  8601 ts_tablet_manager.cc:1403] T 4f93b4088ce1421cb59ed9a917919b22 P b560e9aaec7a4c78b9123b38e73519a3: Time spent bootstrapping tablet: real 0.063s	user 0.011s	sys 0.000s
I20260709 13:02:04.155560  8518 leader_election.cc:304] T 308f98e21e714cea8c363eb315d72e27 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b3ea460d1294b8a82672d7c21475cb5, b560e9aaec7a4c78b9123b38e73519a3; no voters: 
I20260709 13:02:04.156416  8885 raft_consensus.cc:2804] T 308f98e21e714cea8c363eb315d72e27 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:04.156818  8885 raft_consensus.cc:493] T 308f98e21e714cea8c363eb315d72e27 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:04.157188  8885 raft_consensus.cc:3060] T 308f98e21e714cea8c363eb315d72e27 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:04.166455  8598 tablet_bootstrap.cc:654] T f1fec8d4948d45bbbe39d0f3e73c3992 P 53a66c851dc74c70b94c65d464a391f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:04.177712  8602 tablet_bootstrap.cc:492] T a1667ac154454613a9047f56ee087405 P 7b3ea460d1294b8a82672d7c21475cb5: No bootstrap required, opened a new log
I20260709 13:02:04.178275  8602 ts_tablet_manager.cc:1403] T a1667ac154454613a9047f56ee087405 P 7b3ea460d1294b8a82672d7c21475cb5: Time spent bootstrapping tablet: real 0.065s	user 0.007s	sys 0.010s
I20260709 13:02:04.180639  8600 tablet_bootstrap.cc:654] T b1d8e928d8444f77ac2950eab2115f65 P 590ee39ce5734876b94d91fc3931b807: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:04.183936  8602 raft_consensus.cc:359] T a1667ac154454613a9047f56ee087405 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:04.184623  8401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "308f98e21e714cea8c363eb315d72e27" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:02:04.184840  8602 raft_consensus.cc:385] T a1667ac154454613a9047f56ee087405 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:04.166752  8885 raft_consensus.cc:515] T 308f98e21e714cea8c363eb315d72e27 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:04.185367  8602 raft_consensus.cc:740] T a1667ac154454613a9047f56ee087405 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Initialized, Role: FOLLOWER
I20260709 13:02:04.187403  8885 leader_election.cc:290] T 308f98e21e714cea8c363eb315d72e27 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 election: Requested vote from peers 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:02:04.187256  8602 consensus_queue.cc:260] T a1667ac154454613a9047f56ee087405 P 7b3ea460d1294b8a82672d7c21475cb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:04.189383  8601 raft_consensus.cc:359] T 4f93b4088ce1421cb59ed9a917919b22 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:04.189383  8477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "308f98e21e714cea8c363eb315d72e27" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5"
I20260709 13:02:04.190143  8601 raft_consensus.cc:385] T 4f93b4088ce1421cb59ed9a917919b22 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:04.190445  8601 raft_consensus.cc:740] T 4f93b4088ce1421cb59ed9a917919b22 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Initialized, Role: FOLLOWER
I20260709 13:02:04.190460  8477 raft_consensus.cc:3060] T 308f98e21e714cea8c363eb315d72e27 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:04.191536  8602 ts_tablet_manager.cc:1434] T a1667ac154454613a9047f56ee087405 P 7b3ea460d1294b8a82672d7c21475cb5: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 13:02:04.193008  8602 tablet_bootstrap.cc:492] T d4cd925acef04f3c8910aa1903b760c7 P 7b3ea460d1294b8a82672d7c21475cb5: Bootstrap starting.
I20260709 13:02:04.191232  8601 consensus_queue.cc:260] T 4f93b4088ce1421cb59ed9a917919b22 P b560e9aaec7a4c78b9123b38e73519a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
W20260709 13:02:04.197307  8518 leader_election.cc:343] T 308f98e21e714cea8c363eb315d72e27 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:04.200469  8601 ts_tablet_manager.cc:1434] T 4f93b4088ce1421cb59ed9a917919b22 P b560e9aaec7a4c78b9123b38e73519a3: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.002s
I20260709 13:02:04.200913  8401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "308f98e21e714cea8c363eb315d72e27" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6"
I20260709 13:02:04.202647  8477 raft_consensus.cc:2468] T 308f98e21e714cea8c363eb315d72e27 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 1.
W20260709 13:02:04.204196  8518 leader_election.cc:343] T 308f98e21e714cea8c363eb315d72e27 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:04.209811  8602 tablet_bootstrap.cc:654] T d4cd925acef04f3c8910aa1903b760c7 P 7b3ea460d1294b8a82672d7c21475cb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:04.213678  8518 leader_election.cc:304] T 308f98e21e714cea8c363eb315d72e27 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b3ea460d1294b8a82672d7c21475cb5, b560e9aaec7a4c78b9123b38e73519a3; no voters: 53a66c851dc74c70b94c65d464a391f6
I20260709 13:02:04.214111  8224 catalog_manager.cc:5697] T da02fa98f6de48a7baefadf6e69d2046 P 590ee39ce5734876b94d91fc3931b807 reported cstate change: term changed from 0 to 1, leader changed from <none> to 590ee39ce5734876b94d91fc3931b807 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "590ee39ce5734876b94d91fc3931b807" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:04.217562  8601 tablet_bootstrap.cc:492] T f1fec8d4948d45bbbe39d0f3e73c3992 P b560e9aaec7a4c78b9123b38e73519a3: Bootstrap starting.
I20260709 13:02:04.231621  8885 raft_consensus.cc:2804] T 308f98e21e714cea8c363eb315d72e27 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:04.245512  8885 raft_consensus.cc:697] T 308f98e21e714cea8c363eb315d72e27 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Becoming Leader. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Running, Role: LEADER
I20260709 13:02:04.259922  8799 raft_consensus.cc:493] T b574d11894634755bd89c530b4155f1e P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.260592  8799 raft_consensus.cc:515] T b574d11894634755bd89c530b4155f1e P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:04.262873  8799 leader_election.cc:290] T b574d11894634755bd89c530b4155f1e P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:02:04.264838  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b574d11894634755bd89c530b4155f1e" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
I20260709 13:02:04.265848  8326 raft_consensus.cc:2468] T b574d11894634755bd89c530b4155f1e P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 0.
I20260709 13:02:04.267649  8519 leader_election.cc:304] T b574d11894634755bd89c530b4155f1e P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807, b560e9aaec7a4c78b9123b38e73519a3; no voters: 
I20260709 13:02:04.269598  8899 consensus_queue.cc:1048] T 53842ab4d1d748bda0c7f0d933e5a785 P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:04.270262  8605 raft_consensus.cc:2804] T b574d11894634755bd89c530b4155f1e P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:04.270865  8605 raft_consensus.cc:493] T b574d11894634755bd89c530b4155f1e P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:04.271296  8605 raft_consensus.cc:3060] T b574d11894634755bd89c530b4155f1e P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:04.271466  8885 consensus_queue.cc:237] T 308f98e21e714cea8c363eb315d72e27 P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:04.272627  8887 consensus_queue.cc:1048] T 1fe73d50e76147ebace9610e09de74a5 P 7b3ea460d1294b8a82672d7c21475cb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:04.274077  8887 consensus_queue.cc:1048] T e8353e508def43e5a8008bb63ff1a84a P 7b3ea460d1294b8a82672d7c21475cb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:04.296259  8605 raft_consensus.cc:515] T b574d11894634755bd89c530b4155f1e P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:04.317771  8605 leader_election.cc:290] T b574d11894634755bd89c530b4155f1e P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 election: Requested vote from peers 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:02:04.345058  8602 tablet_bootstrap.cc:492] T d4cd925acef04f3c8910aa1903b760c7 P 7b3ea460d1294b8a82672d7c21475cb5: No bootstrap required, opened a new log
I20260709 13:02:04.345664  8602 ts_tablet_manager.cc:1403] T d4cd925acef04f3c8910aa1903b760c7 P 7b3ea460d1294b8a82672d7c21475cb5: Time spent bootstrapping tablet: real 0.153s	user 0.022s	sys 0.023s
I20260709 13:02:04.350646  8600 tablet_bootstrap.cc:492] T b1d8e928d8444f77ac2950eab2115f65 P 590ee39ce5734876b94d91fc3931b807: No bootstrap required, opened a new log
I20260709 13:02:04.351563  8600 ts_tablet_manager.cc:1403] T b1d8e928d8444f77ac2950eab2115f65 P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.201s	user 0.025s	sys 0.042s
I20260709 13:02:04.364351  8601 tablet_bootstrap.cc:654] T f1fec8d4948d45bbbe39d0f3e73c3992 P b560e9aaec7a4c78b9123b38e73519a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:04.368038  8477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b574d11894634755bd89c530b4155f1e" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
I20260709 13:02:04.372814  8477 raft_consensus.cc:2468] T b574d11894634755bd89c530b4155f1e P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 0.
I20260709 13:02:04.374168  8598 tablet_bootstrap.cc:492] T f1fec8d4948d45bbbe39d0f3e73c3992 P 53a66c851dc74c70b94c65d464a391f6: No bootstrap required, opened a new log
I20260709 13:02:04.374707  8598 ts_tablet_manager.cc:1403] T f1fec8d4948d45bbbe39d0f3e73c3992 P 53a66c851dc74c70b94c65d464a391f6: Time spent bootstrapping tablet: real 0.257s	user 0.003s	sys 0.017s
I20260709 13:02:04.371413  8600 raft_consensus.cc:359] T b1d8e928d8444f77ac2950eab2115f65 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:04.377544  8600 raft_consensus.cc:385] T b1d8e928d8444f77ac2950eab2115f65 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:04.377945  8600 raft_consensus.cc:740] T b1d8e928d8444f77ac2950eab2115f65 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:04.378805  8600 consensus_queue.cc:260] T b1d8e928d8444f77ac2950eab2115f65 P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
W20260709 13:02:04.387589  8518 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37751, user_credentials={real_user=slave}} blocked reactor thread for 73387.8us
I20260709 13:02:04.383391  8602 raft_consensus.cc:359] T d4cd925acef04f3c8910aa1903b760c7 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:04.389588  8602 raft_consensus.cc:385] T d4cd925acef04f3c8910aa1903b760c7 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:04.391933  8600 ts_tablet_manager.cc:1434] T b1d8e928d8444f77ac2950eab2115f65 P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.002s
I20260709 13:02:04.389884  8602 raft_consensus.cc:740] T d4cd925acef04f3c8910aa1903b760c7 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Initialized, Role: FOLLOWER
W20260709 13:02:04.355827  8519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40837, user_credentials={real_user=slave}} blocked reactor thread for 77502.3us
I20260709 13:02:04.397017  8602 consensus_queue.cc:260] T d4cd925acef04f3c8910aa1903b760c7 P 7b3ea460d1294b8a82672d7c21475cb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:04.401274  8602 ts_tablet_manager.cc:1434] T d4cd925acef04f3c8910aa1903b760c7 P 7b3ea460d1294b8a82672d7c21475cb5: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.001s
I20260709 13:02:04.401712  8598 raft_consensus.cc:359] T f1fec8d4948d45bbbe39d0f3e73c3992 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:04.402752  8598 raft_consensus.cc:385] T f1fec8d4948d45bbbe39d0f3e73c3992 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:04.403126  8598 raft_consensus.cc:740] T f1fec8d4948d45bbbe39d0f3e73c3992 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Initialized, Role: FOLLOWER
I20260709 13:02:04.404141  8598 consensus_queue.cc:260] T f1fec8d4948d45bbbe39d0f3e73c3992 P 53a66c851dc74c70b94c65d464a391f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:04.427388  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b574d11894634755bd89c530b4155f1e" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807"
I20260709 13:02:04.428110  8327 raft_consensus.cc:3060] T b574d11894634755bd89c530b4155f1e P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:04.430042  8600 tablet_bootstrap.cc:492] T d4cd925acef04f3c8910aa1903b760c7 P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:04.433272  8958 consensus_queue.cc:1048] T 6a82728feb4f4f1094191c0e30d748dd P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:02:04.486022  8654 raft_consensus.cc:493] T b1d8e928d8444f77ac2950eab2115f65 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:04.495280  8371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40837, user_credentials={real_user=slave}} blocked reactor thread for 61664.4us
I20260709 13:02:04.499787  8598 ts_tablet_manager.cc:1434] T f1fec8d4948d45bbbe39d0f3e73c3992 P 53a66c851dc74c70b94c65d464a391f6: Time spent starting tablet: real 0.125s	user 0.019s	sys 0.007s
I20260709 13:02:04.495908  8654 raft_consensus.cc:515] T b1d8e928d8444f77ac2950eab2115f65 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:04.503320  8654 leader_election.cc:290] T b1d8e928d8444f77ac2950eab2115f65 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:02:04.503844  8654 raft_consensus.cc:493] T 610562885f5849d083ac5f7a85011891 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.504328  8654 raft_consensus.cc:515] T 610562885f5849d083ac5f7a85011891 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:04.535384  8598 tablet_bootstrap.cc:492] T a1667ac154454613a9047f56ee087405 P 53a66c851dc74c70b94c65d464a391f6: Bootstrap starting.
I20260709 13:02:04.545517  8598 tablet_bootstrap.cc:654] T a1667ac154454613a9047f56ee087405 P 53a66c851dc74c70b94c65d464a391f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:04.547349  8601 tablet_bootstrap.cc:492] T f1fec8d4948d45bbbe39d0f3e73c3992 P b560e9aaec7a4c78b9123b38e73519a3: No bootstrap required, opened a new log
I20260709 13:02:04.547889  8601 ts_tablet_manager.cc:1403] T f1fec8d4948d45bbbe39d0f3e73c3992 P b560e9aaec7a4c78b9123b38e73519a3: Time spent bootstrapping tablet: real 0.331s	user 0.034s	sys 0.038s
I20260709 13:02:04.550925  8600 tablet_bootstrap.cc:654] T d4cd925acef04f3c8910aa1903b760c7 P 590ee39ce5734876b94d91fc3931b807: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:04.570559  8654 leader_election.cc:290] T 610562885f5849d083ac5f7a85011891 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:02:04.570852  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b574d11894634755bd89c530b4155f1e" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5"
I20260709 13:02:04.572944  8962 consensus_queue.cc:1048] T 6a82728feb4f4f1094191c0e30d748dd P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:04.578411  8601 raft_consensus.cc:359] T f1fec8d4948d45bbbe39d0f3e73c3992 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:04.579152  8601 raft_consensus.cc:385] T f1fec8d4948d45bbbe39d0f3e73c3992 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:04.579463  8601 raft_consensus.cc:740] T f1fec8d4948d45bbbe39d0f3e73c3992 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Initialized, Role: FOLLOWER
I20260709 13:02:04.587774  8477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610562885f5849d083ac5f7a85011891" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
I20260709 13:02:04.588598  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d8e928d8444f77ac2950eab2115f65" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
I20260709 13:02:04.589305  8474 raft_consensus.cc:2468] T b1d8e928d8444f77ac2950eab2115f65 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 590ee39ce5734876b94d91fc3931b807 in term 0.
I20260709 13:02:04.590202  8899 consensus_queue.cc:1048] T 53842ab4d1d748bda0c7f0d933e5a785 P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:04.591145  8330 raft_consensus.cc:3060] T 610562885f5849d083ac5f7a85011891 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:04.571583  8478 raft_consensus.cc:3060] T b574d11894634755bd89c530b4155f1e P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:04.592064  8602 tablet_bootstrap.cc:492] T 8e53899e04fe4f58b666f67ac07bbf79 P 7b3ea460d1294b8a82672d7c21475cb5: Bootstrap starting.
I20260709 13:02:04.608047  8959 raft_consensus.cc:493] T 4f93b4088ce1421cb59ed9a917919b22 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.608733  8959 raft_consensus.cc:515] T 4f93b4088ce1421cb59ed9a917919b22 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:04.611053  8959 leader_election.cc:290] T 4f93b4088ce1421cb59ed9a917919b22 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:02:04.580152  8601 consensus_queue.cc:260] T f1fec8d4948d45bbbe39d0f3e73c3992 P b560e9aaec7a4c78b9123b38e73519a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:04.615512  8888 consensus_queue.cc:1048] T e8353e508def43e5a8008bb63ff1a84a P 7b3ea460d1294b8a82672d7c21475cb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:04.616715  8601 ts_tablet_manager.cc:1434] T f1fec8d4948d45bbbe39d0f3e73c3992 P b560e9aaec7a4c78b9123b38e73519a3: Time spent starting tablet: real 0.069s	user 0.009s	sys 0.000s
I20260709 13:02:04.606432  8226 catalog_manager.cc:5697] T 308f98e21e714cea8c363eb315d72e27 P b560e9aaec7a4c78b9123b38e73519a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "b560e9aaec7a4c78b9123b38e73519a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:04.618083  8601 tablet_bootstrap.cc:492] T c6245fdde2e4422581bc418d4840b580 P b560e9aaec7a4c78b9123b38e73519a3: Bootstrap starting.
I20260709 13:02:04.619719  8955 consensus_queue.cc:1048] T 610562885f5849d083ac5f7a85011891 P 7b3ea460d1294b8a82672d7c21475cb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:04.616417  8602 tablet_bootstrap.cc:654] T 8e53899e04fe4f58b666f67ac07bbf79 P 7b3ea460d1294b8a82672d7c21475cb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:04.633080  8327 raft_consensus.cc:2468] T b574d11894634755bd89c530b4155f1e P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 1.
I20260709 13:02:04.642154  8601 tablet_bootstrap.cc:654] T c6245fdde2e4422581bc418d4840b580 P b560e9aaec7a4c78b9123b38e73519a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:04.684741  8295 leader_election.cc:304] T b1d8e928d8444f77ac2950eab2115f65 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807, 7b3ea460d1294b8a82672d7c21475cb5; no voters: 
I20260709 13:02:04.693377  8404 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f93b4088ce1421cb59ed9a917919b22" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:02:04.694326  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d8e928d8444f77ac2950eab2115f65" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:02:04.696587  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "610562885f5849d083ac5f7a85011891" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:02:04.702920  8819 raft_consensus.cc:493] T a1667ac154454613a9047f56ee087405 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.707577  8327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f93b4088ce1421cb59ed9a917919b22" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
I20260709 13:02:04.714315  8519 leader_election.cc:304] T b574d11894634755bd89c530b4155f1e P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807, b560e9aaec7a4c78b9123b38e73519a3; no voters: 
I20260709 13:02:04.720278  8963 raft_consensus.cc:493] T f1fec8d4948d45bbbe39d0f3e73c3992 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.721913  8600 tablet_bootstrap.cc:492] T d4cd925acef04f3c8910aa1903b760c7 P 590ee39ce5734876b94d91fc3931b807: No bootstrap required, opened a new log
I20260709 13:02:04.766970  8600 ts_tablet_manager.cc:1403] T d4cd925acef04f3c8910aa1903b760c7 P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.360s	user 0.013s	sys 0.003s
I20260709 13:02:04.754386  8400 raft_consensus.cc:2393] T 610562885f5849d083ac5f7a85011891 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 590ee39ce5734876b94d91fc3931b807 in current term 1: Already voted for candidate 7b3ea460d1294b8a82672d7c21475cb5 in this term.
I20260709 13:02:04.755594  8969 raft_consensus.cc:2804] T b1d8e928d8444f77ac2950eab2115f65 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:04.769150  8969 raft_consensus.cc:493] T b1d8e928d8444f77ac2950eab2115f65 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:04.769537  8969 raft_consensus.cc:3060] T b1d8e928d8444f77ac2950eab2115f65 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:04.737643  8478 raft_consensus.cc:2468] T b574d11894634755bd89c530b4155f1e P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 1.
I20260709 13:02:04.756801  8819 raft_consensus.cc:515] T a1667ac154454613a9047f56ee087405 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:04.774741  8967 raft_consensus.cc:493] T f1fec8d4948d45bbbe39d0f3e73c3992 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.775445  8967 raft_consensus.cc:515] T f1fec8d4948d45bbbe39d0f3e73c3992 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:04.778060  8967 leader_election.cc:290] T f1fec8d4948d45bbbe39d0f3e73c3992 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:02:04.735608  8955 raft_consensus.cc:493] T d4cd925acef04f3c8910aa1903b760c7 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:04.776033  8819 leader_election.cc:290] T a1667ac154454613a9047f56ee087405 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:02:04.794502  8959 raft_consensus.cc:2804] T b574d11894634755bd89c530b4155f1e P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:02:04.789706  8519 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40837, user_credentials={real_user=slave}} blocked reactor thread for 75530.5us
I20260709 13:02:04.767892  8888 consensus_queue.cc:1048] T 610562885f5849d083ac5f7a85011891 P 7b3ea460d1294b8a82672d7c21475cb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20260709 13:02:04.787775  8963 raft_consensus.cc:515] T f1fec8d4948d45bbbe39d0f3e73c3992 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:04.804678  8959 raft_consensus.cc:697] T b574d11894634755bd89c530b4155f1e P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Becoming Leader. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Running, Role: LEADER
I20260709 13:02:04.794065  8955 raft_consensus.cc:515] T d4cd925acef04f3c8910aa1903b760c7 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
W20260709 13:02:04.853813  8371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40837, user_credentials={real_user=slave}} blocked reactor thread for 89050.4us
W20260709 13:02:04.864235  8518 leader_election.cc:343] T 4f93b4088ce1421cb59ed9a917919b22 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:04.862764  8295 leader_election.cc:343] T b1d8e928d8444f77ac2950eab2115f65 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:04.867470  8295 leader_election.cc:304] T 610562885f5849d083ac5f7a85011891 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807; no voters: 53a66c851dc74c70b94c65d464a391f6, 7b3ea460d1294b8a82672d7c21475cb5
I20260709 13:02:04.941903  8601 tablet_bootstrap.cc:492] T c6245fdde2e4422581bc418d4840b580 P b560e9aaec7a4c78b9123b38e73519a3: No bootstrap required, opened a new log
I20260709 13:02:04.942487  8601 ts_tablet_manager.cc:1403] T c6245fdde2e4422581bc418d4840b580 P b560e9aaec7a4c78b9123b38e73519a3: Time spent bootstrapping tablet: real 0.325s	user 0.023s	sys 0.019s
I20260709 13:02:04.950361  8600 raft_consensus.cc:359] T d4cd925acef04f3c8910aa1903b760c7 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:04.953392  8600 raft_consensus.cc:385] T d4cd925acef04f3c8910aa1903b760c7 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:04.953754  8600 raft_consensus.cc:740] T d4cd925acef04f3c8910aa1903b760c7 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:04.954501  8600 consensus_queue.cc:260] T d4cd925acef04f3c8910aa1903b760c7 P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:04.956179  8598 tablet_bootstrap.cc:492] T a1667ac154454613a9047f56ee087405 P 53a66c851dc74c70b94c65d464a391f6: No bootstrap required, opened a new log
I20260709 13:02:04.923897  8913 consensus_queue.cc:1048] T da02fa98f6de48a7baefadf6e69d2046 P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.168s
I20260709 13:02:04.956727  8598 ts_tablet_manager.cc:1403] T a1667ac154454613a9047f56ee087405 P 53a66c851dc74c70b94c65d464a391f6: Time spent bootstrapping tablet: real 0.422s	user 0.040s	sys 0.039s
I20260709 13:02:04.943589  8402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1667ac154454613a9047f56ee087405" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:02:04.961002  8600 ts_tablet_manager.cc:1434] T d4cd925acef04f3c8910aa1903b760c7 P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.194s	user 0.006s	sys 0.002s
I20260709 13:02:04.962409  8602 tablet_bootstrap.cc:492] T 8e53899e04fe4f58b666f67ac07bbf79 P 7b3ea460d1294b8a82672d7c21475cb5: No bootstrap required, opened a new log
I20260709 13:02:04.962893  8602 ts_tablet_manager.cc:1403] T 8e53899e04fe4f58b666f67ac07bbf79 P 7b3ea460d1294b8a82672d7c21475cb5: Time spent bootstrapping tablet: real 0.371s	user 0.025s	sys 0.059s
I20260709 13:02:04.963624  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fec8d4948d45bbbe39d0f3e73c3992" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
I20260709 13:02:04.967295  8955 leader_election.cc:290] T d4cd925acef04f3c8910aa1903b760c7 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:02:04.970551  8600 tablet_bootstrap.cc:492] T a1667ac154454613a9047f56ee087405 P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:04.972982  8324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1667ac154454613a9047f56ee087405" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
I20260709 13:02:04.974349  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fec8d4948d45bbbe39d0f3e73c3992" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3" is_pre_election: true
W20260709 13:02:04.974937  8276 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:04.975143  8546 raft_consensus.cc:2468] T f1fec8d4948d45bbbe39d0f3e73c3992 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53a66c851dc74c70b94c65d464a391f6 in term 0.
W20260709 13:02:04.975445  8972 log.cc:927] Time spent T 1fe73d50e76147ebace9610e09de74a5 P b560e9aaec7a4c78b9123b38e73519a3: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 13:02:04.942239  8959 consensus_queue.cc:237] T b574d11894634755bd89c530b4155f1e P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:04.979444  8600 tablet_bootstrap.cc:654] T a1667ac154454613a9047f56ee087405 P 590ee39ce5734876b94d91fc3931b807: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:04.980928  8974 log.cc:927] Time spent T 6a82728feb4f4f1094191c0e30d748dd P 53a66c851dc74c70b94c65d464a391f6: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260709 13:02:05.010443  8601 raft_consensus.cc:359] T c6245fdde2e4422581bc418d4840b580 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:05.011301  8601 raft_consensus.cc:385] T c6245fdde2e4422581bc418d4840b580 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.011595  8601 raft_consensus.cc:740] T c6245fdde2e4422581bc418d4840b580 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.011781  8598 raft_consensus.cc:359] T a1667ac154454613a9047f56ee087405 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:05.012277  8601 consensus_queue.cc:260] T c6245fdde2e4422581bc418d4840b580 P b560e9aaec7a4c78b9123b38e73519a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:05.014218  8598 raft_consensus.cc:385] T a1667ac154454613a9047f56ee087405 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.014632  8598 raft_consensus.cc:740] T a1667ac154454613a9047f56ee087405 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.017213  8598 consensus_queue.cc:260] T a1667ac154454613a9047f56ee087405 P 53a66c851dc74c70b94c65d464a391f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:05.021332  8602 raft_consensus.cc:359] T 8e53899e04fe4f58b666f67ac07bbf79 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:05.022751  8837 consensus_queue.cc:1048] T da02fa98f6de48a7baefadf6e69d2046 P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:05.025223  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4cd925acef04f3c8910aa1903b760c7" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
I20260709 13:02:05.004927  8654 raft_consensus.cc:2749] T 610562885f5849d083ac5f7a85011891 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:05.027377  8602 raft_consensus.cc:385] T 8e53899e04fe4f58b666f67ac07bbf79 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.029099  8602 raft_consensus.cc:740] T 8e53899e04fe4f58b666f67ac07bbf79 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.030551  8602 consensus_queue.cc:260] T 8e53899e04fe4f58b666f67ac07bbf79 P 7b3ea460d1294b8a82672d7c21475cb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:05.035580  8598 ts_tablet_manager.cc:1434] T a1667ac154454613a9047f56ee087405 P 53a66c851dc74c70b94c65d464a391f6: Time spent starting tablet: real 0.079s	user 0.006s	sys 0.001s
W20260709 13:02:05.026322  8445 leader_election.cc:343] T a1667ac154454613a9047f56ee087405 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:05.037112  8601 ts_tablet_manager.cc:1434] T c6245fdde2e4422581bc418d4840b580 P b560e9aaec7a4c78b9123b38e73519a3: Time spent starting tablet: real 0.094s	user 0.006s	sys 0.001s
I20260709 13:02:05.038506  8602 ts_tablet_manager.cc:1434] T 8e53899e04fe4f58b666f67ac07bbf79 P 7b3ea460d1294b8a82672d7c21475cb5: Time spent starting tablet: real 0.075s	user 0.008s	sys 0.000s
I20260709 13:02:05.031242  8328 raft_consensus.cc:2468] T d4cd925acef04f3c8910aa1903b760c7 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b3ea460d1294b8a82672d7c21475cb5 in term 0.
I20260709 13:02:05.044219  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fec8d4948d45bbbe39d0f3e73c3992" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
I20260709 13:02:05.048962  8601 tablet_bootstrap.cc:492] T 19fa9442e72f4d4697a919590110cc68 P b560e9aaec7a4c78b9123b38e73519a3: Bootstrap starting.
I20260709 13:02:05.048235  8369 leader_election.cc:304] T f1fec8d4948d45bbbe39d0f3e73c3992 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, b560e9aaec7a4c78b9123b38e73519a3; no voters: 
I20260709 13:02:05.047844  8598 tablet_bootstrap.cc:492] T b1d8e928d8444f77ac2950eab2115f65 P 53a66c851dc74c70b94c65d464a391f6: Bootstrap starting.
I20260709 13:02:05.049791  8967 raft_consensus.cc:2804] T f1fec8d4948d45bbbe39d0f3e73c3992 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:05.050338  8967 raft_consensus.cc:493] T f1fec8d4948d45bbbe39d0f3e73c3992 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.050670  8967 raft_consensus.cc:3060] T f1fec8d4948d45bbbe39d0f3e73c3992 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.055713  8963 leader_election.cc:290] T f1fec8d4948d45bbbe39d0f3e73c3992 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:02:05.056759  8601 tablet_bootstrap.cc:654] T 19fa9442e72f4d4697a919590110cc68 P b560e9aaec7a4c78b9123b38e73519a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.033043  8969 raft_consensus.cc:515] T b1d8e928d8444f77ac2950eab2115f65 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:05.058185  8600 tablet_bootstrap.cc:492] T a1667ac154454613a9047f56ee087405 P 590ee39ce5734876b94d91fc3931b807: No bootstrap required, opened a new log
I20260709 13:02:05.058952  8600 ts_tablet_manager.cc:1403] T a1667ac154454613a9047f56ee087405 P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.089s	user 0.017s	sys 0.011s
I20260709 13:02:05.059269  8969 leader_election.cc:290] T b1d8e928d8444f77ac2950eab2115f65 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 election: Requested vote from peers 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:02:05.061339  8478 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d8e928d8444f77ac2950eab2115f65" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5"
I20260709 13:02:05.062435  8478 raft_consensus.cc:3060] T b1d8e928d8444f77ac2950eab2115f65 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.063051  8602 tablet_bootstrap.cc:492] T 19fa9442e72f4d4697a919590110cc68 P 7b3ea460d1294b8a82672d7c21475cb5: Bootstrap starting.
W20260709 13:02:05.066565  8519 leader_election.cc:343] T 4f93b4088ce1421cb59ed9a917919b22 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:05.067148  8519 leader_election.cc:304] T 4f93b4088ce1421cb59ed9a917919b22 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b560e9aaec7a4c78b9123b38e73519a3; no voters: 53a66c851dc74c70b94c65d464a391f6, 590ee39ce5734876b94d91fc3931b807
I20260709 13:02:05.069142  8956 raft_consensus.cc:2749] T 4f93b4088ce1421cb59ed9a917919b22 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:05.073175  8991 raft_consensus.cc:493] T c6245fdde2e4422581bc418d4840b580 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.073822  8991 raft_consensus.cc:515] T c6245fdde2e4422581bc418d4840b580 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:05.076102  8600 raft_consensus.cc:359] T a1667ac154454613a9047f56ee087405 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:05.076881  8600 raft_consensus.cc:385] T a1667ac154454613a9047f56ee087405 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.077087  8991 leader_election.cc:290] T c6245fdde2e4422581bc418d4840b580 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:02:05.077193  8600 raft_consensus.cc:740] T a1667ac154454613a9047f56ee087405 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.078203  8600 consensus_queue.cc:260] T a1667ac154454613a9047f56ee087405 P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:05.079790  8600 ts_tablet_manager.cc:1434] T a1667ac154454613a9047f56ee087405 P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:02:05.081979  8478 raft_consensus.cc:2468] T b1d8e928d8444f77ac2950eab2115f65 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 590ee39ce5734876b94d91fc3931b807 in term 1.
W20260709 13:02:05.082813  8519 leader_election.cc:343] T f1fec8d4948d45bbbe39d0f3e73c3992 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:05.085058  8445 leader_election.cc:304] T d4cd925acef04f3c8910aa1903b760c7 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807, 7b3ea460d1294b8a82672d7c21475cb5; no voters: 
I20260709 13:02:05.085501  8600 tablet_bootstrap.cc:492] T f1fec8d4948d45bbbe39d0f3e73c3992 P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:05.087684  8821 raft_consensus.cc:2804] T d4cd925acef04f3c8910aa1903b760c7 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:05.088068  8821 raft_consensus.cc:493] T d4cd925acef04f3c8910aa1903b760c7 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.088408  8821 raft_consensus.cc:3060] T d4cd925acef04f3c8910aa1903b760c7 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.090293  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6245fdde2e4422581bc418d4840b580" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
I20260709 13:02:05.094259  8295 leader_election.cc:304] T b1d8e928d8444f77ac2950eab2115f65 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807, 7b3ea460d1294b8a82672d7c21475cb5; no voters: 
I20260709 13:02:05.094978  8969 raft_consensus.cc:2804] T b1d8e928d8444f77ac2950eab2115f65 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:05.095449  8969 raft_consensus.cc:697] T b1d8e928d8444f77ac2950eab2115f65 P 590ee39ce5734876b94d91fc3931b807 [term 1 LEADER]: Becoming Leader. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Running, Role: LEADER
I20260709 13:02:05.096272  8969 consensus_queue.cc:237] T b1d8e928d8444f77ac2950eab2115f65 P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
W20260709 13:02:05.098070  8371 leader_election.cc:343] T f1fec8d4948d45bbbe39d0f3e73c3992 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:05.100950  8519 leader_election.cc:343] T c6245fdde2e4422581bc418d4840b580 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:05.193702  8548 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4cd925acef04f3c8910aa1903b760c7" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3" is_pre_election: true
I20260709 13:02:05.194567  8548 raft_consensus.cc:2468] T d4cd925acef04f3c8910aa1903b760c7 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b3ea460d1294b8a82672d7c21475cb5 in term 0.
I20260709 13:02:05.200220  8821 raft_consensus.cc:515] T d4cd925acef04f3c8910aa1903b760c7 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:05.204324  8402 raft_consensus.cc:2468] T a1667ac154454613a9047f56ee087405 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b3ea460d1294b8a82672d7c21475cb5 in term 0.
I20260709 13:02:05.204059  8967 raft_consensus.cc:515] T f1fec8d4948d45bbbe39d0f3e73c3992 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:05.213887  8967 leader_election.cc:290] T f1fec8d4948d45bbbe39d0f3e73c3992 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 election: Requested vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:02:05.219681  8602 tablet_bootstrap.cc:654] T 19fa9442e72f4d4697a919590110cc68 P 7b3ea460d1294b8a82672d7c21475cb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.220134  8551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fec8d4948d45bbbe39d0f3e73c3992" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3"
I20260709 13:02:05.220872  8551 raft_consensus.cc:3060] T f1fec8d4948d45bbbe39d0f3e73c3992 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.221132  8544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4cd925acef04f3c8910aa1903b760c7" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3"
I20260709 13:02:05.221822  8544 raft_consensus.cc:3060] T d4cd925acef04f3c8910aa1903b760c7 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.219858  8598 tablet_bootstrap.cc:654] T b1d8e928d8444f77ac2950eab2115f65 P 53a66c851dc74c70b94c65d464a391f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.225728  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fec8d4948d45bbbe39d0f3e73c3992" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:02:05.226660  8405 raft_consensus.cc:2393] T f1fec8d4948d45bbbe39d0f3e73c3992 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b560e9aaec7a4c78b9123b38e73519a3 in current term 1: Already voted for candidate 53a66c851dc74c70b94c65d464a391f6 in this term.
I20260709 13:02:05.235577  8551 raft_consensus.cc:2468] T f1fec8d4948d45bbbe39d0f3e73c3992 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53a66c851dc74c70b94c65d464a391f6 in term 1.
I20260709 13:02:05.237170  8369 leader_election.cc:304] T f1fec8d4948d45bbbe39d0f3e73c3992 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, b560e9aaec7a4c78b9123b38e73519a3; no voters: 
I20260709 13:02:05.238507  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6245fdde2e4422581bc418d4840b580" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
I20260709 13:02:05.261927  8600 tablet_bootstrap.cc:654] T f1fec8d4948d45bbbe39d0f3e73c3992 P 590ee39ce5734876b94d91fc3931b807: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:05.262503  8998 log.cc:927] Time spent T b1d8e928d8444f77ac2950eab2115f65 P 590ee39ce5734876b94d91fc3931b807: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:02:05.270820  8988 raft_consensus.cc:493] T 8e53899e04fe4f58b666f67ac07bbf79 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.271610  8988 raft_consensus.cc:515] T 8e53899e04fe4f58b666f67ac07bbf79 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:05.274184  8988 leader_election.cc:290] T 8e53899e04fe4f58b666f67ac07bbf79 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
W20260709 13:02:05.275691  8445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40837, user_credentials={real_user=slave}} blocked reactor thread for 44027us
I20260709 13:02:05.257992  8708 raft_consensus.cc:2804] T f1fec8d4948d45bbbe39d0f3e73c3992 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:05.266624  8821 leader_election.cc:290] T d4cd925acef04f3c8910aa1903b760c7 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 election: Requested vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:02:05.285772  8544 raft_consensus.cc:2468] T d4cd925acef04f3c8910aa1903b760c7 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b3ea460d1294b8a82672d7c21475cb5 in term 1.
I20260709 13:02:05.287562  8443 leader_election.cc:304] T d4cd925acef04f3c8910aa1903b760c7 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b3ea460d1294b8a82672d7c21475cb5, b560e9aaec7a4c78b9123b38e73519a3; no voters: 
I20260709 13:02:05.289462  8887 raft_consensus.cc:2804] T d4cd925acef04f3c8910aa1903b760c7 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:05.283191  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4cd925acef04f3c8910aa1903b760c7" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807"
I20260709 13:02:05.290024  8887 raft_consensus.cc:697] T d4cd925acef04f3c8910aa1903b760c7 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 LEADER]: Becoming Leader. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Running, Role: LEADER
I20260709 13:02:05.290201  8326 raft_consensus.cc:3060] T d4cd925acef04f3c8910aa1903b760c7 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.291026  8887 consensus_queue.cc:237] T d4cd925acef04f3c8910aa1903b760c7 P 7b3ea460d1294b8a82672d7c21475cb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:05.287561  8601 tablet_bootstrap.cc:492] T 19fa9442e72f4d4697a919590110cc68 P b560e9aaec7a4c78b9123b38e73519a3: No bootstrap required, opened a new log
I20260709 13:02:05.293522  8601 ts_tablet_manager.cc:1403] T 19fa9442e72f4d4697a919590110cc68 P b560e9aaec7a4c78b9123b38e73519a3: Time spent bootstrapping tablet: real 0.250s	user 0.012s	sys 0.014s
I20260709 13:02:05.293715  8330 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e53899e04fe4f58b666f67ac07bbf79" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
W20260709 13:02:05.303426  8445 leader_election.cc:343] T 8e53899e04fe4f58b666f67ac07bbf79 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:05.307727  8602 tablet_bootstrap.cc:492] T 19fa9442e72f4d4697a919590110cc68 P 7b3ea460d1294b8a82672d7c21475cb5: No bootstrap required, opened a new log
I20260709 13:02:05.311403  8602 ts_tablet_manager.cc:1403] T 19fa9442e72f4d4697a919590110cc68 P 7b3ea460d1294b8a82672d7c21475cb5: Time spent bootstrapping tablet: real 0.249s	user 0.032s	sys 0.043s
I20260709 13:02:05.309530  8708 raft_consensus.cc:697] T f1fec8d4948d45bbbe39d0f3e73c3992 P 53a66c851dc74c70b94c65d464a391f6 [term 1 LEADER]: Becoming Leader. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Running, Role: LEADER
W20260709 13:02:05.310568  8996 log.cc:927] Time spent T 6a82728feb4f4f1094191c0e30d748dd P b560e9aaec7a4c78b9123b38e73519a3: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 13:02:05.259209  8370 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45429, user_credentials={real_user=slave}} blocked reactor thread for 58730.5us
I20260709 13:02:05.314109  8956 consensus_queue.cc:1048] T 308f98e21e714cea8c363eb315d72e27 P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:05.316802  8601 raft_consensus.cc:359] T 19fa9442e72f4d4697a919590110cc68 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:05.332392  8601 raft_consensus.cc:385] T 19fa9442e72f4d4697a919590110cc68 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.332935  8601 raft_consensus.cc:740] T 19fa9442e72f4d4697a919590110cc68 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Initialized, Role: FOLLOWER
W20260709 13:02:05.325363  8518 leader_election.cc:343] T c6245fdde2e4422581bc418d4840b580 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:05.334132  8518 leader_election.cc:304] T c6245fdde2e4422581bc418d4840b580 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b560e9aaec7a4c78b9123b38e73519a3; no voters: 590ee39ce5734876b94d91fc3931b807, 7b3ea460d1294b8a82672d7c21475cb5
I20260709 13:02:05.341439  8601 consensus_queue.cc:260] T 19fa9442e72f4d4697a919590110cc68 P b560e9aaec7a4c78b9123b38e73519a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:05.347697  8601 ts_tablet_manager.cc:1434] T 19fa9442e72f4d4697a919590110cc68 P b560e9aaec7a4c78b9123b38e73519a3: Time spent starting tablet: real 0.054s	user 0.008s	sys 0.000s
I20260709 13:02:05.348749  8601 tablet_bootstrap.cc:492] T cca6412bb2df45b4880e711fe56d2f8d P b560e9aaec7a4c78b9123b38e73519a3: Bootstrap starting.
I20260709 13:02:05.348379  8708 consensus_queue.cc:237] T f1fec8d4948d45bbbe39d0f3e73c3992 P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:05.340286  8600 tablet_bootstrap.cc:492] T f1fec8d4948d45bbbe39d0f3e73c3992 P 590ee39ce5734876b94d91fc3931b807: No bootstrap required, opened a new log
I20260709 13:02:05.353842  8600 ts_tablet_manager.cc:1403] T f1fec8d4948d45bbbe39d0f3e73c3992 P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.273s	user 0.027s	sys 0.022s
I20260709 13:02:05.354144  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d8e928d8444f77ac2950eab2115f65" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6"
I20260709 13:02:05.363016  8600 raft_consensus.cc:359] T f1fec8d4948d45bbbe39d0f3e73c3992 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:05.363816  8600 raft_consensus.cc:385] T f1fec8d4948d45bbbe39d0f3e73c3992 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.364089  8600 raft_consensus.cc:740] T f1fec8d4948d45bbbe39d0f3e73c3992 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.364769  8600 consensus_queue.cc:260] T f1fec8d4948d45bbbe39d0f3e73c3992 P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:05.330410  8225 catalog_manager.cc:5697] T b1d8e928d8444f77ac2950eab2115f65 P 590ee39ce5734876b94d91fc3931b807 reported cstate change: term changed from 0 to 1, leader changed from <none> to 590ee39ce5734876b94d91fc3931b807 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "590ee39ce5734876b94d91fc3931b807" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:05.401371  9006 log.cc:927] Time spent T da02fa98f6de48a7baefadf6e69d2046 P 590ee39ce5734876b94d91fc3931b807: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
W20260709 13:02:05.411242  8518 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.195:45429, user_credentials={real_user=slave}} blocked reactor thread for 85928.5us
I20260709 13:02:05.425776  8601 tablet_bootstrap.cc:654] T cca6412bb2df45b4880e711fe56d2f8d P b560e9aaec7a4c78b9123b38e73519a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.427922  8600 ts_tablet_manager.cc:1434] T f1fec8d4948d45bbbe39d0f3e73c3992 P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.074s	user 0.006s	sys 0.001s
I20260709 13:02:05.436012  8602 raft_consensus.cc:359] T 19fa9442e72f4d4697a919590110cc68 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:05.442477  8602 raft_consensus.cc:385] T 19fa9442e72f4d4697a919590110cc68 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.442780  8602 raft_consensus.cc:740] T 19fa9442e72f4d4697a919590110cc68 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.443409  8602 consensus_queue.cc:260] T 19fa9442e72f4d4697a919590110cc68 P 7b3ea460d1294b8a82672d7c21475cb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:05.425550  8969 raft_consensus.cc:493] T a1667ac154454613a9047f56ee087405 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.447216  8602 ts_tablet_manager.cc:1434] T 19fa9442e72f4d4697a919590110cc68 P 7b3ea460d1294b8a82672d7c21475cb5: Time spent starting tablet: real 0.135s	user 0.000s	sys 0.010s
I20260709 13:02:05.434911  8885 raft_consensus.cc:2749] T c6245fdde2e4422581bc418d4840b580 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:02:05.430013  8443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42503, user_credentials={real_user=slave}} blocked reactor thread for 43856.1us
W20260709 13:02:05.429801  8294 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42503, user_credentials={real_user=slave}} blocked reactor thread for 44670us
I20260709 13:02:05.462750  8885 raft_consensus.cc:493] T 19fa9442e72f4d4697a919590110cc68 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.464239  8885 raft_consensus.cc:515] T 19fa9442e72f4d4697a919590110cc68 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:05.466480  8885 leader_election.cc:290] T 19fa9442e72f4d4697a919590110cc68 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:02:05.467823  8956 consensus_queue.cc:1048] T b574d11894634755bd89c530b4155f1e P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:05.468170  8477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19fa9442e72f4d4697a919590110cc68" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
I20260709 13:02:05.468881  8477 raft_consensus.cc:2468] T 19fa9442e72f4d4697a919590110cc68 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 0.
I20260709 13:02:05.470501  8518 leader_election.cc:304] T 19fa9442e72f4d4697a919590110cc68 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b3ea460d1294b8a82672d7c21475cb5, b560e9aaec7a4c78b9123b38e73519a3; no voters: 
I20260709 13:02:05.450634  8969 raft_consensus.cc:515] T a1667ac154454613a9047f56ee087405 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:05.471906  8885 raft_consensus.cc:2804] T 19fa9442e72f4d4697a919590110cc68 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:05.472656  8885 raft_consensus.cc:493] T 19fa9442e72f4d4697a919590110cc68 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.473246  8885 raft_consensus.cc:3060] T 19fa9442e72f4d4697a919590110cc68 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.474237  8969 leader_election.cc:290] T a1667ac154454613a9047f56ee087405 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:02:05.477680  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1667ac154454613a9047f56ee087405" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
I20260709 13:02:05.478399  8476 raft_consensus.cc:2468] T a1667ac154454613a9047f56ee087405 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 590ee39ce5734876b94d91fc3931b807 in term 0.
I20260709 13:02:05.479393  8295 leader_election.cc:304] T a1667ac154454613a9047f56ee087405 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807, 7b3ea460d1294b8a82672d7c21475cb5; no voters: 
I20260709 13:02:05.480370  8969 raft_consensus.cc:2804] T a1667ac154454613a9047f56ee087405 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:05.480813  8969 raft_consensus.cc:493] T a1667ac154454613a9047f56ee087405 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:05.482065  8969 raft_consensus.cc:3060] T a1667ac154454613a9047f56ee087405 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.487028  8956 consensus_queue.cc:1048] T b574d11894634755bd89c530b4155f1e P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:05.494596  8326 raft_consensus.cc:2468] T d4cd925acef04f3c8910aa1903b760c7 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b3ea460d1294b8a82672d7c21475cb5 in term 1.
I20260709 13:02:05.494920  8969 raft_consensus.cc:515] T a1667ac154454613a9047f56ee087405 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:05.499091  8477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1667ac154454613a9047f56ee087405" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5"
I20260709 13:02:05.499738  8477 raft_consensus.cc:3060] T a1667ac154454613a9047f56ee087405 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.501794  8600 tablet_bootstrap.cc:492] T 4f93b4088ce1421cb59ed9a917919b22 P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:05.504122  8598 tablet_bootstrap.cc:492] T b1d8e928d8444f77ac2950eab2115f65 P 53a66c851dc74c70b94c65d464a391f6: No bootstrap required, opened a new log
I20260709 13:02:05.504741  8598 ts_tablet_manager.cc:1403] T b1d8e928d8444f77ac2950eab2115f65 P 53a66c851dc74c70b94c65d464a391f6: Time spent bootstrapping tablet: real 0.458s	user 0.043s	sys 0.063s
I20260709 13:02:05.512487  8602 tablet_bootstrap.cc:492] T ca262e71501a4ae4a89152ec6771ffb9 P 7b3ea460d1294b8a82672d7c21475cb5: Bootstrap starting.
I20260709 13:02:05.463064  8654 raft_consensus.cc:493] T f1fec8d4948d45bbbe39d0f3e73c3992 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.514792  8598 raft_consensus.cc:359] T b1d8e928d8444f77ac2950eab2115f65 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:05.517325  8598 raft_consensus.cc:385] T b1d8e928d8444f77ac2950eab2115f65 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.517732  8598 raft_consensus.cc:740] T b1d8e928d8444f77ac2950eab2115f65 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.518623  8598 consensus_queue.cc:260] T b1d8e928d8444f77ac2950eab2115f65 P 53a66c851dc74c70b94c65d464a391f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:05.527585  8598 ts_tablet_manager.cc:1434] T b1d8e928d8444f77ac2950eab2115f65 P 53a66c851dc74c70b94c65d464a391f6: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 13:02:05.529023  8598 tablet_bootstrap.cc:492] T 19fa9442e72f4d4697a919590110cc68 P 53a66c851dc74c70b94c65d464a391f6: Bootstrap starting.
I20260709 13:02:05.508803  8969 leader_election.cc:290] T a1667ac154454613a9047f56ee087405 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 election: Requested vote from peers 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:02:05.525807  8654 raft_consensus.cc:515] T f1fec8d4948d45bbbe39d0f3e73c3992 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:05.573078  8600 tablet_bootstrap.cc:654] T 4f93b4088ce1421cb59ed9a917919b22 P 590ee39ce5734876b94d91fc3931b807: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:05.579411  8518 consensus_peers.cc:597] T 308f98e21e714cea8c363eb315d72e27 P b560e9aaec7a4c78b9123b38e73519a3 -> Peer 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751): Couldn't send request to peer 53a66c851dc74c70b94c65d464a391f6. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:05.581300  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e53899e04fe4f58b666f67ac07bbf79" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:02:05.583803  8324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fec8d4948d45bbbe39d0f3e73c3992" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807"
I20260709 13:02:05.546495  8885 raft_consensus.cc:515] T 19fa9442e72f4d4697a919590110cc68 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:05.586637  8518 leader_election.cc:304] T f1fec8d4948d45bbbe39d0f3e73c3992 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b560e9aaec7a4c78b9123b38e73519a3; no voters: 53a66c851dc74c70b94c65d464a391f6, 590ee39ce5734876b94d91fc3931b807
I20260709 13:02:05.587636  8885 leader_election.cc:290] T 19fa9442e72f4d4697a919590110cc68 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 election: Requested vote from peers 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:02:05.588677  8989 raft_consensus.cc:2749] T f1fec8d4948d45bbbe39d0f3e73c3992 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:05.589977  8654 leader_election.cc:290] T f1fec8d4948d45bbbe39d0f3e73c3992 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:02:05.592401  8324 raft_consensus.cc:3060] T f1fec8d4948d45bbbe39d0f3e73c3992 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.594434  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fec8d4948d45bbbe39d0f3e73c3992" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3" is_pre_election: true
I20260709 13:02:05.595345  8545 raft_consensus.cc:2393] T f1fec8d4948d45bbbe39d0f3e73c3992 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 590ee39ce5734876b94d91fc3931b807 in current term 1: Already voted for candidate 53a66c851dc74c70b94c65d464a391f6 in this term.
I20260709 13:02:05.579160  8444 leader_election.cc:304] T a1667ac154454613a9047f56ee087405 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, 7b3ea460d1294b8a82672d7c21475cb5; no voters: 590ee39ce5734876b94d91fc3931b807
I20260709 13:02:05.589764  8598 tablet_bootstrap.cc:654] T 19fa9442e72f4d4697a919590110cc68 P 53a66c851dc74c70b94c65d464a391f6: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:05.600565  8295 leader_election.cc:343] T b1d8e928d8444f77ac2950eab2115f65 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:05.627452  8477 raft_consensus.cc:2468] T a1667ac154454613a9047f56ee087405 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 590ee39ce5734876b94d91fc3931b807 in term 1.
I20260709 13:02:05.633941  8821 raft_consensus.cc:2764] T a1667ac154454613a9047f56ee087405 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:02:05.634231  8295 leader_election.cc:304] T a1667ac154454613a9047f56ee087405 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807, 7b3ea460d1294b8a82672d7c21475cb5; no voters: 
I20260709 13:02:05.624156  8602 tablet_bootstrap.cc:654] T ca262e71501a4ae4a89152ec6771ffb9 P 7b3ea460d1294b8a82672d7c21475cb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.637145  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19fa9442e72f4d4697a919590110cc68" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5"
I20260709 13:02:05.646771  8474 raft_consensus.cc:3060] T 19fa9442e72f4d4697a919590110cc68 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.651662  8969 consensus_queue.cc:1048] T b1d8e928d8444f77ac2950eab2115f65 P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:05.655994  8601 tablet_bootstrap.cc:492] T cca6412bb2df45b4880e711fe56d2f8d P b560e9aaec7a4c78b9123b38e73519a3: No bootstrap required, opened a new log
I20260709 13:02:05.656579  8601 ts_tablet_manager.cc:1403] T cca6412bb2df45b4880e711fe56d2f8d P b560e9aaec7a4c78b9123b38e73519a3: Time spent bootstrapping tablet: real 0.308s	user 0.006s	sys 0.029s
I20260709 13:02:05.659734  8324 raft_consensus.cc:2468] T f1fec8d4948d45bbbe39d0f3e73c3992 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53a66c851dc74c70b94c65d464a391f6 in term 1.
I20260709 13:02:05.659668  8601 raft_consensus.cc:359] T cca6412bb2df45b4880e711fe56d2f8d P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:05.660421  8601 raft_consensus.cc:385] T cca6412bb2df45b4880e711fe56d2f8d P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.660753  8601 raft_consensus.cc:740] T cca6412bb2df45b4880e711fe56d2f8d P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.661624  8601 consensus_queue.cc:260] T cca6412bb2df45b4880e711fe56d2f8d P b560e9aaec7a4c78b9123b38e73519a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:05.663645  8601 ts_tablet_manager.cc:1434] T cca6412bb2df45b4880e711fe56d2f8d P b560e9aaec7a4c78b9123b38e73519a3: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:02:05.667083  8401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19fa9442e72f4d4697a919590110cc68" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:02:05.668217  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19fa9442e72f4d4697a919590110cc68" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6"
I20260709 13:02:05.669569  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1667ac154454613a9047f56ee087405" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:02:05.670236  8400 raft_consensus.cc:2468] T a1667ac154454613a9047f56ee087405 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 590ee39ce5734876b94d91fc3931b807 in term 0.
I20260709 13:02:05.671798  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1667ac154454613a9047f56ee087405" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6"
I20260709 13:02:05.672338  8400 raft_consensus.cc:3060] T a1667ac154454613a9047f56ee087405 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.673861  8474 raft_consensus.cc:2468] T 19fa9442e72f4d4697a919590110cc68 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 1.
W20260709 13:02:05.680328  8444 leader_election.cc:343] T 8e53899e04fe4f58b666f67ac07bbf79 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:05.683017  8602 tablet_bootstrap.cc:492] T ca262e71501a4ae4a89152ec6771ffb9 P 7b3ea460d1294b8a82672d7c21475cb5: No bootstrap required, opened a new log
I20260709 13:02:05.683683  8444 leader_election.cc:304] T 8e53899e04fe4f58b666f67ac07bbf79 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b3ea460d1294b8a82672d7c21475cb5; no voters: 53a66c851dc74c70b94c65d464a391f6, 590ee39ce5734876b94d91fc3931b807
I20260709 13:02:05.683902  8602 ts_tablet_manager.cc:1403] T ca262e71501a4ae4a89152ec6771ffb9 P 7b3ea460d1294b8a82672d7c21475cb5: Time spent bootstrapping tablet: real 0.177s	user 0.013s	sys 0.005s
I20260709 13:02:05.683017  8600 tablet_bootstrap.cc:492] T 4f93b4088ce1421cb59ed9a917919b22 P 590ee39ce5734876b94d91fc3931b807: No bootstrap required, opened a new log
I20260709 13:02:05.685889  8518 leader_election.cc:304] T 19fa9442e72f4d4697a919590110cc68 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b3ea460d1294b8a82672d7c21475cb5, b560e9aaec7a4c78b9123b38e73519a3; no voters: 
I20260709 13:02:05.686712  8402 raft_consensus.cc:3060] T b1d8e928d8444f77ac2950eab2115f65 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:05.686975  8958 raft_consensus.cc:2804] T 19fa9442e72f4d4697a919590110cc68 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:05.687526  8958 raft_consensus.cc:697] T 19fa9442e72f4d4697a919590110cc68 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Becoming Leader. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Running, Role: LEADER
I20260709 13:02:05.687536  8600 ts_tablet_manager.cc:1403] T 4f93b4088ce1421cb59ed9a917919b22 P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.186s	user 0.011s	sys 0.019s
I20260709 13:02:05.688345  8958 consensus_queue.cc:237] T 19fa9442e72f4d4697a919590110cc68 P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:05.665521  8654 raft_consensus.cc:2804] T a1667ac154454613a9047f56ee087405 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:05.690202  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1fec8d4948d45bbbe39d0f3e73c3992" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:02:05.692603  8986 raft_consensus.cc:2749] T 8e53899e04fe4f58b666f67ac07bbf79 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:05.694490  8400 raft_consensus.cc:2468] T a1667ac154454613a9047f56ee087405 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 590ee39ce5734876b94d91fc3931b807 in term 1.
I20260709 13:02:05.696342  8602 raft_consensus.cc:359] T ca262e71501a4ae4a89152ec6771ffb9 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:05.698237  8602 raft_consensus.cc:385] T ca262e71501a4ae4a89152ec6771ffb9 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.698987  8654 raft_consensus.cc:697] T a1667ac154454613a9047f56ee087405 P 590ee39ce5734876b94d91fc3931b807 [term 1 LEADER]: Becoming Leader. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Running, Role: LEADER
I20260709 13:02:05.698586  8602 raft_consensus.cc:740] T ca262e71501a4ae4a89152ec6771ffb9 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.699965  8654 consensus_queue.cc:237] T a1667ac154454613a9047f56ee087405 P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:05.700202  8602 consensus_queue.cc:260] T ca262e71501a4ae4a89152ec6771ffb9 P 7b3ea460d1294b8a82672d7c21475cb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:05.702006  8601 tablet_bootstrap.cc:492] T d97df5fdb12a439080fa6edc391ebd82 P b560e9aaec7a4c78b9123b38e73519a3: Bootstrap starting.
I20260709 13:02:05.703243  8602 ts_tablet_manager.cc:1434] T ca262e71501a4ae4a89152ec6771ffb9 P 7b3ea460d1294b8a82672d7c21475cb5: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
W20260709 13:02:05.703719  8518 leader_election.cc:343] T 19fa9442e72f4d4697a919590110cc68 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:05.704908  8518 leader_election.cc:343] T 19fa9442e72f4d4697a919590110cc68 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:05.717698  8295 leader_election.cc:304] T f1fec8d4948d45bbbe39d0f3e73c3992 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807; no voters: 53a66c851dc74c70b94c65d464a391f6, b560e9aaec7a4c78b9123b38e73519a3
I20260709 13:02:05.724699  8600 raft_consensus.cc:359] T 4f93b4088ce1421cb59ed9a917919b22 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:05.725580  8600 raft_consensus.cc:385] T 4f93b4088ce1421cb59ed9a917919b22 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.725965  8600 raft_consensus.cc:740] T 4f93b4088ce1421cb59ed9a917919b22 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.728003  8598 tablet_bootstrap.cc:492] T 19fa9442e72f4d4697a919590110cc68 P 53a66c851dc74c70b94c65d464a391f6: No bootstrap required, opened a new log
I20260709 13:02:05.728506  8598 ts_tablet_manager.cc:1403] T 19fa9442e72f4d4697a919590110cc68 P 53a66c851dc74c70b94c65d464a391f6: Time spent bootstrapping tablet: real 0.200s	user 0.012s	sys 0.006s
I20260709 13:02:05.726888  8600 consensus_queue.cc:260] T 4f93b4088ce1421cb59ed9a917919b22 P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:05.732059  8598 raft_consensus.cc:359] T 19fa9442e72f4d4697a919590110cc68 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:05.732671  8602 tablet_bootstrap.cc:492] T cca6412bb2df45b4880e711fe56d2f8d P 7b3ea460d1294b8a82672d7c21475cb5: Bootstrap starting.
I20260709 13:02:05.732796  8598 raft_consensus.cc:385] T 19fa9442e72f4d4697a919590110cc68 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.733166  8598 raft_consensus.cc:740] T 19fa9442e72f4d4697a919590110cc68 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.733785  8598 consensus_queue.cc:260] T 19fa9442e72f4d4697a919590110cc68 P 53a66c851dc74c70b94c65d464a391f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:05.736151  8598 ts_tablet_manager.cc:1434] T 19fa9442e72f4d4697a919590110cc68 P 53a66c851dc74c70b94c65d464a391f6: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 13:02:05.747069  8654 raft_consensus.cc:2749] T f1fec8d4948d45bbbe39d0f3e73c3992 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:05.754922  8602 tablet_bootstrap.cc:654] T cca6412bb2df45b4880e711fe56d2f8d P 7b3ea460d1294b8a82672d7c21475cb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.758114  9026 consensus_queue.cc:1048] T b1d8e928d8444f77ac2950eab2115f65 P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:05.774266  8601 tablet_bootstrap.cc:654] T d97df5fdb12a439080fa6edc391ebd82 P b560e9aaec7a4c78b9123b38e73519a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.778131  8598 tablet_bootstrap.cc:492] T 308f98e21e714cea8c363eb315d72e27 P 53a66c851dc74c70b94c65d464a391f6: Bootstrap starting.
I20260709 13:02:05.785269  8598 tablet_bootstrap.cc:654] T 308f98e21e714cea8c363eb315d72e27 P 53a66c851dc74c70b94c65d464a391f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.789880  8987 consensus_queue.cc:1048] T d4cd925acef04f3c8910aa1903b760c7 P 7b3ea460d1294b8a82672d7c21475cb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:05.794399  8600 ts_tablet_manager.cc:1434] T 4f93b4088ce1421cb59ed9a917919b22 P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.106s	user 0.015s	sys 0.013s
I20260709 13:02:05.795764  8600 tablet_bootstrap.cc:492] T 8e53899e04fe4f58b666f67ac07bbf79 P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:05.806322  8602 tablet_bootstrap.cc:492] T cca6412bb2df45b4880e711fe56d2f8d P 7b3ea460d1294b8a82672d7c21475cb5: No bootstrap required, opened a new log
I20260709 13:02:05.806972  8602 ts_tablet_manager.cc:1403] T cca6412bb2df45b4880e711fe56d2f8d P 7b3ea460d1294b8a82672d7c21475cb5: Time spent bootstrapping tablet: real 0.087s	user 0.004s	sys 0.009s
I20260709 13:02:05.810576  8602 raft_consensus.cc:359] T cca6412bb2df45b4880e711fe56d2f8d P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:05.811434  8602 raft_consensus.cc:385] T cca6412bb2df45b4880e711fe56d2f8d P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.811779  8602 raft_consensus.cc:740] T cca6412bb2df45b4880e711fe56d2f8d P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.819888  8598 tablet_bootstrap.cc:492] T 308f98e21e714cea8c363eb315d72e27 P 53a66c851dc74c70b94c65d464a391f6: No bootstrap required, opened a new log
I20260709 13:02:05.820937  8598 ts_tablet_manager.cc:1403] T 308f98e21e714cea8c363eb315d72e27 P 53a66c851dc74c70b94c65d464a391f6: Time spent bootstrapping tablet: real 0.043s	user 0.012s	sys 0.003s
I20260709 13:02:05.826328  8602 consensus_queue.cc:260] T cca6412bb2df45b4880e711fe56d2f8d P 7b3ea460d1294b8a82672d7c21475cb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
W20260709 13:02:05.831300  9023 log.cc:927] Time spent T 19fa9442e72f4d4697a919590110cc68 P b560e9aaec7a4c78b9123b38e73519a3: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 13:02:05.831813  8602 ts_tablet_manager.cc:1434] T cca6412bb2df45b4880e711fe56d2f8d P 7b3ea460d1294b8a82672d7c21475cb5: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.001s
I20260709 13:02:05.833001  8602 tablet_bootstrap.cc:492] T ef35fbe0cee64967ab342c52aa0b1ac1 P 7b3ea460d1294b8a82672d7c21475cb5: Bootstrap starting.
I20260709 13:02:05.824582  8598 raft_consensus.cc:359] T 308f98e21e714cea8c363eb315d72e27 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:05.837040  8598 raft_consensus.cc:385] T 308f98e21e714cea8c363eb315d72e27 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.837455  8598 raft_consensus.cc:740] T 308f98e21e714cea8c363eb315d72e27 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.839931  8600 tablet_bootstrap.cc:654] T 8e53899e04fe4f58b666f67ac07bbf79 P 590ee39ce5734876b94d91fc3931b807: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.842075  8947 consensus_queue.cc:1048] T f1fec8d4948d45bbbe39d0f3e73c3992 P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:05.843713  8598 consensus_queue.cc:260] T 308f98e21e714cea8c363eb315d72e27 P 53a66c851dc74c70b94c65d464a391f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:05.845818  8598 ts_tablet_manager.cc:1434] T 308f98e21e714cea8c363eb315d72e27 P 53a66c851dc74c70b94c65d464a391f6: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 13:02:05.847047  8598 tablet_bootstrap.cc:492] T d97df5fdb12a439080fa6edc391ebd82 P 53a66c851dc74c70b94c65d464a391f6: Bootstrap starting.
I20260709 13:02:05.856105  8602 tablet_bootstrap.cc:654] T ef35fbe0cee64967ab342c52aa0b1ac1 P 7b3ea460d1294b8a82672d7c21475cb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.858721  8600 tablet_bootstrap.cc:492] T 8e53899e04fe4f58b666f67ac07bbf79 P 590ee39ce5734876b94d91fc3931b807: No bootstrap required, opened a new log
I20260709 13:02:05.860339  8600 ts_tablet_manager.cc:1403] T 8e53899e04fe4f58b666f67ac07bbf79 P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.065s	user 0.007s	sys 0.007s
I20260709 13:02:05.863246  8600 raft_consensus.cc:359] T 8e53899e04fe4f58b666f67ac07bbf79 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:05.864082  8600 raft_consensus.cc:385] T 8e53899e04fe4f58b666f67ac07bbf79 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.864405  8600 raft_consensus.cc:740] T 8e53899e04fe4f58b666f67ac07bbf79 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.871810  8598 tablet_bootstrap.cc:654] T d97df5fdb12a439080fa6edc391ebd82 P 53a66c851dc74c70b94c65d464a391f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.869784  8600 consensus_queue.cc:260] T 8e53899e04fe4f58b666f67ac07bbf79 P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:05.877388  8600 ts_tablet_manager.cc:1434] T 8e53899e04fe4f58b666f67ac07bbf79 P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:02:05.878647  8600 tablet_bootstrap.cc:492] T d97df5fdb12a439080fa6edc391ebd82 P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:05.883627  8602 tablet_bootstrap.cc:492] T ef35fbe0cee64967ab342c52aa0b1ac1 P 7b3ea460d1294b8a82672d7c21475cb5: No bootstrap required, opened a new log
I20260709 13:02:05.884282  8602 ts_tablet_manager.cc:1403] T ef35fbe0cee64967ab342c52aa0b1ac1 P 7b3ea460d1294b8a82672d7c21475cb5: Time spent bootstrapping tablet: real 0.051s	user 0.005s	sys 0.006s
I20260709 13:02:05.887754  8602 raft_consensus.cc:359] T ef35fbe0cee64967ab342c52aa0b1ac1 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:05.893918  8602 raft_consensus.cc:385] T ef35fbe0cee64967ab342c52aa0b1ac1 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.894281  8602 raft_consensus.cc:740] T ef35fbe0cee64967ab342c52aa0b1ac1 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.893419  8598 tablet_bootstrap.cc:492] T d97df5fdb12a439080fa6edc391ebd82 P 53a66c851dc74c70b94c65d464a391f6: No bootstrap required, opened a new log
I20260709 13:02:05.895381  8598 ts_tablet_manager.cc:1403] T d97df5fdb12a439080fa6edc391ebd82 P 53a66c851dc74c70b94c65d464a391f6: Time spent bootstrapping tablet: real 0.049s	user 0.013s	sys 0.001s
I20260709 13:02:05.898824  8598 raft_consensus.cc:359] T d97df5fdb12a439080fa6edc391ebd82 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:05.899475  8598 raft_consensus.cc:385] T d97df5fdb12a439080fa6edc391ebd82 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.899784  8598 raft_consensus.cc:740] T d97df5fdb12a439080fa6edc391ebd82 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.900792  8602 consensus_queue.cc:260] T ef35fbe0cee64967ab342c52aa0b1ac1 P 7b3ea460d1294b8a82672d7c21475cb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:05.909446  8602 ts_tablet_manager.cc:1434] T ef35fbe0cee64967ab342c52aa0b1ac1 P 7b3ea460d1294b8a82672d7c21475cb5: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.001s
I20260709 13:02:05.910612  8602 tablet_bootstrap.cc:492] T c6245fdde2e4422581bc418d4840b580 P 7b3ea460d1294b8a82672d7c21475cb5: Bootstrap starting.
I20260709 13:02:05.912763  8888 consensus_queue.cc:1048] T d4cd925acef04f3c8910aa1903b760c7 P 7b3ea460d1294b8a82672d7c21475cb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:05.905015  8600 tablet_bootstrap.cc:654] T d97df5fdb12a439080fa6edc391ebd82 P 590ee39ce5734876b94d91fc3931b807: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.918581  9027 raft_consensus.cc:493] T 8e53899e04fe4f58b666f67ac07bbf79 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.919167  9027 raft_consensus.cc:515] T 8e53899e04fe4f58b666f67ac07bbf79 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:05.922287  9027 leader_election.cc:290] T 8e53899e04fe4f58b666f67ac07bbf79 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:02:05.900431  8598 consensus_queue.cc:260] T d97df5fdb12a439080fa6edc391ebd82 P 53a66c851dc74c70b94c65d464a391f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:05.916399  8602 tablet_bootstrap.cc:654] T c6245fdde2e4422581bc418d4840b580 P 7b3ea460d1294b8a82672d7c21475cb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.935459  8598 ts_tablet_manager.cc:1434] T d97df5fdb12a439080fa6edc391ebd82 P 53a66c851dc74c70b94c65d464a391f6: Time spent starting tablet: real 0.040s	user 0.007s	sys 0.000s
I20260709 13:02:05.936511  8598 tablet_bootstrap.cc:492] T 4f93b4088ce1421cb59ed9a917919b22 P 53a66c851dc74c70b94c65d464a391f6: Bootstrap starting.
I20260709 13:02:05.941438  8600 tablet_bootstrap.cc:492] T d97df5fdb12a439080fa6edc391ebd82 P 590ee39ce5734876b94d91fc3931b807: No bootstrap required, opened a new log
I20260709 13:02:05.942015  8600 ts_tablet_manager.cc:1403] T d97df5fdb12a439080fa6edc391ebd82 P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.064s	user 0.015s	sys 0.000s
I20260709 13:02:05.946130  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e53899e04fe4f58b666f67ac07bbf79" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
I20260709 13:02:05.947163  8476 raft_consensus.cc:2468] T 8e53899e04fe4f58b666f67ac07bbf79 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 590ee39ce5734876b94d91fc3931b807 in term 0.
I20260709 13:02:05.947419  8598 tablet_bootstrap.cc:654] T 4f93b4088ce1421cb59ed9a917919b22 P 53a66c851dc74c70b94c65d464a391f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.946564  8228 catalog_manager.cc:5697] T f1fec8d4948d45bbbe39d0f3e73c3992 P 53a66c851dc74c70b94c65d464a391f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "53a66c851dc74c70b94c65d464a391f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:05.949404  8968 consensus_queue.cc:1048] T f1fec8d4948d45bbbe39d0f3e73c3992 P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:05.950470  8600 raft_consensus.cc:359] T d97df5fdb12a439080fa6edc391ebd82 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:05.951157  8600 raft_consensus.cc:385] T d97df5fdb12a439080fa6edc391ebd82 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:05.951421  8600 raft_consensus.cc:740] T d97df5fdb12a439080fa6edc391ebd82 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:05.952044  8600 consensus_queue.cc:260] T d97df5fdb12a439080fa6edc391ebd82 P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:05.954658  8600 ts_tablet_manager.cc:1434] T d97df5fdb12a439080fa6edc391ebd82 P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:02:05.955667  8600 tablet_bootstrap.cc:492] T fcc07b65535048fca9045891e1ae0153 P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:05.964502  8600 tablet_bootstrap.cc:654] T fcc07b65535048fca9045891e1ae0153 P 590ee39ce5734876b94d91fc3931b807: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:05.990793  8959 raft_consensus.cc:493] T cca6412bb2df45b4880e711fe56d2f8d P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:05.993590  8959 raft_consensus.cc:515] T cca6412bb2df45b4880e711fe56d2f8d P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:06.056113  8967 raft_consensus.cc:493] T 308f98e21e714cea8c363eb315d72e27 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.071882  8967 raft_consensus.cc:515] T 308f98e21e714cea8c363eb315d72e27 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:06.066638  8598 tablet_bootstrap.cc:492] T 4f93b4088ce1421cb59ed9a917919b22 P 53a66c851dc74c70b94c65d464a391f6: No bootstrap required, opened a new log
I20260709 13:02:06.068331  8602 tablet_bootstrap.cc:492] T c6245fdde2e4422581bc418d4840b580 P 7b3ea460d1294b8a82672d7c21475cb5: No bootstrap required, opened a new log
I20260709 13:02:06.074659  8598 ts_tablet_manager.cc:1403] T 4f93b4088ce1421cb59ed9a917919b22 P 53a66c851dc74c70b94c65d464a391f6: Time spent bootstrapping tablet: real 0.138s	user 0.011s	sys 0.000s
I20260709 13:02:06.074654  8602 ts_tablet_manager.cc:1403] T c6245fdde2e4422581bc418d4840b580 P 7b3ea460d1294b8a82672d7c21475cb5: Time spent bootstrapping tablet: real 0.164s	user 0.009s	sys 0.002s
I20260709 13:02:06.077308  8967 leader_election.cc:290] T 308f98e21e714cea8c363eb315d72e27 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429), b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503)
I20260709 13:02:06.077967  8602 raft_consensus.cc:359] T c6245fdde2e4422581bc418d4840b580 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:06.078678  8602 raft_consensus.cc:385] T c6245fdde2e4422581bc418d4840b580 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:06.078950  8602 raft_consensus.cc:740] T c6245fdde2e4422581bc418d4840b580 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Initialized, Role: FOLLOWER
I20260709 13:02:06.079643  8602 consensus_queue.cc:260] T c6245fdde2e4422581bc418d4840b580 P 7b3ea460d1294b8a82672d7c21475cb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:06.080189  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "308f98e21e714cea8c363eb315d72e27" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
I20260709 13:02:06.081238  8602 ts_tablet_manager.cc:1434] T c6245fdde2e4422581bc418d4840b580 P 7b3ea460d1294b8a82672d7c21475cb5: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.005s
I20260709 13:02:06.083047  8602 tablet_bootstrap.cc:492] T fcc07b65535048fca9045891e1ae0153 P 7b3ea460d1294b8a82672d7c21475cb5: Bootstrap starting.
I20260709 13:02:06.081223  8545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "308f98e21e714cea8c363eb315d72e27" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3" is_pre_election: true
I20260709 13:02:06.086498  8369 leader_election.cc:304] T 308f98e21e714cea8c363eb315d72e27 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6; no voters: 7b3ea460d1294b8a82672d7c21475cb5, b560e9aaec7a4c78b9123b38e73519a3
I20260709 13:02:06.086573  8598 raft_consensus.cc:359] T 4f93b4088ce1421cb59ed9a917919b22 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:06.087639  8598 raft_consensus.cc:385] T 4f93b4088ce1421cb59ed9a917919b22 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:06.087988  8598 raft_consensus.cc:740] T 4f93b4088ce1421cb59ed9a917919b22 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Initialized, Role: FOLLOWER
I20260709 13:02:06.088405  8967 raft_consensus.cc:2749] T 308f98e21e714cea8c363eb315d72e27 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:06.090732  8598 consensus_queue.cc:260] T 4f93b4088ce1421cb59ed9a917919b22 P 53a66c851dc74c70b94c65d464a391f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:06.093248  8598 ts_tablet_manager.cc:1434] T 4f93b4088ce1421cb59ed9a917919b22 P 53a66c851dc74c70b94c65d464a391f6: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:02:06.097398  8598 tablet_bootstrap.cc:492] T cca6412bb2df45b4880e711fe56d2f8d P 53a66c851dc74c70b94c65d464a391f6: Bootstrap starting.
I20260709 13:02:06.101619  8602 tablet_bootstrap.cc:654] T fcc07b65535048fca9045891e1ae0153 P 7b3ea460d1294b8a82672d7c21475cb5: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:06.104195  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca6412bb2df45b4880e711fe56d2f8d" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
I20260709 13:02:06.105332  8474 raft_consensus.cc:2468] T cca6412bb2df45b4880e711fe56d2f8d P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 0.
I20260709 13:02:06.106864  8518 leader_election.cc:304] T cca6412bb2df45b4880e711fe56d2f8d P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b3ea460d1294b8a82672d7c21475cb5, b560e9aaec7a4c78b9123b38e73519a3; no voters: 
I20260709 13:02:06.108646  8964 raft_consensus.cc:2804] T cca6412bb2df45b4880e711fe56d2f8d P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:06.109242  8964 raft_consensus.cc:493] T cca6412bb2df45b4880e711fe56d2f8d P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.109753  8964 raft_consensus.cc:3060] T cca6412bb2df45b4880e711fe56d2f8d P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.123219  8986 raft_consensus.cc:493] T ca262e71501a4ae4a89152ec6771ffb9 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.123849  8602 tablet_bootstrap.cc:492] T fcc07b65535048fca9045891e1ae0153 P 7b3ea460d1294b8a82672d7c21475cb5: No bootstrap required, opened a new log
I20260709 13:02:06.130509  8602 ts_tablet_manager.cc:1403] T fcc07b65535048fca9045891e1ae0153 P 7b3ea460d1294b8a82672d7c21475cb5: Time spent bootstrapping tablet: real 0.048s	user 0.015s	sys 0.000s
W20260709 13:02:06.140193  8276 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:06.181631  8708 raft_consensus.cc:493] T 19fa9442e72f4d4697a919590110cc68 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.242738  8405 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e53899e04fe4f58b666f67ac07bbf79" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:02:06.124086  8986 raft_consensus.cc:515] T ca262e71501a4ae4a89152ec6771ffb9 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:06.300516  9027 raft_consensus.cc:493] T 4f93b4088ce1421cb59ed9a917919b22 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.299696  8959 leader_election.cc:290] T cca6412bb2df45b4880e711fe56d2f8d P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:02:06.309836  8987 raft_consensus.cc:493] T ef35fbe0cee64967ab342c52aa0b1ac1 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.338027  8602 raft_consensus.cc:359] T fcc07b65535048fca9045891e1ae0153 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:06.339174  8602 raft_consensus.cc:385] T fcc07b65535048fca9045891e1ae0153 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:06.339566  8602 raft_consensus.cc:740] T fcc07b65535048fca9045891e1ae0153 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Initialized, Role: FOLLOWER
I20260709 13:02:06.228842  8708 raft_consensus.cc:515] T 19fa9442e72f4d4697a919590110cc68 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:06.349000  8602 consensus_queue.cc:260] T fcc07b65535048fca9045891e1ae0153 P 7b3ea460d1294b8a82672d7c21475cb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
W20260709 13:02:06.369342  8295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45429, user_credentials={real_user=slave}} blocked reactor thread for 71480.8us
I20260709 13:02:06.335927  9027 raft_consensus.cc:515] T 4f93b4088ce1421cb59ed9a917919b22 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:06.348130  8987 raft_consensus.cc:515] T ef35fbe0cee64967ab342c52aa0b1ac1 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:06.413324  8295 leader_election.cc:304] T 8e53899e04fe4f58b666f67ac07bbf79 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807, 7b3ea460d1294b8a82672d7c21475cb5; no voters: 
I20260709 13:02:06.414042  8888 raft_consensus.cc:493] T c6245fdde2e4422581bc418d4840b580 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.445482  8986 leader_election.cc:290] T ca262e71501a4ae4a89152ec6771ffb9 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:02:06.447090  9047 raft_consensus.cc:2804] T 8e53899e04fe4f58b666f67ac07bbf79 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:06.447549  9047 raft_consensus.cc:493] T 8e53899e04fe4f58b666f67ac07bbf79 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.447887  9047 raft_consensus.cc:3060] T 8e53899e04fe4f58b666f67ac07bbf79 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.417869  9001 raft_consensus.cc:493] T d97df5fdb12a439080fa6edc391ebd82 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:06.466941  8601 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.154s	sys 0.265s
W20260709 13:02:06.467490  8601 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.154s	sys 0.265s
W20260709 13:02:06.486183  8600 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.153s	sys 0.298s
W20260709 13:02:06.486567  8600 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.153s	sys 0.298s
I20260709 13:02:06.499217  8601 tablet_bootstrap.cc:492] T d97df5fdb12a439080fa6edc391ebd82 P b560e9aaec7a4c78b9123b38e73519a3: No bootstrap required, opened a new log
I20260709 13:02:06.499969  8601 ts_tablet_manager.cc:1403] T d97df5fdb12a439080fa6edc391ebd82 P b560e9aaec7a4c78b9123b38e73519a3: Time spent bootstrapping tablet: real 0.833s	user 0.168s	sys 0.265s
I20260709 13:02:06.456563  8888 raft_consensus.cc:515] T c6245fdde2e4422581bc418d4840b580 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:06.475363  9001 raft_consensus.cc:515] T d97df5fdb12a439080fa6edc391ebd82 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:06.527047  8598 tablet_bootstrap.cc:654] T cca6412bb2df45b4880e711fe56d2f8d P 53a66c851dc74c70b94c65d464a391f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:06.528784  8708 leader_election.cc:290] T 19fa9442e72f4d4697a919590110cc68 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429), b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503)
I20260709 13:02:06.535331  8601 raft_consensus.cc:359] T d97df5fdb12a439080fa6edc391ebd82 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:06.536837  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca262e71501a4ae4a89152ec6771ffb9" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3" is_pre_election: true
I20260709 13:02:06.539362  9001 leader_election.cc:290] T d97df5fdb12a439080fa6edc391ebd82 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:02:06.544409  8888 leader_election.cc:290] T c6245fdde2e4422581bc418d4840b580 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:02:06.545035  8601 raft_consensus.cc:385] T d97df5fdb12a439080fa6edc391ebd82 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:06.545579  8601 raft_consensus.cc:740] T d97df5fdb12a439080fa6edc391ebd82 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Initialized, Role: FOLLOWER
I20260709 13:02:06.546321  8601 consensus_queue.cc:260] T d97df5fdb12a439080fa6edc391ebd82 P b560e9aaec7a4c78b9123b38e73519a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:06.546144  8224 catalog_manager.cc:5697] T d4cd925acef04f3c8910aa1903b760c7 P 7b3ea460d1294b8a82672d7c21475cb5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "7b3ea460d1294b8a82672d7c21475cb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:06.553061  8602 ts_tablet_manager.cc:1434] T fcc07b65535048fca9045891e1ae0153 P 7b3ea460d1294b8a82672d7c21475cb5: Time spent starting tablet: real 0.422s	user 0.046s	sys 0.053s
I20260709 13:02:06.558341  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6245fdde2e4422581bc418d4840b580" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
I20260709 13:02:06.561084  8987 leader_election.cc:290] T ef35fbe0cee64967ab342c52aa0b1ac1 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:02:06.563639  8399 raft_consensus.cc:3060] T 19fa9442e72f4d4697a919590110cc68 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.522452  8968 raft_consensus.cc:493] T 4f93b4088ce1421cb59ed9a917919b22 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.571807  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f93b4088ce1421cb59ed9a917919b22" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3" is_pre_election: true
I20260709 13:02:06.568460  9047 raft_consensus.cc:515] T 8e53899e04fe4f58b666f67ac07bbf79 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:06.611668  8546 raft_consensus.cc:2468] T 4f93b4088ce1421cb59ed9a917919b22 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 590ee39ce5734876b94d91fc3931b807 in term 0.
I20260709 13:02:06.613080  9047 leader_election.cc:290] T 8e53899e04fe4f58b666f67ac07bbf79 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 election: Requested vote from peers 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:02:06.580065  8964 raft_consensus.cc:515] T cca6412bb2df45b4880e711fe56d2f8d P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:06.584686  8549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6245fdde2e4422581bc418d4840b580" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3" is_pre_election: true
I20260709 13:02:06.616142  8549 raft_consensus.cc:2468] T c6245fdde2e4422581bc418d4840b580 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b3ea460d1294b8a82672d7c21475cb5 in term 0.
W20260709 13:02:06.585815  9044 log.cc:927] Time spent T f1fec8d4948d45bbbe39d0f3e73c3992 P 590ee39ce5734876b94d91fc3931b807: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 13:02:06.617641  8294 leader_election.cc:304] T 4f93b4088ce1421cb59ed9a917919b22 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807, b560e9aaec7a4c78b9123b38e73519a3; no voters: 
I20260709 13:02:06.586140  9027 leader_election.cc:290] T 4f93b4088ce1421cb59ed9a917919b22 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:02:06.618428  9051 raft_consensus.cc:2804] T 4f93b4088ce1421cb59ed9a917919b22 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:06.618944  9051 raft_consensus.cc:493] T 4f93b4088ce1421cb59ed9a917919b22 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.619285  9051 raft_consensus.cc:3060] T 4f93b4088ce1421cb59ed9a917919b22 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.586498  8968 raft_consensus.cc:515] T 4f93b4088ce1421cb59ed9a917919b22 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:06.587877  8553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef35fbe0cee64967ab342c52aa0b1ac1" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3" is_pre_election: true
I20260709 13:02:06.591171  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca6412bb2df45b4880e711fe56d2f8d" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:02:06.637877  9051 raft_consensus.cc:515] T 4f93b4088ce1421cb59ed9a917919b22 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:06.595760  8601 ts_tablet_manager.cc:1434] T d97df5fdb12a439080fa6edc391ebd82 P b560e9aaec7a4c78b9123b38e73519a3: Time spent starting tablet: real 0.095s	user 0.004s	sys 0.004s
I20260709 13:02:06.639840  8601 tablet_bootstrap.cc:492] T ca262e71501a4ae4a89152ec6771ffb9 P b560e9aaec7a4c78b9123b38e73519a3: Bootstrap starting.
W20260709 13:02:06.608428  8369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42503, user_credentials={real_user=slave}} blocked reactor thread for 154376us
I20260709 13:02:06.640954  9051 leader_election.cc:290] T 4f93b4088ce1421cb59ed9a917919b22 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 election: Requested vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:02:06.602774  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef35fbe0cee64967ab342c52aa0b1ac1" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
W20260709 13:02:06.592971  8443 leader_election.cc:343] T ca262e71501a4ae4a89152ec6771ffb9 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:06.590413  8445 leader_election.cc:343] T c6245fdde2e4422581bc418d4840b580 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:06.646385  8445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40837, user_credentials={real_user=slave}} blocked reactor thread for 56025.8us
I20260709 13:02:06.570168  8402 raft_consensus.cc:3060] T 308f98e21e714cea8c363eb315d72e27 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.636683  8968 leader_election.cc:290] T 4f93b4088ce1421cb59ed9a917919b22 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:02:06.599570  8600 tablet_bootstrap.cc:492] T fcc07b65535048fca9045891e1ae0153 P 590ee39ce5734876b94d91fc3931b807: No bootstrap required, opened a new log
I20260709 13:02:06.648607  8600 ts_tablet_manager.cc:1403] T fcc07b65535048fca9045891e1ae0153 P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.693s	user 0.160s	sys 0.301s
W20260709 13:02:06.649359  8518 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45429, user_credentials={real_user=slave}} blocked reactor thread for 191768us
W20260709 13:02:06.601820  8295 leader_election.cc:343] T 8e53899e04fe4f58b666f67ac07bbf79 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:06.653419  8295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37751, user_credentials={real_user=slave}} blocked reactor thread for 51660us
W20260709 13:02:06.658152  8371 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40837, user_credentials={real_user=slave}} blocked reactor thread for 88741.2us
I20260709 13:02:06.637048  8964 leader_election.cc:290] T cca6412bb2df45b4880e711fe56d2f8d P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 election: Requested vote from peers 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:02:06.585443  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca262e71501a4ae4a89152ec6771ffb9" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
W20260709 13:02:06.646876  8443 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.196:42503, user_credentials={real_user=slave}} blocked reactor thread for 53951.4us
I20260709 13:02:06.662074  8598 tablet_bootstrap.cc:492] T cca6412bb2df45b4880e711fe56d2f8d P 53a66c851dc74c70b94c65d464a391f6: No bootstrap required, opened a new log
I20260709 13:02:06.640800  8553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f93b4088ce1421cb59ed9a917919b22" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3"
I20260709 13:02:06.662808  8598 ts_tablet_manager.cc:1403] T cca6412bb2df45b4880e711fe56d2f8d P 53a66c851dc74c70b94c65d464a391f6: Time spent bootstrapping tablet: real 0.566s	user 0.015s	sys 0.006s
I20260709 13:02:06.662952  8553 raft_consensus.cc:3060] T 4f93b4088ce1421cb59ed9a917919b22 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.666184  8324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97df5fdb12a439080fa6edc391ebd82" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
I20260709 13:02:06.666867  8324 raft_consensus.cc:2468] T d97df5fdb12a439080fa6edc391ebd82 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53a66c851dc74c70b94c65d464a391f6 in term 0.
I20260709 13:02:06.667383  8600 raft_consensus.cc:359] T fcc07b65535048fca9045891e1ae0153 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:06.668342  8600 raft_consensus.cc:385] T fcc07b65535048fca9045891e1ae0153 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:06.668645  8600 raft_consensus.cc:740] T fcc07b65535048fca9045891e1ae0153 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:06.669375  8600 consensus_queue.cc:260] T fcc07b65535048fca9045891e1ae0153 P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
W20260709 13:02:06.670848  8445 leader_election.cc:343] T ca262e71501a4ae4a89152ec6771ffb9 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:06.671284  8445 leader_election.cc:304] T ca262e71501a4ae4a89152ec6771ffb9 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b3ea460d1294b8a82672d7c21475cb5; no voters: 590ee39ce5734876b94d91fc3931b807, b560e9aaec7a4c78b9123b38e73519a3
I20260709 13:02:06.673004  8598 raft_consensus.cc:359] T cca6412bb2df45b4880e711fe56d2f8d P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:06.673705  8598 raft_consensus.cc:385] T cca6412bb2df45b4880e711fe56d2f8d P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:06.674465  8598 raft_consensus.cc:740] T cca6412bb2df45b4880e711fe56d2f8d P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Initialized, Role: FOLLOWER
I20260709 13:02:06.675117  8598 consensus_queue.cc:260] T cca6412bb2df45b4880e711fe56d2f8d P 53a66c851dc74c70b94c65d464a391f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:06.676051  9054 raft_consensus.cc:2749] T ca262e71501a4ae4a89152ec6771ffb9 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:06.677873  8477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19fa9442e72f4d4697a919590110cc68" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
I20260709 13:02:06.678013  8323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f93b4088ce1421cb59ed9a917919b22" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
I20260709 13:02:06.678638  8477 raft_consensus.cc:2393] T 19fa9442e72f4d4697a919590110cc68 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 53a66c851dc74c70b94c65d464a391f6 in current term 1: Already voted for candidate b560e9aaec7a4c78b9123b38e73519a3 in this term.
I20260709 13:02:06.678844  8323 raft_consensus.cc:2393] T 4f93b4088ce1421cb59ed9a917919b22 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 53a66c851dc74c70b94c65d464a391f6 in current term 1: Already voted for candidate 590ee39ce5734876b94d91fc3931b807 in this term.
I20260709 13:02:06.676388  8226 catalog_manager.cc:5697] T b574d11894634755bd89c530b4155f1e P b560e9aaec7a4c78b9123b38e73519a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "b560e9aaec7a4c78b9123b38e73519a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:06.676409  8445 leader_election.cc:343] T ef35fbe0cee64967ab342c52aa0b1ac1 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:06.683059  8443 leader_election.cc:304] T c6245fdde2e4422581bc418d4840b580 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b3ea460d1294b8a82672d7c21475cb5, b560e9aaec7a4c78b9123b38e73519a3; no voters: 590ee39ce5734876b94d91fc3931b807
I20260709 13:02:06.683904  8987 raft_consensus.cc:2804] T c6245fdde2e4422581bc418d4840b580 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:06.684921  8477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e53899e04fe4f58b666f67ac07bbf79" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5"
I20260709 13:02:06.685401  8987 raft_consensus.cc:493] T c6245fdde2e4422581bc418d4840b580 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.688692  8987 raft_consensus.cc:3060] T c6245fdde2e4422581bc418d4840b580 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.690828  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca6412bb2df45b4880e711fe56d2f8d" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5"
I20260709 13:02:06.691463  8476 raft_consensus.cc:3060] T cca6412bb2df45b4880e711fe56d2f8d P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.692162  8600 ts_tablet_manager.cc:1434] T fcc07b65535048fca9045891e1ae0153 P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.001s
I20260709 13:02:06.693472  8600 tablet_bootstrap.cc:492] T ca262e71501a4ae4a89152ec6771ffb9 P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:06.685556  8477 raft_consensus.cc:3060] T 8e53899e04fe4f58b666f67ac07bbf79 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.658876  8601 tablet_bootstrap.cc:654] T ca262e71501a4ae4a89152ec6771ffb9 P b560e9aaec7a4c78b9123b38e73519a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:06.701488  9051 consensus_queue.cc:1048] T a1667ac154454613a9047f56ee087405 P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:02:06.705094  8443 leader_election.cc:343] T ef35fbe0cee64967ab342c52aa0b1ac1 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:06.705560  8600 tablet_bootstrap.cc:654] T ca262e71501a4ae4a89152ec6771ffb9 P 590ee39ce5734876b94d91fc3931b807: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:06.705665  8443 leader_election.cc:304] T ef35fbe0cee64967ab342c52aa0b1ac1 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b3ea460d1294b8a82672d7c21475cb5; no voters: 590ee39ce5734876b94d91fc3931b807, b560e9aaec7a4c78b9123b38e73519a3
I20260709 13:02:06.706627  8888 raft_consensus.cc:2749] T ef35fbe0cee64967ab342c52aa0b1ac1 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:06.710880  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e53899e04fe4f58b666f67ac07bbf79" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6"
I20260709 13:02:06.711063  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f93b4088ce1421cb59ed9a917919b22" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:02:06.711773  8403 raft_consensus.cc:2468] T 4f93b4088ce1421cb59ed9a917919b22 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 590ee39ce5734876b94d91fc3931b807 in term 0.
I20260709 13:02:06.712495  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f93b4088ce1421cb59ed9a917919b22" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6"
I20260709 13:02:06.713090  8399 raft_consensus.cc:3060] T 4f93b4088ce1421cb59ed9a917919b22 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.715124  8601 tablet_bootstrap.cc:492] T ca262e71501a4ae4a89152ec6771ffb9 P b560e9aaec7a4c78b9123b38e73519a3: No bootstrap required, opened a new log
I20260709 13:02:06.715605  8601 ts_tablet_manager.cc:1403] T ca262e71501a4ae4a89152ec6771ffb9 P b560e9aaec7a4c78b9123b38e73519a3: Time spent bootstrapping tablet: real 0.076s	user 0.011s	sys 0.002s
I20260709 13:02:06.718211  8601 raft_consensus.cc:359] T ca262e71501a4ae4a89152ec6771ffb9 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:06.718840  8601 raft_consensus.cc:385] T ca262e71501a4ae4a89152ec6771ffb9 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:06.719098  8601 raft_consensus.cc:740] T ca262e71501a4ae4a89152ec6771ffb9 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Initialized, Role: FOLLOWER
I20260709 13:02:06.719926  8601 consensus_queue.cc:260] T ca262e71501a4ae4a89152ec6771ffb9 P b560e9aaec7a4c78b9123b38e73519a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:06.677398  8598 ts_tablet_manager.cc:1434] T cca6412bb2df45b4880e711fe56d2f8d P 53a66c851dc74c70b94c65d464a391f6: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
W20260709 13:02:06.727275  8518 leader_election.cc:343] T cca6412bb2df45b4880e711fe56d2f8d P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:06.727787  8598 tablet_bootstrap.cc:492] T fcc07b65535048fca9045891e1ae0153 P 53a66c851dc74c70b94c65d464a391f6: Bootstrap starting.
I20260709 13:02:06.721685  8549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19fa9442e72f4d4697a919590110cc68" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3" is_pre_election: true
I20260709 13:02:06.728688  8396 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cca6412bb2df45b4880e711fe56d2f8d" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6"
I20260709 13:02:06.729349  8396 raft_consensus.cc:3060] T cca6412bb2df45b4880e711fe56d2f8d P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.730278  8964 consensus_queue.cc:1048] T 19fa9442e72f4d4697a919590110cc68 P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:06.731254  9026 consensus_queue.cc:1048] T a1667ac154454613a9047f56ee087405 P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:06.734897  9056 raft_consensus.cc:493] T ca262e71501a4ae4a89152ec6771ffb9 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.735410  9056 raft_consensus.cc:515] T ca262e71501a4ae4a89152ec6771ffb9 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:06.735968  8601 ts_tablet_manager.cc:1434] T ca262e71501a4ae4a89152ec6771ffb9 P b560e9aaec7a4c78b9123b38e73519a3: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 13:02:06.736105  8598 tablet_bootstrap.cc:654] T fcc07b65535048fca9045891e1ae0153 P 53a66c851dc74c70b94c65d464a391f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:06.737183  8601 tablet_bootstrap.cc:492] T 1162036be6064d5c821df6a7aa486bab P b560e9aaec7a4c78b9123b38e73519a3: Bootstrap starting.
I20260709 13:02:06.737607  9056 leader_election.cc:290] T ca262e71501a4ae4a89152ec6771ffb9 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:02:06.738668  8323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca262e71501a4ae4a89152ec6771ffb9" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
W20260709 13:02:06.738757  8295 leader_election.cc:343] T 8e53899e04fe4f58b666f67ac07bbf79 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:06.740708  8519 leader_election.cc:343] T ca262e71501a4ae4a89152ec6771ffb9 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:06.740887  8600 tablet_bootstrap.cc:492] T ca262e71501a4ae4a89152ec6771ffb9 P 590ee39ce5734876b94d91fc3931b807: No bootstrap required, opened a new log
I20260709 13:02:06.741427  8600 ts_tablet_manager.cc:1403] T ca262e71501a4ae4a89152ec6771ffb9 P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.048s	user 0.011s	sys 0.000s
I20260709 13:02:06.742506  8549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97df5fdb12a439080fa6edc391ebd82" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3" is_pre_election: true
I20260709 13:02:06.743220  8549 raft_consensus.cc:2468] T d97df5fdb12a439080fa6edc391ebd82 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53a66c851dc74c70b94c65d464a391f6 in term 0.
I20260709 13:02:06.744189  8600 raft_consensus.cc:359] T ca262e71501a4ae4a89152ec6771ffb9 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:06.744354  9056 consensus_queue.cc:1048] T 19fa9442e72f4d4697a919590110cc68 P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:06.744966  8600 raft_consensus.cc:385] T ca262e71501a4ae4a89152ec6771ffb9 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:06.745272  8600 raft_consensus.cc:740] T ca262e71501a4ae4a89152ec6771ffb9 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:06.745139  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f93b4088ce1421cb59ed9a917919b22" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3" is_pre_election: true
I20260709 13:02:06.744482  8371 leader_election.cc:304] T d97df5fdb12a439080fa6edc391ebd82 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, 590ee39ce5734876b94d91fc3931b807; no voters: 
I20260709 13:02:06.746658  8224 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41930 (request call id 66) took 1284 ms. Trace:
I20260709 13:02:06.746915  8708 raft_consensus.cc:2804] T d97df5fdb12a439080fa6edc391ebd82 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:06.747606  8708 raft_consensus.cc:493] T d97df5fdb12a439080fa6edc391ebd82 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.748042  8708 raft_consensus.cc:3060] T d97df5fdb12a439080fa6edc391ebd82 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.746928  8600 consensus_queue.cc:260] T ca262e71501a4ae4a89152ec6771ffb9 P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:06.750949  9054 raft_consensus.cc:493] T fcc07b65535048fca9045891e1ae0153 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:06.751435  9054 raft_consensus.cc:515] T fcc07b65535048fca9045891e1ae0153 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:06.753624  9054 leader_election.cc:290] T fcc07b65535048fca9045891e1ae0153 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:02:06.755059  8323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc07b65535048fca9045891e1ae0153" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
I20260709 13:02:06.755736  8323 raft_consensus.cc:2468] T fcc07b65535048fca9045891e1ae0153 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b3ea460d1294b8a82672d7c21475cb5 in term 0.
I20260709 13:02:06.757157  8445 leader_election.cc:304] T fcc07b65535048fca9045891e1ae0153 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807, 7b3ea460d1294b8a82672d7c21475cb5; no voters: 
I20260709 13:02:06.759135  9060 raft_consensus.cc:2804] T fcc07b65535048fca9045891e1ae0153 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:06.759253  8600 ts_tablet_manager.cc:1434] T ca262e71501a4ae4a89152ec6771ffb9 P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:02:06.759560  9060 raft_consensus.cc:493] T fcc07b65535048fca9045891e1ae0153 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.759935  9060 raft_consensus.cc:3060] T fcc07b65535048fca9045891e1ae0153 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.747090  8224 rpcz_store.cc:276] 0709 13:02:05.463741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.463901 (+   160us) service_pool.cc:224] Handling call
0709 13:02:06.746582 (+1282681us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:06.614086 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:06.614631 (+   545us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:06.614662 (+    31us) write_op.cc:435] Acquired schema lock
0709 13:02:06.614683 (+    21us) tablet.cc:662] Decoding operations
0709 13:02:06.615025 (+   342us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:06.615098 (+    73us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:06.615123 (+    25us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:02:06.615302 (+   179us) tablet.cc:701] Row locks acquired
0709 13:02:06.615327 (+    25us) write_op.cc:260] PREPARE: finished
0709 13:02:06.615464 (+   137us) write_op.cc:270] Start()
0709 13:02:06.615570 (+   106us) write_op.cc:276] Timestamp: P: 1783602126615424 usec, L: 0
0709 13:02:06.615589 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:02:06.616196 (+   607us) log.cc:844] Serialized 540 byte log entry
0709 13:02:06.658012 (+ 41816us) op_driver.cc:464] REPLICATION: finished
0709 13:02:06.658357 (+   345us) write_op.cc:301] APPLY: starting
0709 13:02:06.658438 (+    81us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:06.658540 (+   102us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:06.658631 (+    91us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:06.658838 (+   207us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:06.658979 (+   141us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:02:06.659018 (+    39us) write_op.cc:312] APPLY: finished
0709 13:02:06.659198 (+   180us) log.cc:844] Serialized 22 byte log entry
0709 13:02:06.659349 (+   151us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:06.659425 (+    76us) write_op.cc:454] Released schema lock
0709 13:02:06.659463 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:06.659776 (+   313us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:06.659817 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4583,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":138,"apply.run_cpu_time_us":1383,"apply.run_wall_time_us":1382,"num_ops":1,"prepare.queue_time_us":63479,"prepare.run_cpu_time_us":2369,"prepare.run_wall_time_us":2369,"replication_time_us":42291,"thread_start_us":65953,"threads_started":1}]]}
I20260709 13:02:06.724056  8476 raft_consensus.cc:2468] T cca6412bb2df45b4880e711fe56d2f8d P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 1.
I20260709 13:02:06.766557  8477 raft_consensus.cc:2468] T 8e53899e04fe4f58b666f67ac07bbf79 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 590ee39ce5734876b94d91fc3931b807 in term 1.
I20260709 13:02:06.760407  8600 tablet_bootstrap.cc:492] T 1162036be6064d5c821df6a7aa486bab P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:06.768867  8295 leader_election.cc:304] T 8e53899e04fe4f58b666f67ac07bbf79 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807, 7b3ea460d1294b8a82672d7c21475cb5; no voters: 53a66c851dc74c70b94c65d464a391f6
I20260709 13:02:06.770262  9026 raft_consensus.cc:2804] T 8e53899e04fe4f58b666f67ac07bbf79 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:06.770738  9026 raft_consensus.cc:697] T 8e53899e04fe4f58b666f67ac07bbf79 P 590ee39ce5734876b94d91fc3931b807 [term 1 LEADER]: Becoming Leader. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Running, Role: LEADER
I20260709 13:02:06.771509  8987 raft_consensus.cc:515] T c6245fdde2e4422581bc418d4840b580 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:06.771917  8553 raft_consensus.cc:2468] T 4f93b4088ce1421cb59ed9a917919b22 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 590ee39ce5734876b94d91fc3931b807 in term 1.
I20260709 13:02:06.771543  9026 consensus_queue.cc:237] T 8e53899e04fe4f58b666f67ac07bbf79 P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:06.773859  8987 leader_election.cc:290] T c6245fdde2e4422581bc418d4840b580 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 election: Requested vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:02:06.778690  8294 leader_election.cc:304] T 4f93b4088ce1421cb59ed9a917919b22 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807, b560e9aaec7a4c78b9123b38e73519a3; no voters: 
I20260709 13:02:06.779323  8399 raft_consensus.cc:2468] T 4f93b4088ce1421cb59ed9a917919b22 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 590ee39ce5734876b94d91fc3931b807 in term 1.
I20260709 13:02:06.782342  9051 raft_consensus.cc:2804] T 4f93b4088ce1421cb59ed9a917919b22 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:06.782760  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6245fdde2e4422581bc418d4840b580" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807"
I20260709 13:02:06.783443  8708 raft_consensus.cc:515] T d97df5fdb12a439080fa6edc391ebd82 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:06.782892  9051 raft_consensus.cc:697] T 4f93b4088ce1421cb59ed9a917919b22 P 590ee39ce5734876b94d91fc3931b807 [term 1 LEADER]: Becoming Leader. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Running, Role: LEADER
W20260709 13:02:06.785035  8445 leader_election.cc:343] T c6245fdde2e4422581bc418d4840b580 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:06.780318  8403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc07b65535048fca9045891e1ae0153" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:02:06.792143  8226 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:41944 (request call id 60) took 1174 ms. Trace:
I20260709 13:02:06.792654  8708 leader_election.cc:290] T d97df5fdb12a439080fa6edc391ebd82 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 election: Requested vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:02:06.791882  8228 catalog_manager.cc:5697] T a1667ac154454613a9047f56ee087405 P 590ee39ce5734876b94d91fc3931b807 reported cstate change: term changed from 0 to 1, leader changed from <none> to 590ee39ce5734876b94d91fc3931b807 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "590ee39ce5734876b94d91fc3931b807" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:06.807616  8518 leader_election.cc:304] T cca6412bb2df45b4880e711fe56d2f8d P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b3ea460d1294b8a82672d7c21475cb5, b560e9aaec7a4c78b9123b38e73519a3; no voters: 
W20260709 13:02:06.811161  8444 leader_election.cc:343] T fcc07b65535048fca9045891e1ae0153 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:06.812106  8885 raft_consensus.cc:2804] T cca6412bb2df45b4880e711fe56d2f8d P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:06.834419  8323 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97df5fdb12a439080fa6edc391ebd82" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807"
I20260709 13:02:06.817003  8396 raft_consensus.cc:2468] T cca6412bb2df45b4880e711fe56d2f8d P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 1.
I20260709 13:02:06.819861  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca262e71501a4ae4a89152ec6771ffb9" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
I20260709 13:02:06.792575  8226 rpcz_store.cc:276] 0709 13:02:05.617462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:02:05.617685 (+   223us) service_pool.cc:224] Handling call
0709 13:02:06.792089 (+1174404us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:02:06.774655 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:02:06.775177 (+   522us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:02:06.775216 (+    39us) write_op.cc:435] Acquired schema lock
0709 13:02:06.775232 (+    16us) tablet.cc:662] Decoding operations
0709 13:02:06.775558 (+   326us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:02:06.775607 (+    49us) write_op.cc:641] Partition lock acquired for write op
0709 13:02:06.775635 (+    28us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:02:06.775824 (+   189us) tablet.cc:701] Row locks acquired
0709 13:02:06.775839 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:02:06.775973 (+   134us) write_op.cc:270] Start()
0709 13:02:06.776097 (+   124us) write_op.cc:276] Timestamp: P: 1783602126775926 usec, L: 0
0709 13:02:06.776131 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 13:02:06.776753 (+   622us) log.cc:844] Serialized 540 byte log entry
0709 13:02:06.778419 (+  1666us) op_driver.cc:464] REPLICATION: finished
0709 13:02:06.779791 (+  1372us) write_op.cc:301] APPLY: starting
0709 13:02:06.779953 (+   162us) tablet.cc:1367] starting BulkCheckPresence
0709 13:02:06.780089 (+   136us) tablet.cc:1370] finished BulkCheckPresence
0709 13:02:06.780187 (+    98us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:02:06.780375 (+   188us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:02:06.780552 (+   177us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:02:06.780602 (+    50us) write_op.cc:312] APPLY: finished
0709 13:02:06.780778 (+   176us) log.cc:844] Serialized 22 byte log entry
0709 13:02:06.780949 (+   171us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:06.781034 (+    85us) write_op.cc:454] Released schema lock
0709 13:02:06.781072 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 13:02:06.781365 (+   293us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:02:06.781393 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4913,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":1181,"apply.run_cpu_time_us":1556,"apply.run_wall_time_us":1557,"num_ops":1,"prepare.queue_time_us":83960,"prepare.run_cpu_time_us":2390,"prepare.run_wall_time_us":2390,"replication_time_us":2184}]]}
I20260709 13:02:06.843122  8323 raft_consensus.cc:3060] T d97df5fdb12a439080fa6edc391ebd82 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.851821  8553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6245fdde2e4422581bc418d4840b580" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3"
I20260709 13:02:06.841771  9051 consensus_queue.cc:237] T 4f93b4088ce1421cb59ed9a917919b22 P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:06.858946  9060 raft_consensus.cc:515] T fcc07b65535048fca9045891e1ae0153 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:06.850807  8369 leader_election.cc:304] T 19fa9442e72f4d4697a919590110cc68 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6; no voters: 7b3ea460d1294b8a82672d7c21475cb5, b560e9aaec7a4c78b9123b38e73519a3
I20260709 13:02:06.849421  8476 raft_consensus.cc:2468] T ca262e71501a4ae4a89152ec6771ffb9 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 0.
I20260709 13:02:06.852658  8601 tablet_bootstrap.cc:654] T 1162036be6064d5c821df6a7aa486bab P b560e9aaec7a4c78b9123b38e73519a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:06.879818  8369 leader_election.cc:304] T 4f93b4088ce1421cb59ed9a917919b22 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6; no voters: 590ee39ce5734876b94d91fc3931b807, b560e9aaec7a4c78b9123b38e73519a3
I20260709 13:02:06.872102  8553 raft_consensus.cc:3060] T c6245fdde2e4422581bc418d4840b580 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.882264  9045 raft_consensus.cc:2749] T 4f93b4088ce1421cb59ed9a917919b22 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:06.890673  8600 tablet_bootstrap.cc:654] T 1162036be6064d5c821df6a7aa486bab P 590ee39ce5734876b94d91fc3931b807: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:06.891606  8518 leader_election.cc:304] T ca262e71501a4ae4a89152ec6771ffb9 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b3ea460d1294b8a82672d7c21475cb5, b560e9aaec7a4c78b9123b38e73519a3; no voters: 590ee39ce5734876b94d91fc3931b807
I20260709 13:02:06.903963  8598 tablet_bootstrap.cc:492] T fcc07b65535048fca9045891e1ae0153 P 53a66c851dc74c70b94c65d464a391f6: No bootstrap required, opened a new log
I20260709 13:02:06.904461  8598 ts_tablet_manager.cc:1403] T fcc07b65535048fca9045891e1ae0153 P 53a66c851dc74c70b94c65d464a391f6: Time spent bootstrapping tablet: real 0.177s	user 0.027s	sys 0.012s
I20260709 13:02:06.897416  8958 raft_consensus.cc:2804] T ca262e71501a4ae4a89152ec6771ffb9 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:06.896292  8553 raft_consensus.cc:2468] T c6245fdde2e4422581bc418d4840b580 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b3ea460d1294b8a82672d7c21475cb5 in term 1.
I20260709 13:02:06.896519  8885 raft_consensus.cc:697] T cca6412bb2df45b4880e711fe56d2f8d P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Becoming Leader. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Running, Role: LEADER
I20260709 13:02:06.918556  8885 consensus_queue.cc:237] T cca6412bb2df45b4880e711fe56d2f8d P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:06.914371  8958 raft_consensus.cc:493] T ca262e71501a4ae4a89152ec6771ffb9 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:06.921027  8958 raft_consensus.cc:3060] T ca262e71501a4ae4a89152ec6771ffb9 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.925962  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97df5fdb12a439080fa6edc391ebd82" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3"
I20260709 13:02:06.926465  9058 raft_consensus.cc:2749] T 19fa9442e72f4d4697a919590110cc68 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:06.926766  8546 raft_consensus.cc:3060] T d97df5fdb12a439080fa6edc391ebd82 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.929526  9060 leader_election.cc:290] T fcc07b65535048fca9045891e1ae0153 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 election: Requested vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:02:06.931659  8328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc07b65535048fca9045891e1ae0153" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807"
I20260709 13:02:06.932367  8328 raft_consensus.cc:3060] T fcc07b65535048fca9045891e1ae0153 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.934687  8598 raft_consensus.cc:359] T fcc07b65535048fca9045891e1ae0153 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:06.935405  8598 raft_consensus.cc:385] T fcc07b65535048fca9045891e1ae0153 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:06.935667  8598 raft_consensus.cc:740] T fcc07b65535048fca9045891e1ae0153 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Initialized, Role: FOLLOWER
I20260709 13:02:06.936241  8598 consensus_queue.cc:260] T fcc07b65535048fca9045891e1ae0153 P 53a66c851dc74c70b94c65d464a391f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:06.940469  8323 raft_consensus.cc:2468] T d97df5fdb12a439080fa6edc391ebd82 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53a66c851dc74c70b94c65d464a391f6 in term 1.
I20260709 13:02:06.959471  8328 raft_consensus.cc:2468] T fcc07b65535048fca9045891e1ae0153 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b3ea460d1294b8a82672d7c21475cb5 in term 1.
I20260709 13:02:06.962235  8443 leader_election.cc:304] T c6245fdde2e4422581bc418d4840b580 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b3ea460d1294b8a82672d7c21475cb5, b560e9aaec7a4c78b9123b38e73519a3; no voters: 590ee39ce5734876b94d91fc3931b807
I20260709 13:02:06.965481  8445 leader_election.cc:304] T fcc07b65535048fca9045891e1ae0153 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807, 7b3ea460d1294b8a82672d7c21475cb5; no voters: 
I20260709 13:02:06.966491  9048 raft_consensus.cc:2804] T c6245fdde2e4422581bc418d4840b580 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:06.966598  9060 raft_consensus.cc:2804] T fcc07b65535048fca9045891e1ae0153 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:06.967058  9048 raft_consensus.cc:697] T c6245fdde2e4422581bc418d4840b580 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 LEADER]: Becoming Leader. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Running, Role: LEADER
I20260709 13:02:06.967394  9060 raft_consensus.cc:697] T fcc07b65535048fca9045891e1ae0153 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 LEADER]: Becoming Leader. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Running, Role: LEADER
I20260709 13:02:06.968072  9048 consensus_queue.cc:237] T c6245fdde2e4422581bc418d4840b580 P 7b3ea460d1294b8a82672d7c21475cb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:06.969025  9060 consensus_queue.cc:237] T fcc07b65535048fca9045891e1ae0153 P 7b3ea460d1294b8a82672d7c21475cb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:06.945343  8598 ts_tablet_manager.cc:1434] T fcc07b65535048fca9045891e1ae0153 P 53a66c851dc74c70b94c65d464a391f6: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.000s
I20260709 13:02:06.982187  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fcc07b65535048fca9045891e1ae0153" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6"
I20260709 13:02:06.982899  8398 raft_consensus.cc:3060] T fcc07b65535048fca9045891e1ae0153 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:06.990535  8546 raft_consensus.cc:2468] T d97df5fdb12a439080fa6edc391ebd82 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53a66c851dc74c70b94c65d464a391f6 in term 1.
I20260709 13:02:07.002301  8369 leader_election.cc:304] T d97df5fdb12a439080fa6edc391ebd82 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, b560e9aaec7a4c78b9123b38e73519a3; no voters: 
I20260709 13:02:07.003279  9045 raft_consensus.cc:2804] T d97df5fdb12a439080fa6edc391ebd82 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:07.004148  9045 raft_consensus.cc:697] T d97df5fdb12a439080fa6edc391ebd82 P 53a66c851dc74c70b94c65d464a391f6 [term 1 LEADER]: Becoming Leader. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Running, Role: LEADER
I20260709 13:02:07.005055  9045 consensus_queue.cc:237] T d97df5fdb12a439080fa6edc391ebd82 P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:07.012683  8958 raft_consensus.cc:515] T ca262e71501a4ae4a89152ec6771ffb9 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:07.008600  8398 raft_consensus.cc:2468] T fcc07b65535048fca9045891e1ae0153 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b3ea460d1294b8a82672d7c21475cb5 in term 1.
I20260709 13:02:07.032356  8600 tablet_bootstrap.cc:492] T 1162036be6064d5c821df6a7aa486bab P 590ee39ce5734876b94d91fc3931b807: No bootstrap required, opened a new log
I20260709 13:02:07.032948  8600 ts_tablet_manager.cc:1403] T 1162036be6064d5c821df6a7aa486bab P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.273s	user 0.014s	sys 0.000s
I20260709 13:02:07.058456  8598 tablet_bootstrap.cc:492] T 8e53899e04fe4f58b666f67ac07bbf79 P 53a66c851dc74c70b94c65d464a391f6: Bootstrap starting.
I20260709 13:02:07.063861  8601 tablet_bootstrap.cc:492] T 1162036be6064d5c821df6a7aa486bab P b560e9aaec7a4c78b9123b38e73519a3: No bootstrap required, opened a new log
I20260709 13:02:07.064411  8601 ts_tablet_manager.cc:1403] T 1162036be6064d5c821df6a7aa486bab P b560e9aaec7a4c78b9123b38e73519a3: Time spent bootstrapping tablet: real 0.328s	user 0.012s	sys 0.017s
I20260709 13:02:07.067281  8601 raft_consensus.cc:359] T 1162036be6064d5c821df6a7aa486bab P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:07.068017  8601 raft_consensus.cc:385] T 1162036be6064d5c821df6a7aa486bab P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.068289  8601 raft_consensus.cc:740] T 1162036be6064d5c821df6a7aa486bab P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.069399  8601 consensus_queue.cc:260] T 1162036be6064d5c821df6a7aa486bab P b560e9aaec7a4c78b9123b38e73519a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:07.073062  8598 tablet_bootstrap.cc:654] T 8e53899e04fe4f58b666f67ac07bbf79 P 53a66c851dc74c70b94c65d464a391f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.073652  8228 catalog_manager.cc:5697] T 4f93b4088ce1421cb59ed9a917919b22 P 590ee39ce5734876b94d91fc3931b807 reported cstate change: term changed from 0 to 1, leader changed from <none> to 590ee39ce5734876b94d91fc3931b807 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "590ee39ce5734876b94d91fc3931b807" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:07.077807  8228 catalog_manager.cc:5697] T 8e53899e04fe4f58b666f67ac07bbf79 P 590ee39ce5734876b94d91fc3931b807 reported cstate change: term changed from 0 to 1, leader changed from <none> to 590ee39ce5734876b94d91fc3931b807 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "590ee39ce5734876b94d91fc3931b807" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:07.114704  8601 ts_tablet_manager.cc:1434] T 1162036be6064d5c821df6a7aa486bab P b560e9aaec7a4c78b9123b38e73519a3: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.000s
I20260709 13:02:07.118575  8958 leader_election.cc:290] T ca262e71501a4ae4a89152ec6771ffb9 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 election: Requested vote from peers 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:02:07.115962  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca262e71501a4ae4a89152ec6771ffb9" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5"
I20260709 13:02:07.121696  8476 raft_consensus.cc:3060] T ca262e71501a4ae4a89152ec6771ffb9 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.124426  8600 raft_consensus.cc:359] T 1162036be6064d5c821df6a7aa486bab P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:07.129350  8600 raft_consensus.cc:385] T 1162036be6064d5c821df6a7aa486bab P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.129730  8600 raft_consensus.cc:740] T 1162036be6064d5c821df6a7aa486bab P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.131579  8601 tablet_bootstrap.cc:492] T ef35fbe0cee64967ab342c52aa0b1ac1 P b560e9aaec7a4c78b9123b38e73519a3: Bootstrap starting.
I20260709 13:02:07.130636  8600 consensus_queue.cc:260] T 1162036be6064d5c821df6a7aa486bab P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:07.138464  8600 ts_tablet_manager.cc:1434] T 1162036be6064d5c821df6a7aa486bab P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.105s	user 0.009s	sys 0.000s
I20260709 13:02:07.140326  8959 raft_consensus.cc:493] T 1162036be6064d5c821df6a7aa486bab P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:07.148909  9079 log.cc:927] Time spent T 4f93b4088ce1421cb59ed9a917919b22 P 590ee39ce5734876b94d91fc3931b807: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 13:02:07.151337  8600 tablet_bootstrap.cc:492] T ef35fbe0cee64967ab342c52aa0b1ac1 P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:07.159466  8476 raft_consensus.cc:2468] T ca262e71501a4ae4a89152ec6771ffb9 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 1.
I20260709 13:02:07.152871  8959 raft_consensus.cc:515] T 1162036be6064d5c821df6a7aa486bab P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:07.162984  8959 leader_election.cc:290] T 1162036be6064d5c821df6a7aa486bab P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:02:07.175164  8601 tablet_bootstrap.cc:654] T ef35fbe0cee64967ab342c52aa0b1ac1 P b560e9aaec7a4c78b9123b38e73519a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.175064  8518 leader_election.cc:304] T ca262e71501a4ae4a89152ec6771ffb9 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b3ea460d1294b8a82672d7c21475cb5, b560e9aaec7a4c78b9123b38e73519a3; no voters: 
I20260709 13:02:07.193364  8885 raft_consensus.cc:2804] T ca262e71501a4ae4a89152ec6771ffb9 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:07.193996  8885 raft_consensus.cc:697] T ca262e71501a4ae4a89152ec6771ffb9 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Becoming Leader. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Running, Role: LEADER
I20260709 13:02:07.195066  8885 consensus_queue.cc:237] T ca262e71501a4ae4a89152ec6771ffb9 P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:07.177958  8600 tablet_bootstrap.cc:654] T ef35fbe0cee64967ab342c52aa0b1ac1 P 590ee39ce5734876b94d91fc3931b807: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.179322  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca262e71501a4ae4a89152ec6771ffb9" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807"
I20260709 13:02:07.197633  8329 raft_consensus.cc:3060] T ca262e71501a4ae4a89152ec6771ffb9 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.198098  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1162036be6064d5c821df6a7aa486bab" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
W20260709 13:02:07.199790  8518 leader_election.cc:343] T 1162036be6064d5c821df6a7aa486bab P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.180056  8324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1162036be6064d5c821df6a7aa486bab" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
I20260709 13:02:07.201361  8324 raft_consensus.cc:2468] T 1162036be6064d5c821df6a7aa486bab P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 0.
I20260709 13:02:07.203713  8519 leader_election.cc:304] T 1162036be6064d5c821df6a7aa486bab P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807, b560e9aaec7a4c78b9123b38e73519a3; no voters: 53a66c851dc74c70b94c65d464a391f6
I20260709 13:02:07.204573  9073 raft_consensus.cc:2804] T 1162036be6064d5c821df6a7aa486bab P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:07.204972  9073 raft_consensus.cc:493] T 1162036be6064d5c821df6a7aa486bab P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.205314  9073 raft_consensus.cc:3060] T 1162036be6064d5c821df6a7aa486bab P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.207161  8601 tablet_bootstrap.cc:492] T ef35fbe0cee64967ab342c52aa0b1ac1 P b560e9aaec7a4c78b9123b38e73519a3: No bootstrap required, opened a new log
I20260709 13:02:07.207662  8601 ts_tablet_manager.cc:1403] T ef35fbe0cee64967ab342c52aa0b1ac1 P b560e9aaec7a4c78b9123b38e73519a3: Time spent bootstrapping tablet: real 0.078s	user 0.007s	sys 0.003s
I20260709 13:02:07.207939  9057 consensus_queue.cc:1048] T 8e53899e04fe4f58b666f67ac07bbf79 P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:07.215094  8329 raft_consensus.cc:2468] T ca262e71501a4ae4a89152ec6771ffb9 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 1.
I20260709 13:02:07.216907  9073 raft_consensus.cc:515] T 1162036be6064d5c821df6a7aa486bab P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:07.219515  9073 leader_election.cc:290] T 1162036be6064d5c821df6a7aa486bab P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 election: Requested vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:02:07.222862  8601 raft_consensus.cc:359] T ef35fbe0cee64967ab342c52aa0b1ac1 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:07.223168  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1162036be6064d5c821df6a7aa486bab" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6"
I20260709 13:02:07.223628  8601 raft_consensus.cc:385] T ef35fbe0cee64967ab342c52aa0b1ac1 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.223981  8601 raft_consensus.cc:740] T ef35fbe0cee64967ab342c52aa0b1ac1 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Initialized, Role: FOLLOWER
W20260709 13:02:07.225086  8518 leader_election.cc:343] T 1162036be6064d5c821df6a7aa486bab P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:07.227376  8601 consensus_queue.cc:260] T ef35fbe0cee64967ab342c52aa0b1ac1 P b560e9aaec7a4c78b9123b38e73519a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:07.234800  8226 catalog_manager.cc:5697] T 19fa9442e72f4d4697a919590110cc68 P 53a66c851dc74c70b94c65d464a391f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "b560e9aaec7a4c78b9123b38e73519a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } }
W20260709 13:02:07.240399  8276 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:07.243103  8601 ts_tablet_manager.cc:1434] T ef35fbe0cee64967ab342c52aa0b1ac1 P b560e9aaec7a4c78b9123b38e73519a3: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 13:02:07.245316  8329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1162036be6064d5c821df6a7aa486bab" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807"
I20260709 13:02:07.246393  8329 raft_consensus.cc:3060] T 1162036be6064d5c821df6a7aa486bab P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.254168  8329 raft_consensus.cc:2468] T 1162036be6064d5c821df6a7aa486bab P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 1.
I20260709 13:02:07.255465  8600 tablet_bootstrap.cc:492] T ef35fbe0cee64967ab342c52aa0b1ac1 P 590ee39ce5734876b94d91fc3931b807: No bootstrap required, opened a new log
I20260709 13:02:07.255497  8598 tablet_bootstrap.cc:492] T 8e53899e04fe4f58b666f67ac07bbf79 P 53a66c851dc74c70b94c65d464a391f6: No bootstrap required, opened a new log
I20260709 13:02:07.256107  8600 ts_tablet_manager.cc:1403] T ef35fbe0cee64967ab342c52aa0b1ac1 P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.114s	user 0.012s	sys 0.000s
I20260709 13:02:07.256294  8598 ts_tablet_manager.cc:1403] T 8e53899e04fe4f58b666f67ac07bbf79 P 53a66c851dc74c70b94c65d464a391f6: Time spent bootstrapping tablet: real 0.198s	user 0.024s	sys 0.008s
I20260709 13:02:07.258219  8519 leader_election.cc:304] T 1162036be6064d5c821df6a7aa486bab P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807, b560e9aaec7a4c78b9123b38e73519a3; no voters: 53a66c851dc74c70b94c65d464a391f6
I20260709 13:02:07.259608  8600 raft_consensus.cc:359] T ef35fbe0cee64967ab342c52aa0b1ac1 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:07.259896  8598 raft_consensus.cc:359] T 8e53899e04fe4f58b666f67ac07bbf79 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:07.260444  8600 raft_consensus.cc:385] T ef35fbe0cee64967ab342c52aa0b1ac1 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.260797  8598 raft_consensus.cc:385] T 8e53899e04fe4f58b666f67ac07bbf79 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.260811  8600 raft_consensus.cc:740] T ef35fbe0cee64967ab342c52aa0b1ac1 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.261348  8598 raft_consensus.cc:740] T 8e53899e04fe4f58b666f67ac07bbf79 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.261771  8600 consensus_queue.cc:260] T ef35fbe0cee64967ab342c52aa0b1ac1 P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:07.262354  8598 consensus_queue.cc:260] T 8e53899e04fe4f58b666f67ac07bbf79 P 53a66c851dc74c70b94c65d464a391f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:07.262975  9056 raft_consensus.cc:2804] T 1162036be6064d5c821df6a7aa486bab P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:07.263522  9056 raft_consensus.cc:697] T 1162036be6064d5c821df6a7aa486bab P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Becoming Leader. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Running, Role: LEADER
I20260709 13:02:07.264113  8600 ts_tablet_manager.cc:1434] T ef35fbe0cee64967ab342c52aa0b1ac1 P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:02:07.264314  9056 consensus_queue.cc:237] T 1162036be6064d5c821df6a7aa486bab P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:07.265231  8600 tablet_bootstrap.cc:492] T c6245fdde2e4422581bc418d4840b580 P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:07.271543  8598 ts_tablet_manager.cc:1434] T 8e53899e04fe4f58b666f67ac07bbf79 P 53a66c851dc74c70b94c65d464a391f6: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:02:07.271987  8398 raft_consensus.cc:3060] T 8e53899e04fe4f58b666f67ac07bbf79 P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.282677  9047 consensus_queue.cc:1048] T 4f93b4088ce1421cb59ed9a917919b22 P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:07.284088  8598 tablet_bootstrap.cc:492] T 1162036be6064d5c821df6a7aa486bab P 53a66c851dc74c70b94c65d464a391f6: Bootstrap starting.
I20260709 13:02:07.291517  8598 tablet_bootstrap.cc:654] T 1162036be6064d5c821df6a7aa486bab P 53a66c851dc74c70b94c65d464a391f6: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.299376  9027 consensus_queue.cc:1048] T 8e53899e04fe4f58b666f67ac07bbf79 P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:07.309692  8600 tablet_bootstrap.cc:654] T c6245fdde2e4422581bc418d4840b580 P 590ee39ce5734876b94d91fc3931b807: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:07.310321  8224 catalog_manager.cc:5697] T fcc07b65535048fca9045891e1ae0153 P 7b3ea460d1294b8a82672d7c21475cb5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "7b3ea460d1294b8a82672d7c21475cb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:07.336488  8224 catalog_manager.cc:5697] T c6245fdde2e4422581bc418d4840b580 P 7b3ea460d1294b8a82672d7c21475cb5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "7b3ea460d1294b8a82672d7c21475cb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:07.375895  8959 consensus_queue.cc:1048] T cca6412bb2df45b4880e711fe56d2f8d P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:07.362082  9027 consensus_queue.cc:1048] T 4f93b4088ce1421cb59ed9a917919b22 P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 13:02:07.417585  8600 tablet_bootstrap.cc:492] T c6245fdde2e4422581bc418d4840b580 P 590ee39ce5734876b94d91fc3931b807: No bootstrap required, opened a new log
I20260709 13:02:07.418111  8600 ts_tablet_manager.cc:1403] T c6245fdde2e4422581bc418d4840b580 P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.153s	user 0.021s	sys 0.019s
I20260709 13:02:07.420933  8600 raft_consensus.cc:359] T c6245fdde2e4422581bc418d4840b580 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:07.421598  8600 raft_consensus.cc:385] T c6245fdde2e4422581bc418d4840b580 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.421855  8600 raft_consensus.cc:740] T c6245fdde2e4422581bc418d4840b580 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.422530  8600 consensus_queue.cc:260] T c6245fdde2e4422581bc418d4840b580 P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:07.424904  8600 ts_tablet_manager.cc:1434] T c6245fdde2e4422581bc418d4840b580 P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:02:07.428818  8821 consensus_queue.cc:1048] T c6245fdde2e4422581bc418d4840b580 P 7b3ea460d1294b8a82672d7c21475cb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:07.439687  9056 consensus_queue.cc:1048] T cca6412bb2df45b4880e711fe56d2f8d P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:07.444234  8225 catalog_manager.cc:5697] T cca6412bb2df45b4880e711fe56d2f8d P b560e9aaec7a4c78b9123b38e73519a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "b560e9aaec7a4c78b9123b38e73519a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:07.468169  8598 tablet_bootstrap.cc:492] T 1162036be6064d5c821df6a7aa486bab P 53a66c851dc74c70b94c65d464a391f6: No bootstrap required, opened a new log
I20260709 13:02:07.468770  8598 ts_tablet_manager.cc:1403] T 1162036be6064d5c821df6a7aa486bab P 53a66c851dc74c70b94c65d464a391f6: Time spent bootstrapping tablet: real 0.185s	user 0.015s	sys 0.020s
I20260709 13:02:07.491652  8598 raft_consensus.cc:359] T 1162036be6064d5c821df6a7aa486bab P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:07.492401  8598 raft_consensus.cc:385] T 1162036be6064d5c821df6a7aa486bab P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:07.492690  8598 raft_consensus.cc:740] T 1162036be6064d5c821df6a7aa486bab P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Initialized, Role: FOLLOWER
I20260709 13:02:07.493321  8598 consensus_queue.cc:260] T 1162036be6064d5c821df6a7aa486bab P 53a66c851dc74c70b94c65d464a391f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:07.501470  8323 raft_consensus.cc:3060] T c6245fdde2e4422581bc418d4840b580 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.504331  9073 raft_consensus.cc:493] T ef35fbe0cee64967ab342c52aa0b1ac1 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.504956  9073 raft_consensus.cc:515] T ef35fbe0cee64967ab342c52aa0b1ac1 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:07.507685  8477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef35fbe0cee64967ab342c52aa0b1ac1" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
I20260709 13:02:07.508672  9073 leader_election.cc:290] T ef35fbe0cee64967ab342c52aa0b1ac1 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:02:07.508309  8477 raft_consensus.cc:2468] T ef35fbe0cee64967ab342c52aa0b1ac1 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 0.
I20260709 13:02:07.509927  8324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef35fbe0cee64967ab342c52aa0b1ac1" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
I20260709 13:02:07.510167  8518 leader_election.cc:304] T ef35fbe0cee64967ab342c52aa0b1ac1 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b3ea460d1294b8a82672d7c21475cb5, b560e9aaec7a4c78b9123b38e73519a3; no voters: 
I20260709 13:02:07.510618  8324 raft_consensus.cc:2468] T ef35fbe0cee64967ab342c52aa0b1ac1 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 0.
I20260709 13:02:07.511466  9073 raft_consensus.cc:2804] T ef35fbe0cee64967ab342c52aa0b1ac1 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:07.511866  9073 raft_consensus.cc:493] T ef35fbe0cee64967ab342c52aa0b1ac1 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:07.512151  8598 ts_tablet_manager.cc:1434] T 1162036be6064d5c821df6a7aa486bab P 53a66c851dc74c70b94c65d464a391f6: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.000s
I20260709 13:02:07.512176  9073 raft_consensus.cc:3060] T ef35fbe0cee64967ab342c52aa0b1ac1 P b560e9aaec7a4c78b9123b38e73519a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.512506  8888 consensus_queue.cc:1048] T c6245fdde2e4422581bc418d4840b580 P 7b3ea460d1294b8a82672d7c21475cb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:02:07.527118  8987 consensus_queue.cc:1048] T fcc07b65535048fca9045891e1ae0153 P 7b3ea460d1294b8a82672d7c21475cb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:07.523022  8708 consensus_queue.cc:1048] T d97df5fdb12a439080fa6edc391ebd82 P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:02:07.540938  8228 catalog_manager.cc:5697] T d97df5fdb12a439080fa6edc391ebd82 P 53a66c851dc74c70b94c65d464a391f6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "53a66c851dc74c70b94c65d464a391f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:07.541503  8708 consensus_queue.cc:1048] T d97df5fdb12a439080fa6edc391ebd82 P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:07.532505  9073 raft_consensus.cc:515] T ef35fbe0cee64967ab342c52aa0b1ac1 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:07.548702  9073 leader_election.cc:290] T ef35fbe0cee64967ab342c52aa0b1ac1 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 election: Requested vote from peers 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:02:07.549506  8477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef35fbe0cee64967ab342c52aa0b1ac1" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5"
I20260709 13:02:07.550176  8477 raft_consensus.cc:3060] T ef35fbe0cee64967ab342c52aa0b1ac1 P 7b3ea460d1294b8a82672d7c21475cb5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.552084  8326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef35fbe0cee64967ab342c52aa0b1ac1" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807"
I20260709 13:02:07.552815  8326 raft_consensus.cc:3060] T ef35fbe0cee64967ab342c52aa0b1ac1 P 590ee39ce5734876b94d91fc3931b807 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.557737  8477 raft_consensus.cc:2468] T ef35fbe0cee64967ab342c52aa0b1ac1 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 1.
I20260709 13:02:07.563680  8518 leader_election.cc:304] T ef35fbe0cee64967ab342c52aa0b1ac1 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b3ea460d1294b8a82672d7c21475cb5, b560e9aaec7a4c78b9123b38e73519a3; no voters: 
I20260709 13:02:07.564488  9075 raft_consensus.cc:2804] T ef35fbe0cee64967ab342c52aa0b1ac1 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:07.564749  8888 consensus_queue.cc:1048] T fcc07b65535048fca9045891e1ae0153 P 7b3ea460d1294b8a82672d7c21475cb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:07.565449  9075 raft_consensus.cc:697] T ef35fbe0cee64967ab342c52aa0b1ac1 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Becoming Leader. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Running, Role: LEADER
I20260709 13:02:07.566370  9075 consensus_queue.cc:237] T ef35fbe0cee64967ab342c52aa0b1ac1 P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:07.568133  8326 raft_consensus.cc:2468] T ef35fbe0cee64967ab342c52aa0b1ac1 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 1.
I20260709 13:02:07.681090  8228 catalog_manager.cc:5697] T ef35fbe0cee64967ab342c52aa0b1ac1 P b560e9aaec7a4c78b9123b38e73519a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "b560e9aaec7a4c78b9123b38e73519a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:07.683920  8228 catalog_manager.cc:5697] T ca262e71501a4ae4a89152ec6771ffb9 P b560e9aaec7a4c78b9123b38e73519a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "b560e9aaec7a4c78b9123b38e73519a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:07.686239  8228 catalog_manager.cc:5697] T 1162036be6064d5c821df6a7aa486bab P b560e9aaec7a4c78b9123b38e73519a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196). New cstate: current_term: 1 leader_uuid: "b560e9aaec7a4c78b9123b38e73519a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:07.725559  9056 consensus_queue.cc:1048] T ca262e71501a4ae4a89152ec6771ffb9 P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:07.739732  9075 consensus_queue.cc:1048] T ca262e71501a4ae4a89152ec6771ffb9 P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:07.779107  8708 raft_consensus.cc:493] T 1162036be6064d5c821df6a7aa486bab P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:07.779593  8708 raft_consensus.cc:515] T 1162036be6064d5c821df6a7aa486bab P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:07.781481  8708 leader_election.cc:290] T 1162036be6064d5c821df6a7aa486bab P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:02:07.783177  8549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1162036be6064d5c821df6a7aa486bab" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3" is_pre_election: true
I20260709 13:02:07.783625  8324 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1162036be6064d5c821df6a7aa486bab" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "590ee39ce5734876b94d91fc3931b807" is_pre_election: true
I20260709 13:02:07.784546  8324 raft_consensus.cc:2393] T 1162036be6064d5c821df6a7aa486bab P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 53a66c851dc74c70b94c65d464a391f6 in current term 1: Already voted for candidate b560e9aaec7a4c78b9123b38e73519a3 in this term.
I20260709 13:02:07.785606  8371 leader_election.cc:304] T 1162036be6064d5c821df6a7aa486bab P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6; no voters: 590ee39ce5734876b94d91fc3931b807, b560e9aaec7a4c78b9123b38e73519a3
I20260709 13:02:07.786938  8708 raft_consensus.cc:3060] T 1162036be6064d5c821df6a7aa486bab P 53a66c851dc74c70b94c65d464a391f6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:07.792831  8708 raft_consensus.cc:2749] T 1162036be6064d5c821df6a7aa486bab P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:07.824345  8885 consensus_queue.cc:1048] T 1162036be6064d5c821df6a7aa486bab P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:07.842638  9056 consensus_queue.cc:1048] T 1162036be6064d5c821df6a7aa486bab P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:07.977662  8885 consensus_queue.cc:1048] T ef35fbe0cee64967ab342c52aa0b1ac1 P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:07.988952  9073 consensus_queue.cc:1048] T ef35fbe0cee64967ab342c52aa0b1ac1 P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:09.308825   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 13:02:09.311126  8519 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:02:09.315107  8519 consensus_peers.cc:597] T b574d11894634755bd89c530b4155f1e P b560e9aaec7a4c78b9123b38e73519a3 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:09.323242  8371 consensus_peers.cc:597] T 5527a2aef01d45cebcfad8a1b0a5273d P 53a66c851dc74c70b94c65d464a391f6 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:09.323982  8371 consensus_peers.cc:597] T a3a46de7366f4683a88d19d25ad04901 P 53a66c851dc74c70b94c65d464a391f6 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:09.334533  8371 consensus_peers.cc:597] T cea53371e56d4a668406dcd8f5a93dcb P 53a66c851dc74c70b94c65d464a391f6 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:09.367936  8371 consensus_peers.cc:597] T e1f344d27b0b44819ef6d23574175c26 P 53a66c851dc74c70b94c65d464a391f6 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:09.370500  8445 consensus_peers.cc:597] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P 7b3ea460d1294b8a82672d7c21475cb5 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:09.371150  8445 consensus_peers.cc:597] T d4cd925acef04f3c8910aa1903b760c7 P 7b3ea460d1294b8a82672d7c21475cb5 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:09.371289   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:09.372246   431 tablet_replica.cc:333] T c6245fdde2e4422581bc418d4840b580 P 590ee39ce5734876b94d91fc3931b807: stopping tablet replica
I20260709 13:02:09.373692   431 raft_consensus.cc:2243] T c6245fdde2e4422581bc418d4840b580 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:09.374243   431 raft_consensus.cc:2272] T c6245fdde2e4422581bc418d4840b580 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:09.375548  8445 consensus_peers.cc:597] T 6fffc940549b445c973a289ba1bebcb3 P 7b3ea460d1294b8a82672d7c21475cb5 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:09.377517   431 tablet_replica.cc:333] T fcc07b65535048fca9045891e1ae0153 P 590ee39ce5734876b94d91fc3931b807: stopping tablet replica
I20260709 13:02:09.378378   431 raft_consensus.cc:2243] T fcc07b65535048fca9045891e1ae0153 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:09.378835   431 raft_consensus.cc:2272] T fcc07b65535048fca9045891e1ae0153 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:09.380795  8519 consensus_peers.cc:597] T 69ef277bbcbd41d8a10ae92d9a63145e P b560e9aaec7a4c78b9123b38e73519a3 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:09.381192   431 tablet_replica.cc:333] T d97df5fdb12a439080fa6edc391ebd82 P 590ee39ce5734876b94d91fc3931b807: stopping tablet replica
I20260709 13:02:09.381871   431 raft_consensus.cc:2243] T d97df5fdb12a439080fa6edc391ebd82 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:09.382298   431 raft_consensus.cc:2272] T d97df5fdb12a439080fa6edc391ebd82 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:09.384130   431 tablet_replica.cc:333] T 4f93b4088ce1421cb59ed9a917919b22 P 590ee39ce5734876b94d91fc3931b807: stopping tablet replica
I20260709 13:02:09.384784   431 raft_consensus.cc:2243] T 4f93b4088ce1421cb59ed9a917919b22 P 590ee39ce5734876b94d91fc3931b807 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:09.385546   431 raft_consensus.cc:2272] T 4f93b4088ce1421cb59ed9a917919b22 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:09.387250   431 tablet_replica.cc:333] T d4cd925acef04f3c8910aa1903b760c7 P 590ee39ce5734876b94d91fc3931b807: stopping tablet replica
I20260709 13:02:09.387837   431 raft_consensus.cc:2243] T d4cd925acef04f3c8910aa1903b760c7 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:09.388247   431 raft_consensus.cc:2272] T d4cd925acef04f3c8910aa1903b760c7 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:09.390062   431 tablet_replica.cc:333] T a1667ac154454613a9047f56ee087405 P 590ee39ce5734876b94d91fc3931b807: stopping tablet replica
I20260709 13:02:09.390697   431 raft_consensus.cc:2243] T a1667ac154454613a9047f56ee087405 P 590ee39ce5734876b94d91fc3931b807 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:09.391439   431 raft_consensus.cc:2272] T a1667ac154454613a9047f56ee087405 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:09.393214   431 tablet_replica.cc:333] T b1d8e928d8444f77ac2950eab2115f65 P 590ee39ce5734876b94d91fc3931b807: stopping tablet replica
I20260709 13:02:09.393829   431 raft_consensus.cc:2243] T b1d8e928d8444f77ac2950eab2115f65 P 590ee39ce5734876b94d91fc3931b807 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:09.394590   431 raft_consensus.cc:2272] T b1d8e928d8444f77ac2950eab2115f65 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:09.396649   431 tablet_replica.cc:333] T b574d11894634755bd89c530b4155f1e P 590ee39ce5734876b94d91fc3931b807: stopping tablet replica
I20260709 13:02:09.397416   431 raft_consensus.cc:2243] T b574d11894634755bd89c530b4155f1e P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:09.398025   431 raft_consensus.cc:2272] T b574d11894634755bd89c530b4155f1e P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:09.398664  8445 consensus_peers.cc:597] T e8353e508def43e5a8008bb63ff1a84a P 7b3ea460d1294b8a82672d7c21475cb5 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:09.400231   431 tablet_replica.cc:333] T da02fa98f6de48a7baefadf6e69d2046 P 590ee39ce5734876b94d91fc3931b807: stopping tablet replica
I20260709 13:02:09.400951   431 raft_consensus.cc:2243] T da02fa98f6de48a7baefadf6e69d2046 P 590ee39ce5734876b94d91fc3931b807 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:09.401692   431 raft_consensus.cc:2272] T da02fa98f6de48a7baefadf6e69d2046 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:09.403457   431 tablet_replica.cc:333] T 610562885f5849d083ac5f7a85011891 P 590ee39ce5734876b94d91fc3931b807: stopping tablet replica
I20260709 13:02:09.404023   431 raft_consensus.cc:2243] T 610562885f5849d083ac5f7a85011891 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:09.404424   431 raft_consensus.cc:2272] T 610562885f5849d083ac5f7a85011891 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:09.406477   431 tablet_replica.cc:333] T e8353e508def43e5a8008bb63ff1a84a P 590ee39ce5734876b94d91fc3931b807: stopping tablet replica
I20260709 13:02:09.407410   431 raft_consensus.cc:2243] T e8353e508def43e5a8008bb63ff1a84a P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:09.407907   431 raft_consensus.cc:2272] T e8353e508def43e5a8008bb63ff1a84a P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:09.410092   431 tablet_replica.cc:333] T ca262e71501a4ae4a89152ec6771ffb9 P 590ee39ce5734876b94d91fc3931b807: stopping tablet replica
I20260709 13:02:09.410810   431 raft_consensus.cc:2243] T ca262e71501a4ae4a89152ec6771ffb9 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:09.411230   431 raft_consensus.cc:2272] T ca262e71501a4ae4a89152ec6771ffb9 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:09.413048   431 tablet_replica.cc:333] T 69ef277bbcbd41d8a10ae92d9a63145e P 590ee39ce5734876b94d91fc3931b807: stopping tablet replica
I20260709 13:02:09.413609   431 raft_consensus.cc:2243] T 69ef277bbcbd41d8a10ae92d9a63145e P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:09.413947   431 raft_consensus.cc:2272] T 69ef277bbcbd41d8a10ae92d9a63145e P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:09.415696   431 tablet_replica.cc:333] T 30e220d65bed42489b2af858d3a60981 P 590ee39ce5734876b94d91fc3931b807: stopping tablet replica
I20260709 13:02:09.416380   431 raft_consensus.cc:2243] T 30e220d65bed42489b2af858d3a60981 P 590ee39ce5734876b94d91fc3931b807 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:09.417322   431 raft_consensus.cc:2272] T 30e220d65bed42489b2af858d3a60981 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:09.420945   431 tablet_replica.cc:333] T cd24f768f33e40bba3406e8dde3f45cc P 590ee39ce5734876b94d91fc3931b807: stopping tablet replica
I20260709 13:02:09.421682   431 raft_consensus.cc:2243] T cd24f768f33e40bba3406e8dde3f45cc P 590ee39ce5734876b94d91fc3931b807 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:09.422565   431 raft_consensus.cc:2272] T cd24f768f33e40bba3406e8dde3f45cc P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:09.424021  8445 consensus_peers.cc:597] T 6433163abeff4ee0b011d159ca454a6a P 7b3ea460d1294b8a82672d7c21475cb5 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:09.425148   431 tablet_replica.cc:333] T 62a3aed976de4d62a1d4dc7bc5252328 P 590ee39ce5734876b94d91fc3931b807: stopping tablet replica
I20260709 13:02:09.425979   431 raft_consensus.cc:2243] T 62a3aed976de4d62a1d4dc7bc5252328 P 590ee39ce5734876b94d91fc3931b807 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:09.427297   431 raft_consensus.cc:2272] T 62a3aed976de4d62a1d4dc7bc5252328 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:09.429097  8519 consensus_peers.cc:597] T ca262e71501a4ae4a89152ec6771ffb9 P b560e9aaec7a4c78b9123b38e73519a3 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:09.429517   431 tablet_replica.cc:333] T 1162036be6064d5c821df6a7aa486bab P 590ee39ce5734876b94d91fc3931b807: stopping tablet replica
I20260709 13:02:09.430414   431 raft_consensus.cc:2243] T 1162036be6064d5c821df6a7aa486bab P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:09.430889   431 raft_consensus.cc:2272] T 1162036be6064d5c821df6a7aa486bab P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:09.433095   431 tablet_replica.cc:333] T 3921dc7d601b4e4ea05f40ca34d69819 P 590ee39ce5734876b94d91fc3931b807: stopping tablet replica
I20260709 13:02:09.433851   431 raft_consensus.cc:2243] T 3921dc7d601b4e4ea05f40ca34d69819 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:09.434257   431 raft_consensus.cc:2272] T 3921dc7d601b4e4ea05f40ca34d69819 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:09.436383   431 tablet_replica.cc:333] T a3a46de7366f4683a88d19d25ad04901 P 590ee39ce5734876b94d91fc3931b807: stopping tablet replica
I20260709 13:02:09.437168   431 raft_consensus.cc:2243] T a3a46de7366f4683a88d19d25ad04901 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:09.437608   431 raft_consensus.cc:2272] T a3a46de7366f4683a88d19d25ad04901 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:09.438599  8519 consensus_peers.cc:597] T ef35fbe0cee64967ab342c52aa0b1ac1 P b560e9aaec7a4c78b9123b38e73519a3 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:09.439636   431 tablet_replica.cc:333] T 6433163abeff4ee0b011d159ca454a6a P 590ee39ce5734876b94d91fc3931b807: stopping tablet replica
I20260709 13:02:09.440299   431 raft_consensus.cc:2243] T 6433163abeff4ee0b011d159ca454a6a P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:09.440752   431 raft_consensus.cc:2272] T 6433163abeff4ee0b011d159ca454a6a P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:09.442649   431 tablet_replica.cc:333] T 4d5829b9233a48fea0290d9bb023f97e P 590ee39ce5734876b94d91fc3931b807: stopping tablet replica
I20260709 13:02:09.443342   431 raft_consensus.cc:2243] T 4d5829b9233a48fea0290d9bb023f97e P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:09.443786   431 raft_consensus.cc:2272] T 4d5829b9233a48fea0290d9bb023f97e P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:09.445845   431 tablet_replica.cc:333] T 45171bd0207f452f9884a58c225ddb72 P 590ee39ce5734876b94d91fc3931b807: stopping tablet replica
I20260709 13:02:09.446415   431 raft_consensus.cc:2243] T 45171bd0207f452f9884a58c225ddb72 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:09.446798   431 raft_consensus.cc:2272] T 45171bd0207f452f9884a58c225ddb72 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:09.448678   431 tablet_replica.cc:333] T e8bdd44ba5144cadada8b14a380f995a P 590ee39ce5734876b94d91fc3931b807: stopping tablet replica
I20260709 13:02:09.449296   431 raft_consensus.cc:2243] T e8bdd44ba5144cadada8b14a380f995a P 590ee39ce5734876b94d91fc3931b807 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:09.450007   431 raft_consensus.cc:2272] T e8bdd44ba5144cadada8b14a380f995a P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:09.451540  8371 consensus_peers.cc:597] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 53a66c851dc74c70b94c65d464a391f6 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:09.452062   431 tablet_replica.cc:333] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P 590ee39ce5734876b94d91fc3931b807: stopping tablet replica
I20260709 13:02:09.453058   431 raft_consensus.cc:2243] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:09.453557   431 raft_consensus.cc:2272] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:09.455327  8371 consensus_peers.cc:597] T d97df5fdb12a439080fa6edc391ebd82 P 53a66c851dc74c70b94c65d464a391f6 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:09.455787   431 tablet_replica.cc:333] T 5a94bf713e4848879b9e2a1bbec03def P 590ee39ce5734876b94d91fc3931b807: stopping tablet replica
I20260709 13:02:09.456385   431 raft_consensus.cc:2243] T 5a94bf713e4848879b9e2a1bbec03def P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:09.456790   431 raft_consensus.cc:2272] T 5a94bf713e4848879b9e2a1bbec03def P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:09.458555   431 tablet_replica.cc:333] T 8e53899e04fe4f58b666f67ac07bbf79 P 590ee39ce5734876b94d91fc3931b807: stopping tablet replica
I20260709 13:02:09.459331   431 raft_consensus.cc:2243] T 8e53899e04fe4f58b666f67ac07bbf79 P 590ee39ce5734876b94d91fc3931b807 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:09.460229   431 raft_consensus.cc:2272] T 8e53899e04fe4f58b666f67ac07bbf79 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:09.462435   431 tablet_replica.cc:333] T f8ec593f6c894c24a5bc727cfed4190a P 590ee39ce5734876b94d91fc3931b807: stopping tablet replica
I20260709 13:02:09.463198   431 raft_consensus.cc:2243] T f8ec593f6c894c24a5bc727cfed4190a P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:09.463681   431 raft_consensus.cc:2272] T f8ec593f6c894c24a5bc727cfed4190a P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:09.465885   431 tablet_replica.cc:333] T 8b0d84add64c4f5db82c90e98b7f4b74 P 590ee39ce5734876b94d91fc3931b807: stopping tablet replica
I20260709 13:02:09.466476   431 raft_consensus.cc:2243] T 8b0d84add64c4f5db82c90e98b7f4b74 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:09.466884   431 raft_consensus.cc:2272] T 8b0d84add64c4f5db82c90e98b7f4b74 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:09.468708   431 tablet_replica.cc:333] T cb85497b295d4b3f8cda882af3676c65 P 590ee39ce5734876b94d91fc3931b807: stopping tablet replica
I20260709 13:02:09.469262   431 raft_consensus.cc:2243] T cb85497b295d4b3f8cda882af3676c65 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:09.469656   431 raft_consensus.cc:2272] T cb85497b295d4b3f8cda882af3676c65 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:09.471386   431 tablet_replica.cc:333] T f1fec8d4948d45bbbe39d0f3e73c3992 P 590ee39ce5734876b94d91fc3931b807: stopping tablet replica
I20260709 13:02:09.471925   431 raft_consensus.cc:2243] T f1fec8d4948d45bbbe39d0f3e73c3992 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:09.472400   431 raft_consensus.cc:2272] T f1fec8d4948d45bbbe39d0f3e73c3992 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:09.474128   431 tablet_replica.cc:333] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 590ee39ce5734876b94d91fc3931b807: stopping tablet replica
I20260709 13:02:09.474681   431 raft_consensus.cc:2243] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:09.475080   431 raft_consensus.cc:2272] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:09.476876   431 tablet_replica.cc:333] T 5527a2aef01d45cebcfad8a1b0a5273d P 590ee39ce5734876b94d91fc3931b807: stopping tablet replica
I20260709 13:02:09.477561   431 raft_consensus.cc:2243] T 5527a2aef01d45cebcfad8a1b0a5273d P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:09.478017   431 raft_consensus.cc:2272] T 5527a2aef01d45cebcfad8a1b0a5273d P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:09.480219   431 tablet_replica.cc:333] T 53842ab4d1d748bda0c7f0d933e5a785 P 590ee39ce5734876b94d91fc3931b807: stopping tablet replica
I20260709 13:02:09.480804   431 raft_consensus.cc:2243] T 53842ab4d1d748bda0c7f0d933e5a785 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:09.481257   431 raft_consensus.cc:2272] T 53842ab4d1d748bda0c7f0d933e5a785 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:09.483194   431 tablet_replica.cc:333] T 6540f8b1e5df49f698558db1af45038b P 590ee39ce5734876b94d91fc3931b807: stopping tablet replica
I20260709 13:02:09.484014   431 raft_consensus.cc:2243] T 6540f8b1e5df49f698558db1af45038b P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:09.484453   431 raft_consensus.cc:2272] T 6540f8b1e5df49f698558db1af45038b P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:09.486780   431 tablet_replica.cc:333] T e1f344d27b0b44819ef6d23574175c26 P 590ee39ce5734876b94d91fc3931b807: stopping tablet replica
I20260709 13:02:09.487478   431 raft_consensus.cc:2243] T e1f344d27b0b44819ef6d23574175c26 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:09.487980   431 raft_consensus.cc:2272] T e1f344d27b0b44819ef6d23574175c26 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:09.490089   431 tablet_replica.cc:333] T cea53371e56d4a668406dcd8f5a93dcb P 590ee39ce5734876b94d91fc3931b807: stopping tablet replica
I20260709 13:02:09.490815   431 raft_consensus.cc:2243] T cea53371e56d4a668406dcd8f5a93dcb P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:09.491299   431 raft_consensus.cc:2272] T cea53371e56d4a668406dcd8f5a93dcb P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:09.493752   431 tablet_replica.cc:333] T a79ccdf7d9cf4be7bf8b0c69bf90538a P 590ee39ce5734876b94d91fc3931b807: stopping tablet replica
I20260709 13:02:09.494450   431 raft_consensus.cc:2243] T a79ccdf7d9cf4be7bf8b0c69bf90538a P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:09.494895   431 raft_consensus.cc:2272] T a79ccdf7d9cf4be7bf8b0c69bf90538a P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:09.495060  8445 consensus_peers.cc:597] T 52f213b355c14b45a13d7cf5b3e76efe P 7b3ea460d1294b8a82672d7c21475cb5 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:09.497160   431 tablet_replica.cc:333] T da5b0b01a880412896838e8eb658db7a P 590ee39ce5734876b94d91fc3931b807: stopping tablet replica
I20260709 13:02:09.497865   431 raft_consensus.cc:2243] T da5b0b01a880412896838e8eb658db7a P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:09.498345   431 raft_consensus.cc:2272] T da5b0b01a880412896838e8eb658db7a P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:09.500349   431 tablet_replica.cc:333] T a1946cc2deaa4799be02943612a39b16 P 590ee39ce5734876b94d91fc3931b807: stopping tablet replica
I20260709 13:02:09.500989   431 raft_consensus.cc:2243] T a1946cc2deaa4799be02943612a39b16 P 590ee39ce5734876b94d91fc3931b807 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:09.501796   431 raft_consensus.cc:2272] T a1946cc2deaa4799be02943612a39b16 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:09.504087   431 tablet_replica.cc:333] T ef35fbe0cee64967ab342c52aa0b1ac1 P 590ee39ce5734876b94d91fc3931b807: stopping tablet replica
I20260709 13:02:09.504751   431 raft_consensus.cc:2243] T ef35fbe0cee64967ab342c52aa0b1ac1 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:09.505160   431 raft_consensus.cc:2272] T ef35fbe0cee64967ab342c52aa0b1ac1 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:09.507078   431 tablet_replica.cc:333] T 5db51a6d67e6461a98e669fa2b1e59c8 P 590ee39ce5734876b94d91fc3931b807: stopping tablet replica
I20260709 13:02:09.507622   431 raft_consensus.cc:2243] T 5db51a6d67e6461a98e669fa2b1e59c8 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:09.508039   431 raft_consensus.cc:2272] T 5db51a6d67e6461a98e669fa2b1e59c8 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:09.508047  8371 consensus_peers.cc:597] T 3921dc7d601b4e4ea05f40ca34d69819 P 53a66c851dc74c70b94c65d464a391f6 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:09.509963   431 tablet_replica.cc:333] T c63211d1d13a4736adb18dee69b400a3 P 590ee39ce5734876b94d91fc3931b807: stopping tablet replica
I20260709 13:02:09.510528   431 raft_consensus.cc:2243] T c63211d1d13a4736adb18dee69b400a3 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:09.510937   431 raft_consensus.cc:2272] T c63211d1d13a4736adb18dee69b400a3 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:09.512589   431 tablet_replica.cc:333] T c66f53044d784114970ae5061755da40 P 590ee39ce5734876b94d91fc3931b807: stopping tablet replica
I20260709 13:02:09.513089   431 raft_consensus.cc:2243] T c66f53044d784114970ae5061755da40 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:09.513513   431 raft_consensus.cc:2272] T c66f53044d784114970ae5061755da40 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:09.515311   431 tablet_replica.cc:333] T 6fffc940549b445c973a289ba1bebcb3 P 590ee39ce5734876b94d91fc3931b807: stopping tablet replica
I20260709 13:02:09.515777   431 raft_consensus.cc:2243] T 6fffc940549b445c973a289ba1bebcb3 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:09.516208   431 raft_consensus.cc:2272] T 6fffc940549b445c973a289ba1bebcb3 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:09.518030   431 tablet_replica.cc:333] T 52f213b355c14b45a13d7cf5b3e76efe P 590ee39ce5734876b94d91fc3931b807: stopping tablet replica
I20260709 13:02:09.518581   431 raft_consensus.cc:2243] T 52f213b355c14b45a13d7cf5b3e76efe P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:09.519035   431 raft_consensus.cc:2272] T 52f213b355c14b45a13d7cf5b3e76efe P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:09.522204  8445 consensus_peers.cc:597] T c6245fdde2e4422581bc418d4840b580 P 7b3ea460d1294b8a82672d7c21475cb5 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:09.527854  8371 consensus_peers.cc:597] T 45171bd0207f452f9884a58c225ddb72 P 53a66c851dc74c70b94c65d464a391f6 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:09.531687  8445 consensus_peers.cc:597] T 610562885f5849d083ac5f7a85011891 P 7b3ea460d1294b8a82672d7c21475cb5 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:09.545665  8445 consensus_peers.cc:597] T 8b0d84add64c4f5db82c90e98b7f4b74 P 7b3ea460d1294b8a82672d7c21475cb5 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:09.555369  8519 consensus_peers.cc:597] T 5a94bf713e4848879b9e2a1bbec03def P b560e9aaec7a4c78b9123b38e73519a3 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:09.570178  8519 consensus_peers.cc:597] T f8ec593f6c894c24a5bc727cfed4190a P b560e9aaec7a4c78b9123b38e73519a3 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:09.576241  8519 consensus_peers.cc:597] T cb85497b295d4b3f8cda882af3676c65 P b560e9aaec7a4c78b9123b38e73519a3 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:09.583691   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:02:09.584805  8519 consensus_peers.cc:597] T 5db51a6d67e6461a98e669fa2b1e59c8 P b560e9aaec7a4c78b9123b38e73519a3 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:09.618235  8445 consensus_peers.cc:597] T c66f53044d784114970ae5061755da40 P 7b3ea460d1294b8a82672d7c21475cb5 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:09.631340  8445 consensus_peers.cc:597] T fcc07b65535048fca9045891e1ae0153 P 7b3ea460d1294b8a82672d7c21475cb5 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:09.641378  8371 consensus_peers.cc:597] T f1fec8d4948d45bbbe39d0f3e73c3992 P 53a66c851dc74c70b94c65d464a391f6 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:09.641805  8519 consensus_peers.cc:597] T a79ccdf7d9cf4be7bf8b0c69bf90538a P b560e9aaec7a4c78b9123b38e73519a3 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:09.645128   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:09.651362  9126 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:09.651741  9127 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:09.654184  9129 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:09.654229   431 server_base.cc:1061] running on GCE node
I20260709 13:02:09.657572   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:09.658056   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:09.658315   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602129658296 us; error 0 us; skew 500 ppm
I20260709 13:02:09.659277   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:09.662518   431 webserver.cc:533] Webserver started at http://127.0.107.193:45605/ using document root <none> and password file <none>
I20260709 13:02:09.714089   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:09.715037   431 fs_manager.cc:365] Using existing metadata directory in first data directory
W20260709 13:02:09.741549  8519 consensus_peers.cc:597] T 4d5829b9233a48fea0290d9bb023f97e P b560e9aaec7a4c78b9123b38e73519a3 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:09.773989  8445 consensus_peers.cc:597] T da5b0b01a880412896838e8eb658db7a P 7b3ea460d1294b8a82672d7c21475cb5 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:09.774701  8445 consensus_peers.cc:597] T c63211d1d13a4736adb18dee69b400a3 P 7b3ea460d1294b8a82672d7c21475cb5 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:09.796986  8519 consensus_peers.cc:597] T 1162036be6064d5c821df6a7aa486bab P b560e9aaec7a4c78b9123b38e73519a3 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:09.826431  8371 consensus_peers.cc:597] T 6540f8b1e5df49f698558db1af45038b P 53a66c851dc74c70b94c65d464a391f6 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:09.841234   431 fs_manager.cc:714] Time spent opening directory manager: real 0.068s	user 0.006s	sys 0.016s
I20260709 13:02:09.878527  9140 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
W20260709 13:02:09.887156  8371 consensus_peers.cc:597] T 53842ab4d1d748bda0c7f0d933e5a785 P 53a66c851dc74c70b94c65d464a391f6 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:09.896394   431 fs_manager.cc:730] Time spent opening block manager: real 0.021s	user 0.000s	sys 0.004s
I20260709 13:02:09.897109   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601869227091-431-0/minicluster-data/ts-0-root
uuid: "590ee39ce5734876b94d91fc3931b807"
format_stamp: "Formatted at 2026-07-09 13:01:55 on dist-test-slave-5mzn"
I20260709 13:02:09.897964   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601869227091-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601869227091-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783601869227091-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:09.924446   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:09.926807   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:09.928875   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:09.933774  9148 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 13:02:10.218629   431 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:02:10.218920   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.286s	user 0.011s	sys 0.001s
I20260709 13:02:10.219164   431 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:02:10.226150  9148 tablet_bootstrap.cc:492] T 3921dc7d601b4e4ea05f40ca34d69819 P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:10.243155  9148 tablet_bootstrap.cc:492] T 3921dc7d601b4e4ea05f40ca34d69819 P 590ee39ce5734876b94d91fc3931b807: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:10.244184  9148 tablet_bootstrap.cc:492] T 3921dc7d601b4e4ea05f40ca34d69819 P 590ee39ce5734876b94d91fc3931b807: Bootstrap complete.
I20260709 13:02:10.244939  9148 ts_tablet_manager.cc:1403] T 3921dc7d601b4e4ea05f40ca34d69819 P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 13:02:10.247964  9148 raft_consensus.cc:359] T 3921dc7d601b4e4ea05f40ca34d69819 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:10.249869  9148 raft_consensus.cc:740] T 3921dc7d601b4e4ea05f40ca34d69819 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.250628  9148 consensus_queue.cc:260] T 3921dc7d601b4e4ea05f40ca34d69819 P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:10.310706  9148 ts_tablet_manager.cc:1434] T 3921dc7d601b4e4ea05f40ca34d69819 P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.065s	user 0.009s	sys 0.007s
I20260709 13:02:10.311970  9148 tablet_bootstrap.cc:492] T da02fa98f6de48a7baefadf6e69d2046 P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:10.343590  9148 tablet_bootstrap.cc:492] T da02fa98f6de48a7baefadf6e69d2046 P 590ee39ce5734876b94d91fc3931b807: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:10.344681  9148 tablet_bootstrap.cc:492] T da02fa98f6de48a7baefadf6e69d2046 P 590ee39ce5734876b94d91fc3931b807: Bootstrap complete.
I20260709 13:02:10.345395  9148 ts_tablet_manager.cc:1403] T da02fa98f6de48a7baefadf6e69d2046 P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.034s	user 0.024s	sys 0.008s
I20260709 13:02:10.348002  9148 raft_consensus.cc:359] T da02fa98f6de48a7baefadf6e69d2046 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:10.348694  9148 raft_consensus.cc:740] T da02fa98f6de48a7baefadf6e69d2046 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.349412  9148 consensus_queue.cc:260] T da02fa98f6de48a7baefadf6e69d2046 P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:10.351132  9148 ts_tablet_manager.cc:1434] T da02fa98f6de48a7baefadf6e69d2046 P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.005s	user 0.001s	sys 0.003s
I20260709 13:02:10.351809  9148 tablet_bootstrap.cc:492] T a3a46de7366f4683a88d19d25ad04901 P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:10.367324  9148 tablet_bootstrap.cc:492] T a3a46de7366f4683a88d19d25ad04901 P 590ee39ce5734876b94d91fc3931b807: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:10.368463  9122 raft_consensus.cc:493] T a1667ac154454613a9047f56ee087405 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 590ee39ce5734876b94d91fc3931b807)
I20260709 13:02:10.369292  9122 raft_consensus.cc:515] T a1667ac154454613a9047f56ee087405 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:10.371959  9122 leader_election.cc:290] T a1667ac154454613a9047f56ee087405 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:02:10.373217  9148 tablet_bootstrap.cc:492] T a3a46de7366f4683a88d19d25ad04901 P 590ee39ce5734876b94d91fc3931b807: Bootstrap complete.
I20260709 13:02:10.373992  9148 ts_tablet_manager.cc:1403] T a3a46de7366f4683a88d19d25ad04901 P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.000s
I20260709 13:02:10.374684  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1667ac154454613a9047f56ee087405" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:02:10.377182  9148 raft_consensus.cc:359] T a3a46de7366f4683a88d19d25ad04901 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:10.377907  9148 raft_consensus.cc:740] T a3a46de7366f4683a88d19d25ad04901 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.378597  9148 consensus_queue.cc:260] T a3a46de7366f4683a88d19d25ad04901 P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:10.380601  9148 ts_tablet_manager.cc:1434] T a3a46de7366f4683a88d19d25ad04901 P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:02:10.381719  9148 tablet_bootstrap.cc:492] T 5db51a6d67e6461a98e669fa2b1e59c8 P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
W20260709 13:02:10.406440  8445 leader_election.cc:336] T a1667ac154454613a9047f56ee087405 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111)
I20260709 13:02:10.406963  8445 leader_election.cc:304] T a1667ac154454613a9047f56ee087405 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b3ea460d1294b8a82672d7c21475cb5; no voters: 53a66c851dc74c70b94c65d464a391f6, 590ee39ce5734876b94d91fc3931b807
I20260709 13:02:10.407977  9122 raft_consensus.cc:2749] T a1667ac154454613a9047f56ee087405 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:10.418535  9122 raft_consensus.cc:493] T 30e220d65bed42489b2af858d3a60981 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 590ee39ce5734876b94d91fc3931b807)
I20260709 13:02:10.419107  9122 raft_consensus.cc:515] T 30e220d65bed42489b2af858d3a60981 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:10.421077  9122 leader_election.cc:290] T 30e220d65bed42489b2af858d3a60981 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:02:10.422497  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e220d65bed42489b2af858d3a60981" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:02:10.429601  9137 raft_consensus.cc:493] T 4f93b4088ce1421cb59ed9a917919b22 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 590ee39ce5734876b94d91fc3931b807)
I20260709 13:02:10.430305  9137 raft_consensus.cc:515] T 4f93b4088ce1421cb59ed9a917919b22 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:10.429627  9148 tablet_bootstrap.cc:492] T 5db51a6d67e6461a98e669fa2b1e59c8 P 590ee39ce5734876b94d91fc3931b807: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:10.433341  9148 tablet_bootstrap.cc:492] T 5db51a6d67e6461a98e669fa2b1e59c8 P 590ee39ce5734876b94d91fc3931b807: Bootstrap complete.
I20260709 13:02:10.433975  9137 leader_election.cc:290] T 4f93b4088ce1421cb59ed9a917919b22 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:02:10.434042  9148 ts_tablet_manager.cc:1403] T 5db51a6d67e6461a98e669fa2b1e59c8 P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.053s	user 0.018s	sys 0.028s
I20260709 13:02:10.442687  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f93b4088ce1421cb59ed9a917919b22" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:02:10.445678  9148 raft_consensus.cc:359] T 5db51a6d67e6461a98e669fa2b1e59c8 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:10.446499  9148 raft_consensus.cc:740] T 5db51a6d67e6461a98e669fa2b1e59c8 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.447407  9148 consensus_queue.cc:260] T 5db51a6d67e6461a98e669fa2b1e59c8 P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:10.449817  9148 ts_tablet_manager.cc:1434] T 5db51a6d67e6461a98e669fa2b1e59c8 P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.003s
I20260709 13:02:10.450680  9148 tablet_bootstrap.cc:492] T 4f93b4088ce1421cb59ed9a917919b22 P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:10.451838  9137 raft_consensus.cc:493] T cd24f768f33e40bba3406e8dde3f45cc P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 590ee39ce5734876b94d91fc3931b807)
I20260709 13:02:10.452561  9137 raft_consensus.cc:515] T cd24f768f33e40bba3406e8dde3f45cc P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:10.454682  9137 leader_election.cc:290] T cd24f768f33e40bba3406e8dde3f45cc P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:02:10.460933  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd24f768f33e40bba3406e8dde3f45cc" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
W20260709 13:02:10.466760  8445 leader_election.cc:336] T 30e220d65bed42489b2af858d3a60981 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111)
I20260709 13:02:10.467221  8445 leader_election.cc:304] T 30e220d65bed42489b2af858d3a60981 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b3ea460d1294b8a82672d7c21475cb5; no voters: 53a66c851dc74c70b94c65d464a391f6, 590ee39ce5734876b94d91fc3931b807
I20260709 13:02:10.469506  8888 raft_consensus.cc:2749] T 30e220d65bed42489b2af858d3a60981 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:10.474509  9148 tablet_bootstrap.cc:492] T 4f93b4088ce1421cb59ed9a917919b22 P 590ee39ce5734876b94d91fc3931b807: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:10.475652  9148 tablet_bootstrap.cc:492] T 4f93b4088ce1421cb59ed9a917919b22 P 590ee39ce5734876b94d91fc3931b807: Bootstrap complete.
I20260709 13:02:10.476410  9148 ts_tablet_manager.cc:1403] T 4f93b4088ce1421cb59ed9a917919b22 P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.026s	user 0.017s	sys 0.004s
W20260709 13:02:10.478183  8519 leader_election.cc:336] T 4f93b4088ce1421cb59ed9a917919b22 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111)
I20260709 13:02:10.480556  8519 leader_election.cc:304] T 4f93b4088ce1421cb59ed9a917919b22 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b560e9aaec7a4c78b9123b38e73519a3; no voters: 53a66c851dc74c70b94c65d464a391f6, 590ee39ce5734876b94d91fc3931b807
I20260709 13:02:10.482817  9134 raft_consensus.cc:2749] T 4f93b4088ce1421cb59ed9a917919b22 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:10.479461  9148 raft_consensus.cc:359] T 4f93b4088ce1421cb59ed9a917919b22 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:10.483544  9148 raft_consensus.cc:740] T 4f93b4088ce1421cb59ed9a917919b22 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.484472  9148 consensus_queue.cc:260] T 4f93b4088ce1421cb59ed9a917919b22 P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:10.486981  9148 ts_tablet_manager.cc:1434] T 4f93b4088ce1421cb59ed9a917919b22 P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:02:10.487834  9148 tablet_bootstrap.cc:492] T 1162036be6064d5c821df6a7aa486bab P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
W20260709 13:02:10.491073  8519 leader_election.cc:336] T cd24f768f33e40bba3406e8dde3f45cc P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111)
I20260709 13:02:10.491767  8519 leader_election.cc:304] T cd24f768f33e40bba3406e8dde3f45cc P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b560e9aaec7a4c78b9123b38e73519a3; no voters: 53a66c851dc74c70b94c65d464a391f6, 590ee39ce5734876b94d91fc3931b807
I20260709 13:02:10.492794  9155 raft_consensus.cc:2749] T cd24f768f33e40bba3406e8dde3f45cc P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:10.503953  9136 raft_consensus.cc:493] T b1d8e928d8444f77ac2950eab2115f65 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 590ee39ce5734876b94d91fc3931b807)
I20260709 13:02:10.504559  9148 tablet_bootstrap.cc:492] T 1162036be6064d5c821df6a7aa486bab P 590ee39ce5734876b94d91fc3931b807: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:10.504679  9136 raft_consensus.cc:515] T b1d8e928d8444f77ac2950eab2115f65 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:10.505781  9148 tablet_bootstrap.cc:492] T 1162036be6064d5c821df6a7aa486bab P 590ee39ce5734876b94d91fc3931b807: Bootstrap complete.
I20260709 13:02:10.506529  9148 ts_tablet_manager.cc:1403] T 1162036be6064d5c821df6a7aa486bab P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 13:02:10.509487  9148 raft_consensus.cc:359] T 1162036be6064d5c821df6a7aa486bab P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:10.510277  9148 raft_consensus.cc:740] T 1162036be6064d5c821df6a7aa486bab P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.511162  9148 consensus_queue.cc:260] T 1162036be6064d5c821df6a7aa486bab P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
W20260709 13:02:10.512379  8371 leader_election.cc:336] T b1d8e928d8444f77ac2950eab2115f65 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111)
I20260709 13:02:10.513641  9148 ts_tablet_manager.cc:1434] T 1162036be6064d5c821df6a7aa486bab P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:02:10.514506  9136 leader_election.cc:290] T b1d8e928d8444f77ac2950eab2115f65 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:02:10.514622  9148 tablet_bootstrap.cc:492] T 53842ab4d1d748bda0c7f0d933e5a785 P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:10.515028  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d8e928d8444f77ac2950eab2115f65" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
I20260709 13:02:10.517007  8370 leader_election.cc:304] T b1d8e928d8444f77ac2950eab2115f65 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6; no voters: 590ee39ce5734876b94d91fc3931b807, 7b3ea460d1294b8a82672d7c21475cb5
I20260709 13:02:10.518383  9045 raft_consensus.cc:2749] T b1d8e928d8444f77ac2950eab2115f65 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:10.538946  9148 tablet_bootstrap.cc:492] T 53842ab4d1d748bda0c7f0d933e5a785 P 590ee39ce5734876b94d91fc3931b807: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:10.540066  9148 tablet_bootstrap.cc:492] T 53842ab4d1d748bda0c7f0d933e5a785 P 590ee39ce5734876b94d91fc3931b807: Bootstrap complete.
I20260709 13:02:10.540774  9148 ts_tablet_manager.cc:1403] T 53842ab4d1d748bda0c7f0d933e5a785 P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.026s	user 0.015s	sys 0.010s
I20260709 13:02:10.543581  9148 raft_consensus.cc:359] T 53842ab4d1d748bda0c7f0d933e5a785 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:10.544328  9148 raft_consensus.cc:740] T 53842ab4d1d748bda0c7f0d933e5a785 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.545269  9148 consensus_queue.cc:260] T 53842ab4d1d748bda0c7f0d933e5a785 P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:10.547672  9148 ts_tablet_manager.cc:1434] T 53842ab4d1d748bda0c7f0d933e5a785 P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 13:02:10.548568  9148 tablet_bootstrap.cc:492] T a1667ac154454613a9047f56ee087405 P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:10.556876  9155 raft_consensus.cc:493] T da02fa98f6de48a7baefadf6e69d2046 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 590ee39ce5734876b94d91fc3931b807)
I20260709 13:02:10.557546  9155 raft_consensus.cc:515] T da02fa98f6de48a7baefadf6e69d2046 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:10.562778  9155 leader_election.cc:290] T da02fa98f6de48a7baefadf6e69d2046 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:02:10.565531  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da02fa98f6de48a7baefadf6e69d2046" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
W20260709 13:02:10.568003  8519 leader_election.cc:336] T da02fa98f6de48a7baefadf6e69d2046 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111)
I20260709 13:02:10.568409  8519 leader_election.cc:304] T da02fa98f6de48a7baefadf6e69d2046 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b560e9aaec7a4c78b9123b38e73519a3; no voters: 53a66c851dc74c70b94c65d464a391f6, 590ee39ce5734876b94d91fc3931b807
I20260709 13:02:10.569169  9155 raft_consensus.cc:2749] T da02fa98f6de48a7baefadf6e69d2046 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:10.574848  9148 tablet_bootstrap.cc:492] T a1667ac154454613a9047f56ee087405 P 590ee39ce5734876b94d91fc3931b807: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:10.575918  9148 tablet_bootstrap.cc:492] T a1667ac154454613a9047f56ee087405 P 590ee39ce5734876b94d91fc3931b807: Bootstrap complete.
I20260709 13:02:10.576488  9148 ts_tablet_manager.cc:1403] T a1667ac154454613a9047f56ee087405 P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.003s
I20260709 13:02:10.578696  9148 raft_consensus.cc:359] T a1667ac154454613a9047f56ee087405 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:10.579248  9148 raft_consensus.cc:740] T a1667ac154454613a9047f56ee087405 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.579926  9148 consensus_queue.cc:260] T a1667ac154454613a9047f56ee087405 P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:10.581506  9148 ts_tablet_manager.cc:1434] T a1667ac154454613a9047f56ee087405 P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:02:10.582188  9148 tablet_bootstrap.cc:492] T 30e220d65bed42489b2af858d3a60981 P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:10.595870  9148 tablet_bootstrap.cc:492] T 30e220d65bed42489b2af858d3a60981 P 590ee39ce5734876b94d91fc3931b807: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:10.596726  9148 tablet_bootstrap.cc:492] T 30e220d65bed42489b2af858d3a60981 P 590ee39ce5734876b94d91fc3931b807: Bootstrap complete.
I20260709 13:02:10.597266  9148 ts_tablet_manager.cc:1403] T 30e220d65bed42489b2af858d3a60981 P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 13:02:10.599205  9148 raft_consensus.cc:359] T 30e220d65bed42489b2af858d3a60981 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:10.599916  9148 raft_consensus.cc:740] T 30e220d65bed42489b2af858d3a60981 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.600694  9148 consensus_queue.cc:260] T 30e220d65bed42489b2af858d3a60981 P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:10.603175  9148 ts_tablet_manager.cc:1434] T 30e220d65bed42489b2af858d3a60981 P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:02:10.603996  9148 tablet_bootstrap.cc:492] T ca262e71501a4ae4a89152ec6771ffb9 P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:10.607831   431 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:02:10.608243   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.389s	user 0.253s	sys 0.004s
I20260709 13:02:10.608798  9054 raft_consensus.cc:493] T b1d8e928d8444f77ac2950eab2115f65 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 590ee39ce5734876b94d91fc3931b807)
I20260709 13:02:10.609773  9054 raft_consensus.cc:515] T b1d8e928d8444f77ac2950eab2115f65 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:10.612619  9159 raft_consensus.cc:493] T e8bdd44ba5144cadada8b14a380f995a P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 590ee39ce5734876b94d91fc3931b807)
I20260709 13:02:10.613206  9159 raft_consensus.cc:515] T e8bdd44ba5144cadada8b14a380f995a P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:10.615586  9159 leader_election.cc:290] T e8bdd44ba5144cadada8b14a380f995a P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:02:10.618196  8549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8bdd44ba5144cadada8b14a380f995a" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3" is_pre_election: true
I20260709 13:02:10.621218  9054 leader_election.cc:290] T b1d8e928d8444f77ac2950eab2115f65 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:02:10.623615  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d8e928d8444f77ac2950eab2115f65" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:02:10.624405  8398 raft_consensus.cc:2468] T b1d8e928d8444f77ac2950eab2115f65 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b3ea460d1294b8a82672d7c21475cb5 in term 1.
I20260709 13:02:10.623777  9054 raft_consensus.cc:493] T 8e53899e04fe4f58b666f67ac07bbf79 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 590ee39ce5734876b94d91fc3931b807)
I20260709 13:02:10.625886  8444 leader_election.cc:304] T b1d8e928d8444f77ac2950eab2115f65 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, 7b3ea460d1294b8a82672d7c21475cb5; no voters: 
I20260709 13:02:10.626066  9054 raft_consensus.cc:515] T 8e53899e04fe4f58b666f67ac07bbf79 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:10.628700  9159 raft_consensus.cc:2804] T b1d8e928d8444f77ac2950eab2115f65 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:10.629093  9148 tablet_bootstrap.cc:492] T ca262e71501a4ae4a89152ec6771ffb9 P 590ee39ce5734876b94d91fc3931b807: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:10.630118  9148 tablet_bootstrap.cc:492] T ca262e71501a4ae4a89152ec6771ffb9 P 590ee39ce5734876b94d91fc3931b807: Bootstrap complete.
I20260709 13:02:10.630788  9148 ts_tablet_manager.cc:1403] T ca262e71501a4ae4a89152ec6771ffb9 P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.027s	user 0.018s	sys 0.004s
I20260709 13:02:10.632393  9054 leader_election.cc:290] T 8e53899e04fe4f58b666f67ac07bbf79 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:02:10.629113  9159 raft_consensus.cc:493] T b1d8e928d8444f77ac2950eab2115f65 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 590ee39ce5734876b94d91fc3931b807)
I20260709 13:02:10.633996  9159 raft_consensus.cc:3060] T b1d8e928d8444f77ac2950eab2115f65 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:10.633677  9148 raft_consensus.cc:359] T ca262e71501a4ae4a89152ec6771ffb9 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:10.634254  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e53899e04fe4f58b666f67ac07bbf79" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:02:10.634596  9148 raft_consensus.cc:740] T ca262e71501a4ae4a89152ec6771ffb9 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.636006  9148 consensus_queue.cc:260] T ca262e71501a4ae4a89152ec6771ffb9 P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:10.638710  9148 ts_tablet_manager.cc:1434] T ca262e71501a4ae4a89152ec6771ffb9 P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:02:10.639576  9148 tablet_bootstrap.cc:492] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:10.653224  9159 raft_consensus.cc:515] T b1d8e928d8444f77ac2950eab2115f65 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:10.656643  9159 leader_election.cc:290] T b1d8e928d8444f77ac2950eab2115f65 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 2 election: Requested vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:02:10.657363  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d8e928d8444f77ac2950eab2115f65" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6"
I20260709 13:02:10.658210  8398 raft_consensus.cc:3060] T b1d8e928d8444f77ac2950eab2115f65 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:02:10.659525  8445 leader_election.cc:336] T e8bdd44ba5144cadada8b14a380f995a P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111)
I20260709 13:02:10.659919  9148 tablet_bootstrap.cc:492] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 590ee39ce5734876b94d91fc3931b807: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:10.660432  8445 leader_election.cc:304] T e8bdd44ba5144cadada8b14a380f995a P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b3ea460d1294b8a82672d7c21475cb5; no voters: 590ee39ce5734876b94d91fc3931b807, b560e9aaec7a4c78b9123b38e73519a3
I20260709 13:02:10.661161  9148 tablet_bootstrap.cc:492] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 590ee39ce5734876b94d91fc3931b807: Bootstrap complete.
I20260709 13:02:10.661957  9148 ts_tablet_manager.cc:1403] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.003s
I20260709 13:02:10.661559  9159 raft_consensus.cc:2749] T e8bdd44ba5144cadada8b14a380f995a P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:02:10.662003  8445 leader_election.cc:336] T b1d8e928d8444f77ac2950eab2115f65 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111)
W20260709 13:02:10.665443  8445 leader_election.cc:336] T 8e53899e04fe4f58b666f67ac07bbf79 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111)
I20260709 13:02:10.665875  8445 leader_election.cc:304] T 8e53899e04fe4f58b666f67ac07bbf79 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b3ea460d1294b8a82672d7c21475cb5; no voters: 53a66c851dc74c70b94c65d464a391f6, 590ee39ce5734876b94d91fc3931b807
I20260709 13:02:10.666672  9159 raft_consensus.cc:2749] T 8e53899e04fe4f58b666f67ac07bbf79 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:10.668318  9136 raft_consensus.cc:493] T 8e53899e04fe4f58b666f67ac07bbf79 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 590ee39ce5734876b94d91fc3931b807)
I20260709 13:02:10.668946  9136 raft_consensus.cc:515] T 8e53899e04fe4f58b666f67ac07bbf79 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:10.669274  9148 raft_consensus.cc:359] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:10.670075  9148 raft_consensus.cc:740] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.671012  9148 consensus_queue.cc:260] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:10.672495  9136 leader_election.cc:290] T 8e53899e04fe4f58b666f67ac07bbf79 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:02:10.681859  8398 raft_consensus.cc:2468] T b1d8e928d8444f77ac2950eab2115f65 P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b3ea460d1294b8a82672d7c21475cb5 in term 2.
I20260709 13:02:10.673647  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e53899e04fe4f58b666f67ac07bbf79" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
W20260709 13:02:10.677798  8371 leader_election.cc:336] T 8e53899e04fe4f58b666f67ac07bbf79 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111)
I20260709 13:02:10.684873  8476 raft_consensus.cc:2468] T 8e53899e04fe4f58b666f67ac07bbf79 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53a66c851dc74c70b94c65d464a391f6 in term 1.
W20260709 13:02:10.678385  8445 leader_election.cc:336] T b1d8e928d8444f77ac2950eab2115f65 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111)
I20260709 13:02:10.688760  9136 raft_consensus.cc:493] T 4f93b4088ce1421cb59ed9a917919b22 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 590ee39ce5734876b94d91fc3931b807)
I20260709 13:02:10.689352  9136 raft_consensus.cc:515] T 4f93b4088ce1421cb59ed9a917919b22 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:10.691356  9136 leader_election.cc:290] T 4f93b4088ce1421cb59ed9a917919b22 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:02:10.673561  9148 ts_tablet_manager.cc:1434] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:02:10.693446  9148 tablet_bootstrap.cc:492] T 8b0d84add64c4f5db82c90e98b7f4b74 P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:10.698316  8444 leader_election.cc:304] T b1d8e928d8444f77ac2950eab2115f65 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, 7b3ea460d1294b8a82672d7c21475cb5; no voters: 590ee39ce5734876b94d91fc3931b807
I20260709 13:02:10.699985  9054 raft_consensus.cc:2804] T b1d8e928d8444f77ac2950eab2115f65 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:10.700824  9054 raft_consensus.cc:697] T b1d8e928d8444f77ac2950eab2115f65 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 LEADER]: Becoming Leader. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Running, Role: LEADER
I20260709 13:02:10.702149  9054 consensus_queue.cc:237] T b1d8e928d8444f77ac2950eab2115f65 P 7b3ea460d1294b8a82672d7c21475cb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:10.703060  9159 raft_consensus.cc:493] T 62a3aed976de4d62a1d4dc7bc5252328 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 590ee39ce5734876b94d91fc3931b807)
I20260709 13:02:10.703739  9159 raft_consensus.cc:515] T 62a3aed976de4d62a1d4dc7bc5252328 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:10.705093  8370 leader_election.cc:304] T 8e53899e04fe4f58b666f67ac07bbf79 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, 7b3ea460d1294b8a82672d7c21475cb5; no voters: 590ee39ce5734876b94d91fc3931b807
I20260709 13:02:10.707417  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a3aed976de4d62a1d4dc7bc5252328" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3" is_pre_election: true
I20260709 13:02:10.709308  9136 raft_consensus.cc:2804] T 8e53899e04fe4f58b666f67ac07bbf79 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:10.709723  9136 raft_consensus.cc:493] T 8e53899e04fe4f58b666f67ac07bbf79 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 590ee39ce5734876b94d91fc3931b807)
W20260709 13:02:10.709852  8371 leader_election.cc:336] T 4f93b4088ce1421cb59ed9a917919b22 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111)
I20260709 13:02:10.710264  9136 raft_consensus.cc:3060] T 8e53899e04fe4f58b666f67ac07bbf79 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:10.709685  8549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f93b4088ce1421cb59ed9a917919b22" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3" is_pre_election: true
I20260709 13:02:10.711154  8549 raft_consensus.cc:2468] T 4f93b4088ce1421cb59ed9a917919b22 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53a66c851dc74c70b94c65d464a391f6 in term 1.
I20260709 13:02:10.711263  9155 raft_consensus.cc:493] T 62a3aed976de4d62a1d4dc7bc5252328 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 590ee39ce5734876b94d91fc3931b807)
I20260709 13:02:10.712212  9155 raft_consensus.cc:515] T 62a3aed976de4d62a1d4dc7bc5252328 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:10.715251  9155 leader_election.cc:290] T 62a3aed976de4d62a1d4dc7bc5252328 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:02:10.717088  9122 raft_consensus.cc:493] T a1946cc2deaa4799be02943612a39b16 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 590ee39ce5734876b94d91fc3931b807)
I20260709 13:02:10.717674  9122 raft_consensus.cc:515] T a1946cc2deaa4799be02943612a39b16 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:10.718173  8369 leader_election.cc:304] T 4f93b4088ce1421cb59ed9a917919b22 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, b560e9aaec7a4c78b9123b38e73519a3; no voters: 590ee39ce5734876b94d91fc3931b807
I20260709 13:02:10.719278  9045 raft_consensus.cc:2804] T 4f93b4088ce1421cb59ed9a917919b22 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:10.719631  9045 raft_consensus.cc:493] T 4f93b4088ce1421cb59ed9a917919b22 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 590ee39ce5734876b94d91fc3931b807)
I20260709 13:02:10.720000  9045 raft_consensus.cc:3060] T 4f93b4088ce1421cb59ed9a917919b22 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:10.721879  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a3aed976de4d62a1d4dc7bc5252328" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
I20260709 13:02:10.722652  8474 raft_consensus.cc:2468] T 62a3aed976de4d62a1d4dc7bc5252328 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 1.
I20260709 13:02:10.719977  9122 leader_election.cc:290] T a1946cc2deaa4799be02943612a39b16 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:02:10.726528  9137 raft_consensus.cc:493] T e8bdd44ba5144cadada8b14a380f995a P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 590ee39ce5734876b94d91fc3931b807)
I20260709 13:02:10.727116  9137 raft_consensus.cc:515] T e8bdd44ba5144cadada8b14a380f995a P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:10.729272  9137 leader_election.cc:290] T e8bdd44ba5144cadada8b14a380f995a P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
W20260709 13:02:10.728202  8519 leader_election.cc:336] T 62a3aed976de4d62a1d4dc7bc5252328 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111)
I20260709 13:02:10.735582  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8bdd44ba5144cadada8b14a380f995a" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
I20260709 13:02:10.737104  8474 raft_consensus.cc:2468] T e8bdd44ba5144cadada8b14a380f995a P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 1.
I20260709 13:02:10.740175  9149 raft_consensus.cc:493] T cd24f768f33e40bba3406e8dde3f45cc P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 590ee39ce5734876b94d91fc3931b807)
I20260709 13:02:10.740778  9159 leader_election.cc:290] T 62a3aed976de4d62a1d4dc7bc5252328 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:02:10.741142  9149 raft_consensus.cc:515] T cd24f768f33e40bba3406e8dde3f45cc P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:10.742875  9148 tablet_bootstrap.cc:492] T 8b0d84add64c4f5db82c90e98b7f4b74 P 590ee39ce5734876b94d91fc3931b807: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:10.743815  9148 tablet_bootstrap.cc:492] T 8b0d84add64c4f5db82c90e98b7f4b74 P 590ee39ce5734876b94d91fc3931b807: Bootstrap complete.
I20260709 13:02:10.744445  9149 leader_election.cc:290] T cd24f768f33e40bba3406e8dde3f45cc P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:02:10.744589  9136 raft_consensus.cc:515] T 8e53899e04fe4f58b666f67ac07bbf79 P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:10.746687  9136 leader_election.cc:290] T 8e53899e04fe4f58b666f67ac07bbf79 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 2 election: Requested vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:02:10.747864  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e53899e04fe4f58b666f67ac07bbf79" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5"
I20260709 13:02:10.735818  9045 raft_consensus.cc:515] T 4f93b4088ce1421cb59ed9a917919b22 P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:10.748689  8474 raft_consensus.cc:3060] T 8e53899e04fe4f58b666f67ac07bbf79 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:10.751111  9045 leader_election.cc:290] T 4f93b4088ce1421cb59ed9a917919b22 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 2 election: Requested vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
W20260709 13:02:10.752930  8445 leader_election.cc:336] T a1946cc2deaa4799be02943612a39b16 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111)
I20260709 13:02:10.754562  8518 leader_election.cc:304] T 62a3aed976de4d62a1d4dc7bc5252328 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b3ea460d1294b8a82672d7c21475cb5, b560e9aaec7a4c78b9123b38e73519a3; no voters: 590ee39ce5734876b94d91fc3931b807
I20260709 13:02:10.756700  9137 raft_consensus.cc:2804] T 62a3aed976de4d62a1d4dc7bc5252328 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:02:10.756906  8445 leader_election.cc:336] T 62a3aed976de4d62a1d4dc7bc5252328 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111)
I20260709 13:02:10.757180  9137 raft_consensus.cc:493] T 62a3aed976de4d62a1d4dc7bc5252328 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 590ee39ce5734876b94d91fc3931b807)
I20260709 13:02:10.757397  8445 leader_election.cc:304] T 62a3aed976de4d62a1d4dc7bc5252328 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7b3ea460d1294b8a82672d7c21475cb5; no voters: 590ee39ce5734876b94d91fc3931b807, b560e9aaec7a4c78b9123b38e73519a3
I20260709 13:02:10.757591  9137 raft_consensus.cc:3060] T 62a3aed976de4d62a1d4dc7bc5252328 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:10.758124  9159 raft_consensus.cc:2749] T 62a3aed976de4d62a1d4dc7bc5252328 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:10.756342  8518 leader_election.cc:304] T e8bdd44ba5144cadada8b14a380f995a P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b3ea460d1294b8a82672d7c21475cb5, b560e9aaec7a4c78b9123b38e73519a3; no voters: 
I20260709 13:02:10.756728  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1946cc2deaa4799be02943612a39b16" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:02:10.761615  8398 raft_consensus.cc:2468] T a1946cc2deaa4799be02943612a39b16 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b3ea460d1294b8a82672d7c21475cb5 in term 1.
I20260709 13:02:10.744431  9148 ts_tablet_manager.cc:1403] T 8b0d84add64c4f5db82c90e98b7f4b74 P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.051s	user 0.016s	sys 0.003s
I20260709 13:02:10.768270  8444 leader_election.cc:304] T a1946cc2deaa4799be02943612a39b16 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, 7b3ea460d1294b8a82672d7c21475cb5; no voters: 590ee39ce5734876b94d91fc3931b807
I20260709 13:02:10.769073  9159 raft_consensus.cc:2804] T a1946cc2deaa4799be02943612a39b16 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:10.769434  9159 raft_consensus.cc:493] T a1946cc2deaa4799be02943612a39b16 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 590ee39ce5734876b94d91fc3931b807)
I20260709 13:02:10.769790  9159 raft_consensus.cc:3060] T a1946cc2deaa4799be02943612a39b16 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:10.769840  8549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd24f768f33e40bba3406e8dde3f45cc" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3" is_pre_election: true
I20260709 13:02:10.771042  8549 raft_consensus.cc:2468] T cd24f768f33e40bba3406e8dde3f45cc P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53a66c851dc74c70b94c65d464a391f6 in term 1.
I20260709 13:02:10.773983  8474 raft_consensus.cc:2468] T 8e53899e04fe4f58b666f67ac07bbf79 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53a66c851dc74c70b94c65d464a391f6 in term 2.
I20260709 13:02:10.778591  9056 raft_consensus.cc:2804] T e8bdd44ba5144cadada8b14a380f995a P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:10.778424  9148 raft_consensus.cc:359] T 8b0d84add64c4f5db82c90e98b7f4b74 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:10.779798  9148 raft_consensus.cc:740] T 8b0d84add64c4f5db82c90e98b7f4b74 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.779239  9056 raft_consensus.cc:493] T e8bdd44ba5144cadada8b14a380f995a P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 590ee39ce5734876b94d91fc3931b807)
I20260709 13:02:10.780720  9056 raft_consensus.cc:3060] T e8bdd44ba5144cadada8b14a380f995a P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:10.781657  9148 consensus_queue.cc:260] T 8b0d84add64c4f5db82c90e98b7f4b74 P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:10.784049  9148 ts_tablet_manager.cc:1434] T 8b0d84add64c4f5db82c90e98b7f4b74 P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:02:10.783495  8228 catalog_manager.cc:5697] T b1d8e928d8444f77ac2950eab2115f65 P 7b3ea460d1294b8a82672d7c21475cb5 reported cstate change: term changed from 1 to 2, leader changed from 590ee39ce5734876b94d91fc3931b807 (127.0.107.193) to 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "7b3ea460d1294b8a82672d7c21475cb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:10.784884  9148 tablet_bootstrap.cc:492] T 610562885f5849d083ac5f7a85011891 P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:10.785967  8370 leader_election.cc:304] T 8e53899e04fe4f58b666f67ac07bbf79 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, 7b3ea460d1294b8a82672d7c21475cb5; no voters: 
W20260709 13:02:10.786931  8371 leader_election.cc:336] T cd24f768f33e40bba3406e8dde3f45cc P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111)
I20260709 13:02:10.787072  9136 raft_consensus.cc:2804] T 8e53899e04fe4f58b666f67ac07bbf79 P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 13:02:10.787484  8371 leader_election.cc:336] T 8e53899e04fe4f58b666f67ac07bbf79 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111)
I20260709 13:02:10.787820  9136 raft_consensus.cc:697] T 8e53899e04fe4f58b666f67ac07bbf79 P 53a66c851dc74c70b94c65d464a391f6 [term 2 LEADER]: Becoming Leader. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Running, Role: LEADER
W20260709 13:02:10.788206  8371 leader_election.cc:336] T 4f93b4088ce1421cb59ed9a917919b22 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111)
I20260709 13:02:10.789235  9136 consensus_queue.cc:237] T 8e53899e04fe4f58b666f67ac07bbf79 P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:10.778373  9159 raft_consensus.cc:515] T a1946cc2deaa4799be02943612a39b16 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:10.796949  8549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f93b4088ce1421cb59ed9a917919b22" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3"
I20260709 13:02:10.797566  8549 raft_consensus.cc:3060] T 4f93b4088ce1421cb59ed9a917919b22 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:10.800047  8369 leader_election.cc:304] T cd24f768f33e40bba3406e8dde3f45cc P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, b560e9aaec7a4c78b9123b38e73519a3; no voters: 590ee39ce5734876b94d91fc3931b807
I20260709 13:02:10.802253  9149 raft_consensus.cc:2804] T cd24f768f33e40bba3406e8dde3f45cc P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:10.802716  9149 raft_consensus.cc:493] T cd24f768f33e40bba3406e8dde3f45cc P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 590ee39ce5734876b94d91fc3931b807)
I20260709 13:02:10.803148  9149 raft_consensus.cc:3060] T cd24f768f33e40bba3406e8dde3f45cc P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:10.803997  9159 leader_election.cc:290] T a1946cc2deaa4799be02943612a39b16 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 2 election: Requested vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:02:10.806641  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1946cc2deaa4799be02943612a39b16" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6"
I20260709 13:02:10.807476  8398 raft_consensus.cc:3060] T a1946cc2deaa4799be02943612a39b16 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:10.807035  9137 raft_consensus.cc:515] T 62a3aed976de4d62a1d4dc7bc5252328 P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:10.810271  9137 leader_election.cc:290] T 62a3aed976de4d62a1d4dc7bc5252328 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 2 election: Requested vote from peers 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
W20260709 13:02:10.811167  8445 leader_election.cc:336] T a1946cc2deaa4799be02943612a39b16 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111)
I20260709 13:02:10.805419  9056 raft_consensus.cc:515] T e8bdd44ba5144cadada8b14a380f995a P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:10.814055  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62a3aed976de4d62a1d4dc7bc5252328" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5"
I20260709 13:02:10.814667  8474 raft_consensus.cc:3060] T 62a3aed976de4d62a1d4dc7bc5252328 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:02:10.816814  8519 leader_election.cc:336] T e8bdd44ba5144cadada8b14a380f995a P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111)
W20260709 13:02:10.823585  8519 leader_election.cc:336] T 62a3aed976de4d62a1d4dc7bc5252328 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111)
I20260709 13:02:10.823820  8549 raft_consensus.cc:2468] T 4f93b4088ce1421cb59ed9a917919b22 P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53a66c851dc74c70b94c65d464a391f6 in term 2.
I20260709 13:02:10.827811  8369 leader_election.cc:304] T 4f93b4088ce1421cb59ed9a917919b22 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, b560e9aaec7a4c78b9123b38e73519a3; no voters: 590ee39ce5734876b94d91fc3931b807
I20260709 13:02:10.830228  9045 raft_consensus.cc:2804] T 4f93b4088ce1421cb59ed9a917919b22 P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:10.830499  8474 raft_consensus.cc:2468] T 62a3aed976de4d62a1d4dc7bc5252328 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 2.
I20260709 13:02:10.839712  9056 leader_election.cc:290] T e8bdd44ba5144cadada8b14a380f995a P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 2 election: Requested vote from peers 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:02:10.843617  8518 leader_election.cc:304] T 62a3aed976de4d62a1d4dc7bc5252328 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b3ea460d1294b8a82672d7c21475cb5, b560e9aaec7a4c78b9123b38e73519a3; no voters: 590ee39ce5734876b94d91fc3931b807
I20260709 13:02:10.841401  8477 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8bdd44ba5144cadada8b14a380f995a" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5"
I20260709 13:02:10.846079  8477 raft_consensus.cc:3060] T e8bdd44ba5144cadada8b14a380f995a P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:10.846922  9056 raft_consensus.cc:2804] T 62a3aed976de4d62a1d4dc7bc5252328 P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:10.847952  9056 raft_consensus.cc:697] T 62a3aed976de4d62a1d4dc7bc5252328 P b560e9aaec7a4c78b9123b38e73519a3 [term 2 LEADER]: Becoming Leader. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Running, Role: LEADER
I20260709 13:02:10.841573  9045 raft_consensus.cc:697] T 4f93b4088ce1421cb59ed9a917919b22 P 53a66c851dc74c70b94c65d464a391f6 [term 2 LEADER]: Becoming Leader. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Running, Role: LEADER
I20260709 13:02:10.854851  9045 consensus_queue.cc:237] T 4f93b4088ce1421cb59ed9a917919b22 P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:10.856781  8398 raft_consensus.cc:2468] T a1946cc2deaa4799be02943612a39b16 P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b3ea460d1294b8a82672d7c21475cb5 in term 2.
I20260709 13:02:10.857028  9056 consensus_queue.cc:237] T 62a3aed976de4d62a1d4dc7bc5252328 P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
W20260709 13:02:10.860222  8519 leader_election.cc:336] T e8bdd44ba5144cadada8b14a380f995a P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111)
I20260709 13:02:10.875449  8477 raft_consensus.cc:2468] T e8bdd44ba5144cadada8b14a380f995a P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 2.
I20260709 13:02:10.889654  8518 leader_election.cc:304] T e8bdd44ba5144cadada8b14a380f995a P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7b3ea460d1294b8a82672d7c21475cb5, b560e9aaec7a4c78b9123b38e73519a3; no voters: 590ee39ce5734876b94d91fc3931b807
I20260709 13:02:10.890857  9137 raft_consensus.cc:2804] T e8bdd44ba5144cadada8b14a380f995a P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:10.891476  9137 raft_consensus.cc:697] T e8bdd44ba5144cadada8b14a380f995a P b560e9aaec7a4c78b9123b38e73519a3 [term 2 LEADER]: Becoming Leader. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Running, Role: LEADER
I20260709 13:02:10.895273  8224 catalog_manager.cc:5697] T 62a3aed976de4d62a1d4dc7bc5252328 P b560e9aaec7a4c78b9123b38e73519a3 reported cstate change: term changed from 1 to 2, leader changed from 590ee39ce5734876b94d91fc3931b807 (127.0.107.193) to b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "b560e9aaec7a4c78b9123b38e73519a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:10.898479  8226 catalog_manager.cc:5697] T 8e53899e04fe4f58b666f67ac07bbf79 P 53a66c851dc74c70b94c65d464a391f6 reported cstate change: term changed from 1 to 2, leader changed from 590ee39ce5734876b94d91fc3931b807 (127.0.107.193) to 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "53a66c851dc74c70b94c65d464a391f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:10.892485  9137 consensus_queue.cc:237] T e8bdd44ba5144cadada8b14a380f995a P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:10.901018  9149 raft_consensus.cc:515] T cd24f768f33e40bba3406e8dde3f45cc P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:10.902292  9184 raft_consensus.cc:493] T da02fa98f6de48a7baefadf6e69d2046 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 590ee39ce5734876b94d91fc3931b807)
I20260709 13:02:10.903043  9184 raft_consensus.cc:515] T da02fa98f6de48a7baefadf6e69d2046 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:10.903503  9149 leader_election.cc:290] T cd24f768f33e40bba3406e8dde3f45cc P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 2 election: Requested vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:02:10.904748  8444 leader_election.cc:304] T a1946cc2deaa4799be02943612a39b16 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, 7b3ea460d1294b8a82672d7c21475cb5; no voters: 590ee39ce5734876b94d91fc3931b807
I20260709 13:02:10.906280  9054 raft_consensus.cc:2804] T a1946cc2deaa4799be02943612a39b16 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:10.906821  9054 raft_consensus.cc:697] T a1946cc2deaa4799be02943612a39b16 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 LEADER]: Becoming Leader. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Running, Role: LEADER
I20260709 13:02:10.907624  9184 leader_election.cc:290] T da02fa98f6de48a7baefadf6e69d2046 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:02:10.907907  9054 consensus_queue.cc:237] T a1946cc2deaa4799be02943612a39b16 P 7b3ea460d1294b8a82672d7c21475cb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:10.909783  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd24f768f33e40bba3406e8dde3f45cc" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3"
I20260709 13:02:10.910430  8546 raft_consensus.cc:3060] T cd24f768f33e40bba3406e8dde3f45cc P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:10.912474  9148 tablet_bootstrap.cc:492] T 610562885f5849d083ac5f7a85011891 P 590ee39ce5734876b94d91fc3931b807: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:10.914799  9148 tablet_bootstrap.cc:492] T 610562885f5849d083ac5f7a85011891 P 590ee39ce5734876b94d91fc3931b807: Bootstrap complete.
I20260709 13:02:10.915501  9148 ts_tablet_manager.cc:1403] T 610562885f5849d083ac5f7a85011891 P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.131s	user 0.010s	sys 0.012s
I20260709 13:02:10.917022  8549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da02fa98f6de48a7baefadf6e69d2046" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3" is_pre_election: true
I20260709 13:02:10.917723  8549 raft_consensus.cc:2468] T da02fa98f6de48a7baefadf6e69d2046 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53a66c851dc74c70b94c65d464a391f6 in term 1.
I20260709 13:02:10.915548  9184 raft_consensus.cc:493] T 30e220d65bed42489b2af858d3a60981 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 590ee39ce5734876b94d91fc3931b807)
I20260709 13:02:10.921509  9184 raft_consensus.cc:515] T 30e220d65bed42489b2af858d3a60981 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:10.921893  8546 raft_consensus.cc:2468] T cd24f768f33e40bba3406e8dde3f45cc P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53a66c851dc74c70b94c65d464a391f6 in term 2.
I20260709 13:02:10.922811  9136 raft_consensus.cc:493] T a1667ac154454613a9047f56ee087405 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 590ee39ce5734876b94d91fc3931b807)
I20260709 13:02:10.924170  8369 leader_election.cc:304] T da02fa98f6de48a7baefadf6e69d2046 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, b560e9aaec7a4c78b9123b38e73519a3; no voters: 
I20260709 13:02:10.925899  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e220d65bed42489b2af858d3a60981" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
I20260709 13:02:10.927088  8476 raft_consensus.cc:2468] T 30e220d65bed42489b2af858d3a60981 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53a66c851dc74c70b94c65d464a391f6 in term 1.
I20260709 13:02:10.923480  9136 raft_consensus.cc:515] T a1667ac154454613a9047f56ee087405 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:10.928177  8370 leader_election.cc:304] T 30e220d65bed42489b2af858d3a60981 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, 7b3ea460d1294b8a82672d7c21475cb5; no voters: 
I20260709 13:02:10.928514  9045 raft_consensus.cc:2804] T da02fa98f6de48a7baefadf6e69d2046 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:10.928998  9045 raft_consensus.cc:493] T da02fa98f6de48a7baefadf6e69d2046 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 590ee39ce5734876b94d91fc3931b807)
I20260709 13:02:10.929359  9045 raft_consensus.cc:3060] T da02fa98f6de48a7baefadf6e69d2046 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:10.929554  9185 raft_consensus.cc:2804] T 30e220d65bed42489b2af858d3a60981 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:10.930019  9185 raft_consensus.cc:493] T 30e220d65bed42489b2af858d3a60981 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 590ee39ce5734876b94d91fc3931b807)
I20260709 13:02:10.930444  9185 raft_consensus.cc:3060] T 30e220d65bed42489b2af858d3a60981 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:10.929869  9136 leader_election.cc:290] T a1667ac154454613a9047f56ee087405 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:02:10.931272  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1667ac154454613a9047f56ee087405" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
I20260709 13:02:10.932045  8476 raft_consensus.cc:2468] T a1667ac154454613a9047f56ee087405 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53a66c851dc74c70b94c65d464a391f6 in term 1.
I20260709 13:02:10.934188  9148 raft_consensus.cc:359] T 610562885f5849d083ac5f7a85011891 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:10.934887  9148 raft_consensus.cc:740] T 610562885f5849d083ac5f7a85011891 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:10.935570  9148 consensus_queue.cc:260] T 610562885f5849d083ac5f7a85011891 P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:10.936990  8370 leader_election.cc:304] T a1667ac154454613a9047f56ee087405 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, 7b3ea460d1294b8a82672d7c21475cb5; no voters: 
I20260709 13:02:10.937801  9136 raft_consensus.cc:2804] T a1667ac154454613a9047f56ee087405 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:10.938187  9136 raft_consensus.cc:493] T a1667ac154454613a9047f56ee087405 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 590ee39ce5734876b94d91fc3931b807)
I20260709 13:02:10.938545  9136 raft_consensus.cc:3060] T a1667ac154454613a9047f56ee087405 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:10.927711  8369 leader_election.cc:304] T cd24f768f33e40bba3406e8dde3f45cc P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, b560e9aaec7a4c78b9123b38e73519a3; no voters: 
I20260709 13:02:10.926434  9184 leader_election.cc:290] T 30e220d65bed42489b2af858d3a60981 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:02:10.945891  9149 raft_consensus.cc:2804] T cd24f768f33e40bba3406e8dde3f45cc P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:10.948753  9149 raft_consensus.cc:697] T cd24f768f33e40bba3406e8dde3f45cc P 53a66c851dc74c70b94c65d464a391f6 [term 2 LEADER]: Becoming Leader. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Running, Role: LEADER
I20260709 13:02:10.951807  9148 ts_tablet_manager.cc:1434] T 610562885f5849d083ac5f7a85011891 P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.000s
I20260709 13:02:10.955737  9148 tablet_bootstrap.cc:492] T b574d11894634755bd89c530b4155f1e P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:10.955622  9136 raft_consensus.cc:515] T a1667ac154454613a9047f56ee087405 P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:10.953123  9149 consensus_queue.cc:237] T cd24f768f33e40bba3406e8dde3f45cc P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
W20260709 13:02:10.977739  8371 leader_election.cc:336] T cd24f768f33e40bba3406e8dde3f45cc P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111)
I20260709 13:02:10.975445  9045 raft_consensus.cc:515] T da02fa98f6de48a7baefadf6e69d2046 P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:10.994192  9136 leader_election.cc:290] T a1667ac154454613a9047f56ee087405 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 2 election: Requested vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:02:10.994405  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1667ac154454613a9047f56ee087405" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5"
I20260709 13:02:10.995119  8474 raft_consensus.cc:3060] T a1667ac154454613a9047f56ee087405 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:10.996302  9045 leader_election.cc:290] T da02fa98f6de48a7baefadf6e69d2046 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 2 election: Requested vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:02:11.000735  8549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da02fa98f6de48a7baefadf6e69d2046" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3"
I20260709 13:02:11.001549  8549 raft_consensus.cc:3060] T da02fa98f6de48a7baefadf6e69d2046 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:11.006799  8474 raft_consensus.cc:2468] T a1667ac154454613a9047f56ee087405 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53a66c851dc74c70b94c65d464a391f6 in term 2.
I20260709 13:02:11.009552  8370 leader_election.cc:304] T a1667ac154454613a9047f56ee087405 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, 7b3ea460d1294b8a82672d7c21475cb5; no voters: 
I20260709 13:02:11.010288  8549 raft_consensus.cc:2468] T da02fa98f6de48a7baefadf6e69d2046 P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53a66c851dc74c70b94c65d464a391f6 in term 2.
W20260709 13:02:11.012454  8371 leader_election.cc:336] T da02fa98f6de48a7baefadf6e69d2046 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111)
W20260709 13:02:11.013780  8371 leader_election.cc:336] T 30e220d65bed42489b2af858d3a60981 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111)
W20260709 13:02:11.014730  8371 leader_election.cc:336] T a1667ac154454613a9047f56ee087405 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111)
I20260709 13:02:11.014786  8369 leader_election.cc:304] T da02fa98f6de48a7baefadf6e69d2046 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, b560e9aaec7a4c78b9123b38e73519a3; no voters: 
I20260709 13:02:11.018936  9148 tablet_bootstrap.cc:492] T b574d11894634755bd89c530b4155f1e P 590ee39ce5734876b94d91fc3931b807: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:11.020016  9148 tablet_bootstrap.cc:492] T b574d11894634755bd89c530b4155f1e P 590ee39ce5734876b94d91fc3931b807: Bootstrap complete.
I20260709 13:02:11.020711  9148 ts_tablet_manager.cc:1403] T b574d11894634755bd89c530b4155f1e P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.065s	user 0.016s	sys 0.003s
I20260709 13:02:11.024434  9183 raft_consensus.cc:2804] T a1667ac154454613a9047f56ee087405 P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:11.025072  9183 raft_consensus.cc:697] T a1667ac154454613a9047f56ee087405 P 53a66c851dc74c70b94c65d464a391f6 [term 2 LEADER]: Becoming Leader. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Running, Role: LEADER
I20260709 13:02:11.026233  9190 raft_consensus.cc:2804] T da02fa98f6de48a7baefadf6e69d2046 P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:11.026067  9183 consensus_queue.cc:237] T a1667ac154454613a9047f56ee087405 P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:11.027047  9190 raft_consensus.cc:697] T da02fa98f6de48a7baefadf6e69d2046 P 53a66c851dc74c70b94c65d464a391f6 [term 2 LEADER]: Becoming Leader. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Running, Role: LEADER
I20260709 13:02:11.028476  9190 consensus_queue.cc:237] T da02fa98f6de48a7baefadf6e69d2046 P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:11.030033  8228 catalog_manager.cc:5697] T a1946cc2deaa4799be02943612a39b16 P 7b3ea460d1294b8a82672d7c21475cb5 reported cstate change: term changed from 1 to 2, leader changed from 590ee39ce5734876b94d91fc3931b807 (127.0.107.193) to 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "7b3ea460d1294b8a82672d7c21475cb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:11.063369  8371 leader_election.cc:336] T a1667ac154454613a9047f56ee087405 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111)
W20260709 13:02:11.065114  8371 leader_election.cc:336] T da02fa98f6de48a7baefadf6e69d2046 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111)
I20260709 13:02:10.992009  9185 raft_consensus.cc:515] T 30e220d65bed42489b2af858d3a60981 P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:11.070781  9185 leader_election.cc:290] T 30e220d65bed42489b2af858d3a60981 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 2 election: Requested vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:02:11.080844  8224 catalog_manager.cc:5697] T e8bdd44ba5144cadada8b14a380f995a P b560e9aaec7a4c78b9123b38e73519a3 reported cstate change: term changed from 1 to 2, leader changed from 590ee39ce5734876b94d91fc3931b807 (127.0.107.193) to b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196). New cstate: current_term: 2 leader_uuid: "b560e9aaec7a4c78b9123b38e73519a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:11.084237  9148 raft_consensus.cc:359] T b574d11894634755bd89c530b4155f1e P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:11.090495  9148 raft_consensus.cc:740] T b574d11894634755bd89c530b4155f1e P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.098423  9148 consensus_queue.cc:260] T b574d11894634755bd89c530b4155f1e P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:11.108990  9148 ts_tablet_manager.cc:1434] T b574d11894634755bd89c530b4155f1e P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.088s	user 0.009s	sys 0.000s
I20260709 13:02:11.113088  9148 tablet_bootstrap.cc:492] T b1d8e928d8444f77ac2950eab2115f65 P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:11.085897  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e220d65bed42489b2af858d3a60981" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5"
W20260709 13:02:11.130812  8371 leader_election.cc:336] T 30e220d65bed42489b2af858d3a60981 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111)
I20260709 13:02:11.134017  8399 raft_consensus.cc:1275] T b1d8e928d8444f77ac2950eab2115f65 P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Refusing update from remote peer 7b3ea460d1294b8a82672d7c21475cb5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:11.136778  9122 consensus_queue.cc:1048] T b1d8e928d8444f77ac2950eab2115f65 P 7b3ea460d1294b8a82672d7c21475cb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:11.115593  8474 raft_consensus.cc:3060] T 30e220d65bed42489b2af858d3a60981 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:02:11.151592  8445 consensus_peers.cc:597] T b1d8e928d8444f77ac2950eab2115f65 P 7b3ea460d1294b8a82672d7c21475cb5 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:11.156430  8228 catalog_manager.cc:5697] T cd24f768f33e40bba3406e8dde3f45cc P 53a66c851dc74c70b94c65d464a391f6 reported cstate change: term changed from 1 to 2, leader changed from 590ee39ce5734876b94d91fc3931b807 (127.0.107.193) to 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "53a66c851dc74c70b94c65d464a391f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:11.160516  8228 catalog_manager.cc:5697] T 4f93b4088ce1421cb59ed9a917919b22 P 53a66c851dc74c70b94c65d464a391f6 reported cstate change: term changed from 1 to 2, leader changed from 590ee39ce5734876b94d91fc3931b807 (127.0.107.193) to 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "53a66c851dc74c70b94c65d464a391f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:11.193898  9148 tablet_bootstrap.cc:492] T b1d8e928d8444f77ac2950eab2115f65 P 590ee39ce5734876b94d91fc3931b807: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:11.195001  9148 tablet_bootstrap.cc:492] T b1d8e928d8444f77ac2950eab2115f65 P 590ee39ce5734876b94d91fc3931b807: Bootstrap complete.
I20260709 13:02:11.195645  9148 ts_tablet_manager.cc:1403] T b1d8e928d8444f77ac2950eab2115f65 P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.083s	user 0.025s	sys 0.009s
I20260709 13:02:11.198307  9148 raft_consensus.cc:359] T b1d8e928d8444f77ac2950eab2115f65 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:11.198953  9148 raft_consensus.cc:740] T b1d8e928d8444f77ac2950eab2115f65 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.199628  9148 consensus_queue.cc:260] T b1d8e928d8444f77ac2950eab2115f65 P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:11.162452  8228 catalog_manager.cc:5697] T a1667ac154454613a9047f56ee087405 P 53a66c851dc74c70b94c65d464a391f6 reported cstate change: term changed from 1 to 2, leader changed from 590ee39ce5734876b94d91fc3931b807 (127.0.107.193) to 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "53a66c851dc74c70b94c65d464a391f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:11.201848  9148 ts_tablet_manager.cc:1434] T b1d8e928d8444f77ac2950eab2115f65 P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:02:11.202651  9148 tablet_bootstrap.cc:492] T e1f344d27b0b44819ef6d23574175c26 P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:11.202175  8228 catalog_manager.cc:5697] T da02fa98f6de48a7baefadf6e69d2046 P 53a66c851dc74c70b94c65d464a391f6 reported cstate change: term changed from 1 to 2, leader changed from 590ee39ce5734876b94d91fc3931b807 (127.0.107.193) to 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "53a66c851dc74c70b94c65d464a391f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:11.234146  8477 raft_consensus.cc:1275] T 8e53899e04fe4f58b666f67ac07bbf79 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Refusing update from remote peer 53a66c851dc74c70b94c65d464a391f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:11.236673  9148 tablet_bootstrap.cc:492] T e1f344d27b0b44819ef6d23574175c26 P 590ee39ce5734876b94d91fc3931b807: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:11.240859  9148 tablet_bootstrap.cc:492] T e1f344d27b0b44819ef6d23574175c26 P 590ee39ce5734876b94d91fc3931b807: Bootstrap complete.
I20260709 13:02:11.241940  9148 ts_tablet_manager.cc:1403] T e1f344d27b0b44819ef6d23574175c26 P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.039s	user 0.017s	sys 0.003s
I20260709 13:02:11.238895  8474 raft_consensus.cc:2468] T 30e220d65bed42489b2af858d3a60981 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53a66c851dc74c70b94c65d464a391f6 in term 2.
I20260709 13:02:11.249123  8477 raft_consensus.cc:1275] T 62a3aed976de4d62a1d4dc7bc5252328 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Refusing update from remote peer b560e9aaec7a4c78b9123b38e73519a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:11.251483  9134 consensus_queue.cc:1048] T 62a3aed976de4d62a1d4dc7bc5252328 P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:11.252786  8370 leader_election.cc:304] T 30e220d65bed42489b2af858d3a60981 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, 7b3ea460d1294b8a82672d7c21475cb5; no voters: 590ee39ce5734876b94d91fc3931b807
I20260709 13:02:11.254088  9149 raft_consensus.cc:2804] T 30e220d65bed42489b2af858d3a60981 P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:11.254623  9149 raft_consensus.cc:697] T 30e220d65bed42489b2af858d3a60981 P 53a66c851dc74c70b94c65d464a391f6 [term 2 LEADER]: Becoming Leader. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Running, Role: LEADER
I20260709 13:02:11.255610  9149 consensus_queue.cc:237] T 30e220d65bed42489b2af858d3a60981 P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:11.258111  9148 raft_consensus.cc:359] T e1f344d27b0b44819ef6d23574175c26 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:11.258890  9148 raft_consensus.cc:740] T e1f344d27b0b44819ef6d23574175c26 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.260509  9148 consensus_queue.cc:260] T e1f344d27b0b44819ef6d23574175c26 P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:11.263125  9148 ts_tablet_manager.cc:1434] T e1f344d27b0b44819ef6d23574175c26 P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 13:02:11.264153  9148 tablet_bootstrap.cc:492] T 5a94bf713e4848879b9e2a1bbec03def P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:11.243065  9183 consensus_queue.cc:1048] T 8e53899e04fe4f58b666f67ac07bbf79 P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:02:11.294974  8224 catalog_manager.cc:5697] T 30e220d65bed42489b2af858d3a60981 P 53a66c851dc74c70b94c65d464a391f6 reported cstate change: term changed from 1 to 2, leader changed from 590ee39ce5734876b94d91fc3931b807 (127.0.107.193) to 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "53a66c851dc74c70b94c65d464a391f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:11.297863  8371 consensus_peers.cc:597] T 8e53899e04fe4f58b666f67ac07bbf79 P 53a66c851dc74c70b94c65d464a391f6 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:11.326632  8519 consensus_peers.cc:597] T 62a3aed976de4d62a1d4dc7bc5252328 P b560e9aaec7a4c78b9123b38e73519a3 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:11.357970  8549 raft_consensus.cc:1275] T 4f93b4088ce1421cb59ed9a917919b22 P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Refusing update from remote peer 53a66c851dc74c70b94c65d464a391f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:02:11.358982  8371 consensus_peers.cc:597] T 4f93b4088ce1421cb59ed9a917919b22 P 53a66c851dc74c70b94c65d464a391f6 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:11.360395  9185 consensus_queue.cc:1048] T 4f93b4088ce1421cb59ed9a917919b22 P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:11.368964  8477 raft_consensus.cc:1275] T e8bdd44ba5144cadada8b14a380f995a P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Refusing update from remote peer b560e9aaec7a4c78b9123b38e73519a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:11.373183  9056 consensus_queue.cc:1048] T e8bdd44ba5144cadada8b14a380f995a P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:11.381160  9148 tablet_bootstrap.cc:492] T 5a94bf713e4848879b9e2a1bbec03def P 590ee39ce5734876b94d91fc3931b807: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:11.382284  9148 tablet_bootstrap.cc:492] T 5a94bf713e4848879b9e2a1bbec03def P 590ee39ce5734876b94d91fc3931b807: Bootstrap complete.
I20260709 13:02:11.383280  9148 ts_tablet_manager.cc:1403] T 5a94bf713e4848879b9e2a1bbec03def P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.119s	user 0.033s	sys 0.012s
I20260709 13:02:11.386657  9148 raft_consensus.cc:359] T 5a94bf713e4848879b9e2a1bbec03def P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:11.387395  9148 raft_consensus.cc:740] T 5a94bf713e4848879b9e2a1bbec03def P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.388372  9148 consensus_queue.cc:260] T 5a94bf713e4848879b9e2a1bbec03def P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:11.390825  9148 ts_tablet_manager.cc:1434] T 5a94bf713e4848879b9e2a1bbec03def P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:02:11.391664  9148 tablet_bootstrap.cc:492] T 62a3aed976de4d62a1d4dc7bc5252328 P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:11.415164  8546 raft_consensus.cc:1275] T cd24f768f33e40bba3406e8dde3f45cc P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Refusing update from remote peer 53a66c851dc74c70b94c65d464a391f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:11.418551  9185 consensus_queue.cc:1048] T cd24f768f33e40bba3406e8dde3f45cc P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:02:11.421345  8519 consensus_peers.cc:597] T e8bdd44ba5144cadada8b14a380f995a P b560e9aaec7a4c78b9123b38e73519a3 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:11.441264  8549 raft_consensus.cc:1275] T da02fa98f6de48a7baefadf6e69d2046 P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Refusing update from remote peer 53a66c851dc74c70b94c65d464a391f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:11.444504  9185 consensus_queue.cc:1048] T da02fa98f6de48a7baefadf6e69d2046 P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:02:11.445608  8371 consensus_peers.cc:597] T a1667ac154454613a9047f56ee087405 P 53a66c851dc74c70b94c65d464a391f6 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:11.447297  9148 tablet_bootstrap.cc:492] T 62a3aed976de4d62a1d4dc7bc5252328 P 590ee39ce5734876b94d91fc3931b807: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:11.448343  9148 tablet_bootstrap.cc:492] T 62a3aed976de4d62a1d4dc7bc5252328 P 590ee39ce5734876b94d91fc3931b807: Bootstrap complete.
I20260709 13:02:11.449072  9148 ts_tablet_manager.cc:1403] T 62a3aed976de4d62a1d4dc7bc5252328 P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.058s	user 0.011s	sys 0.008s
I20260709 13:02:11.452128  9148 raft_consensus.cc:359] T 62a3aed976de4d62a1d4dc7bc5252328 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:11.453133  9148 raft_consensus.cc:740] T 62a3aed976de4d62a1d4dc7bc5252328 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.453908  9148 consensus_queue.cc:260] T 62a3aed976de4d62a1d4dc7bc5252328 P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:11.456035  9148 ts_tablet_manager.cc:1434] T 62a3aed976de4d62a1d4dc7bc5252328 P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:02:11.456805  9148 tablet_bootstrap.cc:492] T a79ccdf7d9cf4be7bf8b0c69bf90538a P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:11.458117  8398 raft_consensus.cc:1275] T a1946cc2deaa4799be02943612a39b16 P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Refusing update from remote peer 7b3ea460d1294b8a82672d7c21475cb5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:11.467427  9159 consensus_queue.cc:1048] T a1946cc2deaa4799be02943612a39b16 P 7b3ea460d1294b8a82672d7c21475cb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:11.472267  8477 raft_consensus.cc:1275] T a1667ac154454613a9047f56ee087405 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Refusing update from remote peer 53a66c851dc74c70b94c65d464a391f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:11.474033  9045 consensus_queue.cc:1048] T a1667ac154454613a9047f56ee087405 P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:11.479432  9148 tablet_bootstrap.cc:492] T a79ccdf7d9cf4be7bf8b0c69bf90538a P 590ee39ce5734876b94d91fc3931b807: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:11.480697  9148 tablet_bootstrap.cc:492] T a79ccdf7d9cf4be7bf8b0c69bf90538a P 590ee39ce5734876b94d91fc3931b807: Bootstrap complete.
I20260709 13:02:11.481511  9148 ts_tablet_manager.cc:1403] T a79ccdf7d9cf4be7bf8b0c69bf90538a P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.025s	user 0.015s	sys 0.007s
W20260709 13:02:11.482128  8371 consensus_peers.cc:597] T cd24f768f33e40bba3406e8dde3f45cc P 53a66c851dc74c70b94c65d464a391f6 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:11.484865  9148 raft_consensus.cc:359] T a79ccdf7d9cf4be7bf8b0c69bf90538a P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:11.485631  9148 raft_consensus.cc:740] T a79ccdf7d9cf4be7bf8b0c69bf90538a P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.486580  9148 consensus_queue.cc:260] T a79ccdf7d9cf4be7bf8b0c69bf90538a P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:11.488790  9148 ts_tablet_manager.cc:1434] T a79ccdf7d9cf4be7bf8b0c69bf90538a P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:02:11.489521  9148 tablet_bootstrap.cc:492] T e8353e508def43e5a8008bb63ff1a84a P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
W20260709 13:02:11.507079  8445 consensus_peers.cc:597] T a1946cc2deaa4799be02943612a39b16 P 7b3ea460d1294b8a82672d7c21475cb5 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:11.511135  8371 consensus_peers.cc:597] T da02fa98f6de48a7baefadf6e69d2046 P 53a66c851dc74c70b94c65d464a391f6 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:11.516790  9148 tablet_bootstrap.cc:492] T e8353e508def43e5a8008bb63ff1a84a P 590ee39ce5734876b94d91fc3931b807: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:11.518151  9148 tablet_bootstrap.cc:492] T e8353e508def43e5a8008bb63ff1a84a P 590ee39ce5734876b94d91fc3931b807: Bootstrap complete.
I20260709 13:02:11.518982  9148 ts_tablet_manager.cc:1403] T e8353e508def43e5a8008bb63ff1a84a P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.030s	user 0.015s	sys 0.007s
I20260709 13:02:11.522035  9148 raft_consensus.cc:359] T e8353e508def43e5a8008bb63ff1a84a P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:11.522650  9148 raft_consensus.cc:740] T e8353e508def43e5a8008bb63ff1a84a P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.523445  9148 consensus_queue.cc:260] T e8353e508def43e5a8008bb63ff1a84a P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:11.525487  9148 ts_tablet_manager.cc:1434] T e8353e508def43e5a8008bb63ff1a84a P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:02:11.526353  9148 tablet_bootstrap.cc:492] T cb85497b295d4b3f8cda882af3676c65 P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:11.558132  9148 tablet_bootstrap.cc:492] T cb85497b295d4b3f8cda882af3676c65 P 590ee39ce5734876b94d91fc3931b807: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:11.559233  9148 tablet_bootstrap.cc:492] T cb85497b295d4b3f8cda882af3676c65 P 590ee39ce5734876b94d91fc3931b807: Bootstrap complete.
I20260709 13:02:11.560053  9148 ts_tablet_manager.cc:1403] T cb85497b295d4b3f8cda882af3676c65 P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.034s	user 0.014s	sys 0.008s
I20260709 13:02:11.563445  9148 raft_consensus.cc:359] T cb85497b295d4b3f8cda882af3676c65 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:11.564095  9148 raft_consensus.cc:740] T cb85497b295d4b3f8cda882af3676c65 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.564898  9148 consensus_queue.cc:260] T cb85497b295d4b3f8cda882af3676c65 P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:11.568168  9148 ts_tablet_manager.cc:1434] T cb85497b295d4b3f8cda882af3676c65 P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:02:11.568946  9148 tablet_bootstrap.cc:492] T 6433163abeff4ee0b011d159ca454a6a P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:11.585605  9148 tablet_bootstrap.cc:492] T 6433163abeff4ee0b011d159ca454a6a P 590ee39ce5734876b94d91fc3931b807: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:11.586534  9148 tablet_bootstrap.cc:492] T 6433163abeff4ee0b011d159ca454a6a P 590ee39ce5734876b94d91fc3931b807: Bootstrap complete.
I20260709 13:02:11.587119  9148 ts_tablet_manager.cc:1403] T 6433163abeff4ee0b011d159ca454a6a P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.004s
I20260709 13:02:11.589548  9148 raft_consensus.cc:359] T 6433163abeff4ee0b011d159ca454a6a P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:11.590437  9148 raft_consensus.cc:740] T 6433163abeff4ee0b011d159ca454a6a P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.591202  9148 consensus_queue.cc:260] T 6433163abeff4ee0b011d159ca454a6a P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:11.593704  9148 ts_tablet_manager.cc:1434] T 6433163abeff4ee0b011d159ca454a6a P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:02:11.594645  9148 tablet_bootstrap.cc:492] T 45171bd0207f452f9884a58c225ddb72 P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:11.634315  9148 tablet_bootstrap.cc:492] T 45171bd0207f452f9884a58c225ddb72 P 590ee39ce5734876b94d91fc3931b807: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:11.635247  9148 tablet_bootstrap.cc:492] T 45171bd0207f452f9884a58c225ddb72 P 590ee39ce5734876b94d91fc3931b807: Bootstrap complete.
I20260709 13:02:11.635835  9148 ts_tablet_manager.cc:1403] T 45171bd0207f452f9884a58c225ddb72 P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.041s	user 0.008s	sys 0.013s
I20260709 13:02:11.639235  9148 raft_consensus.cc:359] T 45171bd0207f452f9884a58c225ddb72 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:11.640384  9148 raft_consensus.cc:740] T 45171bd0207f452f9884a58c225ddb72 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.642547  9148 consensus_queue.cc:260] T 45171bd0207f452f9884a58c225ddb72 P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:11.645180  9148 ts_tablet_manager.cc:1434] T 45171bd0207f452f9884a58c225ddb72 P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 13:02:11.645911  9148 tablet_bootstrap.cc:492] T 8e53899e04fe4f58b666f67ac07bbf79 P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
W20260709 13:02:11.664364  8371 consensus_peers.cc:597] T a3a46de7366f4683a88d19d25ad04901 P 53a66c851dc74c70b94c65d464a391f6 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:11.680766  9151 raft_consensus.cc:493] T 1162036be6064d5c821df6a7aa486bab P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:02:11.680833  8445 consensus_peers.cc:597] T 6fffc940549b445c973a289ba1bebcb3 P 7b3ea460d1294b8a82672d7c21475cb5 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:11.681531  9151 raft_consensus.cc:515] T 1162036be6064d5c821df6a7aa486bab P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:11.692772  9151 leader_election.cc:290] T 1162036be6064d5c821df6a7aa486bab P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:02:11.718376  9148 tablet_bootstrap.cc:492] T 8e53899e04fe4f58b666f67ac07bbf79 P 590ee39ce5734876b94d91fc3931b807: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:11.719483  9148 tablet_bootstrap.cc:492] T 8e53899e04fe4f58b666f67ac07bbf79 P 590ee39ce5734876b94d91fc3931b807: Bootstrap complete.
I20260709 13:02:11.720152  9148 ts_tablet_manager.cc:1403] T 8e53899e04fe4f58b666f67ac07bbf79 P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.074s	user 0.026s	sys 0.012s
I20260709 13:02:11.729532  9148 raft_consensus.cc:359] T 8e53899e04fe4f58b666f67ac07bbf79 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:11.731014  9148 raft_consensus.cc:740] T 8e53899e04fe4f58b666f67ac07bbf79 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.731837  9148 consensus_queue.cc:260] T 8e53899e04fe4f58b666f67ac07bbf79 P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:11.734158  9148 ts_tablet_manager.cc:1434] T 8e53899e04fe4f58b666f67ac07bbf79 P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.003s
I20260709 13:02:11.735059  9148 tablet_bootstrap.cc:492] T cea53371e56d4a668406dcd8f5a93dcb P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:11.737186  8549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1162036be6064d5c821df6a7aa486bab" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3" is_pre_election: true
I20260709 13:02:11.746536  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1162036be6064d5c821df6a7aa486bab" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:02:11.749037  9144 leader_election.cc:304] T 1162036be6064d5c821df6a7aa486bab P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807; no voters: 53a66c851dc74c70b94c65d464a391f6, b560e9aaec7a4c78b9123b38e73519a3
I20260709 13:02:11.750785  9151 raft_consensus.cc:493] T 53842ab4d1d748bda0c7f0d933e5a785 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.751427  9151 raft_consensus.cc:515] T 53842ab4d1d748bda0c7f0d933e5a785 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:11.751470  9270 raft_consensus.cc:2749] T 1162036be6064d5c821df6a7aa486bab P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:11.754570  9151 leader_election.cc:290] T 53842ab4d1d748bda0c7f0d933e5a785 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:02:11.756860  9148 tablet_bootstrap.cc:492] T cea53371e56d4a668406dcd8f5a93dcb P 590ee39ce5734876b94d91fc3931b807: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:11.758059  9148 tablet_bootstrap.cc:492] T cea53371e56d4a668406dcd8f5a93dcb P 590ee39ce5734876b94d91fc3931b807: Bootstrap complete.
I20260709 13:02:11.758924  9148 ts_tablet_manager.cc:1403] T cea53371e56d4a668406dcd8f5a93dcb P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.004s
I20260709 13:02:11.759092  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842ab4d1d748bda0c7f0d933e5a785" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:02:11.766594  9148 raft_consensus.cc:359] T cea53371e56d4a668406dcd8f5a93dcb P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:11.767596  9148 raft_consensus.cc:740] T cea53371e56d4a668406dcd8f5a93dcb P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.769157   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:40837
I20260709 13:02:11.769482  9269 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:40837 every 8 connection(s)
I20260709 13:02:11.770411  9148 consensus_queue.cc:260] T cea53371e56d4a668406dcd8f5a93dcb P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:11.773468  9148 ts_tablet_manager.cc:1434] T cea53371e56d4a668406dcd8f5a93dcb P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:02:11.774749  9148 tablet_bootstrap.cc:492] T 52f213b355c14b45a13d7cf5b3e76efe P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:11.784278  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53842ab4d1d748bda0c7f0d933e5a785" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
I20260709 13:02:11.788128  9144 leader_election.cc:304] T 53842ab4d1d748bda0c7f0d933e5a785 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807; no voters: 53a66c851dc74c70b94c65d464a391f6, 7b3ea460d1294b8a82672d7c21475cb5
I20260709 13:02:11.790124  9270 raft_consensus.cc:2749] T 53842ab4d1d748bda0c7f0d933e5a785 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:11.794376  9148 tablet_bootstrap.cc:492] T 52f213b355c14b45a13d7cf5b3e76efe P 590ee39ce5734876b94d91fc3931b807: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:11.795593  9148 tablet_bootstrap.cc:492] T 52f213b355c14b45a13d7cf5b3e76efe P 590ee39ce5734876b94d91fc3931b807: Bootstrap complete.
I20260709 13:02:11.796377  9148 ts_tablet_manager.cc:1403] T 52f213b355c14b45a13d7cf5b3e76efe P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.004s
I20260709 13:02:11.800413  9148 raft_consensus.cc:359] T 52f213b355c14b45a13d7cf5b3e76efe P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:11.801247  9148 raft_consensus.cc:740] T 52f213b355c14b45a13d7cf5b3e76efe P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.802065  9148 consensus_queue.cc:260] T 52f213b355c14b45a13d7cf5b3e76efe P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:11.804425  9148 ts_tablet_manager.cc:1434] T 52f213b355c14b45a13d7cf5b3e76efe P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:02:11.805455  9148 tablet_bootstrap.cc:492] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:11.835995  9148 tablet_bootstrap.cc:492] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P 590ee39ce5734876b94d91fc3931b807: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:11.837131  9148 tablet_bootstrap.cc:492] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P 590ee39ce5734876b94d91fc3931b807: Bootstrap complete.
I20260709 13:02:11.837864  9148 ts_tablet_manager.cc:1403] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.016s
I20260709 13:02:11.840564  9148 raft_consensus.cc:359] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:11.841578  9148 raft_consensus.cc:740] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:11.842303  9148 consensus_queue.cc:260] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
W20260709 13:02:11.843640  8371 consensus_peers.cc:597] T d97df5fdb12a439080fa6edc391ebd82 P 53a66c851dc74c70b94c65d464a391f6 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:11.845146  9148 ts_tablet_manager.cc:1434] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:02:11.846135  9148 tablet_bootstrap.cc:492] T a1946cc2deaa4799be02943612a39b16 P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:11.847494  8474 raft_consensus.cc:1275] T 30e220d65bed42489b2af858d3a60981 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Refusing update from remote peer 53a66c851dc74c70b94c65d464a391f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:11.848227  9151 raft_consensus.cc:493] T 4f93b4088ce1421cb59ed9a917919b22 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.850883  9045 consensus_queue.cc:1048] T 30e220d65bed42489b2af858d3a60981 P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:11.851974  9151 raft_consensus.cc:515] T 4f93b4088ce1421cb59ed9a917919b22 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:11.856220  9151 leader_election.cc:290] T 4f93b4088ce1421cb59ed9a917919b22 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:02:11.859789  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f93b4088ce1421cb59ed9a917919b22" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3" is_pre_election: true
I20260709 13:02:11.870499  9226 raft_consensus.cc:3060] T 30e220d65bed42489b2af858d3a60981 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:11.886795  9228 raft_consensus.cc:3060] T 8e53899e04fe4f58b666f67ac07bbf79 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:11.893678  9270 raft_consensus.cc:493] T da02fa98f6de48a7baefadf6e69d2046 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.894546  9270 raft_consensus.cc:515] T da02fa98f6de48a7baefadf6e69d2046 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:11.903208  9270 leader_election.cc:290] T da02fa98f6de48a7baefadf6e69d2046 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:02:11.903748  9270 raft_consensus.cc:493] T a3a46de7366f4683a88d19d25ad04901 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:11.904210  9270 raft_consensus.cc:515] T a3a46de7366f4683a88d19d25ad04901 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:11.906153  9270 leader_election.cc:290] T a3a46de7366f4683a88d19d25ad04901 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:02:11.909931  8549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da02fa98f6de48a7baefadf6e69d2046" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3" is_pre_election: true
I20260709 13:02:11.925073  9225 raft_consensus.cc:3060] T 4f93b4088ce1421cb59ed9a917919b22 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:11.963618  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f93b4088ce1421cb59ed9a917919b22" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:02:11.974393  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da02fa98f6de48a7baefadf6e69d2046" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:02:11.990929  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3a46de7366f4683a88d19d25ad04901" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:02:11.992328  9224 raft_consensus.cc:3060] T da02fa98f6de48a7baefadf6e69d2046 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:12.006340  9222 raft_consensus.cc:3060] T 62a3aed976de4d62a1d4dc7bc5252328 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:11.993499  8474 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a3a46de7366f4683a88d19d25ad04901" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
W20260709 13:02:12.041330  8371 consensus_peers.cc:597] T 5527a2aef01d45cebcfad8a1b0a5273d P 53a66c851dc74c70b94c65d464a391f6 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:12.057768  9226 raft_consensus.cc:1275] T 30e220d65bed42489b2af858d3a60981 P 590ee39ce5734876b94d91fc3931b807 [term 2 FOLLOWER]: Refusing update from remote peer 53a66c851dc74c70b94c65d464a391f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:12.069235  9144 leader_election.cc:304] T da02fa98f6de48a7baefadf6e69d2046 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807; no voters: 53a66c851dc74c70b94c65d464a391f6, b560e9aaec7a4c78b9123b38e73519a3
W20260709 13:02:12.081700  8445 consensus_peers.cc:597] T c63211d1d13a4736adb18dee69b400a3 P 7b3ea460d1294b8a82672d7c21475cb5 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:12.086714  9281 raft_consensus.cc:493] T 5db51a6d67e6461a98e669fa2b1e59c8 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.087543  9281 raft_consensus.cc:515] T 5db51a6d67e6461a98e669fa2b1e59c8 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:12.089144  9226 raft_consensus.cc:3060] T a1667ac154454613a9047f56ee087405 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:12.091562  8549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51a6d67e6461a98e669fa2b1e59c8" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3" is_pre_election: true
I20260709 13:02:12.091836  9281 leader_election.cc:290] T 5db51a6d67e6461a98e669fa2b1e59c8 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
W20260709 13:02:12.104923  8445 consensus_peers.cc:597] T fcc07b65535048fca9045891e1ae0153 P 7b3ea460d1294b8a82672d7c21475cb5 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:12.119347  9221 raft_consensus.cc:3060] T b1d8e928d8444f77ac2950eab2115f65 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:12.126371  9185 consensus_queue.cc:1048] T 30e220d65bed42489b2af858d3a60981 P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:02:12.134042  8445 consensus_peers.cc:597] T d4cd925acef04f3c8910aa1903b760c7 P 7b3ea460d1294b8a82672d7c21475cb5 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:12.140197  9148 tablet_bootstrap.cc:492] T a1946cc2deaa4799be02943612a39b16 P 590ee39ce5734876b94d91fc3931b807: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 13:02:12.131851  9144 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:37751, user_credentials={real_user=slave}} blocked reactor thread for 62715.1us
W20260709 13:02:12.168633  8445 consensus_peers.cc:597] T c6245fdde2e4422581bc418d4840b580 P 7b3ea460d1294b8a82672d7c21475cb5 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:12.213701  8445 consensus_peers.cc:597] T da5b0b01a880412896838e8eb658db7a P 7b3ea460d1294b8a82672d7c21475cb5 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:12.214577  8445 consensus_peers.cc:597] T c66f53044d784114970ae5061755da40 P 7b3ea460d1294b8a82672d7c21475cb5 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:12.218891  9144 leader_election.cc:304] T 4f93b4088ce1421cb59ed9a917919b22 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807; no voters: 53a66c851dc74c70b94c65d464a391f6, b560e9aaec7a4c78b9123b38e73519a3
I20260709 13:02:12.220496  9144 leader_election.cc:304] T a3a46de7366f4683a88d19d25ad04901 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807; no voters: 53a66c851dc74c70b94c65d464a391f6, 7b3ea460d1294b8a82672d7c21475cb5
I20260709 13:02:12.225747  9270 raft_consensus.cc:2749] T a3a46de7366f4683a88d19d25ad04901 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:12.232369  9148 tablet_bootstrap.cc:492] T a1946cc2deaa4799be02943612a39b16 P 590ee39ce5734876b94d91fc3931b807: Bootstrap complete.
I20260709 13:02:12.233237  9148 ts_tablet_manager.cc:1403] T a1946cc2deaa4799be02943612a39b16 P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.387s	user 0.093s	sys 0.138s
I20260709 13:02:12.242842  9148 raft_consensus.cc:359] T a1946cc2deaa4799be02943612a39b16 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
W20260709 13:02:12.237084  8519 consensus_peers.cc:597] T f8ec593f6c894c24a5bc727cfed4190a P b560e9aaec7a4c78b9123b38e73519a3 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:12.243924  9148 raft_consensus.cc:740] T a1946cc2deaa4799be02943612a39b16 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:12.255386  9148 consensus_queue.cc:260] T a1946cc2deaa4799be02943612a39b16 P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:12.257511  9270 raft_consensus.cc:493] T b574d11894634755bd89c530b4155f1e P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:12.265743  9283 raft_consensus.cc:2749] T 4f93b4088ce1421cb59ed9a917919b22 P 590ee39ce5734876b94d91fc3931b807 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:12.269057  9270 raft_consensus.cc:515] T b574d11894634755bd89c530b4155f1e P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:12.278553  9281 raft_consensus.cc:2749] T da02fa98f6de48a7baefadf6e69d2046 P 590ee39ce5734876b94d91fc3931b807 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:12.280006  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51a6d67e6461a98e669fa2b1e59c8" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "53a66c851dc74c70b94c65d464a391f6" is_pre_election: true
I20260709 13:02:12.279567  9270 leader_election.cc:290] T b574d11894634755bd89c530b4155f1e P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429), b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503)
I20260709 13:02:12.282606  8549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b574d11894634755bd89c530b4155f1e" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3" is_pre_election: true
W20260709 13:02:12.283998  8371 consensus_peers.cc:597] T f1fec8d4948d45bbbe39d0f3e73c3992 P 53a66c851dc74c70b94c65d464a391f6 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:12.310006  8519 consensus_peers.cc:597] T 69ef277bbcbd41d8a10ae92d9a63145e P b560e9aaec7a4c78b9123b38e73519a3 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:12.311857  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b574d11894634755bd89c530b4155f1e" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5" is_pre_election: true
W20260709 13:02:12.314260  8519 consensus_peers.cc:597] T ef35fbe0cee64967ab342c52aa0b1ac1 P b560e9aaec7a4c78b9123b38e73519a3 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:12.337299  9144 leader_election.cc:304] T 5db51a6d67e6461a98e669fa2b1e59c8 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807; no voters: 53a66c851dc74c70b94c65d464a391f6, b560e9aaec7a4c78b9123b38e73519a3
I20260709 13:02:12.362474  9283 raft_consensus.cc:2749] T 5db51a6d67e6461a98e669fa2b1e59c8 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:02:12.383520  9148 ts_tablet_manager.cc:1434] T a1946cc2deaa4799be02943612a39b16 P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.150s	user 0.022s	sys 0.003s
I20260709 13:02:12.399777  9148 tablet_bootstrap.cc:492] T c66f53044d784114970ae5061755da40 P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:12.409039  9144 leader_election.cc:304] T b574d11894634755bd89c530b4155f1e P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807; no voters: 7b3ea460d1294b8a82672d7c21475cb5, b560e9aaec7a4c78b9123b38e73519a3
I20260709 13:02:12.410161  9299 raft_consensus.cc:2749] T b574d11894634755bd89c530b4155f1e P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:02:12.431538  8518 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:37751, user_credentials={real_user=slave}} blocked reactor thread for 50034.6us
I20260709 13:02:12.471275  9273 heartbeater.cc:344] Connected to a master server at 127.0.107.254:37501
I20260709 13:02:12.473438  9273 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:12.474350  9273 heartbeater.cc:507] Master 127.0.107.254:37501 requested a full tablet report, sending...
W20260709 13:02:12.472800  8519 consensus_peers.cc:597] T 4d5829b9233a48fea0290d9bb023f97e P b560e9aaec7a4c78b9123b38e73519a3 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:02:12.487646  9218 raft_consensus.cc:3060] T a1946cc2deaa4799be02943612a39b16 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:02:12.530871  8371 consensus_peers.cc:597] T 6540f8b1e5df49f698558db1af45038b P 53a66c851dc74c70b94c65d464a391f6 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:12.541517  8445 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:40837, user_credentials={real_user=slave}} blocked reactor thread for 56884.1us
I20260709 13:02:12.622802  9148 tablet_bootstrap.cc:492] T c66f53044d784114970ae5061755da40 P 590ee39ce5734876b94d91fc3931b807: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:12.623898  9148 tablet_bootstrap.cc:492] T c66f53044d784114970ae5061755da40 P 590ee39ce5734876b94d91fc3931b807: Bootstrap complete.
I20260709 13:02:12.624480  9148 ts_tablet_manager.cc:1403] T c66f53044d784114970ae5061755da40 P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.240s	user 0.016s	sys 0.004s
I20260709 13:02:12.626775  9148 raft_consensus.cc:359] T c66f53044d784114970ae5061755da40 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:12.627403  9148 raft_consensus.cc:740] T c66f53044d784114970ae5061755da40 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:12.628098  9148 consensus_queue.cc:260] T c66f53044d784114970ae5061755da40 P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:12.630235  9148 ts_tablet_manager.cc:1434] T c66f53044d784114970ae5061755da40 P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:02:12.631012  9148 tablet_bootstrap.cc:492] T ef35fbe0cee64967ab342c52aa0b1ac1 P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:12.646652  9148 tablet_bootstrap.cc:492] T ef35fbe0cee64967ab342c52aa0b1ac1 P 590ee39ce5734876b94d91fc3931b807: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:12.647833  9148 tablet_bootstrap.cc:492] T ef35fbe0cee64967ab342c52aa0b1ac1 P 590ee39ce5734876b94d91fc3931b807: Bootstrap complete.
I20260709 13:02:12.656426  9148 ts_tablet_manager.cc:1403] T ef35fbe0cee64967ab342c52aa0b1ac1 P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.026s	user 0.008s	sys 0.008s
I20260709 13:02:12.659296  9148 raft_consensus.cc:359] T ef35fbe0cee64967ab342c52aa0b1ac1 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:12.659958  9148 raft_consensus.cc:740] T ef35fbe0cee64967ab342c52aa0b1ac1 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:12.660749  9148 consensus_queue.cc:260] T ef35fbe0cee64967ab342c52aa0b1ac1 P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:12.663367  9148 ts_tablet_manager.cc:1434] T ef35fbe0cee64967ab342c52aa0b1ac1 P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:02:12.664145  9148 tablet_bootstrap.cc:492] T d97df5fdb12a439080fa6edc391ebd82 P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:12.694511  8228 ts_manager.cc:194] Re-registered known tserver with Master: 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
I20260709 13:02:12.703994  9148 tablet_bootstrap.cc:492] T d97df5fdb12a439080fa6edc391ebd82 P 590ee39ce5734876b94d91fc3931b807: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:12.716977  9148 tablet_bootstrap.cc:492] T d97df5fdb12a439080fa6edc391ebd82 P 590ee39ce5734876b94d91fc3931b807: Bootstrap complete.
I20260709 13:02:12.717660  9148 ts_tablet_manager.cc:1403] T d97df5fdb12a439080fa6edc391ebd82 P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.054s	user 0.012s	sys 0.009s
I20260709 13:02:12.720047  9148 raft_consensus.cc:359] T d97df5fdb12a439080fa6edc391ebd82 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:12.720737  9148 raft_consensus.cc:740] T d97df5fdb12a439080fa6edc391ebd82 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:12.721475  9148 consensus_queue.cc:260] T d97df5fdb12a439080fa6edc391ebd82 P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:12.723475  9148 ts_tablet_manager.cc:1434] T d97df5fdb12a439080fa6edc391ebd82 P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:02:12.724182  9148 tablet_bootstrap.cc:492] T 69ef277bbcbd41d8a10ae92d9a63145e P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:12.760311  9148 tablet_bootstrap.cc:492] T 69ef277bbcbd41d8a10ae92d9a63145e P 590ee39ce5734876b94d91fc3931b807: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:12.761338  9148 tablet_bootstrap.cc:492] T 69ef277bbcbd41d8a10ae92d9a63145e P 590ee39ce5734876b94d91fc3931b807: Bootstrap complete.
I20260709 13:02:12.761996  9148 ts_tablet_manager.cc:1403] T 69ef277bbcbd41d8a10ae92d9a63145e P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.038s	user 0.013s	sys 0.003s
I20260709 13:02:12.765198  9148 raft_consensus.cc:359] T 69ef277bbcbd41d8a10ae92d9a63145e P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:12.765976  9148 raft_consensus.cc:740] T 69ef277bbcbd41d8a10ae92d9a63145e P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:12.767115  9148 consensus_queue.cc:260] T 69ef277bbcbd41d8a10ae92d9a63145e P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:12.771473  9148 ts_tablet_manager.cc:1434] T 69ef277bbcbd41d8a10ae92d9a63145e P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.006s
I20260709 13:02:12.772516  9148 tablet_bootstrap.cc:492] T da5b0b01a880412896838e8eb658db7a P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:12.811636  8228 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60482
I20260709 13:02:12.819695  9273 heartbeater.cc:499] Master 127.0.107.254:37501 was elected leader, sending a full tablet report...
I20260709 13:02:12.829913  9148 tablet_bootstrap.cc:492] T da5b0b01a880412896838e8eb658db7a P 590ee39ce5734876b94d91fc3931b807: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:12.831040  9148 tablet_bootstrap.cc:492] T da5b0b01a880412896838e8eb658db7a P 590ee39ce5734876b94d91fc3931b807: Bootstrap complete.
I20260709 13:02:12.831771  9148 ts_tablet_manager.cc:1403] T da5b0b01a880412896838e8eb658db7a P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.059s	user 0.014s	sys 0.012s
I20260709 13:02:12.834450  9148 raft_consensus.cc:359] T da5b0b01a880412896838e8eb658db7a P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:12.835395  9148 raft_consensus.cc:740] T da5b0b01a880412896838e8eb658db7a P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:12.836231  9148 consensus_queue.cc:260] T da5b0b01a880412896838e8eb658db7a P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:12.839038  9148 ts_tablet_manager.cc:1434] T da5b0b01a880412896838e8eb658db7a P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 13:02:12.839869  9148 tablet_bootstrap.cc:492] T 6fffc940549b445c973a289ba1bebcb3 P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:12.865357  9148 tablet_bootstrap.cc:492] T 6fffc940549b445c973a289ba1bebcb3 P 590ee39ce5734876b94d91fc3931b807: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:12.866581  9148 tablet_bootstrap.cc:492] T 6fffc940549b445c973a289ba1bebcb3 P 590ee39ce5734876b94d91fc3931b807: Bootstrap complete.
I20260709 13:02:12.867381  9148 ts_tablet_manager.cc:1403] T 6fffc940549b445c973a289ba1bebcb3 P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.010s
I20260709 13:02:12.873198  9148 raft_consensus.cc:359] T 6fffc940549b445c973a289ba1bebcb3 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:12.873754  9148 raft_consensus.cc:740] T 6fffc940549b445c973a289ba1bebcb3 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:12.874435  9148 consensus_queue.cc:260] T 6fffc940549b445c973a289ba1bebcb3 P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:12.876582  9148 ts_tablet_manager.cc:1434] T 6fffc940549b445c973a289ba1bebcb3 P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:02:12.877454  9148 tablet_bootstrap.cc:492] T f8ec593f6c894c24a5bc727cfed4190a P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:12.917876  9148 tablet_bootstrap.cc:492] T f8ec593f6c894c24a5bc727cfed4190a P 590ee39ce5734876b94d91fc3931b807: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:12.918828  9148 tablet_bootstrap.cc:492] T f8ec593f6c894c24a5bc727cfed4190a P 590ee39ce5734876b94d91fc3931b807: Bootstrap complete.
I20260709 13:02:12.919469  9148 ts_tablet_manager.cc:1403] T f8ec593f6c894c24a5bc727cfed4190a P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.042s	user 0.009s	sys 0.027s
I20260709 13:02:12.921988  9148 raft_consensus.cc:359] T f8ec593f6c894c24a5bc727cfed4190a P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:12.923064  9148 raft_consensus.cc:740] T f8ec593f6c894c24a5bc727cfed4190a P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:12.923750  9148 consensus_queue.cc:260] T f8ec593f6c894c24a5bc727cfed4190a P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:12.925877  9148 ts_tablet_manager.cc:1434] T f8ec593f6c894c24a5bc727cfed4190a P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.006s	user 0.009s	sys 0.000s
I20260709 13:02:12.926664  9148 tablet_bootstrap.cc:492] T d4cd925acef04f3c8910aa1903b760c7 P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:12.956965  9148 tablet_bootstrap.cc:492] T d4cd925acef04f3c8910aa1903b760c7 P 590ee39ce5734876b94d91fc3931b807: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:12.957931  9148 tablet_bootstrap.cc:492] T d4cd925acef04f3c8910aa1903b760c7 P 590ee39ce5734876b94d91fc3931b807: Bootstrap complete.
I20260709 13:02:12.958575  9148 ts_tablet_manager.cc:1403] T d4cd925acef04f3c8910aa1903b760c7 P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.004s
I20260709 13:02:12.961059  9148 raft_consensus.cc:359] T d4cd925acef04f3c8910aa1903b760c7 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:12.961705  9148 raft_consensus.cc:740] T d4cd925acef04f3c8910aa1903b760c7 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:12.962363  9148 consensus_queue.cc:260] T d4cd925acef04f3c8910aa1903b760c7 P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:12.964673  9148 ts_tablet_manager.cc:1434] T d4cd925acef04f3c8910aa1903b760c7 P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:02:12.965473  9148 tablet_bootstrap.cc:492] T fcc07b65535048fca9045891e1ae0153 P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:12.985874  9148 tablet_bootstrap.cc:492] T fcc07b65535048fca9045891e1ae0153 P 590ee39ce5734876b94d91fc3931b807: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:12.986675  9148 tablet_bootstrap.cc:492] T fcc07b65535048fca9045891e1ae0153 P 590ee39ce5734876b94d91fc3931b807: Bootstrap complete.
I20260709 13:02:12.987272  9148 ts_tablet_manager.cc:1403] T fcc07b65535048fca9045891e1ae0153 P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.000s
I20260709 13:02:12.989284  9148 raft_consensus.cc:359] T fcc07b65535048fca9045891e1ae0153 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:12.989811  9148 raft_consensus.cc:740] T fcc07b65535048fca9045891e1ae0153 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:12.990475  9148 consensus_queue.cc:260] T fcc07b65535048fca9045891e1ae0153 P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:12.992054  9148 ts_tablet_manager.cc:1434] T fcc07b65535048fca9045891e1ae0153 P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:02:12.995015  9148 tablet_bootstrap.cc:492] T 5527a2aef01d45cebcfad8a1b0a5273d P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:13.010397  9148 tablet_bootstrap.cc:492] T 5527a2aef01d45cebcfad8a1b0a5273d P 590ee39ce5734876b94d91fc3931b807: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:13.011353  9148 tablet_bootstrap.cc:492] T 5527a2aef01d45cebcfad8a1b0a5273d P 590ee39ce5734876b94d91fc3931b807: Bootstrap complete.
I20260709 13:02:13.011965  9148 ts_tablet_manager.cc:1403] T 5527a2aef01d45cebcfad8a1b0a5273d P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.004s
I20260709 13:02:13.014300  9148 raft_consensus.cc:359] T 5527a2aef01d45cebcfad8a1b0a5273d P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:13.014983  9148 raft_consensus.cc:740] T 5527a2aef01d45cebcfad8a1b0a5273d P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:13.015713  9148 consensus_queue.cc:260] T 5527a2aef01d45cebcfad8a1b0a5273d P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:13.017743  9148 ts_tablet_manager.cc:1434] T 5527a2aef01d45cebcfad8a1b0a5273d P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:02:13.018534  9148 tablet_bootstrap.cc:492] T 6540f8b1e5df49f698558db1af45038b P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:13.035101  9148 tablet_bootstrap.cc:492] T 6540f8b1e5df49f698558db1af45038b P 590ee39ce5734876b94d91fc3931b807: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:13.036049  9148 tablet_bootstrap.cc:492] T 6540f8b1e5df49f698558db1af45038b P 590ee39ce5734876b94d91fc3931b807: Bootstrap complete.
I20260709 13:02:13.036653  9148 ts_tablet_manager.cc:1403] T 6540f8b1e5df49f698558db1af45038b P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.004s
I20260709 13:02:13.038573  9148 raft_consensus.cc:359] T 6540f8b1e5df49f698558db1af45038b P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:13.039062  9148 raft_consensus.cc:740] T 6540f8b1e5df49f698558db1af45038b P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:13.039549  9148 consensus_queue.cc:260] T 6540f8b1e5df49f698558db1af45038b P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:13.041139  9148 ts_tablet_manager.cc:1434] T 6540f8b1e5df49f698558db1af45038b P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:02:13.041900  9148 tablet_bootstrap.cc:492] T 4d5829b9233a48fea0290d9bb023f97e P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:13.056295  9148 tablet_bootstrap.cc:492] T 4d5829b9233a48fea0290d9bb023f97e P 590ee39ce5734876b94d91fc3931b807: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:13.057212  9148 tablet_bootstrap.cc:492] T 4d5829b9233a48fea0290d9bb023f97e P 590ee39ce5734876b94d91fc3931b807: Bootstrap complete.
I20260709 13:02:13.057696  9148 ts_tablet_manager.cc:1403] T 4d5829b9233a48fea0290d9bb023f97e P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.003s
I20260709 13:02:13.059356  9148 raft_consensus.cc:359] T 4d5829b9233a48fea0290d9bb023f97e P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:13.059787  9148 raft_consensus.cc:740] T 4d5829b9233a48fea0290d9bb023f97e P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:13.060309  9148 consensus_queue.cc:260] T 4d5829b9233a48fea0290d9bb023f97e P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:13.061900  9148 ts_tablet_manager.cc:1434] T 4d5829b9233a48fea0290d9bb023f97e P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:02:13.062939  9148 tablet_bootstrap.cc:492] T c63211d1d13a4736adb18dee69b400a3 P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:13.077102  9148 tablet_bootstrap.cc:492] T c63211d1d13a4736adb18dee69b400a3 P 590ee39ce5734876b94d91fc3931b807: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:13.078639  9148 tablet_bootstrap.cc:492] T c63211d1d13a4736adb18dee69b400a3 P 590ee39ce5734876b94d91fc3931b807: Bootstrap complete.
I20260709 13:02:13.080510  9148 ts_tablet_manager.cc:1403] T c63211d1d13a4736adb18dee69b400a3 P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.004s
I20260709 13:02:13.082511  9148 raft_consensus.cc:359] T c63211d1d13a4736adb18dee69b400a3 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:13.082996  9148 raft_consensus.cc:740] T c63211d1d13a4736adb18dee69b400a3 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:13.083630  9148 consensus_queue.cc:260] T c63211d1d13a4736adb18dee69b400a3 P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:13.085604  9148 ts_tablet_manager.cc:1434] T c63211d1d13a4736adb18dee69b400a3 P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:02:13.086567  9148 tablet_bootstrap.cc:492] T e8bdd44ba5144cadada8b14a380f995a P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:13.103600  9148 tablet_bootstrap.cc:492] T e8bdd44ba5144cadada8b14a380f995a P 590ee39ce5734876b94d91fc3931b807: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:13.104552  9148 tablet_bootstrap.cc:492] T e8bdd44ba5144cadada8b14a380f995a P 590ee39ce5734876b94d91fc3931b807: Bootstrap complete.
I20260709 13:02:13.105211  9148 ts_tablet_manager.cc:1403] T e8bdd44ba5144cadada8b14a380f995a P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 13:02:13.108144  9148 raft_consensus.cc:359] T e8bdd44ba5144cadada8b14a380f995a P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:13.108836  9148 raft_consensus.cc:740] T e8bdd44ba5144cadada8b14a380f995a P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:13.109555  9148 consensus_queue.cc:260] T e8bdd44ba5144cadada8b14a380f995a P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:13.111981  9148 ts_tablet_manager.cc:1434] T e8bdd44ba5144cadada8b14a380f995a P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:02:13.112948  9148 tablet_bootstrap.cc:492] T f1fec8d4948d45bbbe39d0f3e73c3992 P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:13.130695  9148 tablet_bootstrap.cc:492] T f1fec8d4948d45bbbe39d0f3e73c3992 P 590ee39ce5734876b94d91fc3931b807: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:13.131489  9148 tablet_bootstrap.cc:492] T f1fec8d4948d45bbbe39d0f3e73c3992 P 590ee39ce5734876b94d91fc3931b807: Bootstrap complete.
I20260709 13:02:13.132087  9148 ts_tablet_manager.cc:1403] T f1fec8d4948d45bbbe39d0f3e73c3992 P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.005s
I20260709 13:02:13.134512  9148 raft_consensus.cc:359] T f1fec8d4948d45bbbe39d0f3e73c3992 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:13.135076  9148 raft_consensus.cc:740] T f1fec8d4948d45bbbe39d0f3e73c3992 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:13.135782  9148 consensus_queue.cc:260] T f1fec8d4948d45bbbe39d0f3e73c3992 P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:13.137331  9148 ts_tablet_manager.cc:1434] T f1fec8d4948d45bbbe39d0f3e73c3992 P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.003s
I20260709 13:02:13.138242  9148 tablet_bootstrap.cc:492] T c6245fdde2e4422581bc418d4840b580 P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:13.160638  9148 tablet_bootstrap.cc:492] T c6245fdde2e4422581bc418d4840b580 P 590ee39ce5734876b94d91fc3931b807: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:13.161638  9148 tablet_bootstrap.cc:492] T c6245fdde2e4422581bc418d4840b580 P 590ee39ce5734876b94d91fc3931b807: Bootstrap complete.
I20260709 13:02:13.162250  9148 ts_tablet_manager.cc:1403] T c6245fdde2e4422581bc418d4840b580 P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.005s
I20260709 13:02:13.164422  9148 raft_consensus.cc:359] T c6245fdde2e4422581bc418d4840b580 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:13.164980  9148 raft_consensus.cc:740] T c6245fdde2e4422581bc418d4840b580 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:13.165606  9148 consensus_queue.cc:260] T c6245fdde2e4422581bc418d4840b580 P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:13.170972  9148 ts_tablet_manager.cc:1434] T c6245fdde2e4422581bc418d4840b580 P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:02:13.171746  9148 tablet_bootstrap.cc:492] T cd24f768f33e40bba3406e8dde3f45cc P 590ee39ce5734876b94d91fc3931b807: Bootstrap starting.
I20260709 13:02:13.187005  9148 tablet_bootstrap.cc:492] T cd24f768f33e40bba3406e8dde3f45cc P 590ee39ce5734876b94d91fc3931b807: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:13.187752  9148 tablet_bootstrap.cc:492] T cd24f768f33e40bba3406e8dde3f45cc P 590ee39ce5734876b94d91fc3931b807: Bootstrap complete.
I20260709 13:02:13.188378  9148 ts_tablet_manager.cc:1403] T cd24f768f33e40bba3406e8dde3f45cc P 590ee39ce5734876b94d91fc3931b807: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.004s
I20260709 13:02:13.190449  9148 raft_consensus.cc:359] T cd24f768f33e40bba3406e8dde3f45cc P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:13.191061  9148 raft_consensus.cc:740] T cd24f768f33e40bba3406e8dde3f45cc P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Initialized, Role: FOLLOWER
I20260709 13:02:13.191584  9148 consensus_queue.cc:260] T cd24f768f33e40bba3406e8dde3f45cc P 590ee39ce5734876b94d91fc3931b807 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:13.193356  9148 ts_tablet_manager.cc:1434] T cd24f768f33e40bba3406e8dde3f45cc P 590ee39ce5734876b94d91fc3931b807: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:02:13.202380  9228 raft_consensus.cc:3060] T e8bdd44ba5144cadada8b14a380f995a P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:13.419450  9228 raft_consensus.cc:3060] T cd24f768f33e40bba3406e8dde3f45cc P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:02:19.711769  8369 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.000s	sys 0.014s
W20260709 13:02:19.712218  8369 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.000s	sys 0.014s
W20260709 13:02:19.759384  8371 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.004s	sys 0.014s
W20260709 13:02:19.759788  8371 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.004s	sys 0.014s
W20260709 13:02:19.909251  8518 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:45429, user_credentials={real_user=slave}} blocked reactor thread for 50985.6us
W20260709 13:02:19.987692  8369 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.196:42503, user_credentials={real_user=slave}} blocked reactor thread for 57970.8us
W20260709 13:02:20.125552  8500 debug-util.cc:398] Leaking SignalData structure 0x7b08002e3f40 after lost signal to thread 434
W20260709 13:02:20.127059  8500 debug-util.cc:398] Leaking SignalData structure 0x7b08000a8a20 after lost signal to thread 8262
W20260709 13:02:20.128827  8500 debug-util.cc:398] Leaking SignalData structure 0x7b08001e74e0 after lost signal to thread 8429
W20260709 13:02:20.130348  8500 debug-util.cc:398] Leaking SignalData structure 0x7b080026ae40 after lost signal to thread 8503
W20260709 13:02:20.132038  8500 debug-util.cc:398] Leaking SignalData structure 0x7b08001d72a0 after lost signal to thread 8577
W20260709 13:02:20.135998  8500 debug-util.cc:398] Leaking SignalData structure 0x7b0800332e20 after lost signal to thread 9269
W20260709 13:02:20.136447  8500 debug-util.cc:398] Leaking SignalData structure 0x7b080015cca0 after lost signal to thread 9296
I20260709 13:02:22.298735   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:22.363108  8399 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30e220d65bed42489b2af858d3a60981"
dest_uuid: "53a66c851dc74c70b94c65d464a391f6"
mode: GRACEFUL
new_leader_uuid: "590ee39ce5734876b94d91fc3931b807"
 from {username='slave'} at 127.0.0.1:48082
I20260709 13:02:22.363946  8399 raft_consensus.cc:606] T 30e220d65bed42489b2af858d3a60981 P 53a66c851dc74c70b94c65d464a391f6 [term 2 LEADER]: Received request to transfer leadership to TS 590ee39ce5734876b94d91fc3931b807
I20260709 13:02:22.380343  8475 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40926724afa743899b7ab0af312dc717"
dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5"
mode: GRACEFUL
new_leader_uuid: "53a66c851dc74c70b94c65d464a391f6"
 from {username='slave'} at 127.0.0.1:40498
I20260709 13:02:22.381002  8475 raft_consensus.cc:606] T 40926724afa743899b7ab0af312dc717 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 LEADER]: Received request to transfer leadership to TS 53a66c851dc74c70b94c65d464a391f6
I20260709 13:02:22.386368  8398 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "45171bd0207f452f9884a58c225ddb72"
dest_uuid: "53a66c851dc74c70b94c65d464a391f6"
mode: GRACEFUL
new_leader_uuid: "590ee39ce5734876b94d91fc3931b807"
 from {username='slave'} at 127.0.0.1:48082
I20260709 13:02:22.386991  8398 raft_consensus.cc:606] T 45171bd0207f452f9884a58c225ddb72 P 53a66c851dc74c70b94c65d464a391f6 [term 1 LEADER]: Received request to transfer leadership to TS 590ee39ce5734876b94d91fc3931b807
I20260709 13:02:22.403218  8552 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5db51a6d67e6461a98e669fa2b1e59c8"
dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3"
mode: GRACEFUL
new_leader_uuid: "590ee39ce5734876b94d91fc3931b807"
 from {username='slave'} at 127.0.0.1:51694
I20260709 13:02:22.403915  8552 raft_consensus.cc:606] T 5db51a6d67e6461a98e669fa2b1e59c8 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Received request to transfer leadership to TS 590ee39ce5734876b94d91fc3931b807
I20260709 13:02:22.407459  8398 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7ed73594956241f4b3e6e456bae82964"
dest_uuid: "53a66c851dc74c70b94c65d464a391f6"
mode: GRACEFUL
new_leader_uuid: "7b3ea460d1294b8a82672d7c21475cb5"
 from {username='slave'} at 127.0.0.1:48082
I20260709 13:02:22.408165  8398 raft_consensus.cc:606] T 7ed73594956241f4b3e6e456bae82964 P 53a66c851dc74c70b94c65d464a391f6 [term 1 LEADER]: Received request to transfer leadership to TS 7b3ea460d1294b8a82672d7c21475cb5
I20260709 13:02:22.411151  8398 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8e53899e04fe4f58b666f67ac07bbf79"
dest_uuid: "53a66c851dc74c70b94c65d464a391f6"
mode: GRACEFUL
new_leader_uuid: "590ee39ce5734876b94d91fc3931b807"
 from {username='slave'} at 127.0.0.1:48082
I20260709 13:02:22.411877  8398 raft_consensus.cc:606] T 8e53899e04fe4f58b666f67ac07bbf79 P 53a66c851dc74c70b94c65d464a391f6 [term 2 LEADER]: Received request to transfer leadership to TS 590ee39ce5734876b94d91fc3931b807
I20260709 13:02:22.413501   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:02:22.415345   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:22.517527  9367 raft_consensus.cc:993] T 45171bd0207f452f9884a58c225ddb72 P 53a66c851dc74c70b94c65d464a391f6: : Instructing follower 590ee39ce5734876b94d91fc3931b807 to start an election
I20260709 13:02:22.518540  9367 raft_consensus.cc:1081] T 45171bd0207f452f9884a58c225ddb72 P 53a66c851dc74c70b94c65d464a391f6 [term 1 LEADER]: Signalling peer 590ee39ce5734876b94d91fc3931b807 to start an election
I20260709 13:02:22.520424  9225 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "45171bd0207f452f9884a58c225ddb72"
dest_uuid: "590ee39ce5734876b94d91fc3931b807"
 from {username='slave'} at 127.0.0.1:56016
I20260709 13:02:22.521143  9225 raft_consensus.cc:493] T 45171bd0207f452f9884a58c225ddb72 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:22.521647  9225 raft_consensus.cc:3060] T 45171bd0207f452f9884a58c225ddb72 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:22.531662  9225 raft_consensus.cc:515] T 45171bd0207f452f9884a58c225ddb72 P 590ee39ce5734876b94d91fc3931b807 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:22.536919  8552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45171bd0207f452f9884a58c225ddb72" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3"
I20260709 13:02:22.537483  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "45171bd0207f452f9884a58c225ddb72" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "53a66c851dc74c70b94c65d464a391f6"
I20260709 13:02:22.537837  8552 raft_consensus.cc:3060] T 45171bd0207f452f9884a58c225ddb72 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:22.538182  8399 raft_consensus.cc:3055] T 45171bd0207f452f9884a58c225ddb72 P 53a66c851dc74c70b94c65d464a391f6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:22.538542  8399 raft_consensus.cc:740] T 45171bd0207f452f9884a58c225ddb72 P 53a66c851dc74c70b94c65d464a391f6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Running, Role: LEADER
I20260709 13:02:22.539489  8399 consensus_queue.cc:260] T 45171bd0207f452f9884a58c225ddb72 P 53a66c851dc74c70b94c65d464a391f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:22.540877  8399 raft_consensus.cc:3060] T 45171bd0207f452f9884a58c225ddb72 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:22.550814  9360 raft_consensus.cc:993] T 5db51a6d67e6461a98e669fa2b1e59c8 P b560e9aaec7a4c78b9123b38e73519a3: : Instructing follower 590ee39ce5734876b94d91fc3931b807 to start an election
I20260709 13:02:22.551666  9225 leader_election.cc:290] T 45171bd0207f452f9884a58c225ddb72 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 2 election: Requested vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:02:22.553020  9337 raft_consensus.cc:1081] T 5db51a6d67e6461a98e669fa2b1e59c8 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Signalling peer 590ee39ce5734876b94d91fc3931b807 to start an election
I20260709 13:02:22.555228  9222 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5db51a6d67e6461a98e669fa2b1e59c8"
dest_uuid: "590ee39ce5734876b94d91fc3931b807"
 from {username='slave'} at 127.0.0.1:56020
I20260709 13:02:22.556038  9222 raft_consensus.cc:493] T 5db51a6d67e6461a98e669fa2b1e59c8 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:22.556593  9222 raft_consensus.cc:3060] T 5db51a6d67e6461a98e669fa2b1e59c8 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:22.557726  8552 raft_consensus.cc:2468] T 45171bd0207f452f9884a58c225ddb72 P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 590ee39ce5734876b94d91fc3931b807 in term 2.
I20260709 13:02:22.560307  9143 leader_election.cc:304] T 45171bd0207f452f9884a58c225ddb72 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807, b560e9aaec7a4c78b9123b38e73519a3; no voters: 
I20260709 13:02:22.566998  8399 raft_consensus.cc:2468] T 45171bd0207f452f9884a58c225ddb72 P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 590ee39ce5734876b94d91fc3931b807 in term 2.
I20260709 13:02:22.570458  9369 raft_consensus.cc:993] T 8e53899e04fe4f58b666f67ac07bbf79 P 53a66c851dc74c70b94c65d464a391f6: : Instructing follower 590ee39ce5734876b94d91fc3931b807 to start an election
I20260709 13:02:22.571035  9369 raft_consensus.cc:1081] T 8e53899e04fe4f58b666f67ac07bbf79 P 53a66c851dc74c70b94c65d464a391f6 [term 2 LEADER]: Signalling peer 590ee39ce5734876b94d91fc3931b807 to start an election
I20260709 13:02:22.583184  9224 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8e53899e04fe4f58b666f67ac07bbf79"
dest_uuid: "590ee39ce5734876b94d91fc3931b807"
 from {username='slave'} at 127.0.0.1:56016
I20260709 13:02:22.583859  9224 raft_consensus.cc:493] T 8e53899e04fe4f58b666f67ac07bbf79 P 590ee39ce5734876b94d91fc3931b807 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:22.584398  9224 raft_consensus.cc:3060] T 8e53899e04fe4f58b666f67ac07bbf79 P 590ee39ce5734876b94d91fc3931b807 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:22.584230  9222 raft_consensus.cc:515] T 5db51a6d67e6461a98e669fa2b1e59c8 P 590ee39ce5734876b94d91fc3931b807 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:22.591629  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51a6d67e6461a98e669fa2b1e59c8" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "53a66c851dc74c70b94c65d464a391f6"
I20260709 13:02:22.592206  9375 raft_consensus.cc:2804] T 45171bd0207f452f9884a58c225ddb72 P 590ee39ce5734876b94d91fc3931b807 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:22.592234  8399 raft_consensus.cc:3060] T 5db51a6d67e6461a98e669fa2b1e59c8 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:22.592657  9222 leader_election.cc:290] T 5db51a6d67e6461a98e669fa2b1e59c8 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 2 election: Requested vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:02:22.593152  8552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5db51a6d67e6461a98e669fa2b1e59c8" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3"
I20260709 13:02:22.593726  8552 raft_consensus.cc:3055] T 5db51a6d67e6461a98e669fa2b1e59c8 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:22.594004  8552 raft_consensus.cc:740] T 5db51a6d67e6461a98e669fa2b1e59c8 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Running, Role: LEADER
I20260709 13:02:22.594784  8552 consensus_queue.cc:260] T 5db51a6d67e6461a98e669fa2b1e59c8 P b560e9aaec7a4c78b9123b38e73519a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:22.596081  8552 raft_consensus.cc:3060] T 5db51a6d67e6461a98e669fa2b1e59c8 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:22.597379  9224 raft_consensus.cc:515] T 8e53899e04fe4f58b666f67ac07bbf79 P 590ee39ce5734876b94d91fc3931b807 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:22.601548  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e53899e04fe4f58b666f67ac07bbf79" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "53a66c851dc74c70b94c65d464a391f6"
I20260709 13:02:22.602070  8398 raft_consensus.cc:3055] T 8e53899e04fe4f58b666f67ac07bbf79 P 53a66c851dc74c70b94c65d464a391f6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:22.602402  8398 raft_consensus.cc:740] T 8e53899e04fe4f58b666f67ac07bbf79 P 53a66c851dc74c70b94c65d464a391f6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Running, Role: LEADER
I20260709 13:02:22.603334  8552 raft_consensus.cc:2468] T 5db51a6d67e6461a98e669fa2b1e59c8 P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 590ee39ce5734876b94d91fc3931b807 in term 2.
I20260709 13:02:22.603302  8398 consensus_queue.cc:260] T 8e53899e04fe4f58b666f67ac07bbf79 P 53a66c851dc74c70b94c65d464a391f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:22.605746  9143 leader_election.cc:304] T 5db51a6d67e6461a98e669fa2b1e59c8 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807, b560e9aaec7a4c78b9123b38e73519a3; no voters: 
I20260709 13:02:22.606087  8398 raft_consensus.cc:3060] T 8e53899e04fe4f58b666f67ac07bbf79 P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:22.604293  8399 raft_consensus.cc:2468] T 5db51a6d67e6461a98e669fa2b1e59c8 P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 590ee39ce5734876b94d91fc3931b807 in term 2.
I20260709 13:02:22.609958  9224 leader_election.cc:290] T 8e53899e04fe4f58b666f67ac07bbf79 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 3 election: Requested vote from peers 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:02:22.612103  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8e53899e04fe4f58b666f67ac07bbf79" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5"
I20260709 13:02:22.612710  8475 raft_consensus.cc:3060] T 8e53899e04fe4f58b666f67ac07bbf79 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:22.613976  9378 raft_consensus.cc:2804] T 5db51a6d67e6461a98e669fa2b1e59c8 P 590ee39ce5734876b94d91fc3931b807 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:22.614470  9378 raft_consensus.cc:697] T 5db51a6d67e6461a98e669fa2b1e59c8 P 590ee39ce5734876b94d91fc3931b807 [term 2 LEADER]: Becoming Leader. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Running, Role: LEADER
I20260709 13:02:22.615404  9378 consensus_queue.cc:237] T 5db51a6d67e6461a98e669fa2b1e59c8 P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:22.616508  8398 raft_consensus.cc:2468] T 8e53899e04fe4f58b666f67ac07bbf79 P 53a66c851dc74c70b94c65d464a391f6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 590ee39ce5734876b94d91fc3931b807 in term 3.
I20260709 13:02:22.617661  9144 leader_election.cc:304] T 8e53899e04fe4f58b666f67ac07bbf79 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, 590ee39ce5734876b94d91fc3931b807; no voters: 
I20260709 13:02:22.620157  8475 raft_consensus.cc:2468] T 8e53899e04fe4f58b666f67ac07bbf79 P 7b3ea460d1294b8a82672d7c21475cb5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 590ee39ce5734876b94d91fc3931b807 in term 3.
I20260709 13:02:22.623831  9375 raft_consensus.cc:697] T 45171bd0207f452f9884a58c225ddb72 P 590ee39ce5734876b94d91fc3931b807 [term 2 LEADER]: Becoming Leader. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Running, Role: LEADER
I20260709 13:02:22.623365  9379 raft_consensus.cc:2804] T 8e53899e04fe4f58b666f67ac07bbf79 P 590ee39ce5734876b94d91fc3931b807 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:22.625061  9379 raft_consensus.cc:697] T 8e53899e04fe4f58b666f67ac07bbf79 P 590ee39ce5734876b94d91fc3931b807 [term 3 LEADER]: Becoming Leader. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Running, Role: LEADER
I20260709 13:02:22.624909  9375 consensus_queue.cc:237] T 45171bd0207f452f9884a58c225ddb72 P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:22.626513  9379 consensus_queue.cc:237] T 8e53899e04fe4f58b666f67ac07bbf79 P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:22.631250  9369 raft_consensus.cc:993] T 7ed73594956241f4b3e6e456bae82964 P 53a66c851dc74c70b94c65d464a391f6: : Instructing follower 7b3ea460d1294b8a82672d7c21475cb5 to start an election
I20260709 13:02:22.632014  9353 raft_consensus.cc:1081] T 7ed73594956241f4b3e6e456bae82964 P 53a66c851dc74c70b94c65d464a391f6 [term 1 LEADER]: Signalling peer 7b3ea460d1294b8a82672d7c21475cb5 to start an election
I20260709 13:02:22.635521  8476 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7ed73594956241f4b3e6e456bae82964"
dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5"
 from {username='slave'} at 127.0.0.1:40054
I20260709 13:02:22.636063  8476 raft_consensus.cc:493] T 7ed73594956241f4b3e6e456bae82964 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:22.636400  8476 raft_consensus.cc:3060] T 7ed73594956241f4b3e6e456bae82964 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:22.656219  9369 raft_consensus.cc:993] T 30e220d65bed42489b2af858d3a60981 P 53a66c851dc74c70b94c65d464a391f6: : Instructing follower 590ee39ce5734876b94d91fc3931b807 to start an election
I20260709 13:02:22.655838  8228 catalog_manager.cc:5697] T 45171bd0207f452f9884a58c225ddb72 P 590ee39ce5734876b94d91fc3931b807 reported cstate change: term changed from 1 to 2, leader changed from 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194) to 590ee39ce5734876b94d91fc3931b807 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "590ee39ce5734876b94d91fc3931b807" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:22.656858  9353 raft_consensus.cc:1081] T 30e220d65bed42489b2af858d3a60981 P 53a66c851dc74c70b94c65d464a391f6 [term 2 LEADER]: Signalling peer 590ee39ce5734876b94d91fc3931b807 to start an election
I20260709 13:02:22.658555  9224 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "30e220d65bed42489b2af858d3a60981"
dest_uuid: "590ee39ce5734876b94d91fc3931b807"
 from {username='slave'} at 127.0.0.1:56016
I20260709 13:02:22.659134  9224 raft_consensus.cc:493] T 30e220d65bed42489b2af858d3a60981 P 590ee39ce5734876b94d91fc3931b807 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:22.659780  9224 raft_consensus.cc:3060] T 30e220d65bed42489b2af858d3a60981 P 590ee39ce5734876b94d91fc3931b807 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:22.662746  8476 raft_consensus.cc:515] T 7ed73594956241f4b3e6e456bae82964 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:22.668947  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed73594956241f4b3e6e456bae82964" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "53a66c851dc74c70b94c65d464a391f6"
I20260709 13:02:22.669584  8398 raft_consensus.cc:3055] T 7ed73594956241f4b3e6e456bae82964 P 53a66c851dc74c70b94c65d464a391f6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:22.669891  8398 raft_consensus.cc:740] T 7ed73594956241f4b3e6e456bae82964 P 53a66c851dc74c70b94c65d464a391f6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Running, Role: LEADER
I20260709 13:02:22.670261  8476 leader_election.cc:290] T 7ed73594956241f4b3e6e456bae82964 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 2 election: Requested vote from peers 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751), b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503)
I20260709 13:02:22.670751  8398 consensus_queue.cc:260] T 7ed73594956241f4b3e6e456bae82964 P 53a66c851dc74c70b94c65d464a391f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:22.671350  8552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7ed73594956241f4b3e6e456bae82964" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3"
I20260709 13:02:22.671926  8552 raft_consensus.cc:3060] T 7ed73594956241f4b3e6e456bae82964 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:22.672016  8398 raft_consensus.cc:3060] T 7ed73594956241f4b3e6e456bae82964 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:22.679656  8552 raft_consensus.cc:2468] T 7ed73594956241f4b3e6e456bae82964 P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b3ea460d1294b8a82672d7c21475cb5 in term 2.
I20260709 13:02:22.681741  8443 leader_election.cc:304] T 7ed73594956241f4b3e6e456bae82964 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b3ea460d1294b8a82672d7c21475cb5, b560e9aaec7a4c78b9123b38e73519a3; no voters: 
I20260709 13:02:22.682649  9224 raft_consensus.cc:515] T 30e220d65bed42489b2af858d3a60981 P 590ee39ce5734876b94d91fc3931b807 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:22.683260  9338 raft_consensus.cc:2804] T 7ed73594956241f4b3e6e456bae82964 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:22.683857  9338 raft_consensus.cc:697] T 7ed73594956241f4b3e6e456bae82964 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 LEADER]: Becoming Leader. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Running, Role: LEADER
I20260709 13:02:22.685011  9224 leader_election.cc:290] T 30e220d65bed42489b2af858d3a60981 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 3 election: Requested vote from peers 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:02:22.693112  8398 raft_consensus.cc:2468] T 7ed73594956241f4b3e6e456bae82964 P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b3ea460d1294b8a82672d7c21475cb5 in term 2.
I20260709 13:02:22.694377  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e220d65bed42489b2af858d3a60981" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "53a66c851dc74c70b94c65d464a391f6"
I20260709 13:02:22.695080  8399 raft_consensus.cc:3055] T 30e220d65bed42489b2af858d3a60981 P 53a66c851dc74c70b94c65d464a391f6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:22.695482  8399 raft_consensus.cc:740] T 30e220d65bed42489b2af858d3a60981 P 53a66c851dc74c70b94c65d464a391f6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Running, Role: LEADER
I20260709 13:02:22.695556  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e220d65bed42489b2af858d3a60981" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5"
I20260709 13:02:22.696285  8475 raft_consensus.cc:3060] T 30e220d65bed42489b2af858d3a60981 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:22.696367  8399 consensus_queue.cc:260] T 30e220d65bed42489b2af858d3a60981 P 53a66c851dc74c70b94c65d464a391f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:22.697932  8399 raft_consensus.cc:3060] T 30e220d65bed42489b2af858d3a60981 P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:22.698675  9338 consensus_queue.cc:237] T 7ed73594956241f4b3e6e456bae82964 P 7b3ea460d1294b8a82672d7c21475cb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:22.706157  8475 raft_consensus.cc:2468] T 30e220d65bed42489b2af858d3a60981 P 7b3ea460d1294b8a82672d7c21475cb5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 590ee39ce5734876b94d91fc3931b807 in term 3.
I20260709 13:02:22.714567  8399 raft_consensus.cc:2468] T 30e220d65bed42489b2af858d3a60981 P 53a66c851dc74c70b94c65d464a391f6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 590ee39ce5734876b94d91fc3931b807 in term 3.
I20260709 13:02:22.716480  9144 leader_election.cc:304] T 30e220d65bed42489b2af858d3a60981 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, 590ee39ce5734876b94d91fc3931b807; no voters: 
I20260709 13:02:22.717844  9379 raft_consensus.cc:2804] T 30e220d65bed42489b2af858d3a60981 P 590ee39ce5734876b94d91fc3931b807 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:22.718452  9379 raft_consensus.cc:697] T 30e220d65bed42489b2af858d3a60981 P 590ee39ce5734876b94d91fc3931b807 [term 3 LEADER]: Becoming Leader. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Running, Role: LEADER
I20260709 13:02:22.719290  9379 consensus_queue.cc:237] T 30e220d65bed42489b2af858d3a60981 P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:22.746172  9368 raft_consensus.cc:993] T 40926724afa743899b7ab0af312dc717 P 7b3ea460d1294b8a82672d7c21475cb5: : Instructing follower 53a66c851dc74c70b94c65d464a391f6 to start an election
I20260709 13:02:22.746729  9368 raft_consensus.cc:1081] T 40926724afa743899b7ab0af312dc717 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 LEADER]: Signalling peer 53a66c851dc74c70b94c65d464a391f6 to start an election
I20260709 13:02:22.748518  8399 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "40926724afa743899b7ab0af312dc717"
dest_uuid: "53a66c851dc74c70b94c65d464a391f6"
 from {username='slave'} at 127.0.0.1:51016
I20260709 13:02:22.749046  8399 raft_consensus.cc:493] T 40926724afa743899b7ab0af312dc717 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:22.749390  8399 raft_consensus.cc:3060] T 40926724afa743899b7ab0af312dc717 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:22.756938  8399 raft_consensus.cc:515] T 40926724afa743899b7ab0af312dc717 P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:22.760111  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40926724afa743899b7ab0af312dc717" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5"
I20260709 13:02:22.760733  8476 raft_consensus.cc:3055] T 40926724afa743899b7ab0af312dc717 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:22.761049  8476 raft_consensus.cc:740] T 40926724afa743899b7ab0af312dc717 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Running, Role: LEADER
W20260709 13:02:22.761443  9386 log.cc:927] Time spent T 7ed73594956241f4b3e6e456bae82964 P 7b3ea460d1294b8a82672d7c21475cb5: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:02:22.761763  8476 consensus_queue.cc:260] T 40926724afa743899b7ab0af312dc717 P 7b3ea460d1294b8a82672d7c21475cb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:22.763023  8476 raft_consensus.cc:3060] T 40926724afa743899b7ab0af312dc717 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:22.769596  8476 raft_consensus.cc:2468] T 40926724afa743899b7ab0af312dc717 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53a66c851dc74c70b94c65d464a391f6 in term 2.
I20260709 13:02:22.770898  8370 leader_election.cc:304] T 40926724afa743899b7ab0af312dc717 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, 7b3ea460d1294b8a82672d7c21475cb5; no voters: 
I20260709 13:02:22.771790  9369 raft_consensus.cc:2804] T 40926724afa743899b7ab0af312dc717 P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:22.772061  8552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40926724afa743899b7ab0af312dc717" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3"
I20260709 13:02:22.772722  8552 raft_consensus.cc:3060] T 40926724afa743899b7ab0af312dc717 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:22.772295  9369 raft_consensus.cc:697] T 40926724afa743899b7ab0af312dc717 P 53a66c851dc74c70b94c65d464a391f6 [term 2 LEADER]: Becoming Leader. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Running, Role: LEADER
I20260709 13:02:22.774962  9369 consensus_queue.cc:237] T 40926724afa743899b7ab0af312dc717 P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:22.779964  8552 raft_consensus.cc:2468] T 40926724afa743899b7ab0af312dc717 P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53a66c851dc74c70b94c65d464a391f6 in term 2.
I20260709 13:02:22.782549  8399 leader_election.cc:290] T 40926724afa743899b7ab0af312dc717 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 2 election: Requested vote from peers 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429), b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503)
I20260709 13:02:22.789497  8225 catalog_manager.cc:5697] T 7ed73594956241f4b3e6e456bae82964 P 7b3ea460d1294b8a82672d7c21475cb5 reported cstate change: term changed from 1 to 2, leader changed from 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194) to 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "7b3ea460d1294b8a82672d7c21475cb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:22.821501  8228 catalog_manager.cc:5697] T 40926724afa743899b7ab0af312dc717 P 53a66c851dc74c70b94c65d464a391f6 reported cstate change: term changed from 1 to 2, leader changed from 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195) to 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "53a66c851dc74c70b94c65d464a391f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:22.838205  8225 catalog_manager.cc:5697] T 5db51a6d67e6461a98e669fa2b1e59c8 P 590ee39ce5734876b94d91fc3931b807 reported cstate change: term changed from 1 to 2, leader changed from b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196) to 590ee39ce5734876b94d91fc3931b807 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "590ee39ce5734876b94d91fc3931b807" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:22.839912  8225 catalog_manager.cc:5697] T 8e53899e04fe4f58b666f67ac07bbf79 P 590ee39ce5734876b94d91fc3931b807 reported cstate change: term changed from 2 to 3, leader changed from 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194) to 590ee39ce5734876b94d91fc3931b807 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "590ee39ce5734876b94d91fc3931b807" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:22.841470  8225 catalog_manager.cc:5697] T 30e220d65bed42489b2af858d3a60981 P 590ee39ce5734876b94d91fc3931b807 reported cstate change: term changed from 2 to 3, leader changed from 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194) to 590ee39ce5734876b94d91fc3931b807 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "590ee39ce5734876b94d91fc3931b807" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:23.010331  8476 raft_consensus.cc:1275] T 8e53899e04fe4f58b666f67ac07bbf79 P 7b3ea460d1294b8a82672d7c21475cb5 [term 3 FOLLOWER]: Refusing update from remote peer 590ee39ce5734876b94d91fc3931b807: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:23.012148  9379 consensus_queue.cc:1048] T 8e53899e04fe4f58b666f67ac07bbf79 P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:23.047034  8398 raft_consensus.cc:1275] T 8e53899e04fe4f58b666f67ac07bbf79 P 53a66c851dc74c70b94c65d464a391f6 [term 3 FOLLOWER]: Refusing update from remote peer 590ee39ce5734876b94d91fc3931b807: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:23.070438  9379 consensus_queue.cc:1048] T 8e53899e04fe4f58b666f67ac07bbf79 P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:23.127246  8546 raft_consensus.cc:1275] T 45171bd0207f452f9884a58c225ddb72 P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Refusing update from remote peer 590ee39ce5734876b94d91fc3931b807: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:23.129091  9379 consensus_queue.cc:1048] T 45171bd0207f452f9884a58c225ddb72 P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:23.144073  8400 raft_consensus.cc:1275] T 45171bd0207f452f9884a58c225ddb72 P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Refusing update from remote peer 590ee39ce5734876b94d91fc3931b807: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:23.149233  9378 consensus_queue.cc:1048] T 45171bd0207f452f9884a58c225ddb72 P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:23.164057  8546 raft_consensus.cc:1275] T 5db51a6d67e6461a98e669fa2b1e59c8 P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Refusing update from remote peer 590ee39ce5734876b94d91fc3931b807: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:23.166288  9379 consensus_queue.cc:1048] T 5db51a6d67e6461a98e669fa2b1e59c8 P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:23.192343  8400 raft_consensus.cc:1275] T 5db51a6d67e6461a98e669fa2b1e59c8 P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Refusing update from remote peer 590ee39ce5734876b94d91fc3931b807: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:23.194028  9375 consensus_queue.cc:1048] T 5db51a6d67e6461a98e669fa2b1e59c8 P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:23.228099  8398 raft_consensus.cc:1275] T 7ed73594956241f4b3e6e456bae82964 P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Refusing update from remote peer 7b3ea460d1294b8a82672d7c21475cb5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:23.231966  9368 consensus_queue.cc:1048] T 7ed73594956241f4b3e6e456bae82964 P 7b3ea460d1294b8a82672d7c21475cb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:23.236708  8546 raft_consensus.cc:1275] T 7ed73594956241f4b3e6e456bae82964 P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Refusing update from remote peer 7b3ea460d1294b8a82672d7c21475cb5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:23.239097  9338 consensus_queue.cc:1048] T 7ed73594956241f4b3e6e456bae82964 P 7b3ea460d1294b8a82672d7c21475cb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:23.253451  8476 raft_consensus.cc:1275] T 40926724afa743899b7ab0af312dc717 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Refusing update from remote peer 53a66c851dc74c70b94c65d464a391f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:23.255884  9369 consensus_queue.cc:1048] T 40926724afa743899b7ab0af312dc717 P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:23.282119  8398 raft_consensus.cc:1275] T 30e220d65bed42489b2af858d3a60981 P 53a66c851dc74c70b94c65d464a391f6 [term 3 FOLLOWER]: Refusing update from remote peer 590ee39ce5734876b94d91fc3931b807: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:23.284178  9379 consensus_queue.cc:1048] T 30e220d65bed42489b2af858d3a60981 P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:02:23.350458  8475 raft_consensus.cc:1275] T 30e220d65bed42489b2af858d3a60981 P 7b3ea460d1294b8a82672d7c21475cb5 [term 3 FOLLOWER]: Refusing update from remote peer 590ee39ce5734876b94d91fc3931b807: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:23.352720  9379 consensus_queue.cc:1048] T 30e220d65bed42489b2af858d3a60981 P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:02:23.356869  9406 log.cc:927] Time spent T 7ed73594956241f4b3e6e456bae82964 P 53a66c851dc74c70b94c65d464a391f6: Append to log took a long time: real 0.061s	user 0.004s	sys 0.005s
I20260709 13:02:23.389531  8552 raft_consensus.cc:1275] T 40926724afa743899b7ab0af312dc717 P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Refusing update from remote peer 53a66c851dc74c70b94c65d464a391f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:23.391170  9367 consensus_queue.cc:1048] T 40926724afa743899b7ab0af312dc717 P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:23.416787   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:23.563055   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:23.625384  8398 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3921dc7d601b4e4ea05f40ca34d69819"
dest_uuid: "53a66c851dc74c70b94c65d464a391f6"
mode: GRACEFUL
new_leader_uuid: "590ee39ce5734876b94d91fc3931b807"
 from {username='slave'} at 127.0.0.1:48082
I20260709 13:02:23.626343  8398 raft_consensus.cc:606] T 3921dc7d601b4e4ea05f40ca34d69819 P 53a66c851dc74c70b94c65d464a391f6 [term 1 LEADER]: Received request to transfer leadership to TS 590ee39ce5734876b94d91fc3931b807
I20260709 13:02:23.629361  8546 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "435da692a6474cb697066524d4f5216e"
dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3"
mode: GRACEFUL
new_leader_uuid: "53a66c851dc74c70b94c65d464a391f6"
 from {username='slave'} at 127.0.0.1:51694
I20260709 13:02:23.629896  8546 raft_consensus.cc:606] T 435da692a6474cb697066524d4f5216e P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Received request to transfer leadership to TS 53a66c851dc74c70b94c65d464a391f6
I20260709 13:02:23.632429  8546 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a94bf713e4848879b9e2a1bbec03def"
dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3"
mode: GRACEFUL
new_leader_uuid: "590ee39ce5734876b94d91fc3931b807"
 from {username='slave'} at 127.0.0.1:51694
I20260709 13:02:23.632972  8546 raft_consensus.cc:606] T 5a94bf713e4848879b9e2a1bbec03def P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Received request to transfer leadership to TS 590ee39ce5734876b94d91fc3931b807
I20260709 13:02:23.635574  8475 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1d8e928d8444f77ac2950eab2115f65"
dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5"
mode: GRACEFUL
new_leader_uuid: "590ee39ce5734876b94d91fc3931b807"
 from {username='slave'} at 127.0.0.1:40498
I20260709 13:02:23.636059  8475 raft_consensus.cc:606] T b1d8e928d8444f77ac2950eab2115f65 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 LEADER]: Received request to transfer leadership to TS 590ee39ce5734876b94d91fc3931b807
I20260709 13:02:23.638275  8475 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c66f53044d784114970ae5061755da40"
dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5"
mode: GRACEFUL
new_leader_uuid: "590ee39ce5734876b94d91fc3931b807"
 from {username='slave'} at 127.0.0.1:40498
I20260709 13:02:23.638688  8475 raft_consensus.cc:606] T c66f53044d784114970ae5061755da40 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 LEADER]: Received request to transfer leadership to TS 590ee39ce5734876b94d91fc3931b807
I20260709 13:02:23.639708   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:02:23.641396   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:23.649847  9412 raft_consensus.cc:993] T 3921dc7d601b4e4ea05f40ca34d69819 P 53a66c851dc74c70b94c65d464a391f6: : Instructing follower 590ee39ce5734876b94d91fc3931b807 to start an election
I20260709 13:02:23.650406  9412 raft_consensus.cc:1081] T 3921dc7d601b4e4ea05f40ca34d69819 P 53a66c851dc74c70b94c65d464a391f6 [term 1 LEADER]: Signalling peer 590ee39ce5734876b94d91fc3931b807 to start an election
I20260709 13:02:23.655126  9225 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3921dc7d601b4e4ea05f40ca34d69819"
dest_uuid: "590ee39ce5734876b94d91fc3931b807"
 from {username='slave'} at 127.0.0.1:56016
I20260709 13:02:23.655632  9225 raft_consensus.cc:493] T 3921dc7d601b4e4ea05f40ca34d69819 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:23.661492  9225 raft_consensus.cc:3060] T 3921dc7d601b4e4ea05f40ca34d69819 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:23.669199  9225 raft_consensus.cc:515] T 3921dc7d601b4e4ea05f40ca34d69819 P 590ee39ce5734876b94d91fc3931b807 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:23.671224  9225 leader_election.cc:290] T 3921dc7d601b4e4ea05f40ca34d69819 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 2 election: Requested vote from peers 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:02:23.672200  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3921dc7d601b4e4ea05f40ca34d69819" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5"
I20260709 13:02:23.672588  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3921dc7d601b4e4ea05f40ca34d69819" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "53a66c851dc74c70b94c65d464a391f6"
I20260709 13:02:23.672873  8475 raft_consensus.cc:3060] T 3921dc7d601b4e4ea05f40ca34d69819 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:23.673164  8398 raft_consensus.cc:3055] T 3921dc7d601b4e4ea05f40ca34d69819 P 53a66c851dc74c70b94c65d464a391f6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:23.673465  8398 raft_consensus.cc:740] T 3921dc7d601b4e4ea05f40ca34d69819 P 53a66c851dc74c70b94c65d464a391f6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Running, Role: LEADER
I20260709 13:02:23.674261  8398 consensus_queue.cc:260] T 3921dc7d601b4e4ea05f40ca34d69819 P 53a66c851dc74c70b94c65d464a391f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:23.675520  8398 raft_consensus.cc:3060] T 3921dc7d601b4e4ea05f40ca34d69819 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:23.681818  8475 raft_consensus.cc:2468] T 3921dc7d601b4e4ea05f40ca34d69819 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 590ee39ce5734876b94d91fc3931b807 in term 2.
I20260709 13:02:23.682929  9144 leader_election.cc:304] T 3921dc7d601b4e4ea05f40ca34d69819 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807, 7b3ea460d1294b8a82672d7c21475cb5; no voters: 
I20260709 13:02:23.683635  9379 raft_consensus.cc:2804] T 3921dc7d601b4e4ea05f40ca34d69819 P 590ee39ce5734876b94d91fc3931b807 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:23.684080  9379 raft_consensus.cc:697] T 3921dc7d601b4e4ea05f40ca34d69819 P 590ee39ce5734876b94d91fc3931b807 [term 2 LEADER]: Becoming Leader. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Running, Role: LEADER
I20260709 13:02:23.685614  8398 raft_consensus.cc:2468] T 3921dc7d601b4e4ea05f40ca34d69819 P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 590ee39ce5734876b94d91fc3931b807 in term 2.
I20260709 13:02:23.685535  9379 consensus_queue.cc:237] T 3921dc7d601b4e4ea05f40ca34d69819 P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:23.690696  9410 raft_consensus.cc:993] T c66f53044d784114970ae5061755da40 P 7b3ea460d1294b8a82672d7c21475cb5: : Instructing follower 590ee39ce5734876b94d91fc3931b807 to start an election
I20260709 13:02:23.691206  9410 raft_consensus.cc:1081] T c66f53044d784114970ae5061755da40 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 LEADER]: Signalling peer 590ee39ce5734876b94d91fc3931b807 to start an election
I20260709 13:02:23.693771  9225 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c66f53044d784114970ae5061755da40"
dest_uuid: "590ee39ce5734876b94d91fc3931b807"
 from {username='slave'} at 127.0.0.1:56034
I20260709 13:02:23.694444  9225 raft_consensus.cc:493] T c66f53044d784114970ae5061755da40 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:23.694866  9225 raft_consensus.cc:3060] T c66f53044d784114970ae5061755da40 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:23.701550  9225 raft_consensus.cc:515] T c66f53044d784114970ae5061755da40 P 590ee39ce5734876b94d91fc3931b807 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:23.704104  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66f53044d784114970ae5061755da40" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "53a66c851dc74c70b94c65d464a391f6"
I20260709 13:02:23.704679  8398 raft_consensus.cc:3060] T c66f53044d784114970ae5061755da40 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:23.713030  8225 catalog_manager.cc:5697] T 3921dc7d601b4e4ea05f40ca34d69819 P 590ee39ce5734876b94d91fc3931b807 reported cstate change: term changed from 1 to 2, leader changed from 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194) to 590ee39ce5734876b94d91fc3931b807 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "590ee39ce5734876b94d91fc3931b807" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:23.714187  8398 raft_consensus.cc:2468] T c66f53044d784114970ae5061755da40 P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 590ee39ce5734876b94d91fc3931b807 in term 2.
I20260709 13:02:23.719936  9144 leader_election.cc:304] T c66f53044d784114970ae5061755da40 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, 590ee39ce5734876b94d91fc3931b807; no voters: 
I20260709 13:02:23.720715  9379 raft_consensus.cc:2804] T c66f53044d784114970ae5061755da40 P 590ee39ce5734876b94d91fc3931b807 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:23.721191  9379 raft_consensus.cc:697] T c66f53044d784114970ae5061755da40 P 590ee39ce5734876b94d91fc3931b807 [term 2 LEADER]: Becoming Leader. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Running, Role: LEADER
I20260709 13:02:23.721819  9360 raft_consensus.cc:993] T 435da692a6474cb697066524d4f5216e P b560e9aaec7a4c78b9123b38e73519a3: : Instructing follower 53a66c851dc74c70b94c65d464a391f6 to start an election
I20260709 13:02:23.722337  9360 raft_consensus.cc:1081] T 435da692a6474cb697066524d4f5216e P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Signalling peer 53a66c851dc74c70b94c65d464a391f6 to start an election
I20260709 13:02:23.722177  9379 consensus_queue.cc:237] T c66f53044d784114970ae5061755da40 P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:23.715356  9225 leader_election.cc:290] T c66f53044d784114970ae5061755da40 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 2 election: Requested vote from peers 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:02:23.717078  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c66f53044d784114970ae5061755da40" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5"
I20260709 13:02:23.726255  8475 raft_consensus.cc:3055] T c66f53044d784114970ae5061755da40 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:23.725603  8400 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "435da692a6474cb697066524d4f5216e"
dest_uuid: "53a66c851dc74c70b94c65d464a391f6"
 from {username='slave'} at 127.0.0.1:51022
I20260709 13:02:23.726797  8400 raft_consensus.cc:493] T 435da692a6474cb697066524d4f5216e P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:23.726548  8475 raft_consensus.cc:740] T c66f53044d784114970ae5061755da40 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Running, Role: LEADER
I20260709 13:02:23.727134  8400 raft_consensus.cc:3060] T 435da692a6474cb697066524d4f5216e P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:23.727890  8475 consensus_queue.cc:260] T c66f53044d784114970ae5061755da40 P 7b3ea460d1294b8a82672d7c21475cb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:23.729247  8475 raft_consensus.cc:3060] T c66f53044d784114970ae5061755da40 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:23.735447  8400 raft_consensus.cc:515] T 435da692a6474cb697066524d4f5216e P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:23.740517  8476 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435da692a6474cb697066524d4f5216e" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5"
I20260709 13:02:23.740950  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435da692a6474cb697066524d4f5216e" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3"
I20260709 13:02:23.741143  8476 raft_consensus.cc:3060] T 435da692a6474cb697066524d4f5216e P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:23.741582  8546 raft_consensus.cc:3055] T 435da692a6474cb697066524d4f5216e P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:23.741900  8546 raft_consensus.cc:740] T 435da692a6474cb697066524d4f5216e P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Running, Role: LEADER
I20260709 13:02:23.742614  8546 consensus_queue.cc:260] T 435da692a6474cb697066524d4f5216e P b560e9aaec7a4c78b9123b38e73519a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:23.743757  8546 raft_consensus.cc:3060] T 435da692a6474cb697066524d4f5216e P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:23.748274  8476 raft_consensus.cc:2468] T 435da692a6474cb697066524d4f5216e P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53a66c851dc74c70b94c65d464a391f6 in term 2.
I20260709 13:02:23.751739  8546 raft_consensus.cc:2468] T 435da692a6474cb697066524d4f5216e P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53a66c851dc74c70b94c65d464a391f6 in term 2.
I20260709 13:02:23.767473  8369 leader_election.cc:304] T 435da692a6474cb697066524d4f5216e P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, b560e9aaec7a4c78b9123b38e73519a3; no voters: 
I20260709 13:02:23.754779  8400 leader_election.cc:290] T 435da692a6474cb697066524d4f5216e P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 2 election: Requested vote from peers 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429), b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503)
I20260709 13:02:23.772815  9412 raft_consensus.cc:2804] T 435da692a6474cb697066524d4f5216e P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:23.773367  9412 raft_consensus.cc:697] T 435da692a6474cb697066524d4f5216e P 53a66c851dc74c70b94c65d464a391f6 [term 2 LEADER]: Becoming Leader. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Running, Role: LEADER
I20260709 13:02:23.774212  9412 consensus_queue.cc:237] T 435da692a6474cb697066524d4f5216e P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:23.771198  8475 raft_consensus.cc:2468] T c66f53044d784114970ae5061755da40 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 590ee39ce5734876b94d91fc3931b807 in term 2.
I20260709 13:02:23.777222  9408 raft_consensus.cc:993] T b1d8e928d8444f77ac2950eab2115f65 P 7b3ea460d1294b8a82672d7c21475cb5: : Instructing follower 590ee39ce5734876b94d91fc3931b807 to start an election
I20260709 13:02:23.778043  9408 raft_consensus.cc:1081] T b1d8e928d8444f77ac2950eab2115f65 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 LEADER]: Signalling peer 590ee39ce5734876b94d91fc3931b807 to start an election
I20260709 13:02:23.780715  9225 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b1d8e928d8444f77ac2950eab2115f65"
dest_uuid: "590ee39ce5734876b94d91fc3931b807"
 from {username='slave'} at 127.0.0.1:56034
I20260709 13:02:23.781426  9225 raft_consensus.cc:493] T b1d8e928d8444f77ac2950eab2115f65 P 590ee39ce5734876b94d91fc3931b807 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:23.781911  9225 raft_consensus.cc:3060] T b1d8e928d8444f77ac2950eab2115f65 P 590ee39ce5734876b94d91fc3931b807 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:23.788303  9394 raft_consensus.cc:993] T 5a94bf713e4848879b9e2a1bbec03def P b560e9aaec7a4c78b9123b38e73519a3: : Instructing follower 590ee39ce5734876b94d91fc3931b807 to start an election
I20260709 13:02:23.789012  9394 raft_consensus.cc:1081] T 5a94bf713e4848879b9e2a1bbec03def P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Signalling peer 590ee39ce5734876b94d91fc3931b807 to start an election
I20260709 13:02:23.798365  9222 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a94bf713e4848879b9e2a1bbec03def"
dest_uuid: "590ee39ce5734876b94d91fc3931b807"
 from {username='slave'} at 127.0.0.1:56020
I20260709 13:02:23.799106  9222 raft_consensus.cc:493] T 5a94bf713e4848879b9e2a1bbec03def P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:23.799559  9222 raft_consensus.cc:3060] T 5a94bf713e4848879b9e2a1bbec03def P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:23.816322  9225 raft_consensus.cc:515] T b1d8e928d8444f77ac2950eab2115f65 P 590ee39ce5734876b94d91fc3931b807 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:23.819653  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d8e928d8444f77ac2950eab2115f65" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "53a66c851dc74c70b94c65d464a391f6"
I20260709 13:02:23.818975  9225 leader_election.cc:290] T b1d8e928d8444f77ac2950eab2115f65 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 3 election: Requested vote from peers 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:02:23.820223  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1d8e928d8444f77ac2950eab2115f65" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5"
I20260709 13:02:23.820840  8475 raft_consensus.cc:3055] T b1d8e928d8444f77ac2950eab2115f65 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:23.821130  8475 raft_consensus.cc:740] T b1d8e928d8444f77ac2950eab2115f65 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Running, Role: LEADER
I20260709 13:02:23.821941  8475 consensus_queue.cc:260] T b1d8e928d8444f77ac2950eab2115f65 P 7b3ea460d1294b8a82672d7c21475cb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:23.822948  8475 raft_consensus.cc:3060] T b1d8e928d8444f77ac2950eab2115f65 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:23.820237  8400 raft_consensus.cc:3060] T b1d8e928d8444f77ac2950eab2115f65 P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:23.827695  8228 catalog_manager.cc:5697] T 435da692a6474cb697066524d4f5216e P 53a66c851dc74c70b94c65d464a391f6 reported cstate change: term changed from 1 to 2, leader changed from b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196) to 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "53a66c851dc74c70b94c65d464a391f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:23.853716  9222 raft_consensus.cc:515] T 5a94bf713e4848879b9e2a1bbec03def P 590ee39ce5734876b94d91fc3931b807 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:23.856926  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a94bf713e4848879b9e2a1bbec03def" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3"
I20260709 13:02:23.857585  8546 raft_consensus.cc:3055] T 5a94bf713e4848879b9e2a1bbec03def P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:23.857960  8546 raft_consensus.cc:740] T 5a94bf713e4848879b9e2a1bbec03def P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Running, Role: LEADER
I20260709 13:02:23.858846  8546 consensus_queue.cc:260] T 5a94bf713e4848879b9e2a1bbec03def P b560e9aaec7a4c78b9123b38e73519a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:23.860116  8546 raft_consensus.cc:3060] T 5a94bf713e4848879b9e2a1bbec03def P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:23.864835  8475 raft_consensus.cc:2468] T b1d8e928d8444f77ac2950eab2115f65 P 7b3ea460d1294b8a82672d7c21475cb5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 590ee39ce5734876b94d91fc3931b807 in term 3.
I20260709 13:02:23.868165  9144 leader_election.cc:304] T b1d8e928d8444f77ac2950eab2115f65 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807, 7b3ea460d1294b8a82672d7c21475cb5; no voters: 
I20260709 13:02:23.868999  9379 raft_consensus.cc:2804] T b1d8e928d8444f77ac2950eab2115f65 P 590ee39ce5734876b94d91fc3931b807 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:23.869448  9379 raft_consensus.cc:697] T b1d8e928d8444f77ac2950eab2115f65 P 590ee39ce5734876b94d91fc3931b807 [term 3 LEADER]: Becoming Leader. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Running, Role: LEADER
I20260709 13:02:23.870332  9379 consensus_queue.cc:237] T b1d8e928d8444f77ac2950eab2115f65 P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } }
I20260709 13:02:23.871592  8228 catalog_manager.cc:5697] T c66f53044d784114970ae5061755da40 P 590ee39ce5734876b94d91fc3931b807 reported cstate change: term changed from 1 to 2, leader changed from 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195) to 590ee39ce5734876b94d91fc3931b807 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "590ee39ce5734876b94d91fc3931b807" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:23.900758  8546 raft_consensus.cc:2468] T 5a94bf713e4848879b9e2a1bbec03def P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 590ee39ce5734876b94d91fc3931b807 in term 2.
I20260709 13:02:23.901991  9143 leader_election.cc:304] T 5a94bf713e4848879b9e2a1bbec03def P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807, b560e9aaec7a4c78b9123b38e73519a3; no voters: 
I20260709 13:02:23.902873  9379 raft_consensus.cc:2804] T 5a94bf713e4848879b9e2a1bbec03def P 590ee39ce5734876b94d91fc3931b807 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:23.903539  9379 raft_consensus.cc:697] T 5a94bf713e4848879b9e2a1bbec03def P 590ee39ce5734876b94d91fc3931b807 [term 2 LEADER]: Becoming Leader. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Running, Role: LEADER
I20260709 13:02:23.904567  8400 raft_consensus.cc:2468] T b1d8e928d8444f77ac2950eab2115f65 P 53a66c851dc74c70b94c65d464a391f6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 590ee39ce5734876b94d91fc3931b807 in term 3.
I20260709 13:02:23.904500  9379 consensus_queue.cc:237] T 5a94bf713e4848879b9e2a1bbec03def P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:23.906921  9222 leader_election.cc:290] T 5a94bf713e4848879b9e2a1bbec03def P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 2 election: Requested vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:02:23.924206  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a94bf713e4848879b9e2a1bbec03def" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "53a66c851dc74c70b94c65d464a391f6"
I20260709 13:02:23.924826  8400 raft_consensus.cc:3060] T 5a94bf713e4848879b9e2a1bbec03def P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:23.923799  8228 catalog_manager.cc:5697] T b1d8e928d8444f77ac2950eab2115f65 P 590ee39ce5734876b94d91fc3931b807 reported cstate change: term changed from 2 to 3, leader changed from 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195) to 590ee39ce5734876b94d91fc3931b807 (127.0.107.193). New cstate: current_term: 3 leader_uuid: "590ee39ce5734876b94d91fc3931b807" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:23.943996  8400 raft_consensus.cc:2468] T 5a94bf713e4848879b9e2a1bbec03def P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 590ee39ce5734876b94d91fc3931b807 in term 2.
I20260709 13:02:23.951398  8228 catalog_manager.cc:5697] T 5a94bf713e4848879b9e2a1bbec03def P 590ee39ce5734876b94d91fc3931b807 reported cstate change: term changed from 1 to 2, leader changed from b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196) to 590ee39ce5734876b94d91fc3931b807 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "590ee39ce5734876b94d91fc3931b807" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:24.167196  8476 raft_consensus.cc:1275] T 3921dc7d601b4e4ea05f40ca34d69819 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Refusing update from remote peer 590ee39ce5734876b94d91fc3931b807: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:24.168349  9375 consensus_queue.cc:1048] T 3921dc7d601b4e4ea05f40ca34d69819 P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:24.186214  8400 raft_consensus.cc:1275] T 3921dc7d601b4e4ea05f40ca34d69819 P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Refusing update from remote peer 590ee39ce5734876b94d91fc3931b807: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:24.189512  9375 consensus_queue.cc:1048] T 3921dc7d601b4e4ea05f40ca34d69819 P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:24.204002  8476 raft_consensus.cc:1275] T 435da692a6474cb697066524d4f5216e P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Refusing update from remote peer 53a66c851dc74c70b94c65d464a391f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:24.205199  9353 consensus_queue.cc:1048] T 435da692a6474cb697066524d4f5216e P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:24.216614  8476 raft_consensus.cc:1275] T c66f53044d784114970ae5061755da40 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Refusing update from remote peer 590ee39ce5734876b94d91fc3931b807: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:24.217957  9379 consensus_queue.cc:1048] T c66f53044d784114970ae5061755da40 P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:24.220381  8546 raft_consensus.cc:1275] T 435da692a6474cb697066524d4f5216e P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Refusing update from remote peer 53a66c851dc74c70b94c65d464a391f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:24.224722  9411 consensus_queue.cc:1048] T 435da692a6474cb697066524d4f5216e P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:24.259096  8400 raft_consensus.cc:1275] T c66f53044d784114970ae5061755da40 P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Refusing update from remote peer 590ee39ce5734876b94d91fc3931b807: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:24.261304  9379 consensus_queue.cc:1048] T c66f53044d784114970ae5061755da40 P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:24.344357  8475 raft_consensus.cc:1275] T b1d8e928d8444f77ac2950eab2115f65 P 7b3ea460d1294b8a82672d7c21475cb5 [term 3 FOLLOWER]: Refusing update from remote peer 590ee39ce5734876b94d91fc3931b807: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:24.345548  9379 consensus_queue.cc:1048] T b1d8e928d8444f77ac2950eab2115f65 P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:24.353721  8398 raft_consensus.cc:1275] T b1d8e928d8444f77ac2950eab2115f65 P 53a66c851dc74c70b94c65d464a391f6 [term 3 FOLLOWER]: Refusing update from remote peer 590ee39ce5734876b94d91fc3931b807: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:24.355085  9379 consensus_queue.cc:1048] T b1d8e928d8444f77ac2950eab2115f65 P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:24.414336  8400 raft_consensus.cc:1275] T 5a94bf713e4848879b9e2a1bbec03def P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Refusing update from remote peer 590ee39ce5734876b94d91fc3931b807: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:24.415499  9379 consensus_queue.cc:1048] T 5a94bf713e4848879b9e2a1bbec03def P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:24.427068  8546 raft_consensus.cc:1275] T 5a94bf713e4848879b9e2a1bbec03def P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Refusing update from remote peer 590ee39ce5734876b94d91fc3931b807: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:24.428471  9426 consensus_queue.cc:1048] T 5a94bf713e4848879b9e2a1bbec03def P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:24.642690   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:24.684389   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:24.720171  8549 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1162036be6064d5c821df6a7aa486bab"
dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3"
mode: GRACEFUL
new_leader_uuid: "590ee39ce5734876b94d91fc3931b807"
 from {username='slave'} at 127.0.0.1:51694
I20260709 13:02:24.720821  8549 raft_consensus.cc:606] T 1162036be6064d5c821df6a7aa486bab P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Received request to transfer leadership to TS 590ee39ce5734876b94d91fc3931b807
I20260709 13:02:24.723608  8400 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "435da692a6474cb697066524d4f5216e"
dest_uuid: "53a66c851dc74c70b94c65d464a391f6"
mode: GRACEFUL
new_leader_uuid: "7b3ea460d1294b8a82672d7c21475cb5"
 from {username='slave'} at 127.0.0.1:48082
I20260709 13:02:24.724090  8400 raft_consensus.cc:606] T 435da692a6474cb697066524d4f5216e P 53a66c851dc74c70b94c65d464a391f6 [term 2 LEADER]: Received request to transfer leadership to TS 7b3ea460d1294b8a82672d7c21475cb5
I20260709 13:02:24.726485  8549 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a82728feb4f4f1094191c0e30d748dd"
dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3"
mode: GRACEFUL
new_leader_uuid: "53a66c851dc74c70b94c65d464a391f6"
 from {username='slave'} at 127.0.0.1:51694
I20260709 13:02:24.727013  8549 raft_consensus.cc:606] T 6a82728feb4f4f1094191c0e30d748dd P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Received request to transfer leadership to TS 53a66c851dc74c70b94c65d464a391f6
I20260709 13:02:24.729527  8549 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c9804c61fdb47a7958574869d381b72"
dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3"
mode: GRACEFUL
new_leader_uuid: "7b3ea460d1294b8a82672d7c21475cb5"
 from {username='slave'} at 127.0.0.1:51694
I20260709 13:02:24.729983  8549 raft_consensus.cc:606] T 7c9804c61fdb47a7958574869d381b72 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Received request to transfer leadership to TS 7b3ea460d1294b8a82672d7c21475cb5
I20260709 13:02:24.732646  8549 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae8659e834df408ab36dd56103f10ae4"
dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3"
mode: GRACEFUL
new_leader_uuid: "53a66c851dc74c70b94c65d464a391f6"
 from {username='slave'} at 127.0.0.1:51694
I20260709 13:02:24.733180  8549 raft_consensus.cc:606] T ae8659e834df408ab36dd56103f10ae4 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Received request to transfer leadership to TS 53a66c851dc74c70b94c65d464a391f6
I20260709 13:02:24.734323   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:02:24.735546   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:24.890348  9394 raft_consensus.cc:993] T 1162036be6064d5c821df6a7aa486bab P b560e9aaec7a4c78b9123b38e73519a3: : Instructing follower 590ee39ce5734876b94d91fc3931b807 to start an election
I20260709 13:02:24.890887  9437 raft_consensus.cc:1081] T 1162036be6064d5c821df6a7aa486bab P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Signalling peer 590ee39ce5734876b94d91fc3931b807 to start an election
I20260709 13:02:24.893270  9222 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1162036be6064d5c821df6a7aa486bab"
dest_uuid: "590ee39ce5734876b94d91fc3931b807"
 from {username='slave'} at 127.0.0.1:56020
I20260709 13:02:24.893812  9222 raft_consensus.cc:493] T 1162036be6064d5c821df6a7aa486bab P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:24.894117  9222 raft_consensus.cc:3060] T 1162036be6064d5c821df6a7aa486bab P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:24.900194  9222 raft_consensus.cc:515] T 1162036be6064d5c821df6a7aa486bab P 590ee39ce5734876b94d91fc3931b807 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:24.902257  9222 leader_election.cc:290] T 1162036be6064d5c821df6a7aa486bab P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 2 election: Requested vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:02:24.902496  8549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1162036be6064d5c821df6a7aa486bab" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3"
I20260709 13:02:24.903013  8400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1162036be6064d5c821df6a7aa486bab" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "53a66c851dc74c70b94c65d464a391f6"
I20260709 13:02:24.903131  8549 raft_consensus.cc:3055] T 1162036be6064d5c821df6a7aa486bab P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:24.903570  8400 raft_consensus.cc:3060] T 1162036be6064d5c821df6a7aa486bab P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:24.903578  8549 raft_consensus.cc:740] T 1162036be6064d5c821df6a7aa486bab P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Running, Role: LEADER
I20260709 13:02:24.904496  8549 consensus_queue.cc:260] T 1162036be6064d5c821df6a7aa486bab P b560e9aaec7a4c78b9123b38e73519a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:24.905754  8549 raft_consensus.cc:3060] T 1162036be6064d5c821df6a7aa486bab P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:24.910321  8400 raft_consensus.cc:2468] T 1162036be6064d5c821df6a7aa486bab P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 590ee39ce5734876b94d91fc3931b807 in term 2.
I20260709 13:02:24.911749  9144 leader_election.cc:304] T 1162036be6064d5c821df6a7aa486bab P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, 590ee39ce5734876b94d91fc3931b807; no voters: 
I20260709 13:02:24.912634  9379 raft_consensus.cc:2804] T 1162036be6064d5c821df6a7aa486bab P 590ee39ce5734876b94d91fc3931b807 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:24.912873  8549 raft_consensus.cc:2468] T 1162036be6064d5c821df6a7aa486bab P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 590ee39ce5734876b94d91fc3931b807 in term 2.
I20260709 13:02:24.913141  9379 raft_consensus.cc:697] T 1162036be6064d5c821df6a7aa486bab P 590ee39ce5734876b94d91fc3931b807 [term 2 LEADER]: Becoming Leader. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Running, Role: LEADER
I20260709 13:02:24.914155  9379 consensus_queue.cc:237] T 1162036be6064d5c821df6a7aa486bab P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:24.926967  8225 catalog_manager.cc:5697] T 1162036be6064d5c821df6a7aa486bab P 590ee39ce5734876b94d91fc3931b807 reported cstate change: term changed from 1 to 2, leader changed from b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196) to 590ee39ce5734876b94d91fc3931b807 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "590ee39ce5734876b94d91fc3931b807" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:24.928052  9437 raft_consensus.cc:993] T 7c9804c61fdb47a7958574869d381b72 P b560e9aaec7a4c78b9123b38e73519a3: : Instructing follower 7b3ea460d1294b8a82672d7c21475cb5 to start an election
I20260709 13:02:24.928927  9395 raft_consensus.cc:1081] T 7c9804c61fdb47a7958574869d381b72 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Signalling peer 7b3ea460d1294b8a82672d7c21475cb5 to start an election
I20260709 13:02:24.930630  8476 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c9804c61fdb47a7958574869d381b72"
dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5"
 from {username='slave'} at 127.0.0.1:40052
I20260709 13:02:24.931152  8476 raft_consensus.cc:493] T 7c9804c61fdb47a7958574869d381b72 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:24.931488  8476 raft_consensus.cc:3060] T 7c9804c61fdb47a7958574869d381b72 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:24.936842  8476 raft_consensus.cc:515] T 7c9804c61fdb47a7958574869d381b72 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:24.939414  8476 leader_election.cc:290] T 7c9804c61fdb47a7958574869d381b72 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 2 election: Requested vote from peers 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751), b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503)
I20260709 13:02:24.940711  8549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9804c61fdb47a7958574869d381b72" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3"
I20260709 13:02:24.941216  8549 raft_consensus.cc:3055] T 7c9804c61fdb47a7958574869d381b72 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:24.941450  8549 raft_consensus.cc:740] T 7c9804c61fdb47a7958574869d381b72 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Running, Role: LEADER
I20260709 13:02:24.942080  8549 consensus_queue.cc:260] T 7c9804c61fdb47a7958574869d381b72 P b560e9aaec7a4c78b9123b38e73519a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:24.942916  8549 raft_consensus.cc:3060] T 7c9804c61fdb47a7958574869d381b72 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:24.947235  8549 raft_consensus.cc:2468] T 7c9804c61fdb47a7958574869d381b72 P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b3ea460d1294b8a82672d7c21475cb5 in term 2.
I20260709 13:02:24.948251  8443 leader_election.cc:304] T 7c9804c61fdb47a7958574869d381b72 P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b3ea460d1294b8a82672d7c21475cb5, b560e9aaec7a4c78b9123b38e73519a3; no voters: 
I20260709 13:02:24.949014  9408 raft_consensus.cc:2804] T 7c9804c61fdb47a7958574869d381b72 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:24.949421  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c9804c61fdb47a7958574869d381b72" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "53a66c851dc74c70b94c65d464a391f6"
I20260709 13:02:24.950183  8398 raft_consensus.cc:3060] T 7c9804c61fdb47a7958574869d381b72 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:24.949523  9408 raft_consensus.cc:697] T 7c9804c61fdb47a7958574869d381b72 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 LEADER]: Becoming Leader. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Running, Role: LEADER
I20260709 13:02:24.951138  9408 consensus_queue.cc:237] T 7c9804c61fdb47a7958574869d381b72 P 7b3ea460d1294b8a82672d7c21475cb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:24.951857  9395 raft_consensus.cc:993] T ae8659e834df408ab36dd56103f10ae4 P b560e9aaec7a4c78b9123b38e73519a3: : Instructing follower 53a66c851dc74c70b94c65d464a391f6 to start an election
I20260709 13:02:24.952492  9394 raft_consensus.cc:1081] T ae8659e834df408ab36dd56103f10ae4 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Signalling peer 53a66c851dc74c70b94c65d464a391f6 to start an election
I20260709 13:02:24.954205  8403 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ae8659e834df408ab36dd56103f10ae4"
dest_uuid: "53a66c851dc74c70b94c65d464a391f6"
 from {username='slave'} at 127.0.0.1:51022
I20260709 13:02:24.954877  8403 raft_consensus.cc:493] T ae8659e834df408ab36dd56103f10ae4 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:24.955241  8403 raft_consensus.cc:3060] T ae8659e834df408ab36dd56103f10ae4 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:24.958393  8398 raft_consensus.cc:2468] T 7c9804c61fdb47a7958574869d381b72 P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b3ea460d1294b8a82672d7c21475cb5 in term 2.
I20260709 13:02:24.963932  8225 catalog_manager.cc:5697] T 7c9804c61fdb47a7958574869d381b72 P 7b3ea460d1294b8a82672d7c21475cb5 reported cstate change: term changed from 1 to 2, leader changed from b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196) to 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "7b3ea460d1294b8a82672d7c21475cb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:24.967789  8403 raft_consensus.cc:515] T ae8659e834df408ab36dd56103f10ae4 P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:24.972340  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae8659e834df408ab36dd56103f10ae4" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5"
I20260709 13:02:24.972951  8479 raft_consensus.cc:3060] T ae8659e834df408ab36dd56103f10ae4 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:24.973147  8403 leader_election.cc:290] T ae8659e834df408ab36dd56103f10ae4 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 2 election: Requested vote from peers 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429), b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503)
I20260709 13:02:24.978318  8549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae8659e834df408ab36dd56103f10ae4" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3"
I20260709 13:02:24.978986  8549 raft_consensus.cc:3055] T ae8659e834df408ab36dd56103f10ae4 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:24.979328  8549 raft_consensus.cc:740] T ae8659e834df408ab36dd56103f10ae4 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Running, Role: LEADER
I20260709 13:02:24.983556  8549 consensus_queue.cc:260] T ae8659e834df408ab36dd56103f10ae4 P b560e9aaec7a4c78b9123b38e73519a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:24.984442  8549 raft_consensus.cc:3060] T ae8659e834df408ab36dd56103f10ae4 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:24.988621  8479 raft_consensus.cc:2468] T ae8659e834df408ab36dd56103f10ae4 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53a66c851dc74c70b94c65d464a391f6 in term 2.
I20260709 13:02:24.989471  8475 raft_consensus.cc:1240] T ae8659e834df408ab36dd56103f10ae4 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Rejecting Update request from peer b560e9aaec7a4c78b9123b38e73519a3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:24.992147  8549 raft_consensus.cc:2468] T ae8659e834df408ab36dd56103f10ae4 P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53a66c851dc74c70b94c65d464a391f6 in term 2.
I20260709 13:02:24.992646  8370 leader_election.cc:304] T ae8659e834df408ab36dd56103f10ae4 P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, 7b3ea460d1294b8a82672d7c21475cb5; no voters: 
I20260709 13:02:24.993566  9412 raft_consensus.cc:2804] T ae8659e834df408ab36dd56103f10ae4 P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:24.994154  9412 raft_consensus.cc:697] T ae8659e834df408ab36dd56103f10ae4 P 53a66c851dc74c70b94c65d464a391f6 [term 2 LEADER]: Becoming Leader. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Running, Role: LEADER
I20260709 13:02:24.995122  9412 consensus_queue.cc:237] T ae8659e834df408ab36dd56103f10ae4 P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:25.005374  8225 catalog_manager.cc:5697] T ae8659e834df408ab36dd56103f10ae4 P 53a66c851dc74c70b94c65d464a391f6 reported cstate change: term changed from 1 to 2, leader changed from b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196) to 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "53a66c851dc74c70b94c65d464a391f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:25.034921  9437 raft_consensus.cc:993] T 6a82728feb4f4f1094191c0e30d748dd P b560e9aaec7a4c78b9123b38e73519a3: : Instructing follower 53a66c851dc74c70b94c65d464a391f6 to start an election
I20260709 13:02:25.035445  9437 raft_consensus.cc:1081] T 6a82728feb4f4f1094191c0e30d748dd P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Signalling peer 53a66c851dc74c70b94c65d464a391f6 to start an election
I20260709 13:02:25.038985  8399 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a82728feb4f4f1094191c0e30d748dd"
dest_uuid: "53a66c851dc74c70b94c65d464a391f6"
 from {username='slave'} at 127.0.0.1:51022
I20260709 13:02:25.039535  8399 raft_consensus.cc:493] T 6a82728feb4f4f1094191c0e30d748dd P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:25.039988  8399 raft_consensus.cc:3060] T 6a82728feb4f4f1094191c0e30d748dd P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:25.047067  8399 raft_consensus.cc:515] T 6a82728feb4f4f1094191c0e30d748dd P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:25.050896  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a82728feb4f4f1094191c0e30d748dd" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3"
I20260709 13:02:25.050971  8479 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a82728feb4f4f1094191c0e30d748dd" candidate_uuid: "53a66c851dc74c70b94c65d464a391f6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5"
I20260709 13:02:25.051407  8546 raft_consensus.cc:3055] T 6a82728feb4f4f1094191c0e30d748dd P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:25.051589  8479 raft_consensus.cc:3060] T 6a82728feb4f4f1094191c0e30d748dd P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:25.051748  8546 raft_consensus.cc:740] T 6a82728feb4f4f1094191c0e30d748dd P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Running, Role: LEADER
I20260709 13:02:25.052752  8546 consensus_queue.cc:260] T 6a82728feb4f4f1094191c0e30d748dd P b560e9aaec7a4c78b9123b38e73519a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:25.053628  8546 raft_consensus.cc:3060] T 6a82728feb4f4f1094191c0e30d748dd P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:25.058218  8399 leader_election.cc:290] T 6a82728feb4f4f1094191c0e30d748dd P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 2 election: Requested vote from peers 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429), b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503)
I20260709 13:02:25.060024  8479 raft_consensus.cc:2468] T 6a82728feb4f4f1094191c0e30d748dd P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53a66c851dc74c70b94c65d464a391f6 in term 2.
I20260709 13:02:25.060573  9412 raft_consensus.cc:993] T 435da692a6474cb697066524d4f5216e P 53a66c851dc74c70b94c65d464a391f6: : Instructing follower 7b3ea460d1294b8a82672d7c21475cb5 to start an election
I20260709 13:02:25.060942  8546 raft_consensus.cc:2468] T 6a82728feb4f4f1094191c0e30d748dd P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53a66c851dc74c70b94c65d464a391f6 in term 2.
I20260709 13:02:25.061102  9411 raft_consensus.cc:1081] T 435da692a6474cb697066524d4f5216e P 53a66c851dc74c70b94c65d464a391f6 [term 2 LEADER]: Signalling peer 7b3ea460d1294b8a82672d7c21475cb5 to start an election
I20260709 13:02:25.061198  8370 leader_election.cc:304] T 6a82728feb4f4f1094191c0e30d748dd P 53a66c851dc74c70b94c65d464a391f6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, 7b3ea460d1294b8a82672d7c21475cb5; no voters: 
I20260709 13:02:25.062254  9411 raft_consensus.cc:2804] T 6a82728feb4f4f1094191c0e30d748dd P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:25.062729  9411 raft_consensus.cc:697] T 6a82728feb4f4f1094191c0e30d748dd P 53a66c851dc74c70b94c65d464a391f6 [term 2 LEADER]: Becoming Leader. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Running, Role: LEADER
I20260709 13:02:25.062904  8479 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "435da692a6474cb697066524d4f5216e"
dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5"
 from {username='slave'} at 127.0.0.1:40054
I20260709 13:02:25.063490  8479 raft_consensus.cc:493] T 435da692a6474cb697066524d4f5216e P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:25.063824  8479 raft_consensus.cc:3060] T 435da692a6474cb697066524d4f5216e P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:25.063556  9411 consensus_queue.cc:237] T 6a82728feb4f4f1094191c0e30d748dd P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:25.070050  8479 raft_consensus.cc:515] T 435da692a6474cb697066524d4f5216e P 7b3ea460d1294b8a82672d7c21475cb5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:25.071658  8479 leader_election.cc:290] T 435da692a6474cb697066524d4f5216e P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 3 election: Requested vote from peers 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751), b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503)
I20260709 13:02:25.072382  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435da692a6474cb697066524d4f5216e" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "53a66c851dc74c70b94c65d464a391f6"
I20260709 13:02:25.073017  8399 raft_consensus.cc:3055] T 435da692a6474cb697066524d4f5216e P 53a66c851dc74c70b94c65d464a391f6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:25.073280  8399 raft_consensus.cc:740] T 435da692a6474cb697066524d4f5216e P 53a66c851dc74c70b94c65d464a391f6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Running, Role: LEADER
I20260709 13:02:25.073455  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "435da692a6474cb697066524d4f5216e" candidate_uuid: "7b3ea460d1294b8a82672d7c21475cb5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3"
I20260709 13:02:25.074028  8546 raft_consensus.cc:3060] T 435da692a6474cb697066524d4f5216e P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:25.073976  8399 consensus_queue.cc:260] T 435da692a6474cb697066524d4f5216e P 53a66c851dc74c70b94c65d464a391f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:25.074322  8225 catalog_manager.cc:5697] T 6a82728feb4f4f1094191c0e30d748dd P 53a66c851dc74c70b94c65d464a391f6 reported cstate change: term changed from 1 to 2, leader changed from b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196) to 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "53a66c851dc74c70b94c65d464a391f6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:25.075599  8399 raft_consensus.cc:3060] T 435da692a6474cb697066524d4f5216e P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:25.081053  8399 raft_consensus.cc:2468] T 435da692a6474cb697066524d4f5216e P 53a66c851dc74c70b94c65d464a391f6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b3ea460d1294b8a82672d7c21475cb5 in term 3.
I20260709 13:02:25.081074  8546 raft_consensus.cc:2468] T 435da692a6474cb697066524d4f5216e P b560e9aaec7a4c78b9123b38e73519a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b3ea460d1294b8a82672d7c21475cb5 in term 3.
I20260709 13:02:25.082304  8444 leader_election.cc:304] T 435da692a6474cb697066524d4f5216e P 7b3ea460d1294b8a82672d7c21475cb5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, 7b3ea460d1294b8a82672d7c21475cb5; no voters: 
I20260709 13:02:25.083122  9368 raft_consensus.cc:2804] T 435da692a6474cb697066524d4f5216e P 7b3ea460d1294b8a82672d7c21475cb5 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:25.083580  9368 raft_consensus.cc:697] T 435da692a6474cb697066524d4f5216e P 7b3ea460d1294b8a82672d7c21475cb5 [term 3 LEADER]: Becoming Leader. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Running, Role: LEADER
I20260709 13:02:25.084484  9368 consensus_queue.cc:237] T 435da692a6474cb697066524d4f5216e P 7b3ea460d1294b8a82672d7c21475cb5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:25.094058  8225 catalog_manager.cc:5697] T 435da692a6474cb697066524d4f5216e P 7b3ea460d1294b8a82672d7c21475cb5 reported cstate change: term changed from 2 to 3, leader changed from 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194) to 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "7b3ea460d1294b8a82672d7c21475cb5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:25.354803  8549 raft_consensus.cc:1275] T 1162036be6064d5c821df6a7aa486bab P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Refusing update from remote peer 590ee39ce5734876b94d91fc3931b807: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:25.355885  9379 consensus_queue.cc:1048] T 1162036be6064d5c821df6a7aa486bab P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:25.374056  8399 raft_consensus.cc:1275] T 1162036be6064d5c821df6a7aa486bab P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Refusing update from remote peer 590ee39ce5734876b94d91fc3931b807: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:25.375319  9379 consensus_queue.cc:1048] T 1162036be6064d5c821df6a7aa486bab P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:25.435940  8546 raft_consensus.cc:1275] T ae8659e834df408ab36dd56103f10ae4 P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Refusing update from remote peer 53a66c851dc74c70b94c65d464a391f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:25.437235  9411 consensus_queue.cc:1048] T ae8659e834df408ab36dd56103f10ae4 P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:25.453214  8475 raft_consensus.cc:1275] T ae8659e834df408ab36dd56103f10ae4 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Refusing update from remote peer 53a66c851dc74c70b94c65d464a391f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:25.454484  9412 consensus_queue.cc:1048] T ae8659e834df408ab36dd56103f10ae4 P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:25.473351  8546 raft_consensus.cc:1275] T 435da692a6474cb697066524d4f5216e P b560e9aaec7a4c78b9123b38e73519a3 [term 3 FOLLOWER]: Refusing update from remote peer 7b3ea460d1294b8a82672d7c21475cb5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:25.475782  9368 consensus_queue.cc:1048] T 435da692a6474cb697066524d4f5216e P 7b3ea460d1294b8a82672d7c21475cb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:25.490015  8403 raft_consensus.cc:1275] T 435da692a6474cb697066524d4f5216e P 53a66c851dc74c70b94c65d464a391f6 [term 3 FOLLOWER]: Refusing update from remote peer 7b3ea460d1294b8a82672d7c21475cb5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:25.492008  9408 consensus_queue.cc:1048] T 435da692a6474cb697066524d4f5216e P 7b3ea460d1294b8a82672d7c21475cb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:25.524205  8403 raft_consensus.cc:1275] T 7c9804c61fdb47a7958574869d381b72 P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Refusing update from remote peer 7b3ea460d1294b8a82672d7c21475cb5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:25.525395  9368 consensus_queue.cc:1048] T 7c9804c61fdb47a7958574869d381b72 P 7b3ea460d1294b8a82672d7c21475cb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:25.530061  8546 raft_consensus.cc:1275] T 7c9804c61fdb47a7958574869d381b72 P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Refusing update from remote peer 7b3ea460d1294b8a82672d7c21475cb5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:25.531340  9368 consensus_queue.cc:1048] T 7c9804c61fdb47a7958574869d381b72 P 7b3ea460d1294b8a82672d7c21475cb5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:25.577124  8546 raft_consensus.cc:1275] T 6a82728feb4f4f1094191c0e30d748dd P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Refusing update from remote peer 53a66c851dc74c70b94c65d464a391f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:25.578392  9412 consensus_queue.cc:1048] T 6a82728feb4f4f1094191c0e30d748dd P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:25.587802  8475 raft_consensus.cc:1275] T 6a82728feb4f4f1094191c0e30d748dd P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Refusing update from remote peer 53a66c851dc74c70b94c65d464a391f6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:25.589303  9411 consensus_queue.cc:1048] T 6a82728feb4f4f1094191c0e30d748dd P 53a66c851dc74c70b94c65d464a391f6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:25.736400   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:25.781033   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:25.816975  8399 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40926724afa743899b7ab0af312dc717"
dest_uuid: "53a66c851dc74c70b94c65d464a391f6"
mode: GRACEFUL
new_leader_uuid: "b560e9aaec7a4c78b9123b38e73519a3"
 from {username='slave'} at 127.0.0.1:48082
I20260709 13:02:25.817551  8399 raft_consensus.cc:606] T 40926724afa743899b7ab0af312dc717 P 53a66c851dc74c70b94c65d464a391f6 [term 2 LEADER]: Received request to transfer leadership to TS b560e9aaec7a4c78b9123b38e73519a3
I20260709 13:02:25.819757  8475 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6fffc940549b445c973a289ba1bebcb3"
dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5"
mode: GRACEFUL
new_leader_uuid: "590ee39ce5734876b94d91fc3931b807"
 from {username='slave'} at 127.0.0.1:40498
I20260709 13:02:25.820215  8475 raft_consensus.cc:606] T 6fffc940549b445c973a289ba1bebcb3 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 LEADER]: Received request to transfer leadership to TS 590ee39ce5734876b94d91fc3931b807
I20260709 13:02:25.822502  8546 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca262e71501a4ae4a89152ec6771ffb9"
dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3"
mode: GRACEFUL
new_leader_uuid: "590ee39ce5734876b94d91fc3931b807"
 from {username='slave'} at 127.0.0.1:51694
I20260709 13:02:25.822952  8546 raft_consensus.cc:606] T ca262e71501a4ae4a89152ec6771ffb9 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Received request to transfer leadership to TS 590ee39ce5734876b94d91fc3931b807
I20260709 13:02:25.825237  8399 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d97df5fdb12a439080fa6edc391ebd82"
dest_uuid: "53a66c851dc74c70b94c65d464a391f6"
mode: GRACEFUL
new_leader_uuid: "590ee39ce5734876b94d91fc3931b807"
 from {username='slave'} at 127.0.0.1:48082
I20260709 13:02:25.825814  8399 raft_consensus.cc:606] T d97df5fdb12a439080fa6edc391ebd82 P 53a66c851dc74c70b94c65d464a391f6 [term 1 LEADER]: Received request to transfer leadership to TS 590ee39ce5734876b94d91fc3931b807
I20260709 13:02:25.828708  8475 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "da5b0b01a880412896838e8eb658db7a"
dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5"
mode: GRACEFUL
new_leader_uuid: "590ee39ce5734876b94d91fc3931b807"
 from {username='slave'} at 127.0.0.1:40498
I20260709 13:02:25.829221  8475 raft_consensus.cc:606] T da5b0b01a880412896838e8eb658db7a P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 LEADER]: Received request to transfer leadership to TS 590ee39ce5734876b94d91fc3931b807
I20260709 13:02:25.833021   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:02:25.834635   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:25.844638  9360 raft_consensus.cc:993] T ca262e71501a4ae4a89152ec6771ffb9 P b560e9aaec7a4c78b9123b38e73519a3: : Instructing follower 590ee39ce5734876b94d91fc3931b807 to start an election
I20260709 13:02:25.845244  9394 raft_consensus.cc:1081] T ca262e71501a4ae4a89152ec6771ffb9 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Signalling peer 590ee39ce5734876b94d91fc3931b807 to start an election
I20260709 13:02:25.846694  9225 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca262e71501a4ae4a89152ec6771ffb9"
dest_uuid: "590ee39ce5734876b94d91fc3931b807"
 from {username='slave'} at 127.0.0.1:56020
I20260709 13:02:25.847193  9225 raft_consensus.cc:493] T ca262e71501a4ae4a89152ec6771ffb9 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:25.847507  9225 raft_consensus.cc:3060] T ca262e71501a4ae4a89152ec6771ffb9 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:25.853470  9225 raft_consensus.cc:515] T ca262e71501a4ae4a89152ec6771ffb9 P 590ee39ce5734876b94d91fc3931b807 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:25.855011  9225 leader_election.cc:290] T ca262e71501a4ae4a89152ec6771ffb9 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 2 election: Requested vote from peers 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429), b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503)
I20260709 13:02:25.856650  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca262e71501a4ae4a89152ec6771ffb9" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5"
I20260709 13:02:25.856892  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca262e71501a4ae4a89152ec6771ffb9" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3"
I20260709 13:02:25.857215  8475 raft_consensus.cc:3060] T ca262e71501a4ae4a89152ec6771ffb9 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:25.857553  8546 raft_consensus.cc:3055] T ca262e71501a4ae4a89152ec6771ffb9 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:25.857865  8546 raft_consensus.cc:740] T ca262e71501a4ae4a89152ec6771ffb9 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Running, Role: LEADER
I20260709 13:02:25.858441  8546 consensus_queue.cc:260] T ca262e71501a4ae4a89152ec6771ffb9 P b560e9aaec7a4c78b9123b38e73519a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:25.859541  8546 raft_consensus.cc:3060] T ca262e71501a4ae4a89152ec6771ffb9 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:25.863030  8475 raft_consensus.cc:2468] T ca262e71501a4ae4a89152ec6771ffb9 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 590ee39ce5734876b94d91fc3931b807 in term 2.
I20260709 13:02:25.864169  9144 leader_election.cc:304] T ca262e71501a4ae4a89152ec6771ffb9 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807, 7b3ea460d1294b8a82672d7c21475cb5; no voters: 
I20260709 13:02:25.864925  9375 raft_consensus.cc:2804] T ca262e71501a4ae4a89152ec6771ffb9 P 590ee39ce5734876b94d91fc3931b807 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:25.865293  8546 raft_consensus.cc:2468] T ca262e71501a4ae4a89152ec6771ffb9 P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 590ee39ce5734876b94d91fc3931b807 in term 2.
I20260709 13:02:25.865414  9375 raft_consensus.cc:697] T ca262e71501a4ae4a89152ec6771ffb9 P 590ee39ce5734876b94d91fc3931b807 [term 2 LEADER]: Becoming Leader. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Running, Role: LEADER
I20260709 13:02:25.866405  9375 consensus_queue.cc:237] T ca262e71501a4ae4a89152ec6771ffb9 P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:25.875734  8225 catalog_manager.cc:5697] T ca262e71501a4ae4a89152ec6771ffb9 P 590ee39ce5734876b94d91fc3931b807 reported cstate change: term changed from 1 to 2, leader changed from b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196) to 590ee39ce5734876b94d91fc3931b807 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "590ee39ce5734876b94d91fc3931b807" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:25.940088  9353 raft_consensus.cc:993] T 40926724afa743899b7ab0af312dc717 P 53a66c851dc74c70b94c65d464a391f6: : Instructing follower b560e9aaec7a4c78b9123b38e73519a3 to start an election
I20260709 13:02:25.940608  9411 raft_consensus.cc:1081] T 40926724afa743899b7ab0af312dc717 P 53a66c851dc74c70b94c65d464a391f6 [term 2 LEADER]: Signalling peer b560e9aaec7a4c78b9123b38e73519a3 to start an election
I20260709 13:02:25.942780  8546 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "40926724afa743899b7ab0af312dc717"
dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3"
 from {username='slave'} at 127.0.0.1:38260
I20260709 13:02:25.943336  8546 raft_consensus.cc:493] T 40926724afa743899b7ab0af312dc717 P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:25.943718  8546 raft_consensus.cc:3060] T 40926724afa743899b7ab0af312dc717 P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:25.949831  8546 raft_consensus.cc:515] T 40926724afa743899b7ab0af312dc717 P b560e9aaec7a4c78b9123b38e73519a3 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:25.951962  8546 leader_election.cc:290] T 40926724afa743899b7ab0af312dc717 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 3 election: Requested vote from peers 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751), 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429)
I20260709 13:02:25.952579  8399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40926724afa743899b7ab0af312dc717" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "53a66c851dc74c70b94c65d464a391f6"
I20260709 13:02:25.952870  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40926724afa743899b7ab0af312dc717" candidate_uuid: "b560e9aaec7a4c78b9123b38e73519a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5"
I20260709 13:02:25.953189  8399 raft_consensus.cc:3055] T 40926724afa743899b7ab0af312dc717 P 53a66c851dc74c70b94c65d464a391f6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:25.953462  8475 raft_consensus.cc:3060] T 40926724afa743899b7ab0af312dc717 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:25.953541  8399 raft_consensus.cc:740] T 40926724afa743899b7ab0af312dc717 P 53a66c851dc74c70b94c65d464a391f6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Running, Role: LEADER
I20260709 13:02:25.954351  8399 consensus_queue.cc:260] T 40926724afa743899b7ab0af312dc717 P 53a66c851dc74c70b94c65d464a391f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:25.955446  8399 raft_consensus.cc:3060] T 40926724afa743899b7ab0af312dc717 P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:25.960139  8475 raft_consensus.cc:2468] T 40926724afa743899b7ab0af312dc717 P 7b3ea460d1294b8a82672d7c21475cb5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 3.
I20260709 13:02:25.961140  8518 leader_election.cc:304] T 40926724afa743899b7ab0af312dc717 P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b3ea460d1294b8a82672d7c21475cb5, b560e9aaec7a4c78b9123b38e73519a3; no voters: 
I20260709 13:02:25.961701  8399 raft_consensus.cc:2468] T 40926724afa743899b7ab0af312dc717 P 53a66c851dc74c70b94c65d464a391f6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b560e9aaec7a4c78b9123b38e73519a3 in term 3.
I20260709 13:02:25.961835  9394 raft_consensus.cc:2804] T 40926724afa743899b7ab0af312dc717 P b560e9aaec7a4c78b9123b38e73519a3 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:25.962424  9394 raft_consensus.cc:697] T 40926724afa743899b7ab0af312dc717 P b560e9aaec7a4c78b9123b38e73519a3 [term 3 LEADER]: Becoming Leader. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Running, Role: LEADER
I20260709 13:02:25.964707  9394 consensus_queue.cc:237] T 40926724afa743899b7ab0af312dc717 P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } }
I20260709 13:02:25.968721  9411 raft_consensus.cc:993] T d97df5fdb12a439080fa6edc391ebd82 P 53a66c851dc74c70b94c65d464a391f6: : Instructing follower 590ee39ce5734876b94d91fc3931b807 to start an election
I20260709 13:02:25.969676  9411 raft_consensus.cc:1081] T d97df5fdb12a439080fa6edc391ebd82 P 53a66c851dc74c70b94c65d464a391f6 [term 1 LEADER]: Signalling peer 590ee39ce5734876b94d91fc3931b807 to start an election
I20260709 13:02:25.974277  9222 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d97df5fdb12a439080fa6edc391ebd82"
dest_uuid: "590ee39ce5734876b94d91fc3931b807"
 from {username='slave'} at 127.0.0.1:56016
I20260709 13:02:25.974803  9222 raft_consensus.cc:493] T d97df5fdb12a439080fa6edc391ebd82 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:25.975123  9222 raft_consensus.cc:3060] T d97df5fdb12a439080fa6edc391ebd82 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:25.975917  8225 catalog_manager.cc:5697] T 40926724afa743899b7ab0af312dc717 P b560e9aaec7a4c78b9123b38e73519a3 reported cstate change: term changed from 2 to 3, leader changed from 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194) to b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196). New cstate: current_term: 3 leader_uuid: "b560e9aaec7a4c78b9123b38e73519a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:25.981043  9222 raft_consensus.cc:515] T d97df5fdb12a439080fa6edc391ebd82 P 590ee39ce5734876b94d91fc3931b807 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:25.982978  9222 leader_election.cc:290] T d97df5fdb12a439080fa6edc391ebd82 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 2 election: Requested vote from peers b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:02:25.984869  8398 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97df5fdb12a439080fa6edc391ebd82" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "53a66c851dc74c70b94c65d464a391f6"
I20260709 13:02:25.985474  8398 raft_consensus.cc:3055] T d97df5fdb12a439080fa6edc391ebd82 P 53a66c851dc74c70b94c65d464a391f6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:25.985790  8398 raft_consensus.cc:740] T d97df5fdb12a439080fa6edc391ebd82 P 53a66c851dc74c70b94c65d464a391f6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 53a66c851dc74c70b94c65d464a391f6, State: Running, Role: LEADER
I20260709 13:02:25.986704  8398 consensus_queue.cc:260] T d97df5fdb12a439080fa6edc391ebd82 P 53a66c851dc74c70b94c65d464a391f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:25.987958  8398 raft_consensus.cc:3060] T d97df5fdb12a439080fa6edc391ebd82 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:25.988103  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97df5fdb12a439080fa6edc391ebd82" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3"
I20260709 13:02:25.988770  8546 raft_consensus.cc:3060] T d97df5fdb12a439080fa6edc391ebd82 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:25.993539  8398 raft_consensus.cc:2468] T d97df5fdb12a439080fa6edc391ebd82 P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 590ee39ce5734876b94d91fc3931b807 in term 2.
I20260709 13:02:25.993944  8546 raft_consensus.cc:2468] T d97df5fdb12a439080fa6edc391ebd82 P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 590ee39ce5734876b94d91fc3931b807 in term 2.
I20260709 13:02:25.994685  9144 leader_election.cc:304] T d97df5fdb12a439080fa6edc391ebd82 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53a66c851dc74c70b94c65d464a391f6, 590ee39ce5734876b94d91fc3931b807; no voters: 
I20260709 13:02:25.995600  9379 raft_consensus.cc:2804] T d97df5fdb12a439080fa6edc391ebd82 P 590ee39ce5734876b94d91fc3931b807 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:25.996155  9379 raft_consensus.cc:697] T d97df5fdb12a439080fa6edc391ebd82 P 590ee39ce5734876b94d91fc3931b807 [term 2 LEADER]: Becoming Leader. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Running, Role: LEADER
I20260709 13:02:25.997020  9379 consensus_queue.cc:237] T d97df5fdb12a439080fa6edc391ebd82 P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:26.006269  8225 catalog_manager.cc:5697] T d97df5fdb12a439080fa6edc391ebd82 P 590ee39ce5734876b94d91fc3931b807 reported cstate change: term changed from 1 to 2, leader changed from 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194) to 590ee39ce5734876b94d91fc3931b807 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "590ee39ce5734876b94d91fc3931b807" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:26.086710  9408 raft_consensus.cc:993] T 6fffc940549b445c973a289ba1bebcb3 P 7b3ea460d1294b8a82672d7c21475cb5: : Instructing follower 590ee39ce5734876b94d91fc3931b807 to start an election
I20260709 13:02:26.087241  9410 raft_consensus.cc:1081] T 6fffc940549b445c973a289ba1bebcb3 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 LEADER]: Signalling peer 590ee39ce5734876b94d91fc3931b807 to start an election
I20260709 13:02:26.088735  9222 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6fffc940549b445c973a289ba1bebcb3"
dest_uuid: "590ee39ce5734876b94d91fc3931b807"
 from {username='slave'} at 127.0.0.1:56034
I20260709 13:02:26.089215  9222 raft_consensus.cc:493] T 6fffc940549b445c973a289ba1bebcb3 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:26.089553  9222 raft_consensus.cc:3060] T 6fffc940549b445c973a289ba1bebcb3 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:26.095924  9222 raft_consensus.cc:515] T 6fffc940549b445c973a289ba1bebcb3 P 590ee39ce5734876b94d91fc3931b807 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:26.097867  9222 leader_election.cc:290] T 6fffc940549b445c973a289ba1bebcb3 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 2 election: Requested vote from peers 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429), b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503)
I20260709 13:02:26.098718  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fffc940549b445c973a289ba1bebcb3" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5"
I20260709 13:02:26.098876  8546 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6fffc940549b445c973a289ba1bebcb3" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3"
I20260709 13:02:26.099417  8475 raft_consensus.cc:3055] T 6fffc940549b445c973a289ba1bebcb3 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:26.099503  8546 raft_consensus.cc:3060] T 6fffc940549b445c973a289ba1bebcb3 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:26.099972  8475 raft_consensus.cc:740] T 6fffc940549b445c973a289ba1bebcb3 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Running, Role: LEADER
I20260709 13:02:26.100746  8475 consensus_queue.cc:260] T 6fffc940549b445c973a289ba1bebcb3 P 7b3ea460d1294b8a82672d7c21475cb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:26.101866  8475 raft_consensus.cc:3060] T 6fffc940549b445c973a289ba1bebcb3 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:26.107009  8546 raft_consensus.cc:2468] T 6fffc940549b445c973a289ba1bebcb3 P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 590ee39ce5734876b94d91fc3931b807 in term 2.
I20260709 13:02:26.108449  9143 leader_election.cc:304] T 6fffc940549b445c973a289ba1bebcb3 P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807, b560e9aaec7a4c78b9123b38e73519a3; no voters: 
I20260709 13:02:26.108513  8475 raft_consensus.cc:2468] T 6fffc940549b445c973a289ba1bebcb3 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 590ee39ce5734876b94d91fc3931b807 in term 2.
I20260709 13:02:26.109606  9379 raft_consensus.cc:2804] T 6fffc940549b445c973a289ba1bebcb3 P 590ee39ce5734876b94d91fc3931b807 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:26.110287  9379 raft_consensus.cc:697] T 6fffc940549b445c973a289ba1bebcb3 P 590ee39ce5734876b94d91fc3931b807 [term 2 LEADER]: Becoming Leader. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Running, Role: LEADER
I20260709 13:02:26.111675  9379 consensus_queue.cc:237] T 6fffc940549b445c973a289ba1bebcb3 P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:26.122635  8228 catalog_manager.cc:5697] T 6fffc940549b445c973a289ba1bebcb3 P 590ee39ce5734876b94d91fc3931b807 reported cstate change: term changed from 1 to 2, leader changed from 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195) to 590ee39ce5734876b94d91fc3931b807 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "590ee39ce5734876b94d91fc3931b807" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:26.223300  9408 raft_consensus.cc:993] T da5b0b01a880412896838e8eb658db7a P 7b3ea460d1294b8a82672d7c21475cb5: : Instructing follower 590ee39ce5734876b94d91fc3931b807 to start an election
I20260709 13:02:26.223724  9410 raft_consensus.cc:1081] T da5b0b01a880412896838e8eb658db7a P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 LEADER]: Signalling peer 590ee39ce5734876b94d91fc3931b807 to start an election
I20260709 13:02:26.225033  9222 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "da5b0b01a880412896838e8eb658db7a"
dest_uuid: "590ee39ce5734876b94d91fc3931b807"
 from {username='slave'} at 127.0.0.1:56034
I20260709 13:02:26.225508  9222 raft_consensus.cc:493] T da5b0b01a880412896838e8eb658db7a P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:26.225842  9222 raft_consensus.cc:3060] T da5b0b01a880412896838e8eb658db7a P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:26.230607  9222 raft_consensus.cc:515] T da5b0b01a880412896838e8eb658db7a P 590ee39ce5734876b94d91fc3931b807 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:26.232311  9222 leader_election.cc:290] T da5b0b01a880412896838e8eb658db7a P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 2 election: Requested vote from peers 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429), b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503)
I20260709 13:02:26.233193  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5b0b01a880412896838e8eb658db7a" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5"
I20260709 13:02:26.233978  8549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da5b0b01a880412896838e8eb658db7a" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3"
I20260709 13:02:26.234236  8475 raft_consensus.cc:3055] T da5b0b01a880412896838e8eb658db7a P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:26.234512  8549 raft_consensus.cc:3060] T da5b0b01a880412896838e8eb658db7a P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:26.234706  8475 raft_consensus.cc:740] T da5b0b01a880412896838e8eb658db7a P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7b3ea460d1294b8a82672d7c21475cb5, State: Running, Role: LEADER
I20260709 13:02:26.235600  8475 consensus_queue.cc:260] T da5b0b01a880412896838e8eb658db7a P 7b3ea460d1294b8a82672d7c21475cb5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:26.237196  8475 raft_consensus.cc:3060] T da5b0b01a880412896838e8eb658db7a P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:26.241839  8549 raft_consensus.cc:2468] T da5b0b01a880412896838e8eb658db7a P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 590ee39ce5734876b94d91fc3931b807 in term 2.
I20260709 13:02:26.242806  9143 leader_election.cc:304] T da5b0b01a880412896838e8eb658db7a P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807, b560e9aaec7a4c78b9123b38e73519a3; no voters: 
I20260709 13:02:26.243144  8475 raft_consensus.cc:2468] T da5b0b01a880412896838e8eb658db7a P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 590ee39ce5734876b94d91fc3931b807 in term 2.
I20260709 13:02:26.243634  9379 raft_consensus.cc:2804] T da5b0b01a880412896838e8eb658db7a P 590ee39ce5734876b94d91fc3931b807 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:26.244174  9379 raft_consensus.cc:697] T da5b0b01a880412896838e8eb658db7a P 590ee39ce5734876b94d91fc3931b807 [term 2 LEADER]: Becoming Leader. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Running, Role: LEADER
I20260709 13:02:26.244906  9379 consensus_queue.cc:237] T da5b0b01a880412896838e8eb658db7a P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:26.253525  8228 catalog_manager.cc:5697] T da5b0b01a880412896838e8eb658db7a P 590ee39ce5734876b94d91fc3931b807 reported cstate change: term changed from 1 to 2, leader changed from 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195) to 590ee39ce5734876b94d91fc3931b807 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "590ee39ce5734876b94d91fc3931b807" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:26.317701  8546 raft_consensus.cc:1275] T ca262e71501a4ae4a89152ec6771ffb9 P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Refusing update from remote peer 590ee39ce5734876b94d91fc3931b807: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:26.318878  9379 consensus_queue.cc:1048] T ca262e71501a4ae4a89152ec6771ffb9 P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:26.333212  8475 raft_consensus.cc:1275] T ca262e71501a4ae4a89152ec6771ffb9 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Refusing update from remote peer 590ee39ce5734876b94d91fc3931b807: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:26.334780  9379 consensus_queue.cc:1048] T ca262e71501a4ae4a89152ec6771ffb9 P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:26.458899  8398 raft_consensus.cc:1275] T d97df5fdb12a439080fa6edc391ebd82 P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Refusing update from remote peer 590ee39ce5734876b94d91fc3931b807: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:26.460191  9379 consensus_queue.cc:1048] T d97df5fdb12a439080fa6edc391ebd82 P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:26.469307  8549 raft_consensus.cc:1275] T d97df5fdb12a439080fa6edc391ebd82 P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Refusing update from remote peer 590ee39ce5734876b94d91fc3931b807: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:26.470824  9375 consensus_queue.cc:1048] T d97df5fdb12a439080fa6edc391ebd82 P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:26.502257  8398 raft_consensus.cc:1275] T 40926724afa743899b7ab0af312dc717 P 53a66c851dc74c70b94c65d464a391f6 [term 3 FOLLOWER]: Refusing update from remote peer b560e9aaec7a4c78b9123b38e73519a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:26.503602  9360 consensus_queue.cc:1048] T 40926724afa743899b7ab0af312dc717 P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:26.504074  8475 raft_consensus.cc:1275] T 40926724afa743899b7ab0af312dc717 P 7b3ea460d1294b8a82672d7c21475cb5 [term 3 FOLLOWER]: Refusing update from remote peer b560e9aaec7a4c78b9123b38e73519a3: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:26.505358  9360 consensus_queue.cc:1048] T 40926724afa743899b7ab0af312dc717 P b560e9aaec7a4c78b9123b38e73519a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:26.562618  8549 raft_consensus.cc:1275] T 6fffc940549b445c973a289ba1bebcb3 P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Refusing update from remote peer 590ee39ce5734876b94d91fc3931b807: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:26.564014  9375 consensus_queue.cc:1048] T 6fffc940549b445c973a289ba1bebcb3 P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:26.578306  8475 raft_consensus.cc:1275] T 6fffc940549b445c973a289ba1bebcb3 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Refusing update from remote peer 590ee39ce5734876b94d91fc3931b807: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:26.579898  9426 consensus_queue.cc:1048] T 6fffc940549b445c973a289ba1bebcb3 P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:26.693049  8549 raft_consensus.cc:1275] T da5b0b01a880412896838e8eb658db7a P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Refusing update from remote peer 590ee39ce5734876b94d91fc3931b807: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:26.694172  9483 consensus_queue.cc:1048] T da5b0b01a880412896838e8eb658db7a P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:26.702904  8479 raft_consensus.cc:1275] T da5b0b01a880412896838e8eb658db7a P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Refusing update from remote peer 590ee39ce5734876b94d91fc3931b807: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:26.704295  9426 consensus_queue.cc:1048] T da5b0b01a880412896838e8eb658db7a P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:26.835522   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:26.881843   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:26.923252  8546 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b574d11894634755bd89c530b4155f1e"
dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3"
mode: GRACEFUL
new_leader_uuid: "590ee39ce5734876b94d91fc3931b807"
 from {username='slave'} at 127.0.0.1:51694
I20260709 13:02:26.923727  8546 raft_consensus.cc:606] T b574d11894634755bd89c530b4155f1e P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Received request to transfer leadership to TS 590ee39ce5734876b94d91fc3931b807
I20260709 13:02:26.924834   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:02:26.926014   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:27.371459  9479 raft_consensus.cc:993] T b574d11894634755bd89c530b4155f1e P b560e9aaec7a4c78b9123b38e73519a3: : Instructing follower 590ee39ce5734876b94d91fc3931b807 to start an election
I20260709 13:02:27.371929  9480 raft_consensus.cc:1081] T b574d11894634755bd89c530b4155f1e P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Signalling peer 590ee39ce5734876b94d91fc3931b807 to start an election
I20260709 13:02:27.373234  9225 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b574d11894634755bd89c530b4155f1e"
dest_uuid: "590ee39ce5734876b94d91fc3931b807"
 from {username='slave'} at 127.0.0.1:56020
I20260709 13:02:27.373682  9225 raft_consensus.cc:493] T b574d11894634755bd89c530b4155f1e P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:27.373952  9225 raft_consensus.cc:3060] T b574d11894634755bd89c530b4155f1e P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:27.378376  9225 raft_consensus.cc:515] T b574d11894634755bd89c530b4155f1e P 590ee39ce5734876b94d91fc3931b807 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:27.381702  9225 leader_election.cc:290] T b574d11894634755bd89c530b4155f1e P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 2 election: Requested vote from peers 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429), b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196:42503)
I20260709 13:02:27.382563  8549 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b574d11894634755bd89c530b4155f1e" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b560e9aaec7a4c78b9123b38e73519a3"
I20260709 13:02:27.383770  8475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b574d11894634755bd89c530b4155f1e" candidate_uuid: "590ee39ce5734876b94d91fc3931b807" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7b3ea460d1294b8a82672d7c21475cb5"
I20260709 13:02:27.384253  8549 raft_consensus.cc:3055] T b574d11894634755bd89c530b4155f1e P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:27.384382  8475 raft_consensus.cc:3060] T b574d11894634755bd89c530b4155f1e P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:27.384672  8549 raft_consensus.cc:740] T b574d11894634755bd89c530b4155f1e P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b560e9aaec7a4c78b9123b38e73519a3, State: Running, Role: LEADER
I20260709 13:02:27.385560  8549 consensus_queue.cc:260] T b574d11894634755bd89c530b4155f1e P b560e9aaec7a4c78b9123b38e73519a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:27.386562  8549 raft_consensus.cc:3060] T b574d11894634755bd89c530b4155f1e P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:27.389416  8475 raft_consensus.cc:2468] T b574d11894634755bd89c530b4155f1e P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 590ee39ce5734876b94d91fc3931b807 in term 2.
I20260709 13:02:27.390400  9144 leader_election.cc:304] T b574d11894634755bd89c530b4155f1e P 590ee39ce5734876b94d91fc3931b807 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 590ee39ce5734876b94d91fc3931b807, 7b3ea460d1294b8a82672d7c21475cb5; no voters: 
I20260709 13:02:27.391049  8549 raft_consensus.cc:2468] T b574d11894634755bd89c530b4155f1e P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 590ee39ce5734876b94d91fc3931b807 in term 2.
I20260709 13:02:27.391095  9426 raft_consensus.cc:2804] T b574d11894634755bd89c530b4155f1e P 590ee39ce5734876b94d91fc3931b807 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:27.391716  9426 raft_consensus.cc:697] T b574d11894634755bd89c530b4155f1e P 590ee39ce5734876b94d91fc3931b807 [term 2 LEADER]: Becoming Leader. State: Replica: 590ee39ce5734876b94d91fc3931b807, State: Running, Role: LEADER
I20260709 13:02:27.392797  9426 consensus_queue.cc:237] T b574d11894634755bd89c530b4155f1e P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:27.401587  8225 catalog_manager.cc:5697] T b574d11894634755bd89c530b4155f1e P 590ee39ce5734876b94d91fc3931b807 reported cstate change: term changed from 1 to 2, leader changed from b560e9aaec7a4c78b9123b38e73519a3 (127.0.107.196) to 590ee39ce5734876b94d91fc3931b807 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "590ee39ce5734876b94d91fc3931b807" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:27.833520  8549 raft_consensus.cc:1275] T b574d11894634755bd89c530b4155f1e P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Refusing update from remote peer 590ee39ce5734876b94d91fc3931b807: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:27.834710  9375 consensus_queue.cc:1048] T b574d11894634755bd89c530b4155f1e P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:27.855794  8475 raft_consensus.cc:1275] T b574d11894634755bd89c530b4155f1e P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Refusing update from remote peer 590ee39ce5734876b94d91fc3931b807: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:27.860581  9497 consensus_queue.cc:1048] T b574d11894634755bd89c530b4155f1e P 590ee39ce5734876b94d91fc3931b807 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:27.926772   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:27.971006   431 tablet_server.cc:179] TabletServer@127.0.107.193:40837 shutting down...
I20260709 13:02:28.003074   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:28.004099   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:28.005227   431 raft_consensus.cc:2243] T c6245fdde2e4422581bc418d4840b580 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.005831   431 raft_consensus.cc:2272] T c6245fdde2e4422581bc418d4840b580 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.009060   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:28.009964   431 raft_consensus.cc:2243] T 5527a2aef01d45cebcfad8a1b0a5273d P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.010426   431 raft_consensus.cc:2272] T 5527a2aef01d45cebcfad8a1b0a5273d P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:28.010846  8371 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 210 similar messages]
I20260709 13:02:28.013337   431 tablet_replica.cc:333] stopping tablet replica
W20260709 13:02:28.013998  8371 consensus_peers.cc:597] T a3a46de7366f4683a88d19d25ad04901 P 53a66c851dc74c70b94c65d464a391f6 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:28.014251   431 raft_consensus.cc:2243] T fcc07b65535048fca9045891e1ae0153 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.014853   431 raft_consensus.cc:2272] T fcc07b65535048fca9045891e1ae0153 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.017253   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:28.017984   431 raft_consensus.cc:2243] T d4cd925acef04f3c8910aa1903b760c7 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.018366   431 raft_consensus.cc:2272] T d4cd925acef04f3c8910aa1903b760c7 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.020742   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:28.021574   431 raft_consensus.cc:2243] T d97df5fdb12a439080fa6edc391ebd82 P 590ee39ce5734876b94d91fc3931b807 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:28.022531   431 raft_consensus.cc:2272] T d97df5fdb12a439080fa6edc391ebd82 P 590ee39ce5734876b94d91fc3931b807 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:28.023669  8371 consensus_peers.cc:597] T 5527a2aef01d45cebcfad8a1b0a5273d P 53a66c851dc74c70b94c65d464a391f6 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:28.025060   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:28.025796   431 raft_consensus.cc:2243] T c66f53044d784114970ae5061755da40 P 590ee39ce5734876b94d91fc3931b807 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:28.026544   431 raft_consensus.cc:2272] T c66f53044d784114970ae5061755da40 P 590ee39ce5734876b94d91fc3931b807 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.028659   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:28.029284   431 raft_consensus.cc:2243] T da5b0b01a880412896838e8eb658db7a P 590ee39ce5734876b94d91fc3931b807 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:28.030077   431 raft_consensus.cc:2272] T da5b0b01a880412896838e8eb658db7a P 590ee39ce5734876b94d91fc3931b807 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.032832   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:28.033655   431 raft_consensus.cc:2243] T a1946cc2deaa4799be02943612a39b16 P 590ee39ce5734876b94d91fc3931b807 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.034142   431 raft_consensus.cc:2272] T a1946cc2deaa4799be02943612a39b16 P 590ee39ce5734876b94d91fc3931b807 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.036953   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:28.037627   431 raft_consensus.cc:2243] T 6fffc940549b445c973a289ba1bebcb3 P 590ee39ce5734876b94d91fc3931b807 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:28.038551   431 raft_consensus.cc:2272] T 6fffc940549b445c973a289ba1bebcb3 P 590ee39ce5734876b94d91fc3931b807 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.041352   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:28.041998   431 raft_consensus.cc:2243] T 52f213b355c14b45a13d7cf5b3e76efe P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.042395   431 raft_consensus.cc:2272] T 52f213b355c14b45a13d7cf5b3e76efe P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.044742   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:28.045572   431 raft_consensus.cc:2243] T cea53371e56d4a668406dcd8f5a93dcb P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.046101   431 raft_consensus.cc:2272] T cea53371e56d4a668406dcd8f5a93dcb P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:28.047619  8445 consensus_peers.cc:597] T 52f213b355c14b45a13d7cf5b3e76efe P 7b3ea460d1294b8a82672d7c21475cb5 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:28.048436   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:28.049081   431 raft_consensus.cc:2243] T a79ccdf7d9cf4be7bf8b0c69bf90538a P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.049439   431 raft_consensus.cc:2272] T a79ccdf7d9cf4be7bf8b0c69bf90538a P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.051757   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:28.052464   431 raft_consensus.cc:2243] T 610562885f5849d083ac5f7a85011891 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.052956   431 raft_consensus.cc:2272] T 610562885f5849d083ac5f7a85011891 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.055810   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:28.056494   431 raft_consensus.cc:2243] T e8353e508def43e5a8008bb63ff1a84a P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.056943   431 raft_consensus.cc:2272] T e8353e508def43e5a8008bb63ff1a84a P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.059437   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:28.059985   431 raft_consensus.cc:2243] T e1f344d27b0b44819ef6d23574175c26 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.060359   431 raft_consensus.cc:2272] T e1f344d27b0b44819ef6d23574175c26 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.062592   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:28.063107   431 raft_consensus.cc:2243] T 4d5829b9233a48fea0290d9bb023f97e P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.063443   431 raft_consensus.cc:2272] T 4d5829b9233a48fea0290d9bb023f97e P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.065949   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:28.066749   431 raft_consensus.cc:2243] T 45171bd0207f452f9884a58c225ddb72 P 590ee39ce5734876b94d91fc3931b807 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:28.067726   431 raft_consensus.cc:2272] T 45171bd0207f452f9884a58c225ddb72 P 590ee39ce5734876b94d91fc3931b807 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:28.069796  8519 consensus_peers.cc:597] T 4d5829b9233a48fea0290d9bb023f97e P b560e9aaec7a4c78b9123b38e73519a3 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:28.070340   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:28.070976   431 raft_consensus.cc:2243] T a1667ac154454613a9047f56ee087405 P 590ee39ce5734876b94d91fc3931b807 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.071466   431 raft_consensus.cc:2272] T a1667ac154454613a9047f56ee087405 P 590ee39ce5734876b94d91fc3931b807 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.074580   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:28.075425   431 raft_consensus.cc:2243] T b1d8e928d8444f77ac2950eab2115f65 P 590ee39ce5734876b94d91fc3931b807 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:28.076512   431 raft_consensus.cc:2272] T b1d8e928d8444f77ac2950eab2115f65 P 590ee39ce5734876b94d91fc3931b807 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.079458   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:28.080329   431 raft_consensus.cc:2243] T cb85497b295d4b3f8cda882af3676c65 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.080894   431 raft_consensus.cc:2272] T cb85497b295d4b3f8cda882af3676c65 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.083997   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:28.085130   431 raft_consensus.cc:2243] T c63211d1d13a4736adb18dee69b400a3 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.085639   431 raft_consensus.cc:2272] T c63211d1d13a4736adb18dee69b400a3 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:28.087371  8445 consensus_peers.cc:597] T c6245fdde2e4422581bc418d4840b580 P 7b3ea460d1294b8a82672d7c21475cb5 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:28.088219  8371 consensus_peers.cc:597] T cea53371e56d4a668406dcd8f5a93dcb P 53a66c851dc74c70b94c65d464a391f6 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:28.088743   431 tablet_replica.cc:333] stopping tablet replica
W20260709 13:02:28.090306  8371 consensus_peers.cc:597] T a1667ac154454613a9047f56ee087405 P 53a66c851dc74c70b94c65d464a391f6 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:28.090517   431 raft_consensus.cc:2243] T ef35fbe0cee64967ab342c52aa0b1ac1 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.091078   431 raft_consensus.cc:2272] T ef35fbe0cee64967ab342c52aa0b1ac1 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.093741   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:28.094512   431 raft_consensus.cc:2243] T 5db51a6d67e6461a98e669fa2b1e59c8 P 590ee39ce5734876b94d91fc3931b807 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:28.095243   431 raft_consensus.cc:2272] T 5db51a6d67e6461a98e669fa2b1e59c8 P 590ee39ce5734876b94d91fc3931b807 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.097339   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:28.097884   431 raft_consensus.cc:2243] T f1fec8d4948d45bbbe39d0f3e73c3992 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.098304   431 raft_consensus.cc:2272] T f1fec8d4948d45bbbe39d0f3e73c3992 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.100272   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:28.100888   431 raft_consensus.cc:2243] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.101287   431 raft_consensus.cc:2272] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.103302   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:28.103854   431 raft_consensus.cc:2243] T 69ef277bbcbd41d8a10ae92d9a63145e P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.104259   431 raft_consensus.cc:2272] T 69ef277bbcbd41d8a10ae92d9a63145e P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.106859   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:28.107597   431 raft_consensus.cc:2243] T ca262e71501a4ae4a89152ec6771ffb9 P 590ee39ce5734876b94d91fc3931b807 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:28.108513   431 raft_consensus.cc:2272] T ca262e71501a4ae4a89152ec6771ffb9 P 590ee39ce5734876b94d91fc3931b807 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.111129   431 tablet_replica.cc:333] stopping tablet replica
W20260709 13:02:28.111708  8371 consensus_peers.cc:597] T e1f344d27b0b44819ef6d23574175c26 P 53a66c851dc74c70b94c65d464a391f6 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:28.111774   431 raft_consensus.cc:2243] T 30e220d65bed42489b2af858d3a60981 P 590ee39ce5734876b94d91fc3931b807 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:28.112852   431 raft_consensus.cc:2272] T 30e220d65bed42489b2af858d3a60981 P 590ee39ce5734876b94d91fc3931b807 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.115147   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:28.115702   431 raft_consensus.cc:2243] T cd24f768f33e40bba3406e8dde3f45cc P 590ee39ce5734876b94d91fc3931b807 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.116151   431 raft_consensus.cc:2272] T cd24f768f33e40bba3406e8dde3f45cc P 590ee39ce5734876b94d91fc3931b807 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.118410   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:28.119119   431 raft_consensus.cc:2243] T 62a3aed976de4d62a1d4dc7bc5252328 P 590ee39ce5734876b94d91fc3931b807 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.119668   431 raft_consensus.cc:2272] T 62a3aed976de4d62a1d4dc7bc5252328 P 590ee39ce5734876b94d91fc3931b807 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:28.120692  8371 consensus_peers.cc:597] T 6540f8b1e5df49f698558db1af45038b P 53a66c851dc74c70b94c65d464a391f6 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:28.121959   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:28.122735   431 raft_consensus.cc:2243] T 6433163abeff4ee0b011d159ca454a6a P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.123229   431 raft_consensus.cc:2272] T 6433163abeff4ee0b011d159ca454a6a P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.125847   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:28.126669   431 raft_consensus.cc:2243] T b574d11894634755bd89c530b4155f1e P 590ee39ce5734876b94d91fc3931b807 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:02:28.127383  8519 consensus_peers.cc:597] T e8bdd44ba5144cadada8b14a380f995a P b560e9aaec7a4c78b9123b38e73519a3 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:28.127635   431 raft_consensus.cc:2272] T b574d11894634755bd89c530b4155f1e P 590ee39ce5734876b94d91fc3931b807 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.130594   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:28.131196   431 raft_consensus.cc:2243] T da02fa98f6de48a7baefadf6e69d2046 P 590ee39ce5734876b94d91fc3931b807 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:02:28.131673  8371 consensus_peers.cc:597] T 53842ab4d1d748bda0c7f0d933e5a785 P 53a66c851dc74c70b94c65d464a391f6 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:28.131707   431 raft_consensus.cc:2272] T da02fa98f6de48a7baefadf6e69d2046 P 590ee39ce5734876b94d91fc3931b807 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.135236   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:28.135833   431 raft_consensus.cc:2243] T 6540f8b1e5df49f698558db1af45038b P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.136229   431 raft_consensus.cc:2272] T 6540f8b1e5df49f698558db1af45038b P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.138701   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:28.139492   431 raft_consensus.cc:2243] T 53842ab4d1d748bda0c7f0d933e5a785 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.139977   431 raft_consensus.cc:2272] T 53842ab4d1d748bda0c7f0d933e5a785 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:28.141345  8445 consensus_peers.cc:597] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P 7b3ea460d1294b8a82672d7c21475cb5 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:28.142551   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:28.143275   431 raft_consensus.cc:2243] T 3921dc7d601b4e4ea05f40ca34d69819 P 590ee39ce5734876b94d91fc3931b807 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:28.144073   431 raft_consensus.cc:2272] T 3921dc7d601b4e4ea05f40ca34d69819 P 590ee39ce5734876b94d91fc3931b807 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.146775   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:28.147313   431 raft_consensus.cc:2243] T 1162036be6064d5c821df6a7aa486bab P 590ee39ce5734876b94d91fc3931b807 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:28.148103   431 raft_consensus.cc:2272] T 1162036be6064d5c821df6a7aa486bab P 590ee39ce5734876b94d91fc3931b807 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.150790   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:28.151302   431 raft_consensus.cc:2243] T 4f93b4088ce1421cb59ed9a917919b22 P 590ee39ce5734876b94d91fc3931b807 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.151774   431 raft_consensus.cc:2272] T 4f93b4088ce1421cb59ed9a917919b22 P 590ee39ce5734876b94d91fc3931b807 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.154783   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:28.155381   431 raft_consensus.cc:2243] T a3a46de7366f4683a88d19d25ad04901 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.155993   431 raft_consensus.cc:2272] T a3a46de7366f4683a88d19d25ad04901 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.158406   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:28.159101   431 raft_consensus.cc:2243] T e8bdd44ba5144cadada8b14a380f995a P 590ee39ce5734876b94d91fc3931b807 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.159623   431 raft_consensus.cc:2272] T e8bdd44ba5144cadada8b14a380f995a P 590ee39ce5734876b94d91fc3931b807 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.162029   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:28.162739   431 raft_consensus.cc:2243] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.163200   431 raft_consensus.cc:2272] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.165619   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:28.166275   431 raft_consensus.cc:2243] T 5a94bf713e4848879b9e2a1bbec03def P 590ee39ce5734876b94d91fc3931b807 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:28.167274   431 raft_consensus.cc:2272] T 5a94bf713e4848879b9e2a1bbec03def P 590ee39ce5734876b94d91fc3931b807 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.169766   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:28.170473   431 raft_consensus.cc:2243] T f8ec593f6c894c24a5bc727cfed4190a P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.170930   431 raft_consensus.cc:2272] T f8ec593f6c894c24a5bc727cfed4190a P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.173648   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:28.174122   431 raft_consensus.cc:2243] T 8e53899e04fe4f58b666f67ac07bbf79 P 590ee39ce5734876b94d91fc3931b807 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:28.174844   431 raft_consensus.cc:2272] T 8e53899e04fe4f58b666f67ac07bbf79 P 590ee39ce5734876b94d91fc3931b807 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.176839   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:28.177299   431 raft_consensus.cc:2243] T 8b0d84add64c4f5db82c90e98b7f4b74 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.177685   431 raft_consensus.cc:2272] T 8b0d84add64c4f5db82c90e98b7f4b74 P 590ee39ce5734876b94d91fc3931b807 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:28.202970  8519 consensus_peers.cc:597] T a79ccdf7d9cf4be7bf8b0c69bf90538a P b560e9aaec7a4c78b9123b38e73519a3 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:28.209582  8371 consensus_peers.cc:597] T da02fa98f6de48a7baefadf6e69d2046 P 53a66c851dc74c70b94c65d464a391f6 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:28.223166  8445 consensus_peers.cc:597] T 610562885f5849d083ac5f7a85011891 P 7b3ea460d1294b8a82672d7c21475cb5 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:28.224946  8445 consensus_peers.cc:597] T c63211d1d13a4736adb18dee69b400a3 P 7b3ea460d1294b8a82672d7c21475cb5 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:28.229964  8445 consensus_peers.cc:597] T 8b0d84add64c4f5db82c90e98b7f4b74 P 7b3ea460d1294b8a82672d7c21475cb5 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:28.259688   431 tablet_server.cc:196] TabletServer@127.0.107.193:40837 shutdown complete.
W20260709 13:02:28.265407  8371 consensus_peers.cc:597] T 4f93b4088ce1421cb59ed9a917919b22 P 53a66c851dc74c70b94c65d464a391f6 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:28.280105  8445 consensus_peers.cc:597] T d4cd925acef04f3c8910aa1903b760c7 P 7b3ea460d1294b8a82672d7c21475cb5 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:28.280750  8445 consensus_peers.cc:597] T fcc07b65535048fca9045891e1ae0153 P 7b3ea460d1294b8a82672d7c21475cb5 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:28.303556  8445 consensus_peers.cc:597] T 6433163abeff4ee0b011d159ca454a6a P 7b3ea460d1294b8a82672d7c21475cb5 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:28.305316  8371 consensus_peers.cc:597] T cd24f768f33e40bba3406e8dde3f45cc P 53a66c851dc74c70b94c65d464a391f6 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:28.329224  8445 consensus_peers.cc:597] T e8353e508def43e5a8008bb63ff1a84a P 7b3ea460d1294b8a82672d7c21475cb5 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:28.329905  8445 consensus_peers.cc:597] T a1946cc2deaa4799be02943612a39b16 P 7b3ea460d1294b8a82672d7c21475cb5 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:28.337319  8371 consensus_peers.cc:597] T f1fec8d4948d45bbbe39d0f3e73c3992 P 53a66c851dc74c70b94c65d464a391f6 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:28.340193  8371 consensus_peers.cc:597] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 53a66c851dc74c70b94c65d464a391f6 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:28.350404   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:02:28.378660  8444 consensus_peers.cc:597] T fcc07b65535048fca9045891e1ae0153 P 7b3ea460d1294b8a82672d7c21475cb5 -> Peer 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751): Couldn't send request to peer 53a66c851dc74c70b94c65d464a391f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:28.387569  8519 consensus_peers.cc:597] T f8ec593f6c894c24a5bc727cfed4190a P b560e9aaec7a4c78b9123b38e73519a3 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:28.388998   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:28.389816   431 tablet_replica.cc:333] T 4f93b4088ce1421cb59ed9a917919b22 P 53a66c851dc74c70b94c65d464a391f6: stopping tablet replica
I20260709 13:02:28.390637   431 raft_consensus.cc:2243] T 4f93b4088ce1421cb59ed9a917919b22 P 53a66c851dc74c70b94c65d464a391f6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:28.391532   431 raft_consensus.cc:2272] T 4f93b4088ce1421cb59ed9a917919b22 P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.393805   431 tablet_replica.cc:333] T d97df5fdb12a439080fa6edc391ebd82 P 53a66c851dc74c70b94c65d464a391f6: stopping tablet replica
I20260709 13:02:28.394465   431 raft_consensus.cc:2243] T d97df5fdb12a439080fa6edc391ebd82 P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.394913   431 raft_consensus.cc:2272] T d97df5fdb12a439080fa6edc391ebd82 P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.397327   431 tablet_replica.cc:333] T 308f98e21e714cea8c363eb315d72e27 P 53a66c851dc74c70b94c65d464a391f6: stopping tablet replica
I20260709 13:02:28.398123   431 raft_consensus.cc:2243] T 308f98e21e714cea8c363eb315d72e27 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.398659   431 raft_consensus.cc:2272] T 308f98e21e714cea8c363eb315d72e27 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:28.400250  8519 consensus_peers.cc:597] T cb85497b295d4b3f8cda882af3676c65 P b560e9aaec7a4c78b9123b38e73519a3 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:28.401515   431 tablet_replica.cc:333] T b1d8e928d8444f77ac2950eab2115f65 P 53a66c851dc74c70b94c65d464a391f6: stopping tablet replica
I20260709 13:02:28.402163   431 raft_consensus.cc:2243] T b1d8e928d8444f77ac2950eab2115f65 P 53a66c851dc74c70b94c65d464a391f6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.402592   431 raft_consensus.cc:2272] T b1d8e928d8444f77ac2950eab2115f65 P 53a66c851dc74c70b94c65d464a391f6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.404796   431 tablet_replica.cc:333] T a1667ac154454613a9047f56ee087405 P 53a66c851dc74c70b94c65d464a391f6: stopping tablet replica
I20260709 13:02:28.405650   431 raft_consensus.cc:2243] T a1667ac154454613a9047f56ee087405 P 53a66c851dc74c70b94c65d464a391f6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:28.406677   431 raft_consensus.cc:2272] T a1667ac154454613a9047f56ee087405 P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.409303   431 tablet_replica.cc:333] T da02fa98f6de48a7baefadf6e69d2046 P 53a66c851dc74c70b94c65d464a391f6: stopping tablet replica
I20260709 13:02:28.409866   431 raft_consensus.cc:2243] T da02fa98f6de48a7baefadf6e69d2046 P 53a66c851dc74c70b94c65d464a391f6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:28.410642   431 raft_consensus.cc:2272] T da02fa98f6de48a7baefadf6e69d2046 P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.412626   431 tablet_replica.cc:333] T 30e220d65bed42489b2af858d3a60981 P 53a66c851dc74c70b94c65d464a391f6: stopping tablet replica
I20260709 13:02:28.413399   431 raft_consensus.cc:2243] T 30e220d65bed42489b2af858d3a60981 P 53a66c851dc74c70b94c65d464a391f6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.413821   431 raft_consensus.cc:2272] T 30e220d65bed42489b2af858d3a60981 P 53a66c851dc74c70b94c65d464a391f6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.415704   431 tablet_replica.cc:333] T 19fa9442e72f4d4697a919590110cc68 P 53a66c851dc74c70b94c65d464a391f6: stopping tablet replica
I20260709 13:02:28.416320   431 raft_consensus.cc:2243] T 19fa9442e72f4d4697a919590110cc68 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.416780   431 raft_consensus.cc:2272] T 19fa9442e72f4d4697a919590110cc68 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.418704   431 tablet_replica.cc:333] T 435da692a6474cb697066524d4f5216e P 53a66c851dc74c70b94c65d464a391f6: stopping tablet replica
I20260709 13:02:28.419274   431 raft_consensus.cc:2243] T 435da692a6474cb697066524d4f5216e P 53a66c851dc74c70b94c65d464a391f6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.419613   431 raft_consensus.cc:2272] T 435da692a6474cb697066524d4f5216e P 53a66c851dc74c70b94c65d464a391f6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.421458   431 tablet_replica.cc:333] T d4791a5544bd4cbf8f7e3a05f62a9370 P 53a66c851dc74c70b94c65d464a391f6: stopping tablet replica
I20260709 13:02:28.421983   431 raft_consensus.cc:2243] T d4791a5544bd4cbf8f7e3a05f62a9370 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.422335   431 raft_consensus.cc:2272] T d4791a5544bd4cbf8f7e3a05f62a9370 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.424021   431 tablet_replica.cc:333] T 1162036be6064d5c821df6a7aa486bab P 53a66c851dc74c70b94c65d464a391f6: stopping tablet replica
I20260709 13:02:28.424515   431 raft_consensus.cc:2243] T 1162036be6064d5c821df6a7aa486bab P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.424922   431 raft_consensus.cc:2272] T 1162036be6064d5c821df6a7aa486bab P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.426693   431 tablet_replica.cc:333] T 3921dc7d601b4e4ea05f40ca34d69819 P 53a66c851dc74c70b94c65d464a391f6: stopping tablet replica
I20260709 13:02:28.427251   431 raft_consensus.cc:2243] T 3921dc7d601b4e4ea05f40ca34d69819 P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.427589   431 raft_consensus.cc:2272] T 3921dc7d601b4e4ea05f40ca34d69819 P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.429359   431 tablet_replica.cc:333] T 7c9804c61fdb47a7958574869d381b72 P 53a66c851dc74c70b94c65d464a391f6: stopping tablet replica
I20260709 13:02:28.429889   431 raft_consensus.cc:2243] T 7c9804c61fdb47a7958574869d381b72 P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.430373   431 raft_consensus.cc:2272] T 7c9804c61fdb47a7958574869d381b72 P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.432585   431 tablet_replica.cc:333] T a3a46de7366f4683a88d19d25ad04901 P 53a66c851dc74c70b94c65d464a391f6: stopping tablet replica
I20260709 13:02:28.433089   431 raft_consensus.cc:2243] T a3a46de7366f4683a88d19d25ad04901 P 53a66c851dc74c70b94c65d464a391f6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:28.433790   431 raft_consensus.cc:2272] T a3a46de7366f4683a88d19d25ad04901 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.435477   431 tablet_replica.cc:333] T 8e53899e04fe4f58b666f67ac07bbf79 P 53a66c851dc74c70b94c65d464a391f6: stopping tablet replica
I20260709 13:02:28.435937   431 raft_consensus.cc:2243] T 8e53899e04fe4f58b666f67ac07bbf79 P 53a66c851dc74c70b94c65d464a391f6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.436304   431 raft_consensus.cc:2272] T 8e53899e04fe4f58b666f67ac07bbf79 P 53a66c851dc74c70b94c65d464a391f6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.437996   431 tablet_replica.cc:333] T f8ec593f6c894c24a5bc727cfed4190a P 53a66c851dc74c70b94c65d464a391f6: stopping tablet replica
I20260709 13:02:28.438462   431 raft_consensus.cc:2243] T f8ec593f6c894c24a5bc727cfed4190a P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.438808   431 raft_consensus.cc:2272] T f8ec593f6c894c24a5bc727cfed4190a P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.440734   431 tablet_replica.cc:333] T 8b0d84add64c4f5db82c90e98b7f4b74 P 53a66c851dc74c70b94c65d464a391f6: stopping tablet replica
I20260709 13:02:28.441185   431 raft_consensus.cc:2243] T 8b0d84add64c4f5db82c90e98b7f4b74 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.441558   431 raft_consensus.cc:2272] T 8b0d84add64c4f5db82c90e98b7f4b74 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.443394   431 tablet_replica.cc:333] T 5a94bf713e4848879b9e2a1bbec03def P 53a66c851dc74c70b94c65d464a391f6: stopping tablet replica
I20260709 13:02:28.443974   431 raft_consensus.cc:2243] T 5a94bf713e4848879b9e2a1bbec03def P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.444442   431 raft_consensus.cc:2272] T 5a94bf713e4848879b9e2a1bbec03def P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.446794   431 tablet_replica.cc:333] T 1fe73d50e76147ebace9610e09de74a5 P 53a66c851dc74c70b94c65d464a391f6: stopping tablet replica
I20260709 13:02:28.447536   431 raft_consensus.cc:2243] T 1fe73d50e76147ebace9610e09de74a5 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.448022   431 raft_consensus.cc:2272] T 1fe73d50e76147ebace9610e09de74a5 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:28.448848  8444 consensus_peers.cc:597] T 435da692a6474cb697066524d4f5216e P 7b3ea460d1294b8a82672d7c21475cb5 -> Peer 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751): Couldn't send request to peer 53a66c851dc74c70b94c65d464a391f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:28.450033   431 tablet_replica.cc:333] T c66f53044d784114970ae5061755da40 P 53a66c851dc74c70b94c65d464a391f6: stopping tablet replica
I20260709 13:02:28.450762   431 raft_consensus.cc:2243] T c66f53044d784114970ae5061755da40 P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.451169   431 raft_consensus.cc:2272] T c66f53044d784114970ae5061755da40 P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.453208   431 tablet_replica.cc:333] T ae8659e834df408ab36dd56103f10ae4 P 53a66c851dc74c70b94c65d464a391f6: stopping tablet replica
I20260709 13:02:28.453738   431 raft_consensus.cc:2243] T ae8659e834df408ab36dd56103f10ae4 P 53a66c851dc74c70b94c65d464a391f6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:28.454439   431 raft_consensus.cc:2272] T ae8659e834df408ab36dd56103f10ae4 P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.457005   431 tablet_replica.cc:333] T 4d5829b9233a48fea0290d9bb023f97e P 53a66c851dc74c70b94c65d464a391f6: stopping tablet replica
I20260709 13:02:28.457705   431 raft_consensus.cc:2243] T 4d5829b9233a48fea0290d9bb023f97e P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.458238   431 raft_consensus.cc:2272] T 4d5829b9233a48fea0290d9bb023f97e P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.460700   431 tablet_replica.cc:333] T 40926724afa743899b7ab0af312dc717 P 53a66c851dc74c70b94c65d464a391f6: stopping tablet replica
I20260709 13:02:28.461404   431 raft_consensus.cc:2243] T 40926724afa743899b7ab0af312dc717 P 53a66c851dc74c70b94c65d464a391f6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.461844   431 raft_consensus.cc:2272] T 40926724afa743899b7ab0af312dc717 P 53a66c851dc74c70b94c65d464a391f6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.464201   431 tablet_replica.cc:333] T 45171bd0207f452f9884a58c225ddb72 P 53a66c851dc74c70b94c65d464a391f6: stopping tablet replica
I20260709 13:02:28.464854   431 raft_consensus.cc:2243] T 45171bd0207f452f9884a58c225ddb72 P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.465308   431 raft_consensus.cc:2272] T 45171bd0207f452f9884a58c225ddb72 P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.467559   431 tablet_replica.cc:333] T 5db51a6d67e6461a98e669fa2b1e59c8 P 53a66c851dc74c70b94c65d464a391f6: stopping tablet replica
I20260709 13:02:28.468173   431 raft_consensus.cc:2243] T 5db51a6d67e6461a98e669fa2b1e59c8 P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.468640   431 raft_consensus.cc:2272] T 5db51a6d67e6461a98e669fa2b1e59c8 P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.470791   431 tablet_replica.cc:333] T c63211d1d13a4736adb18dee69b400a3 P 53a66c851dc74c70b94c65d464a391f6: stopping tablet replica
I20260709 13:02:28.471244   431 raft_consensus.cc:2243] T c63211d1d13a4736adb18dee69b400a3 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.471696   431 raft_consensus.cc:2272] T c63211d1d13a4736adb18dee69b400a3 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.474251   431 tablet_replica.cc:333] T fcc07b65535048fca9045891e1ae0153 P 53a66c851dc74c70b94c65d464a391f6: stopping tablet replica
I20260709 13:02:28.474951   431 raft_consensus.cc:2243] T fcc07b65535048fca9045891e1ae0153 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.475430   431 raft_consensus.cc:2272] T fcc07b65535048fca9045891e1ae0153 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.477659   431 tablet_replica.cc:333] T 5095fba09faf47dd939329e762fbc663 P 53a66c851dc74c70b94c65d464a391f6: stopping tablet replica
I20260709 13:02:28.478312   431 raft_consensus.cc:2243] T 5095fba09faf47dd939329e762fbc663 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.478761   431 raft_consensus.cc:2272] T 5095fba09faf47dd939329e762fbc663 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:28.480144  8518 consensus_peers.cc:597] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P b560e9aaec7a4c78b9123b38e73519a3 -> Peer 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751): Couldn't send request to peer 53a66c851dc74c70b94c65d464a391f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:28.480952   431 tablet_replica.cc:333] T cb85497b295d4b3f8cda882af3676c65 P 53a66c851dc74c70b94c65d464a391f6: stopping tablet replica
I20260709 13:02:28.481807   431 raft_consensus.cc:2243] T cb85497b295d4b3f8cda882af3676c65 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.482317   431 raft_consensus.cc:2272] T cb85497b295d4b3f8cda882af3676c65 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.484171   431 tablet_replica.cc:333] T 610562885f5849d083ac5f7a85011891 P 53a66c851dc74c70b94c65d464a391f6: stopping tablet replica
I20260709 13:02:28.484849   431 raft_consensus.cc:2243] T 610562885f5849d083ac5f7a85011891 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.485304   431 raft_consensus.cc:2272] T 610562885f5849d083ac5f7a85011891 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.487991   431 tablet_replica.cc:333] T 7ed73594956241f4b3e6e456bae82964 P 53a66c851dc74c70b94c65d464a391f6: stopping tablet replica
I20260709 13:02:28.488646   431 raft_consensus.cc:2243] T 7ed73594956241f4b3e6e456bae82964 P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.489120   431 raft_consensus.cc:2272] T 7ed73594956241f4b3e6e456bae82964 P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.491469   431 tablet_replica.cc:333] T cca6412bb2df45b4880e711fe56d2f8d P 53a66c851dc74c70b94c65d464a391f6: stopping tablet replica
I20260709 13:02:28.492144   431 raft_consensus.cc:2243] T cca6412bb2df45b4880e711fe56d2f8d P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.492628   431 raft_consensus.cc:2272] T cca6412bb2df45b4880e711fe56d2f8d P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.494987   431 tablet_replica.cc:333] T f1fec8d4948d45bbbe39d0f3e73c3992 P 53a66c851dc74c70b94c65d464a391f6: stopping tablet replica
I20260709 13:02:28.495745   431 raft_consensus.cc:2243] T f1fec8d4948d45bbbe39d0f3e73c3992 P 53a66c851dc74c70b94c65d464a391f6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:28.496670   431 raft_consensus.cc:2272] T f1fec8d4948d45bbbe39d0f3e73c3992 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.499080   431 tablet_replica.cc:333] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 53a66c851dc74c70b94c65d464a391f6: stopping tablet replica
I20260709 13:02:28.499857   431 raft_consensus.cc:2243] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 53a66c851dc74c70b94c65d464a391f6 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:02:28.500198  8519 consensus_peers.cc:597] T ef35fbe0cee64967ab342c52aa0b1ac1 P b560e9aaec7a4c78b9123b38e73519a3 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:28.500844   431 raft_consensus.cc:2272] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.503506   431 tablet_replica.cc:333] T cd24f768f33e40bba3406e8dde3f45cc P 53a66c851dc74c70b94c65d464a391f6: stopping tablet replica
I20260709 13:02:28.504164   431 raft_consensus.cc:2243] T cd24f768f33e40bba3406e8dde3f45cc P 53a66c851dc74c70b94c65d464a391f6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:28.505172   431 raft_consensus.cc:2272] T cd24f768f33e40bba3406e8dde3f45cc P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:28.505692  8444 consensus_peers.cc:597] T a1946cc2deaa4799be02943612a39b16 P 7b3ea460d1294b8a82672d7c21475cb5 -> Peer 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751): Couldn't send request to peer 53a66c851dc74c70b94c65d464a391f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:28.507680   431 tablet_replica.cc:333] T 5527a2aef01d45cebcfad8a1b0a5273d P 53a66c851dc74c70b94c65d464a391f6: stopping tablet replica
I20260709 13:02:28.508492   431 raft_consensus.cc:2243] T 5527a2aef01d45cebcfad8a1b0a5273d P 53a66c851dc74c70b94c65d464a391f6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:28.509624   431 raft_consensus.cc:2272] T 5527a2aef01d45cebcfad8a1b0a5273d P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.512110   431 tablet_replica.cc:333] T 53842ab4d1d748bda0c7f0d933e5a785 P 53a66c851dc74c70b94c65d464a391f6: stopping tablet replica
I20260709 13:02:28.513089   431 raft_consensus.cc:2243] T 53842ab4d1d748bda0c7f0d933e5a785 P 53a66c851dc74c70b94c65d464a391f6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:28.514106   431 raft_consensus.cc:2272] T 53842ab4d1d748bda0c7f0d933e5a785 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.516909   431 tablet_replica.cc:333] T 6540f8b1e5df49f698558db1af45038b P 53a66c851dc74c70b94c65d464a391f6: stopping tablet replica
I20260709 13:02:28.517735   431 raft_consensus.cc:2243] T 6540f8b1e5df49f698558db1af45038b P 53a66c851dc74c70b94c65d464a391f6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:28.518759   431 raft_consensus.cc:2272] T 6540f8b1e5df49f698558db1af45038b P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.521392   431 tablet_replica.cc:333] T 6a82728feb4f4f1094191c0e30d748dd P 53a66c851dc74c70b94c65d464a391f6: stopping tablet replica
I20260709 13:02:28.522076   431 raft_consensus.cc:2243] T 6a82728feb4f4f1094191c0e30d748dd P 53a66c851dc74c70b94c65d464a391f6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:28.523002   431 raft_consensus.cc:2272] T 6a82728feb4f4f1094191c0e30d748dd P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.525832   431 tablet_replica.cc:333] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P 53a66c851dc74c70b94c65d464a391f6: stopping tablet replica
I20260709 13:02:28.526652   431 raft_consensus.cc:2243] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:02:28.526791  8519 consensus_peers.cc:597] T 62a3aed976de4d62a1d4dc7bc5252328 P b560e9aaec7a4c78b9123b38e73519a3 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:28.527149   431 raft_consensus.cc:2272] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:28.527586  8519 consensus_peers.cc:597] T 69ef277bbcbd41d8a10ae92d9a63145e P b560e9aaec7a4c78b9123b38e73519a3 -> Peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Couldn't send request to peer 590ee39ce5734876b94d91fc3931b807. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:28.530252   431 tablet_replica.cc:333] T dbe23b457e664c298f0f2f6c41af32f8 P 53a66c851dc74c70b94c65d464a391f6: stopping tablet replica
I20260709 13:02:28.531015   431 raft_consensus.cc:2243] T dbe23b457e664c298f0f2f6c41af32f8 P 53a66c851dc74c70b94c65d464a391f6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:28.532021   431 raft_consensus.cc:2272] T dbe23b457e664c298f0f2f6c41af32f8 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:28.532770  8444 consensus_peers.cc:597] T 7ed73594956241f4b3e6e456bae82964 P 7b3ea460d1294b8a82672d7c21475cb5 -> Peer 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751): Couldn't send request to peer 53a66c851dc74c70b94c65d464a391f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:28.534852   431 tablet_replica.cc:333] T a1946cc2deaa4799be02943612a39b16 P 53a66c851dc74c70b94c65d464a391f6: stopping tablet replica
I20260709 13:02:28.535653   431 raft_consensus.cc:2243] T a1946cc2deaa4799be02943612a39b16 P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.536157   431 raft_consensus.cc:2272] T a1946cc2deaa4799be02943612a39b16 P 53a66c851dc74c70b94c65d464a391f6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.539026   431 tablet_replica.cc:333] T e1f344d27b0b44819ef6d23574175c26 P 53a66c851dc74c70b94c65d464a391f6: stopping tablet replica
W20260709 13:02:28.539529  8518 consensus_peers.cc:597] T 4d5829b9233a48fea0290d9bb023f97e P b560e9aaec7a4c78b9123b38e73519a3 -> Peer 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751): Couldn't send request to peer 53a66c851dc74c70b94c65d464a391f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:28.539590   431 raft_consensus.cc:2243] T e1f344d27b0b44819ef6d23574175c26 P 53a66c851dc74c70b94c65d464a391f6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:28.541394   431 raft_consensus.cc:2272] T e1f344d27b0b44819ef6d23574175c26 P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.543707   431 tablet_replica.cc:333] T cea53371e56d4a668406dcd8f5a93dcb P 53a66c851dc74c70b94c65d464a391f6: stopping tablet replica
I20260709 13:02:28.544158   431 raft_consensus.cc:2243] T cea53371e56d4a668406dcd8f5a93dcb P 53a66c851dc74c70b94c65d464a391f6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:28.545008   431 raft_consensus.cc:2272] T cea53371e56d4a668406dcd8f5a93dcb P 53a66c851dc74c70b94c65d464a391f6 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:28.553496  8518 consensus_peers.cc:597] T 5095fba09faf47dd939329e762fbc663 P b560e9aaec7a4c78b9123b38e73519a3 -> Peer 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751): Couldn't send request to peer 53a66c851dc74c70b94c65d464a391f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:28.556211  8444 consensus_peers.cc:597] T c63211d1d13a4736adb18dee69b400a3 P 7b3ea460d1294b8a82672d7c21475cb5 -> Peer 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751): Couldn't send request to peer 53a66c851dc74c70b94c65d464a391f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:28.579118  8518 consensus_peers.cc:597] T cb85497b295d4b3f8cda882af3676c65 P b560e9aaec7a4c78b9123b38e73519a3 -> Peer 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751): Couldn't send request to peer 53a66c851dc74c70b94c65d464a391f6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:28.618342   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
W20260709 13:02:28.631668  8518 consensus_peers.cc:597] T 19fa9442e72f4d4697a919590110cc68 P b560e9aaec7a4c78b9123b38e73519a3 -> Peer 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751): Couldn't send request to peer 53a66c851dc74c70b94c65d464a391f6. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:37751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:28.645785  8444 consensus_peers.cc:597] T 8b0d84add64c4f5db82c90e98b7f4b74 P 7b3ea460d1294b8a82672d7c21475cb5 -> Peer 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751): Couldn't send request to peer 53a66c851dc74c70b94c65d464a391f6. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:37751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:28.656893  8518 consensus_peers.cc:597] T d4791a5544bd4cbf8f7e3a05f62a9370 P b560e9aaec7a4c78b9123b38e73519a3 -> Peer 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751): Couldn't send request to peer 53a66c851dc74c70b94c65d464a391f6. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:37751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:28.681535  8518 consensus_peers.cc:597] T 40926724afa743899b7ab0af312dc717 P b560e9aaec7a4c78b9123b38e73519a3 -> Peer 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751): Couldn't send request to peer 53a66c851dc74c70b94c65d464a391f6. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:37751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:28.715647   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
W20260709 13:02:28.741070  8518 consensus_peers.cc:597] T f8ec593f6c894c24a5bc727cfed4190a P b560e9aaec7a4c78b9123b38e73519a3 -> Peer 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751): Couldn't send request to peer 53a66c851dc74c70b94c65d464a391f6. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:37751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:28.747370  8518 consensus_peers.cc:597] T 308f98e21e714cea8c363eb315d72e27 P b560e9aaec7a4c78b9123b38e73519a3 -> Peer 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751): Couldn't send request to peer 53a66c851dc74c70b94c65d464a391f6. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:37751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:28.769537  8518 consensus_peers.cc:597] T 308f98e21e714cea8c363eb315d72e27 P b560e9aaec7a4c78b9123b38e73519a3 -> Peer 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429): Couldn't send request to peer 7b3ea460d1294b8a82672d7c21475cb5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:28.776487   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:28.777544   431 tablet_replica.cc:333] T c6245fdde2e4422581bc418d4840b580 P 7b3ea460d1294b8a82672d7c21475cb5: stopping tablet replica
I20260709 13:02:28.778555   431 raft_consensus.cc:2243] T c6245fdde2e4422581bc418d4840b580 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:28.779556   431 raft_consensus.cc:2272] T c6245fdde2e4422581bc418d4840b580 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.782245   431 tablet_replica.cc:333] T cca6412bb2df45b4880e711fe56d2f8d P 7b3ea460d1294b8a82672d7c21475cb5: stopping tablet replica
I20260709 13:02:28.783066   431 raft_consensus.cc:2243] T cca6412bb2df45b4880e711fe56d2f8d P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.783437   431 raft_consensus.cc:2272] T cca6412bb2df45b4880e711fe56d2f8d P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.785243   431 tablet_replica.cc:333] T d4cd925acef04f3c8910aa1903b760c7 P 7b3ea460d1294b8a82672d7c21475cb5: stopping tablet replica
I20260709 13:02:28.785758   431 raft_consensus.cc:2243] T d4cd925acef04f3c8910aa1903b760c7 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:28.786439   431 raft_consensus.cc:2272] T d4cd925acef04f3c8910aa1903b760c7 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.788156   431 tablet_replica.cc:333] T 308f98e21e714cea8c363eb315d72e27 P 7b3ea460d1294b8a82672d7c21475cb5: stopping tablet replica
I20260709 13:02:28.788731   431 raft_consensus.cc:2243] T 308f98e21e714cea8c363eb315d72e27 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.789100   431 raft_consensus.cc:2272] T 308f98e21e714cea8c363eb315d72e27 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.790843   431 tablet_replica.cc:333] T a1667ac154454613a9047f56ee087405 P 7b3ea460d1294b8a82672d7c21475cb5: stopping tablet replica
I20260709 13:02:28.791326   431 raft_consensus.cc:2243] T a1667ac154454613a9047f56ee087405 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.791666   431 raft_consensus.cc:2272] T a1667ac154454613a9047f56ee087405 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.793368   431 tablet_replica.cc:333] T b1d8e928d8444f77ac2950eab2115f65 P 7b3ea460d1294b8a82672d7c21475cb5: stopping tablet replica
I20260709 13:02:28.793846   431 raft_consensus.cc:2243] T b1d8e928d8444f77ac2950eab2115f65 P 7b3ea460d1294b8a82672d7c21475cb5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.794183   431 raft_consensus.cc:2272] T b1d8e928d8444f77ac2950eab2115f65 P 7b3ea460d1294b8a82672d7c21475cb5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.795849   431 tablet_replica.cc:333] T b574d11894634755bd89c530b4155f1e P 7b3ea460d1294b8a82672d7c21475cb5: stopping tablet replica
I20260709 13:02:28.796311   431 raft_consensus.cc:2243] T b574d11894634755bd89c530b4155f1e P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.796716   431 raft_consensus.cc:2272] T b574d11894634755bd89c530b4155f1e P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.798890   431 tablet_replica.cc:333] T ca262e71501a4ae4a89152ec6771ffb9 P 7b3ea460d1294b8a82672d7c21475cb5: stopping tablet replica
I20260709 13:02:28.799393   431 raft_consensus.cc:2243] T ca262e71501a4ae4a89152ec6771ffb9 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.799738   431 raft_consensus.cc:2272] T ca262e71501a4ae4a89152ec6771ffb9 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.801402   431 tablet_replica.cc:333] T 30e220d65bed42489b2af858d3a60981 P 7b3ea460d1294b8a82672d7c21475cb5: stopping tablet replica
I20260709 13:02:28.801875   431 raft_consensus.cc:2243] T 30e220d65bed42489b2af858d3a60981 P 7b3ea460d1294b8a82672d7c21475cb5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.802215   431 raft_consensus.cc:2272] T 30e220d65bed42489b2af858d3a60981 P 7b3ea460d1294b8a82672d7c21475cb5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.804076   431 tablet_replica.cc:333] T 69ef277bbcbd41d8a10ae92d9a63145e P 7b3ea460d1294b8a82672d7c21475cb5: stopping tablet replica
I20260709 13:02:28.804778   431 raft_consensus.cc:2243] T 69ef277bbcbd41d8a10ae92d9a63145e P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.805292   431 raft_consensus.cc:2272] T 69ef277bbcbd41d8a10ae92d9a63145e P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:28.806164  8518 consensus_peers.cc:597] T 40926724afa743899b7ab0af312dc717 P b560e9aaec7a4c78b9123b38e73519a3 -> Peer 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429): Couldn't send request to peer 7b3ea460d1294b8a82672d7c21475cb5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:28.807955   431 tablet_replica.cc:333] T d4791a5544bd4cbf8f7e3a05f62a9370 P 7b3ea460d1294b8a82672d7c21475cb5: stopping tablet replica
I20260709 13:02:28.808629   431 raft_consensus.cc:2243] T d4791a5544bd4cbf8f7e3a05f62a9370 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:02:28.808709  8444 consensus_peers.cc:597] T 7c9804c61fdb47a7958574869d381b72 P 7b3ea460d1294b8a82672d7c21475cb5 -> Peer 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751): Couldn't send request to peer 53a66c851dc74c70b94c65d464a391f6. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:37751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:28.809051   431 raft_consensus.cc:2272] T d4791a5544bd4cbf8f7e3a05f62a9370 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.811441   431 tablet_replica.cc:333] T 19fa9442e72f4d4697a919590110cc68 P 7b3ea460d1294b8a82672d7c21475cb5: stopping tablet replica
I20260709 13:02:28.812124   431 raft_consensus.cc:2243] T 19fa9442e72f4d4697a919590110cc68 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.812665   431 raft_consensus.cc:2272] T 19fa9442e72f4d4697a919590110cc68 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.814662   431 tablet_replica.cc:333] T 435da692a6474cb697066524d4f5216e P 7b3ea460d1294b8a82672d7c21475cb5: stopping tablet replica
I20260709 13:02:28.815160   431 raft_consensus.cc:2243] T 435da692a6474cb697066524d4f5216e P 7b3ea460d1294b8a82672d7c21475cb5 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:28.815816   431 raft_consensus.cc:2272] T 435da692a6474cb697066524d4f5216e P 7b3ea460d1294b8a82672d7c21475cb5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.818157   431 tablet_replica.cc:333] T 3921dc7d601b4e4ea05f40ca34d69819 P 7b3ea460d1294b8a82672d7c21475cb5: stopping tablet replica
I20260709 13:02:28.818794   431 raft_consensus.cc:2243] T 3921dc7d601b4e4ea05f40ca34d69819 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.819285   431 raft_consensus.cc:2272] T 3921dc7d601b4e4ea05f40ca34d69819 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.821440   431 tablet_replica.cc:333] T 52f213b355c14b45a13d7cf5b3e76efe P 7b3ea460d1294b8a82672d7c21475cb5: stopping tablet replica
I20260709 13:02:28.821898   431 raft_consensus.cc:2243] T 52f213b355c14b45a13d7cf5b3e76efe P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:28.822671   431 raft_consensus.cc:2272] T 52f213b355c14b45a13d7cf5b3e76efe P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.824613   431 tablet_replica.cc:333] T 6fffc940549b445c973a289ba1bebcb3 P 7b3ea460d1294b8a82672d7c21475cb5: stopping tablet replica
I20260709 13:02:28.825292   431 raft_consensus.cc:2243] T 6fffc940549b445c973a289ba1bebcb3 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.825865   431 raft_consensus.cc:2272] T 6fffc940549b445c973a289ba1bebcb3 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:28.826751  8444 consensus_peers.cc:597] T 610562885f5849d083ac5f7a85011891 P 7b3ea460d1294b8a82672d7c21475cb5 -> Peer 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751): Couldn't send request to peer 53a66c851dc74c70b94c65d464a391f6. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:37751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:28.828392   431 tablet_replica.cc:333] T 7c9804c61fdb47a7958574869d381b72 P 7b3ea460d1294b8a82672d7c21475cb5: stopping tablet replica
W20260709 13:02:28.828823  8444 consensus_peers.cc:597] T 1fe73d50e76147ebace9610e09de74a5 P 7b3ea460d1294b8a82672d7c21475cb5 -> Peer 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751): Couldn't send request to peer 53a66c851dc74c70b94c65d464a391f6. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:37751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:28.829206   431 raft_consensus.cc:2243] T 7c9804c61fdb47a7958574869d381b72 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:28.830200   431 raft_consensus.cc:2272] T 7c9804c61fdb47a7958574869d381b72 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.832872   431 tablet_replica.cc:333] T a3a46de7366f4683a88d19d25ad04901 P 7b3ea460d1294b8a82672d7c21475cb5: stopping tablet replica
I20260709 13:02:28.833621   431 raft_consensus.cc:2243] T a3a46de7366f4683a88d19d25ad04901 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.834108   431 raft_consensus.cc:2272] T a3a46de7366f4683a88d19d25ad04901 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.836845   431 tablet_replica.cc:333] T 1fe73d50e76147ebace9610e09de74a5 P 7b3ea460d1294b8a82672d7c21475cb5: stopping tablet replica
I20260709 13:02:28.837594   431 raft_consensus.cc:2243] T 1fe73d50e76147ebace9610e09de74a5 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:28.838634   431 raft_consensus.cc:2272] T 1fe73d50e76147ebace9610e09de74a5 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.841228   431 tablet_replica.cc:333] T c66f53044d784114970ae5061755da40 P 7b3ea460d1294b8a82672d7c21475cb5: stopping tablet replica
I20260709 13:02:28.841945   431 raft_consensus.cc:2243] T c66f53044d784114970ae5061755da40 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.842424   431 raft_consensus.cc:2272] T c66f53044d784114970ae5061755da40 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.844933   431 tablet_replica.cc:333] T ae8659e834df408ab36dd56103f10ae4 P 7b3ea460d1294b8a82672d7c21475cb5: stopping tablet replica
I20260709 13:02:28.845664   431 raft_consensus.cc:2243] T ae8659e834df408ab36dd56103f10ae4 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.846120   431 raft_consensus.cc:2272] T ae8659e834df408ab36dd56103f10ae4 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:28.848055  8518 consensus_peers.cc:597] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P b560e9aaec7a4c78b9123b38e73519a3 -> Peer 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429): Couldn't send request to peer 7b3ea460d1294b8a82672d7c21475cb5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:28.848762   431 tablet_replica.cc:333] T 6433163abeff4ee0b011d159ca454a6a P 7b3ea460d1294b8a82672d7c21475cb5: stopping tablet replica
I20260709 13:02:28.849591   431 raft_consensus.cc:2243] T 6433163abeff4ee0b011d159ca454a6a P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:28.850492   431 raft_consensus.cc:2272] T 6433163abeff4ee0b011d159ca454a6a P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.852977   431 tablet_replica.cc:333] T fcc07b65535048fca9045891e1ae0153 P 7b3ea460d1294b8a82672d7c21475cb5: stopping tablet replica
I20260709 13:02:28.853705   431 raft_consensus.cc:2243] T fcc07b65535048fca9045891e1ae0153 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:28.854605   431 raft_consensus.cc:2272] T fcc07b65535048fca9045891e1ae0153 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.857156   431 tablet_replica.cc:333] T 5095fba09faf47dd939329e762fbc663 P 7b3ea460d1294b8a82672d7c21475cb5: stopping tablet replica
I20260709 13:02:28.857882   431 raft_consensus.cc:2243] T 5095fba09faf47dd939329e762fbc663 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.858393   431 raft_consensus.cc:2272] T 5095fba09faf47dd939329e762fbc663 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.860932   431 tablet_replica.cc:333] T ef35fbe0cee64967ab342c52aa0b1ac1 P 7b3ea460d1294b8a82672d7c21475cb5: stopping tablet replica
I20260709 13:02:28.861680   431 raft_consensus.cc:2243] T ef35fbe0cee64967ab342c52aa0b1ac1 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.862176   431 raft_consensus.cc:2272] T ef35fbe0cee64967ab342c52aa0b1ac1 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.864799   431 tablet_replica.cc:333] T c63211d1d13a4736adb18dee69b400a3 P 7b3ea460d1294b8a82672d7c21475cb5: stopping tablet replica
I20260709 13:02:28.865540   431 raft_consensus.cc:2243] T c63211d1d13a4736adb18dee69b400a3 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:28.866463   431 raft_consensus.cc:2272] T c63211d1d13a4736adb18dee69b400a3 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.868949   431 tablet_replica.cc:333] T 610562885f5849d083ac5f7a85011891 P 7b3ea460d1294b8a82672d7c21475cb5: stopping tablet replica
I20260709 13:02:28.869673   431 raft_consensus.cc:2243] T 610562885f5849d083ac5f7a85011891 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:28.870568   431 raft_consensus.cc:2272] T 610562885f5849d083ac5f7a85011891 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:28.872644  8518 consensus_peers.cc:597] T 62a3aed976de4d62a1d4dc7bc5252328 P b560e9aaec7a4c78b9123b38e73519a3 -> Peer 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429): Couldn't send request to peer 7b3ea460d1294b8a82672d7c21475cb5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:28.873246   431 tablet_replica.cc:333] T e8353e508def43e5a8008bb63ff1a84a P 7b3ea460d1294b8a82672d7c21475cb5: stopping tablet replica
I20260709 13:02:28.874071   431 raft_consensus.cc:2243] T e8353e508def43e5a8008bb63ff1a84a P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:28.874977   431 raft_consensus.cc:2272] T e8353e508def43e5a8008bb63ff1a84a P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.877471   431 tablet_replica.cc:333] T 7ed73594956241f4b3e6e456bae82964 P 7b3ea460d1294b8a82672d7c21475cb5: stopping tablet replica
I20260709 13:02:28.878180   431 raft_consensus.cc:2243] T 7ed73594956241f4b3e6e456bae82964 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:28.879098   431 raft_consensus.cc:2272] T 7ed73594956241f4b3e6e456bae82964 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.881680   431 tablet_replica.cc:333] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P 7b3ea460d1294b8a82672d7c21475cb5: stopping tablet replica
I20260709 13:02:28.882405   431 raft_consensus.cc:2243] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:28.883296   431 raft_consensus.cc:2272] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.885866   431 tablet_replica.cc:333] T e8bdd44ba5144cadada8b14a380f995a P 7b3ea460d1294b8a82672d7c21475cb5: stopping tablet replica
I20260709 13:02:28.886576   431 raft_consensus.cc:2243] T e8bdd44ba5144cadada8b14a380f995a P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.887121   431 raft_consensus.cc:2272] T e8bdd44ba5144cadada8b14a380f995a P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.889623   431 tablet_replica.cc:333] T 5527a2aef01d45cebcfad8a1b0a5273d P 7b3ea460d1294b8a82672d7c21475cb5: stopping tablet replica
I20260709 13:02:28.890323   431 raft_consensus.cc:2243] T 5527a2aef01d45cebcfad8a1b0a5273d P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.890805   431 raft_consensus.cc:2272] T 5527a2aef01d45cebcfad8a1b0a5273d P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.893203   431 tablet_replica.cc:333] T 53842ab4d1d748bda0c7f0d933e5a785 P 7b3ea460d1294b8a82672d7c21475cb5: stopping tablet replica
I20260709 13:02:28.893862   431 raft_consensus.cc:2243] T 53842ab4d1d748bda0c7f0d933e5a785 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.894368   431 raft_consensus.cc:2272] T 53842ab4d1d748bda0c7f0d933e5a785 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.896881   431 tablet_replica.cc:333] T 6540f8b1e5df49f698558db1af45038b P 7b3ea460d1294b8a82672d7c21475cb5: stopping tablet replica
I20260709 13:02:28.897532   431 raft_consensus.cc:2243] T 6540f8b1e5df49f698558db1af45038b P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.898075   431 raft_consensus.cc:2272] T 6540f8b1e5df49f698558db1af45038b P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.900569   431 tablet_replica.cc:333] T 62a3aed976de4d62a1d4dc7bc5252328 P 7b3ea460d1294b8a82672d7c21475cb5: stopping tablet replica
I20260709 13:02:28.901250   431 raft_consensus.cc:2243] T 62a3aed976de4d62a1d4dc7bc5252328 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.901743   431 raft_consensus.cc:2272] T 62a3aed976de4d62a1d4dc7bc5252328 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.904105   431 tablet_replica.cc:333] T 6a82728feb4f4f1094191c0e30d748dd P 7b3ea460d1294b8a82672d7c21475cb5: stopping tablet replica
I20260709 13:02:28.904764   431 raft_consensus.cc:2243] T 6a82728feb4f4f1094191c0e30d748dd P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.905500   431 raft_consensus.cc:2272] T 6a82728feb4f4f1094191c0e30d748dd P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.907234   431 tablet_replica.cc:333] T dbe23b457e664c298f0f2f6c41af32f8 P 7b3ea460d1294b8a82672d7c21475cb5: stopping tablet replica
I20260709 13:02:28.907774   431 raft_consensus.cc:2243] T dbe23b457e664c298f0f2f6c41af32f8 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.908164   431 raft_consensus.cc:2272] T dbe23b457e664c298f0f2f6c41af32f8 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.910000   431 tablet_replica.cc:333] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P 7b3ea460d1294b8a82672d7c21475cb5: stopping tablet replica
I20260709 13:02:28.910794   431 raft_consensus.cc:2243] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.911321   431 raft_consensus.cc:2272] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.913846   431 tablet_replica.cc:333] T a79ccdf7d9cf4be7bf8b0c69bf90538a P 7b3ea460d1294b8a82672d7c21475cb5: stopping tablet replica
I20260709 13:02:28.914475   431 raft_consensus.cc:2243] T a79ccdf7d9cf4be7bf8b0c69bf90538a P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.914976   431 raft_consensus.cc:2272] T a79ccdf7d9cf4be7bf8b0c69bf90538a P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.917500   431 tablet_replica.cc:333] T a1946cc2deaa4799be02943612a39b16 P 7b3ea460d1294b8a82672d7c21475cb5: stopping tablet replica
I20260709 13:02:28.918208   431 raft_consensus.cc:2243] T a1946cc2deaa4799be02943612a39b16 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:28.918991   431 raft_consensus.cc:2272] T a1946cc2deaa4799be02943612a39b16 P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.921603   431 tablet_replica.cc:333] T da5b0b01a880412896838e8eb658db7a P 7b3ea460d1294b8a82672d7c21475cb5: stopping tablet replica
I20260709 13:02:28.922240   431 raft_consensus.cc:2243] T da5b0b01a880412896838e8eb658db7a P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.922636   431 raft_consensus.cc:2272] T da5b0b01a880412896838e8eb658db7a P 7b3ea460d1294b8a82672d7c21475cb5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.924373   431 tablet_replica.cc:333] T 8e53899e04fe4f58b666f67ac07bbf79 P 7b3ea460d1294b8a82672d7c21475cb5: stopping tablet replica
I20260709 13:02:28.924892   431 raft_consensus.cc:2243] T 8e53899e04fe4f58b666f67ac07bbf79 P 7b3ea460d1294b8a82672d7c21475cb5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.925338   431 raft_consensus.cc:2272] T 8e53899e04fe4f58b666f67ac07bbf79 P 7b3ea460d1294b8a82672d7c21475cb5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.927722   431 tablet_replica.cc:333] T 8b0d84add64c4f5db82c90e98b7f4b74 P 7b3ea460d1294b8a82672d7c21475cb5: stopping tablet replica
I20260709 13:02:28.928396   431 raft_consensus.cc:2243] T 8b0d84add64c4f5db82c90e98b7f4b74 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:28.929442   431 raft_consensus.cc:2272] T 8b0d84add64c4f5db82c90e98b7f4b74 P 7b3ea460d1294b8a82672d7c21475cb5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:28.932106   431 tablet_replica.cc:333] T 40926724afa743899b7ab0af312dc717 P 7b3ea460d1294b8a82672d7c21475cb5: stopping tablet replica
I20260709 13:02:28.932802   431 raft_consensus.cc:2243] T 40926724afa743899b7ab0af312dc717 P 7b3ea460d1294b8a82672d7c21475cb5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:28.933314   431 raft_consensus.cc:2272] T 40926724afa743899b7ab0af312dc717 P 7b3ea460d1294b8a82672d7c21475cb5 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:28.950099  8518 consensus_peers.cc:597] T cca6412bb2df45b4880e711fe56d2f8d P b560e9aaec7a4c78b9123b38e73519a3 -> Peer 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751): Couldn't send request to peer 53a66c851dc74c70b94c65d464a391f6. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:37751: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:28.963119  8518 consensus_peers.cc:597] T 69ef277bbcbd41d8a10ae92d9a63145e P b560e9aaec7a4c78b9123b38e73519a3 -> Peer 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429): Couldn't send request to peer 7b3ea460d1294b8a82672d7c21475cb5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:29.026185   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
W20260709 13:02:29.026217  8518 consensus_peers.cc:597] T cca6412bb2df45b4880e711fe56d2f8d P b560e9aaec7a4c78b9123b38e73519a3 -> Peer 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429): Couldn't send request to peer 7b3ea460d1294b8a82672d7c21475cb5. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:45429: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:29.049860  8518 consensus_peers.cc:597] T 19fa9442e72f4d4697a919590110cc68 P b560e9aaec7a4c78b9123b38e73519a3 -> Peer 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429): Couldn't send request to peer 7b3ea460d1294b8a82672d7c21475cb5. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:45429: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:29.093498  8518 consensus_peers.cc:597] T ef35fbe0cee64967ab342c52aa0b1ac1 P b560e9aaec7a4c78b9123b38e73519a3 -> Peer 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429): Couldn't send request to peer 7b3ea460d1294b8a82672d7c21475cb5. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:45429: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:29.105307   431 tablet_server.cc:179] TabletServer@127.0.107.196:0 shutting down...
W20260709 13:02:29.141153  8518 consensus_peers.cc:597] T e8bdd44ba5144cadada8b14a380f995a P b560e9aaec7a4c78b9123b38e73519a3 -> Peer 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429): Couldn't send request to peer 7b3ea460d1294b8a82672d7c21475cb5. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:45429: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:29.144922  9480 raft_consensus.cc:493] T da5b0b01a880412896838e8eb658db7a P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 590ee39ce5734876b94d91fc3931b807)
I20260709 13:02:29.145753  9480 raft_consensus.cc:515] T da5b0b01a880412896838e8eb658db7a P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b3ea460d1294b8a82672d7c21475cb5" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 45429 } } peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } }
I20260709 13:02:29.148288  9480 leader_election.cc:290] T da5b0b01a880412896838e8eb658db7a P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429), 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837)
W20260709 13:02:29.151777  8518 leader_election.cc:336] T da5b0b01a880412896838e8eb658db7a P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429): Network error: Client connection negotiation failed: client connection to 127.0.107.195:45429: connect: Connection refused (error 111)
W20260709 13:02:29.153338  8519 leader_election.cc:336] T da5b0b01a880412896838e8eb658db7a P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111)
I20260709 13:02:29.153681  8519 leader_election.cc:304] T da5b0b01a880412896838e8eb658db7a P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b560e9aaec7a4c78b9123b38e73519a3; no voters: 590ee39ce5734876b94d91fc3931b807, 7b3ea460d1294b8a82672d7c21475cb5
I20260709 13:02:29.154269  9480 raft_consensus.cc:2749] T da5b0b01a880412896838e8eb658db7a P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:29.157714   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:29.158380   431 tablet_replica.cc:333] T 1162036be6064d5c821df6a7aa486bab P b560e9aaec7a4c78b9123b38e73519a3: stopping tablet replica
I20260709 13:02:29.158985   431 raft_consensus.cc:2243] T 1162036be6064d5c821df6a7aa486bab P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:29.159435   431 raft_consensus.cc:2272] T 1162036be6064d5c821df6a7aa486bab P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:29.161429   431 tablet_replica.cc:333] T d97df5fdb12a439080fa6edc391ebd82 P b560e9aaec7a4c78b9123b38e73519a3: stopping tablet replica
I20260709 13:02:29.161957   431 raft_consensus.cc:2243] T d97df5fdb12a439080fa6edc391ebd82 P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:29.162375   431 raft_consensus.cc:2272] T d97df5fdb12a439080fa6edc391ebd82 P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:29.164076   431 tablet_replica.cc:333] T c6245fdde2e4422581bc418d4840b580 P b560e9aaec7a4c78b9123b38e73519a3: stopping tablet replica
I20260709 13:02:29.164705   431 raft_consensus.cc:2243] T c6245fdde2e4422581bc418d4840b580 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:29.165236   431 raft_consensus.cc:2272] T c6245fdde2e4422581bc418d4840b580 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:29.167953   431 tablet_replica.cc:333] T 4f93b4088ce1421cb59ed9a917919b22 P b560e9aaec7a4c78b9123b38e73519a3: stopping tablet replica
I20260709 13:02:29.169155   431 raft_consensus.cc:2243] T 4f93b4088ce1421cb59ed9a917919b22 P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:29.169688   431 raft_consensus.cc:2272] T 4f93b4088ce1421cb59ed9a917919b22 P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:29.172181   431 tablet_replica.cc:333] T b574d11894634755bd89c530b4155f1e P b560e9aaec7a4c78b9123b38e73519a3: stopping tablet replica
I20260709 13:02:29.172915   431 raft_consensus.cc:2243] T b574d11894634755bd89c530b4155f1e P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:29.173442   431 raft_consensus.cc:2272] T b574d11894634755bd89c530b4155f1e P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:29.175733   431 tablet_replica.cc:333] T 308f98e21e714cea8c363eb315d72e27 P b560e9aaec7a4c78b9123b38e73519a3: stopping tablet replica
I20260709 13:02:29.176453   431 raft_consensus.cc:2243] T 308f98e21e714cea8c363eb315d72e27 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:29.177703   431 raft_consensus.cc:2272] T 308f98e21e714cea8c363eb315d72e27 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:29.180613   431 tablet_replica.cc:333] T d4cd925acef04f3c8910aa1903b760c7 P b560e9aaec7a4c78b9123b38e73519a3: stopping tablet replica
I20260709 13:02:29.181357   431 raft_consensus.cc:2243] T d4cd925acef04f3c8910aa1903b760c7 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:29.182003   431 raft_consensus.cc:2272] T d4cd925acef04f3c8910aa1903b760c7 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:29.184741   431 tablet_replica.cc:333] T da02fa98f6de48a7baefadf6e69d2046 P b560e9aaec7a4c78b9123b38e73519a3: stopping tablet replica
I20260709 13:02:29.185369   431 raft_consensus.cc:2243] T da02fa98f6de48a7baefadf6e69d2046 P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:29.185774   431 raft_consensus.cc:2272] T da02fa98f6de48a7baefadf6e69d2046 P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:29.187747   431 tablet_replica.cc:333] T ca262e71501a4ae4a89152ec6771ffb9 P b560e9aaec7a4c78b9123b38e73519a3: stopping tablet replica
I20260709 13:02:29.188264   431 raft_consensus.cc:2243] T ca262e71501a4ae4a89152ec6771ffb9 P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:29.188722   431 raft_consensus.cc:2272] T ca262e71501a4ae4a89152ec6771ffb9 P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:29.190544   431 tablet_replica.cc:333] T 69ef277bbcbd41d8a10ae92d9a63145e P b560e9aaec7a4c78b9123b38e73519a3: stopping tablet replica
I20260709 13:02:29.191061   431 raft_consensus.cc:2243] T 69ef277bbcbd41d8a10ae92d9a63145e P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:29.191824   431 raft_consensus.cc:2272] T 69ef277bbcbd41d8a10ae92d9a63145e P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:29.194687   431 tablet_replica.cc:333] T 19fa9442e72f4d4697a919590110cc68 P b560e9aaec7a4c78b9123b38e73519a3: stopping tablet replica
I20260709 13:02:29.195557   431 raft_consensus.cc:2243] T 19fa9442e72f4d4697a919590110cc68 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:29.196691   431 raft_consensus.cc:2272] T 19fa9442e72f4d4697a919590110cc68 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:29.196902  9480 raft_consensus.cc:493] T 5a94bf713e4848879b9e2a1bbec03def P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 590ee39ce5734876b94d91fc3931b807)
I20260709 13:02:29.197518  9480 raft_consensus.cc:515] T 5a94bf713e4848879b9e2a1bbec03def P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b560e9aaec7a4c78b9123b38e73519a3" member_type: VOTER last_known_addr { host: "127.0.107.196" port: 42503 } } peers { permanent_uuid: "590ee39ce5734876b94d91fc3931b807" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40837 } } peers { permanent_uuid: "53a66c851dc74c70b94c65d464a391f6" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 37751 } }
I20260709 13:02:29.199530   431 tablet_replica.cc:333] T 435da692a6474cb697066524d4f5216e P b560e9aaec7a4c78b9123b38e73519a3: stopping tablet replica
I20260709 13:02:29.200296  9480 leader_election.cc:290] T 5a94bf713e4848879b9e2a1bbec03def P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837), 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751)
I20260709 13:02:29.200446   431 raft_consensus.cc:2243] T 435da692a6474cb697066524d4f5216e P b560e9aaec7a4c78b9123b38e73519a3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:29.201141   431 raft_consensus.cc:2272] T 435da692a6474cb697066524d4f5216e P b560e9aaec7a4c78b9123b38e73519a3 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:29.203433  8519 leader_election.cc:336] T 5a94bf713e4848879b9e2a1bbec03def P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 590ee39ce5734876b94d91fc3931b807 (127.0.107.193:40837): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40837: connect: Connection refused (error 111)
I20260709 13:02:29.203629   431 tablet_replica.cc:333] T ef35fbe0cee64967ab342c52aa0b1ac1 P b560e9aaec7a4c78b9123b38e73519a3: stopping tablet replica
I20260709 13:02:29.204344   431 raft_consensus.cc:2243] T ef35fbe0cee64967ab342c52aa0b1ac1 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:29.205317   431 raft_consensus.cc:2272] T ef35fbe0cee64967ab342c52aa0b1ac1 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:29.205662  8518 consensus_peers.cc:597] T d4791a5544bd4cbf8f7e3a05f62a9370 P b560e9aaec7a4c78b9123b38e73519a3 -> Peer 7b3ea460d1294b8a82672d7c21475cb5 (127.0.107.195:45429): Couldn't send request to peer 7b3ea460d1294b8a82672d7c21475cb5. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.195:45429: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:29.206432  8518 leader_election.cc:336] T 5a94bf713e4848879b9e2a1bbec03def P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 53a66c851dc74c70b94c65d464a391f6 (127.0.107.194:37751): Network error: Client connection negotiation failed: client connection to 127.0.107.194:37751: connect: Connection refused (error 111)
I20260709 13:02:29.206748  8518 leader_election.cc:304] T 5a94bf713e4848879b9e2a1bbec03def P b560e9aaec7a4c78b9123b38e73519a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b560e9aaec7a4c78b9123b38e73519a3; no voters: 53a66c851dc74c70b94c65d464a391f6, 590ee39ce5734876b94d91fc3931b807
I20260709 13:02:29.207306  9480 raft_consensus.cc:2749] T 5a94bf713e4848879b9e2a1bbec03def P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:29.207574   431 tablet_replica.cc:333] T 5db51a6d67e6461a98e669fa2b1e59c8 P b560e9aaec7a4c78b9123b38e73519a3: stopping tablet replica
I20260709 13:02:29.208256   431 raft_consensus.cc:2243] T 5db51a6d67e6461a98e669fa2b1e59c8 P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:29.208696   431 raft_consensus.cc:2272] T 5db51a6d67e6461a98e669fa2b1e59c8 P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:29.210759   431 tablet_replica.cc:333] T d4791a5544bd4cbf8f7e3a05f62a9370 P b560e9aaec7a4c78b9123b38e73519a3: stopping tablet replica
I20260709 13:02:29.211444   431 raft_consensus.cc:2243] T d4791a5544bd4cbf8f7e3a05f62a9370 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:29.212242   431 raft_consensus.cc:2272] T d4791a5544bd4cbf8f7e3a05f62a9370 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:29.214144   431 tablet_replica.cc:333] T 52f213b355c14b45a13d7cf5b3e76efe P b560e9aaec7a4c78b9123b38e73519a3: stopping tablet replica
I20260709 13:02:29.214712   431 raft_consensus.cc:2243] T 52f213b355c14b45a13d7cf5b3e76efe P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:29.215163   431 raft_consensus.cc:2272] T 52f213b355c14b45a13d7cf5b3e76efe P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:29.217300   431 tablet_replica.cc:333] T 6fffc940549b445c973a289ba1bebcb3 P b560e9aaec7a4c78b9123b38e73519a3: stopping tablet replica
I20260709 13:02:29.217902   431 raft_consensus.cc:2243] T 6fffc940549b445c973a289ba1bebcb3 P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:29.218348   431 raft_consensus.cc:2272] T 6fffc940549b445c973a289ba1bebcb3 P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:29.220156   431 tablet_replica.cc:333] T a79ccdf7d9cf4be7bf8b0c69bf90538a P b560e9aaec7a4c78b9123b38e73519a3: stopping tablet replica
I20260709 13:02:29.220779   431 raft_consensus.cc:2243] T a79ccdf7d9cf4be7bf8b0c69bf90538a P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:29.221549   431 raft_consensus.cc:2272] T a79ccdf7d9cf4be7bf8b0c69bf90538a P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:29.223412   431 tablet_replica.cc:333] T 1fe73d50e76147ebace9610e09de74a5 P b560e9aaec7a4c78b9123b38e73519a3: stopping tablet replica
I20260709 13:02:29.223951   431 raft_consensus.cc:2243] T 1fe73d50e76147ebace9610e09de74a5 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:29.224391   431 raft_consensus.cc:2272] T 1fe73d50e76147ebace9610e09de74a5 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:29.226509   431 tablet_replica.cc:333] T ae8659e834df408ab36dd56103f10ae4 P b560e9aaec7a4c78b9123b38e73519a3: stopping tablet replica
I20260709 13:02:29.227072   431 raft_consensus.cc:2243] T ae8659e834df408ab36dd56103f10ae4 P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:29.227497   431 raft_consensus.cc:2272] T ae8659e834df408ab36dd56103f10ae4 P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:29.229331   431 tablet_replica.cc:333] T 6433163abeff4ee0b011d159ca454a6a P b560e9aaec7a4c78b9123b38e73519a3: stopping tablet replica
I20260709 13:02:29.229969   431 raft_consensus.cc:2243] T 6433163abeff4ee0b011d159ca454a6a P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:29.230396   431 raft_consensus.cc:2272] T 6433163abeff4ee0b011d159ca454a6a P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:29.232308   431 tablet_replica.cc:333] T 4d5829b9233a48fea0290d9bb023f97e P b560e9aaec7a4c78b9123b38e73519a3: stopping tablet replica
I20260709 13:02:29.232913   431 raft_consensus.cc:2243] T 4d5829b9233a48fea0290d9bb023f97e P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:29.233721   431 raft_consensus.cc:2272] T 4d5829b9233a48fea0290d9bb023f97e P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:29.235647   431 tablet_replica.cc:333] T 40926724afa743899b7ab0af312dc717 P b560e9aaec7a4c78b9123b38e73519a3: stopping tablet replica
I20260709 13:02:29.236202   431 raft_consensus.cc:2243] T 40926724afa743899b7ab0af312dc717 P b560e9aaec7a4c78b9123b38e73519a3 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:29.237084   431 raft_consensus.cc:2272] T 40926724afa743899b7ab0af312dc717 P b560e9aaec7a4c78b9123b38e73519a3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:29.239064   431 tablet_replica.cc:333] T 45171bd0207f452f9884a58c225ddb72 P b560e9aaec7a4c78b9123b38e73519a3: stopping tablet replica
I20260709 13:02:29.239629   431 raft_consensus.cc:2243] T 45171bd0207f452f9884a58c225ddb72 P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:29.240176   431 raft_consensus.cc:2272] T 45171bd0207f452f9884a58c225ddb72 P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:29.242046   431 tablet_replica.cc:333] T e8bdd44ba5144cadada8b14a380f995a P b560e9aaec7a4c78b9123b38e73519a3: stopping tablet replica
I20260709 13:02:29.242614   431 raft_consensus.cc:2243] T e8bdd44ba5144cadada8b14a380f995a P b560e9aaec7a4c78b9123b38e73519a3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:29.243609   431 raft_consensus.cc:2272] T e8bdd44ba5144cadada8b14a380f995a P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:29.245959   431 tablet_replica.cc:333] T 5a94bf713e4848879b9e2a1bbec03def P b560e9aaec7a4c78b9123b38e73519a3: stopping tablet replica
I20260709 13:02:29.246519   431 raft_consensus.cc:2243] T 5a94bf713e4848879b9e2a1bbec03def P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:29.246965   431 raft_consensus.cc:2272] T 5a94bf713e4848879b9e2a1bbec03def P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:29.248879   431 tablet_replica.cc:333] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P b560e9aaec7a4c78b9123b38e73519a3: stopping tablet replica
I20260709 13:02:29.249550   431 raft_consensus.cc:2243] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:29.250006   431 raft_consensus.cc:2272] T 4a8bd38b8a2e4bbd9d07dcf2f1cea143 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:29.252063   431 tablet_replica.cc:333] T 5095fba09faf47dd939329e762fbc663 P b560e9aaec7a4c78b9123b38e73519a3: stopping tablet replica
I20260709 13:02:29.252669   431 raft_consensus.cc:2243] T 5095fba09faf47dd939329e762fbc663 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:29.253480   431 raft_consensus.cc:2272] T 5095fba09faf47dd939329e762fbc663 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:29.255419   431 tablet_replica.cc:333] T 6a82728feb4f4f1094191c0e30d748dd P b560e9aaec7a4c78b9123b38e73519a3: stopping tablet replica
I20260709 13:02:29.255975   431 raft_consensus.cc:2243] T 6a82728feb4f4f1094191c0e30d748dd P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:29.256417   431 raft_consensus.cc:2272] T 6a82728feb4f4f1094191c0e30d748dd P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:29.258375   431 tablet_replica.cc:333] T dbe23b457e664c298f0f2f6c41af32f8 P b560e9aaec7a4c78b9123b38e73519a3: stopping tablet replica
I20260709 13:02:29.258934   431 raft_consensus.cc:2243] T dbe23b457e664c298f0f2f6c41af32f8 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:29.259373   431 raft_consensus.cc:2272] T dbe23b457e664c298f0f2f6c41af32f8 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:29.261412   431 tablet_replica.cc:333] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P b560e9aaec7a4c78b9123b38e73519a3: stopping tablet replica
I20260709 13:02:29.261983   431 raft_consensus.cc:2243] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:29.262785   431 raft_consensus.cc:2272] T 1dcf623b1e5f47ec9cf4b5d9f00d4c1b P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:29.264768   431 tablet_replica.cc:333] T 7c9804c61fdb47a7958574869d381b72 P b560e9aaec7a4c78b9123b38e73519a3: stopping tablet replica
I20260709 13:02:29.265321   431 raft_consensus.cc:2243] T 7c9804c61fdb47a7958574869d381b72 P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:29.265753   431 raft_consensus.cc:2272] T 7c9804c61fdb47a7958574869d381b72 P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:29.267514   431 tablet_replica.cc:333] T e8353e508def43e5a8008bb63ff1a84a P b560e9aaec7a4c78b9123b38e73519a3: stopping tablet replica
I20260709 13:02:29.268054   431 raft_consensus.cc:2243] T e8353e508def43e5a8008bb63ff1a84a P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:29.268513   431 raft_consensus.cc:2272] T e8353e508def43e5a8008bb63ff1a84a P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:29.270678   431 tablet_replica.cc:333] T 7ed73594956241f4b3e6e456bae82964 P b560e9aaec7a4c78b9123b38e73519a3: stopping tablet replica
I20260709 13:02:29.271247   431 raft_consensus.cc:2243] T 7ed73594956241f4b3e6e456bae82964 P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:29.271685   431 raft_consensus.cc:2272] T 7ed73594956241f4b3e6e456bae82964 P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:29.273716   431 tablet_replica.cc:333] T cb85497b295d4b3f8cda882af3676c65 P b560e9aaec7a4c78b9123b38e73519a3: stopping tablet replica
I20260709 13:02:29.274246   431 raft_consensus.cc:2243] T cb85497b295d4b3f8cda882af3676c65 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:29.275091   431 raft_consensus.cc:2272] T cb85497b295d4b3f8cda882af3676c65 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:29.277073   431 tablet_replica.cc:333] T cca6412bb2df45b4880e711fe56d2f8d P b560e9aaec7a4c78b9123b38e73519a3: stopping tablet replica
I20260709 13:02:29.277626   431 raft_consensus.cc:2243] T cca6412bb2df45b4880e711fe56d2f8d P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:29.278426   431 raft_consensus.cc:2272] T cca6412bb2df45b4880e711fe56d2f8d P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:29.280256   431 tablet_replica.cc:333] T f1fec8d4948d45bbbe39d0f3e73c3992 P b560e9aaec7a4c78b9123b38e73519a3: stopping tablet replica
I20260709 13:02:29.280854   431 raft_consensus.cc:2243] T f1fec8d4948d45bbbe39d0f3e73c3992 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:29.281291   431 raft_consensus.cc:2272] T f1fec8d4948d45bbbe39d0f3e73c3992 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:29.283203   431 tablet_replica.cc:333] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P b560e9aaec7a4c78b9123b38e73519a3: stopping tablet replica
I20260709 13:02:29.283721   431 raft_consensus.cc:2243] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:29.284150   431 raft_consensus.cc:2272] T 73b7ef1c3ead4480b17e7ce7da20f5f5 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:29.286121   431 tablet_replica.cc:333] T 62a3aed976de4d62a1d4dc7bc5252328 P b560e9aaec7a4c78b9123b38e73519a3: stopping tablet replica
I20260709 13:02:29.286657   431 raft_consensus.cc:2243] T 62a3aed976de4d62a1d4dc7bc5252328 P b560e9aaec7a4c78b9123b38e73519a3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:29.287452   431 raft_consensus.cc:2272] T 62a3aed976de4d62a1d4dc7bc5252328 P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:29.289407   431 tablet_replica.cc:333] T cd24f768f33e40bba3406e8dde3f45cc P b560e9aaec7a4c78b9123b38e73519a3: stopping tablet replica
I20260709 13:02:29.289927   431 raft_consensus.cc:2243] T cd24f768f33e40bba3406e8dde3f45cc P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:29.290369   431 raft_consensus.cc:2272] T cd24f768f33e40bba3406e8dde3f45cc P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:29.292232   431 tablet_replica.cc:333] T f8ec593f6c894c24a5bc727cfed4190a P b560e9aaec7a4c78b9123b38e73519a3: stopping tablet replica
I20260709 13:02:29.292754   431 raft_consensus.cc:2243] T f8ec593f6c894c24a5bc727cfed4190a P b560e9aaec7a4c78b9123b38e73519a3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:29.293541   431 raft_consensus.cc:2272] T f8ec593f6c894c24a5bc727cfed4190a P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:29.295583   431 tablet_replica.cc:333] T da5b0b01a880412896838e8eb658db7a P b560e9aaec7a4c78b9123b38e73519a3: stopping tablet replica
I20260709 13:02:29.296114   431 raft_consensus.cc:2243] T da5b0b01a880412896838e8eb658db7a P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:29.296604   431 raft_consensus.cc:2272] T da5b0b01a880412896838e8eb658db7a P b560e9aaec7a4c78b9123b38e73519a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:29.298719   431 tablet_replica.cc:333] T cea53371e56d4a668406dcd8f5a93dcb P b560e9aaec7a4c78b9123b38e73519a3: stopping tablet replica
I20260709 13:02:29.299162   431 raft_consensus.cc:2243] T cea53371e56d4a668406dcd8f5a93dcb P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:29.299539   431 raft_consensus.cc:2272] T cea53371e56d4a668406dcd8f5a93dcb P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:29.301419   431 tablet_replica.cc:333] T e1f344d27b0b44819ef6d23574175c26 P b560e9aaec7a4c78b9123b38e73519a3: stopping tablet replica
I20260709 13:02:29.301841   431 raft_consensus.cc:2243] T e1f344d27b0b44819ef6d23574175c26 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:29.302284   431 raft_consensus.cc:2272] T e1f344d27b0b44819ef6d23574175c26 P b560e9aaec7a4c78b9123b38e73519a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:29.373769   431 tablet_server.cc:196] TabletServer@127.0.107.196:0 shutdown complete.
I20260709 13:02:29.438041   431 master.cc:562] Master@127.0.107.254:37501 shutting down...
I20260709 13:02:29.461745   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 147a2ee5cb4e4faf937f44519f6ebd75 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:29.462356   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 147a2ee5cb4e4faf937f44519f6ebd75 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:29.462667   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 147a2ee5cb4e4faf937f44519f6ebd75: stopping tablet replica
I20260709 13:02:29.484679   431 master.cc:584] Master@127.0.107.254:37501 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (33841 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:02:29.574581   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:41909
I20260709 13:02:29.575717   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:29.581746  9513 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:29.581815  9514 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:29.582286  9516 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:29.582890   431 server_base.cc:1061] running on GCE node
I20260709 13:02:29.584002   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:29.584210   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:29.584388   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602149584370 us; error 0 us; skew 500 ppm
I20260709 13:02:29.584933   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:29.587466   431 webserver.cc:533] Webserver started at http://127.0.107.254:40949/ using document root <none> and password file <none>
I20260709 13:02:29.588006   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:29.588224   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:29.588569   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:29.589771   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601869227091-431-0/minicluster-data/master-0-root/instance:
uuid: "d18cf9dec3e9461db3450496bcf43a60"
format_stamp: "Formatted at 2026-07-09 13:02:29 on dist-test-slave-5mzn"
I20260709 13:02:29.594343   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:02:29.598060  9521 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:29.598771   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:02:29.599071   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601869227091-431-0/minicluster-data/master-0-root
uuid: "d18cf9dec3e9461db3450496bcf43a60"
format_stamp: "Formatted at 2026-07-09 13:02:29 on dist-test-slave-5mzn"
I20260709 13:02:29.599355   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601869227091-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601869227091-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601869227091-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:29.611639   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:29.612995   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:29.650298   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:41909
I20260709 13:02:29.650386  9572 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:41909 every 8 connection(s)
I20260709 13:02:29.654068  9573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:29.664364  9573 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d18cf9dec3e9461db3450496bcf43a60: Bootstrap starting.
I20260709 13:02:29.669195  9573 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d18cf9dec3e9461db3450496bcf43a60: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:29.673617  9573 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d18cf9dec3e9461db3450496bcf43a60: No bootstrap required, opened a new log
I20260709 13:02:29.675776  9573 raft_consensus.cc:359] T 00000000000000000000000000000000 P d18cf9dec3e9461db3450496bcf43a60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d18cf9dec3e9461db3450496bcf43a60" member_type: VOTER }
I20260709 13:02:29.676169  9573 raft_consensus.cc:385] T 00000000000000000000000000000000 P d18cf9dec3e9461db3450496bcf43a60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:29.676458  9573 raft_consensus.cc:740] T 00000000000000000000000000000000 P d18cf9dec3e9461db3450496bcf43a60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d18cf9dec3e9461db3450496bcf43a60, State: Initialized, Role: FOLLOWER
I20260709 13:02:29.677145  9573 consensus_queue.cc:260] T 00000000000000000000000000000000 P d18cf9dec3e9461db3450496bcf43a60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d18cf9dec3e9461db3450496bcf43a60" member_type: VOTER }
I20260709 13:02:29.677590  9573 raft_consensus.cc:399] T 00000000000000000000000000000000 P d18cf9dec3e9461db3450496bcf43a60 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:02:29.677814  9573 raft_consensus.cc:493] T 00000000000000000000000000000000 P d18cf9dec3e9461db3450496bcf43a60 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:02:29.678092  9573 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d18cf9dec3e9461db3450496bcf43a60 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:29.682581  9573 raft_consensus.cc:515] T 00000000000000000000000000000000 P d18cf9dec3e9461db3450496bcf43a60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d18cf9dec3e9461db3450496bcf43a60" member_type: VOTER }
I20260709 13:02:29.683126  9573 leader_election.cc:304] T 00000000000000000000000000000000 P d18cf9dec3e9461db3450496bcf43a60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d18cf9dec3e9461db3450496bcf43a60; no voters: 
I20260709 13:02:29.684244  9573 leader_election.cc:290] T 00000000000000000000000000000000 P d18cf9dec3e9461db3450496bcf43a60 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:02:29.684633  9576 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d18cf9dec3e9461db3450496bcf43a60 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:29.686033  9576 raft_consensus.cc:697] T 00000000000000000000000000000000 P d18cf9dec3e9461db3450496bcf43a60 [term 1 LEADER]: Becoming Leader. State: Replica: d18cf9dec3e9461db3450496bcf43a60, State: Running, Role: LEADER
I20260709 13:02:29.686658  9576 consensus_queue.cc:237] T 00000000000000000000000000000000 P d18cf9dec3e9461db3450496bcf43a60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d18cf9dec3e9461db3450496bcf43a60" member_type: VOTER }
I20260709 13:02:29.687229  9573 sys_catalog.cc:565] T 00000000000000000000000000000000 P d18cf9dec3e9461db3450496bcf43a60 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:02:29.691090  9577 sys_catalog.cc:455] T 00000000000000000000000000000000 P d18cf9dec3e9461db3450496bcf43a60 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d18cf9dec3e9461db3450496bcf43a60" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d18cf9dec3e9461db3450496bcf43a60" member_type: VOTER } }
I20260709 13:02:29.691054  9578 sys_catalog.cc:455] T 00000000000000000000000000000000 P d18cf9dec3e9461db3450496bcf43a60 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d18cf9dec3e9461db3450496bcf43a60. Latest consensus state: current_term: 1 leader_uuid: "d18cf9dec3e9461db3450496bcf43a60" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d18cf9dec3e9461db3450496bcf43a60" member_type: VOTER } }
I20260709 13:02:29.691893  9577 sys_catalog.cc:458] T 00000000000000000000000000000000 P d18cf9dec3e9461db3450496bcf43a60 [sys.catalog]: This master's current role is: LEADER
I20260709 13:02:29.691954  9578 sys_catalog.cc:458] T 00000000000000000000000000000000 P d18cf9dec3e9461db3450496bcf43a60 [sys.catalog]: This master's current role is: LEADER
I20260709 13:02:29.700871  9583 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:02:29.705689  9583 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:02:29.706677   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:02:29.714017  9583 catalog_manager.cc:1383] Generated new cluster ID: db4a8a3173ab4ef78e0e7c1e122744a8
I20260709 13:02:29.714305  9583 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:02:29.737526  9583 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:02:29.738826  9583 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:02:29.750825  9583 catalog_manager.cc:6070] T 00000000000000000000000000000000 P d18cf9dec3e9461db3450496bcf43a60: Generated new TSK 0
I20260709 13:02:29.751422  9583 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:02:29.773283   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:29.779343  9594 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:29.780555  9595 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:29.783428  9597 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:29.783490   431 server_base.cc:1061] running on GCE node
I20260709 13:02:29.784878   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:29.785087   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:29.785279   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602149785259 us; error 0 us; skew 500 ppm
I20260709 13:02:29.785840   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:29.788103   431 webserver.cc:533] Webserver started at http://127.0.107.193:37349/ using document root <none> and password file <none>
I20260709 13:02:29.788719   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:29.788913   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:29.789206   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:29.790251   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601869227091-431-0/minicluster-data/ts-0-root/instance:
uuid: "cf0ed7d88d88410788769a36241f22d9"
format_stamp: "Formatted at 2026-07-09 13:02:29 on dist-test-slave-5mzn"
I20260709 13:02:29.794696   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:02:29.797992  9602 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:29.798692   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:02:29.798983   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601869227091-431-0/minicluster-data/ts-0-root
uuid: "cf0ed7d88d88410788769a36241f22d9"
format_stamp: "Formatted at 2026-07-09 13:02:29 on dist-test-slave-5mzn"
I20260709 13:02:29.799254   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601869227091-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601869227091-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601869227091-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:29.810506   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:29.811673   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:29.813158   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:29.815338   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:29.815553   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:29.815819   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:29.816016   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:29.854791   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:40823
I20260709 13:02:29.854878  9664 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:40823 every 8 connection(s)
I20260709 13:02:29.860018   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:29.866938  9669 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:29.868134  9670 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:29.871219  9665 heartbeater.cc:344] Connected to a master server at 127.0.107.254:41909
W20260709 13:02:29.871055  9672 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:29.871754   431 server_base.cc:1061] running on GCE node
I20260709 13:02:29.871837  9665 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:29.873145  9665 heartbeater.cc:507] Master 127.0.107.254:41909 requested a full tablet report, sending...
I20260709 13:02:29.873589   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:29.873883   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:29.874090   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602149874071 us; error 0 us; skew 500 ppm
I20260709 13:02:29.874858   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:29.875419  9538 ts_manager.cc:194] Registered new tserver with Master: cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823)
I20260709 13:02:29.877373   431 webserver.cc:533] Webserver started at http://127.0.107.194:41609/ using document root <none> and password file <none>
I20260709 13:02:29.877714  9538 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56318
I20260709 13:02:29.877910   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:29.878230   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:29.878505   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:29.879957   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601869227091-431-0/minicluster-data/ts-1-root/instance:
uuid: "255b950088324813bcbbe4002928fba9"
format_stamp: "Formatted at 2026-07-09 13:02:29 on dist-test-slave-5mzn"
I20260709 13:02:29.884310   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 13:02:29.887377  9677 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:29.888154   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:02:29.888446   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601869227091-431-0/minicluster-data/ts-1-root
uuid: "255b950088324813bcbbe4002928fba9"
format_stamp: "Formatted at 2026-07-09 13:02:29 on dist-test-slave-5mzn"
I20260709 13:02:29.888840   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601869227091-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601869227091-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601869227091-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:29.901921   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:29.903088   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:29.904424   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:29.906617   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:29.906818   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:29.907083   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:29.907219   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:29.947163   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:34793
I20260709 13:02:29.947268  9739 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:34793 every 8 connection(s)
I20260709 13:02:29.951910   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:29.958650  9743 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:29.959300  9744 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:29.962641  9746 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:29.962774   431 server_base.cc:1061] running on GCE node
I20260709 13:02:29.963578  9740 heartbeater.cc:344] Connected to a master server at 127.0.107.254:41909
I20260709 13:02:29.964059  9740 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:29.964227   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:29.964543   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:29.964754   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602149964734 us; error 0 us; skew 500 ppm
I20260709 13:02:29.964978  9740 heartbeater.cc:507] Master 127.0.107.254:41909 requested a full tablet report, sending...
I20260709 13:02:29.965562   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:29.967279  9538 ts_manager.cc:194] Registered new tserver with Master: 255b950088324813bcbbe4002928fba9 (127.0.107.194:34793)
I20260709 13:02:29.968716   431 webserver.cc:533] Webserver started at http://127.0.107.195:44679/ using document root <none> and password file <none>
I20260709 13:02:29.969014  9538 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56324
I20260709 13:02:29.969242   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:29.969558   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:29.969856   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:29.971431   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601869227091-431-0/minicluster-data/ts-2-root/instance:
uuid: "d495138f573f468abff8f34967cdfbf6"
format_stamp: "Formatted at 2026-07-09 13:02:29 on dist-test-slave-5mzn"
I20260709 13:02:29.975991   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 13:02:30.015395  9752 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:30.017123   431 fs_manager.cc:730] Time spent opening block manager: real 0.039s	user 0.004s	sys 0.000s
I20260709 13:02:30.017539   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601869227091-431-0/minicluster-data/ts-2-root
uuid: "d495138f573f468abff8f34967cdfbf6"
format_stamp: "Formatted at 2026-07-09 13:02:29 on dist-test-slave-5mzn"
I20260709 13:02:30.018076   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601869227091-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601869227091-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601869227091-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:30.033628   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:30.035138   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:30.036900   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:30.039702   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:30.039929   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:30.040349   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:30.040592   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:30.084964   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:44885
I20260709 13:02:30.085090  9814 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:44885 every 8 connection(s)
I20260709 13:02:30.104777  9815 heartbeater.cc:344] Connected to a master server at 127.0.107.254:41909
I20260709 13:02:30.105268  9815 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:30.106418  9815 heartbeater.cc:507] Master 127.0.107.254:41909 requested a full tablet report, sending...
I20260709 13:02:30.109203  9538 ts_manager.cc:194] Registered new tserver with Master: d495138f573f468abff8f34967cdfbf6 (127.0.107.195:44885)
I20260709 13:02:30.109612   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.020378059s
I20260709 13:02:30.111243  9538 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56330
I20260709 13:02:30.138589  9538 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56336:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:02:30.141857  9538 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:02:30.228790  9705 tablet_service.cc:1511] Processing CreateTablet for tablet 6ac83262048e44a28858e8a0e18ac678 (DEFAULT_TABLE table=test-workload [id=c1306fa12cd94b7083ae2976893cc2a8]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:02:30.231221  9705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ac83262048e44a28858e8a0e18ac678. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:30.239768  9704 tablet_service.cc:1511] Processing CreateTablet for tablet 62c912553c2b40ffac89862b3bd40ee7 (DEFAULT_TABLE table=test-workload [id=c1306fa12cd94b7083ae2976893cc2a8]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:02:30.253593  9704 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62c912553c2b40ffac89862b3bd40ee7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:30.253646  9699 tablet_service.cc:1511] Processing CreateTablet for tablet d3af616bce154a0290e2dfda0b625ec3 (DEFAULT_TABLE table=test-workload [id=c1306fa12cd94b7083ae2976893cc2a8]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:02:30.243512  9701 tablet_service.cc:1511] Processing CreateTablet for tablet 6a8d453497c74035b98b1c401e674c74 (DEFAULT_TABLE table=test-workload [id=c1306fa12cd94b7083ae2976893cc2a8]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:02:30.243883  9702 tablet_service.cc:1511] Processing CreateTablet for tablet 5c3b998087e5451cba6d53a1cc6c9477 (DEFAULT_TABLE table=test-workload [id=c1306fa12cd94b7083ae2976893cc2a8]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:02:30.245543  9700 tablet_service.cc:1511] Processing CreateTablet for tablet bfc104a251f842409dcd0830c3371344 (DEFAULT_TABLE table=test-workload [id=c1306fa12cd94b7083ae2976893cc2a8]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:02:30.245712  9780 tablet_service.cc:1511] Processing CreateTablet for tablet 6ac83262048e44a28858e8a0e18ac678 (DEFAULT_TABLE table=test-workload [id=c1306fa12cd94b7083ae2976893cc2a8]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:02:30.257117  9699 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3af616bce154a0290e2dfda0b625ec3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:30.258841  9774 tablet_service.cc:1511] Processing CreateTablet for tablet d3af616bce154a0290e2dfda0b625ec3 (DEFAULT_TABLE table=test-workload [id=c1306fa12cd94b7083ae2976893cc2a8]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:02:30.260569  9629 tablet_service.cc:1511] Processing CreateTablet for tablet 62c912553c2b40ffac89862b3bd40ee7 (DEFAULT_TABLE table=test-workload [id=c1306fa12cd94b7083ae2976893cc2a8]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:02:30.262455  9629 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62c912553c2b40ffac89862b3bd40ee7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:30.258930  9630 tablet_service.cc:1511] Processing CreateTablet for tablet 6ac83262048e44a28858e8a0e18ac678 (DEFAULT_TABLE table=test-workload [id=c1306fa12cd94b7083ae2976893cc2a8]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:02:30.265522  9630 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ac83262048e44a28858e8a0e18ac678. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:30.265314  9773 tablet_service.cc:1511] Processing CreateTablet for tablet a6cc719078d04018b6cb81bbc000528a (DEFAULT_TABLE table=test-workload [id=c1306fa12cd94b7083ae2976893cc2a8]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:02:30.265879  9627 tablet_service.cc:1511] Processing CreateTablet for tablet 5c3b998087e5451cba6d53a1cc6c9477 (DEFAULT_TABLE table=test-workload [id=c1306fa12cd94b7083ae2976893cc2a8]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:02:30.267361  9627 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c3b998087e5451cba6d53a1cc6c9477. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:30.267771  9626 tablet_service.cc:1511] Processing CreateTablet for tablet 6a8d453497c74035b98b1c401e674c74 (DEFAULT_TABLE table=test-workload [id=c1306fa12cd94b7083ae2976893cc2a8]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:02:30.269213  9626 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a8d453497c74035b98b1c401e674c74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:30.269280  9701 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a8d453497c74035b98b1c401e674c74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:30.272707  9698 tablet_service.cc:1511] Processing CreateTablet for tablet a6cc719078d04018b6cb81bbc000528a (DEFAULT_TABLE table=test-workload [id=c1306fa12cd94b7083ae2976893cc2a8]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:02:30.273270  9700 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfc104a251f842409dcd0830c3371344. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:30.274353  9698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6cc719078d04018b6cb81bbc000528a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:30.275046  9702 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c3b998087e5451cba6d53a1cc6c9477. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:30.247583  9779 tablet_service.cc:1511] Processing CreateTablet for tablet 62c912553c2b40ffac89862b3bd40ee7 (DEFAULT_TABLE table=test-workload [id=c1306fa12cd94b7083ae2976893cc2a8]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:02:30.249536  9778 tablet_service.cc:1511] Processing CreateTablet for tablet e7cfaa23415d4a69a5cf998bcdb1c83d (DEFAULT_TABLE table=test-workload [id=c1306fa12cd94b7083ae2976893cc2a8]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:02:30.250146  9775 tablet_service.cc:1511] Processing CreateTablet for tablet bfc104a251f842409dcd0830c3371344 (DEFAULT_TABLE table=test-workload [id=c1306fa12cd94b7083ae2976893cc2a8]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:02:30.251439  9777 tablet_service.cc:1511] Processing CreateTablet for tablet 5c3b998087e5451cba6d53a1cc6c9477 (DEFAULT_TABLE table=test-workload [id=c1306fa12cd94b7083ae2976893cc2a8]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:02:30.253362  9776 tablet_service.cc:1511] Processing CreateTablet for tablet 6a8d453497c74035b98b1c401e674c74 (DEFAULT_TABLE table=test-workload [id=c1306fa12cd94b7083ae2976893cc2a8]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:02:30.264309  9628 tablet_service.cc:1511] Processing CreateTablet for tablet e7cfaa23415d4a69a5cf998bcdb1c83d (DEFAULT_TABLE table=test-workload [id=c1306fa12cd94b7083ae2976893cc2a8]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:02:30.241844  9703 tablet_service.cc:1511] Processing CreateTablet for tablet e7cfaa23415d4a69a5cf998bcdb1c83d (DEFAULT_TABLE table=test-workload [id=c1306fa12cd94b7083ae2976893cc2a8]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:02:30.278425  9703 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7cfaa23415d4a69a5cf998bcdb1c83d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:30.278587  9780 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ac83262048e44a28858e8a0e18ac678. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:30.279628  9777 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c3b998087e5451cba6d53a1cc6c9477. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:30.281965  9779 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 62c912553c2b40ffac89862b3bd40ee7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:30.283172  9773 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6cc719078d04018b6cb81bbc000528a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:30.284413  9775 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfc104a251f842409dcd0830c3371344. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:30.285145  9776 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a8d453497c74035b98b1c401e674c74. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:30.277856  9628 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7cfaa23415d4a69a5cf998bcdb1c83d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:30.287124  9778 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7cfaa23415d4a69a5cf998bcdb1c83d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:30.290428  9774 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3af616bce154a0290e2dfda0b625ec3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:30.292557  9625 tablet_service.cc:1511] Processing CreateTablet for tablet bfc104a251f842409dcd0830c3371344 (DEFAULT_TABLE table=test-workload [id=c1306fa12cd94b7083ae2976893cc2a8]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:02:30.294256  9625 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfc104a251f842409dcd0830c3371344. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:30.294065  9621 tablet_service.cc:1511] Processing CreateTablet for tablet 26555692bc3f487e99e16d30ec822d38 (DEFAULT_TABLE table=test-workload [id=c1306fa12cd94b7083ae2976893cc2a8]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:02:30.295507  9621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26555692bc3f487e99e16d30ec822d38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:30.292560  9624 tablet_service.cc:1511] Processing CreateTablet for tablet d3af616bce154a0290e2dfda0b625ec3 (DEFAULT_TABLE table=test-workload [id=c1306fa12cd94b7083ae2976893cc2a8]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:02:30.301314  9622 tablet_service.cc:1511] Processing CreateTablet for tablet 02a8e72dc52e4f99a1acd4fd1b481bc4 (DEFAULT_TABLE table=test-workload [id=c1306fa12cd94b7083ae2976893cc2a8]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:02:30.302865  9622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02a8e72dc52e4f99a1acd4fd1b481bc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:30.299933  9623 tablet_service.cc:1511] Processing CreateTablet for tablet a6cc719078d04018b6cb81bbc000528a (DEFAULT_TABLE table=test-workload [id=c1306fa12cd94b7083ae2976893cc2a8]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:02:30.309749  9623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6cc719078d04018b6cb81bbc000528a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:30.315644  9697 tablet_service.cc:1511] Processing CreateTablet for tablet 02a8e72dc52e4f99a1acd4fd1b481bc4 (DEFAULT_TABLE table=test-workload [id=c1306fa12cd94b7083ae2976893cc2a8]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:02:30.318607  9697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02a8e72dc52e4f99a1acd4fd1b481bc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:30.328140  9772 tablet_service.cc:1511] Processing CreateTablet for tablet 02a8e72dc52e4f99a1acd4fd1b481bc4 (DEFAULT_TABLE table=test-workload [id=c1306fa12cd94b7083ae2976893cc2a8]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:02:30.328989  9624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3af616bce154a0290e2dfda0b625ec3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:30.329866  9772 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02a8e72dc52e4f99a1acd4fd1b481bc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:30.365531  9830 tablet_bootstrap.cc:492] T 6ac83262048e44a28858e8a0e18ac678 P 255b950088324813bcbbe4002928fba9: Bootstrap starting.
I20260709 13:02:30.382465  9705 tablet_service.cc:1511] Processing CreateTablet for tablet 26555692bc3f487e99e16d30ec822d38 (DEFAULT_TABLE table=test-workload [id=c1306fa12cd94b7083ae2976893cc2a8]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:02:30.383869  9705 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26555692bc3f487e99e16d30ec822d38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:30.391166  9771 tablet_service.cc:1511] Processing CreateTablet for tablet 26555692bc3f487e99e16d30ec822d38 (DEFAULT_TABLE table=test-workload [id=c1306fa12cd94b7083ae2976893cc2a8]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:02:30.392921  9771 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 26555692bc3f487e99e16d30ec822d38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:30.401870  9831 tablet_bootstrap.cc:492] T a6cc719078d04018b6cb81bbc000528a P d495138f573f468abff8f34967cdfbf6: Bootstrap starting.
I20260709 13:02:30.442755  9830 tablet_bootstrap.cc:654] T 6ac83262048e44a28858e8a0e18ac678 P 255b950088324813bcbbe4002928fba9: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:30.450734  9832 tablet_bootstrap.cc:492] T d3af616bce154a0290e2dfda0b625ec3 P cf0ed7d88d88410788769a36241f22d9: Bootstrap starting.
I20260709 13:02:30.460063  9831 tablet_bootstrap.cc:654] T a6cc719078d04018b6cb81bbc000528a P d495138f573f468abff8f34967cdfbf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:30.525275  9830 tablet_bootstrap.cc:492] T 6ac83262048e44a28858e8a0e18ac678 P 255b950088324813bcbbe4002928fba9: No bootstrap required, opened a new log
W20260709 13:02:30.525936  9525 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.107.195:44885, user_credentials={real_user=slave}} blocked reactor thread for 69028.6us
I20260709 13:02:30.529982  9830 ts_tablet_manager.cc:1403] T 6ac83262048e44a28858e8a0e18ac678 P 255b950088324813bcbbe4002928fba9: Time spent bootstrapping tablet: real 0.165s	user 0.015s	sys 0.029s
I20260709 13:02:30.534499  9830 raft_consensus.cc:359] T 6ac83262048e44a28858e8a0e18ac678 P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } } peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } }
I20260709 13:02:30.535602  9830 raft_consensus.cc:385] T 6ac83262048e44a28858e8a0e18ac678 P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:30.535984  9830 raft_consensus.cc:740] T 6ac83262048e44a28858e8a0e18ac678 P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 255b950088324813bcbbe4002928fba9, State: Initialized, Role: FOLLOWER
I20260709 13:02:30.537170  9830 consensus_queue.cc:260] T 6ac83262048e44a28858e8a0e18ac678 P 255b950088324813bcbbe4002928fba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } } peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } }
I20260709 13:02:30.544586  9832 tablet_bootstrap.cc:654] T d3af616bce154a0290e2dfda0b625ec3 P cf0ed7d88d88410788769a36241f22d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:30.546479  9831 tablet_bootstrap.cc:492] T a6cc719078d04018b6cb81bbc000528a P d495138f573f468abff8f34967cdfbf6: No bootstrap required, opened a new log
I20260709 13:02:30.547113  9831 ts_tablet_manager.cc:1403] T a6cc719078d04018b6cb81bbc000528a P d495138f573f468abff8f34967cdfbf6: Time spent bootstrapping tablet: real 0.146s	user 0.012s	sys 0.010s
I20260709 13:02:30.551002  9831 raft_consensus.cc:359] T a6cc719078d04018b6cb81bbc000528a P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:30.555964  9831 raft_consensus.cc:385] T a6cc719078d04018b6cb81bbc000528a P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:30.556367  9831 raft_consensus.cc:740] T a6cc719078d04018b6cb81bbc000528a P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d495138f573f468abff8f34967cdfbf6, State: Initialized, Role: FOLLOWER
W20260709 13:02:30.552991  9523 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.0.107.193:40823, user_credentials={real_user=slave}} blocked reactor thread for 94916.8us
I20260709 13:02:30.554637  9830 ts_tablet_manager.cc:1434] T 6ac83262048e44a28858e8a0e18ac678 P 255b950088324813bcbbe4002928fba9: Time spent starting tablet: real 0.024s	user 0.010s	sys 0.003s
I20260709 13:02:30.555402  9740 heartbeater.cc:499] Master 127.0.107.254:41909 was elected leader, sending a full tablet report...
I20260709 13:02:30.563330  9830 tablet_bootstrap.cc:492] T 6a8d453497c74035b98b1c401e674c74 P 255b950088324813bcbbe4002928fba9: Bootstrap starting.
I20260709 13:02:30.557376  9831 consensus_queue.cc:260] T a6cc719078d04018b6cb81bbc000528a P d495138f573f468abff8f34967cdfbf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:30.570235  9830 tablet_bootstrap.cc:654] T 6a8d453497c74035b98b1c401e674c74 P 255b950088324813bcbbe4002928fba9: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:30.577112  9815 heartbeater.cc:499] Master 127.0.107.254:41909 was elected leader, sending a full tablet report...
I20260709 13:02:30.578293  9831 ts_tablet_manager.cc:1434] T a6cc719078d04018b6cb81bbc000528a P d495138f573f468abff8f34967cdfbf6: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.002s
I20260709 13:02:30.579398  9831 tablet_bootstrap.cc:492] T 6a8d453497c74035b98b1c401e674c74 P d495138f573f468abff8f34967cdfbf6: Bootstrap starting.
I20260709 13:02:30.582402  9832 tablet_bootstrap.cc:492] T d3af616bce154a0290e2dfda0b625ec3 P cf0ed7d88d88410788769a36241f22d9: No bootstrap required, opened a new log
I20260709 13:02:30.583055  9832 ts_tablet_manager.cc:1403] T d3af616bce154a0290e2dfda0b625ec3 P cf0ed7d88d88410788769a36241f22d9: Time spent bootstrapping tablet: real 0.133s	user 0.025s	sys 0.025s
I20260709 13:02:30.586215  9831 tablet_bootstrap.cc:654] T 6a8d453497c74035b98b1c401e674c74 P d495138f573f468abff8f34967cdfbf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:30.586349  9832 raft_consensus.cc:359] T d3af616bce154a0290e2dfda0b625ec3 P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:30.587222  9832 raft_consensus.cc:385] T d3af616bce154a0290e2dfda0b625ec3 P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:30.587594  9832 raft_consensus.cc:740] T d3af616bce154a0290e2dfda0b625ec3 P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf0ed7d88d88410788769a36241f22d9, State: Initialized, Role: FOLLOWER
I20260709 13:02:30.588560  9832 consensus_queue.cc:260] T d3af616bce154a0290e2dfda0b625ec3 P cf0ed7d88d88410788769a36241f22d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
W20260709 13:02:30.590339  9816 tablet.cc:2406] T a6cc719078d04018b6cb81bbc000528a P d495138f573f468abff8f34967cdfbf6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:02:30.599191  9832 ts_tablet_manager.cc:1434] T d3af616bce154a0290e2dfda0b625ec3 P cf0ed7d88d88410788769a36241f22d9: Time spent starting tablet: real 0.016s	user 0.011s	sys 0.003s
I20260709 13:02:30.599953  9665 heartbeater.cc:499] Master 127.0.107.254:41909 was elected leader, sending a full tablet report...
I20260709 13:02:30.600371  9832 tablet_bootstrap.cc:492] T 6ac83262048e44a28858e8a0e18ac678 P cf0ed7d88d88410788769a36241f22d9: Bootstrap starting.
I20260709 13:02:30.601866  9831 tablet_bootstrap.cc:492] T 6a8d453497c74035b98b1c401e674c74 P d495138f573f468abff8f34967cdfbf6: No bootstrap required, opened a new log
I20260709 13:02:30.602401  9831 ts_tablet_manager.cc:1403] T 6a8d453497c74035b98b1c401e674c74 P d495138f573f468abff8f34967cdfbf6: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.009s
I20260709 13:02:30.605906  9831 raft_consensus.cc:359] T 6a8d453497c74035b98b1c401e674c74 P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:30.606722  9831 raft_consensus.cc:385] T 6a8d453497c74035b98b1c401e674c74 P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:30.607057  9831 raft_consensus.cc:740] T 6a8d453497c74035b98b1c401e674c74 P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d495138f573f468abff8f34967cdfbf6, State: Initialized, Role: FOLLOWER
I20260709 13:02:30.607473  9830 tablet_bootstrap.cc:492] T 6a8d453497c74035b98b1c401e674c74 P 255b950088324813bcbbe4002928fba9: No bootstrap required, opened a new log
I20260709 13:02:30.608076  9830 ts_tablet_manager.cc:1403] T 6a8d453497c74035b98b1c401e674c74 P 255b950088324813bcbbe4002928fba9: Time spent bootstrapping tablet: real 0.045s	user 0.022s	sys 0.011s
I20260709 13:02:30.607860  9831 consensus_queue.cc:260] T 6a8d453497c74035b98b1c401e674c74 P d495138f573f468abff8f34967cdfbf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:30.609740  9832 tablet_bootstrap.cc:654] T 6ac83262048e44a28858e8a0e18ac678 P cf0ed7d88d88410788769a36241f22d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:30.611316  9831 ts_tablet_manager.cc:1434] T 6a8d453497c74035b98b1c401e674c74 P d495138f573f468abff8f34967cdfbf6: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:02:30.612007  9830 raft_consensus.cc:359] T 6a8d453497c74035b98b1c401e674c74 P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:30.612443  9831 tablet_bootstrap.cc:492] T bfc104a251f842409dcd0830c3371344 P d495138f573f468abff8f34967cdfbf6: Bootstrap starting.
I20260709 13:02:30.613029  9830 raft_consensus.cc:385] T 6a8d453497c74035b98b1c401e674c74 P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:30.613536  9830 raft_consensus.cc:740] T 6a8d453497c74035b98b1c401e674c74 P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 255b950088324813bcbbe4002928fba9, State: Initialized, Role: FOLLOWER
I20260709 13:02:30.614431  9830 consensus_queue.cc:260] T 6a8d453497c74035b98b1c401e674c74 P 255b950088324813bcbbe4002928fba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:30.616634  9830 ts_tablet_manager.cc:1434] T 6a8d453497c74035b98b1c401e674c74 P 255b950088324813bcbbe4002928fba9: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:02:30.617601  9830 tablet_bootstrap.cc:492] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P 255b950088324813bcbbe4002928fba9: Bootstrap starting.
I20260709 13:02:30.622507  9831 tablet_bootstrap.cc:654] T bfc104a251f842409dcd0830c3371344 P d495138f573f468abff8f34967cdfbf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:30.625195  9830 tablet_bootstrap.cc:654] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P 255b950088324813bcbbe4002928fba9: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:30.629146  9832 tablet_bootstrap.cc:492] T 6ac83262048e44a28858e8a0e18ac678 P cf0ed7d88d88410788769a36241f22d9: No bootstrap required, opened a new log
I20260709 13:02:30.631039  9832 ts_tablet_manager.cc:1403] T 6ac83262048e44a28858e8a0e18ac678 P cf0ed7d88d88410788769a36241f22d9: Time spent bootstrapping tablet: real 0.031s	user 0.019s	sys 0.007s
I20260709 13:02:30.631431  9831 tablet_bootstrap.cc:492] T bfc104a251f842409dcd0830c3371344 P d495138f573f468abff8f34967cdfbf6: No bootstrap required, opened a new log
I20260709 13:02:30.632001  9831 ts_tablet_manager.cc:1403] T bfc104a251f842409dcd0830c3371344 P d495138f573f468abff8f34967cdfbf6: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.004s
I20260709 13:02:30.634156  9832 raft_consensus.cc:359] T 6ac83262048e44a28858e8a0e18ac678 P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } } peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } }
I20260709 13:02:30.635048  9832 raft_consensus.cc:385] T 6ac83262048e44a28858e8a0e18ac678 P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:30.635413  9832 raft_consensus.cc:740] T 6ac83262048e44a28858e8a0e18ac678 P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf0ed7d88d88410788769a36241f22d9, State: Initialized, Role: FOLLOWER
I20260709 13:02:30.635136  9831 raft_consensus.cc:359] T bfc104a251f842409dcd0830c3371344 P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:30.635967  9831 raft_consensus.cc:385] T bfc104a251f842409dcd0830c3371344 P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:30.636351  9831 raft_consensus.cc:740] T bfc104a251f842409dcd0830c3371344 P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d495138f573f468abff8f34967cdfbf6, State: Initialized, Role: FOLLOWER
I20260709 13:02:30.636509  9832 consensus_queue.cc:260] T 6ac83262048e44a28858e8a0e18ac678 P cf0ed7d88d88410788769a36241f22d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } } peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } }
I20260709 13:02:30.637218  9831 consensus_queue.cc:260] T bfc104a251f842409dcd0830c3371344 P d495138f573f468abff8f34967cdfbf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:30.638983  9832 ts_tablet_manager.cc:1434] T 6ac83262048e44a28858e8a0e18ac678 P cf0ed7d88d88410788769a36241f22d9: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:02:30.635964  9830 tablet_bootstrap.cc:492] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P 255b950088324813bcbbe4002928fba9: No bootstrap required, opened a new log
I20260709 13:02:30.640022  9832 tablet_bootstrap.cc:492] T e7cfaa23415d4a69a5cf998bcdb1c83d P cf0ed7d88d88410788769a36241f22d9: Bootstrap starting.
I20260709 13:02:30.640034  9830 ts_tablet_manager.cc:1403] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P 255b950088324813bcbbe4002928fba9: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.000s
I20260709 13:02:30.643561  9831 ts_tablet_manager.cc:1434] T bfc104a251f842409dcd0830c3371344 P d495138f573f468abff8f34967cdfbf6: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 13:02:30.643991  9830 raft_consensus.cc:359] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:30.644783  9831 tablet_bootstrap.cc:492] T 62c912553c2b40ffac89862b3bd40ee7 P d495138f573f468abff8f34967cdfbf6: Bootstrap starting.
I20260709 13:02:30.644805  9830 raft_consensus.cc:385] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:30.647037  9830 raft_consensus.cc:740] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 255b950088324813bcbbe4002928fba9, State: Initialized, Role: FOLLOWER
I20260709 13:02:30.647871  9830 consensus_queue.cc:260] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P 255b950088324813bcbbe4002928fba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:30.650260  9830 ts_tablet_manager.cc:1434] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P 255b950088324813bcbbe4002928fba9: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260709 13:02:30.651371  9830 tablet_bootstrap.cc:492] T 62c912553c2b40ffac89862b3bd40ee7 P 255b950088324813bcbbe4002928fba9: Bootstrap starting.
I20260709 13:02:30.651873  9831 tablet_bootstrap.cc:654] T 62c912553c2b40ffac89862b3bd40ee7 P d495138f573f468abff8f34967cdfbf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:30.651873  9832 tablet_bootstrap.cc:654] T e7cfaa23415d4a69a5cf998bcdb1c83d P cf0ed7d88d88410788769a36241f22d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:30.658509  9830 tablet_bootstrap.cc:654] T 62c912553c2b40ffac89862b3bd40ee7 P 255b950088324813bcbbe4002928fba9: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:30.676843  9830 tablet_bootstrap.cc:492] T 62c912553c2b40ffac89862b3bd40ee7 P 255b950088324813bcbbe4002928fba9: No bootstrap required, opened a new log
I20260709 13:02:30.676944  9832 tablet_bootstrap.cc:492] T e7cfaa23415d4a69a5cf998bcdb1c83d P cf0ed7d88d88410788769a36241f22d9: No bootstrap required, opened a new log
I20260709 13:02:30.677388  9830 ts_tablet_manager.cc:1403] T 62c912553c2b40ffac89862b3bd40ee7 P 255b950088324813bcbbe4002928fba9: Time spent bootstrapping tablet: real 0.026s	user 0.021s	sys 0.003s
I20260709 13:02:30.677429  9831 tablet_bootstrap.cc:492] T 62c912553c2b40ffac89862b3bd40ee7 P d495138f573f468abff8f34967cdfbf6: No bootstrap required, opened a new log
I20260709 13:02:30.677573  9832 ts_tablet_manager.cc:1403] T e7cfaa23415d4a69a5cf998bcdb1c83d P cf0ed7d88d88410788769a36241f22d9: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.012s
I20260709 13:02:30.678090  9831 ts_tablet_manager.cc:1403] T 62c912553c2b40ffac89862b3bd40ee7 P d495138f573f468abff8f34967cdfbf6: Time spent bootstrapping tablet: real 0.034s	user 0.016s	sys 0.015s
I20260709 13:02:30.679997  9830 raft_consensus.cc:359] T 62c912553c2b40ffac89862b3bd40ee7 P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:30.680682  9830 raft_consensus.cc:385] T 62c912553c2b40ffac89862b3bd40ee7 P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:30.680934  9830 raft_consensus.cc:740] T 62c912553c2b40ffac89862b3bd40ee7 P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 255b950088324813bcbbe4002928fba9, State: Initialized, Role: FOLLOWER
I20260709 13:02:30.680859  9832 raft_consensus.cc:359] T e7cfaa23415d4a69a5cf998bcdb1c83d P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:30.681072  9831 raft_consensus.cc:359] T 62c912553c2b40ffac89862b3bd40ee7 P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:30.681810  9832 raft_consensus.cc:385] T e7cfaa23415d4a69a5cf998bcdb1c83d P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:30.681922  9831 raft_consensus.cc:385] T 62c912553c2b40ffac89862b3bd40ee7 P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:30.682173  9832 raft_consensus.cc:740] T e7cfaa23415d4a69a5cf998bcdb1c83d P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf0ed7d88d88410788769a36241f22d9, State: Initialized, Role: FOLLOWER
I20260709 13:02:30.682277  9831 raft_consensus.cc:740] T 62c912553c2b40ffac89862b3bd40ee7 P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d495138f573f468abff8f34967cdfbf6, State: Initialized, Role: FOLLOWER
I20260709 13:02:30.682243  9830 consensus_queue.cc:260] T 62c912553c2b40ffac89862b3bd40ee7 P 255b950088324813bcbbe4002928fba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:30.683179  9832 consensus_queue.cc:260] T e7cfaa23415d4a69a5cf998bcdb1c83d P cf0ed7d88d88410788769a36241f22d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:30.683350  9831 consensus_queue.cc:260] T 62c912553c2b40ffac89862b3bd40ee7 P d495138f573f468abff8f34967cdfbf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:30.684931  9830 ts_tablet_manager.cc:1434] T 62c912553c2b40ffac89862b3bd40ee7 P 255b950088324813bcbbe4002928fba9: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:02:30.685616  9832 ts_tablet_manager.cc:1434] T e7cfaa23415d4a69a5cf998bcdb1c83d P cf0ed7d88d88410788769a36241f22d9: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:02:30.686007  9830 tablet_bootstrap.cc:492] T d3af616bce154a0290e2dfda0b625ec3 P 255b950088324813bcbbe4002928fba9: Bootstrap starting.
I20260709 13:02:30.686681  9832 tablet_bootstrap.cc:492] T 5c3b998087e5451cba6d53a1cc6c9477 P cf0ed7d88d88410788769a36241f22d9: Bootstrap starting.
I20260709 13:02:30.689759  9831 ts_tablet_manager.cc:1434] T 62c912553c2b40ffac89862b3bd40ee7 P d495138f573f468abff8f34967cdfbf6: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 13:02:30.691094  9831 tablet_bootstrap.cc:492] T d3af616bce154a0290e2dfda0b625ec3 P d495138f573f468abff8f34967cdfbf6: Bootstrap starting.
I20260709 13:02:30.693864  9830 tablet_bootstrap.cc:654] T d3af616bce154a0290e2dfda0b625ec3 P 255b950088324813bcbbe4002928fba9: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:30.694109  9832 tablet_bootstrap.cc:654] T 5c3b998087e5451cba6d53a1cc6c9477 P cf0ed7d88d88410788769a36241f22d9: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:30.701856  9586 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:30.701049  9831 tablet_bootstrap.cc:654] T d3af616bce154a0290e2dfda0b625ec3 P d495138f573f468abff8f34967cdfbf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:30.706847  9832 tablet_bootstrap.cc:492] T 5c3b998087e5451cba6d53a1cc6c9477 P cf0ed7d88d88410788769a36241f22d9: No bootstrap required, opened a new log
I20260709 13:02:30.707379  9832 ts_tablet_manager.cc:1403] T 5c3b998087e5451cba6d53a1cc6c9477 P cf0ed7d88d88410788769a36241f22d9: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.001s
I20260709 13:02:30.710556  9832 raft_consensus.cc:359] T 5c3b998087e5451cba6d53a1cc6c9477 P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:30.711354  9832 raft_consensus.cc:385] T 5c3b998087e5451cba6d53a1cc6c9477 P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:30.711680  9832 raft_consensus.cc:740] T 5c3b998087e5451cba6d53a1cc6c9477 P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf0ed7d88d88410788769a36241f22d9, State: Initialized, Role: FOLLOWER
I20260709 13:02:30.712471  9832 consensus_queue.cc:260] T 5c3b998087e5451cba6d53a1cc6c9477 P cf0ed7d88d88410788769a36241f22d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:30.714905  9832 ts_tablet_manager.cc:1434] T 5c3b998087e5451cba6d53a1cc6c9477 P cf0ed7d88d88410788769a36241f22d9: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:02:30.715969  9832 tablet_bootstrap.cc:492] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P cf0ed7d88d88410788769a36241f22d9: Bootstrap starting.
I20260709 13:02:30.718289  9830 tablet_bootstrap.cc:492] T d3af616bce154a0290e2dfda0b625ec3 P 255b950088324813bcbbe4002928fba9: No bootstrap required, opened a new log
I20260709 13:02:30.718863  9830 ts_tablet_manager.cc:1403] T d3af616bce154a0290e2dfda0b625ec3 P 255b950088324813bcbbe4002928fba9: Time spent bootstrapping tablet: real 0.033s	user 0.018s	sys 0.001s
I20260709 13:02:30.722810  9832 tablet_bootstrap.cc:654] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P cf0ed7d88d88410788769a36241f22d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:30.722484  9830 raft_consensus.cc:359] T d3af616bce154a0290e2dfda0b625ec3 P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:30.723896  9830 raft_consensus.cc:385] T d3af616bce154a0290e2dfda0b625ec3 P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:30.724314  9830 raft_consensus.cc:740] T d3af616bce154a0290e2dfda0b625ec3 P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 255b950088324813bcbbe4002928fba9, State: Initialized, Role: FOLLOWER
I20260709 13:02:30.725309  9830 consensus_queue.cc:260] T d3af616bce154a0290e2dfda0b625ec3 P 255b950088324813bcbbe4002928fba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:30.727628  9834 raft_consensus.cc:493] T 6a8d453497c74035b98b1c401e674c74 P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.728365  9834 raft_consensus.cc:515] T 6a8d453497c74035b98b1c401e674c74 P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:30.734773  9837 raft_consensus.cc:493] T a6cc719078d04018b6cb81bbc000528a P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.735656  9831 tablet_bootstrap.cc:492] T d3af616bce154a0290e2dfda0b625ec3 P d495138f573f468abff8f34967cdfbf6: No bootstrap required, opened a new log
I20260709 13:02:30.735605  9837 raft_consensus.cc:515] T a6cc719078d04018b6cb81bbc000528a P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:30.736258  9831 ts_tablet_manager.cc:1403] T d3af616bce154a0290e2dfda0b625ec3 P d495138f573f468abff8f34967cdfbf6: Time spent bootstrapping tablet: real 0.045s	user 0.012s	sys 0.015s
I20260709 13:02:30.737744  9834 leader_election.cc:290] T 6a8d453497c74035b98b1c401e674c74 P 255b950088324813bcbbe4002928fba9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823), d495138f573f468abff8f34967cdfbf6 (127.0.107.195:44885)
I20260709 13:02:30.738620  9832 tablet_bootstrap.cc:492] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P cf0ed7d88d88410788769a36241f22d9: No bootstrap required, opened a new log
I20260709 13:02:30.741145  9832 ts_tablet_manager.cc:1403] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P cf0ed7d88d88410788769a36241f22d9: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.005s
I20260709 13:02:30.740821  9831 raft_consensus.cc:359] T d3af616bce154a0290e2dfda0b625ec3 P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:30.741643  9831 raft_consensus.cc:385] T d3af616bce154a0290e2dfda0b625ec3 P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:30.741994  9831 raft_consensus.cc:740] T d3af616bce154a0290e2dfda0b625ec3 P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d495138f573f468abff8f34967cdfbf6, State: Initialized, Role: FOLLOWER
I20260709 13:02:30.742998  9831 consensus_queue.cc:260] T d3af616bce154a0290e2dfda0b625ec3 P d495138f573f468abff8f34967cdfbf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:30.743875  9830 ts_tablet_manager.cc:1434] T d3af616bce154a0290e2dfda0b625ec3 P 255b950088324813bcbbe4002928fba9: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 13:02:30.745972  9830 tablet_bootstrap.cc:492] T bfc104a251f842409dcd0830c3371344 P 255b950088324813bcbbe4002928fba9: Bootstrap starting.
I20260709 13:02:30.751708  9837 leader_election.cc:290] T a6cc719078d04018b6cb81bbc000528a P d495138f573f468abff8f34967cdfbf6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823), 255b950088324813bcbbe4002928fba9 (127.0.107.194:34793)
I20260709 13:02:30.755036  9832 raft_consensus.cc:359] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:30.756234  9832 raft_consensus.cc:385] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:30.756719  9832 raft_consensus.cc:740] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf0ed7d88d88410788769a36241f22d9, State: Initialized, Role: FOLLOWER
I20260709 13:02:30.757316  9830 tablet_bootstrap.cc:654] T bfc104a251f842409dcd0830c3371344 P 255b950088324813bcbbe4002928fba9: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:30.757742  9832 consensus_queue.cc:260] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P cf0ed7d88d88410788769a36241f22d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:30.761087  9832 ts_tablet_manager.cc:1434] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P cf0ed7d88d88410788769a36241f22d9: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 13:02:30.761245  9855 raft_consensus.cc:493] T 6a8d453497c74035b98b1c401e674c74 P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.761801  9855 raft_consensus.cc:515] T 6a8d453497c74035b98b1c401e674c74 P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:30.762645  9832 tablet_bootstrap.cc:492] T 62c912553c2b40ffac89862b3bd40ee7 P cf0ed7d88d88410788769a36241f22d9: Bootstrap starting.
I20260709 13:02:30.763934  9855 leader_election.cc:290] T 6a8d453497c74035b98b1c401e674c74 P d495138f573f468abff8f34967cdfbf6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823), 255b950088324813bcbbe4002928fba9 (127.0.107.194:34793)
I20260709 13:02:30.766911  9831 ts_tablet_manager.cc:1434] T d3af616bce154a0290e2dfda0b625ec3 P d495138f573f468abff8f34967cdfbf6: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.010s
I20260709 13:02:30.768172  9831 tablet_bootstrap.cc:492] T 6ac83262048e44a28858e8a0e18ac678 P d495138f573f468abff8f34967cdfbf6: Bootstrap starting.
I20260709 13:02:30.770634  9832 tablet_bootstrap.cc:654] T 62c912553c2b40ffac89862b3bd40ee7 P cf0ed7d88d88410788769a36241f22d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:30.773838  9790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a8d453497c74035b98b1c401e674c74" candidate_uuid: "255b950088324813bcbbe4002928fba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d495138f573f468abff8f34967cdfbf6" is_pre_election: true
I20260709 13:02:30.774984  9790 raft_consensus.cc:2468] T 6a8d453497c74035b98b1c401e674c74 P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 255b950088324813bcbbe4002928fba9 in term 0.
I20260709 13:02:30.776903  9681 leader_election.cc:304] T 6a8d453497c74035b98b1c401e674c74 P 255b950088324813bcbbe4002928fba9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 255b950088324813bcbbe4002928fba9, d495138f573f468abff8f34967cdfbf6; no voters: 
I20260709 13:02:30.779477  9834 raft_consensus.cc:2804] T 6a8d453497c74035b98b1c401e674c74 P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:30.779985  9834 raft_consensus.cc:493] T 6a8d453497c74035b98b1c401e674c74 P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.780323  9834 raft_consensus.cc:3060] T 6a8d453497c74035b98b1c401e674c74 P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:30.785033  9831 tablet_bootstrap.cc:654] T 6ac83262048e44a28858e8a0e18ac678 P d495138f573f468abff8f34967cdfbf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:30.783133  9832 tablet_bootstrap.cc:492] T 62c912553c2b40ffac89862b3bd40ee7 P cf0ed7d88d88410788769a36241f22d9: No bootstrap required, opened a new log
I20260709 13:02:30.785912  9832 ts_tablet_manager.cc:1403] T 62c912553c2b40ffac89862b3bd40ee7 P cf0ed7d88d88410788769a36241f22d9: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.005s
I20260709 13:02:30.789696  9834 raft_consensus.cc:515] T 6a8d453497c74035b98b1c401e674c74 P 255b950088324813bcbbe4002928fba9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:30.790035  9832 raft_consensus.cc:359] T 62c912553c2b40ffac89862b3bd40ee7 P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:30.791225  9832 raft_consensus.cc:385] T 62c912553c2b40ffac89862b3bd40ee7 P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:30.791687  9832 raft_consensus.cc:740] T 62c912553c2b40ffac89862b3bd40ee7 P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf0ed7d88d88410788769a36241f22d9, State: Initialized, Role: FOLLOWER
I20260709 13:02:30.792294  9855 raft_consensus.cc:493] T 62c912553c2b40ffac89862b3bd40ee7 P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.792829  9855 raft_consensus.cc:515] T 62c912553c2b40ffac89862b3bd40ee7 P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:30.793061  9834 leader_election.cc:290] T 6a8d453497c74035b98b1c401e674c74 P 255b950088324813bcbbe4002928fba9 [CANDIDATE]: Term 1 election: Requested vote from peers cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823), d495138f573f468abff8f34967cdfbf6 (127.0.107.195:44885)
I20260709 13:02:30.792980  9790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a8d453497c74035b98b1c401e674c74" candidate_uuid: "255b950088324813bcbbe4002928fba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d495138f573f468abff8f34967cdfbf6"
I20260709 13:02:30.794106  9790 raft_consensus.cc:3060] T 6a8d453497c74035b98b1c401e674c74 P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:30.804139  9640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6cc719078d04018b6cb81bbc000528a" candidate_uuid: "d495138f573f468abff8f34967cdfbf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf0ed7d88d88410788769a36241f22d9" is_pre_election: true
I20260709 13:02:30.792964  9832 consensus_queue.cc:260] T 62c912553c2b40ffac89862b3bd40ee7 P cf0ed7d88d88410788769a36241f22d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:30.806921  9640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a8d453497c74035b98b1c401e674c74" candidate_uuid: "d495138f573f468abff8f34967cdfbf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf0ed7d88d88410788769a36241f22d9" is_pre_election: true
I20260709 13:02:30.810791  9855 leader_election.cc:290] T 62c912553c2b40ffac89862b3bd40ee7 P d495138f573f468abff8f34967cdfbf6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823), 255b950088324813bcbbe4002928fba9 (127.0.107.194:34793)
I20260709 13:02:30.811575  9832 ts_tablet_manager.cc:1434] T 62c912553c2b40ffac89862b3bd40ee7 P cf0ed7d88d88410788769a36241f22d9: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.001s
I20260709 13:02:30.812388  9715 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6cc719078d04018b6cb81bbc000528a" candidate_uuid: "d495138f573f468abff8f34967cdfbf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "255b950088324813bcbbe4002928fba9" is_pre_election: true
I20260709 13:02:30.813519  9790 raft_consensus.cc:2468] T 6a8d453497c74035b98b1c401e674c74 P d495138f573f468abff8f34967cdfbf6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 255b950088324813bcbbe4002928fba9 in term 1.
I20260709 13:02:30.814689  9714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a8d453497c74035b98b1c401e674c74" candidate_uuid: "d495138f573f468abff8f34967cdfbf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "255b950088324813bcbbe4002928fba9" is_pre_election: true
I20260709 13:02:30.815941  9714 raft_consensus.cc:2393] T 6a8d453497c74035b98b1c401e674c74 P 255b950088324813bcbbe4002928fba9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d495138f573f468abff8f34967cdfbf6 in current term 1: Already voted for candidate 255b950088324813bcbbe4002928fba9 in this term.
I20260709 13:02:30.816035  9681 leader_election.cc:304] T 6a8d453497c74035b98b1c401e674c74 P 255b950088324813bcbbe4002928fba9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 255b950088324813bcbbe4002928fba9, d495138f573f468abff8f34967cdfbf6; no voters: 
I20260709 13:02:30.817274  9713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c912553c2b40ffac89862b3bd40ee7" candidate_uuid: "d495138f573f468abff8f34967cdfbf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "255b950088324813bcbbe4002928fba9" is_pre_election: true
I20260709 13:02:30.817634  9834 raft_consensus.cc:2804] T 6a8d453497c74035b98b1c401e674c74 P 255b950088324813bcbbe4002928fba9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:30.818243  9713 raft_consensus.cc:2468] T 62c912553c2b40ffac89862b3bd40ee7 P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d495138f573f468abff8f34967cdfbf6 in term 0.
I20260709 13:02:30.820278  9834 raft_consensus.cc:697] T 6a8d453497c74035b98b1c401e674c74 P 255b950088324813bcbbe4002928fba9 [term 1 LEADER]: Becoming Leader. State: Replica: 255b950088324813bcbbe4002928fba9, State: Running, Role: LEADER
I20260709 13:02:30.821736  9834 consensus_queue.cc:237] T 6a8d453497c74035b98b1c401e674c74 P 255b950088324813bcbbe4002928fba9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:30.814721  9832 tablet_bootstrap.cc:492] T a6cc719078d04018b6cb81bbc000528a P cf0ed7d88d88410788769a36241f22d9: Bootstrap starting.
I20260709 13:02:30.826160  9640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c912553c2b40ffac89862b3bd40ee7" candidate_uuid: "d495138f573f468abff8f34967cdfbf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf0ed7d88d88410788769a36241f22d9" is_pre_election: true
W20260709 13:02:30.820374  9756 leader_election.cc:343] T a6cc719078d04018b6cb81bbc000528a P d495138f573f468abff8f34967cdfbf6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 255b950088324813bcbbe4002928fba9 (127.0.107.194:34793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:30.827466  9756 leader_election.cc:304] T 62c912553c2b40ffac89862b3bd40ee7 P d495138f573f468abff8f34967cdfbf6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 255b950088324813bcbbe4002928fba9, d495138f573f468abff8f34967cdfbf6; no voters: 
I20260709 13:02:30.829248  9640 raft_consensus.cc:2468] T 62c912553c2b40ffac89862b3bd40ee7 P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d495138f573f468abff8f34967cdfbf6 in term 0.
I20260709 13:02:30.830693  9837 raft_consensus.cc:2804] T 62c912553c2b40ffac89862b3bd40ee7 P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:30.831278  9837 raft_consensus.cc:493] T 62c912553c2b40ffac89862b3bd40ee7 P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.831732  9837 raft_consensus.cc:3060] T 62c912553c2b40ffac89862b3bd40ee7 P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:30.840754  9855 raft_consensus.cc:493] T d3af616bce154a0290e2dfda0b625ec3 P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.841612  9855 raft_consensus.cc:515] T d3af616bce154a0290e2dfda0b625ec3 P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:30.843350  9832 tablet_bootstrap.cc:654] T a6cc719078d04018b6cb81bbc000528a P cf0ed7d88d88410788769a36241f22d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:30.845454  9714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3af616bce154a0290e2dfda0b625ec3" candidate_uuid: "d495138f573f468abff8f34967cdfbf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "255b950088324813bcbbe4002928fba9" is_pre_election: true
I20260709 13:02:30.846438  9714 raft_consensus.cc:2468] T d3af616bce154a0290e2dfda0b625ec3 P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d495138f573f468abff8f34967cdfbf6 in term 0.
I20260709 13:02:30.848196  9756 leader_election.cc:304] T d3af616bce154a0290e2dfda0b625ec3 P d495138f573f468abff8f34967cdfbf6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 255b950088324813bcbbe4002928fba9, d495138f573f468abff8f34967cdfbf6; no voters: 
I20260709 13:02:30.871582  9837 raft_consensus.cc:515] T 62c912553c2b40ffac89862b3bd40ee7 P d495138f573f468abff8f34967cdfbf6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:30.872112  9830 tablet_bootstrap.cc:492] T bfc104a251f842409dcd0830c3371344 P 255b950088324813bcbbe4002928fba9: No bootstrap required, opened a new log
I20260709 13:02:30.872749  9830 ts_tablet_manager.cc:1403] T bfc104a251f842409dcd0830c3371344 P 255b950088324813bcbbe4002928fba9: Time spent bootstrapping tablet: real 0.127s	user 0.030s	sys 0.047s
W20260709 13:02:30.853307  9754 leader_election.cc:343] T a6cc719078d04018b6cb81bbc000528a P d495138f573f468abff8f34967cdfbf6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:30.875810  9754 leader_election.cc:304] T a6cc719078d04018b6cb81bbc000528a P d495138f573f468abff8f34967cdfbf6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d495138f573f468abff8f34967cdfbf6; no voters: 255b950088324813bcbbe4002928fba9, cf0ed7d88d88410788769a36241f22d9
I20260709 13:02:30.876243  9830 raft_consensus.cc:359] T bfc104a251f842409dcd0830c3371344 P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:30.877182  9830 raft_consensus.cc:385] T bfc104a251f842409dcd0830c3371344 P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:30.877485  9830 raft_consensus.cc:740] T bfc104a251f842409dcd0830c3371344 P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 255b950088324813bcbbe4002928fba9, State: Initialized, Role: FOLLOWER
I20260709 13:02:30.878726  9855 leader_election.cc:290] T d3af616bce154a0290e2dfda0b625ec3 P d495138f573f468abff8f34967cdfbf6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823), 255b950088324813bcbbe4002928fba9 (127.0.107.194:34793)
I20260709 13:02:30.879292  9855 raft_consensus.cc:2804] T d3af616bce154a0290e2dfda0b625ec3 P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:30.879622  9855 raft_consensus.cc:493] T d3af616bce154a0290e2dfda0b625ec3 P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.879949  9855 raft_consensus.cc:3060] T d3af616bce154a0290e2dfda0b625ec3 P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:30.881531  9863 raft_consensus.cc:2749] T a6cc719078d04018b6cb81bbc000528a P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:02:30.884039  9754 leader_election.cc:343] T 6a8d453497c74035b98b1c401e674c74 P d495138f573f468abff8f34967cdfbf6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:30.878391  9830 consensus_queue.cc:260] T bfc104a251f842409dcd0830c3371344 P 255b950088324813bcbbe4002928fba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:30.886804  9830 ts_tablet_manager.cc:1434] T bfc104a251f842409dcd0830c3371344 P 255b950088324813bcbbe4002928fba9: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:02:30.886965  9640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a8d453497c74035b98b1c401e674c74" candidate_uuid: "255b950088324813bcbbe4002928fba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf0ed7d88d88410788769a36241f22d9" is_pre_election: true
I20260709 13:02:30.887301  9714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c912553c2b40ffac89862b3bd40ee7" candidate_uuid: "d495138f573f468abff8f34967cdfbf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "255b950088324813bcbbe4002928fba9"
I20260709 13:02:30.887835  9830 tablet_bootstrap.cc:492] T 5c3b998087e5451cba6d53a1cc6c9477 P 255b950088324813bcbbe4002928fba9: Bootstrap starting.
I20260709 13:02:30.887919  9714 raft_consensus.cc:3060] T 62c912553c2b40ffac89862b3bd40ee7 P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:30.888902  9639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a8d453497c74035b98b1c401e674c74" candidate_uuid: "255b950088324813bcbbe4002928fba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf0ed7d88d88410788769a36241f22d9"
W20260709 13:02:30.891369  9679 leader_election.cc:343] T 6a8d453497c74035b98b1c401e674c74 P 255b950088324813bcbbe4002928fba9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:02:30.892683  9679 leader_election.cc:343] T 6a8d453497c74035b98b1c401e674c74 P 255b950088324813bcbbe4002928fba9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:30.894109  9840 raft_consensus.cc:493] T e7cfaa23415d4a69a5cf998bcdb1c83d P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.894641  9840 raft_consensus.cc:515] T e7cfaa23415d4a69a5cf998bcdb1c83d P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:30.895354  9830 tablet_bootstrap.cc:654] T 5c3b998087e5451cba6d53a1cc6c9477 P 255b950088324813bcbbe4002928fba9: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:30.897550  9840 leader_election.cc:290] T e7cfaa23415d4a69a5cf998bcdb1c83d P cf0ed7d88d88410788769a36241f22d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 255b950088324813bcbbe4002928fba9 (127.0.107.194:34793), d495138f573f468abff8f34967cdfbf6 (127.0.107.195:44885)
I20260709 13:02:30.900715  9840 raft_consensus.cc:493] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.901798  9840 raft_consensus.cc:515] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:30.902209  9855 raft_consensus.cc:515] T d3af616bce154a0290e2dfda0b625ec3 P d495138f573f468abff8f34967cdfbf6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:30.904846  9855 leader_election.cc:290] T d3af616bce154a0290e2dfda0b625ec3 P d495138f573f468abff8f34967cdfbf6 [CANDIDATE]: Term 1 election: Requested vote from peers cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823), 255b950088324813bcbbe4002928fba9 (127.0.107.194:34793)
I20260709 13:02:30.906258  9713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3af616bce154a0290e2dfda0b625ec3" candidate_uuid: "d495138f573f468abff8f34967cdfbf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "255b950088324813bcbbe4002928fba9"
I20260709 13:02:30.907122  9713 raft_consensus.cc:3060] T d3af616bce154a0290e2dfda0b625ec3 P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:30.919142  9840 leader_election.cc:290] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P cf0ed7d88d88410788769a36241f22d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 255b950088324813bcbbe4002928fba9 (127.0.107.194:34793), d495138f573f468abff8f34967cdfbf6 (127.0.107.195:44885)
I20260709 13:02:30.920912  9861 raft_consensus.cc:493] T bfc104a251f842409dcd0830c3371344 P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.921684  9861 raft_consensus.cc:515] T bfc104a251f842409dcd0830c3371344 P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:30.925220  9861 leader_election.cc:290] T bfc104a251f842409dcd0830c3371344 P 255b950088324813bcbbe4002928fba9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823), d495138f573f468abff8f34967cdfbf6 (127.0.107.195:44885)
I20260709 13:02:30.925894  9861 raft_consensus.cc:493] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.884697  9754 leader_election.cc:304] T 6a8d453497c74035b98b1c401e674c74 P d495138f573f468abff8f34967cdfbf6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d495138f573f468abff8f34967cdfbf6; no voters: 255b950088324813bcbbe4002928fba9, cf0ed7d88d88410788769a36241f22d9
I20260709 13:02:30.926446  9861 raft_consensus.cc:515] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:30.927726  9855 raft_consensus.cc:2749] T 6a8d453497c74035b98b1c401e674c74 P d495138f573f468abff8f34967cdfbf6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:02:30.927907  9754 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:40823, user_credentials={real_user=slave}} blocked reactor thread for 43937.1us
I20260709 13:02:30.929666  9861 leader_election.cc:290] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P 255b950088324813bcbbe4002928fba9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823), d495138f573f468abff8f34967cdfbf6 (127.0.107.195:44885)
I20260709 13:02:30.928582  9837 leader_election.cc:290] T 62c912553c2b40ffac89862b3bd40ee7 P d495138f573f468abff8f34967cdfbf6 [CANDIDATE]: Term 1 election: Requested vote from peers cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823), 255b950088324813bcbbe4002928fba9 (127.0.107.194:34793)
I20260709 13:02:30.934307  9790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfc104a251f842409dcd0830c3371344" candidate_uuid: "255b950088324813bcbbe4002928fba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d495138f573f468abff8f34967cdfbf6" is_pre_election: true
I20260709 13:02:30.935045  9790 raft_consensus.cc:2468] T bfc104a251f842409dcd0830c3371344 P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 255b950088324813bcbbe4002928fba9 in term 0.
I20260709 13:02:30.936370  9714 raft_consensus.cc:2468] T 62c912553c2b40ffac89862b3bd40ee7 P 255b950088324813bcbbe4002928fba9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d495138f573f468abff8f34967cdfbf6 in term 1.
I20260709 13:02:30.937160  9789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a8e72dc52e4f99a1acd4fd1b481bc4" candidate_uuid: "255b950088324813bcbbe4002928fba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d495138f573f468abff8f34967cdfbf6" is_pre_election: true
I20260709 13:02:30.937647  9834 raft_consensus.cc:493] T 6ac83262048e44a28858e8a0e18ac678 P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:30.942829  9639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3af616bce154a0290e2dfda0b625ec3" candidate_uuid: "d495138f573f468abff8f34967cdfbf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf0ed7d88d88410788769a36241f22d9" is_pre_election: true
I20260709 13:02:30.953518  9834 raft_consensus.cc:515] T 6ac83262048e44a28858e8a0e18ac678 P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } } peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } }
I20260709 13:02:30.953761  9639 raft_consensus.cc:2468] T d3af616bce154a0290e2dfda0b625ec3 P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d495138f573f468abff8f34967cdfbf6 in term 0.
I20260709 13:02:30.955821  9834 leader_election.cc:290] T 6ac83262048e44a28858e8a0e18ac678 P 255b950088324813bcbbe4002928fba9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d495138f573f468abff8f34967cdfbf6 (127.0.107.195:44885), cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823)
I20260709 13:02:30.955781  9756 leader_election.cc:304] T 62c912553c2b40ffac89862b3bd40ee7 P d495138f573f468abff8f34967cdfbf6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 255b950088324813bcbbe4002928fba9, d495138f573f468abff8f34967cdfbf6; no voters: 
I20260709 13:02:30.946533  9681 leader_election.cc:304] T bfc104a251f842409dcd0830c3371344 P 255b950088324813bcbbe4002928fba9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 255b950088324813bcbbe4002928fba9, d495138f573f468abff8f34967cdfbf6; no voters: 
I20260709 13:02:30.949790  9640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "62c912553c2b40ffac89862b3bd40ee7" candidate_uuid: "d495138f573f468abff8f34967cdfbf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf0ed7d88d88410788769a36241f22d9"
I20260709 13:02:30.957734  9640 raft_consensus.cc:3060] T 62c912553c2b40ffac89862b3bd40ee7 P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:30.932042  9713 raft_consensus.cc:2468] T d3af616bce154a0290e2dfda0b625ec3 P 255b950088324813bcbbe4002928fba9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d495138f573f468abff8f34967cdfbf6 in term 1.
I20260709 13:02:30.949800  9832 tablet_bootstrap.cc:492] T a6cc719078d04018b6cb81bbc000528a P cf0ed7d88d88410788769a36241f22d9: No bootstrap required, opened a new log
I20260709 13:02:30.949863  9831 tablet_bootstrap.cc:492] T 6ac83262048e44a28858e8a0e18ac678 P d495138f573f468abff8f34967cdfbf6: No bootstrap required, opened a new log
I20260709 13:02:30.951692  9536 catalog_manager.cc:5697] T 6a8d453497c74035b98b1c401e674c74 P 255b950088324813bcbbe4002928fba9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 255b950088324813bcbbe4002928fba9 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "255b950088324813bcbbe4002928fba9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:30.965065  9832 ts_tablet_manager.cc:1403] T a6cc719078d04018b6cb81bbc000528a P cf0ed7d88d88410788769a36241f22d9: Time spent bootstrapping tablet: real 0.151s	user 0.007s	sys 0.037s
I20260709 13:02:30.968596  9789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac83262048e44a28858e8a0e18ac678" candidate_uuid: "255b950088324813bcbbe4002928fba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d495138f573f468abff8f34967cdfbf6" is_pre_election: true
I20260709 13:02:30.964429  9834 raft_consensus.cc:2804] T bfc104a251f842409dcd0830c3371344 P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:30.970243  9834 raft_consensus.cc:493] T bfc104a251f842409dcd0830c3371344 P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.970741  9834 raft_consensus.cc:3060] T bfc104a251f842409dcd0830c3371344 P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:30.970139  9832 raft_consensus.cc:359] T a6cc719078d04018b6cb81bbc000528a P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:30.971194  9832 raft_consensus.cc:385] T a6cc719078d04018b6cb81bbc000528a P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:30.971508  9832 raft_consensus.cc:740] T a6cc719078d04018b6cb81bbc000528a P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf0ed7d88d88410788769a36241f22d9, State: Initialized, Role: FOLLOWER
I20260709 13:02:30.972289  9832 consensus_queue.cc:260] T a6cc719078d04018b6cb81bbc000528a P cf0ed7d88d88410788769a36241f22d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:30.972645  9637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac83262048e44a28858e8a0e18ac678" candidate_uuid: "255b950088324813bcbbe4002928fba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf0ed7d88d88410788769a36241f22d9" is_pre_election: true
I20260709 13:02:30.973380  9637 raft_consensus.cc:2468] T 6ac83262048e44a28858e8a0e18ac678 P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 255b950088324813bcbbe4002928fba9 in term 0.
I20260709 13:02:30.974226  9638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a8e72dc52e4f99a1acd4fd1b481bc4" candidate_uuid: "255b950088324813bcbbe4002928fba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf0ed7d88d88410788769a36241f22d9" is_pre_election: true
I20260709 13:02:30.974962  9638 raft_consensus.cc:2468] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 255b950088324813bcbbe4002928fba9 in term 0.
I20260709 13:02:30.976167  9639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfc104a251f842409dcd0830c3371344" candidate_uuid: "255b950088324813bcbbe4002928fba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf0ed7d88d88410788769a36241f22d9" is_pre_election: true
I20260709 13:02:30.977417  9638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3af616bce154a0290e2dfda0b625ec3" candidate_uuid: "d495138f573f468abff8f34967cdfbf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf0ed7d88d88410788769a36241f22d9"
I20260709 13:02:30.977723  9679 leader_election.cc:304] T 6ac83262048e44a28858e8a0e18ac678 P 255b950088324813bcbbe4002928fba9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 255b950088324813bcbbe4002928fba9, cf0ed7d88d88410788769a36241f22d9; no voters: 
I20260709 13:02:30.978039  9638 raft_consensus.cc:3060] T d3af616bce154a0290e2dfda0b625ec3 P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:30.978746  9679 leader_election.cc:304] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P 255b950088324813bcbbe4002928fba9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 255b950088324813bcbbe4002928fba9, cf0ed7d88d88410788769a36241f22d9; no voters: 
W20260709 13:02:30.979660  9679 leader_election.cc:343] T bfc104a251f842409dcd0830c3371344 P 255b950088324813bcbbe4002928fba9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:30.980610  9861 raft_consensus.cc:2804] T 6ac83262048e44a28858e8a0e18ac678 P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:30.981036  9861 raft_consensus.cc:493] T 6ac83262048e44a28858e8a0e18ac678 P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.981367  9861 raft_consensus.cc:3060] T 6ac83262048e44a28858e8a0e18ac678 P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:30.988539  9869 raft_consensus.cc:2804] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:30.989099  9869 raft_consensus.cc:493] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:30.989436  9869 raft_consensus.cc:3060] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:30.992882  9681 leader_election.cc:343] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P 255b950088324813bcbbe4002928fba9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d495138f573f468abff8f34967cdfbf6 (127.0.107.195:44885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:30.997691  9756 leader_election.cc:304] T d3af616bce154a0290e2dfda0b625ec3 P d495138f573f468abff8f34967cdfbf6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 255b950088324813bcbbe4002928fba9, d495138f573f468abff8f34967cdfbf6; no voters: 
I20260709 13:02:30.998584  9855 raft_consensus.cc:2804] T d3af616bce154a0290e2dfda0b625ec3 P d495138f573f468abff8f34967cdfbf6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:30.999111  9855 raft_consensus.cc:697] T d3af616bce154a0290e2dfda0b625ec3 P d495138f573f468abff8f34967cdfbf6 [term 1 LEADER]: Becoming Leader. State: Replica: d495138f573f468abff8f34967cdfbf6, State: Running, Role: LEADER
I20260709 13:02:30.999948  9855 consensus_queue.cc:237] T d3af616bce154a0290e2dfda0b625ec3 P d495138f573f468abff8f34967cdfbf6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:31.000828  9640 raft_consensus.cc:2468] T 62c912553c2b40ffac89862b3bd40ee7 P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d495138f573f468abff8f34967cdfbf6 in term 1.
I20260709 13:02:31.002823  9869 raft_consensus.cc:515] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P 255b950088324813bcbbe4002928fba9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:30.967474  9831 ts_tablet_manager.cc:1403] T 6ac83262048e44a28858e8a0e18ac678 P d495138f573f468abff8f34967cdfbf6: Time spent bootstrapping tablet: real 0.200s	user 0.079s	sys 0.062s
I20260709 13:02:30.966667  9837 raft_consensus.cc:2804] T 62c912553c2b40ffac89862b3bd40ee7 P d495138f573f468abff8f34967cdfbf6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:31.007447  9713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cfaa23415d4a69a5cf998bcdb1c83d" candidate_uuid: "cf0ed7d88d88410788769a36241f22d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "255b950088324813bcbbe4002928fba9" is_pre_election: true
I20260709 13:02:31.007865  9834 raft_consensus.cc:515] T bfc104a251f842409dcd0830c3371344 P 255b950088324813bcbbe4002928fba9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:31.008021  9714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a8e72dc52e4f99a1acd4fd1b481bc4" candidate_uuid: "cf0ed7d88d88410788769a36241f22d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "255b950088324813bcbbe4002928fba9" is_pre_election: true
W20260709 13:02:31.003719  9681 leader_election.cc:343] T 6ac83262048e44a28858e8a0e18ac678 P 255b950088324813bcbbe4002928fba9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d495138f573f468abff8f34967cdfbf6 (127.0.107.195:44885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:31.010967  9714 raft_consensus.cc:2393] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P 255b950088324813bcbbe4002928fba9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf0ed7d88d88410788769a36241f22d9 in current term 1: Already voted for candidate 255b950088324813bcbbe4002928fba9 in this term.
I20260709 13:02:31.011148  9638 raft_consensus.cc:2468] T d3af616bce154a0290e2dfda0b625ec3 P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d495138f573f468abff8f34967cdfbf6 in term 1.
W20260709 13:02:31.012305  9606 leader_election.cc:343] T e7cfaa23415d4a69a5cf998bcdb1c83d P cf0ed7d88d88410788769a36241f22d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 255b950088324813bcbbe4002928fba9 (127.0.107.194:34793): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:31.010303  9837 raft_consensus.cc:697] T 62c912553c2b40ffac89862b3bd40ee7 P d495138f573f468abff8f34967cdfbf6 [term 1 LEADER]: Becoming Leader. State: Replica: d495138f573f468abff8f34967cdfbf6, State: Running, Role: LEADER
I20260709 13:02:31.013062  9832 ts_tablet_manager.cc:1434] T a6cc719078d04018b6cb81bbc000528a P cf0ed7d88d88410788769a36241f22d9: Time spent starting tablet: real 0.047s	user 0.008s	sys 0.000s
I20260709 13:02:31.012784  9861 raft_consensus.cc:515] T 6ac83262048e44a28858e8a0e18ac678 P 255b950088324813bcbbe4002928fba9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } } peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } }
I20260709 13:02:31.013808  9837 consensus_queue.cc:237] T 62c912553c2b40ffac89862b3bd40ee7 P d495138f573f468abff8f34967cdfbf6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:31.014268  9832 tablet_bootstrap.cc:492] T 6a8d453497c74035b98b1c401e674c74 P cf0ed7d88d88410788769a36241f22d9: Bootstrap starting.
I20260709 13:02:31.019881  9789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cfaa23415d4a69a5cf998bcdb1c83d" candidate_uuid: "cf0ed7d88d88410788769a36241f22d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d495138f573f468abff8f34967cdfbf6" is_pre_election: true
I20260709 13:02:31.021253  9790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac83262048e44a28858e8a0e18ac678" candidate_uuid: "255b950088324813bcbbe4002928fba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d495138f573f468abff8f34967cdfbf6"
W20260709 13:02:31.024281  9681 leader_election.cc:343] T 6ac83262048e44a28858e8a0e18ac678 P 255b950088324813bcbbe4002928fba9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d495138f573f468abff8f34967cdfbf6 (127.0.107.195:44885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:31.017216  9861 leader_election.cc:290] T 6ac83262048e44a28858e8a0e18ac678 P 255b950088324813bcbbe4002928fba9 [CANDIDATE]: Term 1 election: Requested vote from peers d495138f573f468abff8f34967cdfbf6 (127.0.107.195:44885), cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823)
W20260709 13:02:31.032358  9606 leader_election.cc:343] T e7cfaa23415d4a69a5cf998bcdb1c83d P cf0ed7d88d88410788769a36241f22d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d495138f573f468abff8f34967cdfbf6 (127.0.107.195:44885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:31.032419  9640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfc104a251f842409dcd0830c3371344" candidate_uuid: "255b950088324813bcbbe4002928fba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf0ed7d88d88410788769a36241f22d9"
I20260709 13:02:31.033207  9606 leader_election.cc:304] T e7cfaa23415d4a69a5cf998bcdb1c83d P cf0ed7d88d88410788769a36241f22d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf0ed7d88d88410788769a36241f22d9; no voters: 255b950088324813bcbbe4002928fba9, d495138f573f468abff8f34967cdfbf6
I20260709 13:02:31.032940  9790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a8e72dc52e4f99a1acd4fd1b481bc4" candidate_uuid: "cf0ed7d88d88410788769a36241f22d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d495138f573f468abff8f34967cdfbf6" is_pre_election: true
I20260709 13:02:31.034401  9840 raft_consensus.cc:2749] T e7cfaa23415d4a69a5cf998bcdb1c83d P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:31.035971  9830 tablet_bootstrap.cc:492] T 5c3b998087e5451cba6d53a1cc6c9477 P 255b950088324813bcbbe4002928fba9: No bootstrap required, opened a new log
I20260709 13:02:31.036674  9830 ts_tablet_manager.cc:1403] T 5c3b998087e5451cba6d53a1cc6c9477 P 255b950088324813bcbbe4002928fba9: Time spent bootstrapping tablet: real 0.149s	user 0.035s	sys 0.068s
W20260709 13:02:31.036921  9606 leader_election.cc:343] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P cf0ed7d88d88410788769a36241f22d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d495138f573f468abff8f34967cdfbf6 (127.0.107.195:44885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:31.037405  9606 leader_election.cc:304] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P cf0ed7d88d88410788769a36241f22d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf0ed7d88d88410788769a36241f22d9; no voters: 255b950088324813bcbbe4002928fba9, d495138f573f468abff8f34967cdfbf6
I20260709 13:02:31.024663  9831 raft_consensus.cc:359] T 6ac83262048e44a28858e8a0e18ac678 P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } } peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } }
I20260709 13:02:31.038440  9831 raft_consensus.cc:385] T 6ac83262048e44a28858e8a0e18ac678 P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:02:31.038648  9679 leader_election.cc:343] T bfc104a251f842409dcd0830c3371344 P 255b950088324813bcbbe4002928fba9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:31.038805  9831 raft_consensus.cc:740] T 6ac83262048e44a28858e8a0e18ac678 P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d495138f573f468abff8f34967cdfbf6, State: Initialized, Role: FOLLOWER
I20260709 13:02:31.039588  9790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfc104a251f842409dcd0830c3371344" candidate_uuid: "255b950088324813bcbbe4002928fba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d495138f573f468abff8f34967cdfbf6"
I20260709 13:02:31.039883  9831 consensus_queue.cc:260] T 6ac83262048e44a28858e8a0e18ac678 P d495138f573f468abff8f34967cdfbf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } } peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } }
I20260709 13:02:31.040315  9790 raft_consensus.cc:3060] T bfc104a251f842409dcd0830c3371344 P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:31.042542  9831 ts_tablet_manager.cc:1434] T 6ac83262048e44a28858e8a0e18ac678 P d495138f573f468abff8f34967cdfbf6: Time spent starting tablet: real 0.034s	user 0.002s	sys 0.005s
I20260709 13:02:31.046160  9834 leader_election.cc:290] T bfc104a251f842409dcd0830c3371344 P 255b950088324813bcbbe4002928fba9 [CANDIDATE]: Term 1 election: Requested vote from peers cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823), d495138f573f468abff8f34967cdfbf6 (127.0.107.195:44885)
I20260709 13:02:31.030980  9638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac83262048e44a28858e8a0e18ac678" candidate_uuid: "255b950088324813bcbbe4002928fba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf0ed7d88d88410788769a36241f22d9"
I20260709 13:02:31.039429  9789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a8e72dc52e4f99a1acd4fd1b481bc4" candidate_uuid: "255b950088324813bcbbe4002928fba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d495138f573f468abff8f34967cdfbf6"
I20260709 13:02:31.047704  9638 raft_consensus.cc:3060] T 6ac83262048e44a28858e8a0e18ac678 P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:31.045303  9830 raft_consensus.cc:359] T 5c3b998087e5451cba6d53a1cc6c9477 P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:31.040244  9869 leader_election.cc:290] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P 255b950088324813bcbbe4002928fba9 [CANDIDATE]: Term 1 election: Requested vote from peers cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823), d495138f573f468abff8f34967cdfbf6 (127.0.107.195:44885)
I20260709 13:02:31.044731  9840 raft_consensus.cc:3060] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:31.048790  9681 leader_election.cc:343] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P 255b950088324813bcbbe4002928fba9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d495138f573f468abff8f34967cdfbf6 (127.0.107.195:44885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:31.047948  9640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a8e72dc52e4f99a1acd4fd1b481bc4" candidate_uuid: "255b950088324813bcbbe4002928fba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf0ed7d88d88410788769a36241f22d9"
I20260709 13:02:31.054033  9790 raft_consensus.cc:2468] T bfc104a251f842409dcd0830c3371344 P d495138f573f468abff8f34967cdfbf6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 255b950088324813bcbbe4002928fba9 in term 1.
I20260709 13:02:31.054795  9831 tablet_bootstrap.cc:492] T 26555692bc3f487e99e16d30ec822d38 P d495138f573f468abff8f34967cdfbf6: Bootstrap starting.
I20260709 13:02:31.055389  9681 leader_election.cc:304] T bfc104a251f842409dcd0830c3371344 P 255b950088324813bcbbe4002928fba9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 255b950088324813bcbbe4002928fba9, d495138f573f468abff8f34967cdfbf6; no voters: cf0ed7d88d88410788769a36241f22d9
I20260709 13:02:31.055666  9840 raft_consensus.cc:2749] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:31.056633  9869 raft_consensus.cc:2804] T bfc104a251f842409dcd0830c3371344 P 255b950088324813bcbbe4002928fba9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:31.057492  9869 raft_consensus.cc:697] T bfc104a251f842409dcd0830c3371344 P 255b950088324813bcbbe4002928fba9 [term 1 LEADER]: Becoming Leader. State: Replica: 255b950088324813bcbbe4002928fba9, State: Running, Role: LEADER
I20260709 13:02:31.058418  9869 consensus_queue.cc:237] T bfc104a251f842409dcd0830c3371344 P 255b950088324813bcbbe4002928fba9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:31.056913  9830 raft_consensus.cc:385] T 5c3b998087e5451cba6d53a1cc6c9477 P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:31.061326  9830 raft_consensus.cc:740] T 5c3b998087e5451cba6d53a1cc6c9477 P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 255b950088324813bcbbe4002928fba9, State: Initialized, Role: FOLLOWER
I20260709 13:02:31.061815  9638 raft_consensus.cc:2468] T 6ac83262048e44a28858e8a0e18ac678 P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 255b950088324813bcbbe4002928fba9 in term 1.
I20260709 13:02:31.062331  9831 tablet_bootstrap.cc:654] T 26555692bc3f487e99e16d30ec822d38 P d495138f573f468abff8f34967cdfbf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:31.063231  9679 leader_election.cc:304] T 6ac83262048e44a28858e8a0e18ac678 P 255b950088324813bcbbe4002928fba9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 255b950088324813bcbbe4002928fba9, cf0ed7d88d88410788769a36241f22d9; no voters: d495138f573f468abff8f34967cdfbf6
I20260709 13:02:31.064553  9834 raft_consensus.cc:2804] T 6ac83262048e44a28858e8a0e18ac678 P 255b950088324813bcbbe4002928fba9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:31.064589  9640 raft_consensus.cc:2468] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 255b950088324813bcbbe4002928fba9 in term 1.
I20260709 13:02:31.065167  9834 raft_consensus.cc:697] T 6ac83262048e44a28858e8a0e18ac678 P 255b950088324813bcbbe4002928fba9 [term 1 LEADER]: Becoming Leader. State: Replica: 255b950088324813bcbbe4002928fba9, State: Running, Role: LEADER
I20260709 13:02:31.066520  9832 tablet_bootstrap.cc:654] T 6a8d453497c74035b98b1c401e674c74 P cf0ed7d88d88410788769a36241f22d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:31.066334  9834 consensus_queue.cc:237] T 6ac83262048e44a28858e8a0e18ac678 P 255b950088324813bcbbe4002928fba9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } } peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } }
I20260709 13:02:31.068964  9679 leader_election.cc:304] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P 255b950088324813bcbbe4002928fba9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 255b950088324813bcbbe4002928fba9, cf0ed7d88d88410788769a36241f22d9; no voters: d495138f573f468abff8f34967cdfbf6
I20260709 13:02:31.070010  9861 raft_consensus.cc:2804] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P 255b950088324813bcbbe4002928fba9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:31.072913  9830 consensus_queue.cc:260] T 5c3b998087e5451cba6d53a1cc6c9477 P 255b950088324813bcbbe4002928fba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:31.076380  9538 catalog_manager.cc:5697] T d3af616bce154a0290e2dfda0b625ec3 P d495138f573f468abff8f34967cdfbf6 reported cstate change: term changed from 0 to 1, leader changed from <none> to d495138f573f468abff8f34967cdfbf6 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "d495138f573f468abff8f34967cdfbf6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:31.082005  9830 ts_tablet_manager.cc:1434] T 5c3b998087e5451cba6d53a1cc6c9477 P 255b950088324813bcbbe4002928fba9: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.001s
I20260709 13:02:31.083648  9830 tablet_bootstrap.cc:492] T 26555692bc3f487e99e16d30ec822d38 P 255b950088324813bcbbe4002928fba9: Bootstrap starting.
I20260709 13:02:31.088551  9861 raft_consensus.cc:697] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P 255b950088324813bcbbe4002928fba9 [term 1 LEADER]: Becoming Leader. State: Replica: 255b950088324813bcbbe4002928fba9, State: Running, Role: LEADER
I20260709 13:02:31.089680  9861 consensus_queue.cc:237] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P 255b950088324813bcbbe4002928fba9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:31.091099  9830 tablet_bootstrap.cc:654] T 26555692bc3f487e99e16d30ec822d38 P 255b950088324813bcbbe4002928fba9: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:31.093092  9536 catalog_manager.cc:5697] T bfc104a251f842409dcd0830c3371344 P 255b950088324813bcbbe4002928fba9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 255b950088324813bcbbe4002928fba9 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "255b950088324813bcbbe4002928fba9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:31.095304  9536 catalog_manager.cc:5697] T 6ac83262048e44a28858e8a0e18ac678 P 255b950088324813bcbbe4002928fba9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 255b950088324813bcbbe4002928fba9 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "255b950088324813bcbbe4002928fba9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:31.099057  9831 tablet_bootstrap.cc:492] T 26555692bc3f487e99e16d30ec822d38 P d495138f573f468abff8f34967cdfbf6: No bootstrap required, opened a new log
I20260709 13:02:31.100051  9831 ts_tablet_manager.cc:1403] T 26555692bc3f487e99e16d30ec822d38 P d495138f573f468abff8f34967cdfbf6: Time spent bootstrapping tablet: real 0.050s	user 0.014s	sys 0.006s
I20260709 13:02:31.101191  9832 tablet_bootstrap.cc:492] T 6a8d453497c74035b98b1c401e674c74 P cf0ed7d88d88410788769a36241f22d9: No bootstrap required, opened a new log
I20260709 13:02:31.101992  9832 ts_tablet_manager.cc:1403] T 6a8d453497c74035b98b1c401e674c74 P cf0ed7d88d88410788769a36241f22d9: Time spent bootstrapping tablet: real 0.088s	user 0.008s	sys 0.014s
I20260709 13:02:31.103425  9831 raft_consensus.cc:359] T 26555692bc3f487e99e16d30ec822d38 P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:31.104285  9831 raft_consensus.cc:385] T 26555692bc3f487e99e16d30ec822d38 P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:31.104662  9831 raft_consensus.cc:740] T 26555692bc3f487e99e16d30ec822d38 P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d495138f573f468abff8f34967cdfbf6, State: Initialized, Role: FOLLOWER
I20260709 13:02:31.105636  9831 consensus_queue.cc:260] T 26555692bc3f487e99e16d30ec822d38 P d495138f573f468abff8f34967cdfbf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:31.106014  9832 raft_consensus.cc:359] T 6a8d453497c74035b98b1c401e674c74 P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:31.107118  9832 raft_consensus.cc:385] T 6a8d453497c74035b98b1c401e674c74 P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:31.107483  9832 raft_consensus.cc:740] T 6a8d453497c74035b98b1c401e674c74 P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf0ed7d88d88410788769a36241f22d9, State: Initialized, Role: FOLLOWER
I20260709 13:02:31.108691  9831 ts_tablet_manager.cc:1434] T 26555692bc3f487e99e16d30ec822d38 P d495138f573f468abff8f34967cdfbf6: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 13:02:31.108409  9832 consensus_queue.cc:260] T 6a8d453497c74035b98b1c401e674c74 P cf0ed7d88d88410788769a36241f22d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:31.110024  9831 tablet_bootstrap.cc:492] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P d495138f573f468abff8f34967cdfbf6: Bootstrap starting.
I20260709 13:02:31.112272  9538 catalog_manager.cc:5697] T 62c912553c2b40ffac89862b3bd40ee7 P d495138f573f468abff8f34967cdfbf6 reported cstate change: term changed from 0 to 1, leader changed from <none> to d495138f573f468abff8f34967cdfbf6 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "d495138f573f468abff8f34967cdfbf6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:31.130115  9831 tablet_bootstrap.cc:654] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P d495138f573f468abff8f34967cdfbf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:31.131441  9537 catalog_manager.cc:5697] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P 255b950088324813bcbbe4002928fba9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 255b950088324813bcbbe4002928fba9 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "255b950088324813bcbbe4002928fba9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:31.133208  9830 tablet_bootstrap.cc:492] T 26555692bc3f487e99e16d30ec822d38 P 255b950088324813bcbbe4002928fba9: No bootstrap required, opened a new log
I20260709 13:02:31.133757  9830 ts_tablet_manager.cc:1403] T 26555692bc3f487e99e16d30ec822d38 P 255b950088324813bcbbe4002928fba9: Time spent bootstrapping tablet: real 0.050s	user 0.012s	sys 0.004s
I20260709 13:02:31.138370  9830 raft_consensus.cc:359] T 26555692bc3f487e99e16d30ec822d38 P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:31.139061  9830 raft_consensus.cc:385] T 26555692bc3f487e99e16d30ec822d38 P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:31.139320  9830 raft_consensus.cc:740] T 26555692bc3f487e99e16d30ec822d38 P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 255b950088324813bcbbe4002928fba9, State: Initialized, Role: FOLLOWER
I20260709 13:02:31.139735  9832 ts_tablet_manager.cc:1434] T 6a8d453497c74035b98b1c401e674c74 P cf0ed7d88d88410788769a36241f22d9: Time spent starting tablet: real 0.037s	user 0.009s	sys 0.001s
I20260709 13:02:31.139986  9830 consensus_queue.cc:260] T 26555692bc3f487e99e16d30ec822d38 P 255b950088324813bcbbe4002928fba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:31.140782  9832 tablet_bootstrap.cc:492] T bfc104a251f842409dcd0830c3371344 P cf0ed7d88d88410788769a36241f22d9: Bootstrap starting.
I20260709 13:02:31.142352  9830 ts_tablet_manager.cc:1434] T 26555692bc3f487e99e16d30ec822d38 P 255b950088324813bcbbe4002928fba9: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:02:31.143290  9830 tablet_bootstrap.cc:492] T e7cfaa23415d4a69a5cf998bcdb1c83d P 255b950088324813bcbbe4002928fba9: Bootstrap starting.
I20260709 13:02:31.146512  9832 tablet_bootstrap.cc:654] T bfc104a251f842409dcd0830c3371344 P cf0ed7d88d88410788769a36241f22d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:31.149067  9830 tablet_bootstrap.cc:654] T e7cfaa23415d4a69a5cf998bcdb1c83d P 255b950088324813bcbbe4002928fba9: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:31.149684  9861 raft_consensus.cc:493] T 26555692bc3f487e99e16d30ec822d38 P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.150177  9861 raft_consensus.cc:515] T 26555692bc3f487e99e16d30ec822d38 P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:31.151870  9831 tablet_bootstrap.cc:492] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P d495138f573f468abff8f34967cdfbf6: No bootstrap required, opened a new log
I20260709 13:02:31.152273  9861 leader_election.cc:290] T 26555692bc3f487e99e16d30ec822d38 P 255b950088324813bcbbe4002928fba9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823), d495138f573f468abff8f34967cdfbf6 (127.0.107.195:44885)
I20260709 13:02:31.152432  9831 ts_tablet_manager.cc:1403] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P d495138f573f468abff8f34967cdfbf6: Time spent bootstrapping tablet: real 0.043s	user 0.013s	sys 0.004s
I20260709 13:02:31.154026  9790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26555692bc3f487e99e16d30ec822d38" candidate_uuid: "255b950088324813bcbbe4002928fba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d495138f573f468abff8f34967cdfbf6" is_pre_election: true
I20260709 13:02:31.154717  9790 raft_consensus.cc:2468] T 26555692bc3f487e99e16d30ec822d38 P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 255b950088324813bcbbe4002928fba9 in term 0.
I20260709 13:02:31.154906  9640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26555692bc3f487e99e16d30ec822d38" candidate_uuid: "255b950088324813bcbbe4002928fba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf0ed7d88d88410788769a36241f22d9" is_pre_election: true
I20260709 13:02:31.155510  9831 raft_consensus.cc:359] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:31.156002  9681 leader_election.cc:304] T 26555692bc3f487e99e16d30ec822d38 P 255b950088324813bcbbe4002928fba9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 255b950088324813bcbbe4002928fba9, d495138f573f468abff8f34967cdfbf6; no voters: 
I20260709 13:02:31.156294  9831 raft_consensus.cc:385] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:31.156769  9831 raft_consensus.cc:740] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d495138f573f468abff8f34967cdfbf6, State: Initialized, Role: FOLLOWER
W20260709 13:02:31.157021  9679 leader_election.cc:343] T 26555692bc3f487e99e16d30ec822d38 P 255b950088324813bcbbe4002928fba9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:31.157701  9831 consensus_queue.cc:260] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P d495138f573f468abff8f34967cdfbf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:31.158702  9861 raft_consensus.cc:2804] T 26555692bc3f487e99e16d30ec822d38 P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:31.159063  9837 raft_consensus.cc:493] T 6ac83262048e44a28858e8a0e18ac678 P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.159163  9861 raft_consensus.cc:493] T 26555692bc3f487e99e16d30ec822d38 P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.159662  9861 raft_consensus.cc:3060] T 26555692bc3f487e99e16d30ec822d38 P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:31.159627  9837 raft_consensus.cc:515] T 6ac83262048e44a28858e8a0e18ac678 P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } } peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } }
I20260709 13:02:31.160277  9831 ts_tablet_manager.cc:1434] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P d495138f573f468abff8f34967cdfbf6: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:02:31.160701  9830 tablet_bootstrap.cc:492] T e7cfaa23415d4a69a5cf998bcdb1c83d P 255b950088324813bcbbe4002928fba9: No bootstrap required, opened a new log
I20260709 13:02:31.161191  9830 ts_tablet_manager.cc:1403] T e7cfaa23415d4a69a5cf998bcdb1c83d P 255b950088324813bcbbe4002928fba9: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.000s
I20260709 13:02:31.161254  9831 tablet_bootstrap.cc:492] T 5c3b998087e5451cba6d53a1cc6c9477 P d495138f573f468abff8f34967cdfbf6: Bootstrap starting.
I20260709 13:02:31.164134  9830 raft_consensus.cc:359] T e7cfaa23415d4a69a5cf998bcdb1c83d P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:31.164909  9830 raft_consensus.cc:385] T e7cfaa23415d4a69a5cf998bcdb1c83d P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:31.165164  9830 raft_consensus.cc:740] T e7cfaa23415d4a69a5cf998bcdb1c83d P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 255b950088324813bcbbe4002928fba9, State: Initialized, Role: FOLLOWER
I20260709 13:02:31.165851  9640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac83262048e44a28858e8a0e18ac678" candidate_uuid: "d495138f573f468abff8f34967cdfbf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf0ed7d88d88410788769a36241f22d9" is_pre_election: true
I20260709 13:02:31.166698  9640 raft_consensus.cc:2393] T 6ac83262048e44a28858e8a0e18ac678 P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d495138f573f468abff8f34967cdfbf6 in current term 1: Already voted for candidate 255b950088324813bcbbe4002928fba9 in this term.
I20260709 13:02:31.166875  9840 raft_consensus.cc:493] T 5c3b998087e5451cba6d53a1cc6c9477 P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.167358  9840 raft_consensus.cc:515] T 5c3b998087e5451cba6d53a1cc6c9477 P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:31.167583  9861 raft_consensus.cc:515] T 26555692bc3f487e99e16d30ec822d38 P 255b950088324813bcbbe4002928fba9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:31.165838  9830 consensus_queue.cc:260] T e7cfaa23415d4a69a5cf998bcdb1c83d P 255b950088324813bcbbe4002928fba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:31.168195  9831 tablet_bootstrap.cc:654] T 5c3b998087e5451cba6d53a1cc6c9477 P d495138f573f468abff8f34967cdfbf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:31.169425  9840 leader_election.cc:290] T 5c3b998087e5451cba6d53a1cc6c9477 P cf0ed7d88d88410788769a36241f22d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 255b950088324813bcbbe4002928fba9 (127.0.107.194:34793), d495138f573f468abff8f34967cdfbf6 (127.0.107.195:44885)
I20260709 13:02:31.170753  9832 tablet_bootstrap.cc:492] T bfc104a251f842409dcd0830c3371344 P cf0ed7d88d88410788769a36241f22d9: No bootstrap required, opened a new log
I20260709 13:02:31.171253  9832 ts_tablet_manager.cc:1403] T bfc104a251f842409dcd0830c3371344 P cf0ed7d88d88410788769a36241f22d9: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.003s
I20260709 13:02:31.171761  9790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26555692bc3f487e99e16d30ec822d38" candidate_uuid: "255b950088324813bcbbe4002928fba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d495138f573f468abff8f34967cdfbf6"
I20260709 13:02:31.172356  9790 raft_consensus.cc:3060] T 26555692bc3f487e99e16d30ec822d38 P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:31.174192  9832 raft_consensus.cc:359] T bfc104a251f842409dcd0830c3371344 P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:31.174872  9832 raft_consensus.cc:385] T bfc104a251f842409dcd0830c3371344 P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:31.175119  9832 raft_consensus.cc:740] T bfc104a251f842409dcd0830c3371344 P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf0ed7d88d88410788769a36241f22d9, State: Initialized, Role: FOLLOWER
I20260709 13:02:31.175145  9640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26555692bc3f487e99e16d30ec822d38" candidate_uuid: "255b950088324813bcbbe4002928fba9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf0ed7d88d88410788769a36241f22d9"
I20260709 13:02:31.177487  9830 ts_tablet_manager.cc:1434] T e7cfaa23415d4a69a5cf998bcdb1c83d P 255b950088324813bcbbe4002928fba9: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:02:31.177367  9714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3b998087e5451cba6d53a1cc6c9477" candidate_uuid: "cf0ed7d88d88410788769a36241f22d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "255b950088324813bcbbe4002928fba9" is_pre_election: true
I20260709 13:02:31.178090  9714 raft_consensus.cc:2468] T 5c3b998087e5451cba6d53a1cc6c9477 P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf0ed7d88d88410788769a36241f22d9 in term 0.
I20260709 13:02:31.178561  9830 tablet_bootstrap.cc:492] T a6cc719078d04018b6cb81bbc000528a P 255b950088324813bcbbe4002928fba9: Bootstrap starting.
I20260709 13:02:31.179447  9790 raft_consensus.cc:2468] T 26555692bc3f487e99e16d30ec822d38 P d495138f573f468abff8f34967cdfbf6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 255b950088324813bcbbe4002928fba9 in term 1.
I20260709 13:02:31.179744  9831 tablet_bootstrap.cc:492] T 5c3b998087e5451cba6d53a1cc6c9477 P d495138f573f468abff8f34967cdfbf6: No bootstrap required, opened a new log
I20260709 13:02:31.180332  9831 ts_tablet_manager.cc:1403] T 5c3b998087e5451cba6d53a1cc6c9477 P d495138f573f468abff8f34967cdfbf6: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.007s
I20260709 13:02:31.180655  9681 leader_election.cc:304] T 26555692bc3f487e99e16d30ec822d38 P 255b950088324813bcbbe4002928fba9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 255b950088324813bcbbe4002928fba9, d495138f573f468abff8f34967cdfbf6; no voters: 
I20260709 13:02:31.180860  9789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3b998087e5451cba6d53a1cc6c9477" candidate_uuid: "cf0ed7d88d88410788769a36241f22d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d495138f573f468abff8f34967cdfbf6" is_pre_election: true
I20260709 13:02:31.181627  9861 leader_election.cc:290] T 26555692bc3f487e99e16d30ec822d38 P 255b950088324813bcbbe4002928fba9 [CANDIDATE]: Term 1 election: Requested vote from peers cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823), d495138f573f468abff8f34967cdfbf6 (127.0.107.195:44885)
I20260709 13:02:31.182027  9834 raft_consensus.cc:2804] T 26555692bc3f487e99e16d30ec822d38 P 255b950088324813bcbbe4002928fba9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:31.182260  9832 consensus_queue.cc:260] T bfc104a251f842409dcd0830c3371344 P cf0ed7d88d88410788769a36241f22d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:31.182643  9834 raft_consensus.cc:697] T 26555692bc3f487e99e16d30ec822d38 P 255b950088324813bcbbe4002928fba9 [term 1 LEADER]: Becoming Leader. State: Replica: 255b950088324813bcbbe4002928fba9, State: Running, Role: LEADER
I20260709 13:02:31.183634  9834 consensus_queue.cc:237] T 26555692bc3f487e99e16d30ec822d38 P 255b950088324813bcbbe4002928fba9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:31.184728  9606 leader_election.cc:304] T 5c3b998087e5451cba6d53a1cc6c9477 P cf0ed7d88d88410788769a36241f22d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 255b950088324813bcbbe4002928fba9, cf0ed7d88d88410788769a36241f22d9; no voters: 
W20260709 13:02:31.185796  9606 leader_election.cc:343] T 5c3b998087e5451cba6d53a1cc6c9477 P cf0ed7d88d88410788769a36241f22d9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d495138f573f468abff8f34967cdfbf6 (127.0.107.195:44885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:31.185691  9831 raft_consensus.cc:359] T 5c3b998087e5451cba6d53a1cc6c9477 P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:31.186556  9831 raft_consensus.cc:385] T 5c3b998087e5451cba6d53a1cc6c9477 P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:31.186880  9831 raft_consensus.cc:740] T 5c3b998087e5451cba6d53a1cc6c9477 P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d495138f573f468abff8f34967cdfbf6, State: Initialized, Role: FOLLOWER
W20260709 13:02:31.187067  9679 leader_election.cc:343] T 26555692bc3f487e99e16d30ec822d38 P 255b950088324813bcbbe4002928fba9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:31.187770  9831 consensus_queue.cc:260] T 5c3b998087e5451cba6d53a1cc6c9477 P d495138f573f468abff8f34967cdfbf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:31.188453  9714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ac83262048e44a28858e8a0e18ac678" candidate_uuid: "d495138f573f468abff8f34967cdfbf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "255b950088324813bcbbe4002928fba9" is_pre_election: true
I20260709 13:02:31.189822  9840 raft_consensus.cc:2804] T 5c3b998087e5451cba6d53a1cc6c9477 P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:31.190384  9840 raft_consensus.cc:493] T 5c3b998087e5451cba6d53a1cc6c9477 P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.190311  9756 leader_election.cc:304] T 6ac83262048e44a28858e8a0e18ac678 P d495138f573f468abff8f34967cdfbf6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d495138f573f468abff8f34967cdfbf6; no voters: 255b950088324813bcbbe4002928fba9, cf0ed7d88d88410788769a36241f22d9
I20260709 13:02:31.161914  9837 leader_election.cc:290] T 6ac83262048e44a28858e8a0e18ac678 P d495138f573f468abff8f34967cdfbf6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 255b950088324813bcbbe4002928fba9 (127.0.107.194:34793), cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823)
I20260709 13:02:31.191329  9840 raft_consensus.cc:3060] T 5c3b998087e5451cba6d53a1cc6c9477 P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:31.191788  9837 raft_consensus.cc:3060] T 6ac83262048e44a28858e8a0e18ac678 P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:31.197569  9832 ts_tablet_manager.cc:1434] T bfc104a251f842409dcd0830c3371344 P cf0ed7d88d88410788769a36241f22d9: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.001s
I20260709 13:02:31.185055  9830 tablet_bootstrap.cc:654] T a6cc719078d04018b6cb81bbc000528a P 255b950088324813bcbbe4002928fba9: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:31.201562  9832 tablet_bootstrap.cc:492] T 26555692bc3f487e99e16d30ec822d38 P cf0ed7d88d88410788769a36241f22d9: Bootstrap starting.
I20260709 13:02:31.214267  9830 tablet_bootstrap.cc:492] T a6cc719078d04018b6cb81bbc000528a P 255b950088324813bcbbe4002928fba9: No bootstrap required, opened a new log
I20260709 13:02:31.214879  9830 ts_tablet_manager.cc:1403] T a6cc719078d04018b6cb81bbc000528a P 255b950088324813bcbbe4002928fba9: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.002s
I20260709 13:02:31.213927  9866 raft_consensus.cc:493] T 6a8d453497c74035b98b1c401e674c74 P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.216218  9832 tablet_bootstrap.cc:654] T 26555692bc3f487e99e16d30ec822d38 P cf0ed7d88d88410788769a36241f22d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:31.216418  9866 raft_consensus.cc:515] T 6a8d453497c74035b98b1c401e674c74 P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:31.217943  9830 raft_consensus.cc:359] T a6cc719078d04018b6cb81bbc000528a P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:31.218724  9830 raft_consensus.cc:385] T a6cc719078d04018b6cb81bbc000528a P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:31.219053  9830 raft_consensus.cc:740] T a6cc719078d04018b6cb81bbc000528a P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 255b950088324813bcbbe4002928fba9, State: Initialized, Role: FOLLOWER
I20260709 13:02:31.219125  9866 leader_election.cc:290] T 6a8d453497c74035b98b1c401e674c74 P cf0ed7d88d88410788769a36241f22d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 255b950088324813bcbbe4002928fba9 (127.0.107.194:34793), d495138f573f468abff8f34967cdfbf6 (127.0.107.195:44885)
I20260709 13:02:31.220239  9830 consensus_queue.cc:260] T a6cc719078d04018b6cb81bbc000528a P 255b950088324813bcbbe4002928fba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:31.221479  9714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a8d453497c74035b98b1c401e674c74" candidate_uuid: "cf0ed7d88d88410788769a36241f22d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "255b950088324813bcbbe4002928fba9" is_pre_election: true
I20260709 13:02:31.222420  9840 raft_consensus.cc:515] T 5c3b998087e5451cba6d53a1cc6c9477 P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:31.224031  9789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a8d453497c74035b98b1c401e674c74" candidate_uuid: "cf0ed7d88d88410788769a36241f22d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d495138f573f468abff8f34967cdfbf6" is_pre_election: true
I20260709 13:02:31.224288  9830 ts_tablet_manager.cc:1434] T a6cc719078d04018b6cb81bbc000528a P 255b950088324813bcbbe4002928fba9: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.002s
I20260709 13:02:31.225028  9789 raft_consensus.cc:2393] T 6a8d453497c74035b98b1c401e674c74 P d495138f573f468abff8f34967cdfbf6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf0ed7d88d88410788769a36241f22d9 in current term 1: Already voted for candidate 255b950088324813bcbbe4002928fba9 in this term.
I20260709 13:02:31.226227  9840 leader_election.cc:290] T 5c3b998087e5451cba6d53a1cc6c9477 P cf0ed7d88d88410788769a36241f22d9 [CANDIDATE]: Term 1 election: Requested vote from peers 255b950088324813bcbbe4002928fba9 (127.0.107.194:34793), d495138f573f468abff8f34967cdfbf6 (127.0.107.195:44885)
I20260709 13:02:31.226943  9606 leader_election.cc:304] T 6a8d453497c74035b98b1c401e674c74 P cf0ed7d88d88410788769a36241f22d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf0ed7d88d88410788769a36241f22d9; no voters: 255b950088324813bcbbe4002928fba9, d495138f573f468abff8f34967cdfbf6
I20260709 13:02:31.226943  9714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3b998087e5451cba6d53a1cc6c9477" candidate_uuid: "cf0ed7d88d88410788769a36241f22d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "255b950088324813bcbbe4002928fba9"
I20260709 13:02:31.227795  9832 tablet_bootstrap.cc:492] T 26555692bc3f487e99e16d30ec822d38 P cf0ed7d88d88410788769a36241f22d9: No bootstrap required, opened a new log
I20260709 13:02:31.228391  9832 ts_tablet_manager.cc:1403] T 26555692bc3f487e99e16d30ec822d38 P cf0ed7d88d88410788769a36241f22d9: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.004s
I20260709 13:02:31.228579  9840 raft_consensus.cc:3060] T 6a8d453497c74035b98b1c401e674c74 P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:31.228957  9789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3b998087e5451cba6d53a1cc6c9477" candidate_uuid: "cf0ed7d88d88410788769a36241f22d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d495138f573f468abff8f34967cdfbf6"
I20260709 13:02:31.229687  9789 raft_consensus.cc:3060] T 5c3b998087e5451cba6d53a1cc6c9477 P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:31.230999  9831 ts_tablet_manager.cc:1434] T 5c3b998087e5451cba6d53a1cc6c9477 P d495138f573f468abff8f34967cdfbf6: Time spent starting tablet: real 0.050s	user 0.003s	sys 0.004s
I20260709 13:02:31.228197  9714 raft_consensus.cc:3060] T 5c3b998087e5451cba6d53a1cc6c9477 P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:31.231702  9832 raft_consensus.cc:359] T 26555692bc3f487e99e16d30ec822d38 P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:31.232481  9832 raft_consensus.cc:385] T 26555692bc3f487e99e16d30ec822d38 P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:31.206146  9837 raft_consensus.cc:2749] T 6ac83262048e44a28858e8a0e18ac678 P d495138f573f468abff8f34967cdfbf6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:31.232872  9831 tablet_bootstrap.cc:492] T e7cfaa23415d4a69a5cf998bcdb1c83d P d495138f573f468abff8f34967cdfbf6: Bootstrap starting.
I20260709 13:02:31.237030  9536 catalog_manager.cc:5697] T 26555692bc3f487e99e16d30ec822d38 P 255b950088324813bcbbe4002928fba9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 255b950088324813bcbbe4002928fba9 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "255b950088324813bcbbe4002928fba9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:31.239415  9840 raft_consensus.cc:2749] T 6a8d453497c74035b98b1c401e674c74 P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:31.239980  9831 tablet_bootstrap.cc:654] T e7cfaa23415d4a69a5cf998bcdb1c83d P d495138f573f468abff8f34967cdfbf6: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:31.241186  9714 raft_consensus.cc:2468] T 5c3b998087e5451cba6d53a1cc6c9477 P 255b950088324813bcbbe4002928fba9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf0ed7d88d88410788769a36241f22d9 in term 1.
I20260709 13:02:31.232851  9832 raft_consensus.cc:740] T 26555692bc3f487e99e16d30ec822d38 P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf0ed7d88d88410788769a36241f22d9, State: Initialized, Role: FOLLOWER
I20260709 13:02:31.243045  9832 consensus_queue.cc:260] T 26555692bc3f487e99e16d30ec822d38 P cf0ed7d88d88410788769a36241f22d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:31.246960  9832 ts_tablet_manager.cc:1434] T 26555692bc3f487e99e16d30ec822d38 P cf0ed7d88d88410788769a36241f22d9: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 13:02:31.248260  9606 leader_election.cc:304] T 5c3b998087e5451cba6d53a1cc6c9477 P cf0ed7d88d88410788769a36241f22d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 255b950088324813bcbbe4002928fba9, cf0ed7d88d88410788769a36241f22d9; no voters: 
I20260709 13:02:31.250818  9789 raft_consensus.cc:2468] T 5c3b998087e5451cba6d53a1cc6c9477 P d495138f573f468abff8f34967cdfbf6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf0ed7d88d88410788769a36241f22d9 in term 1.
I20260709 13:02:31.251484  9840 raft_consensus.cc:2804] T 5c3b998087e5451cba6d53a1cc6c9477 P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:31.252700  9840 raft_consensus.cc:697] T 5c3b998087e5451cba6d53a1cc6c9477 P cf0ed7d88d88410788769a36241f22d9 [term 1 LEADER]: Becoming Leader. State: Replica: cf0ed7d88d88410788769a36241f22d9, State: Running, Role: LEADER
I20260709 13:02:31.253646  9840 consensus_queue.cc:237] T 5c3b998087e5451cba6d53a1cc6c9477 P cf0ed7d88d88410788769a36241f22d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:31.254911  9831 tablet_bootstrap.cc:492] T e7cfaa23415d4a69a5cf998bcdb1c83d P d495138f573f468abff8f34967cdfbf6: No bootstrap required, opened a new log
I20260709 13:02:31.255460  9831 ts_tablet_manager.cc:1403] T e7cfaa23415d4a69a5cf998bcdb1c83d P d495138f573f468abff8f34967cdfbf6: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.005s
I20260709 13:02:31.258343  9831 raft_consensus.cc:359] T e7cfaa23415d4a69a5cf998bcdb1c83d P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:31.259104  9831 raft_consensus.cc:385] T e7cfaa23415d4a69a5cf998bcdb1c83d P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:31.259479  9831 raft_consensus.cc:740] T e7cfaa23415d4a69a5cf998bcdb1c83d P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d495138f573f468abff8f34967cdfbf6, State: Initialized, Role: FOLLOWER
I20260709 13:02:31.260273  9831 consensus_queue.cc:260] T e7cfaa23415d4a69a5cf998bcdb1c83d P d495138f573f468abff8f34967cdfbf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:31.262470  9831 ts_tablet_manager.cc:1434] T e7cfaa23415d4a69a5cf998bcdb1c83d P d495138f573f468abff8f34967cdfbf6: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:02:31.264837  9536 catalog_manager.cc:5697] T 5c3b998087e5451cba6d53a1cc6c9477 P cf0ed7d88d88410788769a36241f22d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf0ed7d88d88410788769a36241f22d9 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "cf0ed7d88d88410788769a36241f22d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:31.272073  9834 consensus_queue.cc:1048] T 6a8d453497c74035b98b1c401e674c74 P 255b950088324813bcbbe4002928fba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:31.284348  9861 consensus_queue.cc:1048] T 6a8d453497c74035b98b1c401e674c74 P 255b950088324813bcbbe4002928fba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:31.363000  9840 raft_consensus.cc:493] T a6cc719078d04018b6cb81bbc000528a P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.363555  9840 raft_consensus.cc:515] T a6cc719078d04018b6cb81bbc000528a P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:31.365327  9840 leader_election.cc:290] T a6cc719078d04018b6cb81bbc000528a P cf0ed7d88d88410788769a36241f22d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 255b950088324813bcbbe4002928fba9 (127.0.107.194:34793), d495138f573f468abff8f34967cdfbf6 (127.0.107.195:44885)
I20260709 13:02:31.366251  9714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6cc719078d04018b6cb81bbc000528a" candidate_uuid: "cf0ed7d88d88410788769a36241f22d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "255b950088324813bcbbe4002928fba9" is_pre_election: true
I20260709 13:02:31.366519  9789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6cc719078d04018b6cb81bbc000528a" candidate_uuid: "cf0ed7d88d88410788769a36241f22d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d495138f573f468abff8f34967cdfbf6" is_pre_election: true
I20260709 13:02:31.366890  9714 raft_consensus.cc:2468] T a6cc719078d04018b6cb81bbc000528a P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf0ed7d88d88410788769a36241f22d9 in term 0.
I20260709 13:02:31.367170  9789 raft_consensus.cc:2468] T a6cc719078d04018b6cb81bbc000528a P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf0ed7d88d88410788769a36241f22d9 in term 0.
I20260709 13:02:31.367910  9606 leader_election.cc:304] T a6cc719078d04018b6cb81bbc000528a P cf0ed7d88d88410788769a36241f22d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 255b950088324813bcbbe4002928fba9, cf0ed7d88d88410788769a36241f22d9; no voters: 
I20260709 13:02:31.368672  9840 raft_consensus.cc:2804] T a6cc719078d04018b6cb81bbc000528a P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:31.369033  9840 raft_consensus.cc:493] T a6cc719078d04018b6cb81bbc000528a P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.369331  9840 raft_consensus.cc:3060] T a6cc719078d04018b6cb81bbc000528a P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:31.374581  9840 raft_consensus.cc:515] T a6cc719078d04018b6cb81bbc000528a P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:31.376225  9840 leader_election.cc:290] T a6cc719078d04018b6cb81bbc000528a P cf0ed7d88d88410788769a36241f22d9 [CANDIDATE]: Term 1 election: Requested vote from peers 255b950088324813bcbbe4002928fba9 (127.0.107.194:34793), d495138f573f468abff8f34967cdfbf6 (127.0.107.195:44885)
I20260709 13:02:31.376981  9714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6cc719078d04018b6cb81bbc000528a" candidate_uuid: "cf0ed7d88d88410788769a36241f22d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "255b950088324813bcbbe4002928fba9"
I20260709 13:02:31.377332  9789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6cc719078d04018b6cb81bbc000528a" candidate_uuid: "cf0ed7d88d88410788769a36241f22d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d495138f573f468abff8f34967cdfbf6"
I20260709 13:02:31.377736  9714 raft_consensus.cc:3060] T a6cc719078d04018b6cb81bbc000528a P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:31.377893  9789 raft_consensus.cc:3060] T a6cc719078d04018b6cb81bbc000528a P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:31.385042  9714 raft_consensus.cc:2468] T a6cc719078d04018b6cb81bbc000528a P 255b950088324813bcbbe4002928fba9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf0ed7d88d88410788769a36241f22d9 in term 1.
I20260709 13:02:31.385042  9789 raft_consensus.cc:2468] T a6cc719078d04018b6cb81bbc000528a P d495138f573f468abff8f34967cdfbf6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf0ed7d88d88410788769a36241f22d9 in term 1.
I20260709 13:02:31.386483  9606 leader_election.cc:304] T a6cc719078d04018b6cb81bbc000528a P cf0ed7d88d88410788769a36241f22d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 255b950088324813bcbbe4002928fba9, cf0ed7d88d88410788769a36241f22d9; no voters: 
I20260709 13:02:31.387331  9840 raft_consensus.cc:2804] T a6cc719078d04018b6cb81bbc000528a P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:31.388000  9840 raft_consensus.cc:697] T a6cc719078d04018b6cb81bbc000528a P cf0ed7d88d88410788769a36241f22d9 [term 1 LEADER]: Becoming Leader. State: Replica: cf0ed7d88d88410788769a36241f22d9, State: Running, Role: LEADER
I20260709 13:02:31.388962  9840 consensus_queue.cc:237] T a6cc719078d04018b6cb81bbc000528a P cf0ed7d88d88410788769a36241f22d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:31.389405  9837 consensus_queue.cc:1048] T d3af616bce154a0290e2dfda0b625ec3 P d495138f573f468abff8f34967cdfbf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:31.400720  9537 catalog_manager.cc:5697] T a6cc719078d04018b6cb81bbc000528a P cf0ed7d88d88410788769a36241f22d9 reported cstate change: term changed from 0 to 1, leader changed from <none> to cf0ed7d88d88410788769a36241f22d9 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "cf0ed7d88d88410788769a36241f22d9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:31.405201  9840 raft_consensus.cc:493] T bfc104a251f842409dcd0830c3371344 P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.405835  9865 consensus_queue.cc:1048] T d3af616bce154a0290e2dfda0b625ec3 P d495138f573f468abff8f34967cdfbf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:31.405809  9840 raft_consensus.cc:515] T bfc104a251f842409dcd0830c3371344 P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:31.410195  9840 leader_election.cc:290] T bfc104a251f842409dcd0830c3371344 P cf0ed7d88d88410788769a36241f22d9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 255b950088324813bcbbe4002928fba9 (127.0.107.194:34793), d495138f573f468abff8f34967cdfbf6 (127.0.107.195:44885)
I20260709 13:02:31.412951  9789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfc104a251f842409dcd0830c3371344" candidate_uuid: "cf0ed7d88d88410788769a36241f22d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d495138f573f468abff8f34967cdfbf6" is_pre_election: true
I20260709 13:02:31.412969  9855 consensus_queue.cc:1048] T 62c912553c2b40ffac89862b3bd40ee7 P d495138f573f468abff8f34967cdfbf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:31.414012  9789 raft_consensus.cc:2393] T bfc104a251f842409dcd0830c3371344 P d495138f573f468abff8f34967cdfbf6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cf0ed7d88d88410788769a36241f22d9 in current term 1: Already voted for candidate 255b950088324813bcbbe4002928fba9 in this term.
I20260709 13:02:31.415143  9714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfc104a251f842409dcd0830c3371344" candidate_uuid: "cf0ed7d88d88410788769a36241f22d9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "255b950088324813bcbbe4002928fba9" is_pre_election: true
I20260709 13:02:31.416581  9855 raft_consensus.cc:493] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.417102  9855 raft_consensus.cc:515] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:31.418212  9606 leader_election.cc:304] T bfc104a251f842409dcd0830c3371344 P cf0ed7d88d88410788769a36241f22d9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cf0ed7d88d88410788769a36241f22d9; no voters: 255b950088324813bcbbe4002928fba9, d495138f573f468abff8f34967cdfbf6
I20260709 13:02:31.418979  9840 raft_consensus.cc:3060] T bfc104a251f842409dcd0830c3371344 P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:31.420601  9855 leader_election.cc:290] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P d495138f573f468abff8f34967cdfbf6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823), 255b950088324813bcbbe4002928fba9 (127.0.107.194:34793)
I20260709 13:02:31.420748  9638 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a8e72dc52e4f99a1acd4fd1b481bc4" candidate_uuid: "d495138f573f468abff8f34967cdfbf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf0ed7d88d88410788769a36241f22d9" is_pre_election: true
I20260709 13:02:31.421945  9638 raft_consensus.cc:2393] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d495138f573f468abff8f34967cdfbf6 in current term 1: Already voted for candidate 255b950088324813bcbbe4002928fba9 in this term.
I20260709 13:02:31.420343  9714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a8e72dc52e4f99a1acd4fd1b481bc4" candidate_uuid: "d495138f573f468abff8f34967cdfbf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "255b950088324813bcbbe4002928fba9" is_pre_election: true
I20260709 13:02:31.424780  9756 leader_election.cc:304] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P d495138f573f468abff8f34967cdfbf6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d495138f573f468abff8f34967cdfbf6; no voters: 255b950088324813bcbbe4002928fba9, cf0ed7d88d88410788769a36241f22d9
I20260709 13:02:31.426118  9855 raft_consensus.cc:3060] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:31.426638  9840 raft_consensus.cc:2749] T bfc104a251f842409dcd0830c3371344 P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:31.432379  9865 consensus_queue.cc:1048] T 62c912553c2b40ffac89862b3bd40ee7 P d495138f573f468abff8f34967cdfbf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:31.434203  9855 raft_consensus.cc:2749] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P d495138f573f468abff8f34967cdfbf6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:31.442246  9855 raft_consensus.cc:493] T e7cfaa23415d4a69a5cf998bcdb1c83d P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:31.442775  9855 raft_consensus.cc:515] T e7cfaa23415d4a69a5cf998bcdb1c83d P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:31.444752  9855 leader_election.cc:290] T e7cfaa23415d4a69a5cf998bcdb1c83d P d495138f573f468abff8f34967cdfbf6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823), 255b950088324813bcbbe4002928fba9 (127.0.107.194:34793)
I20260709 13:02:31.445416  9640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cfaa23415d4a69a5cf998bcdb1c83d" candidate_uuid: "d495138f573f468abff8f34967cdfbf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf0ed7d88d88410788769a36241f22d9" is_pre_election: true
I20260709 13:02:31.445806  9713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cfaa23415d4a69a5cf998bcdb1c83d" candidate_uuid: "d495138f573f468abff8f34967cdfbf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "255b950088324813bcbbe4002928fba9" is_pre_election: true
I20260709 13:02:31.446121  9640 raft_consensus.cc:2468] T e7cfaa23415d4a69a5cf998bcdb1c83d P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d495138f573f468abff8f34967cdfbf6 in term 0.
I20260709 13:02:31.446550  9713 raft_consensus.cc:2468] T e7cfaa23415d4a69a5cf998bcdb1c83d P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d495138f573f468abff8f34967cdfbf6 in term 0.
I20260709 13:02:31.447366  9754 leader_election.cc:304] T e7cfaa23415d4a69a5cf998bcdb1c83d P d495138f573f468abff8f34967cdfbf6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cf0ed7d88d88410788769a36241f22d9, d495138f573f468abff8f34967cdfbf6; no voters: 
I20260709 13:02:31.448119  9855 raft_consensus.cc:2804] T e7cfaa23415d4a69a5cf998bcdb1c83d P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:31.448680  9855 raft_consensus.cc:493] T e7cfaa23415d4a69a5cf998bcdb1c83d P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:31.449012  9855 raft_consensus.cc:3060] T e7cfaa23415d4a69a5cf998bcdb1c83d P d495138f573f468abff8f34967cdfbf6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:31.454003  9855 raft_consensus.cc:515] T e7cfaa23415d4a69a5cf998bcdb1c83d P d495138f573f468abff8f34967cdfbf6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:31.455716  9855 leader_election.cc:290] T e7cfaa23415d4a69a5cf998bcdb1c83d P d495138f573f468abff8f34967cdfbf6 [CANDIDATE]: Term 1 election: Requested vote from peers cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823), 255b950088324813bcbbe4002928fba9 (127.0.107.194:34793)
I20260709 13:02:31.456403  9640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cfaa23415d4a69a5cf998bcdb1c83d" candidate_uuid: "d495138f573f468abff8f34967cdfbf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cf0ed7d88d88410788769a36241f22d9"
I20260709 13:02:31.456774  9713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cfaa23415d4a69a5cf998bcdb1c83d" candidate_uuid: "d495138f573f468abff8f34967cdfbf6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "255b950088324813bcbbe4002928fba9"
I20260709 13:02:31.456991  9640 raft_consensus.cc:3060] T e7cfaa23415d4a69a5cf998bcdb1c83d P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:31.457386  9713 raft_consensus.cc:3060] T e7cfaa23415d4a69a5cf998bcdb1c83d P 255b950088324813bcbbe4002928fba9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:31.461938  9640 raft_consensus.cc:2468] T e7cfaa23415d4a69a5cf998bcdb1c83d P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d495138f573f468abff8f34967cdfbf6 in term 1.
I20260709 13:02:31.462100  9713 raft_consensus.cc:2468] T e7cfaa23415d4a69a5cf998bcdb1c83d P 255b950088324813bcbbe4002928fba9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d495138f573f468abff8f34967cdfbf6 in term 1.
I20260709 13:02:31.463099  9754 leader_election.cc:304] T e7cfaa23415d4a69a5cf998bcdb1c83d P d495138f573f468abff8f34967cdfbf6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cf0ed7d88d88410788769a36241f22d9, d495138f573f468abff8f34967cdfbf6; no voters: 
I20260709 13:02:31.463791  9855 raft_consensus.cc:2804] T e7cfaa23415d4a69a5cf998bcdb1c83d P d495138f573f468abff8f34967cdfbf6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:31.464129  9855 raft_consensus.cc:697] T e7cfaa23415d4a69a5cf998bcdb1c83d P d495138f573f468abff8f34967cdfbf6 [term 1 LEADER]: Becoming Leader. State: Replica: d495138f573f468abff8f34967cdfbf6, State: Running, Role: LEADER
I20260709 13:02:31.464805  9855 consensus_queue.cc:237] T e7cfaa23415d4a69a5cf998bcdb1c83d P d495138f573f468abff8f34967cdfbf6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:31.471840  9536 catalog_manager.cc:5697] T e7cfaa23415d4a69a5cf998bcdb1c83d P d495138f573f468abff8f34967cdfbf6 reported cstate change: term changed from 0 to 1, leader changed from <none> to d495138f573f468abff8f34967cdfbf6 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "d495138f573f468abff8f34967cdfbf6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:31.487036  9861 consensus_queue.cc:1048] T 6ac83262048e44a28858e8a0e18ac678 P 255b950088324813bcbbe4002928fba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:31.489027  9861 consensus_queue.cc:1048] T bfc104a251f842409dcd0830c3371344 P 255b950088324813bcbbe4002928fba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:31.498140  9869 consensus_queue.cc:1048] T 6ac83262048e44a28858e8a0e18ac678 P 255b950088324813bcbbe4002928fba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:31.503293  9834 consensus_queue.cc:1048] T bfc104a251f842409dcd0830c3371344 P 255b950088324813bcbbe4002928fba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:31.521095   431 ts_manager.cc:295] Set tserver state for cf0ed7d88d88410788769a36241f22d9 to MAINTENANCE_MODE
I20260709 13:02:31.521915   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 13:02:31.552834   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:31.553870   431 tablet_replica.cc:333] T 26555692bc3f487e99e16d30ec822d38 P cf0ed7d88d88410788769a36241f22d9: stopping tablet replica
I20260709 13:02:31.554602   431 raft_consensus.cc:2243] T 26555692bc3f487e99e16d30ec822d38 P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:31.555047   431 raft_consensus.cc:2272] T 26555692bc3f487e99e16d30ec822d38 P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:31.557595   431 tablet_replica.cc:333] T a6cc719078d04018b6cb81bbc000528a P cf0ed7d88d88410788769a36241f22d9: stopping tablet replica
I20260709 13:02:31.558182   431 raft_consensus.cc:2243] T a6cc719078d04018b6cb81bbc000528a P cf0ed7d88d88410788769a36241f22d9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:31.558823   431 pending_rounds.cc:70] T a6cc719078d04018b6cb81bbc000528a P cf0ed7d88d88410788769a36241f22d9: Trying to abort 1 pending ops.
I20260709 13:02:31.559031   431 pending_rounds.cc:77] T a6cc719078d04018b6cb81bbc000528a P cf0ed7d88d88410788769a36241f22d9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305634412100157440 op_type: NO_OP noop_request { }
I20260709 13:02:31.559355   431 raft_consensus.cc:2889] T a6cc719078d04018b6cb81bbc000528a P cf0ed7d88d88410788769a36241f22d9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:02:31.559664   431 raft_consensus.cc:2272] T a6cc719078d04018b6cb81bbc000528a P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:31.561954   431 tablet_replica.cc:333] T 6a8d453497c74035b98b1c401e674c74 P cf0ed7d88d88410788769a36241f22d9: stopping tablet replica
I20260709 13:02:31.562537   431 raft_consensus.cc:2243] T 6a8d453497c74035b98b1c401e674c74 P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:31.562963   431 raft_consensus.cc:2272] T 6a8d453497c74035b98b1c401e674c74 P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:31.565550   431 tablet_replica.cc:333] T 62c912553c2b40ffac89862b3bd40ee7 P cf0ed7d88d88410788769a36241f22d9: stopping tablet replica
I20260709 13:02:31.566102   431 raft_consensus.cc:2243] T 62c912553c2b40ffac89862b3bd40ee7 P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:31.566531   431 raft_consensus.cc:2272] T 62c912553c2b40ffac89862b3bd40ee7 P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:31.568924   431 tablet_replica.cc:333] T 5c3b998087e5451cba6d53a1cc6c9477 P cf0ed7d88d88410788769a36241f22d9: stopping tablet replica
I20260709 13:02:31.569484   431 raft_consensus.cc:2243] T 5c3b998087e5451cba6d53a1cc6c9477 P cf0ed7d88d88410788769a36241f22d9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:31.570077   431 pending_rounds.cc:70] T 5c3b998087e5451cba6d53a1cc6c9477 P cf0ed7d88d88410788769a36241f22d9: Trying to abort 1 pending ops.
I20260709 13:02:31.570240   431 pending_rounds.cc:77] T 5c3b998087e5451cba6d53a1cc6c9477 P cf0ed7d88d88410788769a36241f22d9: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305634411546349568 op_type: NO_OP noop_request { }
I20260709 13:02:31.570561   431 raft_consensus.cc:2889] T 5c3b998087e5451cba6d53a1cc6c9477 P cf0ed7d88d88410788769a36241f22d9 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:02:31.570883   431 raft_consensus.cc:2272] T 5c3b998087e5451cba6d53a1cc6c9477 P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:31.573040   431 tablet_replica.cc:333] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P cf0ed7d88d88410788769a36241f22d9: stopping tablet replica
I20260709 13:02:31.573596   431 raft_consensus.cc:2243] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:31.573987   431 raft_consensus.cc:2272] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:31.575701   431 tablet_replica.cc:333] T e7cfaa23415d4a69a5cf998bcdb1c83d P cf0ed7d88d88410788769a36241f22d9: stopping tablet replica
I20260709 13:02:31.576498   431 raft_consensus.cc:2243] T e7cfaa23415d4a69a5cf998bcdb1c83d P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:31.577024   431 raft_consensus.cc:2272] T e7cfaa23415d4a69a5cf998bcdb1c83d P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:31.579005   431 tablet_replica.cc:333] T 6ac83262048e44a28858e8a0e18ac678 P cf0ed7d88d88410788769a36241f22d9: stopping tablet replica
I20260709 13:02:31.579622   431 raft_consensus.cc:2243] T 6ac83262048e44a28858e8a0e18ac678 P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:31.579484  9834 consensus_queue.cc:1048] T 26555692bc3f487e99e16d30ec822d38 P 255b950088324813bcbbe4002928fba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:31.580243   431 raft_consensus.cc:2272] T 6ac83262048e44a28858e8a0e18ac678 P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:31.583060   431 tablet_replica.cc:333] T bfc104a251f842409dcd0830c3371344 P cf0ed7d88d88410788769a36241f22d9: stopping tablet replica
I20260709 13:02:31.583570   431 raft_consensus.cc:2243] T bfc104a251f842409dcd0830c3371344 P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:31.584002   431 raft_consensus.cc:2272] T bfc104a251f842409dcd0830c3371344 P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:31.587344   431 tablet_replica.cc:333] T d3af616bce154a0290e2dfda0b625ec3 P cf0ed7d88d88410788769a36241f22d9: stopping tablet replica
I20260709 13:02:31.588028   431 raft_consensus.cc:2243] T d3af616bce154a0290e2dfda0b625ec3 P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:31.588660   431 raft_consensus.cc:2272] T d3af616bce154a0290e2dfda0b625ec3 P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:31.604708  9679 consensus_peers.cc:597] T 26555692bc3f487e99e16d30ec822d38 P 255b950088324813bcbbe4002928fba9 -> Peer cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823): Couldn't send request to peer cf0ed7d88d88410788769a36241f22d9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:31.624142   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
I20260709 13:02:31.667403  9834 consensus_queue.cc:1048] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P 255b950088324813bcbbe4002928fba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:02:31.683627  9679 consensus_peers.cc:597] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P 255b950088324813bcbbe4002928fba9 -> Peer cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823): Couldn't send request to peer cf0ed7d88d88410788769a36241f22d9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40823: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:31.702984  9586 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:02:31.822978  9754 consensus_peers.cc:597] T 62c912553c2b40ffac89862b3bd40ee7 P d495138f573f468abff8f34967cdfbf6 -> Peer cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823): Couldn't send request to peer cf0ed7d88d88410788769a36241f22d9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40823: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:31.830477  9679 consensus_peers.cc:597] T 6a8d453497c74035b98b1c401e674c74 P 255b950088324813bcbbe4002928fba9 -> Peer cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823): Couldn't send request to peer cf0ed7d88d88410788769a36241f22d9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40823: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:31.880476  9855 consensus_queue.cc:1048] T e7cfaa23415d4a69a5cf998bcdb1c83d P d495138f573f468abff8f34967cdfbf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:02:31.885753  9754 consensus_peers.cc:597] T e7cfaa23415d4a69a5cf998bcdb1c83d P d495138f573f468abff8f34967cdfbf6 -> Peer cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823): Couldn't send request to peer cf0ed7d88d88410788769a36241f22d9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40823: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:31.979662  9754 consensus_peers.cc:597] T d3af616bce154a0290e2dfda0b625ec3 P d495138f573f468abff8f34967cdfbf6 -> Peer cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823): Couldn't send request to peer cf0ed7d88d88410788769a36241f22d9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40823: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:32.099009  9679 consensus_peers.cc:597] T bfc104a251f842409dcd0830c3371344 P 255b950088324813bcbbe4002928fba9 -> Peer cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823): Couldn't send request to peer cf0ed7d88d88410788769a36241f22d9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40823: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:32.105428  9679 consensus_peers.cc:597] T 6ac83262048e44a28858e8a0e18ac678 P 255b950088324813bcbbe4002928fba9 -> Peer cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823): Couldn't send request to peer cf0ed7d88d88410788769a36241f22d9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40823: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:32.703987  9586 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:02:33.050586  9679 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40823: connect: Connection refused (error 111) [suppressed 117 similar messages]
I20260709 13:02:33.120076  9865 raft_consensus.cc:493] T 5c3b998087e5451cba6d53a1cc6c9477 P d495138f573f468abff8f34967cdfbf6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.120692  9865 raft_consensus.cc:515] T 5c3b998087e5451cba6d53a1cc6c9477 P d495138f573f468abff8f34967cdfbf6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:33.122711  9865 leader_election.cc:290] T 5c3b998087e5451cba6d53a1cc6c9477 P d495138f573f468abff8f34967cdfbf6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823), 255b950088324813bcbbe4002928fba9 (127.0.107.194:34793)
I20260709 13:02:33.123792  9713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3b998087e5451cba6d53a1cc6c9477" candidate_uuid: "d495138f573f468abff8f34967cdfbf6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "255b950088324813bcbbe4002928fba9" is_pre_election: true
I20260709 13:02:33.124619  9713 raft_consensus.cc:2468] T 5c3b998087e5451cba6d53a1cc6c9477 P 255b950088324813bcbbe4002928fba9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d495138f573f468abff8f34967cdfbf6 in term 1.
I20260709 13:02:33.125749  9756 leader_election.cc:304] T 5c3b998087e5451cba6d53a1cc6c9477 P d495138f573f468abff8f34967cdfbf6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 255b950088324813bcbbe4002928fba9, d495138f573f468abff8f34967cdfbf6; no voters: 
W20260709 13:02:33.126423  9754 leader_election.cc:336] T 5c3b998087e5451cba6d53a1cc6c9477 P d495138f573f468abff8f34967cdfbf6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40823: connect: Connection refused (error 111)
I20260709 13:02:33.126464  9865 raft_consensus.cc:2804] T 5c3b998087e5451cba6d53a1cc6c9477 P d495138f573f468abff8f34967cdfbf6 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:33.127187  9865 raft_consensus.cc:493] T 5c3b998087e5451cba6d53a1cc6c9477 P d495138f573f468abff8f34967cdfbf6 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.127581  9865 raft_consensus.cc:3060] T 5c3b998087e5451cba6d53a1cc6c9477 P d495138f573f468abff8f34967cdfbf6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:33.132464  9865 raft_consensus.cc:515] T 5c3b998087e5451cba6d53a1cc6c9477 P d495138f573f468abff8f34967cdfbf6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:33.134056  9865 leader_election.cc:290] T 5c3b998087e5451cba6d53a1cc6c9477 P d495138f573f468abff8f34967cdfbf6 [CANDIDATE]: Term 2 election: Requested vote from peers cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823), 255b950088324813bcbbe4002928fba9 (127.0.107.194:34793)
I20260709 13:02:33.135187  9713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3b998087e5451cba6d53a1cc6c9477" candidate_uuid: "d495138f573f468abff8f34967cdfbf6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "255b950088324813bcbbe4002928fba9"
I20260709 13:02:33.135882  9713 raft_consensus.cc:3060] T 5c3b998087e5451cba6d53a1cc6c9477 P 255b950088324813bcbbe4002928fba9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:02:33.137702  9754 leader_election.cc:336] T 5c3b998087e5451cba6d53a1cc6c9477 P d495138f573f468abff8f34967cdfbf6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40823: connect: Connection refused (error 111)
I20260709 13:02:33.141306  9713 raft_consensus.cc:2468] T 5c3b998087e5451cba6d53a1cc6c9477 P 255b950088324813bcbbe4002928fba9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d495138f573f468abff8f34967cdfbf6 in term 2.
I20260709 13:02:33.142377  9756 leader_election.cc:304] T 5c3b998087e5451cba6d53a1cc6c9477 P d495138f573f468abff8f34967cdfbf6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 255b950088324813bcbbe4002928fba9, d495138f573f468abff8f34967cdfbf6; no voters: cf0ed7d88d88410788769a36241f22d9
I20260709 13:02:33.143111  9865 raft_consensus.cc:2804] T 5c3b998087e5451cba6d53a1cc6c9477 P d495138f573f468abff8f34967cdfbf6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:33.143879  9865 raft_consensus.cc:697] T 5c3b998087e5451cba6d53a1cc6c9477 P d495138f573f468abff8f34967cdfbf6 [term 2 LEADER]: Becoming Leader. State: Replica: d495138f573f468abff8f34967cdfbf6, State: Running, Role: LEADER
I20260709 13:02:33.144634  9865 consensus_queue.cc:237] T 5c3b998087e5451cba6d53a1cc6c9477 P d495138f573f468abff8f34967cdfbf6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:33.151845  9537 catalog_manager.cc:5697] T 5c3b998087e5451cba6d53a1cc6c9477 P d495138f573f468abff8f34967cdfbf6 reported cstate change: term changed from 1 to 2, leader changed from cf0ed7d88d88410788769a36241f22d9 (127.0.107.193) to d495138f573f468abff8f34967cdfbf6 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "d495138f573f468abff8f34967cdfbf6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:33.247737  9865 raft_consensus.cc:493] T a6cc719078d04018b6cb81bbc000528a P d495138f573f468abff8f34967cdfbf6 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:33.248231  9865 raft_consensus.cc:515] T a6cc719078d04018b6cb81bbc000528a P d495138f573f468abff8f34967cdfbf6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:33.250089  9865 leader_election.cc:290] T a6cc719078d04018b6cb81bbc000528a P d495138f573f468abff8f34967cdfbf6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823), 255b950088324813bcbbe4002928fba9 (127.0.107.194:34793)
I20260709 13:02:33.251257  9713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6cc719078d04018b6cb81bbc000528a" candidate_uuid: "d495138f573f468abff8f34967cdfbf6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "255b950088324813bcbbe4002928fba9" is_pre_election: true
I20260709 13:02:33.251894  9713 raft_consensus.cc:2468] T a6cc719078d04018b6cb81bbc000528a P 255b950088324813bcbbe4002928fba9 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d495138f573f468abff8f34967cdfbf6 in term 1.
I20260709 13:02:33.252861  9756 leader_election.cc:304] T a6cc719078d04018b6cb81bbc000528a P d495138f573f468abff8f34967cdfbf6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 255b950088324813bcbbe4002928fba9, d495138f573f468abff8f34967cdfbf6; no voters: 
I20260709 13:02:33.253682  9865 raft_consensus.cc:2804] T a6cc719078d04018b6cb81bbc000528a P d495138f573f468abff8f34967cdfbf6 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:02:33.253785  9754 leader_election.cc:336] T a6cc719078d04018b6cb81bbc000528a P d495138f573f468abff8f34967cdfbf6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40823: connect: Connection refused (error 111)
I20260709 13:02:33.254123  9865 raft_consensus.cc:493] T a6cc719078d04018b6cb81bbc000528a P d495138f573f468abff8f34967cdfbf6 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:33.254487  9865 raft_consensus.cc:3060] T a6cc719078d04018b6cb81bbc000528a P d495138f573f468abff8f34967cdfbf6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:33.259294  9865 raft_consensus.cc:515] T a6cc719078d04018b6cb81bbc000528a P d495138f573f468abff8f34967cdfbf6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:33.260944  9865 leader_election.cc:290] T a6cc719078d04018b6cb81bbc000528a P d495138f573f468abff8f34967cdfbf6 [CANDIDATE]: Term 2 election: Requested vote from peers cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823), 255b950088324813bcbbe4002928fba9 (127.0.107.194:34793)
I20260709 13:02:33.262140  9713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6cc719078d04018b6cb81bbc000528a" candidate_uuid: "d495138f573f468abff8f34967cdfbf6" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "255b950088324813bcbbe4002928fba9"
I20260709 13:02:33.262825  9713 raft_consensus.cc:3060] T a6cc719078d04018b6cb81bbc000528a P 255b950088324813bcbbe4002928fba9 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:02:33.264438  9754 leader_election.cc:336] T a6cc719078d04018b6cb81bbc000528a P d495138f573f468abff8f34967cdfbf6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823): Network error: Client connection negotiation failed: client connection to 127.0.107.193:40823: connect: Connection refused (error 111)
I20260709 13:02:33.268362  9713 raft_consensus.cc:2468] T a6cc719078d04018b6cb81bbc000528a P 255b950088324813bcbbe4002928fba9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d495138f573f468abff8f34967cdfbf6 in term 2.
I20260709 13:02:33.269407  9756 leader_election.cc:304] T a6cc719078d04018b6cb81bbc000528a P d495138f573f468abff8f34967cdfbf6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 255b950088324813bcbbe4002928fba9, d495138f573f468abff8f34967cdfbf6; no voters: cf0ed7d88d88410788769a36241f22d9
I20260709 13:02:33.270099  9865 raft_consensus.cc:2804] T a6cc719078d04018b6cb81bbc000528a P d495138f573f468abff8f34967cdfbf6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:33.270520  9865 raft_consensus.cc:697] T a6cc719078d04018b6cb81bbc000528a P d495138f573f468abff8f34967cdfbf6 [term 2 LEADER]: Becoming Leader. State: Replica: d495138f573f468abff8f34967cdfbf6, State: Running, Role: LEADER
I20260709 13:02:33.271297  9865 consensus_queue.cc:237] T a6cc719078d04018b6cb81bbc000528a P d495138f573f468abff8f34967cdfbf6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:33.277776  9537 catalog_manager.cc:5697] T a6cc719078d04018b6cb81bbc000528a P d495138f573f468abff8f34967cdfbf6 reported cstate change: term changed from 1 to 2, leader changed from cf0ed7d88d88410788769a36241f22d9 (127.0.107.193) to d495138f573f468abff8f34967cdfbf6 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "d495138f573f468abff8f34967cdfbf6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } health_report { overall_health: HEALTHY } } }
W20260709 13:02:33.616448  9754 consensus_peers.cc:597] T 5c3b998087e5451cba6d53a1cc6c9477 P d495138f573f468abff8f34967cdfbf6 -> Peer cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823): Couldn't send request to peer cf0ed7d88d88410788769a36241f22d9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40823: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:33.637029  9713 raft_consensus.cc:1275] T 5c3b998087e5451cba6d53a1cc6c9477 P 255b950088324813bcbbe4002928fba9 [term 2 FOLLOWER]: Refusing update from remote peer d495138f573f468abff8f34967cdfbf6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:02:33.638243  9865 consensus_queue.cc:1048] T 5c3b998087e5451cba6d53a1cc6c9477 P d495138f573f468abff8f34967cdfbf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:02:33.704982  9586 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:02:33.725494  9713 raft_consensus.cc:1275] T a6cc719078d04018b6cb81bbc000528a P 255b950088324813bcbbe4002928fba9 [term 2 FOLLOWER]: Refusing update from remote peer d495138f573f468abff8f34967cdfbf6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:02:33.726789  9865 consensus_queue.cc:1048] T a6cc719078d04018b6cb81bbc000528a P d495138f573f468abff8f34967cdfbf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:02:33.741556  9754 consensus_peers.cc:597] T a6cc719078d04018b6cb81bbc000528a P d495138f573f468abff8f34967cdfbf6 -> Peer cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823): Couldn't send request to peer cf0ed7d88d88410788769a36241f22d9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40823: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:33.924700  9679 consensus_peers.cc:597] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P 255b950088324813bcbbe4002928fba9 -> Peer cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823): Couldn't send request to peer cf0ed7d88d88410788769a36241f22d9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40823: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:34.169685  9679 consensus_peers.cc:597] T 26555692bc3f487e99e16d30ec822d38 P 255b950088324813bcbbe4002928fba9 -> Peer cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823): Couldn't send request to peer cf0ed7d88d88410788769a36241f22d9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40823: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:34.202641  9754 consensus_peers.cc:597] T e7cfaa23415d4a69a5cf998bcdb1c83d P d495138f573f468abff8f34967cdfbf6 -> Peer cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823): Couldn't send request to peer cf0ed7d88d88410788769a36241f22d9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40823: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:34.203078  9754 consensus_peers.cc:597] T 62c912553c2b40ffac89862b3bd40ee7 P d495138f573f468abff8f34967cdfbf6 -> Peer cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823): Couldn't send request to peer cf0ed7d88d88410788769a36241f22d9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40823: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:34.296814  9754 consensus_peers.cc:597] T d3af616bce154a0290e2dfda0b625ec3 P d495138f573f468abff8f34967cdfbf6 -> Peer cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823): Couldn't send request to peer cf0ed7d88d88410788769a36241f22d9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40823: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:34.456013  9679 consensus_peers.cc:597] T 6ac83262048e44a28858e8a0e18ac678 P 255b950088324813bcbbe4002928fba9 -> Peer cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823): Couldn't send request to peer cf0ed7d88d88410788769a36241f22d9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40823: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:34.623077  9679 consensus_peers.cc:597] T bfc104a251f842409dcd0830c3371344 P 255b950088324813bcbbe4002928fba9 -> Peer cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823): Couldn't send request to peer cf0ed7d88d88410788769a36241f22d9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40823: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:34.628587  9679 consensus_peers.cc:597] T 6a8d453497c74035b98b1c401e674c74 P 255b950088324813bcbbe4002928fba9 -> Peer cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823): Couldn't send request to peer cf0ed7d88d88410788769a36241f22d9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40823: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:34.705967  9586 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:02:35.707001  9586 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:02:36.152770  9754 consensus_peers.cc:597] T a6cc719078d04018b6cb81bbc000528a P d495138f573f468abff8f34967cdfbf6 -> Peer cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823): Couldn't send request to peer cf0ed7d88d88410788769a36241f22d9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40823: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:36.193723  9754 consensus_peers.cc:597] T 5c3b998087e5451cba6d53a1cc6c9477 P d495138f573f468abff8f34967cdfbf6 -> Peer cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823): Couldn't send request to peer cf0ed7d88d88410788769a36241f22d9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40823: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:36.420116  9679 consensus_peers.cc:597] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P 255b950088324813bcbbe4002928fba9 -> Peer cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823): Couldn't send request to peer cf0ed7d88d88410788769a36241f22d9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40823: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:36.575506  9754 consensus_peers.cc:597] T d3af616bce154a0290e2dfda0b625ec3 P d495138f573f468abff8f34967cdfbf6 -> Peer cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823): Couldn't send request to peer cf0ed7d88d88410788769a36241f22d9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40823: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:02:36.602864  9754 consensus_peers.cc:597] T 62c912553c2b40ffac89862b3bd40ee7 P d495138f573f468abff8f34967cdfbf6 -> Peer cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823): Couldn't send request to peer cf0ed7d88d88410788769a36241f22d9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40823: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:36.643050   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:36.649819  9932 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:36.651055  9933 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:36.653478   431 server_base.cc:1061] running on GCE node
W20260709 13:02:36.653990  9935 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:36.656016   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:36.656342   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:36.656615   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602156656595 us; error 0 us; skew 500 ppm
I20260709 13:02:36.657320   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:36.660183   431 webserver.cc:533] Webserver started at http://127.0.107.193:37349/ using document root <none> and password file <none>
I20260709 13:02:36.660742   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:36.660956   431 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:02:36.664594   431 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.001s	sys 0.002s
I20260709 13:02:36.668159  9940 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:36.669044   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:02:36.669298   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601869227091-431-0/minicluster-data/ts-0-root
uuid: "cf0ed7d88d88410788769a36241f22d9"
format_stamp: "Formatted at 2026-07-09 13:02:29 on dist-test-slave-5mzn"
I20260709 13:02:36.669551   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601869227091-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601869227091-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783601869227091-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:36.699458   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:36.700510   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:36.702114   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:36.705482  9947 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 13:02:36.707998  9586 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:02:36.727283  9754 consensus_peers.cc:597] T e7cfaa23415d4a69a5cf998bcdb1c83d P d495138f573f468abff8f34967cdfbf6 -> Peer cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823): Couldn't send request to peer cf0ed7d88d88410788769a36241f22d9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40823: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:36.756742   431 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:02:36.757094   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.052s	user 0.002s	sys 0.000s
I20260709 13:02:36.757318   431 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:02:36.763556  9947 tablet_bootstrap.cc:492] T 6ac83262048e44a28858e8a0e18ac678 P cf0ed7d88d88410788769a36241f22d9: Bootstrap starting.
W20260709 13:02:36.763837  9679 consensus_peers.cc:597] T 26555692bc3f487e99e16d30ec822d38 P 255b950088324813bcbbe4002928fba9 -> Peer cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823): Couldn't send request to peer cf0ed7d88d88410788769a36241f22d9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40823: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:02:36.777783  9947 tablet_bootstrap.cc:492] T 6ac83262048e44a28858e8a0e18ac678 P cf0ed7d88d88410788769a36241f22d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:36.778668  9947 tablet_bootstrap.cc:492] T 6ac83262048e44a28858e8a0e18ac678 P cf0ed7d88d88410788769a36241f22d9: Bootstrap complete.
I20260709 13:02:36.779214  9947 ts_tablet_manager.cc:1403] T 6ac83262048e44a28858e8a0e18ac678 P cf0ed7d88d88410788769a36241f22d9: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.004s
I20260709 13:02:36.781271  9947 raft_consensus.cc:359] T 6ac83262048e44a28858e8a0e18ac678 P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } } peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } }
I20260709 13:02:36.781796  9947 raft_consensus.cc:740] T 6ac83262048e44a28858e8a0e18ac678 P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf0ed7d88d88410788769a36241f22d9, State: Initialized, Role: FOLLOWER
I20260709 13:02:36.782377  9947 consensus_queue.cc:260] T 6ac83262048e44a28858e8a0e18ac678 P cf0ed7d88d88410788769a36241f22d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } } peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } }
I20260709 13:02:36.784518  9947 ts_tablet_manager.cc:1434] T 6ac83262048e44a28858e8a0e18ac678 P cf0ed7d88d88410788769a36241f22d9: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:02:36.785233  9947 tablet_bootstrap.cc:492] T 5c3b998087e5451cba6d53a1cc6c9477 P cf0ed7d88d88410788769a36241f22d9: Bootstrap starting.
I20260709 13:02:36.798549  9947 tablet_bootstrap.cc:492] T 5c3b998087e5451cba6d53a1cc6c9477 P cf0ed7d88d88410788769a36241f22d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:02:36.799311  9947 tablet_bootstrap.cc:492] T 5c3b998087e5451cba6d53a1cc6c9477 P cf0ed7d88d88410788769a36241f22d9: Bootstrap complete.
I20260709 13:02:36.799847  9947 ts_tablet_manager.cc:1403] T 5c3b998087e5451cba6d53a1cc6c9477 P cf0ed7d88d88410788769a36241f22d9: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.000s
I20260709 13:02:36.801885   431 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:02:36.802253   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.045s	user 0.043s	sys 0.000s
I20260709 13:02:36.802021  9947 raft_consensus.cc:359] T 5c3b998087e5451cba6d53a1cc6c9477 P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:36.802886  9947 raft_consensus.cc:740] T 5c3b998087e5451cba6d53a1cc6c9477 P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf0ed7d88d88410788769a36241f22d9, State: Initialized, Role: FOLLOWER
I20260709 13:02:36.803645  9947 consensus_queue.cc:260] T 5c3b998087e5451cba6d53a1cc6c9477 P cf0ed7d88d88410788769a36241f22d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:36.805182  9947 ts_tablet_manager.cc:1434] T 5c3b998087e5451cba6d53a1cc6c9477 P cf0ed7d88d88410788769a36241f22d9: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.003s
I20260709 13:02:36.805838  9947 tablet_bootstrap.cc:492] T e7cfaa23415d4a69a5cf998bcdb1c83d P cf0ed7d88d88410788769a36241f22d9: Bootstrap starting.
I20260709 13:02:36.817790  9947 tablet_bootstrap.cc:492] T e7cfaa23415d4a69a5cf998bcdb1c83d P cf0ed7d88d88410788769a36241f22d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:36.818835  9947 tablet_bootstrap.cc:492] T e7cfaa23415d4a69a5cf998bcdb1c83d P cf0ed7d88d88410788769a36241f22d9: Bootstrap complete.
I20260709 13:02:36.819496  9947 ts_tablet_manager.cc:1403] T e7cfaa23415d4a69a5cf998bcdb1c83d P cf0ed7d88d88410788769a36241f22d9: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 13:02:36.821940  9947 raft_consensus.cc:359] T e7cfaa23415d4a69a5cf998bcdb1c83d P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:36.822561  9947 raft_consensus.cc:740] T e7cfaa23415d4a69a5cf998bcdb1c83d P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf0ed7d88d88410788769a36241f22d9, State: Initialized, Role: FOLLOWER
I20260709 13:02:36.823355  9947 consensus_queue.cc:260] T e7cfaa23415d4a69a5cf998bcdb1c83d P cf0ed7d88d88410788769a36241f22d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:36.825582  9947 ts_tablet_manager.cc:1434] T e7cfaa23415d4a69a5cf998bcdb1c83d P cf0ed7d88d88410788769a36241f22d9: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:02:36.826534  9947 tablet_bootstrap.cc:492] T bfc104a251f842409dcd0830c3371344 P cf0ed7d88d88410788769a36241f22d9: Bootstrap starting.
I20260709 13:02:36.838549  9947 tablet_bootstrap.cc:492] T bfc104a251f842409dcd0830c3371344 P cf0ed7d88d88410788769a36241f22d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:36.839365  9947 tablet_bootstrap.cc:492] T bfc104a251f842409dcd0830c3371344 P cf0ed7d88d88410788769a36241f22d9: Bootstrap complete.
I20260709 13:02:36.839952  9947 ts_tablet_manager.cc:1403] T bfc104a251f842409dcd0830c3371344 P cf0ed7d88d88410788769a36241f22d9: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 13:02:36.841902  9947 raft_consensus.cc:359] T bfc104a251f842409dcd0830c3371344 P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:36.842443  9947 raft_consensus.cc:740] T bfc104a251f842409dcd0830c3371344 P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf0ed7d88d88410788769a36241f22d9, State: Initialized, Role: FOLLOWER
I20260709 13:02:36.843082  9947 consensus_queue.cc:260] T bfc104a251f842409dcd0830c3371344 P cf0ed7d88d88410788769a36241f22d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:36.845017  9947 ts_tablet_manager.cc:1434] T bfc104a251f842409dcd0830c3371344 P cf0ed7d88d88410788769a36241f22d9: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:02:36.845723  9947 tablet_bootstrap.cc:492] T d3af616bce154a0290e2dfda0b625ec3 P cf0ed7d88d88410788769a36241f22d9: Bootstrap starting.
I20260709 13:02:36.863255  9947 tablet_bootstrap.cc:492] T d3af616bce154a0290e2dfda0b625ec3 P cf0ed7d88d88410788769a36241f22d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:36.864069  9947 tablet_bootstrap.cc:492] T d3af616bce154a0290e2dfda0b625ec3 P cf0ed7d88d88410788769a36241f22d9: Bootstrap complete.
I20260709 13:02:36.864713  9947 ts_tablet_manager.cc:1403] T d3af616bce154a0290e2dfda0b625ec3 P cf0ed7d88d88410788769a36241f22d9: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.007s
I20260709 13:02:36.866668  9947 raft_consensus.cc:359] T d3af616bce154a0290e2dfda0b625ec3 P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:36.867223  9947 raft_consensus.cc:740] T d3af616bce154a0290e2dfda0b625ec3 P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf0ed7d88d88410788769a36241f22d9, State: Initialized, Role: FOLLOWER
I20260709 13:02:36.867384   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:40823
I20260709 13:02:36.867465 10009 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:40823 every 8 connection(s)
I20260709 13:02:36.867897  9947 consensus_queue.cc:260] T d3af616bce154a0290e2dfda0b625ec3 P cf0ed7d88d88410788769a36241f22d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:36.870203  9947 ts_tablet_manager.cc:1434] T d3af616bce154a0290e2dfda0b625ec3 P cf0ed7d88d88410788769a36241f22d9: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:02:36.871052  9947 tablet_bootstrap.cc:492] T 6a8d453497c74035b98b1c401e674c74 P cf0ed7d88d88410788769a36241f22d9: Bootstrap starting.
I20260709 13:02:36.873572   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:36.891719  9947 tablet_bootstrap.cc:492] T 6a8d453497c74035b98b1c401e674c74 P cf0ed7d88d88410788769a36241f22d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:36.892939  9947 tablet_bootstrap.cc:492] T 6a8d453497c74035b98b1c401e674c74 P cf0ed7d88d88410788769a36241f22d9: Bootstrap complete.
I20260709 13:02:36.893744  9947 ts_tablet_manager.cc:1403] T 6a8d453497c74035b98b1c401e674c74 P cf0ed7d88d88410788769a36241f22d9: Time spent bootstrapping tablet: real 0.023s	user 0.018s	sys 0.004s
I20260709 13:02:36.896731  9947 raft_consensus.cc:359] T 6a8d453497c74035b98b1c401e674c74 P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:36.897589  9947 raft_consensus.cc:740] T 6a8d453497c74035b98b1c401e674c74 P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf0ed7d88d88410788769a36241f22d9, State: Initialized, Role: FOLLOWER
I20260709 13:02:36.898545  9947 consensus_queue.cc:260] T 6a8d453497c74035b98b1c401e674c74 P cf0ed7d88d88410788769a36241f22d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:36.900600  9947 ts_tablet_manager.cc:1434] T 6a8d453497c74035b98b1c401e674c74 P cf0ed7d88d88410788769a36241f22d9: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.004s
I20260709 13:02:36.901419  9947 tablet_bootstrap.cc:492] T 62c912553c2b40ffac89862b3bd40ee7 P cf0ed7d88d88410788769a36241f22d9: Bootstrap starting.
I20260709 13:02:36.907408 10010 heartbeater.cc:344] Connected to a master server at 127.0.107.254:41909
I20260709 13:02:36.907925 10010 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:36.908905 10010 heartbeater.cc:507] Master 127.0.107.254:41909 requested a full tablet report, sending...
I20260709 13:02:36.909355  9713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26555692bc3f487e99e16d30ec822d38"
dest_uuid: "255b950088324813bcbbe4002928fba9"
mode: GRACEFUL
new_leader_uuid: "d495138f573f468abff8f34967cdfbf6"
 from {username='slave'} at 127.0.0.1:33198
I20260709 13:02:36.910166  9713 raft_consensus.cc:606] T 26555692bc3f487e99e16d30ec822d38 P 255b950088324813bcbbe4002928fba9 [term 1 LEADER]: Received request to transfer leadership to TS d495138f573f468abff8f34967cdfbf6
I20260709 13:02:36.915006  9537 ts_manager.cc:194] Re-registered known tserver with Master: cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823)
I20260709 13:02:36.920922  9947 tablet_bootstrap.cc:492] T 62c912553c2b40ffac89862b3bd40ee7 P cf0ed7d88d88410788769a36241f22d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:36.921907  9947 tablet_bootstrap.cc:492] T 62c912553c2b40ffac89862b3bd40ee7 P cf0ed7d88d88410788769a36241f22d9: Bootstrap complete.
I20260709 13:02:36.922478  9947 ts_tablet_manager.cc:1403] T 62c912553c2b40ffac89862b3bd40ee7 P cf0ed7d88d88410788769a36241f22d9: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.005s
I20260709 13:02:36.924593  9947 raft_consensus.cc:359] T 62c912553c2b40ffac89862b3bd40ee7 P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:36.925307  9947 raft_consensus.cc:740] T 62c912553c2b40ffac89862b3bd40ee7 P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf0ed7d88d88410788769a36241f22d9, State: Initialized, Role: FOLLOWER
I20260709 13:02:36.926170  9537 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56350
I20260709 13:02:36.926080  9947 consensus_queue.cc:260] T 62c912553c2b40ffac89862b3bd40ee7 P cf0ed7d88d88410788769a36241f22d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:36.928370  9947 ts_tablet_manager.cc:1434] T 62c912553c2b40ffac89862b3bd40ee7 P cf0ed7d88d88410788769a36241f22d9: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:02:36.929237  9947 tablet_bootstrap.cc:492] T a6cc719078d04018b6cb81bbc000528a P cf0ed7d88d88410788769a36241f22d9: Bootstrap starting.
I20260709 13:02:36.929788 10010 heartbeater.cc:499] Master 127.0.107.254:41909 was elected leader, sending a full tablet report...
I20260709 13:02:36.930783  9790 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3af616bce154a0290e2dfda0b625ec3"
dest_uuid: "d495138f573f468abff8f34967cdfbf6"
mode: GRACEFUL
new_leader_uuid: "255b950088324813bcbbe4002928fba9"
 from {username='slave'} at 127.0.0.1:36462
I20260709 13:02:36.931411  9790 raft_consensus.cc:606] T d3af616bce154a0290e2dfda0b625ec3 P d495138f573f468abff8f34967cdfbf6 [term 1 LEADER]: Received request to transfer leadership to TS 255b950088324813bcbbe4002928fba9
I20260709 13:02:36.932824   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:02:36.933507   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:36.934226   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:36.945547  9947 tablet_bootstrap.cc:492] T a6cc719078d04018b6cb81bbc000528a P cf0ed7d88d88410788769a36241f22d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:02:36.946755  9947 tablet_bootstrap.cc:492] T a6cc719078d04018b6cb81bbc000528a P cf0ed7d88d88410788769a36241f22d9: Bootstrap complete.
I20260709 13:02:36.947494  9947 ts_tablet_manager.cc:1403] T a6cc719078d04018b6cb81bbc000528a P cf0ed7d88d88410788769a36241f22d9: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.006s
I20260709 13:02:36.949988  9947 raft_consensus.cc:359] T a6cc719078d04018b6cb81bbc000528a P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:36.950860  9947 raft_consensus.cc:740] T a6cc719078d04018b6cb81bbc000528a P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf0ed7d88d88410788769a36241f22d9, State: Initialized, Role: FOLLOWER
I20260709 13:02:36.951465  9947 consensus_queue.cc:260] T a6cc719078d04018b6cb81bbc000528a P cf0ed7d88d88410788769a36241f22d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:36.953089  9947 ts_tablet_manager.cc:1434] T a6cc719078d04018b6cb81bbc000528a P cf0ed7d88d88410788769a36241f22d9: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 13:02:36.953763  9947 tablet_bootstrap.cc:492] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P cf0ed7d88d88410788769a36241f22d9: Bootstrap starting.
I20260709 13:02:36.968973  9947 tablet_bootstrap.cc:492] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P cf0ed7d88d88410788769a36241f22d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:36.969955  9947 tablet_bootstrap.cc:492] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P cf0ed7d88d88410788769a36241f22d9: Bootstrap complete.
I20260709 13:02:36.970686  9947 ts_tablet_manager.cc:1403] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P cf0ed7d88d88410788769a36241f22d9: Time spent bootstrapping tablet: real 0.017s	user 0.013s	sys 0.000s
I20260709 13:02:36.973414  9947 raft_consensus.cc:359] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:36.974231  9947 raft_consensus.cc:740] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf0ed7d88d88410788769a36241f22d9, State: Initialized, Role: FOLLOWER
I20260709 13:02:36.974923  9947 consensus_queue.cc:260] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P cf0ed7d88d88410788769a36241f22d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:36.976603  9947 ts_tablet_manager.cc:1434] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P cf0ed7d88d88410788769a36241f22d9: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.000s
I20260709 13:02:36.977376  9947 tablet_bootstrap.cc:492] T 26555692bc3f487e99e16d30ec822d38 P cf0ed7d88d88410788769a36241f22d9: Bootstrap starting.
I20260709 13:02:36.989276  9947 tablet_bootstrap.cc:492] T 26555692bc3f487e99e16d30ec822d38 P cf0ed7d88d88410788769a36241f22d9: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:02:36.989993  9947 tablet_bootstrap.cc:492] T 26555692bc3f487e99e16d30ec822d38 P cf0ed7d88d88410788769a36241f22d9: Bootstrap complete.
I20260709 13:02:36.990608  9947 ts_tablet_manager.cc:1403] T 26555692bc3f487e99e16d30ec822d38 P cf0ed7d88d88410788769a36241f22d9: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:02:36.992678  9947 raft_consensus.cc:359] T 26555692bc3f487e99e16d30ec822d38 P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:36.993256  9947 raft_consensus.cc:385] T 26555692bc3f487e99e16d30ec822d38 P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:36.993497  9947 raft_consensus.cc:740] T 26555692bc3f487e99e16d30ec822d38 P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf0ed7d88d88410788769a36241f22d9, State: Initialized, Role: FOLLOWER
I20260709 13:02:36.994093  9947 consensus_queue.cc:260] T 26555692bc3f487e99e16d30ec822d38 P cf0ed7d88d88410788769a36241f22d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:36.995903  9947 ts_tablet_manager.cc:1434] T 26555692bc3f487e99e16d30ec822d38 P cf0ed7d88d88410788769a36241f22d9: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:02:37.030759  9984 raft_consensus.cc:3060] T a6cc719078d04018b6cb81bbc000528a P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:37.036903  9984 pending_rounds.cc:85] T a6cc719078d04018b6cb81bbc000528a P cf0ed7d88d88410788769a36241f22d9: Aborting all ops after (but not including) 0
I20260709 13:02:37.037190  9984 pending_rounds.cc:107] T a6cc719078d04018b6cb81bbc000528a P cf0ed7d88d88410788769a36241f22d9: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:02:37.037465  9984 raft_consensus.cc:2889] T a6cc719078d04018b6cb81bbc000528a P cf0ed7d88d88410788769a36241f22d9 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:37.040409 10024 raft_consensus.cc:993] T d3af616bce154a0290e2dfda0b625ec3 P d495138f573f468abff8f34967cdfbf6: : Instructing follower 255b950088324813bcbbe4002928fba9 to start an election
I20260709 13:02:37.041162  9928 raft_consensus.cc:1081] T d3af616bce154a0290e2dfda0b625ec3 P d495138f573f468abff8f34967cdfbf6 [term 1 LEADER]: Signalling peer 255b950088324813bcbbe4002928fba9 to start an election
I20260709 13:02:37.044006  9713 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d3af616bce154a0290e2dfda0b625ec3"
dest_uuid: "255b950088324813bcbbe4002928fba9"
 from {username='slave'} at 127.0.0.1:33182
I20260709 13:02:37.044622  9713 raft_consensus.cc:493] T d3af616bce154a0290e2dfda0b625ec3 P 255b950088324813bcbbe4002928fba9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:37.045003  9713 raft_consensus.cc:3060] T d3af616bce154a0290e2dfda0b625ec3 P 255b950088324813bcbbe4002928fba9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:37.052012  9713 raft_consensus.cc:515] T d3af616bce154a0290e2dfda0b625ec3 P 255b950088324813bcbbe4002928fba9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:37.054201  9713 leader_election.cc:290] T d3af616bce154a0290e2dfda0b625ec3 P 255b950088324813bcbbe4002928fba9 [CANDIDATE]: Term 2 election: Requested vote from peers cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823), d495138f573f468abff8f34967cdfbf6 (127.0.107.195:44885)
I20260709 13:02:37.055436  9984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3af616bce154a0290e2dfda0b625ec3" candidate_uuid: "255b950088324813bcbbe4002928fba9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cf0ed7d88d88410788769a36241f22d9"
I20260709 13:02:37.056090  9984 raft_consensus.cc:3060] T d3af616bce154a0290e2dfda0b625ec3 P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:37.057541  9790 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3af616bce154a0290e2dfda0b625ec3" candidate_uuid: "255b950088324813bcbbe4002928fba9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d495138f573f468abff8f34967cdfbf6"
I20260709 13:02:37.058176  9790 raft_consensus.cc:3055] T d3af616bce154a0290e2dfda0b625ec3 P d495138f573f468abff8f34967cdfbf6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:37.058485  9790 raft_consensus.cc:740] T d3af616bce154a0290e2dfda0b625ec3 P d495138f573f468abff8f34967cdfbf6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d495138f573f468abff8f34967cdfbf6, State: Running, Role: LEADER
I20260709 13:02:37.059295  9790 consensus_queue.cc:260] T d3af616bce154a0290e2dfda0b625ec3 P d495138f573f468abff8f34967cdfbf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:37.060642  9790 raft_consensus.cc:3060] T d3af616bce154a0290e2dfda0b625ec3 P d495138f573f468abff8f34967cdfbf6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:37.063510  9984 raft_consensus.cc:2468] T d3af616bce154a0290e2dfda0b625ec3 P cf0ed7d88d88410788769a36241f22d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 255b950088324813bcbbe4002928fba9 in term 2.
I20260709 13:02:37.064798  9679 leader_election.cc:304] T d3af616bce154a0290e2dfda0b625ec3 P 255b950088324813bcbbe4002928fba9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 255b950088324813bcbbe4002928fba9, cf0ed7d88d88410788769a36241f22d9; no voters: 
I20260709 13:02:37.065486  9929 raft_consensus.cc:2804] T d3af616bce154a0290e2dfda0b625ec3 P 255b950088324813bcbbe4002928fba9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:37.065946  9929 raft_consensus.cc:697] T d3af616bce154a0290e2dfda0b625ec3 P 255b950088324813bcbbe4002928fba9 [term 2 LEADER]: Becoming Leader. State: Replica: 255b950088324813bcbbe4002928fba9, State: Running, Role: LEADER
I20260709 13:02:37.066802  9790 raft_consensus.cc:2468] T d3af616bce154a0290e2dfda0b625ec3 P d495138f573f468abff8f34967cdfbf6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 255b950088324813bcbbe4002928fba9 in term 2.
I20260709 13:02:37.066716  9929 consensus_queue.cc:237] T d3af616bce154a0290e2dfda0b625ec3 P 255b950088324813bcbbe4002928fba9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:37.073887  9537 catalog_manager.cc:5697] T d3af616bce154a0290e2dfda0b625ec3 P 255b950088324813bcbbe4002928fba9 reported cstate change: term changed from 1 to 2, leader changed from d495138f573f468abff8f34967cdfbf6 (127.0.107.195) to 255b950088324813bcbbe4002928fba9 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "255b950088324813bcbbe4002928fba9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:37.196308  9984 raft_consensus.cc:3060] T 5c3b998087e5451cba6d53a1cc6c9477 P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:37.201381  9984 pending_rounds.cc:85] T 5c3b998087e5451cba6d53a1cc6c9477 P cf0ed7d88d88410788769a36241f22d9: Aborting all ops after (but not including) 0
I20260709 13:02:37.201653  9984 pending_rounds.cc:107] T 5c3b998087e5451cba6d53a1cc6c9477 P cf0ed7d88d88410788769a36241f22d9: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:02:37.201879  9984 raft_consensus.cc:2889] T 5c3b998087e5451cba6d53a1cc6c9477 P cf0ed7d88d88410788769a36241f22d9 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:02:37.265542  9984 raft_consensus.cc:3060] T 26555692bc3f487e99e16d30ec822d38 P cf0ed7d88d88410788769a36241f22d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:37.292640  9931 raft_consensus.cc:993] T 26555692bc3f487e99e16d30ec822d38 P 255b950088324813bcbbe4002928fba9: : Instructing follower d495138f573f468abff8f34967cdfbf6 to start an election
I20260709 13:02:37.293061  9929 raft_consensus.cc:1081] T 26555692bc3f487e99e16d30ec822d38 P 255b950088324813bcbbe4002928fba9 [term 1 LEADER]: Signalling peer d495138f573f468abff8f34967cdfbf6 to start an election
I20260709 13:02:37.294448  9790 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "26555692bc3f487e99e16d30ec822d38"
dest_uuid: "d495138f573f468abff8f34967cdfbf6"
 from {username='slave'} at 127.0.0.1:36432
I20260709 13:02:37.294955  9790 raft_consensus.cc:493] T 26555692bc3f487e99e16d30ec822d38 P d495138f573f468abff8f34967cdfbf6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:37.295271  9790 raft_consensus.cc:3060] T 26555692bc3f487e99e16d30ec822d38 P d495138f573f468abff8f34967cdfbf6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:37.300369  9790 raft_consensus.cc:515] T 26555692bc3f487e99e16d30ec822d38 P d495138f573f468abff8f34967cdfbf6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:37.301992  9790 leader_election.cc:290] T 26555692bc3f487e99e16d30ec822d38 P d495138f573f468abff8f34967cdfbf6 [CANDIDATE]: Term 2 election: Requested vote from peers cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823), 255b950088324813bcbbe4002928fba9 (127.0.107.194:34793)
I20260709 13:02:37.302841  9984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26555692bc3f487e99e16d30ec822d38" candidate_uuid: "d495138f573f468abff8f34967cdfbf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cf0ed7d88d88410788769a36241f22d9"
I20260709 13:02:37.303002  9713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26555692bc3f487e99e16d30ec822d38" candidate_uuid: "d495138f573f468abff8f34967cdfbf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "255b950088324813bcbbe4002928fba9"
I20260709 13:02:37.303412  9984 raft_consensus.cc:3060] T 26555692bc3f487e99e16d30ec822d38 P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:37.303620  9713 raft_consensus.cc:3055] T 26555692bc3f487e99e16d30ec822d38 P 255b950088324813bcbbe4002928fba9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:37.303985  9713 raft_consensus.cc:740] T 26555692bc3f487e99e16d30ec822d38 P 255b950088324813bcbbe4002928fba9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 255b950088324813bcbbe4002928fba9, State: Running, Role: LEADER
I20260709 13:02:37.304651  9713 consensus_queue.cc:260] T 26555692bc3f487e99e16d30ec822d38 P 255b950088324813bcbbe4002928fba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:37.305590  9713 raft_consensus.cc:3060] T 26555692bc3f487e99e16d30ec822d38 P 255b950088324813bcbbe4002928fba9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:37.308365  9984 raft_consensus.cc:2468] T 26555692bc3f487e99e16d30ec822d38 P cf0ed7d88d88410788769a36241f22d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d495138f573f468abff8f34967cdfbf6 in term 2.
I20260709 13:02:37.309458  9754 leader_election.cc:304] T 26555692bc3f487e99e16d30ec822d38 P d495138f573f468abff8f34967cdfbf6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cf0ed7d88d88410788769a36241f22d9, d495138f573f468abff8f34967cdfbf6; no voters: 
I20260709 13:02:37.310181 10024 raft_consensus.cc:2804] T 26555692bc3f487e99e16d30ec822d38 P d495138f573f468abff8f34967cdfbf6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:37.310578 10024 raft_consensus.cc:697] T 26555692bc3f487e99e16d30ec822d38 P d495138f573f468abff8f34967cdfbf6 [term 2 LEADER]: Becoming Leader. State: Replica: d495138f573f468abff8f34967cdfbf6, State: Running, Role: LEADER
I20260709 13:02:37.310801  9713 raft_consensus.cc:2468] T 26555692bc3f487e99e16d30ec822d38 P 255b950088324813bcbbe4002928fba9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d495138f573f468abff8f34967cdfbf6 in term 2.
I20260709 13:02:37.311312 10024 consensus_queue.cc:237] T 26555692bc3f487e99e16d30ec822d38 P d495138f573f468abff8f34967cdfbf6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:37.318799  9537 catalog_manager.cc:5697] T 26555692bc3f487e99e16d30ec822d38 P d495138f573f468abff8f34967cdfbf6 reported cstate change: term changed from 1 to 2, leader changed from 255b950088324813bcbbe4002928fba9 (127.0.107.194) to d495138f573f468abff8f34967cdfbf6 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "d495138f573f468abff8f34967cdfbf6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:37.511600  9984 raft_consensus.cc:1275] T d3af616bce154a0290e2dfda0b625ec3 P cf0ed7d88d88410788769a36241f22d9 [term 2 FOLLOWER]: Refusing update from remote peer 255b950088324813bcbbe4002928fba9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:37.513010 10037 consensus_queue.cc:1048] T d3af616bce154a0290e2dfda0b625ec3 P 255b950088324813bcbbe4002928fba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:37.523977  9790 raft_consensus.cc:1275] T d3af616bce154a0290e2dfda0b625ec3 P d495138f573f468abff8f34967cdfbf6 [term 2 FOLLOWER]: Refusing update from remote peer 255b950088324813bcbbe4002928fba9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:37.525578  9929 consensus_queue.cc:1048] T d3af616bce154a0290e2dfda0b625ec3 P 255b950088324813bcbbe4002928fba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:02:37.709138  9586 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:02:37.856025  9713 raft_consensus.cc:1275] T 26555692bc3f487e99e16d30ec822d38 P 255b950088324813bcbbe4002928fba9 [term 2 FOLLOWER]: Refusing update from remote peer d495138f573f468abff8f34967cdfbf6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:37.857483 10024 consensus_queue.cc:1048] T 26555692bc3f487e99e16d30ec822d38 P d495138f573f468abff8f34967cdfbf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:37.865932  9984 raft_consensus.cc:1275] T 26555692bc3f487e99e16d30ec822d38 P cf0ed7d88d88410788769a36241f22d9 [term 2 FOLLOWER]: Refusing update from remote peer d495138f573f468abff8f34967cdfbf6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:37.867373  9928 consensus_queue.cc:1048] T 26555692bc3f487e99e16d30ec822d38 P d495138f573f468abff8f34967cdfbf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:37.942754   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:37.951062  9713 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a8d453497c74035b98b1c401e674c74"
dest_uuid: "255b950088324813bcbbe4002928fba9"
mode: GRACEFUL
new_leader_uuid: "d495138f573f468abff8f34967cdfbf6"
 from {username='slave'} at 127.0.0.1:33198
I20260709 13:02:37.951648  9713 raft_consensus.cc:606] T 6a8d453497c74035b98b1c401e674c74 P 255b950088324813bcbbe4002928fba9 [term 1 LEADER]: Received request to transfer leadership to TS d495138f573f468abff8f34967cdfbf6
I20260709 13:02:37.954154  9790 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7cfaa23415d4a69a5cf998bcdb1c83d"
dest_uuid: "d495138f573f468abff8f34967cdfbf6"
mode: GRACEFUL
new_leader_uuid: "255b950088324813bcbbe4002928fba9"
 from {username='slave'} at 127.0.0.1:36462
I20260709 13:02:37.954674  9790 raft_consensus.cc:606] T e7cfaa23415d4a69a5cf998bcdb1c83d P d495138f573f468abff8f34967cdfbf6 [term 1 LEADER]: Received request to transfer leadership to TS 255b950088324813bcbbe4002928fba9
I20260709 13:02:37.955760   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:02:37.956251   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:37.956849   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:38.303054  9931 raft_consensus.cc:993] T 6a8d453497c74035b98b1c401e674c74 P 255b950088324813bcbbe4002928fba9: : Instructing follower d495138f573f468abff8f34967cdfbf6 to start an election
I20260709 13:02:38.303475 10037 raft_consensus.cc:1081] T 6a8d453497c74035b98b1c401e674c74 P 255b950088324813bcbbe4002928fba9 [term 1 LEADER]: Signalling peer d495138f573f468abff8f34967cdfbf6 to start an election
I20260709 13:02:38.304824  9789 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a8d453497c74035b98b1c401e674c74"
dest_uuid: "d495138f573f468abff8f34967cdfbf6"
 from {username='slave'} at 127.0.0.1:36432
I20260709 13:02:38.305352  9789 raft_consensus.cc:493] T 6a8d453497c74035b98b1c401e674c74 P d495138f573f468abff8f34967cdfbf6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:38.305645  9789 raft_consensus.cc:3060] T 6a8d453497c74035b98b1c401e674c74 P d495138f573f468abff8f34967cdfbf6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:38.311895  9789 raft_consensus.cc:515] T 6a8d453497c74035b98b1c401e674c74 P d495138f573f468abff8f34967cdfbf6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:38.313601  9789 leader_election.cc:290] T 6a8d453497c74035b98b1c401e674c74 P d495138f573f468abff8f34967cdfbf6 [CANDIDATE]: Term 2 election: Requested vote from peers cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823), 255b950088324813bcbbe4002928fba9 (127.0.107.194:34793)
I20260709 13:02:38.314337  9984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a8d453497c74035b98b1c401e674c74" candidate_uuid: "d495138f573f468abff8f34967cdfbf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cf0ed7d88d88410788769a36241f22d9"
I20260709 13:02:38.314579  9713 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a8d453497c74035b98b1c401e674c74" candidate_uuid: "d495138f573f468abff8f34967cdfbf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "255b950088324813bcbbe4002928fba9"
I20260709 13:02:38.315121  9984 raft_consensus.cc:3060] T 6a8d453497c74035b98b1c401e674c74 P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:38.315224  9713 raft_consensus.cc:3055] T 6a8d453497c74035b98b1c401e674c74 P 255b950088324813bcbbe4002928fba9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:38.315625  9713 raft_consensus.cc:740] T 6a8d453497c74035b98b1c401e674c74 P 255b950088324813bcbbe4002928fba9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 255b950088324813bcbbe4002928fba9, State: Running, Role: LEADER
I20260709 13:02:38.316413  9713 consensus_queue.cc:260] T 6a8d453497c74035b98b1c401e674c74 P 255b950088324813bcbbe4002928fba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:38.317679  9713 raft_consensus.cc:3060] T 6a8d453497c74035b98b1c401e674c74 P 255b950088324813bcbbe4002928fba9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:38.323406  9984 raft_consensus.cc:2468] T 6a8d453497c74035b98b1c401e674c74 P cf0ed7d88d88410788769a36241f22d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d495138f573f468abff8f34967cdfbf6 in term 2.
I20260709 13:02:38.325347  9713 raft_consensus.cc:2468] T 6a8d453497c74035b98b1c401e674c74 P 255b950088324813bcbbe4002928fba9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d495138f573f468abff8f34967cdfbf6 in term 2.
I20260709 13:02:38.329265  9754 leader_election.cc:304] T 6a8d453497c74035b98b1c401e674c74 P d495138f573f468abff8f34967cdfbf6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cf0ed7d88d88410788769a36241f22d9, d495138f573f468abff8f34967cdfbf6; no voters: 
I20260709 13:02:38.330154 10036 raft_consensus.cc:2804] T 6a8d453497c74035b98b1c401e674c74 P d495138f573f468abff8f34967cdfbf6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:38.330673 10036 raft_consensus.cc:697] T 6a8d453497c74035b98b1c401e674c74 P d495138f573f468abff8f34967cdfbf6 [term 2 LEADER]: Becoming Leader. State: Replica: d495138f573f468abff8f34967cdfbf6, State: Running, Role: LEADER
I20260709 13:02:38.331689 10036 consensus_queue.cc:237] T 6a8d453497c74035b98b1c401e674c74 P d495138f573f468abff8f34967cdfbf6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:38.342375 10044 raft_consensus.cc:993] T e7cfaa23415d4a69a5cf998bcdb1c83d P d495138f573f468abff8f34967cdfbf6: : Instructing follower 255b950088324813bcbbe4002928fba9 to start an election
I20260709 13:02:38.342988 10043 raft_consensus.cc:1081] T e7cfaa23415d4a69a5cf998bcdb1c83d P d495138f573f468abff8f34967cdfbf6 [term 1 LEADER]: Signalling peer 255b950088324813bcbbe4002928fba9 to start an election
I20260709 13:02:38.342628  9537 catalog_manager.cc:5697] T 6a8d453497c74035b98b1c401e674c74 P d495138f573f468abff8f34967cdfbf6 reported cstate change: term changed from 1 to 2, leader changed from 255b950088324813bcbbe4002928fba9 (127.0.107.194) to d495138f573f468abff8f34967cdfbf6 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "d495138f573f468abff8f34967cdfbf6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:38.344635  9714 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7cfaa23415d4a69a5cf998bcdb1c83d"
dest_uuid: "255b950088324813bcbbe4002928fba9"
 from {username='slave'} at 127.0.0.1:33182
I20260709 13:02:38.345232  9714 raft_consensus.cc:493] T e7cfaa23415d4a69a5cf998bcdb1c83d P 255b950088324813bcbbe4002928fba9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:38.345705  9714 raft_consensus.cc:3060] T e7cfaa23415d4a69a5cf998bcdb1c83d P 255b950088324813bcbbe4002928fba9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:38.353019  9714 raft_consensus.cc:515] T e7cfaa23415d4a69a5cf998bcdb1c83d P 255b950088324813bcbbe4002928fba9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:38.355891  9714 leader_election.cc:290] T e7cfaa23415d4a69a5cf998bcdb1c83d P 255b950088324813bcbbe4002928fba9 [CANDIDATE]: Term 2 election: Requested vote from peers cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823), d495138f573f468abff8f34967cdfbf6 (127.0.107.195:44885)
I20260709 13:02:38.356233  9984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cfaa23415d4a69a5cf998bcdb1c83d" candidate_uuid: "255b950088324813bcbbe4002928fba9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cf0ed7d88d88410788769a36241f22d9"
I20260709 13:02:38.356561  9789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cfaa23415d4a69a5cf998bcdb1c83d" candidate_uuid: "255b950088324813bcbbe4002928fba9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d495138f573f468abff8f34967cdfbf6"
I20260709 13:02:38.356990  9984 raft_consensus.cc:3060] T e7cfaa23415d4a69a5cf998bcdb1c83d P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:38.357246  9789 raft_consensus.cc:3055] T e7cfaa23415d4a69a5cf998bcdb1c83d P d495138f573f468abff8f34967cdfbf6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:38.357622  9789 raft_consensus.cc:740] T e7cfaa23415d4a69a5cf998bcdb1c83d P d495138f573f468abff8f34967cdfbf6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d495138f573f468abff8f34967cdfbf6, State: Running, Role: LEADER
I20260709 13:02:38.358317  9789 consensus_queue.cc:260] T e7cfaa23415d4a69a5cf998bcdb1c83d P d495138f573f468abff8f34967cdfbf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:38.359231  9789 raft_consensus.cc:3060] T e7cfaa23415d4a69a5cf998bcdb1c83d P d495138f573f468abff8f34967cdfbf6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:38.362617  9984 raft_consensus.cc:2468] T e7cfaa23415d4a69a5cf998bcdb1c83d P cf0ed7d88d88410788769a36241f22d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 255b950088324813bcbbe4002928fba9 in term 2.
I20260709 13:02:38.363929  9679 leader_election.cc:304] T e7cfaa23415d4a69a5cf998bcdb1c83d P 255b950088324813bcbbe4002928fba9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 255b950088324813bcbbe4002928fba9, cf0ed7d88d88410788769a36241f22d9; no voters: 
I20260709 13:02:38.364809 10037 raft_consensus.cc:2804] T e7cfaa23415d4a69a5cf998bcdb1c83d P 255b950088324813bcbbe4002928fba9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:38.365258 10037 raft_consensus.cc:697] T e7cfaa23415d4a69a5cf998bcdb1c83d P 255b950088324813bcbbe4002928fba9 [term 2 LEADER]: Becoming Leader. State: Replica: 255b950088324813bcbbe4002928fba9, State: Running, Role: LEADER
I20260709 13:02:38.365592  9789 raft_consensus.cc:2468] T e7cfaa23415d4a69a5cf998bcdb1c83d P d495138f573f468abff8f34967cdfbf6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 255b950088324813bcbbe4002928fba9 in term 2.
I20260709 13:02:38.366132 10037 consensus_queue.cc:237] T e7cfaa23415d4a69a5cf998bcdb1c83d P 255b950088324813bcbbe4002928fba9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:38.373967  9537 catalog_manager.cc:5697] T e7cfaa23415d4a69a5cf998bcdb1c83d P 255b950088324813bcbbe4002928fba9 reported cstate change: term changed from 1 to 2, leader changed from d495138f573f468abff8f34967cdfbf6 (127.0.107.195) to 255b950088324813bcbbe4002928fba9 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "255b950088324813bcbbe4002928fba9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:38.710153  9586 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:02:38.773650  9789 raft_consensus.cc:1275] T e7cfaa23415d4a69a5cf998bcdb1c83d P d495138f573f468abff8f34967cdfbf6 [term 2 FOLLOWER]: Refusing update from remote peer 255b950088324813bcbbe4002928fba9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:38.774938 10037 consensus_queue.cc:1048] T e7cfaa23415d4a69a5cf998bcdb1c83d P 255b950088324813bcbbe4002928fba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:38.784009  9984 raft_consensus.cc:1275] T e7cfaa23415d4a69a5cf998bcdb1c83d P cf0ed7d88d88410788769a36241f22d9 [term 2 FOLLOWER]: Refusing update from remote peer 255b950088324813bcbbe4002928fba9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:38.785334  9931 consensus_queue.cc:1048] T e7cfaa23415d4a69a5cf998bcdb1c83d P 255b950088324813bcbbe4002928fba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:38.822206  9714 raft_consensus.cc:1275] T 6a8d453497c74035b98b1c401e674c74 P 255b950088324813bcbbe4002928fba9 [term 2 FOLLOWER]: Refusing update from remote peer d495138f573f468abff8f34967cdfbf6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:38.823410 10043 consensus_queue.cc:1048] T 6a8d453497c74035b98b1c401e674c74 P d495138f573f468abff8f34967cdfbf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:38.832675  9983 raft_consensus.cc:1275] T 6a8d453497c74035b98b1c401e674c74 P cf0ed7d88d88410788769a36241f22d9 [term 2 FOLLOWER]: Refusing update from remote peer d495138f573f468abff8f34967cdfbf6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:38.834940 10036 consensus_queue.cc:1048] T 6a8d453497c74035b98b1c401e674c74 P d495138f573f468abff8f34967cdfbf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:38.963233   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:38.970620  9714 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02a8e72dc52e4f99a1acd4fd1b481bc4"
dest_uuid: "255b950088324813bcbbe4002928fba9"
mode: GRACEFUL
new_leader_uuid: "d495138f573f468abff8f34967cdfbf6"
 from {username='slave'} at 127.0.0.1:33198
I20260709 13:02:38.971308  9714 raft_consensus.cc:606] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P 255b950088324813bcbbe4002928fba9 [term 1 LEADER]: Received request to transfer leadership to TS d495138f573f468abff8f34967cdfbf6
I20260709 13:02:38.974308  9789 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "26555692bc3f487e99e16d30ec822d38"
dest_uuid: "d495138f573f468abff8f34967cdfbf6"
mode: GRACEFUL
new_leader_uuid: "255b950088324813bcbbe4002928fba9"
 from {username='slave'} at 127.0.0.1:36462
I20260709 13:02:38.974941  9789 raft_consensus.cc:606] T 26555692bc3f487e99e16d30ec822d38 P d495138f573f468abff8f34967cdfbf6 [term 2 LEADER]: Received request to transfer leadership to TS 255b950088324813bcbbe4002928fba9
I20260709 13:02:38.976109   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:02:38.976647   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:38.977211   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:39.390873 10037 raft_consensus.cc:993] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P 255b950088324813bcbbe4002928fba9: : Instructing follower d495138f573f468abff8f34967cdfbf6 to start an election
I20260709 13:02:39.391351 10063 raft_consensus.cc:1081] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P 255b950088324813bcbbe4002928fba9 [term 1 LEADER]: Signalling peer d495138f573f468abff8f34967cdfbf6 to start an election
I20260709 13:02:39.392884  9789 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "02a8e72dc52e4f99a1acd4fd1b481bc4"
dest_uuid: "d495138f573f468abff8f34967cdfbf6"
 from {username='slave'} at 127.0.0.1:36432
I20260709 13:02:39.393414  9789 raft_consensus.cc:493] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P d495138f573f468abff8f34967cdfbf6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:39.393679  9789 raft_consensus.cc:3060] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P d495138f573f468abff8f34967cdfbf6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:39.399266  9789 raft_consensus.cc:515] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P d495138f573f468abff8f34967cdfbf6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:39.401332  9789 leader_election.cc:290] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P d495138f573f468abff8f34967cdfbf6 [CANDIDATE]: Term 2 election: Requested vote from peers cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823), 255b950088324813bcbbe4002928fba9 (127.0.107.194:34793)
I20260709 13:02:39.401985  9983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a8e72dc52e4f99a1acd4fd1b481bc4" candidate_uuid: "d495138f573f468abff8f34967cdfbf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cf0ed7d88d88410788769a36241f22d9"
I20260709 13:02:39.402487  9714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02a8e72dc52e4f99a1acd4fd1b481bc4" candidate_uuid: "d495138f573f468abff8f34967cdfbf6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "255b950088324813bcbbe4002928fba9"
I20260709 13:02:39.402614  9983 raft_consensus.cc:3060] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:39.403071  9714 raft_consensus.cc:3055] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P 255b950088324813bcbbe4002928fba9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:39.403349  9714 raft_consensus.cc:740] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P 255b950088324813bcbbe4002928fba9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 255b950088324813bcbbe4002928fba9, State: Running, Role: LEADER
I20260709 13:02:39.404045  9714 consensus_queue.cc:260] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P 255b950088324813bcbbe4002928fba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:39.405071  9714 raft_consensus.cc:3060] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P 255b950088324813bcbbe4002928fba9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:39.409366  9983 raft_consensus.cc:2468] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P cf0ed7d88d88410788769a36241f22d9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d495138f573f468abff8f34967cdfbf6 in term 2.
I20260709 13:02:39.410444  9754 leader_election.cc:304] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P d495138f573f468abff8f34967cdfbf6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cf0ed7d88d88410788769a36241f22d9, d495138f573f468abff8f34967cdfbf6; no voters: 
I20260709 13:02:39.411051  9714 raft_consensus.cc:2468] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P 255b950088324813bcbbe4002928fba9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d495138f573f468abff8f34967cdfbf6 in term 2.
I20260709 13:02:39.411059 10060 raft_consensus.cc:2804] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P d495138f573f468abff8f34967cdfbf6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:39.411682 10060 raft_consensus.cc:697] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P d495138f573f468abff8f34967cdfbf6 [term 2 LEADER]: Becoming Leader. State: Replica: d495138f573f468abff8f34967cdfbf6, State: Running, Role: LEADER
I20260709 13:02:39.412461 10060 consensus_queue.cc:237] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P d495138f573f468abff8f34967cdfbf6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:39.418834  9537 catalog_manager.cc:5697] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P d495138f573f468abff8f34967cdfbf6 reported cstate change: term changed from 1 to 2, leader changed from 255b950088324813bcbbe4002928fba9 (127.0.107.194) to d495138f573f468abff8f34967cdfbf6 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "d495138f573f468abff8f34967cdfbf6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:39.524928 10044 raft_consensus.cc:993] T 26555692bc3f487e99e16d30ec822d38 P d495138f573f468abff8f34967cdfbf6: : Instructing follower 255b950088324813bcbbe4002928fba9 to start an election
I20260709 13:02:39.525342 10060 raft_consensus.cc:1081] T 26555692bc3f487e99e16d30ec822d38 P d495138f573f468abff8f34967cdfbf6 [term 2 LEADER]: Signalling peer 255b950088324813bcbbe4002928fba9 to start an election
I20260709 13:02:39.526676  9714 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "26555692bc3f487e99e16d30ec822d38"
dest_uuid: "255b950088324813bcbbe4002928fba9"
 from {username='slave'} at 127.0.0.1:33182
I20260709 13:02:39.527243  9714 raft_consensus.cc:493] T 26555692bc3f487e99e16d30ec822d38 P 255b950088324813bcbbe4002928fba9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:39.527544  9714 raft_consensus.cc:3060] T 26555692bc3f487e99e16d30ec822d38 P 255b950088324813bcbbe4002928fba9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:39.532347  9714 raft_consensus.cc:515] T 26555692bc3f487e99e16d30ec822d38 P 255b950088324813bcbbe4002928fba9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:39.534070  9714 leader_election.cc:290] T 26555692bc3f487e99e16d30ec822d38 P 255b950088324813bcbbe4002928fba9 [CANDIDATE]: Term 3 election: Requested vote from peers cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823), d495138f573f468abff8f34967cdfbf6 (127.0.107.195:44885)
I20260709 13:02:39.534899  9983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26555692bc3f487e99e16d30ec822d38" candidate_uuid: "255b950088324813bcbbe4002928fba9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cf0ed7d88d88410788769a36241f22d9"
I20260709 13:02:39.535125  9789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "26555692bc3f487e99e16d30ec822d38" candidate_uuid: "255b950088324813bcbbe4002928fba9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d495138f573f468abff8f34967cdfbf6"
I20260709 13:02:39.535511  9983 raft_consensus.cc:3060] T 26555692bc3f487e99e16d30ec822d38 P cf0ed7d88d88410788769a36241f22d9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:39.535775  9789 raft_consensus.cc:3055] T 26555692bc3f487e99e16d30ec822d38 P d495138f573f468abff8f34967cdfbf6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:39.536172  9789 raft_consensus.cc:740] T 26555692bc3f487e99e16d30ec822d38 P d495138f573f468abff8f34967cdfbf6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d495138f573f468abff8f34967cdfbf6, State: Running, Role: LEADER
I20260709 13:02:39.537057  9789 consensus_queue.cc:260] T 26555692bc3f487e99e16d30ec822d38 P d495138f573f468abff8f34967cdfbf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:39.538138  9789 raft_consensus.cc:3060] T 26555692bc3f487e99e16d30ec822d38 P d495138f573f468abff8f34967cdfbf6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:39.541826  9983 raft_consensus.cc:2468] T 26555692bc3f487e99e16d30ec822d38 P cf0ed7d88d88410788769a36241f22d9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 255b950088324813bcbbe4002928fba9 in term 3.
I20260709 13:02:39.542794  9679 leader_election.cc:304] T 26555692bc3f487e99e16d30ec822d38 P 255b950088324813bcbbe4002928fba9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 255b950088324813bcbbe4002928fba9, cf0ed7d88d88410788769a36241f22d9; no voters: 
I20260709 13:02:39.543195  9789 raft_consensus.cc:2468] T 26555692bc3f487e99e16d30ec822d38 P d495138f573f468abff8f34967cdfbf6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 255b950088324813bcbbe4002928fba9 in term 3.
I20260709 13:02:39.543416 10063 raft_consensus.cc:2804] T 26555692bc3f487e99e16d30ec822d38 P 255b950088324813bcbbe4002928fba9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:39.543931 10063 raft_consensus.cc:697] T 26555692bc3f487e99e16d30ec822d38 P 255b950088324813bcbbe4002928fba9 [term 3 LEADER]: Becoming Leader. State: Replica: 255b950088324813bcbbe4002928fba9, State: Running, Role: LEADER
I20260709 13:02:39.544773 10063 consensus_queue.cc:237] T 26555692bc3f487e99e16d30ec822d38 P 255b950088324813bcbbe4002928fba9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:39.551275  9537 catalog_manager.cc:5697] T 26555692bc3f487e99e16d30ec822d38 P 255b950088324813bcbbe4002928fba9 reported cstate change: term changed from 2 to 3, leader changed from d495138f573f468abff8f34967cdfbf6 (127.0.107.195) to 255b950088324813bcbbe4002928fba9 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "255b950088324813bcbbe4002928fba9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:39.711010  9586 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:02:39.927093  9983 raft_consensus.cc:1275] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P cf0ed7d88d88410788769a36241f22d9 [term 2 FOLLOWER]: Refusing update from remote peer d495138f573f468abff8f34967cdfbf6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:39.928295 10060 consensus_queue.cc:1048] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P d495138f573f468abff8f34967cdfbf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:39.939937  9714 raft_consensus.cc:1275] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P 255b950088324813bcbbe4002928fba9 [term 2 FOLLOWER]: Refusing update from remote peer d495138f573f468abff8f34967cdfbf6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:39.941645 10073 consensus_queue.cc:1048] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P d495138f573f468abff8f34967cdfbf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:39.944770  9983 raft_consensus.cc:1275] T 26555692bc3f487e99e16d30ec822d38 P cf0ed7d88d88410788769a36241f22d9 [term 3 FOLLOWER]: Refusing update from remote peer 255b950088324813bcbbe4002928fba9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:39.946198 10063 consensus_queue.cc:1048] T 26555692bc3f487e99e16d30ec822d38 P 255b950088324813bcbbe4002928fba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:39.960973  9789 raft_consensus.cc:1275] T 26555692bc3f487e99e16d30ec822d38 P d495138f573f468abff8f34967cdfbf6 [term 3 FOLLOWER]: Refusing update from remote peer 255b950088324813bcbbe4002928fba9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:39.963232 10063 consensus_queue.cc:1048] T 26555692bc3f487e99e16d30ec822d38 P 255b950088324813bcbbe4002928fba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:39.983808   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:39.991997  9789 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6a8d453497c74035b98b1c401e674c74"
dest_uuid: "d495138f573f468abff8f34967cdfbf6"
mode: GRACEFUL
new_leader_uuid: "255b950088324813bcbbe4002928fba9"
 from {username='slave'} at 127.0.0.1:36462
I20260709 13:02:39.992612  9789 raft_consensus.cc:606] T 6a8d453497c74035b98b1c401e674c74 P d495138f573f468abff8f34967cdfbf6 [term 2 LEADER]: Received request to transfer leadership to TS 255b950088324813bcbbe4002928fba9
I20260709 13:02:39.995118  9714 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3af616bce154a0290e2dfda0b625ec3"
dest_uuid: "255b950088324813bcbbe4002928fba9"
mode: GRACEFUL
new_leader_uuid: "d495138f573f468abff8f34967cdfbf6"
 from {username='slave'} at 127.0.0.1:33198
I20260709 13:02:39.995787  9714 raft_consensus.cc:606] T d3af616bce154a0290e2dfda0b625ec3 P 255b950088324813bcbbe4002928fba9 [term 2 LEADER]: Received request to transfer leadership to TS d495138f573f468abff8f34967cdfbf6
I20260709 13:02:39.997231   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:02:39.997759   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:39.998374   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:40.231590 10079 raft_consensus.cc:993] T d3af616bce154a0290e2dfda0b625ec3 P 255b950088324813bcbbe4002928fba9: : Instructing follower d495138f573f468abff8f34967cdfbf6 to start an election
I20260709 13:02:40.232358 10037 raft_consensus.cc:1081] T d3af616bce154a0290e2dfda0b625ec3 P 255b950088324813bcbbe4002928fba9 [term 2 LEADER]: Signalling peer d495138f573f468abff8f34967cdfbf6 to start an election
I20260709 13:02:40.234155  9789 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d3af616bce154a0290e2dfda0b625ec3"
dest_uuid: "d495138f573f468abff8f34967cdfbf6"
 from {username='slave'} at 127.0.0.1:36432
I20260709 13:02:40.234830  9789 raft_consensus.cc:493] T d3af616bce154a0290e2dfda0b625ec3 P d495138f573f468abff8f34967cdfbf6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:40.235219  9789 raft_consensus.cc:3060] T d3af616bce154a0290e2dfda0b625ec3 P d495138f573f468abff8f34967cdfbf6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:40.243214  9789 raft_consensus.cc:515] T d3af616bce154a0290e2dfda0b625ec3 P d495138f573f468abff8f34967cdfbf6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:40.245054  9789 leader_election.cc:290] T d3af616bce154a0290e2dfda0b625ec3 P d495138f573f468abff8f34967cdfbf6 [CANDIDATE]: Term 3 election: Requested vote from peers cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823), 255b950088324813bcbbe4002928fba9 (127.0.107.194:34793)
I20260709 13:02:40.246353  9983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3af616bce154a0290e2dfda0b625ec3" candidate_uuid: "d495138f573f468abff8f34967cdfbf6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cf0ed7d88d88410788769a36241f22d9"
I20260709 13:02:40.246501  9714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3af616bce154a0290e2dfda0b625ec3" candidate_uuid: "d495138f573f468abff8f34967cdfbf6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "255b950088324813bcbbe4002928fba9"
I20260709 13:02:40.247428  9983 raft_consensus.cc:3060] T d3af616bce154a0290e2dfda0b625ec3 P cf0ed7d88d88410788769a36241f22d9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:40.247452  9714 raft_consensus.cc:3055] T d3af616bce154a0290e2dfda0b625ec3 P 255b950088324813bcbbe4002928fba9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:40.247924  9714 raft_consensus.cc:740] T d3af616bce154a0290e2dfda0b625ec3 P 255b950088324813bcbbe4002928fba9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 255b950088324813bcbbe4002928fba9, State: Running, Role: LEADER
I20260709 13:02:40.248978  9714 consensus_queue.cc:260] T d3af616bce154a0290e2dfda0b625ec3 P 255b950088324813bcbbe4002928fba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:40.250540  9714 raft_consensus.cc:3060] T d3af616bce154a0290e2dfda0b625ec3 P 255b950088324813bcbbe4002928fba9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:40.254405  9983 raft_consensus.cc:2468] T d3af616bce154a0290e2dfda0b625ec3 P cf0ed7d88d88410788769a36241f22d9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d495138f573f468abff8f34967cdfbf6 in term 3.
I20260709 13:02:40.255638  9754 leader_election.cc:304] T d3af616bce154a0290e2dfda0b625ec3 P d495138f573f468abff8f34967cdfbf6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cf0ed7d88d88410788769a36241f22d9, d495138f573f468abff8f34967cdfbf6; no voters: 
I20260709 13:02:40.256628 10073 raft_consensus.cc:2804] T d3af616bce154a0290e2dfda0b625ec3 P d495138f573f468abff8f34967cdfbf6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:40.257041 10073 raft_consensus.cc:697] T d3af616bce154a0290e2dfda0b625ec3 P d495138f573f468abff8f34967cdfbf6 [term 3 LEADER]: Becoming Leader. State: Replica: d495138f573f468abff8f34967cdfbf6, State: Running, Role: LEADER
I20260709 13:02:40.258343  9714 raft_consensus.cc:2468] T d3af616bce154a0290e2dfda0b625ec3 P 255b950088324813bcbbe4002928fba9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d495138f573f468abff8f34967cdfbf6 in term 3.
I20260709 13:02:40.258407 10073 consensus_queue.cc:237] T d3af616bce154a0290e2dfda0b625ec3 P d495138f573f468abff8f34967cdfbf6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:40.267097  9538 catalog_manager.cc:5697] T d3af616bce154a0290e2dfda0b625ec3 P d495138f573f468abff8f34967cdfbf6 reported cstate change: term changed from 2 to 3, leader changed from 255b950088324813bcbbe4002928fba9 (127.0.107.194) to d495138f573f468abff8f34967cdfbf6 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "d495138f573f468abff8f34967cdfbf6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:40.288031 10044 raft_consensus.cc:993] T 6a8d453497c74035b98b1c401e674c74 P d495138f573f468abff8f34967cdfbf6: : Instructing follower 255b950088324813bcbbe4002928fba9 to start an election
I20260709 13:02:40.288709 10073 raft_consensus.cc:1081] T 6a8d453497c74035b98b1c401e674c74 P d495138f573f468abff8f34967cdfbf6 [term 2 LEADER]: Signalling peer 255b950088324813bcbbe4002928fba9 to start an election
I20260709 13:02:40.290345  9714 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6a8d453497c74035b98b1c401e674c74"
dest_uuid: "255b950088324813bcbbe4002928fba9"
 from {username='slave'} at 127.0.0.1:33182
I20260709 13:02:40.290871  9714 raft_consensus.cc:493] T 6a8d453497c74035b98b1c401e674c74 P 255b950088324813bcbbe4002928fba9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:40.291139  9714 raft_consensus.cc:3060] T 6a8d453497c74035b98b1c401e674c74 P 255b950088324813bcbbe4002928fba9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:40.296226  9714 raft_consensus.cc:515] T 6a8d453497c74035b98b1c401e674c74 P 255b950088324813bcbbe4002928fba9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:40.299151  9714 leader_election.cc:290] T 6a8d453497c74035b98b1c401e674c74 P 255b950088324813bcbbe4002928fba9 [CANDIDATE]: Term 3 election: Requested vote from peers cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823), d495138f573f468abff8f34967cdfbf6 (127.0.107.195:44885)
I20260709 13:02:40.300006  9789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a8d453497c74035b98b1c401e674c74" candidate_uuid: "255b950088324813bcbbe4002928fba9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d495138f573f468abff8f34967cdfbf6"
I20260709 13:02:40.299465  9983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a8d453497c74035b98b1c401e674c74" candidate_uuid: "255b950088324813bcbbe4002928fba9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cf0ed7d88d88410788769a36241f22d9"
I20260709 13:02:40.301138  9789 raft_consensus.cc:3055] T 6a8d453497c74035b98b1c401e674c74 P d495138f573f468abff8f34967cdfbf6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:40.301152  9983 raft_consensus.cc:3060] T 6a8d453497c74035b98b1c401e674c74 P cf0ed7d88d88410788769a36241f22d9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:40.301620  9789 raft_consensus.cc:740] T 6a8d453497c74035b98b1c401e674c74 P d495138f573f468abff8f34967cdfbf6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d495138f573f468abff8f34967cdfbf6, State: Running, Role: LEADER
I20260709 13:02:40.302697  9789 consensus_queue.cc:260] T 6a8d453497c74035b98b1c401e674c74 P d495138f573f468abff8f34967cdfbf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:40.304126  9789 raft_consensus.cc:3060] T 6a8d453497c74035b98b1c401e674c74 P d495138f573f468abff8f34967cdfbf6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:40.309530  9983 raft_consensus.cc:2468] T 6a8d453497c74035b98b1c401e674c74 P cf0ed7d88d88410788769a36241f22d9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 255b950088324813bcbbe4002928fba9 in term 3.
I20260709 13:02:40.311169  9679 leader_election.cc:304] T 6a8d453497c74035b98b1c401e674c74 P 255b950088324813bcbbe4002928fba9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 255b950088324813bcbbe4002928fba9, cf0ed7d88d88410788769a36241f22d9; no voters: 
I20260709 13:02:40.311909 10037 raft_consensus.cc:2804] T 6a8d453497c74035b98b1c401e674c74 P 255b950088324813bcbbe4002928fba9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:40.312371  9789 raft_consensus.cc:2468] T 6a8d453497c74035b98b1c401e674c74 P d495138f573f468abff8f34967cdfbf6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 255b950088324813bcbbe4002928fba9 in term 3.
I20260709 13:02:40.312428 10037 raft_consensus.cc:697] T 6a8d453497c74035b98b1c401e674c74 P 255b950088324813bcbbe4002928fba9 [term 3 LEADER]: Becoming Leader. State: Replica: 255b950088324813bcbbe4002928fba9, State: Running, Role: LEADER
I20260709 13:02:40.314132 10037 consensus_queue.cc:237] T 6a8d453497c74035b98b1c401e674c74 P 255b950088324813bcbbe4002928fba9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:40.325264  9538 catalog_manager.cc:5697] T 6a8d453497c74035b98b1c401e674c74 P 255b950088324813bcbbe4002928fba9 reported cstate change: term changed from 2 to 3, leader changed from d495138f573f468abff8f34967cdfbf6 (127.0.107.195) to 255b950088324813bcbbe4002928fba9 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "255b950088324813bcbbe4002928fba9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:40.654079  9983 raft_consensus.cc:1275] T d3af616bce154a0290e2dfda0b625ec3 P cf0ed7d88d88410788769a36241f22d9 [term 3 FOLLOWER]: Refusing update from remote peer d495138f573f468abff8f34967cdfbf6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:40.655687 10087 consensus_queue.cc:1048] T d3af616bce154a0290e2dfda0b625ec3 P d495138f573f468abff8f34967cdfbf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:40.669699  9714 raft_consensus.cc:1275] T d3af616bce154a0290e2dfda0b625ec3 P 255b950088324813bcbbe4002928fba9 [term 3 FOLLOWER]: Refusing update from remote peer d495138f573f468abff8f34967cdfbf6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:40.672078 10087 consensus_queue.cc:1048] T d3af616bce154a0290e2dfda0b625ec3 P d495138f573f468abff8f34967cdfbf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:02:40.712159  9586 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:02:40.814437  9789 raft_consensus.cc:1275] T 6a8d453497c74035b98b1c401e674c74 P d495138f573f468abff8f34967cdfbf6 [term 3 FOLLOWER]: Refusing update from remote peer 255b950088324813bcbbe4002928fba9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:40.816154 10079 consensus_queue.cc:1048] T 6a8d453497c74035b98b1c401e674c74 P 255b950088324813bcbbe4002928fba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:40.826869  9984 raft_consensus.cc:1275] T 6a8d453497c74035b98b1c401e674c74 P cf0ed7d88d88410788769a36241f22d9 [term 3 FOLLOWER]: Refusing update from remote peer 255b950088324813bcbbe4002928fba9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:40.828953 10079 consensus_queue.cc:1048] T 6a8d453497c74035b98b1c401e674c74 P 255b950088324813bcbbe4002928fba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:41.005214   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:41.013959  9789 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6cc719078d04018b6cb81bbc000528a"
dest_uuid: "d495138f573f468abff8f34967cdfbf6"
mode: GRACEFUL
new_leader_uuid: "255b950088324813bcbbe4002928fba9"
 from {username='slave'} at 127.0.0.1:36462
I20260709 13:02:41.014669  9789 raft_consensus.cc:606] T a6cc719078d04018b6cb81bbc000528a P d495138f573f468abff8f34967cdfbf6 [term 2 LEADER]: Received request to transfer leadership to TS 255b950088324813bcbbe4002928fba9
I20260709 13:02:41.018026  9714 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7cfaa23415d4a69a5cf998bcdb1c83d"
dest_uuid: "255b950088324813bcbbe4002928fba9"
mode: GRACEFUL
new_leader_uuid: "d495138f573f468abff8f34967cdfbf6"
 from {username='slave'} at 127.0.0.1:33198
I20260709 13:02:41.018617  9714 raft_consensus.cc:606] T e7cfaa23415d4a69a5cf998bcdb1c83d P 255b950088324813bcbbe4002928fba9 [term 2 LEADER]: Received request to transfer leadership to TS d495138f573f468abff8f34967cdfbf6
I20260709 13:02:41.020009   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:02:41.020643   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:41.021406   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:41.080400 10073 raft_consensus.cc:993] T a6cc719078d04018b6cb81bbc000528a P d495138f573f468abff8f34967cdfbf6: : Instructing follower 255b950088324813bcbbe4002928fba9 to start an election
I20260709 13:02:41.081100 10087 raft_consensus.cc:1081] T a6cc719078d04018b6cb81bbc000528a P d495138f573f468abff8f34967cdfbf6 [term 2 LEADER]: Signalling peer 255b950088324813bcbbe4002928fba9 to start an election
I20260709 13:02:41.082762  9714 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a6cc719078d04018b6cb81bbc000528a"
dest_uuid: "255b950088324813bcbbe4002928fba9"
 from {username='slave'} at 127.0.0.1:33182
I20260709 13:02:41.083297  9714 raft_consensus.cc:493] T a6cc719078d04018b6cb81bbc000528a P 255b950088324813bcbbe4002928fba9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:41.083621  9714 raft_consensus.cc:3060] T a6cc719078d04018b6cb81bbc000528a P 255b950088324813bcbbe4002928fba9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:41.089808  9714 raft_consensus.cc:515] T a6cc719078d04018b6cb81bbc000528a P 255b950088324813bcbbe4002928fba9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:41.091758  9714 leader_election.cc:290] T a6cc719078d04018b6cb81bbc000528a P 255b950088324813bcbbe4002928fba9 [CANDIDATE]: Term 3 election: Requested vote from peers cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823), d495138f573f468abff8f34967cdfbf6 (127.0.107.195:44885)
I20260709 13:02:41.092460  9984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6cc719078d04018b6cb81bbc000528a" candidate_uuid: "255b950088324813bcbbe4002928fba9" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "cf0ed7d88d88410788769a36241f22d9"
I20260709 13:02:41.093178  9789 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6cc719078d04018b6cb81bbc000528a" candidate_uuid: "255b950088324813bcbbe4002928fba9" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "d495138f573f468abff8f34967cdfbf6"
I20260709 13:02:41.093319  9984 raft_consensus.cc:3060] T a6cc719078d04018b6cb81bbc000528a P cf0ed7d88d88410788769a36241f22d9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:41.093761  9789 raft_consensus.cc:3055] T a6cc719078d04018b6cb81bbc000528a P d495138f573f468abff8f34967cdfbf6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:41.094534  9789 raft_consensus.cc:740] T a6cc719078d04018b6cb81bbc000528a P d495138f573f468abff8f34967cdfbf6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d495138f573f468abff8f34967cdfbf6, State: Running, Role: LEADER
I20260709 13:02:41.095610  9789 consensus_queue.cc:260] T a6cc719078d04018b6cb81bbc000528a P d495138f573f468abff8f34967cdfbf6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:41.096683  9789 raft_consensus.cc:3060] T a6cc719078d04018b6cb81bbc000528a P d495138f573f468abff8f34967cdfbf6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:41.102605  9984 raft_consensus.cc:2468] T a6cc719078d04018b6cb81bbc000528a P cf0ed7d88d88410788769a36241f22d9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 255b950088324813bcbbe4002928fba9 in term 3.
I20260709 13:02:41.102710  9789 raft_consensus.cc:2468] T a6cc719078d04018b6cb81bbc000528a P d495138f573f468abff8f34967cdfbf6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 255b950088324813bcbbe4002928fba9 in term 3.
I20260709 13:02:41.103958  9679 leader_election.cc:304] T a6cc719078d04018b6cb81bbc000528a P 255b950088324813bcbbe4002928fba9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 255b950088324813bcbbe4002928fba9, cf0ed7d88d88410788769a36241f22d9; no voters: 
I20260709 13:02:41.104802 10079 raft_consensus.cc:2804] T a6cc719078d04018b6cb81bbc000528a P 255b950088324813bcbbe4002928fba9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:41.105198 10079 raft_consensus.cc:697] T a6cc719078d04018b6cb81bbc000528a P 255b950088324813bcbbe4002928fba9 [term 3 LEADER]: Becoming Leader. State: Replica: 255b950088324813bcbbe4002928fba9, State: Running, Role: LEADER
I20260709 13:02:41.106076 10079 consensus_queue.cc:237] T a6cc719078d04018b6cb81bbc000528a P 255b950088324813bcbbe4002928fba9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:41.114028  9537 catalog_manager.cc:5697] T a6cc719078d04018b6cb81bbc000528a P 255b950088324813bcbbe4002928fba9 reported cstate change: term changed from 2 to 3, leader changed from d495138f573f468abff8f34967cdfbf6 (127.0.107.195) to 255b950088324813bcbbe4002928fba9 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "255b950088324813bcbbe4002928fba9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:41.338125 10079 raft_consensus.cc:993] T e7cfaa23415d4a69a5cf998bcdb1c83d P 255b950088324813bcbbe4002928fba9: : Instructing follower d495138f573f468abff8f34967cdfbf6 to start an election
I20260709 13:02:41.338625 10037 raft_consensus.cc:1081] T e7cfaa23415d4a69a5cf998bcdb1c83d P 255b950088324813bcbbe4002928fba9 [term 2 LEADER]: Signalling peer d495138f573f468abff8f34967cdfbf6 to start an election
I20260709 13:02:41.340077  9789 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7cfaa23415d4a69a5cf998bcdb1c83d"
dest_uuid: "d495138f573f468abff8f34967cdfbf6"
 from {username='slave'} at 127.0.0.1:36432
I20260709 13:02:41.340502  9789 raft_consensus.cc:493] T e7cfaa23415d4a69a5cf998bcdb1c83d P d495138f573f468abff8f34967cdfbf6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:41.340804  9789 raft_consensus.cc:3060] T e7cfaa23415d4a69a5cf998bcdb1c83d P d495138f573f468abff8f34967cdfbf6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:41.345656  9789 raft_consensus.cc:515] T e7cfaa23415d4a69a5cf998bcdb1c83d P d495138f573f468abff8f34967cdfbf6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:41.347090  9789 leader_election.cc:290] T e7cfaa23415d4a69a5cf998bcdb1c83d P d495138f573f468abff8f34967cdfbf6 [CANDIDATE]: Term 3 election: Requested vote from peers cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823), 255b950088324813bcbbe4002928fba9 (127.0.107.194:34793)
I20260709 13:02:41.348059  9984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cfaa23415d4a69a5cf998bcdb1c83d" candidate_uuid: "d495138f573f468abff8f34967cdfbf6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cf0ed7d88d88410788769a36241f22d9"
I20260709 13:02:41.348237  9714 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7cfaa23415d4a69a5cf998bcdb1c83d" candidate_uuid: "d495138f573f468abff8f34967cdfbf6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "255b950088324813bcbbe4002928fba9"
I20260709 13:02:41.348901  9984 raft_consensus.cc:3060] T e7cfaa23415d4a69a5cf998bcdb1c83d P cf0ed7d88d88410788769a36241f22d9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:41.348929  9714 raft_consensus.cc:3055] T e7cfaa23415d4a69a5cf998bcdb1c83d P 255b950088324813bcbbe4002928fba9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:41.349417  9714 raft_consensus.cc:740] T e7cfaa23415d4a69a5cf998bcdb1c83d P 255b950088324813bcbbe4002928fba9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 255b950088324813bcbbe4002928fba9, State: Running, Role: LEADER
I20260709 13:02:41.350134  9714 consensus_queue.cc:260] T e7cfaa23415d4a69a5cf998bcdb1c83d P 255b950088324813bcbbe4002928fba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:41.351141  9714 raft_consensus.cc:3060] T e7cfaa23415d4a69a5cf998bcdb1c83d P 255b950088324813bcbbe4002928fba9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:41.356400  9984 raft_consensus.cc:2468] T e7cfaa23415d4a69a5cf998bcdb1c83d P cf0ed7d88d88410788769a36241f22d9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d495138f573f468abff8f34967cdfbf6 in term 3.
I20260709 13:02:41.358178  9714 raft_consensus.cc:2468] T e7cfaa23415d4a69a5cf998bcdb1c83d P 255b950088324813bcbbe4002928fba9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d495138f573f468abff8f34967cdfbf6 in term 3.
I20260709 13:02:41.361063  9756 leader_election.cc:304] T e7cfaa23415d4a69a5cf998bcdb1c83d P d495138f573f468abff8f34967cdfbf6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 255b950088324813bcbbe4002928fba9, d495138f573f468abff8f34967cdfbf6; no voters: 
I20260709 13:02:41.361837 10100 raft_consensus.cc:2804] T e7cfaa23415d4a69a5cf998bcdb1c83d P d495138f573f468abff8f34967cdfbf6 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:41.362300 10100 raft_consensus.cc:697] T e7cfaa23415d4a69a5cf998bcdb1c83d P d495138f573f468abff8f34967cdfbf6 [term 3 LEADER]: Becoming Leader. State: Replica: d495138f573f468abff8f34967cdfbf6, State: Running, Role: LEADER
I20260709 13:02:41.363547 10100 consensus_queue.cc:237] T e7cfaa23415d4a69a5cf998bcdb1c83d P d495138f573f468abff8f34967cdfbf6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } }
I20260709 13:02:41.371713  9537 catalog_manager.cc:5697] T e7cfaa23415d4a69a5cf998bcdb1c83d P d495138f573f468abff8f34967cdfbf6 reported cstate change: term changed from 2 to 3, leader changed from 255b950088324813bcbbe4002928fba9 (127.0.107.194) to d495138f573f468abff8f34967cdfbf6 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "d495138f573f468abff8f34967cdfbf6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:41.609311  9984 raft_consensus.cc:1275] T a6cc719078d04018b6cb81bbc000528a P cf0ed7d88d88410788769a36241f22d9 [term 3 FOLLOWER]: Refusing update from remote peer 255b950088324813bcbbe4002928fba9: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:41.610447 10037 consensus_queue.cc:1048] T a6cc719078d04018b6cb81bbc000528a P 255b950088324813bcbbe4002928fba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:41.621553  9789 raft_consensus.cc:1275] T a6cc719078d04018b6cb81bbc000528a P d495138f573f468abff8f34967cdfbf6 [term 3 FOLLOWER]: Refusing update from remote peer 255b950088324813bcbbe4002928fba9: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:41.623082 10037 consensus_queue.cc:1048] T a6cc719078d04018b6cb81bbc000528a P 255b950088324813bcbbe4002928fba9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d495138f573f468abff8f34967cdfbf6" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 44885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:02:41.713143  9586 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:02:41.845124  9984 raft_consensus.cc:1275] T e7cfaa23415d4a69a5cf998bcdb1c83d P cf0ed7d88d88410788769a36241f22d9 [term 3 FOLLOWER]: Refusing update from remote peer d495138f573f468abff8f34967cdfbf6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:41.846560 10100 consensus_queue.cc:1048] T e7cfaa23415d4a69a5cf998bcdb1c83d P d495138f573f468abff8f34967cdfbf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cf0ed7d88d88410788769a36241f22d9" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 40823 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:41.857048  9714 raft_consensus.cc:1275] T e7cfaa23415d4a69a5cf998bcdb1c83d P 255b950088324813bcbbe4002928fba9 [term 3 FOLLOWER]: Refusing update from remote peer d495138f573f468abff8f34967cdfbf6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:41.858564 10073 consensus_queue.cc:1048] T e7cfaa23415d4a69a5cf998bcdb1c83d P d495138f573f468abff8f34967cdfbf6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "255b950088324813bcbbe4002928fba9" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 34793 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:42.027803   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:42.063329   431 tablet_server.cc:179] TabletServer@127.0.107.193:40823 shutting down...
I20260709 13:02:42.087309   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:42.088186   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:42.089174   431 raft_consensus.cc:2243] T 26555692bc3f487e99e16d30ec822d38 P cf0ed7d88d88410788769a36241f22d9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:42.089705   431 raft_consensus.cc:2272] T 26555692bc3f487e99e16d30ec822d38 P cf0ed7d88d88410788769a36241f22d9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:42.092475   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:42.093204   431 raft_consensus.cc:2243] T a6cc719078d04018b6cb81bbc000528a P cf0ed7d88d88410788769a36241f22d9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:42.093659   431 raft_consensus.cc:2272] T a6cc719078d04018b6cb81bbc000528a P cf0ed7d88d88410788769a36241f22d9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:42.096872   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:42.097436   431 raft_consensus.cc:2243] T 62c912553c2b40ffac89862b3bd40ee7 P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:42.097913   431 raft_consensus.cc:2272] T 62c912553c2b40ffac89862b3bd40ee7 P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:42.100220   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:42.100891   431 raft_consensus.cc:2243] T 6a8d453497c74035b98b1c401e674c74 P cf0ed7d88d88410788769a36241f22d9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:42.101331   431 raft_consensus.cc:2272] T 6a8d453497c74035b98b1c401e674c74 P cf0ed7d88d88410788769a36241f22d9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:42.103610   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:42.104144   431 raft_consensus.cc:2243] T bfc104a251f842409dcd0830c3371344 P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:42.104600   431 raft_consensus.cc:2272] T bfc104a251f842409dcd0830c3371344 P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:42.106945   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:42.107512   431 raft_consensus.cc:2243] T d3af616bce154a0290e2dfda0b625ec3 P cf0ed7d88d88410788769a36241f22d9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:42.107915   431 raft_consensus.cc:2272] T d3af616bce154a0290e2dfda0b625ec3 P cf0ed7d88d88410788769a36241f22d9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:42.110072   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:42.110641   431 raft_consensus.cc:2243] T 5c3b998087e5451cba6d53a1cc6c9477 P cf0ed7d88d88410788769a36241f22d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:42.111104   431 raft_consensus.cc:2272] T 5c3b998087e5451cba6d53a1cc6c9477 P cf0ed7d88d88410788769a36241f22d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:42.113410   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:42.113921   431 raft_consensus.cc:2243] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P cf0ed7d88d88410788769a36241f22d9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:42.114514   431 raft_consensus.cc:2272] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P cf0ed7d88d88410788769a36241f22d9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:42.116966   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:42.117455   431 raft_consensus.cc:2243] T e7cfaa23415d4a69a5cf998bcdb1c83d P cf0ed7d88d88410788769a36241f22d9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:42.117926   431 raft_consensus.cc:2272] T e7cfaa23415d4a69a5cf998bcdb1c83d P cf0ed7d88d88410788769a36241f22d9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:42.121070   431 tablet_replica.cc:333] stopping tablet replica
I20260709 13:02:42.121585   431 raft_consensus.cc:2243] T 6ac83262048e44a28858e8a0e18ac678 P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:42.122010   431 raft_consensus.cc:2272] T 6ac83262048e44a28858e8a0e18ac678 P cf0ed7d88d88410788769a36241f22d9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:42.135262  9679 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 79 similar messages]
W20260709 13:02:42.139364  9679 consensus_peers.cc:597] T bfc104a251f842409dcd0830c3371344 P 255b950088324813bcbbe4002928fba9 -> Peer cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823): Couldn't send request to peer cf0ed7d88d88410788769a36241f22d9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:42.141944  9754 consensus_peers.cc:597] T 5c3b998087e5451cba6d53a1cc6c9477 P d495138f573f468abff8f34967cdfbf6 -> Peer cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823): Couldn't send request to peer cf0ed7d88d88410788769a36241f22d9. Status: Network error: recv got EOF from unknown peer (error 108). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:42.158584   431 tablet_server.cc:196] TabletServer@127.0.107.193:40823 shutdown complete.
W20260709 13:02:42.161015  9754 consensus_peers.cc:597] T d3af616bce154a0290e2dfda0b625ec3 P d495138f573f468abff8f34967cdfbf6 -> Peer cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823): Couldn't send request to peer cf0ed7d88d88410788769a36241f22d9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40823: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:42.185194   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:02:42.206897  9756 consensus_peers.cc:597] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P d495138f573f468abff8f34967cdfbf6 -> Peer 255b950088324813bcbbe4002928fba9 (127.0.107.194:34793): Couldn't send request to peer 255b950088324813bcbbe4002928fba9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:42.212792   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:42.213644   431 tablet_replica.cc:333] T a6cc719078d04018b6cb81bbc000528a P 255b950088324813bcbbe4002928fba9: stopping tablet replica
I20260709 13:02:42.214569   431 raft_consensus.cc:2243] T a6cc719078d04018b6cb81bbc000528a P 255b950088324813bcbbe4002928fba9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:42.215337   431 raft_consensus.cc:2272] T a6cc719078d04018b6cb81bbc000528a P 255b950088324813bcbbe4002928fba9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:42.218547   431 tablet_replica.cc:333] T 26555692bc3f487e99e16d30ec822d38 P 255b950088324813bcbbe4002928fba9: stopping tablet replica
I20260709 13:02:42.219245   431 raft_consensus.cc:2243] T 26555692bc3f487e99e16d30ec822d38 P 255b950088324813bcbbe4002928fba9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:42.220112   431 raft_consensus.cc:2272] T 26555692bc3f487e99e16d30ec822d38 P 255b950088324813bcbbe4002928fba9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:42.222644   431 tablet_replica.cc:333] T 5c3b998087e5451cba6d53a1cc6c9477 P 255b950088324813bcbbe4002928fba9: stopping tablet replica
I20260709 13:02:42.223222   431 raft_consensus.cc:2243] T 5c3b998087e5451cba6d53a1cc6c9477 P 255b950088324813bcbbe4002928fba9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:42.223697   431 raft_consensus.cc:2272] T 5c3b998087e5451cba6d53a1cc6c9477 P 255b950088324813bcbbe4002928fba9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:42.226029   431 tablet_replica.cc:333] T bfc104a251f842409dcd0830c3371344 P 255b950088324813bcbbe4002928fba9: stopping tablet replica
I20260709 13:02:42.226624   431 raft_consensus.cc:2243] T bfc104a251f842409dcd0830c3371344 P 255b950088324813bcbbe4002928fba9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:42.227479   431 raft_consensus.cc:2272] T bfc104a251f842409dcd0830c3371344 P 255b950088324813bcbbe4002928fba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:42.229914   431 tablet_replica.cc:333] T d3af616bce154a0290e2dfda0b625ec3 P 255b950088324813bcbbe4002928fba9: stopping tablet replica
I20260709 13:02:42.230466   431 raft_consensus.cc:2243] T d3af616bce154a0290e2dfda0b625ec3 P 255b950088324813bcbbe4002928fba9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:42.230886   431 raft_consensus.cc:2272] T d3af616bce154a0290e2dfda0b625ec3 P 255b950088324813bcbbe4002928fba9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:42.233001   431 tablet_replica.cc:333] T 6a8d453497c74035b98b1c401e674c74 P 255b950088324813bcbbe4002928fba9: stopping tablet replica
I20260709 13:02:42.233554   431 raft_consensus.cc:2243] T 6a8d453497c74035b98b1c401e674c74 P 255b950088324813bcbbe4002928fba9 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:42.234318   431 raft_consensus.cc:2272] T 6a8d453497c74035b98b1c401e674c74 P 255b950088324813bcbbe4002928fba9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:42.236828   431 tablet_replica.cc:333] T 62c912553c2b40ffac89862b3bd40ee7 P 255b950088324813bcbbe4002928fba9: stopping tablet replica
I20260709 13:02:42.237390   431 raft_consensus.cc:2243] T 62c912553c2b40ffac89862b3bd40ee7 P 255b950088324813bcbbe4002928fba9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:42.237838   431 raft_consensus.cc:2272] T 62c912553c2b40ffac89862b3bd40ee7 P 255b950088324813bcbbe4002928fba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:42.240065   431 tablet_replica.cc:333] T e7cfaa23415d4a69a5cf998bcdb1c83d P 255b950088324813bcbbe4002928fba9: stopping tablet replica
I20260709 13:02:42.240618   431 raft_consensus.cc:2243] T e7cfaa23415d4a69a5cf998bcdb1c83d P 255b950088324813bcbbe4002928fba9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:42.241032   431 raft_consensus.cc:2272] T e7cfaa23415d4a69a5cf998bcdb1c83d P 255b950088324813bcbbe4002928fba9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:42.244042   431 tablet_replica.cc:333] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P 255b950088324813bcbbe4002928fba9: stopping tablet replica
I20260709 13:02:42.244640   431 raft_consensus.cc:2243] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P 255b950088324813bcbbe4002928fba9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:42.245119   431 raft_consensus.cc:2272] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P 255b950088324813bcbbe4002928fba9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:42.247308   431 tablet_replica.cc:333] T 6ac83262048e44a28858e8a0e18ac678 P 255b950088324813bcbbe4002928fba9: stopping tablet replica
I20260709 13:02:42.247817   431 raft_consensus.cc:2243] T 6ac83262048e44a28858e8a0e18ac678 P 255b950088324813bcbbe4002928fba9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:42.248749   431 raft_consensus.cc:2272] T 6ac83262048e44a28858e8a0e18ac678 P 255b950088324813bcbbe4002928fba9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:42.283757   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 13:02:42.312798   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
W20260709 13:02:42.315797  9756 consensus_peers.cc:597] T d3af616bce154a0290e2dfda0b625ec3 P d495138f573f468abff8f34967cdfbf6 -> Peer 255b950088324813bcbbe4002928fba9 (127.0.107.194:34793): Couldn't send request to peer 255b950088324813bcbbe4002928fba9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:34793: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:42.346498   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:42.347322   431 tablet_replica.cc:333] T 5c3b998087e5451cba6d53a1cc6c9477 P d495138f573f468abff8f34967cdfbf6: stopping tablet replica
I20260709 13:02:42.348014   431 raft_consensus.cc:2243] T 5c3b998087e5451cba6d53a1cc6c9477 P d495138f573f468abff8f34967cdfbf6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:42.349068   431 raft_consensus.cc:2272] T 5c3b998087e5451cba6d53a1cc6c9477 P d495138f573f468abff8f34967cdfbf6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:42.351483   431 tablet_replica.cc:333] T e7cfaa23415d4a69a5cf998bcdb1c83d P d495138f573f468abff8f34967cdfbf6: stopping tablet replica
I20260709 13:02:42.352198   431 raft_consensus.cc:2243] T e7cfaa23415d4a69a5cf998bcdb1c83d P d495138f573f468abff8f34967cdfbf6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:42.353104   431 raft_consensus.cc:2272] T e7cfaa23415d4a69a5cf998bcdb1c83d P d495138f573f468abff8f34967cdfbf6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:42.356884   431 tablet_replica.cc:333] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P d495138f573f468abff8f34967cdfbf6: stopping tablet replica
I20260709 13:02:42.358027   431 raft_consensus.cc:2243] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P d495138f573f468abff8f34967cdfbf6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:42.358991   431 raft_consensus.cc:2272] T 02a8e72dc52e4f99a1acd4fd1b481bc4 P d495138f573f468abff8f34967cdfbf6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:42.359038  9754 consensus_peers.cc:597] T 62c912553c2b40ffac89862b3bd40ee7 P d495138f573f468abff8f34967cdfbf6 -> Peer cf0ed7d88d88410788769a36241f22d9 (127.0.107.193:40823): Couldn't send request to peer cf0ed7d88d88410788769a36241f22d9. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:40823: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:42.361466   431 tablet_replica.cc:333] T 26555692bc3f487e99e16d30ec822d38 P d495138f573f468abff8f34967cdfbf6: stopping tablet replica
I20260709 13:02:42.362102   431 raft_consensus.cc:2243] T 26555692bc3f487e99e16d30ec822d38 P d495138f573f468abff8f34967cdfbf6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:42.362601   431 raft_consensus.cc:2272] T 26555692bc3f487e99e16d30ec822d38 P d495138f573f468abff8f34967cdfbf6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:42.365317   431 tablet_replica.cc:333] T 6ac83262048e44a28858e8a0e18ac678 P d495138f573f468abff8f34967cdfbf6: stopping tablet replica
I20260709 13:02:42.366115   431 raft_consensus.cc:2243] T 6ac83262048e44a28858e8a0e18ac678 P d495138f573f468abff8f34967cdfbf6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:42.366518   431 raft_consensus.cc:2272] T 6ac83262048e44a28858e8a0e18ac678 P d495138f573f468abff8f34967cdfbf6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:42.368728   431 tablet_replica.cc:333] T d3af616bce154a0290e2dfda0b625ec3 P d495138f573f468abff8f34967cdfbf6: stopping tablet replica
I20260709 13:02:42.369395   431 raft_consensus.cc:2243] T d3af616bce154a0290e2dfda0b625ec3 P d495138f573f468abff8f34967cdfbf6 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:42.370124   431 raft_consensus.cc:2272] T d3af616bce154a0290e2dfda0b625ec3 P d495138f573f468abff8f34967cdfbf6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:42.372256   431 tablet_replica.cc:333] T bfc104a251f842409dcd0830c3371344 P d495138f573f468abff8f34967cdfbf6: stopping tablet replica
I20260709 13:02:42.372822   431 raft_consensus.cc:2243] T bfc104a251f842409dcd0830c3371344 P d495138f573f468abff8f34967cdfbf6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:42.373286   431 raft_consensus.cc:2272] T bfc104a251f842409dcd0830c3371344 P d495138f573f468abff8f34967cdfbf6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:42.375519   431 tablet_replica.cc:333] T 6a8d453497c74035b98b1c401e674c74 P d495138f573f468abff8f34967cdfbf6: stopping tablet replica
I20260709 13:02:42.376001   431 raft_consensus.cc:2243] T 6a8d453497c74035b98b1c401e674c74 P d495138f573f468abff8f34967cdfbf6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:42.376372   431 raft_consensus.cc:2272] T 6a8d453497c74035b98b1c401e674c74 P d495138f573f468abff8f34967cdfbf6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:42.378786   431 tablet_replica.cc:333] T 62c912553c2b40ffac89862b3bd40ee7 P d495138f573f468abff8f34967cdfbf6: stopping tablet replica
I20260709 13:02:42.379248   431 raft_consensus.cc:2243] T 62c912553c2b40ffac89862b3bd40ee7 P d495138f573f468abff8f34967cdfbf6 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:42.380190   431 raft_consensus.cc:2272] T 62c912553c2b40ffac89862b3bd40ee7 P d495138f573f468abff8f34967cdfbf6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:42.382637   431 tablet_replica.cc:333] T a6cc719078d04018b6cb81bbc000528a P d495138f573f468abff8f34967cdfbf6: stopping tablet replica
I20260709 13:02:42.383147   431 raft_consensus.cc:2243] T a6cc719078d04018b6cb81bbc000528a P d495138f573f468abff8f34967cdfbf6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:42.383544   431 raft_consensus.cc:2272] T a6cc719078d04018b6cb81bbc000528a P d495138f573f468abff8f34967cdfbf6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:42.417493   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:02:42.443064   431 master.cc:562] Master@127.0.107.254:41909 shutting down...
I20260709 13:02:42.465816   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P d18cf9dec3e9461db3450496bcf43a60 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:42.466336   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P d18cf9dec3e9461db3450496bcf43a60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:42.466624   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P d18cf9dec3e9461db3450496bcf43a60: stopping tablet replica
I20260709 13:02:42.486039   431 master.cc:584] Master@127.0.107.254:41909 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (12958 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:02:42.532862   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:40033
I20260709 13:02:42.534139   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:42.540488 10119 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:42.541224 10122 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:42.541533 10120 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:42.542433   431 server_base.cc:1061] running on GCE node
I20260709 13:02:42.543601   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:42.543793   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:42.543999   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602162543970 us; error 0 us; skew 500 ppm
I20260709 13:02:42.544653   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:42.547029   431 webserver.cc:533] Webserver started at http://127.0.107.254:37793/ using document root <none> and password file <none>
I20260709 13:02:42.547528   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:42.547722   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:42.548007   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:42.549257   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601869227091-431-0/minicluster-data/master-0-root/instance:
uuid: "41107e8764a34de4a010b91836d1c8d7"
format_stamp: "Formatted at 2026-07-09 13:02:42 on dist-test-slave-5mzn"
I20260709 13:02:42.553741   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:02:42.557331 10127 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:42.558187   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 13:02:42.558568   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601869227091-431-0/minicluster-data/master-0-root
uuid: "41107e8764a34de4a010b91836d1c8d7"
format_stamp: "Formatted at 2026-07-09 13:02:42 on dist-test-slave-5mzn"
I20260709 13:02:42.558929   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601869227091-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601869227091-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601869227091-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:42.585341   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:42.586604   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:42.623929   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:40033
I20260709 13:02:42.624022 10178 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:40033 every 8 connection(s)
I20260709 13:02:42.627781 10179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:42.638505 10179 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41107e8764a34de4a010b91836d1c8d7: Bootstrap starting.
I20260709 13:02:42.643412 10179 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 41107e8764a34de4a010b91836d1c8d7: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:42.647970 10179 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41107e8764a34de4a010b91836d1c8d7: No bootstrap required, opened a new log
I20260709 13:02:42.650135 10179 raft_consensus.cc:359] T 00000000000000000000000000000000 P 41107e8764a34de4a010b91836d1c8d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41107e8764a34de4a010b91836d1c8d7" member_type: VOTER }
I20260709 13:02:42.650528 10179 raft_consensus.cc:385] T 00000000000000000000000000000000 P 41107e8764a34de4a010b91836d1c8d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:42.650758 10179 raft_consensus.cc:740] T 00000000000000000000000000000000 P 41107e8764a34de4a010b91836d1c8d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41107e8764a34de4a010b91836d1c8d7, State: Initialized, Role: FOLLOWER
I20260709 13:02:42.651404 10179 consensus_queue.cc:260] T 00000000000000000000000000000000 P 41107e8764a34de4a010b91836d1c8d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41107e8764a34de4a010b91836d1c8d7" member_type: VOTER }
I20260709 13:02:42.651862 10179 raft_consensus.cc:399] T 00000000000000000000000000000000 P 41107e8764a34de4a010b91836d1c8d7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:02:42.652309 10179 raft_consensus.cc:493] T 00000000000000000000000000000000 P 41107e8764a34de4a010b91836d1c8d7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:02:42.652626 10179 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 41107e8764a34de4a010b91836d1c8d7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:42.657821 10179 raft_consensus.cc:515] T 00000000000000000000000000000000 P 41107e8764a34de4a010b91836d1c8d7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41107e8764a34de4a010b91836d1c8d7" member_type: VOTER }
I20260709 13:02:42.658382 10179 leader_election.cc:304] T 00000000000000000000000000000000 P 41107e8764a34de4a010b91836d1c8d7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 41107e8764a34de4a010b91836d1c8d7; no voters: 
I20260709 13:02:42.659555 10179 leader_election.cc:290] T 00000000000000000000000000000000 P 41107e8764a34de4a010b91836d1c8d7 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:02:42.659986 10182 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 41107e8764a34de4a010b91836d1c8d7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:42.661473 10182 raft_consensus.cc:697] T 00000000000000000000000000000000 P 41107e8764a34de4a010b91836d1c8d7 [term 1 LEADER]: Becoming Leader. State: Replica: 41107e8764a34de4a010b91836d1c8d7, State: Running, Role: LEADER
I20260709 13:02:42.662145 10182 consensus_queue.cc:237] T 00000000000000000000000000000000 P 41107e8764a34de4a010b91836d1c8d7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41107e8764a34de4a010b91836d1c8d7" member_type: VOTER }
I20260709 13:02:42.662566 10179 sys_catalog.cc:565] T 00000000000000000000000000000000 P 41107e8764a34de4a010b91836d1c8d7 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:02:42.664901 10184 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41107e8764a34de4a010b91836d1c8d7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 41107e8764a34de4a010b91836d1c8d7. Latest consensus state: current_term: 1 leader_uuid: "41107e8764a34de4a010b91836d1c8d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41107e8764a34de4a010b91836d1c8d7" member_type: VOTER } }
I20260709 13:02:42.664901 10183 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41107e8764a34de4a010b91836d1c8d7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "41107e8764a34de4a010b91836d1c8d7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41107e8764a34de4a010b91836d1c8d7" member_type: VOTER } }
I20260709 13:02:42.665709 10184 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41107e8764a34de4a010b91836d1c8d7 [sys.catalog]: This master's current role is: LEADER
I20260709 13:02:42.665794 10183 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41107e8764a34de4a010b91836d1c8d7 [sys.catalog]: This master's current role is: LEADER
I20260709 13:02:42.669569 10187 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:02:42.674352 10187 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:02:42.678304   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:02:42.683001 10187 catalog_manager.cc:1383] Generated new cluster ID: 9f3c6bac5cef489e919070164f731b72
I20260709 13:02:42.683290 10187 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:02:42.696026 10187 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:02:42.697422 10187 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:02:42.715642 10187 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 41107e8764a34de4a010b91836d1c8d7: Generated new TSK 0
I20260709 13:02:42.716266 10187 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:02:42.744748   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:42.750756 10200 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:42.751719 10201 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:42.754525 10203 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:42.755671   431 server_base.cc:1061] running on GCE node
I20260709 13:02:42.756963   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:42.757205   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:42.757411   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602162757392 us; error 0 us; skew 500 ppm
I20260709 13:02:42.758035   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:42.760495   431 webserver.cc:533] Webserver started at http://127.0.107.193:34711/ using document root <none> and password file <none>
I20260709 13:02:42.761104   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:42.761323   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:42.761626   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:42.762849   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601869227091-431-0/minicluster-data/ts-0-root/instance:
uuid: "41cd568e408e40ddb2e85f8c2bee22a3"
format_stamp: "Formatted at 2026-07-09 13:02:42 on dist-test-slave-5mzn"
I20260709 13:02:42.768234   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:02:42.771770 10208 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:42.772650   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:02:42.772965   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601869227091-431-0/minicluster-data/ts-0-root
uuid: "41cd568e408e40ddb2e85f8c2bee22a3"
format_stamp: "Formatted at 2026-07-09 13:02:42 on dist-test-slave-5mzn"
I20260709 13:02:42.773227   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601869227091-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601869227091-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601869227091-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:42.802419   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:42.803639   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:42.805097   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:42.807331   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:42.807544   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:42.807785   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:42.807973   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:42.848409   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:35527
I20260709 13:02:42.848551 10270 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:35527 every 8 connection(s)
I20260709 13:02:42.853446   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:42.861075 10275 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:42.862607 10276 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:42.864225   431 server_base.cc:1061] running on GCE node
W20260709 13:02:42.866079 10278 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:42.867133   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:42.867399   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:42.867486 10271 heartbeater.cc:344] Connected to a master server at 127.0.107.254:40033
I20260709 13:02:42.867627   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602162867609 us; error 0 us; skew 500 ppm
I20260709 13:02:42.868036 10271 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:42.868412   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:42.868893 10271 heartbeater.cc:507] Master 127.0.107.254:40033 requested a full tablet report, sending...
I20260709 13:02:42.871021   431 webserver.cc:533] Webserver started at http://127.0.107.194:45193/ using document root <none> and password file <none>
I20260709 13:02:42.871574   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:42.871498 10144 ts_manager.cc:194] Registered new tserver with Master: 41cd568e408e40ddb2e85f8c2bee22a3 (127.0.107.193:35527)
I20260709 13:02:42.871981   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:42.872275   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:42.873452   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601869227091-431-0/minicluster-data/ts-1-root/instance:
uuid: "882704f8b6a04a66ba918aac12d22da8"
format_stamp: "Formatted at 2026-07-09 13:02:42 on dist-test-slave-5mzn"
I20260709 13:02:42.873759 10144 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35524
I20260709 13:02:42.878625   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:02:42.882339 10283 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:42.883155   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:02:42.883451   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601869227091-431-0/minicluster-data/ts-1-root
uuid: "882704f8b6a04a66ba918aac12d22da8"
format_stamp: "Formatted at 2026-07-09 13:02:42 on dist-test-slave-5mzn"
I20260709 13:02:42.883734   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601869227091-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601869227091-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601869227091-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:42.924238   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:42.925472   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:42.926914   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:42.929221   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:42.929463   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:42.929697   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:42.929864   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:42.971698   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:46641
I20260709 13:02:42.971779 10345 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:46641 every 8 connection(s)
I20260709 13:02:42.977016   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:42.983711 10349 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:42.985859 10350 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:42.989241   431 server_base.cc:1061] running on GCE node
W20260709 13:02:42.989035 10352 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:42.990579 10346 heartbeater.cc:344] Connected to a master server at 127.0.107.254:40033
I20260709 13:02:42.991058 10346 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:42.991078   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:42.991493   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:42.991701   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602162991683 us; error 0 us; skew 500 ppm
I20260709 13:02:42.992134 10346 heartbeater.cc:507] Master 127.0.107.254:40033 requested a full tablet report, sending...
I20260709 13:02:42.992596   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:42.994629 10144 ts_manager.cc:194] Registered new tserver with Master: 882704f8b6a04a66ba918aac12d22da8 (127.0.107.194:46641)
I20260709 13:02:42.995743   431 webserver.cc:533] Webserver started at http://127.0.107.195:36335/ using document root <none> and password file <none>
I20260709 13:02:42.996184 10144 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35526
I20260709 13:02:42.996321   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:42.996695   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:42.996980   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:42.998437   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601869227091-431-0/minicluster-data/ts-2-root/instance:
uuid: "191dd64f4cf64ba08da29e42907a2dd3"
format_stamp: "Formatted at 2026-07-09 13:02:42 on dist-test-slave-5mzn"
I20260709 13:02:43.003044   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 13:02:43.006371 10357 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:43.007150   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.001s
I20260709 13:02:43.007408   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601869227091-431-0/minicluster-data/ts-2-root
uuid: "191dd64f4cf64ba08da29e42907a2dd3"
format_stamp: "Formatted at 2026-07-09 13:02:42 on dist-test-slave-5mzn"
I20260709 13:02:43.007663   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601869227091-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601869227091-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783601869227091-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:43.022246   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:43.023334   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:43.024848   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:43.027123   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:43.027329   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:43.027616   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:43.027776   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:43.067695   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:43473
I20260709 13:02:43.067796 10419 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:43473 every 8 connection(s)
I20260709 13:02:43.083207 10420 heartbeater.cc:344] Connected to a master server at 127.0.107.254:40033
I20260709 13:02:43.083782 10420 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:43.084642 10420 heartbeater.cc:507] Master 127.0.107.254:40033 requested a full tablet report, sending...
I20260709 13:02:43.086707 10144 ts_manager.cc:194] Registered new tserver with Master: 191dd64f4cf64ba08da29e42907a2dd3 (127.0.107.195:43473)
I20260709 13:02:43.087153   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016223317s
I20260709 13:02:43.088750 10144 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:35532
I20260709 13:02:43.114022 10144 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35544:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:02:43.116184 10144 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:02:43.162184 10236 tablet_service.cc:1511] Processing CreateTablet for tablet 5e45f3ce4d134b7d9c5df68e7f6f79e0 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=a2b2ed23235647b2ba851c9ba42b7210]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:02:43.166033 10235 tablet_service.cc:1511] Processing CreateTablet for tablet 282e2cb436704f8cb1325a0b0121e13b (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=a2b2ed23235647b2ba851c9ba42b7210]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:02:43.171178 10236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e45f3ce4d134b7d9c5df68e7f6f79e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:43.170964 10311 tablet_service.cc:1511] Processing CreateTablet for tablet 5e45f3ce4d134b7d9c5df68e7f6f79e0 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=a2b2ed23235647b2ba851c9ba42b7210]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:02:43.172583 10311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e45f3ce4d134b7d9c5df68e7f6f79e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:43.172605 10235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 282e2cb436704f8cb1325a0b0121e13b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:43.173606 10310 tablet_service.cc:1511] Processing CreateTablet for tablet 282e2cb436704f8cb1325a0b0121e13b (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=a2b2ed23235647b2ba851c9ba42b7210]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:02:43.175029 10310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 282e2cb436704f8cb1325a0b0121e13b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:43.189042 10385 tablet_service.cc:1511] Processing CreateTablet for tablet 5e45f3ce4d134b7d9c5df68e7f6f79e0 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=a2b2ed23235647b2ba851c9ba42b7210]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:02:43.190474 10385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e45f3ce4d134b7d9c5df68e7f6f79e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:43.193253 10384 tablet_service.cc:1511] Processing CreateTablet for tablet 282e2cb436704f8cb1325a0b0121e13b (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=a2b2ed23235647b2ba851c9ba42b7210]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:02:43.194633 10384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 282e2cb436704f8cb1325a0b0121e13b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:43.202811 10435 tablet_bootstrap.cc:492] T 282e2cb436704f8cb1325a0b0121e13b P 882704f8b6a04a66ba918aac12d22da8: Bootstrap starting.
I20260709 13:02:43.208912 10436 tablet_bootstrap.cc:492] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 41cd568e408e40ddb2e85f8c2bee22a3: Bootstrap starting.
I20260709 13:02:43.211331 10435 tablet_bootstrap.cc:654] T 282e2cb436704f8cb1325a0b0121e13b P 882704f8b6a04a66ba918aac12d22da8: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:43.222455 10436 tablet_bootstrap.cc:654] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 41cd568e408e40ddb2e85f8c2bee22a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:43.224296 10435 tablet_bootstrap.cc:492] T 282e2cb436704f8cb1325a0b0121e13b P 882704f8b6a04a66ba918aac12d22da8: No bootstrap required, opened a new log
I20260709 13:02:43.224963 10435 ts_tablet_manager.cc:1403] T 282e2cb436704f8cb1325a0b0121e13b P 882704f8b6a04a66ba918aac12d22da8: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.013s
I20260709 13:02:43.225731 10438 tablet_bootstrap.cc:492] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 191dd64f4cf64ba08da29e42907a2dd3: Bootstrap starting.
I20260709 13:02:43.228682 10435 raft_consensus.cc:359] T 282e2cb436704f8cb1325a0b0121e13b P 882704f8b6a04a66ba918aac12d22da8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 } } peers { permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 } } peers { permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 } }
I20260709 13:02:43.229347 10436 tablet_bootstrap.cc:492] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 41cd568e408e40ddb2e85f8c2bee22a3: No bootstrap required, opened a new log
I20260709 13:02:43.229650 10435 raft_consensus.cc:385] T 282e2cb436704f8cb1325a0b0121e13b P 882704f8b6a04a66ba918aac12d22da8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:43.230041 10436 ts_tablet_manager.cc:1403] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 41cd568e408e40ddb2e85f8c2bee22a3: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.004s
I20260709 13:02:43.230078 10435 raft_consensus.cc:740] T 282e2cb436704f8cb1325a0b0121e13b P 882704f8b6a04a66ba918aac12d22da8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 882704f8b6a04a66ba918aac12d22da8, State: Initialized, Role: FOLLOWER
I20260709 13:02:43.231190 10435 consensus_queue.cc:260] T 282e2cb436704f8cb1325a0b0121e13b P 882704f8b6a04a66ba918aac12d22da8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 } } peers { permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 } } peers { permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 } }
I20260709 13:02:43.233465 10438 tablet_bootstrap.cc:654] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 191dd64f4cf64ba08da29e42907a2dd3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:43.233693 10346 heartbeater.cc:499] Master 127.0.107.254:40033 was elected leader, sending a full tablet report...
I20260709 13:02:43.233620 10436 raft_consensus.cc:359] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 41cd568e408e40ddb2e85f8c2bee22a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 } } peers { permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 } } peers { permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 } }
I20260709 13:02:43.234477 10436 raft_consensus.cc:385] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 41cd568e408e40ddb2e85f8c2bee22a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:43.234829 10436 raft_consensus.cc:740] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 41cd568e408e40ddb2e85f8c2bee22a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41cd568e408e40ddb2e85f8c2bee22a3, State: Initialized, Role: FOLLOWER
I20260709 13:02:43.235373 10435 ts_tablet_manager.cc:1434] T 282e2cb436704f8cb1325a0b0121e13b P 882704f8b6a04a66ba918aac12d22da8: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.004s
I20260709 13:02:43.235813 10436 consensus_queue.cc:260] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 41cd568e408e40ddb2e85f8c2bee22a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 } } peers { permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 } } peers { permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 } }
I20260709 13:02:43.236804 10435 tablet_bootstrap.cc:492] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 882704f8b6a04a66ba918aac12d22da8: Bootstrap starting.
I20260709 13:02:43.246621 10435 tablet_bootstrap.cc:654] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 882704f8b6a04a66ba918aac12d22da8: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:43.249918 10271 heartbeater.cc:499] Master 127.0.107.254:40033 was elected leader, sending a full tablet report...
I20260709 13:02:43.251152 10438 tablet_bootstrap.cc:492] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 191dd64f4cf64ba08da29e42907a2dd3: No bootstrap required, opened a new log
I20260709 13:02:43.251988 10438 ts_tablet_manager.cc:1403] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 191dd64f4cf64ba08da29e42907a2dd3: Time spent bootstrapping tablet: real 0.026s	user 0.000s	sys 0.024s
I20260709 13:02:43.253690 10436 ts_tablet_manager.cc:1434] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 41cd568e408e40ddb2e85f8c2bee22a3: Time spent starting tablet: real 0.023s	user 0.010s	sys 0.007s
I20260709 13:02:43.255093 10436 tablet_bootstrap.cc:492] T 282e2cb436704f8cb1325a0b0121e13b P 41cd568e408e40ddb2e85f8c2bee22a3: Bootstrap starting.
I20260709 13:02:43.256394 10438 raft_consensus.cc:359] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 191dd64f4cf64ba08da29e42907a2dd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 } } peers { permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 } } peers { permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 } }
I20260709 13:02:43.257584 10438 raft_consensus.cc:385] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 191dd64f4cf64ba08da29e42907a2dd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:43.257923 10438 raft_consensus.cc:740] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 191dd64f4cf64ba08da29e42907a2dd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 191dd64f4cf64ba08da29e42907a2dd3, State: Initialized, Role: FOLLOWER
I20260709 13:02:43.258781 10438 consensus_queue.cc:260] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 191dd64f4cf64ba08da29e42907a2dd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 } } peers { permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 } } peers { permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 } }
I20260709 13:02:43.260655 10435 tablet_bootstrap.cc:492] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 882704f8b6a04a66ba918aac12d22da8: No bootstrap required, opened a new log
I20260709 13:02:43.261478 10435 ts_tablet_manager.cc:1403] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 882704f8b6a04a66ba918aac12d22da8: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.011s
I20260709 13:02:43.264722 10436 tablet_bootstrap.cc:654] T 282e2cb436704f8cb1325a0b0121e13b P 41cd568e408e40ddb2e85f8c2bee22a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:43.265781 10435 raft_consensus.cc:359] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 882704f8b6a04a66ba918aac12d22da8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 } } peers { permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 } } peers { permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 } }
I20260709 13:02:43.266888 10435 raft_consensus.cc:385] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 882704f8b6a04a66ba918aac12d22da8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:43.267284 10435 raft_consensus.cc:740] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 882704f8b6a04a66ba918aac12d22da8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 882704f8b6a04a66ba918aac12d22da8, State: Initialized, Role: FOLLOWER
I20260709 13:02:43.269347 10438 ts_tablet_manager.cc:1434] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 191dd64f4cf64ba08da29e42907a2dd3: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.009s
I20260709 13:02:43.278570 10420 heartbeater.cc:499] Master 127.0.107.254:40033 was elected leader, sending a full tablet report...
I20260709 13:02:43.278324 10435 consensus_queue.cc:260] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 882704f8b6a04a66ba918aac12d22da8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 } } peers { permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 } } peers { permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 } }
I20260709 13:02:43.280453 10436 tablet_bootstrap.cc:492] T 282e2cb436704f8cb1325a0b0121e13b P 41cd568e408e40ddb2e85f8c2bee22a3: No bootstrap required, opened a new log
I20260709 13:02:43.280766 10435 ts_tablet_manager.cc:1434] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 882704f8b6a04a66ba918aac12d22da8: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.004s
I20260709 13:02:43.281145 10436 ts_tablet_manager.cc:1403] T 282e2cb436704f8cb1325a0b0121e13b P 41cd568e408e40ddb2e85f8c2bee22a3: Time spent bootstrapping tablet: real 0.026s	user 0.013s	sys 0.011s
I20260709 13:02:43.283970 10438 tablet_bootstrap.cc:492] T 282e2cb436704f8cb1325a0b0121e13b P 191dd64f4cf64ba08da29e42907a2dd3: Bootstrap starting.
I20260709 13:02:43.284384 10436 raft_consensus.cc:359] T 282e2cb436704f8cb1325a0b0121e13b P 41cd568e408e40ddb2e85f8c2bee22a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 } } peers { permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 } } peers { permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 } }
I20260709 13:02:43.285321 10436 raft_consensus.cc:385] T 282e2cb436704f8cb1325a0b0121e13b P 41cd568e408e40ddb2e85f8c2bee22a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:43.285607 10436 raft_consensus.cc:740] T 282e2cb436704f8cb1325a0b0121e13b P 41cd568e408e40ddb2e85f8c2bee22a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41cd568e408e40ddb2e85f8c2bee22a3, State: Initialized, Role: FOLLOWER
I20260709 13:02:43.286556 10436 consensus_queue.cc:260] T 282e2cb436704f8cb1325a0b0121e13b P 41cd568e408e40ddb2e85f8c2bee22a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 } } peers { permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 } } peers { permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 } }
I20260709 13:02:43.288771 10436 ts_tablet_manager.cc:1434] T 282e2cb436704f8cb1325a0b0121e13b P 41cd568e408e40ddb2e85f8c2bee22a3: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:02:43.291827 10438 tablet_bootstrap.cc:654] T 282e2cb436704f8cb1325a0b0121e13b P 191dd64f4cf64ba08da29e42907a2dd3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:43.297545 10438 tablet_bootstrap.cc:492] T 282e2cb436704f8cb1325a0b0121e13b P 191dd64f4cf64ba08da29e42907a2dd3: No bootstrap required, opened a new log
I20260709 13:02:43.298038 10438 ts_tablet_manager.cc:1403] T 282e2cb436704f8cb1325a0b0121e13b P 191dd64f4cf64ba08da29e42907a2dd3: Time spent bootstrapping tablet: real 0.014s	user 0.004s	sys 0.008s
I20260709 13:02:43.300204 10438 raft_consensus.cc:359] T 282e2cb436704f8cb1325a0b0121e13b P 191dd64f4cf64ba08da29e42907a2dd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 } } peers { permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 } } peers { permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 } }
I20260709 13:02:43.300828 10438 raft_consensus.cc:385] T 282e2cb436704f8cb1325a0b0121e13b P 191dd64f4cf64ba08da29e42907a2dd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:43.301050 10438 raft_consensus.cc:740] T 282e2cb436704f8cb1325a0b0121e13b P 191dd64f4cf64ba08da29e42907a2dd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 191dd64f4cf64ba08da29e42907a2dd3, State: Initialized, Role: FOLLOWER
I20260709 13:02:43.301537 10438 consensus_queue.cc:260] T 282e2cb436704f8cb1325a0b0121e13b P 191dd64f4cf64ba08da29e42907a2dd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 } } peers { permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 } } peers { permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 } }
I20260709 13:02:43.302981 10438 ts_tablet_manager.cc:1434] T 282e2cb436704f8cb1325a0b0121e13b P 191dd64f4cf64ba08da29e42907a2dd3: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:02:43.326342 10442 raft_consensus.cc:493] T 282e2cb436704f8cb1325a0b0121e13b P 41cd568e408e40ddb2e85f8c2bee22a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.327055 10442 raft_consensus.cc:515] T 282e2cb436704f8cb1325a0b0121e13b P 41cd568e408e40ddb2e85f8c2bee22a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 } } peers { permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 } } peers { permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 } }
I20260709 13:02:43.329679 10442 leader_election.cc:290] T 282e2cb436704f8cb1325a0b0121e13b P 41cd568e408e40ddb2e85f8c2bee22a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 882704f8b6a04a66ba918aac12d22da8 (127.0.107.194:46641), 191dd64f4cf64ba08da29e42907a2dd3 (127.0.107.195:43473)
I20260709 13:02:43.339658 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282e2cb436704f8cb1325a0b0121e13b" candidate_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "882704f8b6a04a66ba918aac12d22da8" is_pre_election: true
I20260709 13:02:43.340466 10321 raft_consensus.cc:2468] T 282e2cb436704f8cb1325a0b0121e13b P 882704f8b6a04a66ba918aac12d22da8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41cd568e408e40ddb2e85f8c2bee22a3 in term 0.
I20260709 13:02:43.341090 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282e2cb436704f8cb1325a0b0121e13b" candidate_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "191dd64f4cf64ba08da29e42907a2dd3" is_pre_election: true
I20260709 13:02:43.341806 10210 leader_election.cc:304] T 282e2cb436704f8cb1325a0b0121e13b P 41cd568e408e40ddb2e85f8c2bee22a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41cd568e408e40ddb2e85f8c2bee22a3, 882704f8b6a04a66ba918aac12d22da8; no voters: 
I20260709 13:02:43.341854 10395 raft_consensus.cc:2468] T 282e2cb436704f8cb1325a0b0121e13b P 191dd64f4cf64ba08da29e42907a2dd3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 41cd568e408e40ddb2e85f8c2bee22a3 in term 0.
I20260709 13:02:43.342801 10442 raft_consensus.cc:2804] T 282e2cb436704f8cb1325a0b0121e13b P 41cd568e408e40ddb2e85f8c2bee22a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:43.343154 10442 raft_consensus.cc:493] T 282e2cb436704f8cb1325a0b0121e13b P 41cd568e408e40ddb2e85f8c2bee22a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:43.343466 10442 raft_consensus.cc:3060] T 282e2cb436704f8cb1325a0b0121e13b P 41cd568e408e40ddb2e85f8c2bee22a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:43.348798 10442 raft_consensus.cc:515] T 282e2cb436704f8cb1325a0b0121e13b P 41cd568e408e40ddb2e85f8c2bee22a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 } } peers { permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 } } peers { permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 } }
I20260709 13:02:43.350608 10442 leader_election.cc:290] T 282e2cb436704f8cb1325a0b0121e13b P 41cd568e408e40ddb2e85f8c2bee22a3 [CANDIDATE]: Term 1 election: Requested vote from peers 882704f8b6a04a66ba918aac12d22da8 (127.0.107.194:46641), 191dd64f4cf64ba08da29e42907a2dd3 (127.0.107.195:43473)
I20260709 13:02:43.351404 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282e2cb436704f8cb1325a0b0121e13b" candidate_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "882704f8b6a04a66ba918aac12d22da8"
I20260709 13:02:43.351702 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282e2cb436704f8cb1325a0b0121e13b" candidate_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "191dd64f4cf64ba08da29e42907a2dd3"
I20260709 13:02:43.352078 10321 raft_consensus.cc:3060] T 282e2cb436704f8cb1325a0b0121e13b P 882704f8b6a04a66ba918aac12d22da8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:43.352273 10395 raft_consensus.cc:3060] T 282e2cb436704f8cb1325a0b0121e13b P 191dd64f4cf64ba08da29e42907a2dd3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:43.359838 10395 raft_consensus.cc:2468] T 282e2cb436704f8cb1325a0b0121e13b P 191dd64f4cf64ba08da29e42907a2dd3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41cd568e408e40ddb2e85f8c2bee22a3 in term 1.
I20260709 13:02:43.359838 10321 raft_consensus.cc:2468] T 282e2cb436704f8cb1325a0b0121e13b P 882704f8b6a04a66ba918aac12d22da8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41cd568e408e40ddb2e85f8c2bee22a3 in term 1.
I20260709 13:02:43.361562 10212 leader_election.cc:304] T 282e2cb436704f8cb1325a0b0121e13b P 41cd568e408e40ddb2e85f8c2bee22a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 191dd64f4cf64ba08da29e42907a2dd3, 41cd568e408e40ddb2e85f8c2bee22a3, 882704f8b6a04a66ba918aac12d22da8; no voters: 
I20260709 13:02:43.362327 10442 raft_consensus.cc:2804] T 282e2cb436704f8cb1325a0b0121e13b P 41cd568e408e40ddb2e85f8c2bee22a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:43.363420 10442 raft_consensus.cc:697] T 282e2cb436704f8cb1325a0b0121e13b P 41cd568e408e40ddb2e85f8c2bee22a3 [term 1 LEADER]: Becoming Leader. State: Replica: 41cd568e408e40ddb2e85f8c2bee22a3, State: Running, Role: LEADER
I20260709 13:02:43.364172 10442 consensus_queue.cc:237] T 282e2cb436704f8cb1325a0b0121e13b P 41cd568e408e40ddb2e85f8c2bee22a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 } } peers { permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 } } peers { permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 } }
I20260709 13:02:43.371472 10143 catalog_manager.cc:5697] T 282e2cb436704f8cb1325a0b0121e13b P 41cd568e408e40ddb2e85f8c2bee22a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 41cd568e408e40ddb2e85f8c2bee22a3 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:43.419514 10444 raft_consensus.cc:493] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 191dd64f4cf64ba08da29e42907a2dd3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.420117 10444 raft_consensus.cc:515] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 191dd64f4cf64ba08da29e42907a2dd3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 } } peers { permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 } } peers { permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 } }
I20260709 13:02:43.422194 10444 leader_election.cc:290] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 191dd64f4cf64ba08da29e42907a2dd3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41cd568e408e40ddb2e85f8c2bee22a3 (127.0.107.193:35527), 882704f8b6a04a66ba918aac12d22da8 (127.0.107.194:46641)
I20260709 13:02:43.430652 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e45f3ce4d134b7d9c5df68e7f6f79e0" candidate_uuid: "191dd64f4cf64ba08da29e42907a2dd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" is_pre_election: true
I20260709 13:02:43.431432 10246 raft_consensus.cc:2468] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 41cd568e408e40ddb2e85f8c2bee22a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 191dd64f4cf64ba08da29e42907a2dd3 in term 0.
I20260709 13:02:43.432456 10360 leader_election.cc:304] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 191dd64f4cf64ba08da29e42907a2dd3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 191dd64f4cf64ba08da29e42907a2dd3, 41cd568e408e40ddb2e85f8c2bee22a3; no voters: 
I20260709 13:02:43.433068 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e45f3ce4d134b7d9c5df68e7f6f79e0" candidate_uuid: "191dd64f4cf64ba08da29e42907a2dd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "882704f8b6a04a66ba918aac12d22da8" is_pre_election: true
I20260709 13:02:43.433235 10444 raft_consensus.cc:2804] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 191dd64f4cf64ba08da29e42907a2dd3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:43.433679 10321 raft_consensus.cc:2468] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 882704f8b6a04a66ba918aac12d22da8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 191dd64f4cf64ba08da29e42907a2dd3 in term 0.
I20260709 13:02:43.433723 10444 raft_consensus.cc:493] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 191dd64f4cf64ba08da29e42907a2dd3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:43.434172 10444 raft_consensus.cc:3060] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 191dd64f4cf64ba08da29e42907a2dd3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:43.439232 10444 raft_consensus.cc:515] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 191dd64f4cf64ba08da29e42907a2dd3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 } } peers { permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 } } peers { permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 } }
I20260709 13:02:43.440876 10444 leader_election.cc:290] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 191dd64f4cf64ba08da29e42907a2dd3 [CANDIDATE]: Term 1 election: Requested vote from peers 41cd568e408e40ddb2e85f8c2bee22a3 (127.0.107.193:35527), 882704f8b6a04a66ba918aac12d22da8 (127.0.107.194:46641)
I20260709 13:02:43.441751 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e45f3ce4d134b7d9c5df68e7f6f79e0" candidate_uuid: "191dd64f4cf64ba08da29e42907a2dd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41cd568e408e40ddb2e85f8c2bee22a3"
I20260709 13:02:43.441947 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e45f3ce4d134b7d9c5df68e7f6f79e0" candidate_uuid: "191dd64f4cf64ba08da29e42907a2dd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "882704f8b6a04a66ba918aac12d22da8"
I20260709 13:02:43.442334 10246 raft_consensus.cc:3060] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 41cd568e408e40ddb2e85f8c2bee22a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:43.442723 10321 raft_consensus.cc:3060] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 882704f8b6a04a66ba918aac12d22da8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:43.447503 10246 raft_consensus.cc:2468] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 41cd568e408e40ddb2e85f8c2bee22a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 191dd64f4cf64ba08da29e42907a2dd3 in term 1.
I20260709 13:02:43.448050 10321 raft_consensus.cc:2468] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 882704f8b6a04a66ba918aac12d22da8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 191dd64f4cf64ba08da29e42907a2dd3 in term 1.
I20260709 13:02:43.448768 10360 leader_election.cc:304] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 191dd64f4cf64ba08da29e42907a2dd3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 191dd64f4cf64ba08da29e42907a2dd3, 41cd568e408e40ddb2e85f8c2bee22a3; no voters: 
I20260709 13:02:43.449517 10444 raft_consensus.cc:2804] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 191dd64f4cf64ba08da29e42907a2dd3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:43.450667 10444 raft_consensus.cc:697] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 191dd64f4cf64ba08da29e42907a2dd3 [term 1 LEADER]: Becoming Leader. State: Replica: 191dd64f4cf64ba08da29e42907a2dd3, State: Running, Role: LEADER
I20260709 13:02:43.451335 10444 consensus_queue.cc:237] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 191dd64f4cf64ba08da29e42907a2dd3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 } } peers { permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 } } peers { permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 } }
I20260709 13:02:43.458047 10143 catalog_manager.cc:5697] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 191dd64f4cf64ba08da29e42907a2dd3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 191dd64f4cf64ba08da29e42907a2dd3 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "191dd64f4cf64ba08da29e42907a2dd3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:43.497701 10143 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35558:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:02:43.499737 10143 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:02:43.523110 10236 tablet_service.cc:1511] Processing CreateTablet for tablet 6c1e83b3ac8c4d939c14b196c3c885ea (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=996f62c722b84a5e8bc13802e15e40ab]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:02:43.524616 10236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c1e83b3ac8c4d939c14b196c3c885ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:43.524463 10311 tablet_service.cc:1511] Processing CreateTablet for tablet 6c1e83b3ac8c4d939c14b196c3c885ea (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=996f62c722b84a5e8bc13802e15e40ab]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:02:43.525882 10311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c1e83b3ac8c4d939c14b196c3c885ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:43.526705 10385 tablet_service.cc:1511] Processing CreateTablet for tablet 6c1e83b3ac8c4d939c14b196c3c885ea (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=996f62c722b84a5e8bc13802e15e40ab]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:02:43.527942 10385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6c1e83b3ac8c4d939c14b196c3c885ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:43.528571 10310 tablet_service.cc:1511] Processing CreateTablet for tablet 5bc6c0ad5d5245e4891db44a1f86d948 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=996f62c722b84a5e8bc13802e15e40ab]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:02:43.529842 10310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bc6c0ad5d5245e4891db44a1f86d948. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:43.530392 10235 tablet_service.cc:1511] Processing CreateTablet for tablet 5bc6c0ad5d5245e4891db44a1f86d948 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=996f62c722b84a5e8bc13802e15e40ab]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:02:43.536922 10235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bc6c0ad5d5245e4891db44a1f86d948. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:43.543043 10384 tablet_service.cc:1511] Processing CreateTablet for tablet 5bc6c0ad5d5245e4891db44a1f86d948 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=996f62c722b84a5e8bc13802e15e40ab]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:02:43.544435 10384 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bc6c0ad5d5245e4891db44a1f86d948. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:43.545051 10435 tablet_bootstrap.cc:492] T 6c1e83b3ac8c4d939c14b196c3c885ea P 882704f8b6a04a66ba918aac12d22da8: Bootstrap starting.
I20260709 13:02:43.551499 10435 tablet_bootstrap.cc:654] T 6c1e83b3ac8c4d939c14b196c3c885ea P 882704f8b6a04a66ba918aac12d22da8: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:43.559823 10438 tablet_bootstrap.cc:492] T 6c1e83b3ac8c4d939c14b196c3c885ea P 191dd64f4cf64ba08da29e42907a2dd3: Bootstrap starting.
I20260709 13:02:43.560604 10435 tablet_bootstrap.cc:492] T 6c1e83b3ac8c4d939c14b196c3c885ea P 882704f8b6a04a66ba918aac12d22da8: No bootstrap required, opened a new log
I20260709 13:02:43.561208 10435 ts_tablet_manager.cc:1403] T 6c1e83b3ac8c4d939c14b196c3c885ea P 882704f8b6a04a66ba918aac12d22da8: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 13:02:43.564162 10435 raft_consensus.cc:359] T 6c1e83b3ac8c4d939c14b196c3c885ea P 882704f8b6a04a66ba918aac12d22da8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 } } peers { permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 } } peers { permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 } }
I20260709 13:02:43.564888 10435 raft_consensus.cc:385] T 6c1e83b3ac8c4d939c14b196c3c885ea P 882704f8b6a04a66ba918aac12d22da8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:43.565174 10435 raft_consensus.cc:740] T 6c1e83b3ac8c4d939c14b196c3c885ea P 882704f8b6a04a66ba918aac12d22da8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 882704f8b6a04a66ba918aac12d22da8, State: Initialized, Role: FOLLOWER
I20260709 13:02:43.566045 10438 tablet_bootstrap.cc:654] T 6c1e83b3ac8c4d939c14b196c3c885ea P 191dd64f4cf64ba08da29e42907a2dd3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:43.566105 10435 consensus_queue.cc:260] T 6c1e83b3ac8c4d939c14b196c3c885ea P 882704f8b6a04a66ba918aac12d22da8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 } } peers { permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 } } peers { permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 } }
I20260709 13:02:43.568692 10435 ts_tablet_manager.cc:1434] T 6c1e83b3ac8c4d939c14b196c3c885ea P 882704f8b6a04a66ba918aac12d22da8: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:02:43.569809 10436 tablet_bootstrap.cc:492] T 6c1e83b3ac8c4d939c14b196c3c885ea P 41cd568e408e40ddb2e85f8c2bee22a3: Bootstrap starting.
I20260709 13:02:43.570214 10435 tablet_bootstrap.cc:492] T 5bc6c0ad5d5245e4891db44a1f86d948 P 882704f8b6a04a66ba918aac12d22da8: Bootstrap starting.
I20260709 13:02:43.573545 10438 tablet_bootstrap.cc:492] T 6c1e83b3ac8c4d939c14b196c3c885ea P 191dd64f4cf64ba08da29e42907a2dd3: No bootstrap required, opened a new log
I20260709 13:02:43.574085 10438 ts_tablet_manager.cc:1403] T 6c1e83b3ac8c4d939c14b196c3c885ea P 191dd64f4cf64ba08da29e42907a2dd3: Time spent bootstrapping tablet: real 0.014s	user 0.001s	sys 0.010s
I20260709 13:02:43.577348 10438 raft_consensus.cc:359] T 6c1e83b3ac8c4d939c14b196c3c885ea P 191dd64f4cf64ba08da29e42907a2dd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 } } peers { permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 } } peers { permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 } }
I20260709 13:02:43.577841 10436 tablet_bootstrap.cc:654] T 6c1e83b3ac8c4d939c14b196c3c885ea P 41cd568e408e40ddb2e85f8c2bee22a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:43.578109 10438 raft_consensus.cc:385] T 6c1e83b3ac8c4d939c14b196c3c885ea P 191dd64f4cf64ba08da29e42907a2dd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:43.578480 10438 raft_consensus.cc:740] T 6c1e83b3ac8c4d939c14b196c3c885ea P 191dd64f4cf64ba08da29e42907a2dd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 191dd64f4cf64ba08da29e42907a2dd3, State: Initialized, Role: FOLLOWER
I20260709 13:02:43.579418 10438 consensus_queue.cc:260] T 6c1e83b3ac8c4d939c14b196c3c885ea P 191dd64f4cf64ba08da29e42907a2dd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 } } peers { permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 } } peers { permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 } }
I20260709 13:02:43.580472 10435 tablet_bootstrap.cc:654] T 5bc6c0ad5d5245e4891db44a1f86d948 P 882704f8b6a04a66ba918aac12d22da8: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:43.581699 10438 ts_tablet_manager.cc:1434] T 6c1e83b3ac8c4d939c14b196c3c885ea P 191dd64f4cf64ba08da29e42907a2dd3: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:02:43.582754 10438 tablet_bootstrap.cc:492] T 5bc6c0ad5d5245e4891db44a1f86d948 P 191dd64f4cf64ba08da29e42907a2dd3: Bootstrap starting.
I20260709 13:02:43.589284 10438 tablet_bootstrap.cc:654] T 5bc6c0ad5d5245e4891db44a1f86d948 P 191dd64f4cf64ba08da29e42907a2dd3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:43.590688 10436 tablet_bootstrap.cc:492] T 6c1e83b3ac8c4d939c14b196c3c885ea P 41cd568e408e40ddb2e85f8c2bee22a3: No bootstrap required, opened a new log
I20260709 13:02:43.591365 10436 ts_tablet_manager.cc:1403] T 6c1e83b3ac8c4d939c14b196c3c885ea P 41cd568e408e40ddb2e85f8c2bee22a3: Time spent bootstrapping tablet: real 0.022s	user 0.009s	sys 0.008s
I20260709 13:02:43.594305 10435 tablet_bootstrap.cc:492] T 5bc6c0ad5d5245e4891db44a1f86d948 P 882704f8b6a04a66ba918aac12d22da8: No bootstrap required, opened a new log
I20260709 13:02:43.594910 10435 ts_tablet_manager.cc:1403] T 5bc6c0ad5d5245e4891db44a1f86d948 P 882704f8b6a04a66ba918aac12d22da8: Time spent bootstrapping tablet: real 0.025s	user 0.009s	sys 0.010s
I20260709 13:02:43.594635 10436 raft_consensus.cc:359] T 6c1e83b3ac8c4d939c14b196c3c885ea P 41cd568e408e40ddb2e85f8c2bee22a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 } } peers { permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 } } peers { permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 } }
I20260709 13:02:43.595403 10436 raft_consensus.cc:385] T 6c1e83b3ac8c4d939c14b196c3c885ea P 41cd568e408e40ddb2e85f8c2bee22a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:43.595732 10436 raft_consensus.cc:740] T 6c1e83b3ac8c4d939c14b196c3c885ea P 41cd568e408e40ddb2e85f8c2bee22a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41cd568e408e40ddb2e85f8c2bee22a3, State: Initialized, Role: FOLLOWER
I20260709 13:02:43.596652 10436 consensus_queue.cc:260] T 6c1e83b3ac8c4d939c14b196c3c885ea P 41cd568e408e40ddb2e85f8c2bee22a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 } } peers { permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 } } peers { permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 } }
I20260709 13:02:43.599102 10436 ts_tablet_manager.cc:1434] T 6c1e83b3ac8c4d939c14b196c3c885ea P 41cd568e408e40ddb2e85f8c2bee22a3: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.004s
I20260709 13:02:43.600162 10436 tablet_bootstrap.cc:492] T 5bc6c0ad5d5245e4891db44a1f86d948 P 41cd568e408e40ddb2e85f8c2bee22a3: Bootstrap starting.
I20260709 13:02:43.606750 10435 raft_consensus.cc:359] T 5bc6c0ad5d5245e4891db44a1f86d948 P 882704f8b6a04a66ba918aac12d22da8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 } } peers { permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 } } peers { permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 } }
I20260709 13:02:43.607501 10436 tablet_bootstrap.cc:654] T 5bc6c0ad5d5245e4891db44a1f86d948 P 41cd568e408e40ddb2e85f8c2bee22a3: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:43.607609 10435 raft_consensus.cc:385] T 5bc6c0ad5d5245e4891db44a1f86d948 P 882704f8b6a04a66ba918aac12d22da8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:43.608088 10435 raft_consensus.cc:740] T 5bc6c0ad5d5245e4891db44a1f86d948 P 882704f8b6a04a66ba918aac12d22da8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 882704f8b6a04a66ba918aac12d22da8, State: Initialized, Role: FOLLOWER
I20260709 13:02:43.608312 10438 tablet_bootstrap.cc:492] T 5bc6c0ad5d5245e4891db44a1f86d948 P 191dd64f4cf64ba08da29e42907a2dd3: No bootstrap required, opened a new log
I20260709 13:02:43.609072 10438 ts_tablet_manager.cc:1403] T 5bc6c0ad5d5245e4891db44a1f86d948 P 191dd64f4cf64ba08da29e42907a2dd3: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.013s
I20260709 13:02:43.608956 10435 consensus_queue.cc:260] T 5bc6c0ad5d5245e4891db44a1f86d948 P 882704f8b6a04a66ba918aac12d22da8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 } } peers { permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 } } peers { permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 } }
I20260709 13:02:43.611721 10435 ts_tablet_manager.cc:1434] T 5bc6c0ad5d5245e4891db44a1f86d948 P 882704f8b6a04a66ba918aac12d22da8: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:02:43.614167 10438 raft_consensus.cc:359] T 5bc6c0ad5d5245e4891db44a1f86d948 P 191dd64f4cf64ba08da29e42907a2dd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 } } peers { permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 } } peers { permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 } }
I20260709 13:02:43.614856 10438 raft_consensus.cc:385] T 5bc6c0ad5d5245e4891db44a1f86d948 P 191dd64f4cf64ba08da29e42907a2dd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:43.616153 10440 raft_consensus.cc:493] T 6c1e83b3ac8c4d939c14b196c3c885ea P 882704f8b6a04a66ba918aac12d22da8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.616690 10440 raft_consensus.cc:515] T 6c1e83b3ac8c4d939c14b196c3c885ea P 882704f8b6a04a66ba918aac12d22da8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 } } peers { permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 } } peers { permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 } }
I20260709 13:02:43.617527 10436 tablet_bootstrap.cc:492] T 5bc6c0ad5d5245e4891db44a1f86d948 P 41cd568e408e40ddb2e85f8c2bee22a3: No bootstrap required, opened a new log
I20260709 13:02:43.618063 10436 ts_tablet_manager.cc:1403] T 5bc6c0ad5d5245e4891db44a1f86d948 P 41cd568e408e40ddb2e85f8c2bee22a3: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.000s
I20260709 13:02:43.621364 10440 leader_election.cc:290] T 6c1e83b3ac8c4d939c14b196c3c885ea P 882704f8b6a04a66ba918aac12d22da8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41cd568e408e40ddb2e85f8c2bee22a3 (127.0.107.193:35527), 191dd64f4cf64ba08da29e42907a2dd3 (127.0.107.195:43473)
I20260709 13:02:43.621079 10436 raft_consensus.cc:359] T 5bc6c0ad5d5245e4891db44a1f86d948 P 41cd568e408e40ddb2e85f8c2bee22a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 } } peers { permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 } } peers { permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 } }
I20260709 13:02:43.615598 10438 raft_consensus.cc:740] T 5bc6c0ad5d5245e4891db44a1f86d948 P 191dd64f4cf64ba08da29e42907a2dd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 191dd64f4cf64ba08da29e42907a2dd3, State: Initialized, Role: FOLLOWER
I20260709 13:02:43.622105 10436 raft_consensus.cc:385] T 5bc6c0ad5d5245e4891db44a1f86d948 P 41cd568e408e40ddb2e85f8c2bee22a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:43.623179 10436 raft_consensus.cc:740] T 5bc6c0ad5d5245e4891db44a1f86d948 P 41cd568e408e40ddb2e85f8c2bee22a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41cd568e408e40ddb2e85f8c2bee22a3, State: Initialized, Role: FOLLOWER
I20260709 13:02:43.623057 10438 consensus_queue.cc:260] T 5bc6c0ad5d5245e4891db44a1f86d948 P 191dd64f4cf64ba08da29e42907a2dd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 } } peers { permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 } } peers { permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 } }
I20260709 13:02:43.624250 10436 consensus_queue.cc:260] T 5bc6c0ad5d5245e4891db44a1f86d948 P 41cd568e408e40ddb2e85f8c2bee22a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 } } peers { permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 } } peers { permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 } }
I20260709 13:02:43.628542 10436 ts_tablet_manager.cc:1434] T 5bc6c0ad5d5245e4891db44a1f86d948 P 41cd568e408e40ddb2e85f8c2bee22a3: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:02:43.632346 10438 ts_tablet_manager.cc:1434] T 5bc6c0ad5d5245e4891db44a1f86d948 P 191dd64f4cf64ba08da29e42907a2dd3: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 13:02:43.638564 10444 raft_consensus.cc:493] T 5bc6c0ad5d5245e4891db44a1f86d948 P 191dd64f4cf64ba08da29e42907a2dd3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:43.638564 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c1e83b3ac8c4d939c14b196c3c885ea" candidate_uuid: "882704f8b6a04a66ba918aac12d22da8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "191dd64f4cf64ba08da29e42907a2dd3" is_pre_election: true
I20260709 13:02:43.639421 10395 raft_consensus.cc:2468] T 6c1e83b3ac8c4d939c14b196c3c885ea P 191dd64f4cf64ba08da29e42907a2dd3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 882704f8b6a04a66ba918aac12d22da8 in term 0.
I20260709 13:02:43.639199 10444 raft_consensus.cc:515] T 5bc6c0ad5d5245e4891db44a1f86d948 P 191dd64f4cf64ba08da29e42907a2dd3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 } } peers { permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 } } peers { permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 } }
I20260709 13:02:43.640664 10287 leader_election.cc:304] T 6c1e83b3ac8c4d939c14b196c3c885ea P 882704f8b6a04a66ba918aac12d22da8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 191dd64f4cf64ba08da29e42907a2dd3, 882704f8b6a04a66ba918aac12d22da8; no voters: 
I20260709 13:02:43.641572 10440 raft_consensus.cc:2804] T 6c1e83b3ac8c4d939c14b196c3c885ea P 882704f8b6a04a66ba918aac12d22da8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:43.642009 10440 raft_consensus.cc:493] T 6c1e83b3ac8c4d939c14b196c3c885ea P 882704f8b6a04a66ba918aac12d22da8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:43.642342 10440 raft_consensus.cc:3060] T 6c1e83b3ac8c4d939c14b196c3c885ea P 882704f8b6a04a66ba918aac12d22da8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:43.642731 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc6c0ad5d5245e4891db44a1f86d948" candidate_uuid: "191dd64f4cf64ba08da29e42907a2dd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "882704f8b6a04a66ba918aac12d22da8" is_pre_election: true
I20260709 13:02:43.642975 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc6c0ad5d5245e4891db44a1f86d948" candidate_uuid: "191dd64f4cf64ba08da29e42907a2dd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" is_pre_election: true
I20260709 13:02:43.643388 10321 raft_consensus.cc:2468] T 5bc6c0ad5d5245e4891db44a1f86d948 P 882704f8b6a04a66ba918aac12d22da8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 191dd64f4cf64ba08da29e42907a2dd3 in term 0.
I20260709 13:02:43.643708 10246 raft_consensus.cc:2468] T 5bc6c0ad5d5245e4891db44a1f86d948 P 41cd568e408e40ddb2e85f8c2bee22a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 191dd64f4cf64ba08da29e42907a2dd3 in term 0.
I20260709 13:02:43.644707 10359 leader_election.cc:304] T 5bc6c0ad5d5245e4891db44a1f86d948 P 191dd64f4cf64ba08da29e42907a2dd3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 191dd64f4cf64ba08da29e42907a2dd3, 882704f8b6a04a66ba918aac12d22da8; no voters: 
I20260709 13:02:43.641584 10444 leader_election.cc:290] T 5bc6c0ad5d5245e4891db44a1f86d948 P 191dd64f4cf64ba08da29e42907a2dd3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 41cd568e408e40ddb2e85f8c2bee22a3 (127.0.107.193:35527), 882704f8b6a04a66ba918aac12d22da8 (127.0.107.194:46641)
I20260709 13:02:43.645687 10451 raft_consensus.cc:2804] T 5bc6c0ad5d5245e4891db44a1f86d948 P 191dd64f4cf64ba08da29e42907a2dd3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:43.646061 10451 raft_consensus.cc:493] T 5bc6c0ad5d5245e4891db44a1f86d948 P 191dd64f4cf64ba08da29e42907a2dd3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:43.646373 10451 raft_consensus.cc:3060] T 5bc6c0ad5d5245e4891db44a1f86d948 P 191dd64f4cf64ba08da29e42907a2dd3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:43.649909 10440 raft_consensus.cc:515] T 6c1e83b3ac8c4d939c14b196c3c885ea P 882704f8b6a04a66ba918aac12d22da8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 } } peers { permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 } } peers { permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 } }
I20260709 13:02:43.653219 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c1e83b3ac8c4d939c14b196c3c885ea" candidate_uuid: "882704f8b6a04a66ba918aac12d22da8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "191dd64f4cf64ba08da29e42907a2dd3"
I20260709 13:02:43.653882 10395 raft_consensus.cc:3060] T 6c1e83b3ac8c4d939c14b196c3c885ea P 191dd64f4cf64ba08da29e42907a2dd3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:43.653949 10451 raft_consensus.cc:515] T 5bc6c0ad5d5245e4891db44a1f86d948 P 191dd64f4cf64ba08da29e42907a2dd3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 } } peers { permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 } } peers { permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 } }
I20260709 13:02:43.653288 10440 leader_election.cc:290] T 6c1e83b3ac8c4d939c14b196c3c885ea P 882704f8b6a04a66ba918aac12d22da8 [CANDIDATE]: Term 1 election: Requested vote from peers 41cd568e408e40ddb2e85f8c2bee22a3 (127.0.107.193:35527), 191dd64f4cf64ba08da29e42907a2dd3 (127.0.107.195:43473)
I20260709 13:02:43.655920 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c1e83b3ac8c4d939c14b196c3c885ea" candidate_uuid: "882704f8b6a04a66ba918aac12d22da8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" is_pre_election: true
I20260709 13:02:43.656610 10245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c1e83b3ac8c4d939c14b196c3c885ea" candidate_uuid: "882704f8b6a04a66ba918aac12d22da8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41cd568e408e40ddb2e85f8c2bee22a3"
I20260709 13:02:43.656690 10246 raft_consensus.cc:2468] T 6c1e83b3ac8c4d939c14b196c3c885ea P 41cd568e408e40ddb2e85f8c2bee22a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 882704f8b6a04a66ba918aac12d22da8 in term 0.
I20260709 13:02:43.657910 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc6c0ad5d5245e4891db44a1f86d948" candidate_uuid: "191dd64f4cf64ba08da29e42907a2dd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "41cd568e408e40ddb2e85f8c2bee22a3"
I20260709 13:02:43.658063 10451 leader_election.cc:290] T 5bc6c0ad5d5245e4891db44a1f86d948 P 191dd64f4cf64ba08da29e42907a2dd3 [CANDIDATE]: Term 1 election: Requested vote from peers 41cd568e408e40ddb2e85f8c2bee22a3 (127.0.107.193:35527), 882704f8b6a04a66ba918aac12d22da8 (127.0.107.194:46641)
I20260709 13:02:43.658591 10244 raft_consensus.cc:3060] T 5bc6c0ad5d5245e4891db44a1f86d948 P 41cd568e408e40ddb2e85f8c2bee22a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:43.659113 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc6c0ad5d5245e4891db44a1f86d948" candidate_uuid: "191dd64f4cf64ba08da29e42907a2dd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "882704f8b6a04a66ba918aac12d22da8"
I20260709 13:02:43.659719 10321 raft_consensus.cc:3060] T 5bc6c0ad5d5245e4891db44a1f86d948 P 882704f8b6a04a66ba918aac12d22da8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:43.660889 10395 raft_consensus.cc:2468] T 6c1e83b3ac8c4d939c14b196c3c885ea P 191dd64f4cf64ba08da29e42907a2dd3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 882704f8b6a04a66ba918aac12d22da8 in term 1.
I20260709 13:02:43.661872 10287 leader_election.cc:304] T 6c1e83b3ac8c4d939c14b196c3c885ea P 882704f8b6a04a66ba918aac12d22da8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 191dd64f4cf64ba08da29e42907a2dd3, 882704f8b6a04a66ba918aac12d22da8; no voters: 41cd568e408e40ddb2e85f8c2bee22a3
I20260709 13:02:43.662569 10440 raft_consensus.cc:2804] T 6c1e83b3ac8c4d939c14b196c3c885ea P 882704f8b6a04a66ba918aac12d22da8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:43.666622 10244 raft_consensus.cc:2468] T 5bc6c0ad5d5245e4891db44a1f86d948 P 41cd568e408e40ddb2e85f8c2bee22a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 191dd64f4cf64ba08da29e42907a2dd3 in term 1.
I20260709 13:02:43.667239 10321 raft_consensus.cc:2468] T 5bc6c0ad5d5245e4891db44a1f86d948 P 882704f8b6a04a66ba918aac12d22da8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 191dd64f4cf64ba08da29e42907a2dd3 in term 1.
I20260709 13:02:43.668049 10440 raft_consensus.cc:697] T 6c1e83b3ac8c4d939c14b196c3c885ea P 882704f8b6a04a66ba918aac12d22da8 [term 1 LEADER]: Becoming Leader. State: Replica: 882704f8b6a04a66ba918aac12d22da8, State: Running, Role: LEADER
I20260709 13:02:43.669268 10359 leader_election.cc:304] T 5bc6c0ad5d5245e4891db44a1f86d948 P 191dd64f4cf64ba08da29e42907a2dd3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 191dd64f4cf64ba08da29e42907a2dd3, 882704f8b6a04a66ba918aac12d22da8; no voters: 
I20260709 13:02:43.670818 10440 consensus_queue.cc:237] T 6c1e83b3ac8c4d939c14b196c3c885ea P 882704f8b6a04a66ba918aac12d22da8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 } } peers { permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 } } peers { permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 } }
I20260709 13:02:43.671741 10451 raft_consensus.cc:2804] T 5bc6c0ad5d5245e4891db44a1f86d948 P 191dd64f4cf64ba08da29e42907a2dd3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:43.672663 10451 raft_consensus.cc:697] T 5bc6c0ad5d5245e4891db44a1f86d948 P 191dd64f4cf64ba08da29e42907a2dd3 [term 1 LEADER]: Becoming Leader. State: Replica: 191dd64f4cf64ba08da29e42907a2dd3, State: Running, Role: LEADER
W20260709 13:02:43.673502 10192 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:43.673569 10451 consensus_queue.cc:237] T 5bc6c0ad5d5245e4891db44a1f86d948 P 191dd64f4cf64ba08da29e42907a2dd3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 } } peers { permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 } } peers { permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 } }
I20260709 13:02:43.680207 10143 catalog_manager.cc:5697] T 6c1e83b3ac8c4d939c14b196c3c885ea P 882704f8b6a04a66ba918aac12d22da8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 882704f8b6a04a66ba918aac12d22da8 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "882704f8b6a04a66ba918aac12d22da8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:43.682683 10144 catalog_manager.cc:5697] T 5bc6c0ad5d5245e4891db44a1f86d948 P 191dd64f4cf64ba08da29e42907a2dd3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 191dd64f4cf64ba08da29e42907a2dd3 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "191dd64f4cf64ba08da29e42907a2dd3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:43.713086 10395 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e45f3ce4d134b7d9c5df68e7f6f79e0"
dest_uuid: "191dd64f4cf64ba08da29e42907a2dd3"
mode: GRACEFUL
new_leader_uuid: "41cd568e408e40ddb2e85f8c2bee22a3"
 from {username='slave'} at 127.0.0.1:53948
I20260709 13:02:43.713685 10395 raft_consensus.cc:606] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 191dd64f4cf64ba08da29e42907a2dd3 [term 1 LEADER]: Received request to transfer leadership to TS 41cd568e408e40ddb2e85f8c2bee22a3
I20260709 13:02:43.726641 10244 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "282e2cb436704f8cb1325a0b0121e13b"
dest_uuid: "41cd568e408e40ddb2e85f8c2bee22a3"
mode: GRACEFUL
new_leader_uuid: "191dd64f4cf64ba08da29e42907a2dd3"
 from {username='slave'} at 127.0.0.1:46622
I20260709 13:02:43.727203 10244 raft_consensus.cc:606] T 282e2cb436704f8cb1325a0b0121e13b P 41cd568e408e40ddb2e85f8c2bee22a3 [term 1 LEADER]: Received request to transfer leadership to TS 191dd64f4cf64ba08da29e42907a2dd3
I20260709 13:02:43.740653 10321 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c1e83b3ac8c4d939c14b196c3c885ea"
dest_uuid: "882704f8b6a04a66ba918aac12d22da8"
mode: GRACEFUL
new_leader_uuid: "41cd568e408e40ddb2e85f8c2bee22a3"
 from {username='slave'} at 127.0.0.1:53882
I20260709 13:02:43.741142 10321 raft_consensus.cc:606] T 6c1e83b3ac8c4d939c14b196c3c885ea P 882704f8b6a04a66ba918aac12d22da8 [term 1 LEADER]: Received request to transfer leadership to TS 41cd568e408e40ddb2e85f8c2bee22a3
I20260709 13:02:43.746269 10395 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5bc6c0ad5d5245e4891db44a1f86d948"
dest_uuid: "191dd64f4cf64ba08da29e42907a2dd3"
mode: GRACEFUL
new_leader_uuid: "41cd568e408e40ddb2e85f8c2bee22a3"
 from {username='slave'} at 127.0.0.1:53948
I20260709 13:02:43.746786 10395 raft_consensus.cc:606] T 5bc6c0ad5d5245e4891db44a1f86d948 P 191dd64f4cf64ba08da29e42907a2dd3 [term 1 LEADER]: Received request to transfer leadership to TS 41cd568e408e40ddb2e85f8c2bee22a3
I20260709 13:02:43.870810 10451 consensus_queue.cc:1048] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 191dd64f4cf64ba08da29e42907a2dd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:43.878123 10444 raft_consensus.cc:993] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 191dd64f4cf64ba08da29e42907a2dd3: : Instructing follower 41cd568e408e40ddb2e85f8c2bee22a3 to start an election
I20260709 13:02:43.878930 10451 raft_consensus.cc:1081] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 191dd64f4cf64ba08da29e42907a2dd3 [term 1 LEADER]: Signalling peer 41cd568e408e40ddb2e85f8c2bee22a3 to start an election
I20260709 13:02:43.881783 10246 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5e45f3ce4d134b7d9c5df68e7f6f79e0"
dest_uuid: "41cd568e408e40ddb2e85f8c2bee22a3"
 from {username='slave'} at 127.0.0.1:46600
I20260709 13:02:43.882403 10246 raft_consensus.cc:493] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 41cd568e408e40ddb2e85f8c2bee22a3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:43.882768 10246 raft_consensus.cc:3060] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 41cd568e408e40ddb2e85f8c2bee22a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:43.886171 10444 consensus_queue.cc:1048] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 191dd64f4cf64ba08da29e42907a2dd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:43.891064 10246 raft_consensus.cc:515] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 41cd568e408e40ddb2e85f8c2bee22a3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 } } peers { permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 } } peers { permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 } }
I20260709 13:02:43.892025 10244 raft_consensus.cc:1240] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 41cd568e408e40ddb2e85f8c2bee22a3 [term 2 FOLLOWER]: Rejecting Update request from peer 191dd64f4cf64ba08da29e42907a2dd3 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:43.894238 10320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e45f3ce4d134b7d9c5df68e7f6f79e0" candidate_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "882704f8b6a04a66ba918aac12d22da8"
I20260709 13:02:43.895294 10246 leader_election.cc:290] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 41cd568e408e40ddb2e85f8c2bee22a3 [CANDIDATE]: Term 2 election: Requested vote from peers 882704f8b6a04a66ba918aac12d22da8 (127.0.107.194:46641), 191dd64f4cf64ba08da29e42907a2dd3 (127.0.107.195:43473)
I20260709 13:02:43.895659 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e45f3ce4d134b7d9c5df68e7f6f79e0" candidate_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "191dd64f4cf64ba08da29e42907a2dd3"
I20260709 13:02:43.896232 10395 raft_consensus.cc:3055] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 191dd64f4cf64ba08da29e42907a2dd3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:43.898834 10395 raft_consensus.cc:740] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 191dd64f4cf64ba08da29e42907a2dd3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 191dd64f4cf64ba08da29e42907a2dd3, State: Running, Role: LEADER
I20260709 13:02:43.899672 10395 consensus_queue.cc:260] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 191dd64f4cf64ba08da29e42907a2dd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 } } peers { permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 } } peers { permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 } }
I20260709 13:02:43.900626 10395 raft_consensus.cc:3060] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 191dd64f4cf64ba08da29e42907a2dd3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:43.901247 10442 consensus_queue.cc:1048] T 282e2cb436704f8cb1325a0b0121e13b P 41cd568e408e40ddb2e85f8c2bee22a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:43.907703 10395 raft_consensus.cc:2468] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 191dd64f4cf64ba08da29e42907a2dd3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41cd568e408e40ddb2e85f8c2bee22a3 in term 2.
I20260709 13:02:43.919337 10212 leader_election.cc:304] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 41cd568e408e40ddb2e85f8c2bee22a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 191dd64f4cf64ba08da29e42907a2dd3, 41cd568e408e40ddb2e85f8c2bee22a3; no voters: 882704f8b6a04a66ba918aac12d22da8
I20260709 13:02:43.919781 10476 consensus_queue.cc:1048] T 282e2cb436704f8cb1325a0b0121e13b P 41cd568e408e40ddb2e85f8c2bee22a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:43.921346 10476 raft_consensus.cc:2804] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 41cd568e408e40ddb2e85f8c2bee22a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:43.921859 10476 raft_consensus.cc:697] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 41cd568e408e40ddb2e85f8c2bee22a3 [term 2 LEADER]: Becoming Leader. State: Replica: 41cd568e408e40ddb2e85f8c2bee22a3, State: Running, Role: LEADER
I20260709 13:02:43.922642 10476 consensus_queue.cc:237] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 41cd568e408e40ddb2e85f8c2bee22a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 } } peers { permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 } } peers { permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 } }
I20260709 13:02:43.936374 10143 catalog_manager.cc:5697] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 41cd568e408e40ddb2e85f8c2bee22a3 reported cstate change: term changed from 1 to 2, leader changed from 191dd64f4cf64ba08da29e42907a2dd3 (127.0.107.195) to 41cd568e408e40ddb2e85f8c2bee22a3 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:43.949254 10477 raft_consensus.cc:993] T 282e2cb436704f8cb1325a0b0121e13b P 41cd568e408e40ddb2e85f8c2bee22a3: : Instructing follower 191dd64f4cf64ba08da29e42907a2dd3 to start an election
I20260709 13:02:43.949851 10480 raft_consensus.cc:1081] T 282e2cb436704f8cb1325a0b0121e13b P 41cd568e408e40ddb2e85f8c2bee22a3 [term 1 LEADER]: Signalling peer 191dd64f4cf64ba08da29e42907a2dd3 to start an election
I20260709 13:02:43.951542 10395 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "282e2cb436704f8cb1325a0b0121e13b"
dest_uuid: "191dd64f4cf64ba08da29e42907a2dd3"
 from {username='slave'} at 127.0.0.1:53940
I20260709 13:02:43.952096 10395 raft_consensus.cc:493] T 282e2cb436704f8cb1325a0b0121e13b P 191dd64f4cf64ba08da29e42907a2dd3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:43.952493 10395 raft_consensus.cc:3060] T 282e2cb436704f8cb1325a0b0121e13b P 191dd64f4cf64ba08da29e42907a2dd3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:43.958463 10395 raft_consensus.cc:515] T 282e2cb436704f8cb1325a0b0121e13b P 191dd64f4cf64ba08da29e42907a2dd3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 } } peers { permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 } } peers { permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 } }
I20260709 13:02:43.961095 10244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282e2cb436704f8cb1325a0b0121e13b" candidate_uuid: "191dd64f4cf64ba08da29e42907a2dd3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "41cd568e408e40ddb2e85f8c2bee22a3"
I20260709 13:02:43.961514 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "282e2cb436704f8cb1325a0b0121e13b" candidate_uuid: "191dd64f4cf64ba08da29e42907a2dd3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "882704f8b6a04a66ba918aac12d22da8"
I20260709 13:02:43.961732 10244 raft_consensus.cc:3055] T 282e2cb436704f8cb1325a0b0121e13b P 41cd568e408e40ddb2e85f8c2bee22a3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:43.961889 10395 leader_election.cc:290] T 282e2cb436704f8cb1325a0b0121e13b P 191dd64f4cf64ba08da29e42907a2dd3 [CANDIDATE]: Term 2 election: Requested vote from peers 41cd568e408e40ddb2e85f8c2bee22a3 (127.0.107.193:35527), 882704f8b6a04a66ba918aac12d22da8 (127.0.107.194:46641)
I20260709 13:02:43.962190 10321 raft_consensus.cc:3060] T 282e2cb436704f8cb1325a0b0121e13b P 882704f8b6a04a66ba918aac12d22da8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:43.962144 10244 raft_consensus.cc:740] T 282e2cb436704f8cb1325a0b0121e13b P 41cd568e408e40ddb2e85f8c2bee22a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 41cd568e408e40ddb2e85f8c2bee22a3, State: Running, Role: LEADER
I20260709 13:02:43.963294 10244 consensus_queue.cc:260] T 282e2cb436704f8cb1325a0b0121e13b P 41cd568e408e40ddb2e85f8c2bee22a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 } } peers { permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 } } peers { permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 } }
I20260709 13:02:43.964495 10244 raft_consensus.cc:3060] T 282e2cb436704f8cb1325a0b0121e13b P 41cd568e408e40ddb2e85f8c2bee22a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:43.969900 10321 raft_consensus.cc:2468] T 282e2cb436704f8cb1325a0b0121e13b P 882704f8b6a04a66ba918aac12d22da8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 191dd64f4cf64ba08da29e42907a2dd3 in term 2.
I20260709 13:02:43.971065 10359 leader_election.cc:304] T 282e2cb436704f8cb1325a0b0121e13b P 191dd64f4cf64ba08da29e42907a2dd3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 191dd64f4cf64ba08da29e42907a2dd3, 882704f8b6a04a66ba918aac12d22da8; no voters: 
I20260709 13:02:43.971884 10244 raft_consensus.cc:2468] T 282e2cb436704f8cb1325a0b0121e13b P 41cd568e408e40ddb2e85f8c2bee22a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 191dd64f4cf64ba08da29e42907a2dd3 in term 2.
I20260709 13:02:43.971939 10444 raft_consensus.cc:2804] T 282e2cb436704f8cb1325a0b0121e13b P 191dd64f4cf64ba08da29e42907a2dd3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:43.972700 10444 raft_consensus.cc:697] T 282e2cb436704f8cb1325a0b0121e13b P 191dd64f4cf64ba08da29e42907a2dd3 [term 2 LEADER]: Becoming Leader. State: Replica: 191dd64f4cf64ba08da29e42907a2dd3, State: Running, Role: LEADER
I20260709 13:02:43.973543 10444 consensus_queue.cc:237] T 282e2cb436704f8cb1325a0b0121e13b P 191dd64f4cf64ba08da29e42907a2dd3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 } } peers { permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 } } peers { permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 } }
I20260709 13:02:43.979777 10144 catalog_manager.cc:5697] T 282e2cb436704f8cb1325a0b0121e13b P 191dd64f4cf64ba08da29e42907a2dd3 reported cstate change: term changed from 1 to 2, leader changed from 41cd568e408e40ddb2e85f8c2bee22a3 (127.0.107.193) to 191dd64f4cf64ba08da29e42907a2dd3 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "191dd64f4cf64ba08da29e42907a2dd3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:44.095829 10444 consensus_queue.cc:1048] T 5bc6c0ad5d5245e4891db44a1f86d948 P 191dd64f4cf64ba08da29e42907a2dd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:44.102994 10471 raft_consensus.cc:993] T 5bc6c0ad5d5245e4891db44a1f86d948 P 191dd64f4cf64ba08da29e42907a2dd3: : Instructing follower 41cd568e408e40ddb2e85f8c2bee22a3 to start an election
I20260709 13:02:44.103505 10451 raft_consensus.cc:1081] T 5bc6c0ad5d5245e4891db44a1f86d948 P 191dd64f4cf64ba08da29e42907a2dd3 [term 1 LEADER]: Signalling peer 41cd568e408e40ddb2e85f8c2bee22a3 to start an election
I20260709 13:02:44.105317 10246 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5bc6c0ad5d5245e4891db44a1f86d948"
dest_uuid: "41cd568e408e40ddb2e85f8c2bee22a3"
 from {username='slave'} at 127.0.0.1:46600
I20260709 13:02:44.107131 10246 raft_consensus.cc:493] T 5bc6c0ad5d5245e4891db44a1f86d948 P 41cd568e408e40ddb2e85f8c2bee22a3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:44.107530 10246 raft_consensus.cc:3060] T 5bc6c0ad5d5245e4891db44a1f86d948 P 41cd568e408e40ddb2e85f8c2bee22a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:44.109135 10451 consensus_queue.cc:1048] T 5bc6c0ad5d5245e4891db44a1f86d948 P 191dd64f4cf64ba08da29e42907a2dd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:44.115525 10246 raft_consensus.cc:515] T 5bc6c0ad5d5245e4891db44a1f86d948 P 41cd568e408e40ddb2e85f8c2bee22a3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 } } peers { permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 } } peers { permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 } }
I20260709 13:02:44.120334 10246 leader_election.cc:290] T 5bc6c0ad5d5245e4891db44a1f86d948 P 41cd568e408e40ddb2e85f8c2bee22a3 [CANDIDATE]: Term 2 election: Requested vote from peers 882704f8b6a04a66ba918aac12d22da8 (127.0.107.194:46641), 191dd64f4cf64ba08da29e42907a2dd3 (127.0.107.195:43473)
I20260709 13:02:44.121840 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc6c0ad5d5245e4891db44a1f86d948" candidate_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "191dd64f4cf64ba08da29e42907a2dd3"
I20260709 13:02:44.122500 10395 raft_consensus.cc:3055] T 5bc6c0ad5d5245e4891db44a1f86d948 P 191dd64f4cf64ba08da29e42907a2dd3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:44.122839 10395 raft_consensus.cc:740] T 5bc6c0ad5d5245e4891db44a1f86d948 P 191dd64f4cf64ba08da29e42907a2dd3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 191dd64f4cf64ba08da29e42907a2dd3, State: Running, Role: LEADER
I20260709 13:02:44.123193 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5bc6c0ad5d5245e4891db44a1f86d948" candidate_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "882704f8b6a04a66ba918aac12d22da8"
I20260709 13:02:44.123773 10321 raft_consensus.cc:3060] T 5bc6c0ad5d5245e4891db44a1f86d948 P 882704f8b6a04a66ba918aac12d22da8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:44.123636 10395 consensus_queue.cc:260] T 5bc6c0ad5d5245e4891db44a1f86d948 P 191dd64f4cf64ba08da29e42907a2dd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 } } peers { permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 } } peers { permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 } }
I20260709 13:02:44.124899 10395 raft_consensus.cc:3060] T 5bc6c0ad5d5245e4891db44a1f86d948 P 191dd64f4cf64ba08da29e42907a2dd3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:44.130374 10395 raft_consensus.cc:2468] T 5bc6c0ad5d5245e4891db44a1f86d948 P 191dd64f4cf64ba08da29e42907a2dd3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41cd568e408e40ddb2e85f8c2bee22a3 in term 2.
I20260709 13:02:44.130599 10321 raft_consensus.cc:2468] T 5bc6c0ad5d5245e4891db44a1f86d948 P 882704f8b6a04a66ba918aac12d22da8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41cd568e408e40ddb2e85f8c2bee22a3 in term 2.
I20260709 13:02:44.131377 10212 leader_election.cc:304] T 5bc6c0ad5d5245e4891db44a1f86d948 P 41cd568e408e40ddb2e85f8c2bee22a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 191dd64f4cf64ba08da29e42907a2dd3, 41cd568e408e40ddb2e85f8c2bee22a3; no voters: 
I20260709 13:02:44.132230 10480 raft_consensus.cc:2804] T 5bc6c0ad5d5245e4891db44a1f86d948 P 41cd568e408e40ddb2e85f8c2bee22a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:44.132654 10480 raft_consensus.cc:697] T 5bc6c0ad5d5245e4891db44a1f86d948 P 41cd568e408e40ddb2e85f8c2bee22a3 [term 2 LEADER]: Becoming Leader. State: Replica: 41cd568e408e40ddb2e85f8c2bee22a3, State: Running, Role: LEADER
I20260709 13:02:44.133481 10480 consensus_queue.cc:237] T 5bc6c0ad5d5245e4891db44a1f86d948 P 41cd568e408e40ddb2e85f8c2bee22a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 } } peers { permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 } } peers { permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 } }
I20260709 13:02:44.139277 10143 catalog_manager.cc:5697] T 5bc6c0ad5d5245e4891db44a1f86d948 P 41cd568e408e40ddb2e85f8c2bee22a3 reported cstate change: term changed from 1 to 2, leader changed from 191dd64f4cf64ba08da29e42907a2dd3 (127.0.107.195) to 41cd568e408e40ddb2e85f8c2bee22a3 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:44.176030 10440 consensus_queue.cc:1048] T 6c1e83b3ac8c4d939c14b196c3c885ea P 882704f8b6a04a66ba918aac12d22da8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:44.188226 10246 raft_consensus.cc:3060] T 6c1e83b3ac8c4d939c14b196c3c885ea P 41cd568e408e40ddb2e85f8c2bee22a3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:44.196894 10485 consensus_queue.cc:1048] T 6c1e83b3ac8c4d939c14b196c3c885ea P 882704f8b6a04a66ba918aac12d22da8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:44.203595 10440 raft_consensus.cc:993] T 6c1e83b3ac8c4d939c14b196c3c885ea P 882704f8b6a04a66ba918aac12d22da8: : Instructing follower 41cd568e408e40ddb2e85f8c2bee22a3 to start an election
I20260709 13:02:44.204108 10485 raft_consensus.cc:1081] T 6c1e83b3ac8c4d939c14b196c3c885ea P 882704f8b6a04a66ba918aac12d22da8 [term 1 LEADER]: Signalling peer 41cd568e408e40ddb2e85f8c2bee22a3 to start an election
I20260709 13:02:44.205729 10246 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6c1e83b3ac8c4d939c14b196c3c885ea"
dest_uuid: "41cd568e408e40ddb2e85f8c2bee22a3"
 from {username='slave'} at 127.0.0.1:46612
I20260709 13:02:44.206362 10246 raft_consensus.cc:493] T 6c1e83b3ac8c4d939c14b196c3c885ea P 41cd568e408e40ddb2e85f8c2bee22a3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:44.206727 10246 raft_consensus.cc:3060] T 6c1e83b3ac8c4d939c14b196c3c885ea P 41cd568e408e40ddb2e85f8c2bee22a3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:44.212199 10246 raft_consensus.cc:515] T 6c1e83b3ac8c4d939c14b196c3c885ea P 41cd568e408e40ddb2e85f8c2bee22a3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 } } peers { permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 } } peers { permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 } }
I20260709 13:02:44.214231 10246 leader_election.cc:290] T 6c1e83b3ac8c4d939c14b196c3c885ea P 41cd568e408e40ddb2e85f8c2bee22a3 [CANDIDATE]: Term 2 election: Requested vote from peers 882704f8b6a04a66ba918aac12d22da8 (127.0.107.194:46641), 191dd64f4cf64ba08da29e42907a2dd3 (127.0.107.195:43473)
I20260709 13:02:44.215137 10321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c1e83b3ac8c4d939c14b196c3c885ea" candidate_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "882704f8b6a04a66ba918aac12d22da8"
I20260709 13:02:44.215446 10395 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c1e83b3ac8c4d939c14b196c3c885ea" candidate_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "191dd64f4cf64ba08da29e42907a2dd3"
I20260709 13:02:44.215893 10321 raft_consensus.cc:3055] T 6c1e83b3ac8c4d939c14b196c3c885ea P 882704f8b6a04a66ba918aac12d22da8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:44.216041 10395 raft_consensus.cc:3060] T 6c1e83b3ac8c4d939c14b196c3c885ea P 191dd64f4cf64ba08da29e42907a2dd3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:44.216305 10321 raft_consensus.cc:740] T 6c1e83b3ac8c4d939c14b196c3c885ea P 882704f8b6a04a66ba918aac12d22da8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 882704f8b6a04a66ba918aac12d22da8, State: Running, Role: LEADER
I20260709 13:02:44.217324 10321 consensus_queue.cc:260] T 6c1e83b3ac8c4d939c14b196c3c885ea P 882704f8b6a04a66ba918aac12d22da8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 } } peers { permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 } } peers { permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 } }
I20260709 13:02:44.218777 10321 raft_consensus.cc:3060] T 6c1e83b3ac8c4d939c14b196c3c885ea P 882704f8b6a04a66ba918aac12d22da8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:44.224117 10395 raft_consensus.cc:2468] T 6c1e83b3ac8c4d939c14b196c3c885ea P 191dd64f4cf64ba08da29e42907a2dd3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41cd568e408e40ddb2e85f8c2bee22a3 in term 2.
I20260709 13:02:44.225564 10212 leader_election.cc:304] T 6c1e83b3ac8c4d939c14b196c3c885ea P 41cd568e408e40ddb2e85f8c2bee22a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 191dd64f4cf64ba08da29e42907a2dd3, 41cd568e408e40ddb2e85f8c2bee22a3; no voters: 
I20260709 13:02:44.226526 10480 raft_consensus.cc:2804] T 6c1e83b3ac8c4d939c14b196c3c885ea P 41cd568e408e40ddb2e85f8c2bee22a3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:44.226665 10321 raft_consensus.cc:2468] T 6c1e83b3ac8c4d939c14b196c3c885ea P 882704f8b6a04a66ba918aac12d22da8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 41cd568e408e40ddb2e85f8c2bee22a3 in term 2.
I20260709 13:02:44.226982 10480 raft_consensus.cc:697] T 6c1e83b3ac8c4d939c14b196c3c885ea P 41cd568e408e40ddb2e85f8c2bee22a3 [term 2 LEADER]: Becoming Leader. State: Replica: 41cd568e408e40ddb2e85f8c2bee22a3, State: Running, Role: LEADER
I20260709 13:02:44.227931 10480 consensus_queue.cc:237] T 6c1e83b3ac8c4d939c14b196c3c885ea P 41cd568e408e40ddb2e85f8c2bee22a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 } } peers { permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 } } peers { permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 } }
I20260709 13:02:44.233713 10143 catalog_manager.cc:5697] T 6c1e83b3ac8c4d939c14b196c3c885ea P 41cd568e408e40ddb2e85f8c2bee22a3 reported cstate change: term changed from 1 to 2, leader changed from 882704f8b6a04a66ba918aac12d22da8 (127.0.107.194) to 41cd568e408e40ddb2e85f8c2bee22a3 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:44.366091 10321 raft_consensus.cc:1275] T 282e2cb436704f8cb1325a0b0121e13b P 882704f8b6a04a66ba918aac12d22da8 [term 2 FOLLOWER]: Refusing update from remote peer 191dd64f4cf64ba08da29e42907a2dd3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:44.367328 10471 consensus_queue.cc:1048] T 282e2cb436704f8cb1325a0b0121e13b P 191dd64f4cf64ba08da29e42907a2dd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:44.375641 10246 raft_consensus.cc:1275] T 282e2cb436704f8cb1325a0b0121e13b P 41cd568e408e40ddb2e85f8c2bee22a3 [term 2 FOLLOWER]: Refusing update from remote peer 191dd64f4cf64ba08da29e42907a2dd3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:44.377450 10451 consensus_queue.cc:1048] T 282e2cb436704f8cb1325a0b0121e13b P 191dd64f4cf64ba08da29e42907a2dd3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:44.400760 10395 raft_consensus.cc:1275] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 191dd64f4cf64ba08da29e42907a2dd3 [term 2 FOLLOWER]: Refusing update from remote peer 41cd568e408e40ddb2e85f8c2bee22a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:44.401940 10480 consensus_queue.cc:1048] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 41cd568e408e40ddb2e85f8c2bee22a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:44.409322 10321 raft_consensus.cc:3060] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 882704f8b6a04a66ba918aac12d22da8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:44.417191 10321 raft_consensus.cc:1275] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 882704f8b6a04a66ba918aac12d22da8 [term 2 FOLLOWER]: Refusing update from remote peer 41cd568e408e40ddb2e85f8c2bee22a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:44.418483 10480 consensus_queue.cc:1048] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 41cd568e408e40ddb2e85f8c2bee22a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:44.474997   431 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:02:44.476583   431 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:02:44.476972   431 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:02:44.488708 10246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6c1e83b3ac8c4d939c14b196c3c885ea"
dest_uuid: "41cd568e408e40ddb2e85f8c2bee22a3"
mode: GRACEFUL
new_leader_uuid: "882704f8b6a04a66ba918aac12d22da8"
 from {username='slave'} at 127.0.0.1:46630
I20260709 13:02:44.489216 10246 raft_consensus.cc:606] T 6c1e83b3ac8c4d939c14b196c3c885ea P 41cd568e408e40ddb2e85f8c2bee22a3 [term 2 LEADER]: Received request to transfer leadership to TS 882704f8b6a04a66ba918aac12d22da8
I20260709 13:02:44.490275   431 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:02:44.655727 10321 raft_consensus.cc:1275] T 6c1e83b3ac8c4d939c14b196c3c885ea P 882704f8b6a04a66ba918aac12d22da8 [term 2 FOLLOWER]: Refusing update from remote peer 41cd568e408e40ddb2e85f8c2bee22a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:44.657181 10480 consensus_queue.cc:1048] T 6c1e83b3ac8c4d939c14b196c3c885ea P 41cd568e408e40ddb2e85f8c2bee22a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:44.662560 10477 raft_consensus.cc:993] T 6c1e83b3ac8c4d939c14b196c3c885ea P 41cd568e408e40ddb2e85f8c2bee22a3: : Instructing follower 882704f8b6a04a66ba918aac12d22da8 to start an election
I20260709 13:02:44.663102 10479 raft_consensus.cc:1081] T 6c1e83b3ac8c4d939c14b196c3c885ea P 41cd568e408e40ddb2e85f8c2bee22a3 [term 2 LEADER]: Signalling peer 882704f8b6a04a66ba918aac12d22da8 to start an election
I20260709 13:02:44.665160 10320 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6c1e83b3ac8c4d939c14b196c3c885ea"
dest_uuid: "882704f8b6a04a66ba918aac12d22da8"
 from {username='slave'} at 127.0.0.1:53866
I20260709 13:02:44.665778 10320 raft_consensus.cc:493] T 6c1e83b3ac8c4d939c14b196c3c885ea P 882704f8b6a04a66ba918aac12d22da8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:44.666188 10320 raft_consensus.cc:3060] T 6c1e83b3ac8c4d939c14b196c3c885ea P 882704f8b6a04a66ba918aac12d22da8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:44.667412 10395 raft_consensus.cc:1275] T 6c1e83b3ac8c4d939c14b196c3c885ea P 191dd64f4cf64ba08da29e42907a2dd3 [term 2 FOLLOWER]: Refusing update from remote peer 41cd568e408e40ddb2e85f8c2bee22a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:44.669204 10480 consensus_queue.cc:1048] T 6c1e83b3ac8c4d939c14b196c3c885ea P 41cd568e408e40ddb2e85f8c2bee22a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:44.675577 10320 raft_consensus.cc:515] T 6c1e83b3ac8c4d939c14b196c3c885ea P 882704f8b6a04a66ba918aac12d22da8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 } } peers { permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 } } peers { permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 } }
I20260709 13:02:44.678609 10246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c1e83b3ac8c4d939c14b196c3c885ea" candidate_uuid: "882704f8b6a04a66ba918aac12d22da8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "41cd568e408e40ddb2e85f8c2bee22a3"
I20260709 13:02:44.679344 10246 raft_consensus.cc:3055] T 6c1e83b3ac8c4d939c14b196c3c885ea P 41cd568e408e40ddb2e85f8c2bee22a3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:44.679644 10246 raft_consensus.cc:740] T 6c1e83b3ac8c4d939c14b196c3c885ea P 41cd568e408e40ddb2e85f8c2bee22a3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 41cd568e408e40ddb2e85f8c2bee22a3, State: Running, Role: LEADER
I20260709 13:02:44.680490 10246 consensus_queue.cc:260] T 6c1e83b3ac8c4d939c14b196c3c885ea P 41cd568e408e40ddb2e85f8c2bee22a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 } } peers { permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 } } peers { permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 } }
I20260709 13:02:44.681666 10246 raft_consensus.cc:3060] T 6c1e83b3ac8c4d939c14b196c3c885ea P 41cd568e408e40ddb2e85f8c2bee22a3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:44.688581 10320 leader_election.cc:290] T 6c1e83b3ac8c4d939c14b196c3c885ea P 882704f8b6a04a66ba918aac12d22da8 [CANDIDATE]: Term 3 election: Requested vote from peers 41cd568e408e40ddb2e85f8c2bee22a3 (127.0.107.193:35527), 191dd64f4cf64ba08da29e42907a2dd3 (127.0.107.195:43473)
I20260709 13:02:44.689487 10321 raft_consensus.cc:1275] T 5bc6c0ad5d5245e4891db44a1f86d948 P 882704f8b6a04a66ba918aac12d22da8 [term 2 FOLLOWER]: Refusing update from remote peer 41cd568e408e40ddb2e85f8c2bee22a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:44.691555 10480 consensus_queue.cc:1048] T 5bc6c0ad5d5245e4891db44a1f86d948 P 41cd568e408e40ddb2e85f8c2bee22a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:44.691473 10246 raft_consensus.cc:2468] T 6c1e83b3ac8c4d939c14b196c3c885ea P 41cd568e408e40ddb2e85f8c2bee22a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 882704f8b6a04a66ba918aac12d22da8 in term 3.
I20260709 13:02:44.693493 10395 raft_consensus.cc:1275] T 5bc6c0ad5d5245e4891db44a1f86d948 P 191dd64f4cf64ba08da29e42907a2dd3 [term 2 FOLLOWER]: Refusing update from remote peer 41cd568e408e40ddb2e85f8c2bee22a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:44.694092 10394 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6c1e83b3ac8c4d939c14b196c3c885ea" candidate_uuid: "882704f8b6a04a66ba918aac12d22da8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "191dd64f4cf64ba08da29e42907a2dd3"
I20260709 13:02:44.694809 10394 raft_consensus.cc:3060] T 6c1e83b3ac8c4d939c14b196c3c885ea P 191dd64f4cf64ba08da29e42907a2dd3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:44.695375 10480 consensus_queue.cc:1048] T 5bc6c0ad5d5245e4891db44a1f86d948 P 41cd568e408e40ddb2e85f8c2bee22a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:44.704586 10286 leader_election.cc:304] T 6c1e83b3ac8c4d939c14b196c3c885ea P 882704f8b6a04a66ba918aac12d22da8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 41cd568e408e40ddb2e85f8c2bee22a3, 882704f8b6a04a66ba918aac12d22da8; no voters: 
I20260709 13:02:44.706717 10485 raft_consensus.cc:2804] T 6c1e83b3ac8c4d939c14b196c3c885ea P 882704f8b6a04a66ba918aac12d22da8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:44.708186 10394 raft_consensus.cc:2468] T 6c1e83b3ac8c4d939c14b196c3c885ea P 191dd64f4cf64ba08da29e42907a2dd3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 882704f8b6a04a66ba918aac12d22da8 in term 3.
I20260709 13:02:44.717507 10485 raft_consensus.cc:697] T 6c1e83b3ac8c4d939c14b196c3c885ea P 882704f8b6a04a66ba918aac12d22da8 [term 3 LEADER]: Becoming Leader. State: Replica: 882704f8b6a04a66ba918aac12d22da8, State: Running, Role: LEADER
I20260709 13:02:44.718771 10485 consensus_queue.cc:237] T 6c1e83b3ac8c4d939c14b196c3c885ea P 882704f8b6a04a66ba918aac12d22da8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 } } peers { permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 } } peers { permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 } }
I20260709 13:02:44.726322 10143 catalog_manager.cc:5697] T 6c1e83b3ac8c4d939c14b196c3c885ea P 882704f8b6a04a66ba918aac12d22da8 reported cstate change: term changed from 2 to 3, leader changed from 41cd568e408e40ddb2e85f8c2bee22a3 (127.0.107.193) to 882704f8b6a04a66ba918aac12d22da8 (127.0.107.194). New cstate: current_term: 3 leader_uuid: "882704f8b6a04a66ba918aac12d22da8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "41cd568e408e40ddb2e85f8c2bee22a3" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 35527 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "882704f8b6a04a66ba918aac12d22da8" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 46641 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "191dd64f4cf64ba08da29e42907a2dd3" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 43473 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:44.849870   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
I20260709 13:02:44.870075   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:44.870683   431 tablet_replica.cc:333] T 6c1e83b3ac8c4d939c14b196c3c885ea P 41cd568e408e40ddb2e85f8c2bee22a3: stopping tablet replica
I20260709 13:02:44.871235   431 raft_consensus.cc:2243] T 6c1e83b3ac8c4d939c14b196c3c885ea P 41cd568e408e40ddb2e85f8c2bee22a3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.871692   431 raft_consensus.cc:2272] T 6c1e83b3ac8c4d939c14b196c3c885ea P 41cd568e408e40ddb2e85f8c2bee22a3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.874334   431 tablet_replica.cc:333] T 5bc6c0ad5d5245e4891db44a1f86d948 P 41cd568e408e40ddb2e85f8c2bee22a3: stopping tablet replica
I20260709 13:02:44.874959   431 raft_consensus.cc:2243] T 5bc6c0ad5d5245e4891db44a1f86d948 P 41cd568e408e40ddb2e85f8c2bee22a3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:44.875699   431 raft_consensus.cc:2272] T 5bc6c0ad5d5245e4891db44a1f86d948 P 41cd568e408e40ddb2e85f8c2bee22a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.878108   431 tablet_replica.cc:333] T 282e2cb436704f8cb1325a0b0121e13b P 41cd568e408e40ddb2e85f8c2bee22a3: stopping tablet replica
I20260709 13:02:44.878594   431 raft_consensus.cc:2243] T 282e2cb436704f8cb1325a0b0121e13b P 41cd568e408e40ddb2e85f8c2bee22a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.879004   431 raft_consensus.cc:2272] T 282e2cb436704f8cb1325a0b0121e13b P 41cd568e408e40ddb2e85f8c2bee22a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.881119   431 tablet_replica.cc:333] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 41cd568e408e40ddb2e85f8c2bee22a3: stopping tablet replica
I20260709 13:02:44.881578   431 raft_consensus.cc:2243] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 41cd568e408e40ddb2e85f8c2bee22a3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:44.882357   431 raft_consensus.cc:2272] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 41cd568e408e40ddb2e85f8c2bee22a3 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:44.901165 10360 consensus_peers.cc:597] T 282e2cb436704f8cb1325a0b0121e13b P 191dd64f4cf64ba08da29e42907a2dd3 -> Peer 41cd568e408e40ddb2e85f8c2bee22a3 (127.0.107.193:35527): Couldn't send request to peer 41cd568e408e40ddb2e85f8c2bee22a3. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:35527: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:44.905220   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
I20260709 13:02:44.917131   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
I20260709 13:02:44.937738   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:44.938369   431 tablet_replica.cc:333] T 6c1e83b3ac8c4d939c14b196c3c885ea P 882704f8b6a04a66ba918aac12d22da8: stopping tablet replica
I20260709 13:02:44.938922   431 raft_consensus.cc:2243] T 6c1e83b3ac8c4d939c14b196c3c885ea P 882704f8b6a04a66ba918aac12d22da8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:02:44.939576   431 pending_rounds.cc:70] T 6c1e83b3ac8c4d939c14b196c3c885ea P 882704f8b6a04a66ba918aac12d22da8: Trying to abort 1 pending ops.
I20260709 13:02:44.939781   431 pending_rounds.cc:77] T 6c1e83b3ac8c4d939c14b196c3c885ea P 882704f8b6a04a66ba918aac12d22da8: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305634466698887168 op_type: NO_OP noop_request { }
I20260709 13:02:44.940079   431 raft_consensus.cc:2889] T 6c1e83b3ac8c4d939c14b196c3c885ea P 882704f8b6a04a66ba918aac12d22da8 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:02:44.940354   431 raft_consensus.cc:2272] T 6c1e83b3ac8c4d939c14b196c3c885ea P 882704f8b6a04a66ba918aac12d22da8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.942701   431 tablet_replica.cc:333] T 5bc6c0ad5d5245e4891db44a1f86d948 P 882704f8b6a04a66ba918aac12d22da8: stopping tablet replica
I20260709 13:02:44.943271   431 raft_consensus.cc:2243] T 5bc6c0ad5d5245e4891db44a1f86d948 P 882704f8b6a04a66ba918aac12d22da8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.943747   431 raft_consensus.cc:2272] T 5bc6c0ad5d5245e4891db44a1f86d948 P 882704f8b6a04a66ba918aac12d22da8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.946369   431 tablet_replica.cc:333] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 882704f8b6a04a66ba918aac12d22da8: stopping tablet replica
I20260709 13:02:44.946957   431 raft_consensus.cc:2243] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 882704f8b6a04a66ba918aac12d22da8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.947477   431 raft_consensus.cc:2272] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 882704f8b6a04a66ba918aac12d22da8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:44.948293 10359 consensus_peers.cc:597] T 282e2cb436704f8cb1325a0b0121e13b P 191dd64f4cf64ba08da29e42907a2dd3 -> Peer 882704f8b6a04a66ba918aac12d22da8 (127.0.107.194:46641): Couldn't send request to peer 882704f8b6a04a66ba918aac12d22da8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:44.949767   431 tablet_replica.cc:333] T 282e2cb436704f8cb1325a0b0121e13b P 882704f8b6a04a66ba918aac12d22da8: stopping tablet replica
I20260709 13:02:44.950328   431 raft_consensus.cc:2243] T 282e2cb436704f8cb1325a0b0121e13b P 882704f8b6a04a66ba918aac12d22da8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:44.950686   431 raft_consensus.cc:2272] T 282e2cb436704f8cb1325a0b0121e13b P 882704f8b6a04a66ba918aac12d22da8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:44.974172   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
I20260709 13:02:44.986279   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 13:02:45.003548   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:45.004127   431 tablet_replica.cc:333] T 6c1e83b3ac8c4d939c14b196c3c885ea P 191dd64f4cf64ba08da29e42907a2dd3: stopping tablet replica
I20260709 13:02:45.004700   431 raft_consensus.cc:2243] T 6c1e83b3ac8c4d939c14b196c3c885ea P 191dd64f4cf64ba08da29e42907a2dd3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.005120   431 raft_consensus.cc:2272] T 6c1e83b3ac8c4d939c14b196c3c885ea P 191dd64f4cf64ba08da29e42907a2dd3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.007261   431 tablet_replica.cc:333] T 5bc6c0ad5d5245e4891db44a1f86d948 P 191dd64f4cf64ba08da29e42907a2dd3: stopping tablet replica
I20260709 13:02:45.007755   431 raft_consensus.cc:2243] T 5bc6c0ad5d5245e4891db44a1f86d948 P 191dd64f4cf64ba08da29e42907a2dd3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.008148   431 raft_consensus.cc:2272] T 5bc6c0ad5d5245e4891db44a1f86d948 P 191dd64f4cf64ba08da29e42907a2dd3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.010852   431 tablet_replica.cc:333] T 282e2cb436704f8cb1325a0b0121e13b P 191dd64f4cf64ba08da29e42907a2dd3: stopping tablet replica
I20260709 13:02:45.011312   431 raft_consensus.cc:2243] T 282e2cb436704f8cb1325a0b0121e13b P 191dd64f4cf64ba08da29e42907a2dd3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:45.012084   431 raft_consensus.cc:2272] T 282e2cb436704f8cb1325a0b0121e13b P 191dd64f4cf64ba08da29e42907a2dd3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.014320   431 tablet_replica.cc:333] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 191dd64f4cf64ba08da29e42907a2dd3: stopping tablet replica
I20260709 13:02:45.014760   431 raft_consensus.cc:2243] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 191dd64f4cf64ba08da29e42907a2dd3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:45.015147   431 raft_consensus.cc:2272] T 5e45f3ce4d134b7d9c5df68e7f6f79e0 P 191dd64f4cf64ba08da29e42907a2dd3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.028184   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:02:45.040015   431 master.cc:562] Master@127.0.107.254:40033 shutting down...
I20260709 13:02:45.056645   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 41107e8764a34de4a010b91836d1c8d7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:02:45.057166   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 41107e8764a34de4a010b91836d1c8d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:45.057487   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 41107e8764a34de4a010b91836d1c8d7: stopping tablet replica
I20260709 13:02:45.076048   431 master.cc:584] Master@127.0.107.254:40033 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2570 ms)
[----------] 6 tests from LeaderRebalancerTest (295698 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:02:45.103129   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:46301
I20260709 13:02:45.104216   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:45.109107 10497 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:45.110242 10498 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:45.111505 10500 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:45.111905   431 server_base.cc:1061] running on GCE node
I20260709 13:02:45.112754   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:45.112927   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:45.113044   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602165113033 us; error 0 us; skew 500 ppm
I20260709 13:02:45.113507   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:45.115651   431 webserver.cc:533] Webserver started at http://127.0.107.254:44977/ using document root <none> and password file <none>
I20260709 13:02:45.116074   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:45.116233   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:45.116464   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:45.117499   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601869227091-431-0/minicluster-data/master-0-root/instance:
uuid: "4631e7102cf64abaacdf677f51e88449"
format_stamp: "Formatted at 2026-07-09 13:02:45 on dist-test-slave-5mzn"
I20260709 13:02:45.121927   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:02:45.125263 10505 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:45.126089   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:02:45.126391   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601869227091-431-0/minicluster-data/master-0-root
uuid: "4631e7102cf64abaacdf677f51e88449"
format_stamp: "Formatted at 2026-07-09 13:02:45 on dist-test-slave-5mzn"
I20260709 13:02:45.126643   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601869227091-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601869227091-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601869227091-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:45.141170   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:45.142217   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:45.179914   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:46301
I20260709 13:02:45.180004 10556 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:46301 every 8 connection(s)
I20260709 13:02:45.183943 10557 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.195014 10557 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4631e7102cf64abaacdf677f51e88449: Bootstrap starting.
I20260709 13:02:45.199425 10557 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4631e7102cf64abaacdf677f51e88449: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.203632 10557 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4631e7102cf64abaacdf677f51e88449: No bootstrap required, opened a new log
I20260709 13:02:45.205920 10557 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4631e7102cf64abaacdf677f51e88449 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4631e7102cf64abaacdf677f51e88449" member_type: VOTER }
I20260709 13:02:45.206326 10557 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4631e7102cf64abaacdf677f51e88449 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.206532 10557 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4631e7102cf64abaacdf677f51e88449 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4631e7102cf64abaacdf677f51e88449, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.207073 10557 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4631e7102cf64abaacdf677f51e88449 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4631e7102cf64abaacdf677f51e88449" member_type: VOTER }
I20260709 13:02:45.207516 10557 raft_consensus.cc:399] T 00000000000000000000000000000000 P 4631e7102cf64abaacdf677f51e88449 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:02:45.207736 10557 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4631e7102cf64abaacdf677f51e88449 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:02:45.207990 10557 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4631e7102cf64abaacdf677f51e88449 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:45.213277 10557 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4631e7102cf64abaacdf677f51e88449 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4631e7102cf64abaacdf677f51e88449" member_type: VOTER }
I20260709 13:02:45.213784 10557 leader_election.cc:304] T 00000000000000000000000000000000 P 4631e7102cf64abaacdf677f51e88449 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4631e7102cf64abaacdf677f51e88449; no voters: 
I20260709 13:02:45.214946 10557 leader_election.cc:290] T 00000000000000000000000000000000 P 4631e7102cf64abaacdf677f51e88449 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:02:45.215258 10560 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4631e7102cf64abaacdf677f51e88449 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:45.216658 10560 raft_consensus.cc:697] T 00000000000000000000000000000000 P 4631e7102cf64abaacdf677f51e88449 [term 1 LEADER]: Becoming Leader. State: Replica: 4631e7102cf64abaacdf677f51e88449, State: Running, Role: LEADER
I20260709 13:02:45.217357 10560 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4631e7102cf64abaacdf677f51e88449 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4631e7102cf64abaacdf677f51e88449" member_type: VOTER }
I20260709 13:02:45.217974 10557 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4631e7102cf64abaacdf677f51e88449 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:02:45.222590 10562 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4631e7102cf64abaacdf677f51e88449 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4631e7102cf64abaacdf677f51e88449. Latest consensus state: current_term: 1 leader_uuid: "4631e7102cf64abaacdf677f51e88449" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4631e7102cf64abaacdf677f51e88449" member_type: VOTER } }
I20260709 13:02:45.223460 10562 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4631e7102cf64abaacdf677f51e88449 [sys.catalog]: This master's current role is: LEADER
I20260709 13:02:45.223632 10561 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4631e7102cf64abaacdf677f51e88449 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4631e7102cf64abaacdf677f51e88449" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4631e7102cf64abaacdf677f51e88449" member_type: VOTER } }
I20260709 13:02:45.224205 10561 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4631e7102cf64abaacdf677f51e88449 [sys.catalog]: This master's current role is: LEADER
I20260709 13:02:45.225509 10567 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:02:45.230300 10567 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:02:45.234573   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:02:45.239017 10567 catalog_manager.cc:1383] Generated new cluster ID: d717b8be7fc94150adb0da236b9af3c7
I20260709 13:02:45.239293 10567 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:02:45.252166 10567 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:02:45.253504 10567 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:02:45.267275 10567 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 4631e7102cf64abaacdf677f51e88449: Generated new TSK 0
I20260709 13:02:45.267928 10567 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:02:45.301129   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:45.307324 10578 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:45.308585 10579 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:45.310593   431 server_base.cc:1061] running on GCE node
W20260709 13:02:45.310935 10581 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:45.311923   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:45.312129   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:45.312373   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602165312337 us; error 0 us; skew 500 ppm
I20260709 13:02:45.312990   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:45.315510   431 webserver.cc:533] Webserver started at http://127.0.107.193:38679/ using document root <none> and password file <none>
I20260709 13:02:45.316042   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:45.316253   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:45.316617   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:45.317833   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601869227091-431-0/minicluster-data/ts-0-root/instance:
uuid: "66abd7e8893940bdbe81d60bffc91261"
format_stamp: "Formatted at 2026-07-09 13:02:45 on dist-test-slave-5mzn"
I20260709 13:02:45.322650   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:02:45.326195 10586 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:45.327068   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.001s
I20260709 13:02:45.327425   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601869227091-431-0/minicluster-data/ts-0-root
uuid: "66abd7e8893940bdbe81d60bffc91261"
format_stamp: "Formatted at 2026-07-09 13:02:45 on dist-test-slave-5mzn"
I20260709 13:02:45.327762   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601869227091-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601869227091-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601869227091-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:45.348233   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:45.349576   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:45.351217   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:45.353838   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:45.354087   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:45.354372   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:45.354563   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:45.396618   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:44009
I20260709 13:02:45.396727 10648 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:44009 every 8 connection(s)
I20260709 13:02:45.402287   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:45.411278 10653 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:45.411278 10654 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:45.413132 10656 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:45.414067 10649 heartbeater.cc:344] Connected to a master server at 127.0.107.254:46301
I20260709 13:02:45.414250   431 server_base.cc:1061] running on GCE node
I20260709 13:02:45.414567 10649 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:45.415341 10649 heartbeater.cc:507] Master 127.0.107.254:46301 requested a full tablet report, sending...
I20260709 13:02:45.416131   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:45.416461   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:45.416731   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602165416710 us; error 0 us; skew 500 ppm
I20260709 13:02:45.417661   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:45.417665 10522 ts_manager.cc:194] Registered new tserver with Master: 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009)
I20260709 13:02:45.421155 10522 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46006
I20260709 13:02:45.421484   431 webserver.cc:533] Webserver started at http://127.0.107.194:37025/ using document root <none> and password file <none>
I20260709 13:02:45.422250   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:45.422530   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:45.422853   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:45.424015   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601869227091-431-0/minicluster-data/ts-1-root/instance:
uuid: "d895d0e90a3b45ed9aed3af8222a9b5d"
format_stamp: "Formatted at 2026-07-09 13:02:45 on dist-test-slave-5mzn"
I20260709 13:02:45.429071   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:02:45.432497 10661 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:45.433378   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:02:45.433704   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601869227091-431-0/minicluster-data/ts-1-root
uuid: "d895d0e90a3b45ed9aed3af8222a9b5d"
format_stamp: "Formatted at 2026-07-09 13:02:45 on dist-test-slave-5mzn"
I20260709 13:02:45.433990   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601869227091-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601869227091-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601869227091-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:45.465745   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:45.466850   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:45.468298   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:45.470556   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:45.470773   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:45.471020   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:45.471189   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:45.510412   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:33683
I20260709 13:02:45.510519 10723 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:33683 every 8 connection(s)
I20260709 13:02:45.515336   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:02:45.522682 10727 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:45.525823 10728 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:02:45.527902 10730 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:02:45.529461   431 server_base.cc:1061] running on GCE node
I20260709 13:02:45.530701   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:02:45.531028   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:02:45.531082 10724 heartbeater.cc:344] Connected to a master server at 127.0.107.254:46301
I20260709 13:02:45.531220   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602165531208 us; error 0 us; skew 500 ppm
I20260709 13:02:45.531796 10724 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:45.532254   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:02:45.532887 10724 heartbeater.cc:507] Master 127.0.107.254:46301 requested a full tablet report, sending...
I20260709 13:02:45.535372 10522 ts_manager.cc:194] Registered new tserver with Master: d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683)
I20260709 13:02:45.535465   431 webserver.cc:533] Webserver started at http://127.0.107.195:39315/ using document root <none> and password file <none>
I20260709 13:02:45.536120   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:02:45.536312   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:02:45.536648   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:02:45.537060 10522 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46022
I20260709 13:02:45.537876   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601869227091-431-0/minicluster-data/ts-2-root/instance:
uuid: "305b05bc72f04d769644fbff5188bc26"
format_stamp: "Formatted at 2026-07-09 13:02:45 on dist-test-slave-5mzn"
I20260709 13:02:45.542515   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:02:45.545876 10735 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:45.546835   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:02:45.547163   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601869227091-431-0/minicluster-data/ts-2-root
uuid: "305b05bc72f04d769644fbff5188bc26"
format_stamp: "Formatted at 2026-07-09 13:02:45 on dist-test-slave-5mzn"
I20260709 13:02:45.547474   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601869227091-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601869227091-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783601869227091-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:02:45.569695   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:02:45.570804   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:02:45.572209   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:02:45.575891   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:02:45.576143   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:02:45.576438   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:02:45.576653   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:02:45.617724   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:32947
I20260709 13:02:45.617811 10797 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:32947 every 8 connection(s)
I20260709 13:02:45.631634 10798 heartbeater.cc:344] Connected to a master server at 127.0.107.254:46301
I20260709 13:02:45.632095 10798 heartbeater.cc:461] Registering TS with master...
I20260709 13:02:45.632891 10798 heartbeater.cc:507] Master 127.0.107.254:46301 requested a full tablet report, sending...
I20260709 13:02:45.634807 10522 ts_manager.cc:194] Registered new tserver with Master: 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947)
I20260709 13:02:45.635762   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014747154s
I20260709 13:02:45.636402 10522 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46034
I20260709 13:02:45.661772 10522 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46046:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:02:45.664463 10522 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:02:45.754042 10614 tablet_service.cc:1511] Processing CreateTablet for tablet bf181cd133ed4b8d8b3cbe5b36b23316 (DEFAULT_TABLE table=test-workload [id=f212ca0e2c814027a88a0761761627bd]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:02:45.754622 10613 tablet_service.cc:1511] Processing CreateTablet for tablet c7a40faf0455492eb35f727fc91e9fab (DEFAULT_TABLE table=test-workload [id=f212ca0e2c814027a88a0761761627bd]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:02:45.755555 10614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf181cd133ed4b8d8b3cbe5b36b23316. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.756270 10613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7a40faf0455492eb35f727fc91e9fab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.769224 10612 tablet_service.cc:1511] Processing CreateTablet for tablet b5719c2d308646c28e9b2297f7d3becd (DEFAULT_TABLE table=test-workload [id=f212ca0e2c814027a88a0761761627bd]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:02:45.770738 10612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5719c2d308646c28e9b2297f7d3becd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.772575 10763 tablet_service.cc:1511] Processing CreateTablet for tablet bf181cd133ed4b8d8b3cbe5b36b23316 (DEFAULT_TABLE table=test-workload [id=f212ca0e2c814027a88a0761761627bd]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:02:45.774230 10763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf181cd133ed4b8d8b3cbe5b36b23316. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.775435 10813 tablet_bootstrap.cc:492] T c7a40faf0455492eb35f727fc91e9fab P 66abd7e8893940bdbe81d60bffc91261: Bootstrap starting.
I20260709 13:02:45.772603 10758 tablet_service.cc:1511] Processing CreateTablet for tablet 0edc1ee1d1aa48b38e4df79d771249ad (DEFAULT_TABLE table=test-workload [id=f212ca0e2c814027a88a0761761627bd]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:02:45.776063 10757 tablet_service.cc:1511] Processing CreateTablet for tablet ddaf52c482884428ab1694c903f54cd8 (DEFAULT_TABLE table=test-workload [id=f212ca0e2c814027a88a0761761627bd]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:02:45.777062 10758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0edc1ee1d1aa48b38e4df79d771249ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.777771 10757 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddaf52c482884428ab1694c903f54cd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.777648 10762 tablet_service.cc:1511] Processing CreateTablet for tablet c7a40faf0455492eb35f727fc91e9fab (DEFAULT_TABLE table=test-workload [id=f212ca0e2c814027a88a0761761627bd]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:02:45.779021 10762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7a40faf0455492eb35f727fc91e9fab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.779162 10759 tablet_service.cc:1511] Processing CreateTablet for tablet e23dd32048434889a42ea8dc88626ed3 (DEFAULT_TABLE table=test-workload [id=f212ca0e2c814027a88a0761761627bd]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:02:45.780455 10759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e23dd32048434889a42ea8dc88626ed3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.780395 10756 tablet_service.cc:1511] Processing CreateTablet for tablet bd8914371e234fd89180b58dd299e334 (DEFAULT_TABLE table=test-workload [id=f212ca0e2c814027a88a0761761627bd]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:02:45.780745 10755 tablet_service.cc:1511] Processing CreateTablet for tablet 8eb4dc0971ed4d6183bfb9d283ad51dc (DEFAULT_TABLE table=test-workload [id=f212ca0e2c814027a88a0761761627bd]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:02:45.781864 10756 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd8914371e234fd89180b58dd299e334. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.782464 10755 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eb4dc0971ed4d6183bfb9d283ad51dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.785643 10760 tablet_service.cc:1511] Processing CreateTablet for tablet 020e5de5fe4f481ba994779ae752696c (DEFAULT_TABLE table=test-workload [id=f212ca0e2c814027a88a0761761627bd]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:02:45.787019 10760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 020e5de5fe4f481ba994779ae752696c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.789655 10761 tablet_service.cc:1511] Processing CreateTablet for tablet b5719c2d308646c28e9b2297f7d3becd (DEFAULT_TABLE table=test-workload [id=f212ca0e2c814027a88a0761761627bd]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:02:45.791080 10761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5719c2d308646c28e9b2297f7d3becd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.803408 10814 tablet_bootstrap.cc:492] T c7a40faf0455492eb35f727fc91e9fab P 305b05bc72f04d769644fbff5188bc26: Bootstrap starting.
I20260709 13:02:45.806706 10813 tablet_bootstrap.cc:654] T c7a40faf0455492eb35f727fc91e9fab P 66abd7e8893940bdbe81d60bffc91261: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.811076 10814 tablet_bootstrap.cc:654] T c7a40faf0455492eb35f727fc91e9fab P 305b05bc72f04d769644fbff5188bc26: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.823413 10814 tablet_bootstrap.cc:492] T c7a40faf0455492eb35f727fc91e9fab P 305b05bc72f04d769644fbff5188bc26: No bootstrap required, opened a new log
I20260709 13:02:45.823935 10814 ts_tablet_manager.cc:1403] T c7a40faf0455492eb35f727fc91e9fab P 305b05bc72f04d769644fbff5188bc26: Time spent bootstrapping tablet: real 0.021s	user 0.006s	sys 0.010s
I20260709 13:02:45.826459 10813 tablet_bootstrap.cc:492] T c7a40faf0455492eb35f727fc91e9fab P 66abd7e8893940bdbe81d60bffc91261: No bootstrap required, opened a new log
I20260709 13:02:45.827028 10813 ts_tablet_manager.cc:1403] T c7a40faf0455492eb35f727fc91e9fab P 66abd7e8893940bdbe81d60bffc91261: Time spent bootstrapping tablet: real 0.052s	user 0.016s	sys 0.005s
I20260709 13:02:45.826929 10814 raft_consensus.cc:359] T c7a40faf0455492eb35f727fc91e9fab P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:45.827854 10814 raft_consensus.cc:385] T c7a40faf0455492eb35f727fc91e9fab P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.828154 10814 raft_consensus.cc:740] T c7a40faf0455492eb35f727fc91e9fab P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 305b05bc72f04d769644fbff5188bc26, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.829259 10814 consensus_queue.cc:260] T c7a40faf0455492eb35f727fc91e9fab P 305b05bc72f04d769644fbff5188bc26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:45.830408 10813 raft_consensus.cc:359] T c7a40faf0455492eb35f727fc91e9fab P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:45.831228 10813 raft_consensus.cc:385] T c7a40faf0455492eb35f727fc91e9fab P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.831524 10813 raft_consensus.cc:740] T c7a40faf0455492eb35f727fc91e9fab P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66abd7e8893940bdbe81d60bffc91261, State: Initialized, Role: FOLLOWER
I20260709 13:02:45.832258 10813 consensus_queue.cc:260] T c7a40faf0455492eb35f727fc91e9fab P 66abd7e8893940bdbe81d60bffc91261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:45.834281 10687 tablet_service.cc:1511] Processing CreateTablet for tablet b5719c2d308646c28e9b2297f7d3becd (DEFAULT_TABLE table=test-workload [id=f212ca0e2c814027a88a0761761627bd]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:02:45.835282 10614 tablet_service.cc:1511] Processing CreateTablet for tablet e23dd32048434889a42ea8dc88626ed3 (DEFAULT_TABLE table=test-workload [id=f212ca0e2c814027a88a0761761627bd]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:02:45.837123 10686 tablet_service.cc:1511] Processing CreateTablet for tablet 020e5de5fe4f481ba994779ae752696c (DEFAULT_TABLE table=test-workload [id=f212ca0e2c814027a88a0761761627bd]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:02:45.837603 10611 tablet_service.cc:1511] Processing CreateTablet for tablet 0edc1ee1d1aa48b38e4df79d771249ad (DEFAULT_TABLE table=test-workload [id=f212ca0e2c814027a88a0761761627bd]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:02:45.841607 10614 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e23dd32048434889a42ea8dc88626ed3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.844633 10611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0edc1ee1d1aa48b38e4df79d771249ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.835757 10687 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5719c2d308646c28e9b2297f7d3becd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.846652 10686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 020e5de5fe4f481ba994779ae752696c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.852658 10613 tablet_service.cc:1511] Processing CreateTablet for tablet 020e5de5fe4f481ba994779ae752696c (DEFAULT_TABLE table=test-workload [id=f212ca0e2c814027a88a0761761627bd]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:02:45.854820 10613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 020e5de5fe4f481ba994779ae752696c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.864490 10683 tablet_service.cc:1511] Processing CreateTablet for tablet ddaf52c482884428ab1694c903f54cd8 (DEFAULT_TABLE table=test-workload [id=f212ca0e2c814027a88a0761761627bd]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:02:45.866184 10683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddaf52c482884428ab1694c903f54cd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.865864 10608 tablet_service.cc:1511] Processing CreateTablet for tablet 8eb4dc0971ed4d6183bfb9d283ad51dc (DEFAULT_TABLE table=test-workload [id=f212ca0e2c814027a88a0761761627bd]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:02:45.867350 10608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eb4dc0971ed4d6183bfb9d283ad51dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.869105 10688 tablet_service.cc:1511] Processing CreateTablet for tablet c7a40faf0455492eb35f727fc91e9fab (DEFAULT_TABLE table=test-workload [id=f212ca0e2c814027a88a0761761627bd]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:02:45.869841 10681 tablet_service.cc:1511] Processing CreateTablet for tablet 8eb4dc0971ed4d6183bfb9d283ad51dc (DEFAULT_TABLE table=test-workload [id=f212ca0e2c814027a88a0761761627bd]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:02:45.870484 10688 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c7a40faf0455492eb35f727fc91e9fab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.871140 10681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8eb4dc0971ed4d6183bfb9d283ad51dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.873155 10609 tablet_service.cc:1511] Processing CreateTablet for tablet bd8914371e234fd89180b58dd299e334 (DEFAULT_TABLE table=test-workload [id=f212ca0e2c814027a88a0761761627bd]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:02:45.874533 10609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd8914371e234fd89180b58dd299e334. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.875268 10610 tablet_service.cc:1511] Processing CreateTablet for tablet ddaf52c482884428ab1694c903f54cd8 (DEFAULT_TABLE table=test-workload [id=f212ca0e2c814027a88a0761761627bd]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:02:45.877072 10689 tablet_service.cc:1511] Processing CreateTablet for tablet bf181cd133ed4b8d8b3cbe5b36b23316 (DEFAULT_TABLE table=test-workload [id=f212ca0e2c814027a88a0761761627bd]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:02:45.878396 10689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf181cd133ed4b8d8b3cbe5b36b23316. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.881091 10685 tablet_service.cc:1511] Processing CreateTablet for tablet e23dd32048434889a42ea8dc88626ed3 (DEFAULT_TABLE table=test-workload [id=f212ca0e2c814027a88a0761761627bd]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:02:45.881606 10684 tablet_service.cc:1511] Processing CreateTablet for tablet 0edc1ee1d1aa48b38e4df79d771249ad (DEFAULT_TABLE table=test-workload [id=f212ca0e2c814027a88a0761761627bd]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:02:45.882560 10685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e23dd32048434889a42ea8dc88626ed3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.881091 10682 tablet_service.cc:1511] Processing CreateTablet for tablet bd8914371e234fd89180b58dd299e334 (DEFAULT_TABLE table=test-workload [id=f212ca0e2c814027a88a0761761627bd]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:02:45.885951 10682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd8914371e234fd89180b58dd299e334. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.888147 10684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0edc1ee1d1aa48b38e4df79d771249ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.881111 10610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddaf52c482884428ab1694c903f54cd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:45.918895 10820 tablet_bootstrap.cc:492] T c7a40faf0455492eb35f727fc91e9fab P d895d0e90a3b45ed9aed3af8222a9b5d: Bootstrap starting.
I20260709 13:02:45.944828 10820 tablet_bootstrap.cc:654] T c7a40faf0455492eb35f727fc91e9fab P d895d0e90a3b45ed9aed3af8222a9b5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.948204 10817 raft_consensus.cc:493] T c7a40faf0455492eb35f727fc91e9fab P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:45.948297 10798 heartbeater.cc:499] Master 127.0.107.254:46301 was elected leader, sending a full tablet report...
I20260709 13:02:45.948923 10817 raft_consensus.cc:515] T c7a40faf0455492eb35f727fc91e9fab P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:45.951043 10814 ts_tablet_manager.cc:1434] T c7a40faf0455492eb35f727fc91e9fab P 305b05bc72f04d769644fbff5188bc26: Time spent starting tablet: real 0.127s	user 0.030s	sys 0.020s
I20260709 13:02:45.953462 10813 ts_tablet_manager.cc:1434] T c7a40faf0455492eb35f727fc91e9fab P 66abd7e8893940bdbe81d60bffc91261: Time spent starting tablet: real 0.126s	user 0.011s	sys 0.027s
I20260709 13:02:45.954608 10649 heartbeater.cc:499] Master 127.0.107.254:46301 was elected leader, sending a full tablet report...
I20260709 13:02:45.965063 10814 tablet_bootstrap.cc:492] T bd8914371e234fd89180b58dd299e334 P 305b05bc72f04d769644fbff5188bc26: Bootstrap starting.
I20260709 13:02:45.971485 10813 tablet_bootstrap.cc:492] T bf181cd133ed4b8d8b3cbe5b36b23316 P 66abd7e8893940bdbe81d60bffc91261: Bootstrap starting.
I20260709 13:02:45.979358 10817 leader_election.cc:290] T c7a40faf0455492eb35f727fc91e9fab P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009), d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683)
I20260709 13:02:45.980005 10813 tablet_bootstrap.cc:654] T bf181cd133ed4b8d8b3cbe5b36b23316 P 66abd7e8893940bdbe81d60bffc91261: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:45.981983 10820 tablet_bootstrap.cc:492] T c7a40faf0455492eb35f727fc91e9fab P d895d0e90a3b45ed9aed3af8222a9b5d: No bootstrap required, opened a new log
I20260709 13:02:45.994342 10820 ts_tablet_manager.cc:1403] T c7a40faf0455492eb35f727fc91e9fab P d895d0e90a3b45ed9aed3af8222a9b5d: Time spent bootstrapping tablet: real 0.076s	user 0.013s	sys 0.012s
I20260709 13:02:45.997710 10820 raft_consensus.cc:359] T c7a40faf0455492eb35f727fc91e9fab P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:45.998570 10820 raft_consensus.cc:385] T c7a40faf0455492eb35f727fc91e9fab P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:45.985311 10814 tablet_bootstrap.cc:654] T bd8914371e234fd89180b58dd299e334 P 305b05bc72f04d769644fbff5188bc26: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.001768 10820 raft_consensus.cc:740] T c7a40faf0455492eb35f727fc91e9fab P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d895d0e90a3b45ed9aed3af8222a9b5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.002878 10820 consensus_queue.cc:260] T c7a40faf0455492eb35f727fc91e9fab P d895d0e90a3b45ed9aed3af8222a9b5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.019622 10699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7a40faf0455492eb35f727fc91e9fab" candidate_uuid: "305b05bc72f04d769644fbff5188bc26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" is_pre_election: true
I20260709 13:02:46.020720 10699 raft_consensus.cc:2468] T c7a40faf0455492eb35f727fc91e9fab P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 305b05bc72f04d769644fbff5188bc26 in term 0.
I20260709 13:02:46.023591 10624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7a40faf0455492eb35f727fc91e9fab" candidate_uuid: "305b05bc72f04d769644fbff5188bc26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66abd7e8893940bdbe81d60bffc91261" is_pre_election: true
I20260709 13:02:46.024549 10624 raft_consensus.cc:2468] T c7a40faf0455492eb35f727fc91e9fab P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 305b05bc72f04d769644fbff5188bc26 in term 0.
I20260709 13:02:46.025599 10813 tablet_bootstrap.cc:492] T bf181cd133ed4b8d8b3cbe5b36b23316 P 66abd7e8893940bdbe81d60bffc91261: No bootstrap required, opened a new log
I20260709 13:02:46.026248 10813 ts_tablet_manager.cc:1403] T bf181cd133ed4b8d8b3cbe5b36b23316 P 66abd7e8893940bdbe81d60bffc91261: Time spent bootstrapping tablet: real 0.055s	user 0.035s	sys 0.016s
I20260709 13:02:46.026480 10737 leader_election.cc:304] T c7a40faf0455492eb35f727fc91e9fab P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 305b05bc72f04d769644fbff5188bc26, d895d0e90a3b45ed9aed3af8222a9b5d; no voters: 
I20260709 13:02:46.027693 10817 raft_consensus.cc:2804] T c7a40faf0455492eb35f727fc91e9fab P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:46.028170 10817 raft_consensus.cc:493] T c7a40faf0455492eb35f727fc91e9fab P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.028604 10817 raft_consensus.cc:3060] T c7a40faf0455492eb35f727fc91e9fab P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.029312 10813 raft_consensus.cc:359] T bf181cd133ed4b8d8b3cbe5b36b23316 P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.030014 10813 raft_consensus.cc:385] T bf181cd133ed4b8d8b3cbe5b36b23316 P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.030341 10813 raft_consensus.cc:740] T bf181cd133ed4b8d8b3cbe5b36b23316 P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66abd7e8893940bdbe81d60bffc91261, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.031172 10813 consensus_queue.cc:260] T bf181cd133ed4b8d8b3cbe5b36b23316 P 66abd7e8893940bdbe81d60bffc91261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.033282 10813 ts_tablet_manager.cc:1434] T bf181cd133ed4b8d8b3cbe5b36b23316 P 66abd7e8893940bdbe81d60bffc91261: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:02:46.034221 10813 tablet_bootstrap.cc:492] T e23dd32048434889a42ea8dc88626ed3 P 66abd7e8893940bdbe81d60bffc91261: Bootstrap starting.
I20260709 13:02:46.040452 10813 tablet_bootstrap.cc:654] T e23dd32048434889a42ea8dc88626ed3 P 66abd7e8893940bdbe81d60bffc91261: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.039258 10817 raft_consensus.cc:515] T c7a40faf0455492eb35f727fc91e9fab P 305b05bc72f04d769644fbff5188bc26 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.042557 10820 ts_tablet_manager.cc:1434] T c7a40faf0455492eb35f727fc91e9fab P d895d0e90a3b45ed9aed3af8222a9b5d: Time spent starting tablet: real 0.048s	user 0.022s	sys 0.002s
I20260709 13:02:46.043644 10820 tablet_bootstrap.cc:492] T ddaf52c482884428ab1694c903f54cd8 P d895d0e90a3b45ed9aed3af8222a9b5d: Bootstrap starting.
I20260709 13:02:46.044952 10624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7a40faf0455492eb35f727fc91e9fab" candidate_uuid: "305b05bc72f04d769644fbff5188bc26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66abd7e8893940bdbe81d60bffc91261"
I20260709 13:02:46.045614 10624 raft_consensus.cc:3060] T c7a40faf0455492eb35f727fc91e9fab P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.044945 10724 heartbeater.cc:499] Master 127.0.107.254:46301 was elected leader, sending a full tablet report...
I20260709 13:02:46.049976 10820 tablet_bootstrap.cc:654] T ddaf52c482884428ab1694c903f54cd8 P d895d0e90a3b45ed9aed3af8222a9b5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.050637 10813 tablet_bootstrap.cc:492] T e23dd32048434889a42ea8dc88626ed3 P 66abd7e8893940bdbe81d60bffc91261: No bootstrap required, opened a new log
I20260709 13:02:46.051091 10813 ts_tablet_manager.cc:1403] T e23dd32048434889a42ea8dc88626ed3 P 66abd7e8893940bdbe81d60bffc91261: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.008s
I20260709 13:02:46.053673 10813 raft_consensus.cc:359] T e23dd32048434889a42ea8dc88626ed3 P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.054414 10813 raft_consensus.cc:385] T e23dd32048434889a42ea8dc88626ed3 P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.054700 10813 raft_consensus.cc:740] T e23dd32048434889a42ea8dc88626ed3 P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66abd7e8893940bdbe81d60bffc91261, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.055418 10813 consensus_queue.cc:260] T e23dd32048434889a42ea8dc88626ed3 P 66abd7e8893940bdbe81d60bffc91261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.057623 10813 ts_tablet_manager.cc:1434] T e23dd32048434889a42ea8dc88626ed3 P 66abd7e8893940bdbe81d60bffc91261: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:02:46.058795 10813 tablet_bootstrap.cc:492] T bd8914371e234fd89180b58dd299e334 P 66abd7e8893940bdbe81d60bffc91261: Bootstrap starting.
I20260709 13:02:46.060933 10624 raft_consensus.cc:2468] T c7a40faf0455492eb35f727fc91e9fab P 66abd7e8893940bdbe81d60bffc91261 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 305b05bc72f04d769644fbff5188bc26 in term 1.
I20260709 13:02:46.062727 10737 leader_election.cc:304] T c7a40faf0455492eb35f727fc91e9fab P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 305b05bc72f04d769644fbff5188bc26, 66abd7e8893940bdbe81d60bffc91261; no voters: 
I20260709 13:02:46.064922 10813 tablet_bootstrap.cc:654] T bd8914371e234fd89180b58dd299e334 P 66abd7e8893940bdbe81d60bffc91261: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.068960 10819 raft_consensus.cc:2804] T c7a40faf0455492eb35f727fc91e9fab P 305b05bc72f04d769644fbff5188bc26 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:46.070019 10814 tablet_bootstrap.cc:492] T bd8914371e234fd89180b58dd299e334 P 305b05bc72f04d769644fbff5188bc26: No bootstrap required, opened a new log
I20260709 13:02:46.070101 10699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7a40faf0455492eb35f727fc91e9fab" candidate_uuid: "305b05bc72f04d769644fbff5188bc26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d"
I20260709 13:02:46.070737 10814 ts_tablet_manager.cc:1403] T bd8914371e234fd89180b58dd299e334 P 305b05bc72f04d769644fbff5188bc26: Time spent bootstrapping tablet: real 0.106s	user 0.011s	sys 0.017s
I20260709 13:02:46.070830 10699 raft_consensus.cc:3060] T c7a40faf0455492eb35f727fc91e9fab P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.073719 10814 raft_consensus.cc:359] T bd8914371e234fd89180b58dd299e334 P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.074450 10814 raft_consensus.cc:385] T bd8914371e234fd89180b58dd299e334 P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.074754 10814 raft_consensus.cc:740] T bd8914371e234fd89180b58dd299e334 P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 305b05bc72f04d769644fbff5188bc26, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.075487 10814 consensus_queue.cc:260] T bd8914371e234fd89180b58dd299e334 P 305b05bc72f04d769644fbff5188bc26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.079267 10699 raft_consensus.cc:2468] T c7a40faf0455492eb35f727fc91e9fab P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 305b05bc72f04d769644fbff5188bc26 in term 1.
I20260709 13:02:46.069031 10817 leader_election.cc:290] T c7a40faf0455492eb35f727fc91e9fab P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 1 election: Requested vote from peers 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009), d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683)
I20260709 13:02:46.086515 10814 ts_tablet_manager.cc:1434] T bd8914371e234fd89180b58dd299e334 P 305b05bc72f04d769644fbff5188bc26: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.005s
I20260709 13:02:46.088853 10814 tablet_bootstrap.cc:492] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 305b05bc72f04d769644fbff5188bc26: Bootstrap starting.
I20260709 13:02:46.097136 10819 raft_consensus.cc:697] T c7a40faf0455492eb35f727fc91e9fab P 305b05bc72f04d769644fbff5188bc26 [term 1 LEADER]: Becoming Leader. State: Replica: 305b05bc72f04d769644fbff5188bc26, State: Running, Role: LEADER
I20260709 13:02:46.098744 10819 consensus_queue.cc:237] T c7a40faf0455492eb35f727fc91e9fab P 305b05bc72f04d769644fbff5188bc26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.102190 10814 tablet_bootstrap.cc:654] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 305b05bc72f04d769644fbff5188bc26: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.112458 10813 tablet_bootstrap.cc:492] T bd8914371e234fd89180b58dd299e334 P 66abd7e8893940bdbe81d60bffc91261: No bootstrap required, opened a new log
I20260709 13:02:46.113005 10813 ts_tablet_manager.cc:1403] T bd8914371e234fd89180b58dd299e334 P 66abd7e8893940bdbe81d60bffc91261: Time spent bootstrapping tablet: real 0.054s	user 0.023s	sys 0.030s
I20260709 13:02:46.114126 10820 tablet_bootstrap.cc:492] T ddaf52c482884428ab1694c903f54cd8 P d895d0e90a3b45ed9aed3af8222a9b5d: No bootstrap required, opened a new log
I20260709 13:02:46.115003 10820 ts_tablet_manager.cc:1403] T ddaf52c482884428ab1694c903f54cd8 P d895d0e90a3b45ed9aed3af8222a9b5d: Time spent bootstrapping tablet: real 0.072s	user 0.022s	sys 0.032s
I20260709 13:02:46.116402 10813 raft_consensus.cc:359] T bd8914371e234fd89180b58dd299e334 P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.117311 10813 raft_consensus.cc:385] T bd8914371e234fd89180b58dd299e334 P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.117588 10813 raft_consensus.cc:740] T bd8914371e234fd89180b58dd299e334 P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66abd7e8893940bdbe81d60bffc91261, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.118579 10813 consensus_queue.cc:260] T bd8914371e234fd89180b58dd299e334 P 66abd7e8893940bdbe81d60bffc91261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.118995 10820 raft_consensus.cc:359] T ddaf52c482884428ab1694c903f54cd8 P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.120267 10820 raft_consensus.cc:385] T ddaf52c482884428ab1694c903f54cd8 P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.120688 10820 raft_consensus.cc:740] T ddaf52c482884428ab1694c903f54cd8 P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d895d0e90a3b45ed9aed3af8222a9b5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.121006 10521 catalog_manager.cc:5697] T c7a40faf0455492eb35f727fc91e9fab P 305b05bc72f04d769644fbff5188bc26 reported cstate change: term changed from 0 to 1, leader changed from <none> to 305b05bc72f04d769644fbff5188bc26 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "305b05bc72f04d769644fbff5188bc26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:46.123322 10820 consensus_queue.cc:260] T ddaf52c482884428ab1694c903f54cd8 P d895d0e90a3b45ed9aed3af8222a9b5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.128340 10813 ts_tablet_manager.cc:1434] T bd8914371e234fd89180b58dd299e334 P 66abd7e8893940bdbe81d60bffc91261: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.002s
I20260709 13:02:46.134475 10820 ts_tablet_manager.cc:1434] T ddaf52c482884428ab1694c903f54cd8 P d895d0e90a3b45ed9aed3af8222a9b5d: Time spent starting tablet: real 0.019s	user 0.002s	sys 0.010s
I20260709 13:02:46.135891 10813 tablet_bootstrap.cc:492] T b5719c2d308646c28e9b2297f7d3becd P 66abd7e8893940bdbe81d60bffc91261: Bootstrap starting.
I20260709 13:02:46.137480 10820 tablet_bootstrap.cc:492] T e23dd32048434889a42ea8dc88626ed3 P d895d0e90a3b45ed9aed3af8222a9b5d: Bootstrap starting.
I20260709 13:02:46.139256 10814 tablet_bootstrap.cc:492] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 305b05bc72f04d769644fbff5188bc26: No bootstrap required, opened a new log
I20260709 13:02:46.139851 10814 ts_tablet_manager.cc:1403] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 305b05bc72f04d769644fbff5188bc26: Time spent bootstrapping tablet: real 0.051s	user 0.025s	sys 0.010s
I20260709 13:02:46.142797 10814 raft_consensus.cc:359] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.143544 10814 raft_consensus.cc:385] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.143847 10814 raft_consensus.cc:740] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 305b05bc72f04d769644fbff5188bc26, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.144347 10820 tablet_bootstrap.cc:654] T e23dd32048434889a42ea8dc88626ed3 P d895d0e90a3b45ed9aed3af8222a9b5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.144784 10814 consensus_queue.cc:260] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 305b05bc72f04d769644fbff5188bc26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.147316 10814 ts_tablet_manager.cc:1434] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 305b05bc72f04d769644fbff5188bc26: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 13:02:46.149094 10814 tablet_bootstrap.cc:492] T ddaf52c482884428ab1694c903f54cd8 P 305b05bc72f04d769644fbff5188bc26: Bootstrap starting.
I20260709 13:02:46.149498 10813 tablet_bootstrap.cc:654] T b5719c2d308646c28e9b2297f7d3becd P 66abd7e8893940bdbe81d60bffc91261: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.158476 10814 tablet_bootstrap.cc:654] T ddaf52c482884428ab1694c903f54cd8 P 305b05bc72f04d769644fbff5188bc26: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.160200 10818 raft_consensus.cc:493] T e23dd32048434889a42ea8dc88626ed3 P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.160823 10818 raft_consensus.cc:515] T e23dd32048434889a42ea8dc88626ed3 P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.163558 10813 tablet_bootstrap.cc:492] T b5719c2d308646c28e9b2297f7d3becd P 66abd7e8893940bdbe81d60bffc91261: No bootstrap required, opened a new log
I20260709 13:02:46.164150 10813 ts_tablet_manager.cc:1403] T b5719c2d308646c28e9b2297f7d3becd P 66abd7e8893940bdbe81d60bffc91261: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.003s
I20260709 13:02:46.167227 10818 leader_election.cc:290] T e23dd32048434889a42ea8dc88626ed3 P 66abd7e8893940bdbe81d60bffc91261 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683), 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947)
I20260709 13:02:46.167892 10813 raft_consensus.cc:359] T b5719c2d308646c28e9b2297f7d3becd P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.168982 10813 raft_consensus.cc:385] T b5719c2d308646c28e9b2297f7d3becd P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.169373 10813 raft_consensus.cc:740] T b5719c2d308646c28e9b2297f7d3becd P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66abd7e8893940bdbe81d60bffc91261, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.170532 10813 consensus_queue.cc:260] T b5719c2d308646c28e9b2297f7d3becd P 66abd7e8893940bdbe81d60bffc91261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.173693 10813 ts_tablet_manager.cc:1434] T b5719c2d308646c28e9b2297f7d3becd P 66abd7e8893940bdbe81d60bffc91261: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 13:02:46.174906 10813 tablet_bootstrap.cc:492] T 0edc1ee1d1aa48b38e4df79d771249ad P 66abd7e8893940bdbe81d60bffc91261: Bootstrap starting.
I20260709 13:02:46.179548 10820 tablet_bootstrap.cc:492] T e23dd32048434889a42ea8dc88626ed3 P d895d0e90a3b45ed9aed3af8222a9b5d: No bootstrap required, opened a new log
I20260709 13:02:46.180361 10820 ts_tablet_manager.cc:1403] T e23dd32048434889a42ea8dc88626ed3 P d895d0e90a3b45ed9aed3af8222a9b5d: Time spent bootstrapping tablet: real 0.043s	user 0.022s	sys 0.016s
I20260709 13:02:46.181715 10813 tablet_bootstrap.cc:654] T 0edc1ee1d1aa48b38e4df79d771249ad P 66abd7e8893940bdbe81d60bffc91261: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.184765 10820 raft_consensus.cc:359] T e23dd32048434889a42ea8dc88626ed3 P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.185953 10820 raft_consensus.cc:385] T e23dd32048434889a42ea8dc88626ed3 P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.186386 10820 raft_consensus.cc:740] T e23dd32048434889a42ea8dc88626ed3 P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d895d0e90a3b45ed9aed3af8222a9b5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.187399 10820 consensus_queue.cc:260] T e23dd32048434889a42ea8dc88626ed3 P d895d0e90a3b45ed9aed3af8222a9b5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.190305 10820 ts_tablet_manager.cc:1434] T e23dd32048434889a42ea8dc88626ed3 P d895d0e90a3b45ed9aed3af8222a9b5d: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:02:46.191987 10820 tablet_bootstrap.cc:492] T b5719c2d308646c28e9b2297f7d3becd P d895d0e90a3b45ed9aed3af8222a9b5d: Bootstrap starting.
I20260709 13:02:46.201073 10820 tablet_bootstrap.cc:654] T b5719c2d308646c28e9b2297f7d3becd P d895d0e90a3b45ed9aed3af8222a9b5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.201299 10813 tablet_bootstrap.cc:492] T 0edc1ee1d1aa48b38e4df79d771249ad P 66abd7e8893940bdbe81d60bffc91261: No bootstrap required, opened a new log
I20260709 13:02:46.201923 10813 ts_tablet_manager.cc:1403] T 0edc1ee1d1aa48b38e4df79d771249ad P 66abd7e8893940bdbe81d60bffc91261: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.003s
I20260709 13:02:46.206300 10818 raft_consensus.cc:493] T bd8914371e234fd89180b58dd299e334 P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.206794 10818 raft_consensus.cc:515] T bd8914371e234fd89180b58dd299e334 P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.208937 10818 leader_election.cc:290] T bd8914371e234fd89180b58dd299e334 P 66abd7e8893940bdbe81d60bffc91261 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683), 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947)
I20260709 13:02:46.209106 10813 raft_consensus.cc:359] T 0edc1ee1d1aa48b38e4df79d771249ad P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.209942 10813 raft_consensus.cc:385] T 0edc1ee1d1aa48b38e4df79d771249ad P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.210253 10813 raft_consensus.cc:740] T 0edc1ee1d1aa48b38e4df79d771249ad P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66abd7e8893940bdbe81d60bffc91261, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.211089 10813 consensus_queue.cc:260] T 0edc1ee1d1aa48b38e4df79d771249ad P 66abd7e8893940bdbe81d60bffc91261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.211902 10819 raft_consensus.cc:493] T bd8914371e234fd89180b58dd299e334 P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.212451 10819 raft_consensus.cc:515] T bd8914371e234fd89180b58dd299e334 P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.213488 10813 ts_tablet_manager.cc:1434] T 0edc1ee1d1aa48b38e4df79d771249ad P 66abd7e8893940bdbe81d60bffc91261: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.002s
I20260709 13:02:46.214572 10813 tablet_bootstrap.cc:492] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 66abd7e8893940bdbe81d60bffc91261: Bootstrap starting.
I20260709 13:02:46.214655 10819 leader_election.cc:290] T bd8914371e234fd89180b58dd299e334 P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009), d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683)
I20260709 13:02:46.215440 10820 tablet_bootstrap.cc:492] T b5719c2d308646c28e9b2297f7d3becd P d895d0e90a3b45ed9aed3af8222a9b5d: No bootstrap required, opened a new log
I20260709 13:02:46.216164 10820 ts_tablet_manager.cc:1403] T b5719c2d308646c28e9b2297f7d3becd P d895d0e90a3b45ed9aed3af8222a9b5d: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.004s
I20260709 13:02:46.218924 10624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd8914371e234fd89180b58dd299e334" candidate_uuid: "305b05bc72f04d769644fbff5188bc26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66abd7e8893940bdbe81d60bffc91261" is_pre_election: true
I20260709 13:02:46.220059 10624 raft_consensus.cc:2468] T bd8914371e234fd89180b58dd299e334 P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 305b05bc72f04d769644fbff5188bc26 in term 0.
I20260709 13:02:46.221041 10699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd8914371e234fd89180b58dd299e334" candidate_uuid: "305b05bc72f04d769644fbff5188bc26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" is_pre_election: true
I20260709 13:02:46.222186 10813 tablet_bootstrap.cc:654] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 66abd7e8893940bdbe81d60bffc91261: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:46.223188 10737 leader_election.cc:343] T bd8914371e234fd89180b58dd299e334 P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:46.225212 10737 leader_election.cc:304] T bd8914371e234fd89180b58dd299e334 P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 305b05bc72f04d769644fbff5188bc26, 66abd7e8893940bdbe81d60bffc91261; no voters: d895d0e90a3b45ed9aed3af8222a9b5d
I20260709 13:02:46.226859 10819 raft_consensus.cc:2804] T bd8914371e234fd89180b58dd299e334 P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:46.227385 10819 raft_consensus.cc:493] T bd8914371e234fd89180b58dd299e334 P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.227843 10819 raft_consensus.cc:3060] T bd8914371e234fd89180b58dd299e334 P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:46.229674 10570 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:46.238252 10820 raft_consensus.cc:359] T b5719c2d308646c28e9b2297f7d3becd P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.239432 10820 raft_consensus.cc:385] T b5719c2d308646c28e9b2297f7d3becd P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.239861 10820 raft_consensus.cc:740] T b5719c2d308646c28e9b2297f7d3becd P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d895d0e90a3b45ed9aed3af8222a9b5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.243954 10819 raft_consensus.cc:515] T bd8914371e234fd89180b58dd299e334 P 305b05bc72f04d769644fbff5188bc26 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.248093 10624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd8914371e234fd89180b58dd299e334" candidate_uuid: "305b05bc72f04d769644fbff5188bc26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66abd7e8893940bdbe81d60bffc91261"
I20260709 13:02:46.249202 10624 raft_consensus.cc:3060] T bd8914371e234fd89180b58dd299e334 P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.250270 10699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23dd32048434889a42ea8dc88626ed3" candidate_uuid: "66abd7e8893940bdbe81d60bffc91261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" is_pre_election: true
I20260709 13:02:46.251237 10699 raft_consensus.cc:2468] T e23dd32048434889a42ea8dc88626ed3 P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66abd7e8893940bdbe81d60bffc91261 in term 0.
I20260709 13:02:46.254163 10588 leader_election.cc:304] T e23dd32048434889a42ea8dc88626ed3 P 66abd7e8893940bdbe81d60bffc91261 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66abd7e8893940bdbe81d60bffc91261, d895d0e90a3b45ed9aed3af8222a9b5d; no voters: 
I20260709 13:02:46.255878 10699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd8914371e234fd89180b58dd299e334" candidate_uuid: "66abd7e8893940bdbe81d60bffc91261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" is_pre_election: true
I20260709 13:02:46.258229 10818 raft_consensus.cc:2804] T e23dd32048434889a42ea8dc88626ed3 P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:46.258762 10818 raft_consensus.cc:493] T e23dd32048434889a42ea8dc88626ed3 P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.259181 10818 raft_consensus.cc:3060] T e23dd32048434889a42ea8dc88626ed3 P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.260946 10820 consensus_queue.cc:260] T b5719c2d308646c28e9b2297f7d3becd P d895d0e90a3b45ed9aed3af8222a9b5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
W20260709 13:02:46.262660 10588 leader_election.cc:343] T bd8914371e234fd89180b58dd299e334 P 66abd7e8893940bdbe81d60bffc91261 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:46.270581 10699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd8914371e234fd89180b58dd299e334" candidate_uuid: "305b05bc72f04d769644fbff5188bc26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d"
W20260709 13:02:46.272435 10737 leader_election.cc:343] T bd8914371e234fd89180b58dd299e334 P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:46.267787 10820 ts_tablet_manager.cc:1434] T b5719c2d308646c28e9b2297f7d3becd P d895d0e90a3b45ed9aed3af8222a9b5d: Time spent starting tablet: real 0.051s	user 0.003s	sys 0.005s
I20260709 13:02:46.274794 10820 tablet_bootstrap.cc:492] T 8eb4dc0971ed4d6183bfb9d283ad51dc P d895d0e90a3b45ed9aed3af8222a9b5d: Bootstrap starting.
I20260709 13:02:46.278214 10814 tablet_bootstrap.cc:492] T ddaf52c482884428ab1694c903f54cd8 P 305b05bc72f04d769644fbff5188bc26: No bootstrap required, opened a new log
I20260709 13:02:46.278828 10814 ts_tablet_manager.cc:1403] T ddaf52c482884428ab1694c903f54cd8 P 305b05bc72f04d769644fbff5188bc26: Time spent bootstrapping tablet: real 0.130s	user 0.040s	sys 0.061s
I20260709 13:02:46.281109 10820 tablet_bootstrap.cc:654] T 8eb4dc0971ed4d6183bfb9d283ad51dc P d895d0e90a3b45ed9aed3af8222a9b5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.280982 10772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd8914371e234fd89180b58dd299e334" candidate_uuid: "66abd7e8893940bdbe81d60bffc91261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "305b05bc72f04d769644fbff5188bc26" is_pre_election: true
I20260709 13:02:46.281359 10773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23dd32048434889a42ea8dc88626ed3" candidate_uuid: "66abd7e8893940bdbe81d60bffc91261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "305b05bc72f04d769644fbff5188bc26" is_pre_election: true
I20260709 13:02:46.281945 10772 raft_consensus.cc:2393] T bd8914371e234fd89180b58dd299e334 P 305b05bc72f04d769644fbff5188bc26 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66abd7e8893940bdbe81d60bffc91261 in current term 1: Already voted for candidate 305b05bc72f04d769644fbff5188bc26 in this term.
I20260709 13:02:46.273466 10819 leader_election.cc:290] T bd8914371e234fd89180b58dd299e334 P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 1 election: Requested vote from peers 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009), d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683)
I20260709 13:02:46.282054 10814 raft_consensus.cc:359] T ddaf52c482884428ab1694c903f54cd8 P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.260159 10624 raft_consensus.cc:2468] T bd8914371e234fd89180b58dd299e334 P 66abd7e8893940bdbe81d60bffc91261 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 305b05bc72f04d769644fbff5188bc26 in term 1.
I20260709 13:02:46.283017 10814 raft_consensus.cc:385] T ddaf52c482884428ab1694c903f54cd8 P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.283437 10814 raft_consensus.cc:740] T ddaf52c482884428ab1694c903f54cd8 P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 305b05bc72f04d769644fbff5188bc26, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.284067 10737 leader_election.cc:304] T bd8914371e234fd89180b58dd299e334 P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 305b05bc72f04d769644fbff5188bc26, 66abd7e8893940bdbe81d60bffc91261; no voters: d895d0e90a3b45ed9aed3af8222a9b5d
I20260709 13:02:46.285331 10819 raft_consensus.cc:2804] T bd8914371e234fd89180b58dd299e334 P 305b05bc72f04d769644fbff5188bc26 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:46.285843 10819 raft_consensus.cc:697] T bd8914371e234fd89180b58dd299e334 P 305b05bc72f04d769644fbff5188bc26 [term 1 LEADER]: Becoming Leader. State: Replica: 305b05bc72f04d769644fbff5188bc26, State: Running, Role: LEADER
W20260709 13:02:46.285355 10590 leader_election.cc:343] T e23dd32048434889a42ea8dc88626ed3 P 66abd7e8893940bdbe81d60bffc91261 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:46.286921 10818 raft_consensus.cc:515] T e23dd32048434889a42ea8dc88626ed3 P 66abd7e8893940bdbe81d60bffc91261 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.287990 10590 leader_election.cc:304] T bd8914371e234fd89180b58dd299e334 P 66abd7e8893940bdbe81d60bffc91261 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66abd7e8893940bdbe81d60bffc91261; no voters: 305b05bc72f04d769644fbff5188bc26, d895d0e90a3b45ed9aed3af8222a9b5d
I20260709 13:02:46.286966 10819 consensus_queue.cc:237] T bd8914371e234fd89180b58dd299e334 P 305b05bc72f04d769644fbff5188bc26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.289096 10818 leader_election.cc:290] T e23dd32048434889a42ea8dc88626ed3 P 66abd7e8893940bdbe81d60bffc91261 [CANDIDATE]: Term 1 election: Requested vote from peers d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683), 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947)
I20260709 13:02:46.289958 10818 raft_consensus.cc:2749] T bd8914371e234fd89180b58dd299e334 P 66abd7e8893940bdbe81d60bffc91261 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:46.291839 10699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23dd32048434889a42ea8dc88626ed3" candidate_uuid: "66abd7e8893940bdbe81d60bffc91261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d"
I20260709 13:02:46.284301 10814 consensus_queue.cc:260] T ddaf52c482884428ab1694c903f54cd8 P 305b05bc72f04d769644fbff5188bc26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.292600 10699 raft_consensus.cc:3060] T e23dd32048434889a42ea8dc88626ed3 P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.294767 10814 ts_tablet_manager.cc:1434] T ddaf52c482884428ab1694c903f54cd8 P 305b05bc72f04d769644fbff5188bc26: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 13:02:46.296069 10814 tablet_bootstrap.cc:492] T b5719c2d308646c28e9b2297f7d3becd P 305b05bc72f04d769644fbff5188bc26: Bootstrap starting.
I20260709 13:02:46.300107 10699 raft_consensus.cc:2468] T e23dd32048434889a42ea8dc88626ed3 P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66abd7e8893940bdbe81d60bffc91261 in term 1.
I20260709 13:02:46.301394 10588 leader_election.cc:304] T e23dd32048434889a42ea8dc88626ed3 P 66abd7e8893940bdbe81d60bffc91261 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66abd7e8893940bdbe81d60bffc91261, d895d0e90a3b45ed9aed3af8222a9b5d; no voters: 
I20260709 13:02:46.302366 10818 raft_consensus.cc:2804] T e23dd32048434889a42ea8dc88626ed3 P 66abd7e8893940bdbe81d60bffc91261 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:46.302999 10818 raft_consensus.cc:697] T e23dd32048434889a42ea8dc88626ed3 P 66abd7e8893940bdbe81d60bffc91261 [term 1 LEADER]: Becoming Leader. State: Replica: 66abd7e8893940bdbe81d60bffc91261, State: Running, Role: LEADER
I20260709 13:02:46.304244 10813 tablet_bootstrap.cc:492] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 66abd7e8893940bdbe81d60bffc91261: No bootstrap required, opened a new log
I20260709 13:02:46.304034 10818 consensus_queue.cc:237] T e23dd32048434889a42ea8dc88626ed3 P 66abd7e8893940bdbe81d60bffc91261 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.309363 10813 ts_tablet_manager.cc:1403] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 66abd7e8893940bdbe81d60bffc91261: Time spent bootstrapping tablet: real 0.095s	user 0.042s	sys 0.035s
I20260709 13:02:46.311100 10814 tablet_bootstrap.cc:654] T b5719c2d308646c28e9b2297f7d3becd P 305b05bc72f04d769644fbff5188bc26: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.313985 10841 raft_consensus.cc:493] T 0edc1ee1d1aa48b38e4df79d771249ad P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.314543 10841 raft_consensus.cc:515] T 0edc1ee1d1aa48b38e4df79d771249ad P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.315033 10772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23dd32048434889a42ea8dc88626ed3" candidate_uuid: "66abd7e8893940bdbe81d60bffc91261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "305b05bc72f04d769644fbff5188bc26"
W20260709 13:02:46.316682 10590 leader_election.cc:343] T e23dd32048434889a42ea8dc88626ed3 P 66abd7e8893940bdbe81d60bffc91261 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:46.317435 10699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edc1ee1d1aa48b38e4df79d771249ad" candidate_uuid: "66abd7e8893940bdbe81d60bffc91261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" is_pre_election: true
W20260709 13:02:46.319191 10588 leader_election.cc:343] T 0edc1ee1d1aa48b38e4df79d771249ad P 66abd7e8893940bdbe81d60bffc91261 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:46.323462 10813 raft_consensus.cc:359] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.324136 10819 raft_consensus.cc:493] T ddaf52c482884428ab1694c903f54cd8 P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.324425 10813 raft_consensus.cc:385] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.324903 10813 raft_consensus.cc:740] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66abd7e8893940bdbe81d60bffc91261, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.324790 10819 raft_consensus.cc:515] T ddaf52c482884428ab1694c903f54cd8 P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.327204 10820 tablet_bootstrap.cc:492] T 8eb4dc0971ed4d6183bfb9d283ad51dc P d895d0e90a3b45ed9aed3af8222a9b5d: No bootstrap required, opened a new log
I20260709 13:02:46.326261 10813 consensus_queue.cc:260] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 66abd7e8893940bdbe81d60bffc91261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.328193 10820 ts_tablet_manager.cc:1403] T 8eb4dc0971ed4d6183bfb9d283ad51dc P d895d0e90a3b45ed9aed3af8222a9b5d: Time spent bootstrapping tablet: real 0.054s	user 0.016s	sys 0.006s
I20260709 13:02:46.329607 10819 leader_election.cc:290] T ddaf52c482884428ab1694c903f54cd8 P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009), d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683)
I20260709 13:02:46.331255 10624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaf52c482884428ab1694c903f54cd8" candidate_uuid: "305b05bc72f04d769644fbff5188bc26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66abd7e8893940bdbe81d60bffc91261" is_pre_election: true
I20260709 13:02:46.331496 10699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaf52c482884428ab1694c903f54cd8" candidate_uuid: "305b05bc72f04d769644fbff5188bc26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" is_pre_election: true
I20260709 13:02:46.332283 10699 raft_consensus.cc:2468] T ddaf52c482884428ab1694c903f54cd8 P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 305b05bc72f04d769644fbff5188bc26 in term 0.
I20260709 13:02:46.331652 10820 raft_consensus.cc:359] T 8eb4dc0971ed4d6183bfb9d283ad51dc P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
W20260709 13:02:46.332692 10737 leader_election.cc:343] T ddaf52c482884428ab1694c903f54cd8 P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:46.332890 10820 raft_consensus.cc:385] T 8eb4dc0971ed4d6183bfb9d283ad51dc P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.331650 10520 catalog_manager.cc:5697] T bd8914371e234fd89180b58dd299e334 P 305b05bc72f04d769644fbff5188bc26 reported cstate change: term changed from 0 to 1, leader changed from <none> to 305b05bc72f04d769644fbff5188bc26 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "305b05bc72f04d769644fbff5188bc26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:46.330588 10813 ts_tablet_manager.cc:1434] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 66abd7e8893940bdbe81d60bffc91261: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 13:02:46.333371 10841 leader_election.cc:290] T 0edc1ee1d1aa48b38e4df79d771249ad P 66abd7e8893940bdbe81d60bffc91261 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683), 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947)
I20260709 13:02:46.333707 10737 leader_election.cc:304] T ddaf52c482884428ab1694c903f54cd8 P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 305b05bc72f04d769644fbff5188bc26, d895d0e90a3b45ed9aed3af8222a9b5d; no voters: 66abd7e8893940bdbe81d60bffc91261
I20260709 13:02:46.333344 10820 raft_consensus.cc:740] T 8eb4dc0971ed4d6183bfb9d283ad51dc P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d895d0e90a3b45ed9aed3af8222a9b5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.334558 10813 tablet_bootstrap.cc:492] T ddaf52c482884428ab1694c903f54cd8 P 66abd7e8893940bdbe81d60bffc91261: Bootstrap starting.
I20260709 13:02:46.334966 10819 raft_consensus.cc:2804] T ddaf52c482884428ab1694c903f54cd8 P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:46.335390 10819 raft_consensus.cc:493] T ddaf52c482884428ab1694c903f54cd8 P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.335879 10819 raft_consensus.cc:3060] T ddaf52c482884428ab1694c903f54cd8 P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.335418 10820 consensus_queue.cc:260] T 8eb4dc0971ed4d6183bfb9d283ad51dc P d895d0e90a3b45ed9aed3af8222a9b5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.342115 10813 tablet_bootstrap.cc:654] T ddaf52c482884428ab1694c903f54cd8 P 66abd7e8893940bdbe81d60bffc91261: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.342357 10772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edc1ee1d1aa48b38e4df79d771249ad" candidate_uuid: "66abd7e8893940bdbe81d60bffc91261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "305b05bc72f04d769644fbff5188bc26" is_pre_election: true
I20260709 13:02:46.344518 10819 raft_consensus.cc:515] T ddaf52c482884428ab1694c903f54cd8 P 305b05bc72f04d769644fbff5188bc26 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
W20260709 13:02:46.346460 10590 leader_election.cc:343] T 0edc1ee1d1aa48b38e4df79d771249ad P 66abd7e8893940bdbe81d60bffc91261 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:46.347044 10590 leader_election.cc:304] T 0edc1ee1d1aa48b38e4df79d771249ad P 66abd7e8893940bdbe81d60bffc91261 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66abd7e8893940bdbe81d60bffc91261; no voters: 305b05bc72f04d769644fbff5188bc26, d895d0e90a3b45ed9aed3af8222a9b5d
I20260709 13:02:46.348012 10844 raft_consensus.cc:493] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.348206 10841 raft_consensus.cc:2749] T 0edc1ee1d1aa48b38e4df79d771249ad P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:46.348075 10624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaf52c482884428ab1694c903f54cd8" candidate_uuid: "305b05bc72f04d769644fbff5188bc26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66abd7e8893940bdbe81d60bffc91261"
I20260709 13:02:46.348590 10844 raft_consensus.cc:515] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
W20260709 13:02:46.350090 10737 leader_election.cc:343] T ddaf52c482884428ab1694c903f54cd8 P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:46.350818 10820 ts_tablet_manager.cc:1434] T 8eb4dc0971ed4d6183bfb9d283ad51dc P d895d0e90a3b45ed9aed3af8222a9b5d: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.004s
I20260709 13:02:46.350924 10844 leader_election.cc:290] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 66abd7e8893940bdbe81d60bffc91261 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683), 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947)
I20260709 13:02:46.352866 10699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eb4dc0971ed4d6183bfb9d283ad51dc" candidate_uuid: "66abd7e8893940bdbe81d60bffc91261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" is_pre_election: true
I20260709 13:02:46.353479 10699 raft_consensus.cc:2468] T 8eb4dc0971ed4d6183bfb9d283ad51dc P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66abd7e8893940bdbe81d60bffc91261 in term 0.
I20260709 13:02:46.354547 10820 tablet_bootstrap.cc:492] T 020e5de5fe4f481ba994779ae752696c P d895d0e90a3b45ed9aed3af8222a9b5d: Bootstrap starting.
I20260709 13:02:46.355048 10588 leader_election.cc:304] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 66abd7e8893940bdbe81d60bffc91261 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66abd7e8893940bdbe81d60bffc91261, d895d0e90a3b45ed9aed3af8222a9b5d; no voters: 
I20260709 13:02:46.355636 10772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eb4dc0971ed4d6183bfb9d283ad51dc" candidate_uuid: "66abd7e8893940bdbe81d60bffc91261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "305b05bc72f04d769644fbff5188bc26" is_pre_election: true
I20260709 13:02:46.356369 10772 raft_consensus.cc:2468] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66abd7e8893940bdbe81d60bffc91261 in term 0.
I20260709 13:02:46.356464 10818 raft_consensus.cc:2804] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:46.357126 10818 raft_consensus.cc:493] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.357581 10818 raft_consensus.cc:3060] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.360765 10522 catalog_manager.cc:5697] T e23dd32048434889a42ea8dc88626ed3 P 66abd7e8893940bdbe81d60bffc91261 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "66abd7e8893940bdbe81d60bffc91261" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:46.368012 10699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaf52c482884428ab1694c903f54cd8" candidate_uuid: "305b05bc72f04d769644fbff5188bc26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d"
I20260709 13:02:46.368999 10699 raft_consensus.cc:3060] T ddaf52c482884428ab1694c903f54cd8 P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.377148 10820 tablet_bootstrap.cc:654] T 020e5de5fe4f481ba994779ae752696c P d895d0e90a3b45ed9aed3af8222a9b5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.362749 10819 leader_election.cc:290] T ddaf52c482884428ab1694c903f54cd8 P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 1 election: Requested vote from peers 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009), d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683)
I20260709 13:02:46.384625 10814 tablet_bootstrap.cc:492] T b5719c2d308646c28e9b2297f7d3becd P 305b05bc72f04d769644fbff5188bc26: No bootstrap required, opened a new log
I20260709 13:02:46.384459 10818 raft_consensus.cc:515] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 66abd7e8893940bdbe81d60bffc91261 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.385473 10814 ts_tablet_manager.cc:1403] T b5719c2d308646c28e9b2297f7d3becd P 305b05bc72f04d769644fbff5188bc26: Time spent bootstrapping tablet: real 0.090s	user 0.022s	sys 0.010s
I20260709 13:02:46.386953 10699 raft_consensus.cc:2468] T ddaf52c482884428ab1694c903f54cd8 P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 305b05bc72f04d769644fbff5188bc26 in term 1.
I20260709 13:02:46.387918 10698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eb4dc0971ed4d6183bfb9d283ad51dc" candidate_uuid: "66abd7e8893940bdbe81d60bffc91261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d"
I20260709 13:02:46.388657 10698 raft_consensus.cc:3060] T 8eb4dc0971ed4d6183bfb9d283ad51dc P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.389302 10814 raft_consensus.cc:359] T b5719c2d308646c28e9b2297f7d3becd P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.390468 10814 raft_consensus.cc:385] T b5719c2d308646c28e9b2297f7d3becd P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.390961 10814 raft_consensus.cc:740] T b5719c2d308646c28e9b2297f7d3becd P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 305b05bc72f04d769644fbff5188bc26, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.392102 10814 consensus_queue.cc:260] T b5719c2d308646c28e9b2297f7d3becd P 305b05bc72f04d769644fbff5188bc26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.394238 10737 leader_election.cc:304] T ddaf52c482884428ab1694c903f54cd8 P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 305b05bc72f04d769644fbff5188bc26, d895d0e90a3b45ed9aed3af8222a9b5d; no voters: 66abd7e8893940bdbe81d60bffc91261
I20260709 13:02:46.395349 10814 ts_tablet_manager.cc:1434] T b5719c2d308646c28e9b2297f7d3becd P 305b05bc72f04d769644fbff5188bc26: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:02:46.395874 10829 raft_consensus.cc:2804] T ddaf52c482884428ab1694c903f54cd8 P 305b05bc72f04d769644fbff5188bc26 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:46.396948 10814 tablet_bootstrap.cc:492] T 020e5de5fe4f481ba994779ae752696c P 305b05bc72f04d769644fbff5188bc26: Bootstrap starting.
I20260709 13:02:46.396471 10829 raft_consensus.cc:697] T ddaf52c482884428ab1694c903f54cd8 P 305b05bc72f04d769644fbff5188bc26 [term 1 LEADER]: Becoming Leader. State: Replica: 305b05bc72f04d769644fbff5188bc26, State: Running, Role: LEADER
I20260709 13:02:46.398471 10829 consensus_queue.cc:237] T ddaf52c482884428ab1694c903f54cd8 P 305b05bc72f04d769644fbff5188bc26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.399876 10698 raft_consensus.cc:2468] T 8eb4dc0971ed4d6183bfb9d283ad51dc P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66abd7e8893940bdbe81d60bffc91261 in term 1.
I20260709 13:02:46.402256 10772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eb4dc0971ed4d6183bfb9d283ad51dc" candidate_uuid: "66abd7e8893940bdbe81d60bffc91261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "305b05bc72f04d769644fbff5188bc26"
I20260709 13:02:46.402935 10772 raft_consensus.cc:3060] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.406002 10814 tablet_bootstrap.cc:654] T 020e5de5fe4f481ba994779ae752696c P 305b05bc72f04d769644fbff5188bc26: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.412670 10818 leader_election.cc:290] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 66abd7e8893940bdbe81d60bffc91261 [CANDIDATE]: Term 1 election: Requested vote from peers d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683), 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947)
I20260709 13:02:46.414647 10813 tablet_bootstrap.cc:492] T ddaf52c482884428ab1694c903f54cd8 P 66abd7e8893940bdbe81d60bffc91261: No bootstrap required, opened a new log
I20260709 13:02:46.415184 10813 ts_tablet_manager.cc:1403] T ddaf52c482884428ab1694c903f54cd8 P 66abd7e8893940bdbe81d60bffc91261: Time spent bootstrapping tablet: real 0.081s	user 0.018s	sys 0.019s
I20260709 13:02:46.417970 10813 raft_consensus.cc:359] T ddaf52c482884428ab1694c903f54cd8 P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.418645 10813 raft_consensus.cc:385] T ddaf52c482884428ab1694c903f54cd8 P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.419723 10588 leader_election.cc:304] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 66abd7e8893940bdbe81d60bffc91261 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66abd7e8893940bdbe81d60bffc91261, d895d0e90a3b45ed9aed3af8222a9b5d; no voters: 
I20260709 13:02:46.420316 10814 tablet_bootstrap.cc:492] T 020e5de5fe4f481ba994779ae752696c P 305b05bc72f04d769644fbff5188bc26: No bootstrap required, opened a new log
I20260709 13:02:46.420706 10818 raft_consensus.cc:2804] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 66abd7e8893940bdbe81d60bffc91261 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:46.421304 10814 ts_tablet_manager.cc:1403] T 020e5de5fe4f481ba994779ae752696c P 305b05bc72f04d769644fbff5188bc26: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.005s
I20260709 13:02:46.412225 10772 raft_consensus.cc:2468] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 305b05bc72f04d769644fbff5188bc26 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66abd7e8893940bdbe81d60bffc91261 in term 1.
I20260709 13:02:46.420485 10522 catalog_manager.cc:5697] T ddaf52c482884428ab1694c903f54cd8 P 305b05bc72f04d769644fbff5188bc26 reported cstate change: term changed from 0 to 1, leader changed from <none> to 305b05bc72f04d769644fbff5188bc26 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "305b05bc72f04d769644fbff5188bc26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:46.421591 10818 raft_consensus.cc:697] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 66abd7e8893940bdbe81d60bffc91261 [term 1 LEADER]: Becoming Leader. State: Replica: 66abd7e8893940bdbe81d60bffc91261, State: Running, Role: LEADER
I20260709 13:02:46.418928 10813 raft_consensus.cc:740] T ddaf52c482884428ab1694c903f54cd8 P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66abd7e8893940bdbe81d60bffc91261, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.424027 10813 consensus_queue.cc:260] T ddaf52c482884428ab1694c903f54cd8 P 66abd7e8893940bdbe81d60bffc91261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.424070 10818 consensus_queue.cc:237] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 66abd7e8893940bdbe81d60bffc91261 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.425469 10814 raft_consensus.cc:359] T 020e5de5fe4f481ba994779ae752696c P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.426275 10814 raft_consensus.cc:385] T 020e5de5fe4f481ba994779ae752696c P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.426388 10813 ts_tablet_manager.cc:1434] T ddaf52c482884428ab1694c903f54cd8 P 66abd7e8893940bdbe81d60bffc91261: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:02:46.426698 10814 raft_consensus.cc:740] T 020e5de5fe4f481ba994779ae752696c P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 305b05bc72f04d769644fbff5188bc26, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.427419 10813 tablet_bootstrap.cc:492] T 020e5de5fe4f481ba994779ae752696c P 66abd7e8893940bdbe81d60bffc91261: Bootstrap starting.
I20260709 13:02:46.427763 10814 consensus_queue.cc:260] T 020e5de5fe4f481ba994779ae752696c P 305b05bc72f04d769644fbff5188bc26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.430953 10814 ts_tablet_manager.cc:1434] T 020e5de5fe4f481ba994779ae752696c P 305b05bc72f04d769644fbff5188bc26: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 13:02:46.431401 10820 tablet_bootstrap.cc:492] T 020e5de5fe4f481ba994779ae752696c P d895d0e90a3b45ed9aed3af8222a9b5d: No bootstrap required, opened a new log
I20260709 13:02:46.431924 10820 ts_tablet_manager.cc:1403] T 020e5de5fe4f481ba994779ae752696c P d895d0e90a3b45ed9aed3af8222a9b5d: Time spent bootstrapping tablet: real 0.078s	user 0.026s	sys 0.018s
I20260709 13:02:46.432111 10814 tablet_bootstrap.cc:492] T bf181cd133ed4b8d8b3cbe5b36b23316 P 305b05bc72f04d769644fbff5188bc26: Bootstrap starting.
I20260709 13:02:46.434046 10844 raft_consensus.cc:493] T bf181cd133ed4b8d8b3cbe5b36b23316 P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.434598 10844 raft_consensus.cc:515] T bf181cd133ed4b8d8b3cbe5b36b23316 P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.435154 10820 raft_consensus.cc:359] T 020e5de5fe4f481ba994779ae752696c P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.437877 10698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf181cd133ed4b8d8b3cbe5b36b23316" candidate_uuid: "66abd7e8893940bdbe81d60bffc91261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" is_pre_election: true
I20260709 13:02:46.439141 10844 leader_election.cc:290] T bf181cd133ed4b8d8b3cbe5b36b23316 P 66abd7e8893940bdbe81d60bffc91261 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683), 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947)
W20260709 13:02:46.439338 10588 leader_election.cc:343] T bf181cd133ed4b8d8b3cbe5b36b23316 P 66abd7e8893940bdbe81d60bffc91261 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:46.440804 10772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf181cd133ed4b8d8b3cbe5b36b23316" candidate_uuid: "66abd7e8893940bdbe81d60bffc91261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "305b05bc72f04d769644fbff5188bc26" is_pre_election: true
I20260709 13:02:46.442404 10813 tablet_bootstrap.cc:654] T 020e5de5fe4f481ba994779ae752696c P 66abd7e8893940bdbe81d60bffc91261: Neither blocks nor log segments found. Creating new log.
W20260709 13:02:46.442642 10590 leader_election.cc:343] T bf181cd133ed4b8d8b3cbe5b36b23316 P 66abd7e8893940bdbe81d60bffc91261 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:46.435963 10820 raft_consensus.cc:385] T 020e5de5fe4f481ba994779ae752696c P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.443181 10590 leader_election.cc:304] T bf181cd133ed4b8d8b3cbe5b36b23316 P 66abd7e8893940bdbe81d60bffc91261 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66abd7e8893940bdbe81d60bffc91261; no voters: 305b05bc72f04d769644fbff5188bc26, d895d0e90a3b45ed9aed3af8222a9b5d
I20260709 13:02:46.443467 10814 tablet_bootstrap.cc:654] T bf181cd133ed4b8d8b3cbe5b36b23316 P 305b05bc72f04d769644fbff5188bc26: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.443605 10820 raft_consensus.cc:740] T 020e5de5fe4f481ba994779ae752696c P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d895d0e90a3b45ed9aed3af8222a9b5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.444839 10820 consensus_queue.cc:260] T 020e5de5fe4f481ba994779ae752696c P d895d0e90a3b45ed9aed3af8222a9b5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.447923 10820 ts_tablet_manager.cc:1434] T 020e5de5fe4f481ba994779ae752696c P d895d0e90a3b45ed9aed3af8222a9b5d: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.006s
I20260709 13:02:46.447337 10522 catalog_manager.cc:5697] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 66abd7e8893940bdbe81d60bffc91261 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "66abd7e8893940bdbe81d60bffc91261" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:46.449709 10820 tablet_bootstrap.cc:492] T 0edc1ee1d1aa48b38e4df79d771249ad P d895d0e90a3b45ed9aed3af8222a9b5d: Bootstrap starting.
I20260709 13:02:46.452843 10818 raft_consensus.cc:2749] T bf181cd133ed4b8d8b3cbe5b36b23316 P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:46.457068 10813 tablet_bootstrap.cc:492] T 020e5de5fe4f481ba994779ae752696c P 66abd7e8893940bdbe81d60bffc91261: No bootstrap required, opened a new log
I20260709 13:02:46.457616 10813 ts_tablet_manager.cc:1403] T 020e5de5fe4f481ba994779ae752696c P 66abd7e8893940bdbe81d60bffc91261: Time spent bootstrapping tablet: real 0.030s	user 0.007s	sys 0.013s
I20260709 13:02:46.458189 10820 tablet_bootstrap.cc:654] T 0edc1ee1d1aa48b38e4df79d771249ad P d895d0e90a3b45ed9aed3af8222a9b5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.460628 10813 raft_consensus.cc:359] T 020e5de5fe4f481ba994779ae752696c P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.461480 10813 raft_consensus.cc:385] T 020e5de5fe4f481ba994779ae752696c P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.461869 10813 raft_consensus.cc:740] T 020e5de5fe4f481ba994779ae752696c P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66abd7e8893940bdbe81d60bffc91261, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.462963 10813 consensus_queue.cc:260] T 020e5de5fe4f481ba994779ae752696c P 66abd7e8893940bdbe81d60bffc91261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.466197 10813 ts_tablet_manager.cc:1434] T 020e5de5fe4f481ba994779ae752696c P 66abd7e8893940bdbe81d60bffc91261: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:02:46.470887 10820 tablet_bootstrap.cc:492] T 0edc1ee1d1aa48b38e4df79d771249ad P d895d0e90a3b45ed9aed3af8222a9b5d: No bootstrap required, opened a new log
I20260709 13:02:46.471433 10820 ts_tablet_manager.cc:1403] T 0edc1ee1d1aa48b38e4df79d771249ad P d895d0e90a3b45ed9aed3af8222a9b5d: Time spent bootstrapping tablet: real 0.022s	user 0.018s	sys 0.001s
I20260709 13:02:46.473105 10814 tablet_bootstrap.cc:492] T bf181cd133ed4b8d8b3cbe5b36b23316 P 305b05bc72f04d769644fbff5188bc26: No bootstrap required, opened a new log
I20260709 13:02:46.473670 10814 ts_tablet_manager.cc:1403] T bf181cd133ed4b8d8b3cbe5b36b23316 P 305b05bc72f04d769644fbff5188bc26: Time spent bootstrapping tablet: real 0.042s	user 0.022s	sys 0.009s
I20260709 13:02:46.474642 10820 raft_consensus.cc:359] T 0edc1ee1d1aa48b38e4df79d771249ad P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.475479 10820 raft_consensus.cc:385] T 0edc1ee1d1aa48b38e4df79d771249ad P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.475788 10820 raft_consensus.cc:740] T 0edc1ee1d1aa48b38e4df79d771249ad P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d895d0e90a3b45ed9aed3af8222a9b5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.476644 10820 consensus_queue.cc:260] T 0edc1ee1d1aa48b38e4df79d771249ad P d895d0e90a3b45ed9aed3af8222a9b5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.476847 10814 raft_consensus.cc:359] T bf181cd133ed4b8d8b3cbe5b36b23316 P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.477635 10814 raft_consensus.cc:385] T bf181cd133ed4b8d8b3cbe5b36b23316 P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.477957 10814 raft_consensus.cc:740] T bf181cd133ed4b8d8b3cbe5b36b23316 P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 305b05bc72f04d769644fbff5188bc26, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.478729 10814 consensus_queue.cc:260] T bf181cd133ed4b8d8b3cbe5b36b23316 P 305b05bc72f04d769644fbff5188bc26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.479245 10820 ts_tablet_manager.cc:1434] T 0edc1ee1d1aa48b38e4df79d771249ad P d895d0e90a3b45ed9aed3af8222a9b5d: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:02:46.480980 10820 tablet_bootstrap.cc:492] T bf181cd133ed4b8d8b3cbe5b36b23316 P d895d0e90a3b45ed9aed3af8222a9b5d: Bootstrap starting.
I20260709 13:02:46.481407 10814 ts_tablet_manager.cc:1434] T bf181cd133ed4b8d8b3cbe5b36b23316 P 305b05bc72f04d769644fbff5188bc26: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 13:02:46.482501 10814 tablet_bootstrap.cc:492] T 0edc1ee1d1aa48b38e4df79d771249ad P 305b05bc72f04d769644fbff5188bc26: Bootstrap starting.
I20260709 13:02:46.488283 10820 tablet_bootstrap.cc:654] T bf181cd133ed4b8d8b3cbe5b36b23316 P d895d0e90a3b45ed9aed3af8222a9b5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.489648 10814 tablet_bootstrap.cc:654] T 0edc1ee1d1aa48b38e4df79d771249ad P 305b05bc72f04d769644fbff5188bc26: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.490957 10825 raft_consensus.cc:493] T b5719c2d308646c28e9b2297f7d3becd P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.491524 10825 raft_consensus.cc:515] T b5719c2d308646c28e9b2297f7d3becd P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.497225 10825 leader_election.cc:290] T b5719c2d308646c28e9b2297f7d3becd P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009), 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947)
I20260709 13:02:46.515081 10814 tablet_bootstrap.cc:492] T 0edc1ee1d1aa48b38e4df79d771249ad P 305b05bc72f04d769644fbff5188bc26: No bootstrap required, opened a new log
I20260709 13:02:46.515961 10814 ts_tablet_manager.cc:1403] T 0edc1ee1d1aa48b38e4df79d771249ad P 305b05bc72f04d769644fbff5188bc26: Time spent bootstrapping tablet: real 0.034s	user 0.018s	sys 0.012s
I20260709 13:02:46.520169 10814 raft_consensus.cc:359] T 0edc1ee1d1aa48b38e4df79d771249ad P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.521179 10814 raft_consensus.cc:385] T 0edc1ee1d1aa48b38e4df79d771249ad P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.521552 10814 raft_consensus.cc:740] T 0edc1ee1d1aa48b38e4df79d771249ad P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 305b05bc72f04d769644fbff5188bc26, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.522573 10624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5719c2d308646c28e9b2297f7d3becd" candidate_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66abd7e8893940bdbe81d60bffc91261" is_pre_election: true
I20260709 13:02:46.523561 10624 raft_consensus.cc:2468] T b5719c2d308646c28e9b2297f7d3becd P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d895d0e90a3b45ed9aed3af8222a9b5d in term 0.
I20260709 13:02:46.523963 10814 consensus_queue.cc:260] T 0edc1ee1d1aa48b38e4df79d771249ad P 305b05bc72f04d769644fbff5188bc26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.524605 10772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5719c2d308646c28e9b2297f7d3becd" candidate_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "305b05bc72f04d769644fbff5188bc26" is_pre_election: true
I20260709 13:02:46.525116 10663 leader_election.cc:304] T b5719c2d308646c28e9b2297f7d3becd P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66abd7e8893940bdbe81d60bffc91261, d895d0e90a3b45ed9aed3af8222a9b5d; no voters: 
I20260709 13:02:46.525323 10772 raft_consensus.cc:2468] T b5719c2d308646c28e9b2297f7d3becd P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d895d0e90a3b45ed9aed3af8222a9b5d in term 0.
I20260709 13:02:46.526309 10814 ts_tablet_manager.cc:1434] T 0edc1ee1d1aa48b38e4df79d771249ad P 305b05bc72f04d769644fbff5188bc26: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:02:46.526400 10820 tablet_bootstrap.cc:492] T bf181cd133ed4b8d8b3cbe5b36b23316 P d895d0e90a3b45ed9aed3af8222a9b5d: No bootstrap required, opened a new log
I20260709 13:02:46.526800 10825 raft_consensus.cc:2804] T b5719c2d308646c28e9b2297f7d3becd P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:46.527001 10820 ts_tablet_manager.cc:1403] T bf181cd133ed4b8d8b3cbe5b36b23316 P d895d0e90a3b45ed9aed3af8222a9b5d: Time spent bootstrapping tablet: real 0.046s	user 0.014s	sys 0.026s
I20260709 13:02:46.527261 10825 raft_consensus.cc:493] T b5719c2d308646c28e9b2297f7d3becd P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.527676 10825 raft_consensus.cc:3060] T b5719c2d308646c28e9b2297f7d3becd P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.528410 10814 tablet_bootstrap.cc:492] T e23dd32048434889a42ea8dc88626ed3 P 305b05bc72f04d769644fbff5188bc26: Bootstrap starting.
I20260709 13:02:46.530325 10820 raft_consensus.cc:359] T bf181cd133ed4b8d8b3cbe5b36b23316 P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.530998 10820 raft_consensus.cc:385] T bf181cd133ed4b8d8b3cbe5b36b23316 P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.531271 10820 raft_consensus.cc:740] T bf181cd133ed4b8d8b3cbe5b36b23316 P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d895d0e90a3b45ed9aed3af8222a9b5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.531962 10820 consensus_queue.cc:260] T bf181cd133ed4b8d8b3cbe5b36b23316 P d895d0e90a3b45ed9aed3af8222a9b5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.532202 10819 consensus_queue.cc:1048] T c7a40faf0455492eb35f727fc91e9fab P 305b05bc72f04d769644fbff5188bc26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:46.534843 10814 tablet_bootstrap.cc:654] T e23dd32048434889a42ea8dc88626ed3 P 305b05bc72f04d769644fbff5188bc26: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.539696 10819 raft_consensus.cc:493] T 020e5de5fe4f481ba994779ae752696c P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.540606 10819 raft_consensus.cc:515] T 020e5de5fe4f481ba994779ae752696c P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.545553 10622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020e5de5fe4f481ba994779ae752696c" candidate_uuid: "305b05bc72f04d769644fbff5188bc26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66abd7e8893940bdbe81d60bffc91261" is_pre_election: true
I20260709 13:02:46.546702 10622 raft_consensus.cc:2468] T 020e5de5fe4f481ba994779ae752696c P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 305b05bc72f04d769644fbff5188bc26 in term 0.
I20260709 13:02:46.547842 10818 raft_consensus.cc:493] T ddaf52c482884428ab1694c903f54cd8 P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.548656 10818 raft_consensus.cc:515] T ddaf52c482884428ab1694c903f54cd8 P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.552517 10818 leader_election.cc:290] T ddaf52c482884428ab1694c903f54cd8 P 66abd7e8893940bdbe81d60bffc91261 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683), 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947)
I20260709 13:02:46.552906 10698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaf52c482884428ab1694c903f54cd8" candidate_uuid: "66abd7e8893940bdbe81d60bffc91261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" is_pre_election: true
I20260709 13:02:46.554216 10698 raft_consensus.cc:2393] T ddaf52c482884428ab1694c903f54cd8 P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66abd7e8893940bdbe81d60bffc91261 in current term 1: Already voted for candidate 305b05bc72f04d769644fbff5188bc26 in this term.
I20260709 13:02:46.554314 10737 leader_election.cc:304] T 020e5de5fe4f481ba994779ae752696c P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 305b05bc72f04d769644fbff5188bc26, 66abd7e8893940bdbe81d60bffc91261; no voters: 
I20260709 13:02:46.555688 10829 raft_consensus.cc:2804] T 020e5de5fe4f481ba994779ae752696c P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:46.556202 10829 raft_consensus.cc:493] T 020e5de5fe4f481ba994779ae752696c P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.556715 10829 raft_consensus.cc:3060] T 020e5de5fe4f481ba994779ae752696c P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.557946 10772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaf52c482884428ab1694c903f54cd8" candidate_uuid: "66abd7e8893940bdbe81d60bffc91261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "305b05bc72f04d769644fbff5188bc26" is_pre_election: true
I20260709 13:02:46.560197 10590 leader_election.cc:304] T ddaf52c482884428ab1694c903f54cd8 P 66abd7e8893940bdbe81d60bffc91261 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66abd7e8893940bdbe81d60bffc91261; no voters: 305b05bc72f04d769644fbff5188bc26, d895d0e90a3b45ed9aed3af8222a9b5d
I20260709 13:02:46.561914 10817 raft_consensus.cc:493] T 0edc1ee1d1aa48b38e4df79d771249ad P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.562742 10817 raft_consensus.cc:515] T 0edc1ee1d1aa48b38e4df79d771249ad P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.565117 10819 leader_election.cc:290] T 020e5de5fe4f481ba994779ae752696c P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009), d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683)
I20260709 13:02:46.569639 10624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edc1ee1d1aa48b38e4df79d771249ad" candidate_uuid: "305b05bc72f04d769644fbff5188bc26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66abd7e8893940bdbe81d60bffc91261" is_pre_election: true
I20260709 13:02:46.565691 10817 leader_election.cc:290] T 0edc1ee1d1aa48b38e4df79d771249ad P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009), d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683)
I20260709 13:02:46.578219 10698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020e5de5fe4f481ba994779ae752696c" candidate_uuid: "305b05bc72f04d769644fbff5188bc26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" is_pre_election: true
I20260709 13:02:46.570917 10624 raft_consensus.cc:2468] T 0edc1ee1d1aa48b38e4df79d771249ad P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 305b05bc72f04d769644fbff5188bc26 in term 0.
I20260709 13:02:46.580161 10699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edc1ee1d1aa48b38e4df79d771249ad" candidate_uuid: "305b05bc72f04d769644fbff5188bc26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" is_pre_election: true
I20260709 13:02:46.575822 10825 raft_consensus.cc:515] T b5719c2d308646c28e9b2297f7d3becd P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.582087 10698 raft_consensus.cc:2468] T 020e5de5fe4f481ba994779ae752696c P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 305b05bc72f04d769644fbff5188bc26 in term 0.
I20260709 13:02:46.581204 10699 raft_consensus.cc:2468] T 0edc1ee1d1aa48b38e4df79d771249ad P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 305b05bc72f04d769644fbff5188bc26 in term 0.
I20260709 13:02:46.583813 10818 raft_consensus.cc:3060] T ddaf52c482884428ab1694c903f54cd8 P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.585790 10825 leader_election.cc:290] T b5719c2d308646c28e9b2297f7d3becd P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 1 election: Requested vote from peers 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009), 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947)
I20260709 13:02:46.588011 10622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5719c2d308646c28e9b2297f7d3becd" candidate_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66abd7e8893940bdbe81d60bffc91261"
I20260709 13:02:46.588970 10622 raft_consensus.cc:3060] T b5719c2d308646c28e9b2297f7d3becd P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.596689 10772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5719c2d308646c28e9b2297f7d3becd" candidate_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "305b05bc72f04d769644fbff5188bc26"
I20260709 13:02:46.597653 10772 raft_consensus.cc:3060] T b5719c2d308646c28e9b2297f7d3becd P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.601171 10737 leader_election.cc:304] T 0edc1ee1d1aa48b38e4df79d771249ad P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 305b05bc72f04d769644fbff5188bc26, d895d0e90a3b45ed9aed3af8222a9b5d; no voters: 
I20260709 13:02:46.602598 10817 raft_consensus.cc:2804] T 0edc1ee1d1aa48b38e4df79d771249ad P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:46.603094 10817 raft_consensus.cc:493] T 0edc1ee1d1aa48b38e4df79d771249ad P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.603533 10817 raft_consensus.cc:3060] T 0edc1ee1d1aa48b38e4df79d771249ad P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.623525 10825 raft_consensus.cc:493] T bf181cd133ed4b8d8b3cbe5b36b23316 P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:46.624392 10825 raft_consensus.cc:515] T bf181cd133ed4b8d8b3cbe5b36b23316 P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.625784 10829 raft_consensus.cc:515] T 020e5de5fe4f481ba994779ae752696c P 305b05bc72f04d769644fbff5188bc26 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.628760 10624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf181cd133ed4b8d8b3cbe5b36b23316" candidate_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66abd7e8893940bdbe81d60bffc91261" is_pre_election: true
I20260709 13:02:46.629451 10621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020e5de5fe4f481ba994779ae752696c" candidate_uuid: "305b05bc72f04d769644fbff5188bc26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66abd7e8893940bdbe81d60bffc91261"
I20260709 13:02:46.629791 10624 raft_consensus.cc:2468] T bf181cd133ed4b8d8b3cbe5b36b23316 P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d895d0e90a3b45ed9aed3af8222a9b5d in term 0.
I20260709 13:02:46.630432 10621 raft_consensus.cc:3060] T 020e5de5fe4f481ba994779ae752696c P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.632164 10663 leader_election.cc:304] T bf181cd133ed4b8d8b3cbe5b36b23316 P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66abd7e8893940bdbe81d60bffc91261, d895d0e90a3b45ed9aed3af8222a9b5d; no voters: 
I20260709 13:02:46.634316 10825 leader_election.cc:290] T bf181cd133ed4b8d8b3cbe5b36b23316 P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009), 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947)
I20260709 13:02:46.635169 10825 raft_consensus.cc:2804] T bf181cd133ed4b8d8b3cbe5b36b23316 P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:46.635763 10825 raft_consensus.cc:493] T bf181cd133ed4b8d8b3cbe5b36b23316 P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:46.636039 10773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf181cd133ed4b8d8b3cbe5b36b23316" candidate_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "305b05bc72f04d769644fbff5188bc26" is_pre_election: true
I20260709 13:02:46.636332 10825 raft_consensus.cc:3060] T bf181cd133ed4b8d8b3cbe5b36b23316 P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.637259 10773 raft_consensus.cc:2468] T bf181cd133ed4b8d8b3cbe5b36b23316 P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d895d0e90a3b45ed9aed3af8222a9b5d in term 0.
I20260709 13:02:46.647692 10825 raft_consensus.cc:515] T bf181cd133ed4b8d8b3cbe5b36b23316 P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.658192 10624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf181cd133ed4b8d8b3cbe5b36b23316" candidate_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66abd7e8893940bdbe81d60bffc91261"
I20260709 13:02:46.658825 10624 raft_consensus.cc:3060] T bf181cd133ed4b8d8b3cbe5b36b23316 P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.662797 10699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020e5de5fe4f481ba994779ae752696c" candidate_uuid: "305b05bc72f04d769644fbff5188bc26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d"
I20260709 13:02:46.663798 10699 raft_consensus.cc:3060] T 020e5de5fe4f481ba994779ae752696c P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.669134 10624 raft_consensus.cc:2468] T bf181cd133ed4b8d8b3cbe5b36b23316 P 66abd7e8893940bdbe81d60bffc91261 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d895d0e90a3b45ed9aed3af8222a9b5d in term 1.
I20260709 13:02:46.671129 10663 leader_election.cc:304] T bf181cd133ed4b8d8b3cbe5b36b23316 P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66abd7e8893940bdbe81d60bffc91261, d895d0e90a3b45ed9aed3af8222a9b5d; no voters: 
I20260709 13:02:46.676354 10773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf181cd133ed4b8d8b3cbe5b36b23316" candidate_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "305b05bc72f04d769644fbff5188bc26"
I20260709 13:02:46.677567 10773 raft_consensus.cc:3060] T bf181cd133ed4b8d8b3cbe5b36b23316 P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.676956 10825 leader_election.cc:290] T bf181cd133ed4b8d8b3cbe5b36b23316 P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 1 election: Requested vote from peers 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009), 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947)
I20260709 13:02:46.678875 10825 raft_consensus.cc:2804] T bf181cd133ed4b8d8b3cbe5b36b23316 P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:46.680361 10825 raft_consensus.cc:697] T bf181cd133ed4b8d8b3cbe5b36b23316 P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 LEADER]: Becoming Leader. State: Replica: d895d0e90a3b45ed9aed3af8222a9b5d, State: Running, Role: LEADER
I20260709 13:02:46.682430 10825 consensus_queue.cc:237] T bf181cd133ed4b8d8b3cbe5b36b23316 P d895d0e90a3b45ed9aed3af8222a9b5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.694566 10814 tablet_bootstrap.cc:492] T e23dd32048434889a42ea8dc88626ed3 P 305b05bc72f04d769644fbff5188bc26: No bootstrap required, opened a new log
I20260709 13:02:46.694716 10818 raft_consensus.cc:2749] T ddaf52c482884428ab1694c903f54cd8 P 66abd7e8893940bdbe81d60bffc91261 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:46.695238 10814 ts_tablet_manager.cc:1403] T e23dd32048434889a42ea8dc88626ed3 P 305b05bc72f04d769644fbff5188bc26: Time spent bootstrapping tablet: real 0.167s	user 0.080s	sys 0.078s
I20260709 13:02:46.696553 10622 raft_consensus.cc:2468] T b5719c2d308646c28e9b2297f7d3becd P 66abd7e8893940bdbe81d60bffc91261 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d895d0e90a3b45ed9aed3af8222a9b5d in term 1.
I20260709 13:02:46.698015 10663 leader_election.cc:304] T b5719c2d308646c28e9b2297f7d3becd P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66abd7e8893940bdbe81d60bffc91261, d895d0e90a3b45ed9aed3af8222a9b5d; no voters: 
I20260709 13:02:46.698938 10814 raft_consensus.cc:359] T e23dd32048434889a42ea8dc88626ed3 P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.699951 10814 raft_consensus.cc:385] T e23dd32048434889a42ea8dc88626ed3 P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.700316 10814 raft_consensus.cc:740] T e23dd32048434889a42ea8dc88626ed3 P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 305b05bc72f04d769644fbff5188bc26, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.701376 10814 consensus_queue.cc:260] T e23dd32048434889a42ea8dc88626ed3 P 305b05bc72f04d769644fbff5188bc26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.703545 10814 ts_tablet_manager.cc:1434] T e23dd32048434889a42ea8dc88626ed3 P 305b05bc72f04d769644fbff5188bc26: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:02:46.704739 10829 leader_election.cc:290] T 020e5de5fe4f481ba994779ae752696c P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 1 election: Requested vote from peers 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009), d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683)
I20260709 13:02:46.709486 10772 raft_consensus.cc:2468] T b5719c2d308646c28e9b2297f7d3becd P 305b05bc72f04d769644fbff5188bc26 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d895d0e90a3b45ed9aed3af8222a9b5d in term 1.
I20260709 13:02:46.713146 10859 raft_consensus.cc:2804] T b5719c2d308646c28e9b2297f7d3becd P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:46.713712 10859 raft_consensus.cc:697] T b5719c2d308646c28e9b2297f7d3becd P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 LEADER]: Becoming Leader. State: Replica: d895d0e90a3b45ed9aed3af8222a9b5d, State: Running, Role: LEADER
I20260709 13:02:46.714560 10859 consensus_queue.cc:237] T b5719c2d308646c28e9b2297f7d3becd P d895d0e90a3b45ed9aed3af8222a9b5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.715409 10699 raft_consensus.cc:2468] T 020e5de5fe4f481ba994779ae752696c P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 305b05bc72f04d769644fbff5188bc26 in term 1.
I20260709 13:02:46.716818 10819 consensus_queue.cc:1048] T c7a40faf0455492eb35f727fc91e9fab P 305b05bc72f04d769644fbff5188bc26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:46.710084 10817 raft_consensus.cc:515] T 0edc1ee1d1aa48b38e4df79d771249ad P 305b05bc72f04d769644fbff5188bc26 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.719352 10817 leader_election.cc:290] T 0edc1ee1d1aa48b38e4df79d771249ad P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 1 election: Requested vote from peers 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009), d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683)
I20260709 13:02:46.719787 10820 ts_tablet_manager.cc:1434] T bf181cd133ed4b8d8b3cbe5b36b23316 P d895d0e90a3b45ed9aed3af8222a9b5d: Time spent starting tablet: real 0.192s	user 0.085s	sys 0.092s
I20260709 13:02:46.720920 10737 leader_election.cc:304] T 020e5de5fe4f481ba994779ae752696c P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 305b05bc72f04d769644fbff5188bc26, d895d0e90a3b45ed9aed3af8222a9b5d; no voters: 
I20260709 13:02:46.721271 10820 tablet_bootstrap.cc:492] T bd8914371e234fd89180b58dd299e334 P d895d0e90a3b45ed9aed3af8222a9b5d: Bootstrap starting.
I20260709 13:02:46.721840 10817 raft_consensus.cc:2804] T 020e5de5fe4f481ba994779ae752696c P 305b05bc72f04d769644fbff5188bc26 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:46.722747 10817 raft_consensus.cc:697] T 020e5de5fe4f481ba994779ae752696c P 305b05bc72f04d769644fbff5188bc26 [term 1 LEADER]: Becoming Leader. State: Replica: 305b05bc72f04d769644fbff5188bc26, State: Running, Role: LEADER
I20260709 13:02:46.723872 10698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edc1ee1d1aa48b38e4df79d771249ad" candidate_uuid: "305b05bc72f04d769644fbff5188bc26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d"
I20260709 13:02:46.724596 10698 raft_consensus.cc:3060] T 0edc1ee1d1aa48b38e4df79d771249ad P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.727938 10820 tablet_bootstrap.cc:654] T bd8914371e234fd89180b58dd299e334 P d895d0e90a3b45ed9aed3af8222a9b5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:46.724594 10623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edc1ee1d1aa48b38e4df79d771249ad" candidate_uuid: "305b05bc72f04d769644fbff5188bc26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66abd7e8893940bdbe81d60bffc91261"
I20260709 13:02:46.734989 10773 raft_consensus.cc:2468] T bf181cd133ed4b8d8b3cbe5b36b23316 P 305b05bc72f04d769644fbff5188bc26 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d895d0e90a3b45ed9aed3af8222a9b5d in term 1.
I20260709 13:02:46.723934 10817 consensus_queue.cc:237] T 020e5de5fe4f481ba994779ae752696c P 305b05bc72f04d769644fbff5188bc26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.741143 10623 raft_consensus.cc:3060] T 0edc1ee1d1aa48b38e4df79d771249ad P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.746373 10520 catalog_manager.cc:5697] T bf181cd133ed4b8d8b3cbe5b36b23316 P d895d0e90a3b45ed9aed3af8222a9b5d reported cstate change: term changed from 0 to 1, leader changed from <none> to d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194). New cstate: current_term: 1 leader_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:46.747189 10621 raft_consensus.cc:2468] T 020e5de5fe4f481ba994779ae752696c P 66abd7e8893940bdbe81d60bffc91261 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 305b05bc72f04d769644fbff5188bc26 in term 1.
I20260709 13:02:46.750641 10698 raft_consensus.cc:2468] T 0edc1ee1d1aa48b38e4df79d771249ad P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 305b05bc72f04d769644fbff5188bc26 in term 1.
I20260709 13:02:46.753080 10737 leader_election.cc:304] T 0edc1ee1d1aa48b38e4df79d771249ad P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 305b05bc72f04d769644fbff5188bc26, d895d0e90a3b45ed9aed3af8222a9b5d; no voters: 
I20260709 13:02:46.753968 10829 raft_consensus.cc:2804] T 0edc1ee1d1aa48b38e4df79d771249ad P 305b05bc72f04d769644fbff5188bc26 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:46.754752 10829 raft_consensus.cc:697] T 0edc1ee1d1aa48b38e4df79d771249ad P 305b05bc72f04d769644fbff5188bc26 [term 1 LEADER]: Becoming Leader. State: Replica: 305b05bc72f04d769644fbff5188bc26, State: Running, Role: LEADER
I20260709 13:02:46.755568 10829 consensus_queue.cc:237] T 0edc1ee1d1aa48b38e4df79d771249ad P 305b05bc72f04d769644fbff5188bc26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.758687 10623 raft_consensus.cc:2468] T 0edc1ee1d1aa48b38e4df79d771249ad P 66abd7e8893940bdbe81d60bffc91261 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 305b05bc72f04d769644fbff5188bc26 in term 1.
I20260709 13:02:46.764287 10820 tablet_bootstrap.cc:492] T bd8914371e234fd89180b58dd299e334 P d895d0e90a3b45ed9aed3af8222a9b5d: No bootstrap required, opened a new log
I20260709 13:02:46.764886 10820 ts_tablet_manager.cc:1403] T bd8914371e234fd89180b58dd299e334 P d895d0e90a3b45ed9aed3af8222a9b5d: Time spent bootstrapping tablet: real 0.044s	user 0.009s	sys 0.005s
I20260709 13:02:46.772276 10520 catalog_manager.cc:5697] T b5719c2d308646c28e9b2297f7d3becd P d895d0e90a3b45ed9aed3af8222a9b5d reported cstate change: term changed from 0 to 1, leader changed from <none> to d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194). New cstate: current_term: 1 leader_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:46.774644 10820 raft_consensus.cc:359] T bd8914371e234fd89180b58dd299e334 P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.775733 10820 raft_consensus.cc:385] T bd8914371e234fd89180b58dd299e334 P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:46.778589 10820 raft_consensus.cc:740] T bd8914371e234fd89180b58dd299e334 P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d895d0e90a3b45ed9aed3af8222a9b5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:46.779210 10820 consensus_queue.cc:260] T bd8914371e234fd89180b58dd299e334 P d895d0e90a3b45ed9aed3af8222a9b5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.780846 10820 ts_tablet_manager.cc:1434] T bd8914371e234fd89180b58dd299e334 P d895d0e90a3b45ed9aed3af8222a9b5d: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 13:02:46.782603 10773 raft_consensus.cc:3060] T e23dd32048434889a42ea8dc88626ed3 P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.782459 10521 catalog_manager.cc:5697] T 020e5de5fe4f481ba994779ae752696c P 305b05bc72f04d769644fbff5188bc26 reported cstate change: term changed from 0 to 1, leader changed from <none> to 305b05bc72f04d769644fbff5188bc26 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "305b05bc72f04d769644fbff5188bc26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:46.790426 10818 consensus_queue.cc:1048] T e23dd32048434889a42ea8dc88626ed3 P 66abd7e8893940bdbe81d60bffc91261 [LEADER]: Connected to new peer: Peer: permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:46.802146 10841 consensus_queue.cc:1048] T e23dd32048434889a42ea8dc88626ed3 P 66abd7e8893940bdbe81d60bffc91261 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:46.805608 10520 catalog_manager.cc:5697] T 0edc1ee1d1aa48b38e4df79d771249ad P 305b05bc72f04d769644fbff5188bc26 reported cstate change: term changed from 0 to 1, leader changed from <none> to 305b05bc72f04d769644fbff5188bc26 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "305b05bc72f04d769644fbff5188bc26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:46.808130 10698 raft_consensus.cc:3060] T bd8914371e234fd89180b58dd299e334 P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:46.816313 10829 consensus_queue.cc:1048] T bd8914371e234fd89180b58dd299e334 P 305b05bc72f04d769644fbff5188bc26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:46.821164 10859 raft_consensus.cc:493] T bd8914371e234fd89180b58dd299e334 P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 305b05bc72f04d769644fbff5188bc26)
I20260709 13:02:46.821645 10859 raft_consensus.cc:515] T bd8914371e234fd89180b58dd299e334 P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.827569 10859 leader_election.cc:290] T bd8914371e234fd89180b58dd299e334 P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009), 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947)
I20260709 13:02:46.829107 10622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd8914371e234fd89180b58dd299e334" candidate_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66abd7e8893940bdbe81d60bffc91261" is_pre_election: true
I20260709 13:02:46.829211 10773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd8914371e234fd89180b58dd299e334" candidate_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "305b05bc72f04d769644fbff5188bc26" is_pre_election: true
I20260709 13:02:46.830015 10622 raft_consensus.cc:2468] T bd8914371e234fd89180b58dd299e334 P 66abd7e8893940bdbe81d60bffc91261 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d895d0e90a3b45ed9aed3af8222a9b5d in term 1.
I20260709 13:02:46.831534 10663 leader_election.cc:304] T bd8914371e234fd89180b58dd299e334 P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66abd7e8893940bdbe81d60bffc91261, d895d0e90a3b45ed9aed3af8222a9b5d; no voters: 305b05bc72f04d769644fbff5188bc26
I20260709 13:02:46.832327 10859 raft_consensus.cc:2804] T bd8914371e234fd89180b58dd299e334 P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:02:46.832746 10859 raft_consensus.cc:493] T bd8914371e234fd89180b58dd299e334 P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 305b05bc72f04d769644fbff5188bc26)
I20260709 13:02:46.833246 10859 raft_consensus.cc:3060] T bd8914371e234fd89180b58dd299e334 P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:46.833854 10819 consensus_queue.cc:1048] T bd8914371e234fd89180b58dd299e334 P 305b05bc72f04d769644fbff5188bc26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:46.843267 10859 raft_consensus.cc:515] T bd8914371e234fd89180b58dd299e334 P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:46.846467 10622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd8914371e234fd89180b58dd299e334" candidate_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66abd7e8893940bdbe81d60bffc91261"
I20260709 13:02:46.847225 10773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd8914371e234fd89180b58dd299e334" candidate_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "305b05bc72f04d769644fbff5188bc26"
I20260709 13:02:46.848791 10859 leader_election.cc:290] T bd8914371e234fd89180b58dd299e334 P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 2 election: Requested vote from peers 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009), 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947)
I20260709 13:02:46.848856 10665 leader_election.cc:304] T bd8914371e234fd89180b58dd299e334 P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d895d0e90a3b45ed9aed3af8222a9b5d; no voters: 305b05bc72f04d769644fbff5188bc26, 66abd7e8893940bdbe81d60bffc91261
I20260709 13:02:46.850055 10859 raft_consensus.cc:2749] T bd8914371e234fd89180b58dd299e334 P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:02:46.900298 10817 consensus_queue.cc:1048] T ddaf52c482884428ab1694c903f54cd8 P 305b05bc72f04d769644fbff5188bc26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:46.913233 10829 consensus_queue.cc:1048] T ddaf52c482884428ab1694c903f54cd8 P 305b05bc72f04d769644fbff5188bc26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:46.932344 10698 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf181cd133ed4b8d8b3cbe5b36b23316"
dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d"
mode: GRACEFUL
new_leader_uuid: "66abd7e8893940bdbe81d60bffc91261"
 from {username='slave'} at 127.0.0.1:38968
I20260709 13:02:46.933064 10698 raft_consensus.cc:606] T bf181cd133ed4b8d8b3cbe5b36b23316 P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 LEADER]: Received request to transfer leadership to TS 66abd7e8893940bdbe81d60bffc91261
I20260709 13:02:46.948817 10773 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7a40faf0455492eb35f727fc91e9fab"
dest_uuid: "305b05bc72f04d769644fbff5188bc26"
mode: GRACEFUL
new_leader_uuid: "66abd7e8893940bdbe81d60bffc91261"
 from {username='slave'} at 127.0.0.1:59754
I20260709 13:02:46.949433 10773 raft_consensus.cc:606] T c7a40faf0455492eb35f727fc91e9fab P 305b05bc72f04d769644fbff5188bc26 [term 1 LEADER]: Received request to transfer leadership to TS 66abd7e8893940bdbe81d60bffc91261
I20260709 13:02:46.955206 10698 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b5719c2d308646c28e9b2297f7d3becd"
dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d"
mode: GRACEFUL
new_leader_uuid: "66abd7e8893940bdbe81d60bffc91261"
 from {username='slave'} at 127.0.0.1:38968
I20260709 13:02:46.955915 10698 raft_consensus.cc:606] T b5719c2d308646c28e9b2297f7d3becd P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 LEADER]: Received request to transfer leadership to TS 66abd7e8893940bdbe81d60bffc91261
I20260709 13:02:46.957350 10841 consensus_queue.cc:1048] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 66abd7e8893940bdbe81d60bffc91261 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:46.962065 10773 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "020e5de5fe4f481ba994779ae752696c"
dest_uuid: "305b05bc72f04d769644fbff5188bc26"
mode: GRACEFUL
new_leader_uuid: "66abd7e8893940bdbe81d60bffc91261"
 from {username='slave'} at 127.0.0.1:59754
I20260709 13:02:46.962790 10773 raft_consensus.cc:606] T 020e5de5fe4f481ba994779ae752696c P 305b05bc72f04d769644fbff5188bc26 [term 1 LEADER]: Received request to transfer leadership to TS 66abd7e8893940bdbe81d60bffc91261
I20260709 13:02:46.969771 10844 consensus_queue.cc:1048] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 66abd7e8893940bdbe81d60bffc91261 [LEADER]: Connected to new peer: Peer: permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:46.987182 10622 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e23dd32048434889a42ea8dc88626ed3"
dest_uuid: "66abd7e8893940bdbe81d60bffc91261"
mode: GRACEFUL
new_leader_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d"
 from {username='slave'} at 127.0.0.1:34362
I20260709 13:02:46.987895 10622 raft_consensus.cc:606] T e23dd32048434889a42ea8dc88626ed3 P 66abd7e8893940bdbe81d60bffc91261 [term 1 LEADER]: Received request to transfer leadership to TS d895d0e90a3b45ed9aed3af8222a9b5d
I20260709 13:02:46.994274 10773 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0edc1ee1d1aa48b38e4df79d771249ad"
dest_uuid: "305b05bc72f04d769644fbff5188bc26"
mode: GRACEFUL
new_leader_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d"
 from {username='slave'} at 127.0.0.1:59754
I20260709 13:02:46.994827 10773 raft_consensus.cc:606] T 0edc1ee1d1aa48b38e4df79d771249ad P 305b05bc72f04d769644fbff5188bc26 [term 1 LEADER]: Received request to transfer leadership to TS d895d0e90a3b45ed9aed3af8222a9b5d
I20260709 13:02:47.000806 10773 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ddaf52c482884428ab1694c903f54cd8"
dest_uuid: "305b05bc72f04d769644fbff5188bc26"
mode: GRACEFUL
new_leader_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d"
 from {username='slave'} at 127.0.0.1:59754
I20260709 13:02:47.001314 10773 raft_consensus.cc:606] T ddaf52c482884428ab1694c903f54cd8 P 305b05bc72f04d769644fbff5188bc26 [term 1 LEADER]: Received request to transfer leadership to TS d895d0e90a3b45ed9aed3af8222a9b5d
I20260709 13:02:47.007457 10773 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd8914371e234fd89180b58dd299e334"
dest_uuid: "305b05bc72f04d769644fbff5188bc26"
mode: GRACEFUL
new_leader_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d"
 from {username='slave'} at 127.0.0.1:59754
I20260709 13:02:47.008031 10773 raft_consensus.cc:606] T bd8914371e234fd89180b58dd299e334 P 305b05bc72f04d769644fbff5188bc26 [term 1 LEADER]: Received request to transfer leadership to TS d895d0e90a3b45ed9aed3af8222a9b5d
I20260709 13:02:47.014143 10622 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8eb4dc0971ed4d6183bfb9d283ad51dc"
dest_uuid: "66abd7e8893940bdbe81d60bffc91261"
mode: GRACEFUL
new_leader_uuid: "305b05bc72f04d769644fbff5188bc26"
 from {username='slave'} at 127.0.0.1:34362
I20260709 13:02:47.014818 10622 raft_consensus.cc:606] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 66abd7e8893940bdbe81d60bffc91261 [term 1 LEADER]: Received request to transfer leadership to TS 305b05bc72f04d769644fbff5188bc26
I20260709 13:02:47.093750 10859 consensus_queue.cc:1048] T bf181cd133ed4b8d8b3cbe5b36b23316 P d895d0e90a3b45ed9aed3af8222a9b5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:47.104115 10825 consensus_queue.cc:1048] T bf181cd133ed4b8d8b3cbe5b36b23316 P d895d0e90a3b45ed9aed3af8222a9b5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:47.112423 10862 raft_consensus.cc:993] T bf181cd133ed4b8d8b3cbe5b36b23316 P d895d0e90a3b45ed9aed3af8222a9b5d: : Instructing follower 66abd7e8893940bdbe81d60bffc91261 to start an election
I20260709 13:02:47.112922 10825 raft_consensus.cc:1081] T bf181cd133ed4b8d8b3cbe5b36b23316 P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 LEADER]: Signalling peer 66abd7e8893940bdbe81d60bffc91261 to start an election
I20260709 13:02:47.114379 10622 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bf181cd133ed4b8d8b3cbe5b36b23316"
dest_uuid: "66abd7e8893940bdbe81d60bffc91261"
 from {username='slave'} at 127.0.0.1:34352
I20260709 13:02:47.114935 10622 raft_consensus.cc:493] T bf181cd133ed4b8d8b3cbe5b36b23316 P 66abd7e8893940bdbe81d60bffc91261 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:47.115320 10622 raft_consensus.cc:3060] T bf181cd133ed4b8d8b3cbe5b36b23316 P 66abd7e8893940bdbe81d60bffc91261 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:47.120494 10622 raft_consensus.cc:515] T bf181cd133ed4b8d8b3cbe5b36b23316 P 66abd7e8893940bdbe81d60bffc91261 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:47.122449 10622 leader_election.cc:290] T bf181cd133ed4b8d8b3cbe5b36b23316 P 66abd7e8893940bdbe81d60bffc91261 [CANDIDATE]: Term 2 election: Requested vote from peers d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683), 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947)
I20260709 13:02:47.123185 10698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf181cd133ed4b8d8b3cbe5b36b23316" candidate_uuid: "66abd7e8893940bdbe81d60bffc91261" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d"
I20260709 13:02:47.123679 10773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf181cd133ed4b8d8b3cbe5b36b23316" candidate_uuid: "66abd7e8893940bdbe81d60bffc91261" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "305b05bc72f04d769644fbff5188bc26"
I20260709 13:02:47.123859 10698 raft_consensus.cc:3055] T bf181cd133ed4b8d8b3cbe5b36b23316 P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:47.124246 10698 raft_consensus.cc:740] T bf181cd133ed4b8d8b3cbe5b36b23316 P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d895d0e90a3b45ed9aed3af8222a9b5d, State: Running, Role: LEADER
I20260709 13:02:47.124308 10773 raft_consensus.cc:3060] T bf181cd133ed4b8d8b3cbe5b36b23316 P 305b05bc72f04d769644fbff5188bc26 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:47.125190 10698 consensus_queue.cc:260] T bf181cd133ed4b8d8b3cbe5b36b23316 P d895d0e90a3b45ed9aed3af8222a9b5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:47.126485 10698 raft_consensus.cc:3060] T bf181cd133ed4b8d8b3cbe5b36b23316 P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:47.132058 10773 raft_consensus.cc:2468] T bf181cd133ed4b8d8b3cbe5b36b23316 P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66abd7e8893940bdbe81d60bffc91261 in term 2.
I20260709 13:02:47.133715 10590 leader_election.cc:304] T bf181cd133ed4b8d8b3cbe5b36b23316 P 66abd7e8893940bdbe81d60bffc91261 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 305b05bc72f04d769644fbff5188bc26, 66abd7e8893940bdbe81d60bffc91261; no voters: 
I20260709 13:02:47.134294 10698 raft_consensus.cc:2468] T bf181cd133ed4b8d8b3cbe5b36b23316 P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66abd7e8893940bdbe81d60bffc91261 in term 2.
I20260709 13:02:47.135957 10844 raft_consensus.cc:2804] T bf181cd133ed4b8d8b3cbe5b36b23316 P 66abd7e8893940bdbe81d60bffc91261 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:47.136631 10844 raft_consensus.cc:697] T bf181cd133ed4b8d8b3cbe5b36b23316 P 66abd7e8893940bdbe81d60bffc91261 [term 2 LEADER]: Becoming Leader. State: Replica: 66abd7e8893940bdbe81d60bffc91261, State: Running, Role: LEADER
I20260709 13:02:47.137434 10844 consensus_queue.cc:237] T bf181cd133ed4b8d8b3cbe5b36b23316 P 66abd7e8893940bdbe81d60bffc91261 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:47.144145 10522 catalog_manager.cc:5697] T bf181cd133ed4b8d8b3cbe5b36b23316 P 66abd7e8893940bdbe81d60bffc91261 reported cstate change: term changed from 1 to 2, leader changed from d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194) to 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "66abd7e8893940bdbe81d60bffc91261" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:47.176860 10817 raft_consensus.cc:993] T c7a40faf0455492eb35f727fc91e9fab P 305b05bc72f04d769644fbff5188bc26: : Instructing follower 66abd7e8893940bdbe81d60bffc91261 to start an election
I20260709 13:02:47.177354 10817 raft_consensus.cc:1081] T c7a40faf0455492eb35f727fc91e9fab P 305b05bc72f04d769644fbff5188bc26 [term 1 LEADER]: Signalling peer 66abd7e8893940bdbe81d60bffc91261 to start an election
I20260709 13:02:47.178995 10622 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c7a40faf0455492eb35f727fc91e9fab"
dest_uuid: "66abd7e8893940bdbe81d60bffc91261"
 from {username='slave'} at 127.0.0.1:34348
I20260709 13:02:47.179502 10622 raft_consensus.cc:493] T c7a40faf0455492eb35f727fc91e9fab P 66abd7e8893940bdbe81d60bffc91261 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:47.179816 10622 raft_consensus.cc:3060] T c7a40faf0455492eb35f727fc91e9fab P 66abd7e8893940bdbe81d60bffc91261 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:47.185137 10622 raft_consensus.cc:515] T c7a40faf0455492eb35f727fc91e9fab P 66abd7e8893940bdbe81d60bffc91261 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:47.186921 10622 leader_election.cc:290] T c7a40faf0455492eb35f727fc91e9fab P 66abd7e8893940bdbe81d60bffc91261 [CANDIDATE]: Term 2 election: Requested vote from peers d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683), 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947)
I20260709 13:02:47.188060 10773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7a40faf0455492eb35f727fc91e9fab" candidate_uuid: "66abd7e8893940bdbe81d60bffc91261" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "305b05bc72f04d769644fbff5188bc26"
I20260709 13:02:47.188002 10698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7a40faf0455492eb35f727fc91e9fab" candidate_uuid: "66abd7e8893940bdbe81d60bffc91261" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d"
I20260709 13:02:47.189069 10773 raft_consensus.cc:3055] T c7a40faf0455492eb35f727fc91e9fab P 305b05bc72f04d769644fbff5188bc26 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:47.189101 10698 raft_consensus.cc:3060] T c7a40faf0455492eb35f727fc91e9fab P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:47.189716 10773 raft_consensus.cc:740] T c7a40faf0455492eb35f727fc91e9fab P 305b05bc72f04d769644fbff5188bc26 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 305b05bc72f04d769644fbff5188bc26, State: Running, Role: LEADER
I20260709 13:02:47.190675 10773 consensus_queue.cc:260] T c7a40faf0455492eb35f727fc91e9fab P 305b05bc72f04d769644fbff5188bc26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:47.192071 10773 raft_consensus.cc:3060] T c7a40faf0455492eb35f727fc91e9fab P 305b05bc72f04d769644fbff5188bc26 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:47.195425 10825 consensus_queue.cc:1048] T b5719c2d308646c28e9b2297f7d3becd P d895d0e90a3b45ed9aed3af8222a9b5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:47.200101 10698 raft_consensus.cc:2468] T c7a40faf0455492eb35f727fc91e9fab P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66abd7e8893940bdbe81d60bffc91261 in term 2.
I20260709 13:02:47.200699 10773 raft_consensus.cc:2468] T c7a40faf0455492eb35f727fc91e9fab P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66abd7e8893940bdbe81d60bffc91261 in term 2.
I20260709 13:02:47.201838 10588 leader_election.cc:304] T c7a40faf0455492eb35f727fc91e9fab P 66abd7e8893940bdbe81d60bffc91261 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66abd7e8893940bdbe81d60bffc91261, d895d0e90a3b45ed9aed3af8222a9b5d; no voters: 
I20260709 13:02:47.203531 10844 raft_consensus.cc:2804] T c7a40faf0455492eb35f727fc91e9fab P 66abd7e8893940bdbe81d60bffc91261 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:47.203682 10817 consensus_queue.cc:1048] T 0edc1ee1d1aa48b38e4df79d771249ad P 305b05bc72f04d769644fbff5188bc26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:47.204175 10844 raft_consensus.cc:697] T c7a40faf0455492eb35f727fc91e9fab P 66abd7e8893940bdbe81d60bffc91261 [term 2 LEADER]: Becoming Leader. State: Replica: 66abd7e8893940bdbe81d60bffc91261, State: Running, Role: LEADER
I20260709 13:02:47.206764 10844 consensus_queue.cc:237] T c7a40faf0455492eb35f727fc91e9fab P 66abd7e8893940bdbe81d60bffc91261 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:47.211078 10862 raft_consensus.cc:993] T b5719c2d308646c28e9b2297f7d3becd P d895d0e90a3b45ed9aed3af8222a9b5d: : Instructing follower 66abd7e8893940bdbe81d60bffc91261 to start an election
I20260709 13:02:47.211669 10862 raft_consensus.cc:1081] T b5719c2d308646c28e9b2297f7d3becd P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 LEADER]: Signalling peer 66abd7e8893940bdbe81d60bffc91261 to start an election
I20260709 13:02:47.214540 10623 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b5719c2d308646c28e9b2297f7d3becd"
dest_uuid: "66abd7e8893940bdbe81d60bffc91261"
 from {username='slave'} at 127.0.0.1:34352
I20260709 13:02:47.216775 10623 raft_consensus.cc:493] T b5719c2d308646c28e9b2297f7d3becd P 66abd7e8893940bdbe81d60bffc91261 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:47.217290 10623 raft_consensus.cc:3060] T b5719c2d308646c28e9b2297f7d3becd P 66abd7e8893940bdbe81d60bffc91261 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:47.225728 10844 raft_consensus.cc:993] T e23dd32048434889a42ea8dc88626ed3 P 66abd7e8893940bdbe81d60bffc91261: : Instructing follower d895d0e90a3b45ed9aed3af8222a9b5d to start an election
I20260709 13:02:47.226480 10818 raft_consensus.cc:1081] T e23dd32048434889a42ea8dc88626ed3 P 66abd7e8893940bdbe81d60bffc91261 [term 1 LEADER]: Signalling peer d895d0e90a3b45ed9aed3af8222a9b5d to start an election
I20260709 13:02:47.225998 10817 consensus_queue.cc:1048] T 0edc1ee1d1aa48b38e4df79d771249ad P 305b05bc72f04d769644fbff5188bc26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:47.225912 10623 raft_consensus.cc:515] T b5719c2d308646c28e9b2297f7d3becd P 66abd7e8893940bdbe81d60bffc91261 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:47.229012 10698 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e23dd32048434889a42ea8dc88626ed3"
dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d"
 from {username='slave'} at 127.0.0.1:38954
I20260709 13:02:47.229732 10698 raft_consensus.cc:493] T e23dd32048434889a42ea8dc88626ed3 P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:47.230183 10698 raft_consensus.cc:3060] T e23dd32048434889a42ea8dc88626ed3 P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:47.232884 10862 consensus_queue.cc:1048] T b5719c2d308646c28e9b2297f7d3becd P d895d0e90a3b45ed9aed3af8222a9b5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:47.233750 10773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5719c2d308646c28e9b2297f7d3becd" candidate_uuid: "66abd7e8893940bdbe81d60bffc91261" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "305b05bc72f04d769644fbff5188bc26"
I20260709 13:02:47.234474 10773 raft_consensus.cc:3060] T b5719c2d308646c28e9b2297f7d3becd P 305b05bc72f04d769644fbff5188bc26 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:47.238127 10522 catalog_manager.cc:5697] T c7a40faf0455492eb35f727fc91e9fab P 66abd7e8893940bdbe81d60bffc91261 reported cstate change: term changed from 1 to 2, leader changed from 305b05bc72f04d769644fbff5188bc26 (127.0.107.195) to 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "66abd7e8893940bdbe81d60bffc91261" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:47.240672 10697 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5719c2d308646c28e9b2297f7d3becd" candidate_uuid: "66abd7e8893940bdbe81d60bffc91261" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d"
I20260709 13:02:47.241446 10697 raft_consensus.cc:3055] T b5719c2d308646c28e9b2297f7d3becd P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:47.241820 10697 raft_consensus.cc:740] T b5719c2d308646c28e9b2297f7d3becd P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d895d0e90a3b45ed9aed3af8222a9b5d, State: Running, Role: LEADER
I20260709 13:02:47.242731 10697 consensus_queue.cc:260] T b5719c2d308646c28e9b2297f7d3becd P d895d0e90a3b45ed9aed3af8222a9b5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:47.243829 10697 raft_consensus.cc:3060] T b5719c2d308646c28e9b2297f7d3becd P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:47.245843 10773 raft_consensus.cc:2468] T b5719c2d308646c28e9b2297f7d3becd P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66abd7e8893940bdbe81d60bffc91261 in term 2.
I20260709 13:02:47.246829 10772 raft_consensus.cc:1240] T b5719c2d308646c28e9b2297f7d3becd P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Rejecting Update request from peer d895d0e90a3b45ed9aed3af8222a9b5d for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:02:47.241458 10623 leader_election.cc:290] T b5719c2d308646c28e9b2297f7d3becd P 66abd7e8893940bdbe81d60bffc91261 [CANDIDATE]: Term 2 election: Requested vote from peers d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683), 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947)
I20260709 13:02:47.254655 10590 leader_election.cc:304] T b5719c2d308646c28e9b2297f7d3becd P 66abd7e8893940bdbe81d60bffc91261 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 305b05bc72f04d769644fbff5188bc26, 66abd7e8893940bdbe81d60bffc91261; no voters: 
I20260709 13:02:47.259057 10818 raft_consensus.cc:2804] T b5719c2d308646c28e9b2297f7d3becd P 66abd7e8893940bdbe81d60bffc91261 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:47.259552 10818 raft_consensus.cc:697] T b5719c2d308646c28e9b2297f7d3becd P 66abd7e8893940bdbe81d60bffc91261 [term 2 LEADER]: Becoming Leader. State: Replica: 66abd7e8893940bdbe81d60bffc91261, State: Running, Role: LEADER
I20260709 13:02:47.260324 10818 consensus_queue.cc:237] T b5719c2d308646c28e9b2297f7d3becd P 66abd7e8893940bdbe81d60bffc91261 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:47.262053 10698 raft_consensus.cc:515] T e23dd32048434889a42ea8dc88626ed3 P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:47.253357 10697 raft_consensus.cc:2468] T b5719c2d308646c28e9b2297f7d3becd P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66abd7e8893940bdbe81d60bffc91261 in term 2.
I20260709 13:02:47.270774 10521 catalog_manager.cc:5697] T b5719c2d308646c28e9b2297f7d3becd P 66abd7e8893940bdbe81d60bffc91261 reported cstate change: term changed from 1 to 2, leader changed from d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194) to 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "66abd7e8893940bdbe81d60bffc91261" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:47.273710 10623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23dd32048434889a42ea8dc88626ed3" candidate_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "66abd7e8893940bdbe81d60bffc91261"
I20260709 13:02:47.274415 10623 raft_consensus.cc:3055] T e23dd32048434889a42ea8dc88626ed3 P 66abd7e8893940bdbe81d60bffc91261 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:47.274489 10819 raft_consensus.cc:993] T 0edc1ee1d1aa48b38e4df79d771249ad P 305b05bc72f04d769644fbff5188bc26: : Instructing follower d895d0e90a3b45ed9aed3af8222a9b5d to start an election
I20260709 13:02:47.274856 10623 raft_consensus.cc:740] T e23dd32048434889a42ea8dc88626ed3 P 66abd7e8893940bdbe81d60bffc91261 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 66abd7e8893940bdbe81d60bffc91261, State: Running, Role: LEADER
I20260709 13:02:47.275177 10819 raft_consensus.cc:1081] T 0edc1ee1d1aa48b38e4df79d771249ad P 305b05bc72f04d769644fbff5188bc26 [term 1 LEADER]: Signalling peer d895d0e90a3b45ed9aed3af8222a9b5d to start an election
I20260709 13:02:47.275878 10623 consensus_queue.cc:260] T e23dd32048434889a42ea8dc88626ed3 P 66abd7e8893940bdbe81d60bffc91261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:47.277304 10623 raft_consensus.cc:3060] T e23dd32048434889a42ea8dc88626ed3 P 66abd7e8893940bdbe81d60bffc91261 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:47.278738 10698 leader_election.cc:290] T e23dd32048434889a42ea8dc88626ed3 P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 2 election: Requested vote from peers 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009), 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947)
I20260709 13:02:47.285377 10623 raft_consensus.cc:2468] T e23dd32048434889a42ea8dc88626ed3 P 66abd7e8893940bdbe81d60bffc91261 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d895d0e90a3b45ed9aed3af8222a9b5d in term 2.
I20260709 13:02:47.285944 10773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e23dd32048434889a42ea8dc88626ed3" candidate_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "305b05bc72f04d769644fbff5188bc26"
I20260709 13:02:47.286865 10773 raft_consensus.cc:3060] T e23dd32048434889a42ea8dc88626ed3 P 305b05bc72f04d769644fbff5188bc26 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:47.289444 10663 leader_election.cc:304] T e23dd32048434889a42ea8dc88626ed3 P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66abd7e8893940bdbe81d60bffc91261, d895d0e90a3b45ed9aed3af8222a9b5d; no voters: 
I20260709 13:02:47.290416 10862 raft_consensus.cc:2804] T e23dd32048434889a42ea8dc88626ed3 P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:47.291082 10862 raft_consensus.cc:697] T e23dd32048434889a42ea8dc88626ed3 P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 LEADER]: Becoming Leader. State: Replica: d895d0e90a3b45ed9aed3af8222a9b5d, State: Running, Role: LEADER
I20260709 13:02:47.293469 10699 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0edc1ee1d1aa48b38e4df79d771249ad"
dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d"
 from {username='slave'} at 127.0.0.1:38940
I20260709 13:02:47.294273 10699 raft_consensus.cc:493] T 0edc1ee1d1aa48b38e4df79d771249ad P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:47.294698 10699 raft_consensus.cc:3060] T 0edc1ee1d1aa48b38e4df79d771249ad P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:47.293455 10862 consensus_queue.cc:237] T e23dd32048434889a42ea8dc88626ed3 P d895d0e90a3b45ed9aed3af8222a9b5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:47.296011 10773 raft_consensus.cc:2468] T e23dd32048434889a42ea8dc88626ed3 P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d895d0e90a3b45ed9aed3af8222a9b5d in term 2.
I20260709 13:02:47.301451 10699 raft_consensus.cc:515] T 0edc1ee1d1aa48b38e4df79d771249ad P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:47.303383 10699 leader_election.cc:290] T 0edc1ee1d1aa48b38e4df79d771249ad P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 2 election: Requested vote from peers 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009), 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947)
I20260709 13:02:47.304306 10623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edc1ee1d1aa48b38e4df79d771249ad" candidate_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "66abd7e8893940bdbe81d60bffc91261"
I20260709 13:02:47.304484 10773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edc1ee1d1aa48b38e4df79d771249ad" candidate_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "305b05bc72f04d769644fbff5188bc26"
I20260709 13:02:47.304920 10623 raft_consensus.cc:3060] T 0edc1ee1d1aa48b38e4df79d771249ad P 66abd7e8893940bdbe81d60bffc91261 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:47.305243 10773 raft_consensus.cc:3055] T 0edc1ee1d1aa48b38e4df79d771249ad P 305b05bc72f04d769644fbff5188bc26 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:47.305635 10773 raft_consensus.cc:740] T 0edc1ee1d1aa48b38e4df79d771249ad P 305b05bc72f04d769644fbff5188bc26 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 305b05bc72f04d769644fbff5188bc26, State: Running, Role: LEADER
I20260709 13:02:47.306541 10773 consensus_queue.cc:260] T 0edc1ee1d1aa48b38e4df79d771249ad P 305b05bc72f04d769644fbff5188bc26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:47.308010 10773 raft_consensus.cc:3060] T 0edc1ee1d1aa48b38e4df79d771249ad P 305b05bc72f04d769644fbff5188bc26 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:47.309011 10521 catalog_manager.cc:5697] T e23dd32048434889a42ea8dc88626ed3 P d895d0e90a3b45ed9aed3af8222a9b5d reported cstate change: term changed from 1 to 2, leader changed from 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193) to d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194). New cstate: current_term: 2 leader_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:47.310261 10623 raft_consensus.cc:2468] T 0edc1ee1d1aa48b38e4df79d771249ad P 66abd7e8893940bdbe81d60bffc91261 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d895d0e90a3b45ed9aed3af8222a9b5d in term 2.
I20260709 13:02:47.311424 10663 leader_election.cc:304] T 0edc1ee1d1aa48b38e4df79d771249ad P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66abd7e8893940bdbe81d60bffc91261, d895d0e90a3b45ed9aed3af8222a9b5d; no voters: 
I20260709 13:02:47.312139 10862 raft_consensus.cc:2804] T 0edc1ee1d1aa48b38e4df79d771249ad P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:47.312616 10862 raft_consensus.cc:697] T 0edc1ee1d1aa48b38e4df79d771249ad P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 LEADER]: Becoming Leader. State: Replica: d895d0e90a3b45ed9aed3af8222a9b5d, State: Running, Role: LEADER
I20260709 13:02:47.313313 10862 consensus_queue.cc:237] T 0edc1ee1d1aa48b38e4df79d771249ad P d895d0e90a3b45ed9aed3af8222a9b5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:47.315541 10773 raft_consensus.cc:2468] T 0edc1ee1d1aa48b38e4df79d771249ad P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d895d0e90a3b45ed9aed3af8222a9b5d in term 2.
I20260709 13:02:47.317421 10817 consensus_queue.cc:1048] T 020e5de5fe4f481ba994779ae752696c P 305b05bc72f04d769644fbff5188bc26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:47.324928 10829 raft_consensus.cc:993] T 020e5de5fe4f481ba994779ae752696c P 305b05bc72f04d769644fbff5188bc26: : Instructing follower 66abd7e8893940bdbe81d60bffc91261 to start an election
I20260709 13:02:47.325423 10829 raft_consensus.cc:1081] T 020e5de5fe4f481ba994779ae752696c P 305b05bc72f04d769644fbff5188bc26 [term 1 LEADER]: Signalling peer 66abd7e8893940bdbe81d60bffc91261 to start an election
I20260709 13:02:47.325213 10521 catalog_manager.cc:5697] T 0edc1ee1d1aa48b38e4df79d771249ad P d895d0e90a3b45ed9aed3af8222a9b5d reported cstate change: term changed from 1 to 2, leader changed from 305b05bc72f04d769644fbff5188bc26 (127.0.107.195) to d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194). New cstate: current_term: 2 leader_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:47.327668 10621 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "020e5de5fe4f481ba994779ae752696c"
dest_uuid: "66abd7e8893940bdbe81d60bffc91261"
 from {username='slave'} at 127.0.0.1:34348
I20260709 13:02:47.328917 10621 raft_consensus.cc:493] T 020e5de5fe4f481ba994779ae752696c P 66abd7e8893940bdbe81d60bffc91261 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:47.329279 10621 raft_consensus.cc:3060] T 020e5de5fe4f481ba994779ae752696c P 66abd7e8893940bdbe81d60bffc91261 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:47.336735 10621 raft_consensus.cc:515] T 020e5de5fe4f481ba994779ae752696c P 66abd7e8893940bdbe81d60bffc91261 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:47.341262 10817 consensus_queue.cc:1048] T 020e5de5fe4f481ba994779ae752696c P 305b05bc72f04d769644fbff5188bc26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:47.343262 10773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020e5de5fe4f481ba994779ae752696c" candidate_uuid: "66abd7e8893940bdbe81d60bffc91261" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "305b05bc72f04d769644fbff5188bc26"
I20260709 13:02:47.343549 10699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020e5de5fe4f481ba994779ae752696c" candidate_uuid: "66abd7e8893940bdbe81d60bffc91261" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d"
I20260709 13:02:47.344130 10773 raft_consensus.cc:3055] T 020e5de5fe4f481ba994779ae752696c P 305b05bc72f04d769644fbff5188bc26 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:47.344645 10773 raft_consensus.cc:740] T 020e5de5fe4f481ba994779ae752696c P 305b05bc72f04d769644fbff5188bc26 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 305b05bc72f04d769644fbff5188bc26, State: Running, Role: LEADER
I20260709 13:02:47.344986 10621 leader_election.cc:290] T 020e5de5fe4f481ba994779ae752696c P 66abd7e8893940bdbe81d60bffc91261 [CANDIDATE]: Term 2 election: Requested vote from peers d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683), 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947)
I20260709 13:02:47.345657 10773 consensus_queue.cc:260] T 020e5de5fe4f481ba994779ae752696c P 305b05bc72f04d769644fbff5188bc26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:47.346930 10773 raft_consensus.cc:3060] T 020e5de5fe4f481ba994779ae752696c P 305b05bc72f04d769644fbff5188bc26 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:47.354750 10773 raft_consensus.cc:2468] T 020e5de5fe4f481ba994779ae752696c P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66abd7e8893940bdbe81d60bffc91261 in term 2.
I20260709 13:02:47.356099 10590 leader_election.cc:304] T 020e5de5fe4f481ba994779ae752696c P 66abd7e8893940bdbe81d60bffc91261 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 305b05bc72f04d769644fbff5188bc26, 66abd7e8893940bdbe81d60bffc91261; no voters: d895d0e90a3b45ed9aed3af8222a9b5d
I20260709 13:02:47.356887 10844 raft_consensus.cc:2804] T 020e5de5fe4f481ba994779ae752696c P 66abd7e8893940bdbe81d60bffc91261 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:47.357453 10844 raft_consensus.cc:697] T 020e5de5fe4f481ba994779ae752696c P 66abd7e8893940bdbe81d60bffc91261 [term 2 LEADER]: Becoming Leader. State: Replica: 66abd7e8893940bdbe81d60bffc91261, State: Running, Role: LEADER
I20260709 13:02:47.358302 10844 consensus_queue.cc:237] T 020e5de5fe4f481ba994779ae752696c P 66abd7e8893940bdbe81d60bffc91261 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:47.366204 10521 catalog_manager.cc:5697] T 020e5de5fe4f481ba994779ae752696c P 66abd7e8893940bdbe81d60bffc91261 reported cstate change: term changed from 1 to 2, leader changed from 305b05bc72f04d769644fbff5188bc26 (127.0.107.195) to 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "66abd7e8893940bdbe81d60bffc91261" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:47.422497 10698 raft_consensus.cc:1240] T bd8914371e234fd89180b58dd299e334 P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Rejecting Update request from peer 305b05bc72f04d769644fbff5188bc26 for earlier term 1. Current term is 2. Ops: []
I20260709 13:02:47.423949 10817 consensus_queue.cc:1059] T bd8914371e234fd89180b58dd299e334 P 305b05bc72f04d769644fbff5188bc26 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:47.424937 10819 raft_consensus.cc:3055] T bd8914371e234fd89180b58dd299e334 P 305b05bc72f04d769644fbff5188bc26 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:47.425243 10819 raft_consensus.cc:740] T bd8914371e234fd89180b58dd299e334 P 305b05bc72f04d769644fbff5188bc26 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 305b05bc72f04d769644fbff5188bc26, State: Running, Role: LEADER
I20260709 13:02:47.425963 10819 consensus_queue.cc:260] T bd8914371e234fd89180b58dd299e334 P 305b05bc72f04d769644fbff5188bc26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:47.426967 10819 raft_consensus.cc:3060] T bd8914371e234fd89180b58dd299e334 P 305b05bc72f04d769644fbff5188bc26 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:47.478392 10818 raft_consensus.cc:993] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 66abd7e8893940bdbe81d60bffc91261: : Instructing follower 305b05bc72f04d769644fbff5188bc26 to start an election
I20260709 13:02:47.479035 10844 raft_consensus.cc:1081] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 66abd7e8893940bdbe81d60bffc91261 [term 1 LEADER]: Signalling peer 305b05bc72f04d769644fbff5188bc26 to start an election
I20260709 13:02:47.480823 10773 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8eb4dc0971ed4d6183bfb9d283ad51dc"
dest_uuid: "305b05bc72f04d769644fbff5188bc26"
 from {username='slave'} at 127.0.0.1:59742
I20260709 13:02:47.481328 10773 raft_consensus.cc:493] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 305b05bc72f04d769644fbff5188bc26 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:47.481686 10773 raft_consensus.cc:3060] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 305b05bc72f04d769644fbff5188bc26 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:47.488302 10773 raft_consensus.cc:515] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:47.490242 10773 leader_election.cc:290] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 2 election: Requested vote from peers 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009), d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683)
I20260709 13:02:47.491142 10621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eb4dc0971ed4d6183bfb9d283ad51dc" candidate_uuid: "305b05bc72f04d769644fbff5188bc26" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "66abd7e8893940bdbe81d60bffc91261"
I20260709 13:02:47.491631 10698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8eb4dc0971ed4d6183bfb9d283ad51dc" candidate_uuid: "305b05bc72f04d769644fbff5188bc26" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d"
I20260709 13:02:47.491801 10621 raft_consensus.cc:3055] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 66abd7e8893940bdbe81d60bffc91261 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:47.492178 10621 raft_consensus.cc:740] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 66abd7e8893940bdbe81d60bffc91261 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 66abd7e8893940bdbe81d60bffc91261, State: Running, Role: LEADER
I20260709 13:02:47.492290 10698 raft_consensus.cc:3060] T 8eb4dc0971ed4d6183bfb9d283ad51dc P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:47.493027 10621 consensus_queue.cc:260] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 66abd7e8893940bdbe81d60bffc91261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:47.494079 10621 raft_consensus.cc:3060] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 66abd7e8893940bdbe81d60bffc91261 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:47.498579 10698 raft_consensus.cc:2468] T 8eb4dc0971ed4d6183bfb9d283ad51dc P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 305b05bc72f04d769644fbff5188bc26 in term 2.
I20260709 13:02:47.499212 10621 raft_consensus.cc:2468] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 66abd7e8893940bdbe81d60bffc91261 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 305b05bc72f04d769644fbff5188bc26 in term 2.
I20260709 13:02:47.500190 10737 leader_election.cc:304] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 305b05bc72f04d769644fbff5188bc26, d895d0e90a3b45ed9aed3af8222a9b5d; no voters: 
I20260709 13:02:47.501169 10819 raft_consensus.cc:2804] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:47.501603 10819 raft_consensus.cc:697] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 305b05bc72f04d769644fbff5188bc26 [term 2 LEADER]: Becoming Leader. State: Replica: 305b05bc72f04d769644fbff5188bc26, State: Running, Role: LEADER
I20260709 13:02:47.502331 10819 consensus_queue.cc:237] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 305b05bc72f04d769644fbff5188bc26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:47.508831 10521 catalog_manager.cc:5697] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 305b05bc72f04d769644fbff5188bc26 reported cstate change: term changed from 1 to 2, leader changed from 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193) to 305b05bc72f04d769644fbff5188bc26 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "305b05bc72f04d769644fbff5188bc26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:47.521806 10817 raft_consensus.cc:993] T ddaf52c482884428ab1694c903f54cd8 P 305b05bc72f04d769644fbff5188bc26: : Instructing follower d895d0e90a3b45ed9aed3af8222a9b5d to start an election
I20260709 13:02:47.522431 10819 raft_consensus.cc:1081] T ddaf52c482884428ab1694c903f54cd8 P 305b05bc72f04d769644fbff5188bc26 [term 1 LEADER]: Signalling peer d895d0e90a3b45ed9aed3af8222a9b5d to start an election
I20260709 13:02:47.523881 10698 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ddaf52c482884428ab1694c903f54cd8"
dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d"
 from {username='slave'} at 127.0.0.1:38940
I20260709 13:02:47.524375 10698 raft_consensus.cc:493] T ddaf52c482884428ab1694c903f54cd8 P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:47.524767 10698 raft_consensus.cc:3060] T ddaf52c482884428ab1694c903f54cd8 P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:47.530035 10698 raft_consensus.cc:515] T ddaf52c482884428ab1694c903f54cd8 P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:47.531723 10698 leader_election.cc:290] T ddaf52c482884428ab1694c903f54cd8 P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 2 election: Requested vote from peers 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009), 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947)
I20260709 13:02:47.532747 10621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaf52c482884428ab1694c903f54cd8" candidate_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "66abd7e8893940bdbe81d60bffc91261"
I20260709 13:02:47.532866 10773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddaf52c482884428ab1694c903f54cd8" candidate_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "305b05bc72f04d769644fbff5188bc26"
I20260709 13:02:47.533524 10621 raft_consensus.cc:3060] T ddaf52c482884428ab1694c903f54cd8 P 66abd7e8893940bdbe81d60bffc91261 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:47.533613 10773 raft_consensus.cc:3055] T ddaf52c482884428ab1694c903f54cd8 P 305b05bc72f04d769644fbff5188bc26 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:47.534081 10773 raft_consensus.cc:740] T ddaf52c482884428ab1694c903f54cd8 P 305b05bc72f04d769644fbff5188bc26 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 305b05bc72f04d769644fbff5188bc26, State: Running, Role: LEADER
I20260709 13:02:47.534729 10773 consensus_queue.cc:260] T ddaf52c482884428ab1694c903f54cd8 P 305b05bc72f04d769644fbff5188bc26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:47.535729 10773 raft_consensus.cc:3060] T ddaf52c482884428ab1694c903f54cd8 P 305b05bc72f04d769644fbff5188bc26 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:47.539073 10621 raft_consensus.cc:2468] T ddaf52c482884428ab1694c903f54cd8 P 66abd7e8893940bdbe81d60bffc91261 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d895d0e90a3b45ed9aed3af8222a9b5d in term 2.
I20260709 13:02:47.540228 10663 leader_election.cc:304] T ddaf52c482884428ab1694c903f54cd8 P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66abd7e8893940bdbe81d60bffc91261, d895d0e90a3b45ed9aed3af8222a9b5d; no voters: 
I20260709 13:02:47.541077 10862 raft_consensus.cc:2804] T ddaf52c482884428ab1694c903f54cd8 P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:47.541585 10773 raft_consensus.cc:2468] T ddaf52c482884428ab1694c903f54cd8 P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d895d0e90a3b45ed9aed3af8222a9b5d in term 2.
I20260709 13:02:47.541610 10862 raft_consensus.cc:697] T ddaf52c482884428ab1694c903f54cd8 P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 LEADER]: Becoming Leader. State: Replica: d895d0e90a3b45ed9aed3af8222a9b5d, State: Running, Role: LEADER
I20260709 13:02:47.542935 10698 raft_consensus.cc:1275] T bf181cd133ed4b8d8b3cbe5b36b23316 P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Refusing update from remote peer 66abd7e8893940bdbe81d60bffc91261: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:47.543008 10862 consensus_queue.cc:237] T ddaf52c482884428ab1694c903f54cd8 P d895d0e90a3b45ed9aed3af8222a9b5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:47.544617 10844 consensus_queue.cc:1048] T bf181cd133ed4b8d8b3cbe5b36b23316 P 66abd7e8893940bdbe81d60bffc91261 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:47.552564 10773 raft_consensus.cc:1275] T bf181cd133ed4b8d8b3cbe5b36b23316 P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Refusing update from remote peer 66abd7e8893940bdbe81d60bffc91261: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:47.552163 10521 catalog_manager.cc:5697] T ddaf52c482884428ab1694c903f54cd8 P d895d0e90a3b45ed9aed3af8222a9b5d reported cstate change: term changed from 1 to 2, leader changed from 305b05bc72f04d769644fbff5188bc26 (127.0.107.195) to d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194). New cstate: current_term: 2 leader_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:47.554754 10841 consensus_queue.cc:1048] T bf181cd133ed4b8d8b3cbe5b36b23316 P 66abd7e8893940bdbe81d60bffc91261 [LEADER]: Connected to new peer: Peer: permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:47.599958 10773 raft_consensus.cc:1275] T c7a40faf0455492eb35f727fc91e9fab P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Refusing update from remote peer 66abd7e8893940bdbe81d60bffc91261: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:47.601368 10818 consensus_queue.cc:1048] T c7a40faf0455492eb35f727fc91e9fab P 66abd7e8893940bdbe81d60bffc91261 [LEADER]: Connected to new peer: Peer: permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:47.611207 10698 raft_consensus.cc:1275] T c7a40faf0455492eb35f727fc91e9fab P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Refusing update from remote peer 66abd7e8893940bdbe81d60bffc91261: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:47.612872 10841 consensus_queue.cc:1048] T c7a40faf0455492eb35f727fc91e9fab P 66abd7e8893940bdbe81d60bffc91261 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:47.697566 10773 raft_consensus.cc:1275] T e23dd32048434889a42ea8dc88626ed3 P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Refusing update from remote peer d895d0e90a3b45ed9aed3af8222a9b5d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:47.698980 10862 consensus_queue.cc:1048] T e23dd32048434889a42ea8dc88626ed3 P d895d0e90a3b45ed9aed3af8222a9b5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:47.707056 10621 raft_consensus.cc:1275] T e23dd32048434889a42ea8dc88626ed3 P 66abd7e8893940bdbe81d60bffc91261 [term 2 FOLLOWER]: Refusing update from remote peer d895d0e90a3b45ed9aed3af8222a9b5d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:47.708870 10825 consensus_queue.cc:1048] T e23dd32048434889a42ea8dc88626ed3 P d895d0e90a3b45ed9aed3af8222a9b5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:47.777477 10773 raft_consensus.cc:1275] T 0edc1ee1d1aa48b38e4df79d771249ad P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Refusing update from remote peer d895d0e90a3b45ed9aed3af8222a9b5d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:47.778787 10825 consensus_queue.cc:1048] T 0edc1ee1d1aa48b38e4df79d771249ad P d895d0e90a3b45ed9aed3af8222a9b5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:47.787602 10621 raft_consensus.cc:1275] T 0edc1ee1d1aa48b38e4df79d771249ad P 66abd7e8893940bdbe81d60bffc91261 [term 2 FOLLOWER]: Refusing update from remote peer d895d0e90a3b45ed9aed3af8222a9b5d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:47.789331 10859 consensus_queue.cc:1048] T 0edc1ee1d1aa48b38e4df79d771249ad P d895d0e90a3b45ed9aed3af8222a9b5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:47.837260 10773 raft_consensus.cc:1275] T b5719c2d308646c28e9b2297f7d3becd P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Refusing update from remote peer 66abd7e8893940bdbe81d60bffc91261: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:47.838616 10841 consensus_queue.cc:1048] T b5719c2d308646c28e9b2297f7d3becd P 66abd7e8893940bdbe81d60bffc91261 [LEADER]: Connected to new peer: Peer: permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:47.850838 10698 raft_consensus.cc:1275] T b5719c2d308646c28e9b2297f7d3becd P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Refusing update from remote peer 66abd7e8893940bdbe81d60bffc91261: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:47.852661 10841 consensus_queue.cc:1048] T b5719c2d308646c28e9b2297f7d3becd P 66abd7e8893940bdbe81d60bffc91261 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:47.893867 10698 raft_consensus.cc:3060] T 020e5de5fe4f481ba994779ae752696c P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:47.899354 10698 raft_consensus.cc:1275] T 020e5de5fe4f481ba994779ae752696c P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Refusing update from remote peer 66abd7e8893940bdbe81d60bffc91261: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:47.900848 10844 consensus_queue.cc:1048] T 020e5de5fe4f481ba994779ae752696c P 66abd7e8893940bdbe81d60bffc91261 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:47.902587 10773 raft_consensus.cc:1275] T 020e5de5fe4f481ba994779ae752696c P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Refusing update from remote peer 66abd7e8893940bdbe81d60bffc91261: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:47.903920 10844 consensus_queue.cc:1048] T 020e5de5fe4f481ba994779ae752696c P 66abd7e8893940bdbe81d60bffc91261 [LEADER]: Connected to new peer: Peer: permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:47.936398 10773 raft_consensus.cc:1275] T ddaf52c482884428ab1694c903f54cd8 P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Refusing update from remote peer d895d0e90a3b45ed9aed3af8222a9b5d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:47.937752 10859 consensus_queue.cc:1048] T ddaf52c482884428ab1694c903f54cd8 P d895d0e90a3b45ed9aed3af8222a9b5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:47.946349 10621 raft_consensus.cc:1275] T ddaf52c482884428ab1694c903f54cd8 P 66abd7e8893940bdbe81d60bffc91261 [term 2 FOLLOWER]: Refusing update from remote peer d895d0e90a3b45ed9aed3af8222a9b5d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:47.947978 10862 consensus_queue.cc:1048] T ddaf52c482884428ab1694c903f54cd8 P d895d0e90a3b45ed9aed3af8222a9b5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:48.067778 10698 raft_consensus.cc:1275] T 8eb4dc0971ed4d6183bfb9d283ad51dc P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Refusing update from remote peer 305b05bc72f04d769644fbff5188bc26: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:48.069108 10819 consensus_queue.cc:1048] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 305b05bc72f04d769644fbff5188bc26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:48.079891 10621 raft_consensus.cc:1275] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 66abd7e8893940bdbe81d60bffc91261 [term 2 FOLLOWER]: Refusing update from remote peer 305b05bc72f04d769644fbff5188bc26: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:48.081923 10895 consensus_queue.cc:1048] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 305b05bc72f04d769644fbff5188bc26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:48.585300 10859 raft_consensus.cc:493] T bd8914371e234fd89180b58dd299e334 P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:48.585922 10859 raft_consensus.cc:515] T bd8914371e234fd89180b58dd299e334 P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:48.587852 10859 leader_election.cc:290] T bd8914371e234fd89180b58dd299e334 P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009), 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947)
I20260709 13:02:48.588770 10621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd8914371e234fd89180b58dd299e334" candidate_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66abd7e8893940bdbe81d60bffc91261" is_pre_election: true
I20260709 13:02:48.589231 10773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd8914371e234fd89180b58dd299e334" candidate_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "305b05bc72f04d769644fbff5188bc26" is_pre_election: true
I20260709 13:02:48.589850 10773 raft_consensus.cc:2468] T bd8914371e234fd89180b58dd299e334 P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d895d0e90a3b45ed9aed3af8222a9b5d in term 2.
I20260709 13:02:48.591030 10665 leader_election.cc:304] T bd8914371e234fd89180b58dd299e334 P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 305b05bc72f04d769644fbff5188bc26, d895d0e90a3b45ed9aed3af8222a9b5d; no voters: 66abd7e8893940bdbe81d60bffc91261
I20260709 13:02:48.591986 10859 raft_consensus.cc:2804] T bd8914371e234fd89180b58dd299e334 P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:48.592401 10859 raft_consensus.cc:493] T bd8914371e234fd89180b58dd299e334 P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:48.592789 10859 raft_consensus.cc:3060] T bd8914371e234fd89180b58dd299e334 P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:48.598639 10859 raft_consensus.cc:515] T bd8914371e234fd89180b58dd299e334 P d895d0e90a3b45ed9aed3af8222a9b5d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:48.600653 10859 leader_election.cc:290] T bd8914371e234fd89180b58dd299e334 P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 3 election: Requested vote from peers 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009), 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947)
I20260709 13:02:48.601539 10621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd8914371e234fd89180b58dd299e334" candidate_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66abd7e8893940bdbe81d60bffc91261"
I20260709 13:02:48.602424 10773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd8914371e234fd89180b58dd299e334" candidate_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "305b05bc72f04d769644fbff5188bc26"
I20260709 13:02:48.603040 10773 raft_consensus.cc:3060] T bd8914371e234fd89180b58dd299e334 P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:48.609618 10773 raft_consensus.cc:2468] T bd8914371e234fd89180b58dd299e334 P 305b05bc72f04d769644fbff5188bc26 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d895d0e90a3b45ed9aed3af8222a9b5d in term 3.
I20260709 13:02:48.611057 10665 leader_election.cc:304] T bd8914371e234fd89180b58dd299e334 P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 305b05bc72f04d769644fbff5188bc26, d895d0e90a3b45ed9aed3af8222a9b5d; no voters: 66abd7e8893940bdbe81d60bffc91261
I20260709 13:02:48.612166 10859 raft_consensus.cc:2804] T bd8914371e234fd89180b58dd299e334 P d895d0e90a3b45ed9aed3af8222a9b5d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:48.612754 10859 raft_consensus.cc:697] T bd8914371e234fd89180b58dd299e334 P d895d0e90a3b45ed9aed3af8222a9b5d [term 3 LEADER]: Becoming Leader. State: Replica: d895d0e90a3b45ed9aed3af8222a9b5d, State: Running, Role: LEADER
I20260709 13:02:48.613584 10859 consensus_queue.cc:237] T bd8914371e234fd89180b58dd299e334 P d895d0e90a3b45ed9aed3af8222a9b5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:48.621667 10522 catalog_manager.cc:5697] T bd8914371e234fd89180b58dd299e334 P d895d0e90a3b45ed9aed3af8222a9b5d reported cstate change: term changed from 1 to 3, leader changed from 305b05bc72f04d769644fbff5188bc26 (127.0.107.195) to d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194). New cstate: current_term: 3 leader_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:48.863770 10841 raft_consensus.cc:493] T bd8914371e234fd89180b58dd299e334 P 66abd7e8893940bdbe81d60bffc91261 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 305b05bc72f04d769644fbff5188bc26)
I20260709 13:02:48.864259 10841 raft_consensus.cc:515] T bd8914371e234fd89180b58dd299e334 P 66abd7e8893940bdbe81d60bffc91261 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:48.865998 10841 leader_election.cc:290] T bd8914371e234fd89180b58dd299e334 P 66abd7e8893940bdbe81d60bffc91261 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683), 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947)
I20260709 13:02:48.867039 10698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd8914371e234fd89180b58dd299e334" candidate_uuid: "66abd7e8893940bdbe81d60bffc91261" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" is_pre_election: true
I20260709 13:02:48.867271 10773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd8914371e234fd89180b58dd299e334" candidate_uuid: "66abd7e8893940bdbe81d60bffc91261" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "305b05bc72f04d769644fbff5188bc26" is_pre_election: true
I20260709 13:02:48.867971 10773 raft_consensus.cc:2368] T bd8914371e234fd89180b58dd299e334 P 305b05bc72f04d769644fbff5188bc26 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66abd7e8893940bdbe81d60bffc91261 for earlier term 2. Current term is 3.
I20260709 13:02:48.868922 10590 leader_election.cc:400] T bd8914371e234fd89180b58dd299e334 P 66abd7e8893940bdbe81d60bffc91261 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947) with higher term. Message: Invalid argument: T bd8914371e234fd89180b58dd299e334 P 305b05bc72f04d769644fbff5188bc26 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66abd7e8893940bdbe81d60bffc91261 for earlier term 2. Current term is 3.
I20260709 13:02:48.869143 10590 leader_election.cc:403] T bd8914371e234fd89180b58dd299e334 P 66abd7e8893940bdbe81d60bffc91261 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:02:48.869730 10841 raft_consensus.cc:3060] T bd8914371e234fd89180b58dd299e334 P 66abd7e8893940bdbe81d60bffc91261 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:02:48.876796 10841 raft_consensus.cc:2749] T bd8914371e234fd89180b58dd299e334 P 66abd7e8893940bdbe81d60bffc91261 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947) with higher term. Message: Invalid argument: T bd8914371e234fd89180b58dd299e334 P 305b05bc72f04d769644fbff5188bc26 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66abd7e8893940bdbe81d60bffc91261 for earlier term 2. Current term is 3.
I20260709 13:02:49.001566 10621 raft_consensus.cc:1275] T bd8914371e234fd89180b58dd299e334 P 66abd7e8893940bdbe81d60bffc91261 [term 3 FOLLOWER]: Refusing update from remote peer d895d0e90a3b45ed9aed3af8222a9b5d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:49.002914 10859 consensus_queue.cc:1048] T bd8914371e234fd89180b58dd299e334 P d895d0e90a3b45ed9aed3af8222a9b5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:49.015323 10773 raft_consensus.cc:1275] T bd8914371e234fd89180b58dd299e334 P 305b05bc72f04d769644fbff5188bc26 [term 3 FOLLOWER]: Refusing update from remote peer d895d0e90a3b45ed9aed3af8222a9b5d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:02:49.016846 10906 consensus_queue.cc:1048] T bd8914371e234fd89180b58dd299e334 P d895d0e90a3b45ed9aed3af8222a9b5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:50.046029 10520 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49846:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:02:50.048190 10520 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:02:50.142199 10682 tablet_service.cc:1511] Processing CreateTablet for tablet b018c17ab00f46b6b1eab7e49e0adfe5 (DEFAULT_TABLE table=soft_deleted_table [id=4ea887c0026e4e15825f08f4d2396528]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:02:50.141902 10613 tablet_service.cc:1511] Processing CreateTablet for tablet b018c17ab00f46b6b1eab7e49e0adfe5 (DEFAULT_TABLE table=soft_deleted_table [id=4ea887c0026e4e15825f08f4d2396528]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:02:50.145866 10613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b018c17ab00f46b6b1eab7e49e0adfe5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:50.146433 10759 tablet_service.cc:1511] Processing CreateTablet for tablet b018c17ab00f46b6b1eab7e49e0adfe5 (DEFAULT_TABLE table=soft_deleted_table [id=4ea887c0026e4e15825f08f4d2396528]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:02:50.148386 10682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b018c17ab00f46b6b1eab7e49e0adfe5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:50.149011 10759 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b018c17ab00f46b6b1eab7e49e0adfe5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:50.155942 10610 tablet_service.cc:1511] Processing CreateTablet for tablet b498f794eab54c15846243452d7992e0 (DEFAULT_TABLE table=soft_deleted_table [id=4ea887c0026e4e15825f08f4d2396528]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:02:50.158303 10610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b498f794eab54c15846243452d7992e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:50.162246 10763 tablet_service.cc:1511] Processing CreateTablet for tablet b498f794eab54c15846243452d7992e0 (DEFAULT_TABLE table=soft_deleted_table [id=4ea887c0026e4e15825f08f4d2396528]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:02:50.164041 10763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b498f794eab54c15846243452d7992e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:50.182478 10758 tablet_service.cc:1511] Processing CreateTablet for tablet 30e72e0b20944bcbbea372c99c5f27fc (DEFAULT_TABLE table=soft_deleted_table [id=4ea887c0026e4e15825f08f4d2396528]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:02:50.184217 10758 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30e72e0b20944bcbbea372c99c5f27fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:50.190184 10760 tablet_service.cc:1511] Processing CreateTablet for tablet 57fe93cb1bec4bc1ad43b091fb49f120 (DEFAULT_TABLE table=soft_deleted_table [id=4ea887c0026e4e15825f08f4d2396528]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:02:50.191864 10760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57fe93cb1bec4bc1ad43b091fb49f120. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:50.194700 10689 tablet_service.cc:1511] Processing CreateTablet for tablet b498f794eab54c15846243452d7992e0 (DEFAULT_TABLE table=soft_deleted_table [id=4ea887c0026e4e15825f08f4d2396528]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:02:50.195165 10608 tablet_service.cc:1511] Processing CreateTablet for tablet 30e72e0b20944bcbbea372c99c5f27fc (DEFAULT_TABLE table=soft_deleted_table [id=4ea887c0026e4e15825f08f4d2396528]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:02:50.196271 10689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b498f794eab54c15846243452d7992e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:50.196820 10608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30e72e0b20944bcbbea372c99c5f27fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:50.224169 10684 tablet_service.cc:1511] Processing CreateTablet for tablet 30e72e0b20944bcbbea372c99c5f27fc (DEFAULT_TABLE table=soft_deleted_table [id=4ea887c0026e4e15825f08f4d2396528]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:02:50.226090 10684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30e72e0b20944bcbbea372c99c5f27fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:50.231205 10611 tablet_service.cc:1511] Processing CreateTablet for tablet 57fe93cb1bec4bc1ad43b091fb49f120 (DEFAULT_TABLE table=soft_deleted_table [id=4ea887c0026e4e15825f08f4d2396528]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:02:50.234071 10611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57fe93cb1bec4bc1ad43b091fb49f120. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:50.234941 10761 tablet_service.cc:1511] Processing CreateTablet for tablet 110992c04e984796a1919262f4bbe67f (DEFAULT_TABLE table=soft_deleted_table [id=4ea887c0026e4e15825f08f4d2396528]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:02:50.237356 10761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 110992c04e984796a1919262f4bbe67f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:50.238037 10683 tablet_service.cc:1511] Processing CreateTablet for tablet 57fe93cb1bec4bc1ad43b091fb49f120 (DEFAULT_TABLE table=soft_deleted_table [id=4ea887c0026e4e15825f08f4d2396528]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:02:50.239766 10683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57fe93cb1bec4bc1ad43b091fb49f120. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:50.251942 10686 tablet_service.cc:1511] Processing CreateTablet for tablet 110992c04e984796a1919262f4bbe67f (DEFAULT_TABLE table=soft_deleted_table [id=4ea887c0026e4e15825f08f4d2396528]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:02:50.253911 10686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 110992c04e984796a1919262f4bbe67f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:50.252164 10612 tablet_service.cc:1511] Processing CreateTablet for tablet 110992c04e984796a1919262f4bbe67f (DEFAULT_TABLE table=soft_deleted_table [id=4ea887c0026e4e15825f08f4d2396528]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:02:50.258193 10612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 110992c04e984796a1919262f4bbe67f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:50.272457 10925 tablet_bootstrap.cc:492] T b018c17ab00f46b6b1eab7e49e0adfe5 P 66abd7e8893940bdbe81d60bffc91261: Bootstrap starting.
I20260709 13:02:50.275380 10926 tablet_bootstrap.cc:492] T b498f794eab54c15846243452d7992e0 P d895d0e90a3b45ed9aed3af8222a9b5d: Bootstrap starting.
I20260709 13:02:50.290382 10926 tablet_bootstrap.cc:654] T b498f794eab54c15846243452d7992e0 P d895d0e90a3b45ed9aed3af8222a9b5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:50.293694 10689 tablet_service.cc:1511] Processing CreateTablet for tablet 34e0b8824c444b59b50cc2c8f61f49af (DEFAULT_TABLE table=soft_deleted_table [id=4ea887c0026e4e15825f08f4d2396528]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:02:50.295169 10689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34e0b8824c444b59b50cc2c8f61f49af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:50.296098 10763 tablet_service.cc:1511] Processing CreateTablet for tablet 34e0b8824c444b59b50cc2c8f61f49af (DEFAULT_TABLE table=soft_deleted_table [id=4ea887c0026e4e15825f08f4d2396528]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:02:50.297133 10610 tablet_service.cc:1511] Processing CreateTablet for tablet 34e0b8824c444b59b50cc2c8f61f49af (DEFAULT_TABLE table=soft_deleted_table [id=4ea887c0026e4e15825f08f4d2396528]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:02:50.297631 10763 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34e0b8824c444b59b50cc2c8f61f49af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:50.298529 10610 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 34e0b8824c444b59b50cc2c8f61f49af. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:02:50.299788 10570 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:02:50.308688 10613 tablet_service.cc:1511] Processing CreateTablet for tablet 420a103ab9df43e9b3d34aacfd2325aa (DEFAULT_TABLE table=soft_deleted_table [id=4ea887c0026e4e15825f08f4d2396528]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:02:50.311393 10613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 420a103ab9df43e9b3d34aacfd2325aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:50.313896 10925 tablet_bootstrap.cc:654] T b018c17ab00f46b6b1eab7e49e0adfe5 P 66abd7e8893940bdbe81d60bffc91261: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:50.317965 10682 tablet_service.cc:1511] Processing CreateTablet for tablet 420a103ab9df43e9b3d34aacfd2325aa (DEFAULT_TABLE table=soft_deleted_table [id=4ea887c0026e4e15825f08f4d2396528]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:02:50.322085 10682 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 420a103ab9df43e9b3d34aacfd2325aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:50.329360 10760 tablet_service.cc:1511] Processing CreateTablet for tablet 420a103ab9df43e9b3d34aacfd2325aa (DEFAULT_TABLE table=soft_deleted_table [id=4ea887c0026e4e15825f08f4d2396528]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:02:50.330955 10760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 420a103ab9df43e9b3d34aacfd2325aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:50.334980 10612 tablet_service.cc:1511] Processing CreateTablet for tablet 70931771066e47f7a57a558edb1b3e61 (DEFAULT_TABLE table=soft_deleted_table [id=4ea887c0026e4e15825f08f4d2396528]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:02:50.336695 10612 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70931771066e47f7a57a558edb1b3e61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:50.368678 10761 tablet_service.cc:1511] Processing CreateTablet for tablet 70931771066e47f7a57a558edb1b3e61 (DEFAULT_TABLE table=soft_deleted_table [id=4ea887c0026e4e15825f08f4d2396528]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:02:50.370560 10761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70931771066e47f7a57a558edb1b3e61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:50.382689 10611 tablet_service.cc:1511] Processing CreateTablet for tablet 0a3e7d3c774f4fbcb175375d2e4d60b6 (DEFAULT_TABLE table=soft_deleted_table [id=4ea887c0026e4e15825f08f4d2396528]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:02:50.384617 10611 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a3e7d3c774f4fbcb175375d2e4d60b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:50.396601 10760 tablet_service.cc:1511] Processing CreateTablet for tablet 0a3e7d3c774f4fbcb175375d2e4d60b6 (DEFAULT_TABLE table=soft_deleted_table [id=4ea887c0026e4e15825f08f4d2396528]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:02:50.398200 10760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a3e7d3c774f4fbcb175375d2e4d60b6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:02:50.404098 10663 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:44009, user_credentials={real_user=slave}} blocked reactor thread for 79361.5us
I20260709 13:02:50.408896 10924 tablet_bootstrap.cc:492] T b018c17ab00f46b6b1eab7e49e0adfe5 P 305b05bc72f04d769644fbff5188bc26: Bootstrap starting.
I20260709 13:02:50.408775 10683 tablet_service.cc:1511] Processing CreateTablet for tablet 0a3e7d3c774f4fbcb175375d2e4d60b6 (DEFAULT_TABLE table=soft_deleted_table [id=4ea887c0026e4e15825f08f4d2396528]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:02:50.410197 10683 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a3e7d3c774f4fbcb175375d2e4d60b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:50.411309 10686 tablet_service.cc:1511] Processing CreateTablet for tablet 70931771066e47f7a57a558edb1b3e61 (DEFAULT_TABLE table=soft_deleted_table [id=4ea887c0026e4e15825f08f4d2396528]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:02:50.412719 10686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70931771066e47f7a57a558edb1b3e61. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:02:50.423090 10925 tablet_bootstrap.cc:492] T b018c17ab00f46b6b1eab7e49e0adfe5 P 66abd7e8893940bdbe81d60bffc91261: No bootstrap required, opened a new log
I20260709 13:02:50.423748 10925 ts_tablet_manager.cc:1403] T b018c17ab00f46b6b1eab7e49e0adfe5 P 66abd7e8893940bdbe81d60bffc91261: Time spent bootstrapping tablet: real 0.152s	user 0.015s	sys 0.000s
I20260709 13:02:50.429400 10924 tablet_bootstrap.cc:654] T b018c17ab00f46b6b1eab7e49e0adfe5 P 305b05bc72f04d769644fbff5188bc26: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:50.431638 10926 tablet_bootstrap.cc:492] T b498f794eab54c15846243452d7992e0 P d895d0e90a3b45ed9aed3af8222a9b5d: No bootstrap required, opened a new log
I20260709 13:02:50.432219 10926 ts_tablet_manager.cc:1403] T b498f794eab54c15846243452d7992e0 P d895d0e90a3b45ed9aed3af8222a9b5d: Time spent bootstrapping tablet: real 0.157s	user 0.010s	sys 0.037s
I20260709 13:02:50.427630 10925 raft_consensus.cc:359] T b018c17ab00f46b6b1eab7e49e0adfe5 P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.433745 10925 raft_consensus.cc:385] T b018c17ab00f46b6b1eab7e49e0adfe5 P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:50.434080 10925 raft_consensus.cc:740] T b018c17ab00f46b6b1eab7e49e0adfe5 P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66abd7e8893940bdbe81d60bffc91261, State: Initialized, Role: FOLLOWER
I20260709 13:02:50.435757 10926 raft_consensus.cc:359] T b498f794eab54c15846243452d7992e0 P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.436627 10926 raft_consensus.cc:385] T b498f794eab54c15846243452d7992e0 P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:50.436919 10926 raft_consensus.cc:740] T b498f794eab54c15846243452d7992e0 P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d895d0e90a3b45ed9aed3af8222a9b5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:50.437676 10926 consensus_queue.cc:260] T b498f794eab54c15846243452d7992e0 P d895d0e90a3b45ed9aed3af8222a9b5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.451924 10926 ts_tablet_manager.cc:1434] T b498f794eab54c15846243452d7992e0 P d895d0e90a3b45ed9aed3af8222a9b5d: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 13:02:50.453009 10926 tablet_bootstrap.cc:492] T b018c17ab00f46b6b1eab7e49e0adfe5 P d895d0e90a3b45ed9aed3af8222a9b5d: Bootstrap starting.
I20260709 13:02:50.452785 10925 consensus_queue.cc:260] T b018c17ab00f46b6b1eab7e49e0adfe5 P 66abd7e8893940bdbe81d60bffc91261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.473922 10926 tablet_bootstrap.cc:654] T b018c17ab00f46b6b1eab7e49e0adfe5 P d895d0e90a3b45ed9aed3af8222a9b5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:50.474027 10925 ts_tablet_manager.cc:1434] T b018c17ab00f46b6b1eab7e49e0adfe5 P 66abd7e8893940bdbe81d60bffc91261: Time spent starting tablet: real 0.050s	user 0.007s	sys 0.004s
I20260709 13:02:50.482263 10925 tablet_bootstrap.cc:492] T b498f794eab54c15846243452d7992e0 P 66abd7e8893940bdbe81d60bffc91261: Bootstrap starting.
I20260709 13:02:50.480141 10924 tablet_bootstrap.cc:492] T b018c17ab00f46b6b1eab7e49e0adfe5 P 305b05bc72f04d769644fbff5188bc26: No bootstrap required, opened a new log
I20260709 13:02:50.483773 10924 ts_tablet_manager.cc:1403] T b018c17ab00f46b6b1eab7e49e0adfe5 P 305b05bc72f04d769644fbff5188bc26: Time spent bootstrapping tablet: real 0.075s	user 0.016s	sys 0.017s
I20260709 13:02:50.487047 10924 raft_consensus.cc:359] T b018c17ab00f46b6b1eab7e49e0adfe5 P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.487890 10924 raft_consensus.cc:385] T b018c17ab00f46b6b1eab7e49e0adfe5 P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:50.488267 10924 raft_consensus.cc:740] T b018c17ab00f46b6b1eab7e49e0adfe5 P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 305b05bc72f04d769644fbff5188bc26, State: Initialized, Role: FOLLOWER
I20260709 13:02:50.488770 10926 tablet_bootstrap.cc:492] T b018c17ab00f46b6b1eab7e49e0adfe5 P d895d0e90a3b45ed9aed3af8222a9b5d: No bootstrap required, opened a new log
I20260709 13:02:50.489578 10926 ts_tablet_manager.cc:1403] T b018c17ab00f46b6b1eab7e49e0adfe5 P d895d0e90a3b45ed9aed3af8222a9b5d: Time spent bootstrapping tablet: real 0.037s	user 0.016s	sys 0.003s
I20260709 13:02:50.489122 10924 consensus_queue.cc:260] T b018c17ab00f46b6b1eab7e49e0adfe5 P 305b05bc72f04d769644fbff5188bc26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.490041 10925 tablet_bootstrap.cc:654] T b498f794eab54c15846243452d7992e0 P 66abd7e8893940bdbe81d60bffc91261: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:50.491806 10924 ts_tablet_manager.cc:1434] T b018c17ab00f46b6b1eab7e49e0adfe5 P 305b05bc72f04d769644fbff5188bc26: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.006s
I20260709 13:02:50.492929 10924 tablet_bootstrap.cc:492] T 30e72e0b20944bcbbea372c99c5f27fc P 305b05bc72f04d769644fbff5188bc26: Bootstrap starting.
I20260709 13:02:50.494769 10926 raft_consensus.cc:359] T b018c17ab00f46b6b1eab7e49e0adfe5 P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.495671 10926 raft_consensus.cc:385] T b018c17ab00f46b6b1eab7e49e0adfe5 P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:50.496047 10926 raft_consensus.cc:740] T b018c17ab00f46b6b1eab7e49e0adfe5 P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d895d0e90a3b45ed9aed3af8222a9b5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:50.496999 10926 consensus_queue.cc:260] T b018c17ab00f46b6b1eab7e49e0adfe5 P d895d0e90a3b45ed9aed3af8222a9b5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.503121 10925 tablet_bootstrap.cc:492] T b498f794eab54c15846243452d7992e0 P 66abd7e8893940bdbe81d60bffc91261: No bootstrap required, opened a new log
I20260709 13:02:50.503801 10925 ts_tablet_manager.cc:1403] T b498f794eab54c15846243452d7992e0 P 66abd7e8893940bdbe81d60bffc91261: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.004s
I20260709 13:02:50.504356 10924 tablet_bootstrap.cc:654] T 30e72e0b20944bcbbea372c99c5f27fc P 305b05bc72f04d769644fbff5188bc26: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:50.507403 10925 raft_consensus.cc:359] T b498f794eab54c15846243452d7992e0 P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.508351 10925 raft_consensus.cc:385] T b498f794eab54c15846243452d7992e0 P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:50.508738 10925 raft_consensus.cc:740] T b498f794eab54c15846243452d7992e0 P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66abd7e8893940bdbe81d60bffc91261, State: Initialized, Role: FOLLOWER
I20260709 13:02:50.503192 10926 ts_tablet_manager.cc:1434] T b018c17ab00f46b6b1eab7e49e0adfe5 P d895d0e90a3b45ed9aed3af8222a9b5d: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 13:02:50.509734 10925 consensus_queue.cc:260] T b498f794eab54c15846243452d7992e0 P 66abd7e8893940bdbe81d60bffc91261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.510439 10926 tablet_bootstrap.cc:492] T 57fe93cb1bec4bc1ad43b091fb49f120 P d895d0e90a3b45ed9aed3af8222a9b5d: Bootstrap starting.
I20260709 13:02:50.512817 10925 ts_tablet_manager.cc:1434] T b498f794eab54c15846243452d7992e0 P 66abd7e8893940bdbe81d60bffc91261: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.005s
I20260709 13:02:50.514039 10925 tablet_bootstrap.cc:492] T 110992c04e984796a1919262f4bbe67f P 66abd7e8893940bdbe81d60bffc91261: Bootstrap starting.
I20260709 13:02:50.517073 10924 tablet_bootstrap.cc:492] T 30e72e0b20944bcbbea372c99c5f27fc P 305b05bc72f04d769644fbff5188bc26: No bootstrap required, opened a new log
I20260709 13:02:50.517688 10924 ts_tablet_manager.cc:1403] T 30e72e0b20944bcbbea372c99c5f27fc P 305b05bc72f04d769644fbff5188bc26: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.002s
I20260709 13:02:50.517978 10926 tablet_bootstrap.cc:654] T 57fe93cb1bec4bc1ad43b091fb49f120 P d895d0e90a3b45ed9aed3af8222a9b5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:50.521713 10925 tablet_bootstrap.cc:654] T 110992c04e984796a1919262f4bbe67f P 66abd7e8893940bdbe81d60bffc91261: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:50.523635 10924 raft_consensus.cc:359] T 30e72e0b20944bcbbea372c99c5f27fc P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.524608 10924 raft_consensus.cc:385] T 30e72e0b20944bcbbea372c99c5f27fc P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:50.525030 10924 raft_consensus.cc:740] T 30e72e0b20944bcbbea372c99c5f27fc P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 305b05bc72f04d769644fbff5188bc26, State: Initialized, Role: FOLLOWER
I20260709 13:02:50.526208 10924 consensus_queue.cc:260] T 30e72e0b20944bcbbea372c99c5f27fc P 305b05bc72f04d769644fbff5188bc26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.529973 10924 ts_tablet_manager.cc:1434] T 30e72e0b20944bcbbea372c99c5f27fc P 305b05bc72f04d769644fbff5188bc26: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.003s
I20260709 13:02:50.532491 10924 tablet_bootstrap.cc:492] T 57fe93cb1bec4bc1ad43b091fb49f120 P 305b05bc72f04d769644fbff5188bc26: Bootstrap starting.
I20260709 13:02:50.542302 10924 tablet_bootstrap.cc:654] T 57fe93cb1bec4bc1ad43b091fb49f120 P 305b05bc72f04d769644fbff5188bc26: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:50.543517 10928 raft_consensus.cc:493] T b498f794eab54c15846243452d7992e0 P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.544179 10928 raft_consensus.cc:515] T b498f794eab54c15846243452d7992e0 P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.547631 10928 leader_election.cc:290] T b498f794eab54c15846243452d7992e0 P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009), 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947)
I20260709 13:02:50.549069 10773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b498f794eab54c15846243452d7992e0" candidate_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "305b05bc72f04d769644fbff5188bc26" is_pre_election: true
I20260709 13:02:50.549203 10621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b498f794eab54c15846243452d7992e0" candidate_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66abd7e8893940bdbe81d60bffc91261" is_pre_election: true
I20260709 13:02:50.550113 10924 tablet_bootstrap.cc:492] T 57fe93cb1bec4bc1ad43b091fb49f120 P 305b05bc72f04d769644fbff5188bc26: No bootstrap required, opened a new log
I20260709 13:02:50.550096 10926 tablet_bootstrap.cc:492] T 57fe93cb1bec4bc1ad43b091fb49f120 P d895d0e90a3b45ed9aed3af8222a9b5d: No bootstrap required, opened a new log
I20260709 13:02:50.550103 10621 raft_consensus.cc:2468] T b498f794eab54c15846243452d7992e0 P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d895d0e90a3b45ed9aed3af8222a9b5d in term 0.
I20260709 13:02:50.550918 10924 ts_tablet_manager.cc:1403] T 57fe93cb1bec4bc1ad43b091fb49f120 P 305b05bc72f04d769644fbff5188bc26: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.003s
W20260709 13:02:50.551046 10665 leader_election.cc:343] T b498f794eab54c15846243452d7992e0 P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:50.551261 10926 ts_tablet_manager.cc:1403] T 57fe93cb1bec4bc1ad43b091fb49f120 P d895d0e90a3b45ed9aed3af8222a9b5d: Time spent bootstrapping tablet: real 0.041s	user 0.008s	sys 0.019s
I20260709 13:02:50.552307 10663 leader_election.cc:304] T b498f794eab54c15846243452d7992e0 P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66abd7e8893940bdbe81d60bffc91261, d895d0e90a3b45ed9aed3af8222a9b5d; no voters: 305b05bc72f04d769644fbff5188bc26
I20260709 13:02:50.553517 10928 raft_consensus.cc:2804] T b498f794eab54c15846243452d7992e0 P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:50.553884 10928 raft_consensus.cc:493] T b498f794eab54c15846243452d7992e0 P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.554244 10928 raft_consensus.cc:3060] T b498f794eab54c15846243452d7992e0 P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:50.554989 10926 raft_consensus.cc:359] T 57fe93cb1bec4bc1ad43b091fb49f120 P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.555858 10926 raft_consensus.cc:385] T 57fe93cb1bec4bc1ad43b091fb49f120 P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:50.554543 10924 raft_consensus.cc:359] T 57fe93cb1bec4bc1ad43b091fb49f120 P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.556281 10926 raft_consensus.cc:740] T 57fe93cb1bec4bc1ad43b091fb49f120 P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d895d0e90a3b45ed9aed3af8222a9b5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:50.556384 10924 raft_consensus.cc:385] T 57fe93cb1bec4bc1ad43b091fb49f120 P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:50.556895 10924 raft_consensus.cc:740] T 57fe93cb1bec4bc1ad43b091fb49f120 P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 305b05bc72f04d769644fbff5188bc26, State: Initialized, Role: FOLLOWER
I20260709 13:02:50.557485 10926 consensus_queue.cc:260] T 57fe93cb1bec4bc1ad43b091fb49f120 P d895d0e90a3b45ed9aed3af8222a9b5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.558004 10924 consensus_queue.cc:260] T 57fe93cb1bec4bc1ad43b091fb49f120 P 305b05bc72f04d769644fbff5188bc26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.561318 10924 ts_tablet_manager.cc:1434] T 57fe93cb1bec4bc1ad43b091fb49f120 P 305b05bc72f04d769644fbff5188bc26: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 13:02:50.562498 10924 tablet_bootstrap.cc:492] T b498f794eab54c15846243452d7992e0 P 305b05bc72f04d769644fbff5188bc26: Bootstrap starting.
I20260709 13:02:50.562423 10926 ts_tablet_manager.cc:1434] T 57fe93cb1bec4bc1ad43b091fb49f120 P d895d0e90a3b45ed9aed3af8222a9b5d: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:02:50.563984 10926 tablet_bootstrap.cc:492] T 110992c04e984796a1919262f4bbe67f P d895d0e90a3b45ed9aed3af8222a9b5d: Bootstrap starting.
I20260709 13:02:50.564790 10925 tablet_bootstrap.cc:492] T 110992c04e984796a1919262f4bbe67f P 66abd7e8893940bdbe81d60bffc91261: No bootstrap required, opened a new log
I20260709 13:02:50.565397 10925 ts_tablet_manager.cc:1403] T 110992c04e984796a1919262f4bbe67f P 66abd7e8893940bdbe81d60bffc91261: Time spent bootstrapping tablet: real 0.052s	user 0.016s	sys 0.013s
I20260709 13:02:50.568500 10928 raft_consensus.cc:515] T b498f794eab54c15846243452d7992e0 P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.571604 10924 tablet_bootstrap.cc:654] T b498f794eab54c15846243452d7992e0 P 305b05bc72f04d769644fbff5188bc26: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:50.576370 10926 tablet_bootstrap.cc:654] T 110992c04e984796a1919262f4bbe67f P d895d0e90a3b45ed9aed3af8222a9b5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:50.579614 10925 raft_consensus.cc:359] T 110992c04e984796a1919262f4bbe67f P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.580844 10925 raft_consensus.cc:385] T 110992c04e984796a1919262f4bbe67f P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:50.581279 10925 raft_consensus.cc:740] T 110992c04e984796a1919262f4bbe67f P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66abd7e8893940bdbe81d60bffc91261, State: Initialized, Role: FOLLOWER
I20260709 13:02:50.582664 10925 consensus_queue.cc:260] T 110992c04e984796a1919262f4bbe67f P 66abd7e8893940bdbe81d60bffc91261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.589764 10925 ts_tablet_manager.cc:1434] T 110992c04e984796a1919262f4bbe67f P 66abd7e8893940bdbe81d60bffc91261: Time spent starting tablet: real 0.024s	user 0.010s	sys 0.000s
I20260709 13:02:50.590903 10926 tablet_bootstrap.cc:492] T 110992c04e984796a1919262f4bbe67f P d895d0e90a3b45ed9aed3af8222a9b5d: No bootstrap required, opened a new log
I20260709 13:02:50.591784 10926 ts_tablet_manager.cc:1403] T 110992c04e984796a1919262f4bbe67f P d895d0e90a3b45ed9aed3af8222a9b5d: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.007s
I20260709 13:02:50.595054 10926 raft_consensus.cc:359] T 110992c04e984796a1919262f4bbe67f P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.595973 10926 raft_consensus.cc:385] T 110992c04e984796a1919262f4bbe67f P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:50.596385 10926 raft_consensus.cc:740] T 110992c04e984796a1919262f4bbe67f P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d895d0e90a3b45ed9aed3af8222a9b5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:50.597827 10621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b498f794eab54c15846243452d7992e0" candidate_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66abd7e8893940bdbe81d60bffc91261"
I20260709 13:02:50.598488 10621 raft_consensus.cc:3060] T b498f794eab54c15846243452d7992e0 P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:50.598673 10925 tablet_bootstrap.cc:492] T 57fe93cb1bec4bc1ad43b091fb49f120 P 66abd7e8893940bdbe81d60bffc91261: Bootstrap starting.
I20260709 13:02:50.599177 10773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b498f794eab54c15846243452d7992e0" candidate_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "305b05bc72f04d769644fbff5188bc26"
W20260709 13:02:50.601302 10665 leader_election.cc:343] T b498f794eab54c15846243452d7992e0 P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:50.602440 10928 leader_election.cc:290] T b498f794eab54c15846243452d7992e0 P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 1 election: Requested vote from peers 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009), 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947)
I20260709 13:02:50.604966 10926 consensus_queue.cc:260] T 110992c04e984796a1919262f4bbe67f P d895d0e90a3b45ed9aed3af8222a9b5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.607271 10924 tablet_bootstrap.cc:492] T b498f794eab54c15846243452d7992e0 P 305b05bc72f04d769644fbff5188bc26: No bootstrap required, opened a new log
I20260709 13:02:50.607543 10621 raft_consensus.cc:2468] T b498f794eab54c15846243452d7992e0 P 66abd7e8893940bdbe81d60bffc91261 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d895d0e90a3b45ed9aed3af8222a9b5d in term 1.
I20260709 13:02:50.607962 10924 ts_tablet_manager.cc:1403] T b498f794eab54c15846243452d7992e0 P 305b05bc72f04d769644fbff5188bc26: Time spent bootstrapping tablet: real 0.046s	user 0.017s	sys 0.016s
I20260709 13:02:50.610080 10663 leader_election.cc:304] T b498f794eab54c15846243452d7992e0 P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66abd7e8893940bdbe81d60bffc91261, d895d0e90a3b45ed9aed3af8222a9b5d; no voters: 305b05bc72f04d769644fbff5188bc26
I20260709 13:02:50.611369 10928 raft_consensus.cc:2804] T b498f794eab54c15846243452d7992e0 P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:50.611877 10928 raft_consensus.cc:697] T b498f794eab54c15846243452d7992e0 P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 LEADER]: Becoming Leader. State: Replica: d895d0e90a3b45ed9aed3af8222a9b5d, State: Running, Role: LEADER
I20260709 13:02:50.611538 10924 raft_consensus.cc:359] T b498f794eab54c15846243452d7992e0 P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.612898 10928 consensus_queue.cc:237] T b498f794eab54c15846243452d7992e0 P d895d0e90a3b45ed9aed3af8222a9b5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.613675 10924 raft_consensus.cc:385] T b498f794eab54c15846243452d7992e0 P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:50.614176 10924 raft_consensus.cc:740] T b498f794eab54c15846243452d7992e0 P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 305b05bc72f04d769644fbff5188bc26, State: Initialized, Role: FOLLOWER
I20260709 13:02:50.615082 10924 consensus_queue.cc:260] T b498f794eab54c15846243452d7992e0 P 305b05bc72f04d769644fbff5188bc26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.617565 10926 ts_tablet_manager.cc:1434] T 110992c04e984796a1919262f4bbe67f P d895d0e90a3b45ed9aed3af8222a9b5d: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.003s
I20260709 13:02:50.618374 10924 ts_tablet_manager.cc:1434] T b498f794eab54c15846243452d7992e0 P 305b05bc72f04d769644fbff5188bc26: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.003s
I20260709 13:02:50.621062 10924 tablet_bootstrap.cc:492] T 110992c04e984796a1919262f4bbe67f P 305b05bc72f04d769644fbff5188bc26: Bootstrap starting.
I20260709 13:02:50.625928 10925 tablet_bootstrap.cc:654] T 57fe93cb1bec4bc1ad43b091fb49f120 P 66abd7e8893940bdbe81d60bffc91261: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:50.626525 10928 raft_consensus.cc:493] T 57fe93cb1bec4bc1ad43b091fb49f120 P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.627118 10928 raft_consensus.cc:515] T 57fe93cb1bec4bc1ad43b091fb49f120 P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.618863 10926 tablet_bootstrap.cc:492] T 30e72e0b20944bcbbea372c99c5f27fc P d895d0e90a3b45ed9aed3af8222a9b5d: Bootstrap starting.
I20260709 13:02:50.630270 10621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe93cb1bec4bc1ad43b091fb49f120" candidate_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66abd7e8893940bdbe81d60bffc91261" is_pre_election: true
I20260709 13:02:50.631147 10773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe93cb1bec4bc1ad43b091fb49f120" candidate_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "305b05bc72f04d769644fbff5188bc26" is_pre_election: true
I20260709 13:02:50.631788 10773 raft_consensus.cc:2468] T 57fe93cb1bec4bc1ad43b091fb49f120 P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d895d0e90a3b45ed9aed3af8222a9b5d in term 0.
W20260709 13:02:50.631853 10663 leader_election.cc:343] T 57fe93cb1bec4bc1ad43b091fb49f120 P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:50.632663 10928 leader_election.cc:290] T 57fe93cb1bec4bc1ad43b091fb49f120 P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009), 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947)
I20260709 13:02:50.633065 10665 leader_election.cc:304] T 57fe93cb1bec4bc1ad43b091fb49f120 P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 305b05bc72f04d769644fbff5188bc26, d895d0e90a3b45ed9aed3af8222a9b5d; no voters: 66abd7e8893940bdbe81d60bffc91261
I20260709 13:02:50.632575 10519 catalog_manager.cc:5697] T b498f794eab54c15846243452d7992e0 P d895d0e90a3b45ed9aed3af8222a9b5d reported cstate change: term changed from 0 to 1, leader changed from <none> to d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194). New cstate: current_term: 1 leader_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:50.636072 10926 tablet_bootstrap.cc:654] T 30e72e0b20944bcbbea372c99c5f27fc P d895d0e90a3b45ed9aed3af8222a9b5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:50.636119 10928 raft_consensus.cc:2804] T 57fe93cb1bec4bc1ad43b091fb49f120 P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:50.636994 10928 raft_consensus.cc:493] T 57fe93cb1bec4bc1ad43b091fb49f120 P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.637394 10928 raft_consensus.cc:3060] T 57fe93cb1bec4bc1ad43b091fb49f120 P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:50.641312 10924 tablet_bootstrap.cc:654] T 110992c04e984796a1919262f4bbe67f P 305b05bc72f04d769644fbff5188bc26: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:50.643263 10928 raft_consensus.cc:515] T 57fe93cb1bec4bc1ad43b091fb49f120 P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.646473 10621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe93cb1bec4bc1ad43b091fb49f120" candidate_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66abd7e8893940bdbe81d60bffc91261"
I20260709 13:02:50.647241 10925 tablet_bootstrap.cc:492] T 57fe93cb1bec4bc1ad43b091fb49f120 P 66abd7e8893940bdbe81d60bffc91261: No bootstrap required, opened a new log
I20260709 13:02:50.647680 10922 raft_consensus.cc:493] T 110992c04e984796a1919262f4bbe67f P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.647960 10925 ts_tablet_manager.cc:1403] T 57fe93cb1bec4bc1ad43b091fb49f120 P 66abd7e8893940bdbe81d60bffc91261: Time spent bootstrapping tablet: real 0.050s	user 0.016s	sys 0.000s
I20260709 13:02:50.648298 10922 raft_consensus.cc:515] T 110992c04e984796a1919262f4bbe67f P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.649602 10926 tablet_bootstrap.cc:492] T 30e72e0b20944bcbbea372c99c5f27fc P d895d0e90a3b45ed9aed3af8222a9b5d: No bootstrap required, opened a new log
I20260709 13:02:50.654322 10698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "110992c04e984796a1919262f4bbe67f" candidate_uuid: "66abd7e8893940bdbe81d60bffc91261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" is_pre_election: true
I20260709 13:02:50.652237 10925 raft_consensus.cc:359] T 57fe93cb1bec4bc1ad43b091fb49f120 P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.655121 10925 raft_consensus.cc:385] T 57fe93cb1bec4bc1ad43b091fb49f120 P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:50.655172 10698 raft_consensus.cc:2468] T 110992c04e984796a1919262f4bbe67f P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66abd7e8893940bdbe81d60bffc91261 in term 0.
I20260709 13:02:50.655670 10925 raft_consensus.cc:740] T 57fe93cb1bec4bc1ad43b091fb49f120 P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66abd7e8893940bdbe81d60bffc91261, State: Initialized, Role: FOLLOWER
I20260709 13:02:50.652794 10773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "110992c04e984796a1919262f4bbe67f" candidate_uuid: "66abd7e8893940bdbe81d60bffc91261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "305b05bc72f04d769644fbff5188bc26" is_pre_election: true
I20260709 13:02:50.654697 10926 ts_tablet_manager.cc:1403] T 30e72e0b20944bcbbea372c99c5f27fc P d895d0e90a3b45ed9aed3af8222a9b5d: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.003s
I20260709 13:02:50.652948 10772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe93cb1bec4bc1ad43b091fb49f120" candidate_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "305b05bc72f04d769644fbff5188bc26"
I20260709 13:02:50.657341 10588 leader_election.cc:304] T 110992c04e984796a1919262f4bbe67f P 66abd7e8893940bdbe81d60bffc91261 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66abd7e8893940bdbe81d60bffc91261, d895d0e90a3b45ed9aed3af8222a9b5d; no voters: 
I20260709 13:02:50.656791 10925 consensus_queue.cc:260] T 57fe93cb1bec4bc1ad43b091fb49f120 P 66abd7e8893940bdbe81d60bffc91261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.658414 10772 raft_consensus.cc:3060] T 57fe93cb1bec4bc1ad43b091fb49f120 P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:02:50.653369 10663 leader_election.cc:343] T 57fe93cb1bec4bc1ad43b091fb49f120 P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:50.653455 10922 leader_election.cc:290] T 110992c04e984796a1919262f4bbe67f P 66abd7e8893940bdbe81d60bffc91261 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683), 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947)
W20260709 13:02:50.659458 10590 leader_election.cc:343] T 110992c04e984796a1919262f4bbe67f P 66abd7e8893940bdbe81d60bffc91261 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:50.659976 10922 raft_consensus.cc:2804] T 110992c04e984796a1919262f4bbe67f P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:50.660477 10922 raft_consensus.cc:493] T 110992c04e984796a1919262f4bbe67f P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.661001 10922 raft_consensus.cc:3060] T 110992c04e984796a1919262f4bbe67f P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:50.663120 10926 raft_consensus.cc:359] T 30e72e0b20944bcbbea372c99c5f27fc P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.664009 10926 raft_consensus.cc:385] T 30e72e0b20944bcbbea372c99c5f27fc P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:50.664340 10926 raft_consensus.cc:740] T 30e72e0b20944bcbbea372c99c5f27fc P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d895d0e90a3b45ed9aed3af8222a9b5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:50.665212 10926 consensus_queue.cc:260] T 30e72e0b20944bcbbea372c99c5f27fc P d895d0e90a3b45ed9aed3af8222a9b5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.666414 10924 tablet_bootstrap.cc:492] T 110992c04e984796a1919262f4bbe67f P 305b05bc72f04d769644fbff5188bc26: No bootstrap required, opened a new log
I20260709 13:02:50.653043 10928 leader_election.cc:290] T 57fe93cb1bec4bc1ad43b091fb49f120 P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 1 election: Requested vote from peers 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009), 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947)
I20260709 13:02:50.667255 10924 ts_tablet_manager.cc:1403] T 110992c04e984796a1919262f4bbe67f P 305b05bc72f04d769644fbff5188bc26: Time spent bootstrapping tablet: real 0.046s	user 0.016s	sys 0.001s
I20260709 13:02:50.670738 10926 ts_tablet_manager.cc:1434] T 30e72e0b20944bcbbea372c99c5f27fc P d895d0e90a3b45ed9aed3af8222a9b5d: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:02:50.671362 10924 raft_consensus.cc:359] T 110992c04e984796a1919262f4bbe67f P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.676767 10924 raft_consensus.cc:385] T 110992c04e984796a1919262f4bbe67f P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:50.676370 10922 raft_consensus.cc:515] T 110992c04e984796a1919262f4bbe67f P 66abd7e8893940bdbe81d60bffc91261 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.677296 10924 raft_consensus.cc:740] T 110992c04e984796a1919262f4bbe67f P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 305b05bc72f04d769644fbff5188bc26, State: Initialized, Role: FOLLOWER
I20260709 13:02:50.679337 10922 leader_election.cc:290] T 110992c04e984796a1919262f4bbe67f P 66abd7e8893940bdbe81d60bffc91261 [CANDIDATE]: Term 1 election: Requested vote from peers d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683), 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947)
I20260709 13:02:50.680035 10924 consensus_queue.cc:260] T 110992c04e984796a1919262f4bbe67f P 305b05bc72f04d769644fbff5188bc26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.683108 10772 raft_consensus.cc:2468] T 57fe93cb1bec4bc1ad43b091fb49f120 P 305b05bc72f04d769644fbff5188bc26 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d895d0e90a3b45ed9aed3af8222a9b5d in term 1.
I20260709 13:02:50.684895 10665 leader_election.cc:304] T 57fe93cb1bec4bc1ad43b091fb49f120 P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 305b05bc72f04d769644fbff5188bc26, d895d0e90a3b45ed9aed3af8222a9b5d; no voters: 66abd7e8893940bdbe81d60bffc91261
I20260709 13:02:50.686197 10928 raft_consensus.cc:2804] T 57fe93cb1bec4bc1ad43b091fb49f120 P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:50.686719 10928 raft_consensus.cc:697] T 57fe93cb1bec4bc1ad43b091fb49f120 P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 LEADER]: Becoming Leader. State: Replica: d895d0e90a3b45ed9aed3af8222a9b5d, State: Running, Role: LEADER
I20260709 13:02:50.687053 10924 ts_tablet_manager.cc:1434] T 110992c04e984796a1919262f4bbe67f P 305b05bc72f04d769644fbff5188bc26: Time spent starting tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 13:02:50.687664 10928 consensus_queue.cc:237] T 57fe93cb1bec4bc1ad43b091fb49f120 P d895d0e90a3b45ed9aed3af8222a9b5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.688810 10924 tablet_bootstrap.cc:492] T 34e0b8824c444b59b50cc2c8f61f49af P 305b05bc72f04d769644fbff5188bc26: Bootstrap starting.
I20260709 13:02:50.672058 10926 tablet_bootstrap.cc:492] T 420a103ab9df43e9b3d34aacfd2325aa P d895d0e90a3b45ed9aed3af8222a9b5d: Bootstrap starting.
I20260709 13:02:50.692996 10903 raft_consensus.cc:493] T 30e72e0b20944bcbbea372c99c5f27fc P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.693830 10925 ts_tablet_manager.cc:1434] T 57fe93cb1bec4bc1ad43b091fb49f120 P 66abd7e8893940bdbe81d60bffc91261: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.022s
I20260709 13:02:50.693624 10903 raft_consensus.cc:515] T 30e72e0b20944bcbbea372c99c5f27fc P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.695158 10925 tablet_bootstrap.cc:492] T 30e72e0b20944bcbbea372c99c5f27fc P 66abd7e8893940bdbe81d60bffc91261: Bootstrap starting.
I20260709 13:02:50.697335 10621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e72e0b20944bcbbea372c99c5f27fc" candidate_uuid: "305b05bc72f04d769644fbff5188bc26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66abd7e8893940bdbe81d60bffc91261" is_pre_election: true
I20260709 13:02:50.698150 10903 leader_election.cc:290] T 30e72e0b20944bcbbea372c99c5f27fc P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009), d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683)
I20260709 13:02:50.699421 10698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e72e0b20944bcbbea372c99c5f27fc" candidate_uuid: "305b05bc72f04d769644fbff5188bc26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" is_pre_election: true
I20260709 13:02:50.700110 10698 raft_consensus.cc:2468] T 30e72e0b20944bcbbea372c99c5f27fc P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 305b05bc72f04d769644fbff5188bc26 in term 0.
W20260709 13:02:50.699043 10737 leader_election.cc:343] T 30e72e0b20944bcbbea372c99c5f27fc P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:50.702414 10737 leader_election.cc:304] T 30e72e0b20944bcbbea372c99c5f27fc P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 305b05bc72f04d769644fbff5188bc26, d895d0e90a3b45ed9aed3af8222a9b5d; no voters: 66abd7e8893940bdbe81d60bffc91261
I20260709 13:02:50.703734 10925 tablet_bootstrap.cc:654] T 30e72e0b20944bcbbea372c99c5f27fc P 66abd7e8893940bdbe81d60bffc91261: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:50.689829 10922 raft_consensus.cc:493] T b018c17ab00f46b6b1eab7e49e0adfe5 P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.704841 10922 raft_consensus.cc:515] T b018c17ab00f46b6b1eab7e49e0adfe5 P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.706305 10924 tablet_bootstrap.cc:654] T 34e0b8824c444b59b50cc2c8f61f49af P 305b05bc72f04d769644fbff5188bc26: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:50.707285 10922 leader_election.cc:290] T b018c17ab00f46b6b1eab7e49e0adfe5 P 66abd7e8893940bdbe81d60bffc91261 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683), 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947)
I20260709 13:02:50.707953 10903 raft_consensus.cc:2804] T 30e72e0b20944bcbbea372c99c5f27fc P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:02:50.708290 10588 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:33683, user_credentials={real_user=slave}} blocked reactor thread for 51200.1us
I20260709 13:02:50.708465 10903 raft_consensus.cc:493] T 30e72e0b20944bcbbea372c99c5f27fc P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.710795 10903 raft_consensus.cc:3060] T 30e72e0b20944bcbbea372c99c5f27fc P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:50.713028 10698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "110992c04e984796a1919262f4bbe67f" candidate_uuid: "66abd7e8893940bdbe81d60bffc91261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d"
I20260709 13:02:50.713899 10698 raft_consensus.cc:3060] T 110992c04e984796a1919262f4bbe67f P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:50.716451 10699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b018c17ab00f46b6b1eab7e49e0adfe5" candidate_uuid: "66abd7e8893940bdbe81d60bffc91261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" is_pre_election: true
I20260709 13:02:50.717450 10699 raft_consensus.cc:2468] T b018c17ab00f46b6b1eab7e49e0adfe5 P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66abd7e8893940bdbe81d60bffc91261 in term 0.
I20260709 13:02:50.737090 10588 leader_election.cc:304] T b018c17ab00f46b6b1eab7e49e0adfe5 P 66abd7e8893940bdbe81d60bffc91261 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66abd7e8893940bdbe81d60bffc91261, d895d0e90a3b45ed9aed3af8222a9b5d; no voters: 
I20260709 13:02:50.742862 10922 raft_consensus.cc:2804] T b018c17ab00f46b6b1eab7e49e0adfe5 P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:50.743543 10922 raft_consensus.cc:493] T b018c17ab00f46b6b1eab7e49e0adfe5 P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.744019 10922 raft_consensus.cc:3060] T b018c17ab00f46b6b1eab7e49e0adfe5 P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:50.750581 10926 tablet_bootstrap.cc:654] T 420a103ab9df43e9b3d34aacfd2325aa P d895d0e90a3b45ed9aed3af8222a9b5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:50.763190 10772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "110992c04e984796a1919262f4bbe67f" candidate_uuid: "66abd7e8893940bdbe81d60bffc91261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "305b05bc72f04d769644fbff5188bc26"
I20260709 13:02:50.764201 10772 raft_consensus.cc:3060] T 110992c04e984796a1919262f4bbe67f P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:50.771307 10773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b018c17ab00f46b6b1eab7e49e0adfe5" candidate_uuid: "66abd7e8893940bdbe81d60bffc91261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "305b05bc72f04d769644fbff5188bc26" is_pre_election: true
I20260709 13:02:50.772071 10773 raft_consensus.cc:2468] T b018c17ab00f46b6b1eab7e49e0adfe5 P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66abd7e8893940bdbe81d60bffc91261 in term 0.
I20260709 13:02:50.784855 10925 tablet_bootstrap.cc:492] T 30e72e0b20944bcbbea372c99c5f27fc P 66abd7e8893940bdbe81d60bffc91261: No bootstrap required, opened a new log
I20260709 13:02:50.785704 10925 ts_tablet_manager.cc:1403] T 30e72e0b20944bcbbea372c99c5f27fc P 66abd7e8893940bdbe81d60bffc91261: Time spent bootstrapping tablet: real 0.091s	user 0.022s	sys 0.016s
I20260709 13:02:50.788568 10519 catalog_manager.cc:5697] T 57fe93cb1bec4bc1ad43b091fb49f120 P d895d0e90a3b45ed9aed3af8222a9b5d reported cstate change: term changed from 0 to 1, leader changed from <none> to d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194). New cstate: current_term: 1 leader_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:50.775832 10922 raft_consensus.cc:515] T b018c17ab00f46b6b1eab7e49e0adfe5 P 66abd7e8893940bdbe81d60bffc91261 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.794766 10922 leader_election.cc:290] T b018c17ab00f46b6b1eab7e49e0adfe5 P 66abd7e8893940bdbe81d60bffc91261 [CANDIDATE]: Term 1 election: Requested vote from peers d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683), 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947)
I20260709 13:02:50.795185 10698 raft_consensus.cc:2468] T 110992c04e984796a1919262f4bbe67f P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66abd7e8893940bdbe81d60bffc91261 in term 1.
I20260709 13:02:50.795804 10924 tablet_bootstrap.cc:492] T 34e0b8824c444b59b50cc2c8f61f49af P 305b05bc72f04d769644fbff5188bc26: No bootstrap required, opened a new log
I20260709 13:02:50.772408 10903 raft_consensus.cc:515] T 30e72e0b20944bcbbea372c99c5f27fc P 305b05bc72f04d769644fbff5188bc26 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.798630 10588 leader_election.cc:304] T 110992c04e984796a1919262f4bbe67f P 66abd7e8893940bdbe81d60bffc91261 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66abd7e8893940bdbe81d60bffc91261, d895d0e90a3b45ed9aed3af8222a9b5d; no voters: 
I20260709 13:02:50.799018 10903 leader_election.cc:290] T 30e72e0b20944bcbbea372c99c5f27fc P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 1 election: Requested vote from peers 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009), d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683)
I20260709 13:02:50.800763 10621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e72e0b20944bcbbea372c99c5f27fc" candidate_uuid: "305b05bc72f04d769644fbff5188bc26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66abd7e8893940bdbe81d60bffc91261"
I20260709 13:02:50.800958 10699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e72e0b20944bcbbea372c99c5f27fc" candidate_uuid: "305b05bc72f04d769644fbff5188bc26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d"
I20260709 13:02:50.801606 10699 raft_consensus.cc:3060] T 30e72e0b20944bcbbea372c99c5f27fc P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:50.804821 10922 raft_consensus.cc:2804] T 110992c04e984796a1919262f4bbe67f P 66abd7e8893940bdbe81d60bffc91261 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:50.780292 10772 raft_consensus.cc:2468] T 110992c04e984796a1919262f4bbe67f P 305b05bc72f04d769644fbff5188bc26 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66abd7e8893940bdbe81d60bffc91261 in term 1.
I20260709 13:02:50.796687 10924 ts_tablet_manager.cc:1403] T 34e0b8824c444b59b50cc2c8f61f49af P 305b05bc72f04d769644fbff5188bc26: Time spent bootstrapping tablet: real 0.108s	user 0.029s	sys 0.032s
I20260709 13:02:50.810729 10699 raft_consensus.cc:2468] T 30e72e0b20944bcbbea372c99c5f27fc P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 305b05bc72f04d769644fbff5188bc26 in term 1.
W20260709 13:02:50.812853 10737 leader_election.cc:343] T 30e72e0b20944bcbbea372c99c5f27fc P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:50.809247 10922 raft_consensus.cc:697] T 110992c04e984796a1919262f4bbe67f P 66abd7e8893940bdbe81d60bffc91261 [term 1 LEADER]: Becoming Leader. State: Replica: 66abd7e8893940bdbe81d60bffc91261, State: Running, Role: LEADER
I20260709 13:02:50.816557 10737 leader_election.cc:304] T 30e72e0b20944bcbbea372c99c5f27fc P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 305b05bc72f04d769644fbff5188bc26, d895d0e90a3b45ed9aed3af8222a9b5d; no voters: 66abd7e8893940bdbe81d60bffc91261
I20260709 13:02:50.816387 10922 consensus_queue.cc:237] T 110992c04e984796a1919262f4bbe67f P 66abd7e8893940bdbe81d60bffc91261 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.818152 10903 raft_consensus.cc:2804] T 30e72e0b20944bcbbea372c99c5f27fc P 305b05bc72f04d769644fbff5188bc26 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:50.812153 10925 raft_consensus.cc:359] T 30e72e0b20944bcbbea372c99c5f27fc P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.819591 10903 raft_consensus.cc:697] T 30e72e0b20944bcbbea372c99c5f27fc P 305b05bc72f04d769644fbff5188bc26 [term 1 LEADER]: Becoming Leader. State: Replica: 305b05bc72f04d769644fbff5188bc26, State: Running, Role: LEADER
I20260709 13:02:50.820948 10925 raft_consensus.cc:385] T 30e72e0b20944bcbbea372c99c5f27fc P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:50.820668 10924 raft_consensus.cc:359] T 34e0b8824c444b59b50cc2c8f61f49af P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.821413 10925 raft_consensus.cc:740] T 30e72e0b20944bcbbea372c99c5f27fc P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66abd7e8893940bdbe81d60bffc91261, State: Initialized, Role: FOLLOWER
I20260709 13:02:50.821722 10924 raft_consensus.cc:385] T 34e0b8824c444b59b50cc2c8f61f49af P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:50.822227 10924 raft_consensus.cc:740] T 34e0b8824c444b59b50cc2c8f61f49af P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 305b05bc72f04d769644fbff5188bc26, State: Initialized, Role: FOLLOWER
I20260709 13:02:50.822310 10925 consensus_queue.cc:260] T 30e72e0b20944bcbbea372c99c5f27fc P 66abd7e8893940bdbe81d60bffc91261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.821637 10903 consensus_queue.cc:237] T 30e72e0b20944bcbbea372c99c5f27fc P 305b05bc72f04d769644fbff5188bc26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.820092 10698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b018c17ab00f46b6b1eab7e49e0adfe5" candidate_uuid: "66abd7e8893940bdbe81d60bffc91261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d"
I20260709 13:02:50.823799 10698 raft_consensus.cc:3060] T b018c17ab00f46b6b1eab7e49e0adfe5 P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:50.823029 10924 consensus_queue.cc:260] T 34e0b8824c444b59b50cc2c8f61f49af P 305b05bc72f04d769644fbff5188bc26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.824747 10772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b018c17ab00f46b6b1eab7e49e0adfe5" candidate_uuid: "66abd7e8893940bdbe81d60bffc91261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "305b05bc72f04d769644fbff5188bc26"
I20260709 13:02:50.825678 10772 raft_consensus.cc:3060] T b018c17ab00f46b6b1eab7e49e0adfe5 P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:50.830729 10698 raft_consensus.cc:2468] T b018c17ab00f46b6b1eab7e49e0adfe5 P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66abd7e8893940bdbe81d60bffc91261 in term 1.
I20260709 13:02:50.832149 10588 leader_election.cc:304] T b018c17ab00f46b6b1eab7e49e0adfe5 P 66abd7e8893940bdbe81d60bffc91261 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66abd7e8893940bdbe81d60bffc91261, d895d0e90a3b45ed9aed3af8222a9b5d; no voters: 
I20260709 13:02:50.833288 10947 raft_consensus.cc:2804] T b018c17ab00f46b6b1eab7e49e0adfe5 P 66abd7e8893940bdbe81d60bffc91261 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:50.833887 10947 raft_consensus.cc:697] T b018c17ab00f46b6b1eab7e49e0adfe5 P 66abd7e8893940bdbe81d60bffc91261 [term 1 LEADER]: Becoming Leader. State: Replica: 66abd7e8893940bdbe81d60bffc91261, State: Running, Role: LEADER
I20260709 13:02:50.834811 10947 consensus_queue.cc:237] T b018c17ab00f46b6b1eab7e49e0adfe5 P 66abd7e8893940bdbe81d60bffc91261 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.833194 10926 tablet_bootstrap.cc:492] T 420a103ab9df43e9b3d34aacfd2325aa P d895d0e90a3b45ed9aed3af8222a9b5d: No bootstrap required, opened a new log
I20260709 13:02:50.840130 10926 ts_tablet_manager.cc:1403] T 420a103ab9df43e9b3d34aacfd2325aa P d895d0e90a3b45ed9aed3af8222a9b5d: Time spent bootstrapping tablet: real 0.168s	user 0.038s	sys 0.037s
I20260709 13:02:50.840255 10924 ts_tablet_manager.cc:1434] T 34e0b8824c444b59b50cc2c8f61f49af P 305b05bc72f04d769644fbff5188bc26: Time spent starting tablet: real 0.025s	user 0.010s	sys 0.000s
I20260709 13:02:50.841722 10924 tablet_bootstrap.cc:492] T 420a103ab9df43e9b3d34aacfd2325aa P 305b05bc72f04d769644fbff5188bc26: Bootstrap starting.
I20260709 13:02:50.849753 10925 ts_tablet_manager.cc:1434] T 30e72e0b20944bcbbea372c99c5f27fc P 66abd7e8893940bdbe81d60bffc91261: Time spent starting tablet: real 0.064s	user 0.009s	sys 0.003s
I20260709 13:02:50.851104 10925 tablet_bootstrap.cc:492] T 420a103ab9df43e9b3d34aacfd2325aa P 66abd7e8893940bdbe81d60bffc91261: Bootstrap starting.
I20260709 13:02:50.856055 10924 tablet_bootstrap.cc:654] T 420a103ab9df43e9b3d34aacfd2325aa P 305b05bc72f04d769644fbff5188bc26: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:50.856698 10926 raft_consensus.cc:359] T 420a103ab9df43e9b3d34aacfd2325aa P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.860870 10926 raft_consensus.cc:385] T 420a103ab9df43e9b3d34aacfd2325aa P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:50.861330 10926 raft_consensus.cc:740] T 420a103ab9df43e9b3d34aacfd2325aa P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d895d0e90a3b45ed9aed3af8222a9b5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:50.862421 10926 consensus_queue.cc:260] T 420a103ab9df43e9b3d34aacfd2325aa P d895d0e90a3b45ed9aed3af8222a9b5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.870735 10925 tablet_bootstrap.cc:654] T 420a103ab9df43e9b3d34aacfd2325aa P 66abd7e8893940bdbe81d60bffc91261: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:50.873500 10772 raft_consensus.cc:2468] T b018c17ab00f46b6b1eab7e49e0adfe5 P 305b05bc72f04d769644fbff5188bc26 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66abd7e8893940bdbe81d60bffc91261 in term 1.
I20260709 13:02:50.873559 10519 catalog_manager.cc:5697] T 110992c04e984796a1919262f4bbe67f P 66abd7e8893940bdbe81d60bffc91261 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "66abd7e8893940bdbe81d60bffc91261" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:50.875531 10926 ts_tablet_manager.cc:1434] T 420a103ab9df43e9b3d34aacfd2325aa P d895d0e90a3b45ed9aed3af8222a9b5d: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 13:02:50.876776 10926 tablet_bootstrap.cc:492] T 34e0b8824c444b59b50cc2c8f61f49af P d895d0e90a3b45ed9aed3af8222a9b5d: Bootstrap starting.
I20260709 13:02:50.876241 10519 catalog_manager.cc:5697] T b018c17ab00f46b6b1eab7e49e0adfe5 P 66abd7e8893940bdbe81d60bffc91261 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "66abd7e8893940bdbe81d60bffc91261" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:50.889443 10926 tablet_bootstrap.cc:654] T 34e0b8824c444b59b50cc2c8f61f49af P d895d0e90a3b45ed9aed3af8222a9b5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:50.892222 10924 tablet_bootstrap.cc:492] T 420a103ab9df43e9b3d34aacfd2325aa P 305b05bc72f04d769644fbff5188bc26: No bootstrap required, opened a new log
I20260709 13:02:50.891810 10522 catalog_manager.cc:5697] T 30e72e0b20944bcbbea372c99c5f27fc P 305b05bc72f04d769644fbff5188bc26 reported cstate change: term changed from 0 to 1, leader changed from <none> to 305b05bc72f04d769644fbff5188bc26 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "305b05bc72f04d769644fbff5188bc26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:50.892884 10924 ts_tablet_manager.cc:1403] T 420a103ab9df43e9b3d34aacfd2325aa P 305b05bc72f04d769644fbff5188bc26: Time spent bootstrapping tablet: real 0.051s	user 0.015s	sys 0.001s
I20260709 13:02:50.897429 10925 tablet_bootstrap.cc:492] T 420a103ab9df43e9b3d34aacfd2325aa P 66abd7e8893940bdbe81d60bffc91261: No bootstrap required, opened a new log
I20260709 13:02:50.898036 10925 ts_tablet_manager.cc:1403] T 420a103ab9df43e9b3d34aacfd2325aa P 66abd7e8893940bdbe81d60bffc91261: Time spent bootstrapping tablet: real 0.047s	user 0.012s	sys 0.003s
I20260709 13:02:50.900799 10925 raft_consensus.cc:359] T 420a103ab9df43e9b3d34aacfd2325aa P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.901363 10926 tablet_bootstrap.cc:492] T 34e0b8824c444b59b50cc2c8f61f49af P d895d0e90a3b45ed9aed3af8222a9b5d: No bootstrap required, opened a new log
I20260709 13:02:50.901592 10925 raft_consensus.cc:385] T 420a103ab9df43e9b3d34aacfd2325aa P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:50.902001 10925 raft_consensus.cc:740] T 420a103ab9df43e9b3d34aacfd2325aa P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66abd7e8893940bdbe81d60bffc91261, State: Initialized, Role: FOLLOWER
I20260709 13:02:50.902078 10926 ts_tablet_manager.cc:1403] T 34e0b8824c444b59b50cc2c8f61f49af P d895d0e90a3b45ed9aed3af8222a9b5d: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.004s
I20260709 13:02:50.902849 10925 consensus_queue.cc:260] T 420a103ab9df43e9b3d34aacfd2325aa P 66abd7e8893940bdbe81d60bffc91261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.903223 10924 raft_consensus.cc:359] T 420a103ab9df43e9b3d34aacfd2325aa P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.904095 10924 raft_consensus.cc:385] T 420a103ab9df43e9b3d34aacfd2325aa P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:50.904742 10924 raft_consensus.cc:740] T 420a103ab9df43e9b3d34aacfd2325aa P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 305b05bc72f04d769644fbff5188bc26, State: Initialized, Role: FOLLOWER
I20260709 13:02:50.905730 10925 ts_tablet_manager.cc:1434] T 420a103ab9df43e9b3d34aacfd2325aa P 66abd7e8893940bdbe81d60bffc91261: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:02:50.905656 10924 consensus_queue.cc:260] T 420a103ab9df43e9b3d34aacfd2325aa P 305b05bc72f04d769644fbff5188bc26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.908454 10924 ts_tablet_manager.cc:1434] T 420a103ab9df43e9b3d34aacfd2325aa P 305b05bc72f04d769644fbff5188bc26: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.002s
I20260709 13:02:50.908066 10926 raft_consensus.cc:359] T 34e0b8824c444b59b50cc2c8f61f49af P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.909018 10926 raft_consensus.cc:385] T 34e0b8824c444b59b50cc2c8f61f49af P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:50.909382 10926 raft_consensus.cc:740] T 34e0b8824c444b59b50cc2c8f61f49af P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d895d0e90a3b45ed9aed3af8222a9b5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:50.909855 10924 tablet_bootstrap.cc:492] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P 305b05bc72f04d769644fbff5188bc26: Bootstrap starting.
I20260709 13:02:50.910243 10926 consensus_queue.cc:260] T 34e0b8824c444b59b50cc2c8f61f49af P d895d0e90a3b45ed9aed3af8222a9b5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.913064 10926 ts_tablet_manager.cc:1434] T 34e0b8824c444b59b50cc2c8f61f49af P d895d0e90a3b45ed9aed3af8222a9b5d: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.003s
I20260709 13:02:50.914147 10926 tablet_bootstrap.cc:492] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P d895d0e90a3b45ed9aed3af8222a9b5d: Bootstrap starting.
I20260709 13:02:50.916818 10925 tablet_bootstrap.cc:492] T 70931771066e47f7a57a558edb1b3e61 P 66abd7e8893940bdbe81d60bffc91261: Bootstrap starting.
I20260709 13:02:50.918120 10924 tablet_bootstrap.cc:654] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P 305b05bc72f04d769644fbff5188bc26: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:50.921625 10926 tablet_bootstrap.cc:654] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P d895d0e90a3b45ed9aed3af8222a9b5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:50.926981 10925 tablet_bootstrap.cc:654] T 70931771066e47f7a57a558edb1b3e61 P 66abd7e8893940bdbe81d60bffc91261: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:50.931052 10924 tablet_bootstrap.cc:492] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P 305b05bc72f04d769644fbff5188bc26: No bootstrap required, opened a new log
I20260709 13:02:50.931813 10924 ts_tablet_manager.cc:1403] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P 305b05bc72f04d769644fbff5188bc26: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.007s
I20260709 13:02:50.938135 10924 raft_consensus.cc:359] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.940744 10924 raft_consensus.cc:385] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:50.941232 10924 raft_consensus.cc:740] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 305b05bc72f04d769644fbff5188bc26, State: Initialized, Role: FOLLOWER
I20260709 13:02:50.942591 10924 consensus_queue.cc:260] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P 305b05bc72f04d769644fbff5188bc26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.944844 10926 tablet_bootstrap.cc:492] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P d895d0e90a3b45ed9aed3af8222a9b5d: No bootstrap required, opened a new log
I20260709 13:02:50.945427 10926 ts_tablet_manager.cc:1403] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P d895d0e90a3b45ed9aed3af8222a9b5d: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.016s
I20260709 13:02:50.945823 10924 ts_tablet_manager.cc:1434] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P 305b05bc72f04d769644fbff5188bc26: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.005s
I20260709 13:02:50.947175 10947 raft_consensus.cc:493] T 420a103ab9df43e9b3d34aacfd2325aa P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.947446 10924 tablet_bootstrap.cc:492] T 70931771066e47f7a57a558edb1b3e61 P 305b05bc72f04d769644fbff5188bc26: Bootstrap starting.
I20260709 13:02:50.947724 10947 raft_consensus.cc:515] T 420a103ab9df43e9b3d34aacfd2325aa P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.948295 10926 raft_consensus.cc:359] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.949070 10926 raft_consensus.cc:385] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:50.949374 10926 raft_consensus.cc:740] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d895d0e90a3b45ed9aed3af8222a9b5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:50.949925 10947 leader_election.cc:290] T 420a103ab9df43e9b3d34aacfd2325aa P 66abd7e8893940bdbe81d60bffc91261 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683), 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947)
I20260709 13:02:50.950153 10926 consensus_queue.cc:260] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P d895d0e90a3b45ed9aed3af8222a9b5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.950727 10698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "420a103ab9df43e9b3d34aacfd2325aa" candidate_uuid: "66abd7e8893940bdbe81d60bffc91261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" is_pre_election: true
I20260709 13:02:50.951375 10698 raft_consensus.cc:2468] T 420a103ab9df43e9b3d34aacfd2325aa P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66abd7e8893940bdbe81d60bffc91261 in term 0.
I20260709 13:02:50.951596 10772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "420a103ab9df43e9b3d34aacfd2325aa" candidate_uuid: "66abd7e8893940bdbe81d60bffc91261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "305b05bc72f04d769644fbff5188bc26" is_pre_election: true
I20260709 13:02:50.952350 10772 raft_consensus.cc:2468] T 420a103ab9df43e9b3d34aacfd2325aa P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66abd7e8893940bdbe81d60bffc91261 in term 0.
I20260709 13:02:50.952819 10588 leader_election.cc:304] T 420a103ab9df43e9b3d34aacfd2325aa P 66abd7e8893940bdbe81d60bffc91261 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66abd7e8893940bdbe81d60bffc91261, d895d0e90a3b45ed9aed3af8222a9b5d; no voters: 
I20260709 13:02:50.954020 10947 raft_consensus.cc:2804] T 420a103ab9df43e9b3d34aacfd2325aa P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:50.954386 10947 raft_consensus.cc:493] T 420a103ab9df43e9b3d34aacfd2325aa P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:50.954725 10947 raft_consensus.cc:3060] T 420a103ab9df43e9b3d34aacfd2325aa P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:50.955130 10924 tablet_bootstrap.cc:654] T 70931771066e47f7a57a558edb1b3e61 P 305b05bc72f04d769644fbff5188bc26: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:50.958967 10926 ts_tablet_manager.cc:1434] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P d895d0e90a3b45ed9aed3af8222a9b5d: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 13:02:50.960074 10926 tablet_bootstrap.cc:492] T 70931771066e47f7a57a558edb1b3e61 P d895d0e90a3b45ed9aed3af8222a9b5d: Bootstrap starting.
I20260709 13:02:50.965344 10947 raft_consensus.cc:515] T 420a103ab9df43e9b3d34aacfd2325aa P 66abd7e8893940bdbe81d60bffc91261 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.966511 10924 tablet_bootstrap.cc:492] T 70931771066e47f7a57a558edb1b3e61 P 305b05bc72f04d769644fbff5188bc26: No bootstrap required, opened a new log
I20260709 13:02:50.967034 10924 ts_tablet_manager.cc:1403] T 70931771066e47f7a57a558edb1b3e61 P 305b05bc72f04d769644fbff5188bc26: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.003s
I20260709 13:02:50.968366 10698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "420a103ab9df43e9b3d34aacfd2325aa" candidate_uuid: "66abd7e8893940bdbe81d60bffc91261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d"
I20260709 13:02:50.968679 10772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "420a103ab9df43e9b3d34aacfd2325aa" candidate_uuid: "66abd7e8893940bdbe81d60bffc91261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "305b05bc72f04d769644fbff5188bc26"
I20260709 13:02:50.969045 10698 raft_consensus.cc:3060] T 420a103ab9df43e9b3d34aacfd2325aa P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:50.969286 10772 raft_consensus.cc:3060] T 420a103ab9df43e9b3d34aacfd2325aa P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:50.969405 10926 tablet_bootstrap.cc:654] T 70931771066e47f7a57a558edb1b3e61 P d895d0e90a3b45ed9aed3af8222a9b5d: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:50.969771 10924 raft_consensus.cc:359] T 70931771066e47f7a57a558edb1b3e61 P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.970489 10924 raft_consensus.cc:385] T 70931771066e47f7a57a558edb1b3e61 P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:50.970754 10924 raft_consensus.cc:740] T 70931771066e47f7a57a558edb1b3e61 P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 305b05bc72f04d769644fbff5188bc26, State: Initialized, Role: FOLLOWER
I20260709 13:02:50.971439 10924 consensus_queue.cc:260] T 70931771066e47f7a57a558edb1b3e61 P 305b05bc72f04d769644fbff5188bc26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.973661 10924 ts_tablet_manager.cc:1434] T 70931771066e47f7a57a558edb1b3e61 P 305b05bc72f04d769644fbff5188bc26: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:02:50.976383 10925 tablet_bootstrap.cc:492] T 70931771066e47f7a57a558edb1b3e61 P 66abd7e8893940bdbe81d60bffc91261: No bootstrap required, opened a new log
I20260709 13:02:50.976974 10925 ts_tablet_manager.cc:1403] T 70931771066e47f7a57a558edb1b3e61 P 66abd7e8893940bdbe81d60bffc91261: Time spent bootstrapping tablet: real 0.060s	user 0.022s	sys 0.007s
I20260709 13:02:50.977133 10772 raft_consensus.cc:2468] T 420a103ab9df43e9b3d34aacfd2325aa P 305b05bc72f04d769644fbff5188bc26 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66abd7e8893940bdbe81d60bffc91261 in term 1.
I20260709 13:02:50.978499 10590 leader_election.cc:304] T 420a103ab9df43e9b3d34aacfd2325aa P 66abd7e8893940bdbe81d60bffc91261 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 305b05bc72f04d769644fbff5188bc26, 66abd7e8893940bdbe81d60bffc91261; no voters: 
I20260709 13:02:50.979465 10922 raft_consensus.cc:2804] T 420a103ab9df43e9b3d34aacfd2325aa P 66abd7e8893940bdbe81d60bffc91261 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:50.979954 10922 raft_consensus.cc:697] T 420a103ab9df43e9b3d34aacfd2325aa P 66abd7e8893940bdbe81d60bffc91261 [term 1 LEADER]: Becoming Leader. State: Replica: 66abd7e8893940bdbe81d60bffc91261, State: Running, Role: LEADER
I20260709 13:02:50.980737 10925 raft_consensus.cc:359] T 70931771066e47f7a57a558edb1b3e61 P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.981828 10947 leader_election.cc:290] T 420a103ab9df43e9b3d34aacfd2325aa P 66abd7e8893940bdbe81d60bffc91261 [CANDIDATE]: Term 1 election: Requested vote from peers d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683), 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947)
I20260709 13:02:50.980811 10922 consensus_queue.cc:237] T 420a103ab9df43e9b3d34aacfd2325aa P 66abd7e8893940bdbe81d60bffc91261 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.981947 10926 tablet_bootstrap.cc:492] T 70931771066e47f7a57a558edb1b3e61 P d895d0e90a3b45ed9aed3af8222a9b5d: No bootstrap required, opened a new log
I20260709 13:02:50.981501 10925 raft_consensus.cc:385] T 70931771066e47f7a57a558edb1b3e61 P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:50.982709 10926 ts_tablet_manager.cc:1403] T 70931771066e47f7a57a558edb1b3e61 P d895d0e90a3b45ed9aed3af8222a9b5d: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.008s
I20260709 13:02:50.982764 10925 raft_consensus.cc:740] T 70931771066e47f7a57a558edb1b3e61 P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66abd7e8893940bdbe81d60bffc91261, State: Initialized, Role: FOLLOWER
I20260709 13:02:50.983733 10925 consensus_queue.cc:260] T 70931771066e47f7a57a558edb1b3e61 P 66abd7e8893940bdbe81d60bffc91261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.986112 10925 ts_tablet_manager.cc:1434] T 70931771066e47f7a57a558edb1b3e61 P 66abd7e8893940bdbe81d60bffc91261: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:02:50.986155 10903 raft_consensus.cc:493] T 34e0b8824c444b59b50cc2c8f61f49af P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:50.986006 10926 raft_consensus.cc:359] T 70931771066e47f7a57a558edb1b3e61 P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.986900 10903 raft_consensus.cc:515] T 34e0b8824c444b59b50cc2c8f61f49af P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:50.987524 10926 raft_consensus.cc:385] T 70931771066e47f7a57a558edb1b3e61 P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:50.988010 10926 raft_consensus.cc:740] T 70931771066e47f7a57a558edb1b3e61 P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d895d0e90a3b45ed9aed3af8222a9b5d, State: Initialized, Role: FOLLOWER
I20260709 13:02:50.987360 10925 tablet_bootstrap.cc:492] T 34e0b8824c444b59b50cc2c8f61f49af P 66abd7e8893940bdbe81d60bffc91261: Bootstrap starting.
I20260709 13:02:50.986455 10698 raft_consensus.cc:2468] T 420a103ab9df43e9b3d34aacfd2325aa P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66abd7e8893940bdbe81d60bffc91261 in term 1.
I20260709 13:02:50.989398 10903 leader_election.cc:290] T 34e0b8824c444b59b50cc2c8f61f49af P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009), d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683)
I20260709 13:02:50.991788 10621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e0b8824c444b59b50cc2c8f61f49af" candidate_uuid: "305b05bc72f04d769644fbff5188bc26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66abd7e8893940bdbe81d60bffc91261" is_pre_election: true
W20260709 13:02:50.993610 10737 leader_election.cc:343] T 34e0b8824c444b59b50cc2c8f61f49af P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:02:50.992835 10698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e0b8824c444b59b50cc2c8f61f49af" candidate_uuid: "305b05bc72f04d769644fbff5188bc26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" is_pre_election: true
I20260709 13:02:51.005343 10925 tablet_bootstrap.cc:654] T 34e0b8824c444b59b50cc2c8f61f49af P 66abd7e8893940bdbe81d60bffc91261: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:51.005709 10698 raft_consensus.cc:2468] T 34e0b8824c444b59b50cc2c8f61f49af P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 305b05bc72f04d769644fbff5188bc26 in term 0.
I20260709 13:02:51.002004 10922 raft_consensus.cc:493] T 30e72e0b20944bcbbea372c99c5f27fc P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.007081 10922 raft_consensus.cc:515] T 30e72e0b20944bcbbea372c99c5f27fc P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:51.007443 10737 leader_election.cc:304] T 34e0b8824c444b59b50cc2c8f61f49af P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 305b05bc72f04d769644fbff5188bc26, d895d0e90a3b45ed9aed3af8222a9b5d; no voters: 66abd7e8893940bdbe81d60bffc91261
I20260709 13:02:51.008783 10903 raft_consensus.cc:2804] T 34e0b8824c444b59b50cc2c8f61f49af P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:51.009171 10903 raft_consensus.cc:493] T 34e0b8824c444b59b50cc2c8f61f49af P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:51.009684 10922 leader_election.cc:290] T 30e72e0b20944bcbbea372c99c5f27fc P 66abd7e8893940bdbe81d60bffc91261 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683), 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947)
I20260709 13:02:51.010465 10699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e72e0b20944bcbbea372c99c5f27fc" candidate_uuid: "66abd7e8893940bdbe81d60bffc91261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" is_pre_election: true
I20260709 13:02:51.011008 10772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e72e0b20944bcbbea372c99c5f27fc" candidate_uuid: "66abd7e8893940bdbe81d60bffc91261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "305b05bc72f04d769644fbff5188bc26" is_pre_election: true
I20260709 13:02:51.011451 10699 raft_consensus.cc:2393] T 30e72e0b20944bcbbea372c99c5f27fc P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66abd7e8893940bdbe81d60bffc91261 in current term 1: Already voted for candidate 305b05bc72f04d769644fbff5188bc26 in this term.
I20260709 13:02:50.994302 10926 consensus_queue.cc:260] T 70931771066e47f7a57a558edb1b3e61 P d895d0e90a3b45ed9aed3af8222a9b5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:51.014238 10926 ts_tablet_manager.cc:1434] T 70931771066e47f7a57a558edb1b3e61 P d895d0e90a3b45ed9aed3af8222a9b5d: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.003s
I20260709 13:02:51.015406 10590 leader_election.cc:304] T 30e72e0b20944bcbbea372c99c5f27fc P 66abd7e8893940bdbe81d60bffc91261 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66abd7e8893940bdbe81d60bffc91261; no voters: 305b05bc72f04d769644fbff5188bc26, d895d0e90a3b45ed9aed3af8222a9b5d
I20260709 13:02:51.015556 10903 raft_consensus.cc:3060] T 34e0b8824c444b59b50cc2c8f61f49af P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:50.999673 10521 catalog_manager.cc:5697] T 420a103ab9df43e9b3d34aacfd2325aa P 66abd7e8893940bdbe81d60bffc91261 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193). New cstate: current_term: 1 leader_uuid: "66abd7e8893940bdbe81d60bffc91261" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:51.016626 10922 raft_consensus.cc:3060] T 30e72e0b20944bcbbea372c99c5f27fc P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:51.021752 10925 tablet_bootstrap.cc:492] T 34e0b8824c444b59b50cc2c8f61f49af P 66abd7e8893940bdbe81d60bffc91261: No bootstrap required, opened a new log
I20260709 13:02:51.022344 10925 ts_tablet_manager.cc:1403] T 34e0b8824c444b59b50cc2c8f61f49af P 66abd7e8893940bdbe81d60bffc91261: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.013s
I20260709 13:02:51.024261 10922 raft_consensus.cc:2749] T 30e72e0b20944bcbbea372c99c5f27fc P 66abd7e8893940bdbe81d60bffc91261 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:51.026146 10925 raft_consensus.cc:359] T 34e0b8824c444b59b50cc2c8f61f49af P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:51.026952 10925 raft_consensus.cc:385] T 34e0b8824c444b59b50cc2c8f61f49af P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:51.027277 10925 raft_consensus.cc:740] T 34e0b8824c444b59b50cc2c8f61f49af P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66abd7e8893940bdbe81d60bffc91261, State: Initialized, Role: FOLLOWER
I20260709 13:02:51.028019 10925 consensus_queue.cc:260] T 34e0b8824c444b59b50cc2c8f61f49af P 66abd7e8893940bdbe81d60bffc91261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:51.030278 10925 ts_tablet_manager.cc:1434] T 34e0b8824c444b59b50cc2c8f61f49af P 66abd7e8893940bdbe81d60bffc91261: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:02:51.031503 10925 tablet_bootstrap.cc:492] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P 66abd7e8893940bdbe81d60bffc91261: Bootstrap starting.
I20260709 13:02:51.031576 10772 raft_consensus.cc:3060] T b498f794eab54c15846243452d7992e0 P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:51.032451 10903 raft_consensus.cc:515] T 34e0b8824c444b59b50cc2c8f61f49af P 305b05bc72f04d769644fbff5188bc26 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:51.034904 10903 leader_election.cc:290] T 34e0b8824c444b59b50cc2c8f61f49af P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 1 election: Requested vote from peers 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009), d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683)
I20260709 13:02:51.036470 10698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e0b8824c444b59b50cc2c8f61f49af" candidate_uuid: "305b05bc72f04d769644fbff5188bc26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d"
I20260709 13:02:51.036940 10621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e0b8824c444b59b50cc2c8f61f49af" candidate_uuid: "305b05bc72f04d769644fbff5188bc26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66abd7e8893940bdbe81d60bffc91261"
I20260709 13:02:51.037107 10698 raft_consensus.cc:3060] T 34e0b8824c444b59b50cc2c8f61f49af P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:51.037595 10621 raft_consensus.cc:3060] T 34e0b8824c444b59b50cc2c8f61f49af P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:51.043779 10698 raft_consensus.cc:2468] T 34e0b8824c444b59b50cc2c8f61f49af P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 305b05bc72f04d769644fbff5188bc26 in term 1.
I20260709 13:02:51.044597 10928 consensus_queue.cc:1048] T b498f794eab54c15846243452d7992e0 P d895d0e90a3b45ed9aed3af8222a9b5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:51.044871 10621 raft_consensus.cc:2468] T 34e0b8824c444b59b50cc2c8f61f49af P 66abd7e8893940bdbe81d60bffc91261 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 305b05bc72f04d769644fbff5188bc26 in term 1.
I20260709 13:02:51.045109 10737 leader_election.cc:304] T 34e0b8824c444b59b50cc2c8f61f49af P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 305b05bc72f04d769644fbff5188bc26, d895d0e90a3b45ed9aed3af8222a9b5d; no voters: 
I20260709 13:02:51.046763 10903 raft_consensus.cc:2804] T 34e0b8824c444b59b50cc2c8f61f49af P 305b05bc72f04d769644fbff5188bc26 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:51.047389 10903 raft_consensus.cc:697] T 34e0b8824c444b59b50cc2c8f61f49af P 305b05bc72f04d769644fbff5188bc26 [term 1 LEADER]: Becoming Leader. State: Replica: 305b05bc72f04d769644fbff5188bc26, State: Running, Role: LEADER
I20260709 13:02:51.048344 10903 consensus_queue.cc:237] T 34e0b8824c444b59b50cc2c8f61f49af P 305b05bc72f04d769644fbff5188bc26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:51.049871 10925 tablet_bootstrap.cc:654] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P 66abd7e8893940bdbe81d60bffc91261: Neither blocks nor log segments found. Creating new log.
I20260709 13:02:51.053414 10928 consensus_queue.cc:1048] T b498f794eab54c15846243452d7992e0 P d895d0e90a3b45ed9aed3af8222a9b5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:51.063731 10922 raft_consensus.cc:493] T 57fe93cb1bec4bc1ad43b091fb49f120 P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.064347 10922 raft_consensus.cc:515] T 57fe93cb1bec4bc1ad43b091fb49f120 P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:51.067510 10698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe93cb1bec4bc1ad43b091fb49f120" candidate_uuid: "66abd7e8893940bdbe81d60bffc91261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" is_pre_election: true
I20260709 13:02:51.068733 10925 tablet_bootstrap.cc:492] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P 66abd7e8893940bdbe81d60bffc91261: No bootstrap required, opened a new log
I20260709 13:02:51.068938 10903 raft_consensus.cc:493] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.069331 10925 ts_tablet_manager.cc:1403] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P 66abd7e8893940bdbe81d60bffc91261: Time spent bootstrapping tablet: real 0.038s	user 0.018s	sys 0.008s
I20260709 13:02:51.069661 10903 raft_consensus.cc:515] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:51.071033 10522 catalog_manager.cc:5697] T 34e0b8824c444b59b50cc2c8f61f49af P 305b05bc72f04d769644fbff5188bc26 reported cstate change: term changed from 0 to 1, leader changed from <none> to 305b05bc72f04d769644fbff5188bc26 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "305b05bc72f04d769644fbff5188bc26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:51.072602 10621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3e7d3c774f4fbcb175375d2e4d60b6" candidate_uuid: "305b05bc72f04d769644fbff5188bc26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66abd7e8893940bdbe81d60bffc91261" is_pre_election: true
I20260709 13:02:51.072734 10925 raft_consensus.cc:359] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:51.072995 10772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe93cb1bec4bc1ad43b091fb49f120" candidate_uuid: "66abd7e8893940bdbe81d60bffc91261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "305b05bc72f04d769644fbff5188bc26" is_pre_election: true
I20260709 13:02:51.073515 10925 raft_consensus.cc:385] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:02:51.073837 10772 raft_consensus.cc:2393] T 57fe93cb1bec4bc1ad43b091fb49f120 P 305b05bc72f04d769644fbff5188bc26 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66abd7e8893940bdbe81d60bffc91261 in current term 1: Already voted for candidate d895d0e90a3b45ed9aed3af8222a9b5d in this term.
I20260709 13:02:51.074470 10922 leader_election.cc:290] T 57fe93cb1bec4bc1ad43b091fb49f120 P 66abd7e8893940bdbe81d60bffc91261 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683), 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947)
I20260709 13:02:51.075227 10590 leader_election.cc:304] T 57fe93cb1bec4bc1ad43b091fb49f120 P 66abd7e8893940bdbe81d60bffc91261 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66abd7e8893940bdbe81d60bffc91261; no voters: 305b05bc72f04d769644fbff5188bc26, d895d0e90a3b45ed9aed3af8222a9b5d
I20260709 13:02:51.073812 10925 raft_consensus.cc:740] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66abd7e8893940bdbe81d60bffc91261, State: Initialized, Role: FOLLOWER
I20260709 13:02:51.076797 10925 consensus_queue.cc:260] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P 66abd7e8893940bdbe81d60bffc91261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:51.077698 10621 raft_consensus.cc:2468] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 305b05bc72f04d769644fbff5188bc26 in term 0.
I20260709 13:02:51.078377 10925 ts_tablet_manager.cc:1434] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P 66abd7e8893940bdbe81d60bffc91261: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:02:51.078881 10922 raft_consensus.cc:3060] T 57fe93cb1bec4bc1ad43b091fb49f120 P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:51.080930 10737 leader_election.cc:304] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 305b05bc72f04d769644fbff5188bc26, 66abd7e8893940bdbe81d60bffc91261; no voters: 
I20260709 13:02:51.082489 10950 raft_consensus.cc:2804] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:51.082877 10950 raft_consensus.cc:493] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:51.083197 10950 raft_consensus.cc:3060] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:51.083600 10698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3e7d3c774f4fbcb175375d2e4d60b6" candidate_uuid: "305b05bc72f04d769644fbff5188bc26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" is_pre_election: true
I20260709 13:02:51.084228 10698 raft_consensus.cc:2468] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 305b05bc72f04d769644fbff5188bc26 in term 0.
I20260709 13:02:51.085563 10903 leader_election.cc:290] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009), d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683)
I20260709 13:02:51.086539 10922 raft_consensus.cc:2749] T 57fe93cb1bec4bc1ad43b091fb49f120 P 66abd7e8893940bdbe81d60bffc91261 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:02:51.090982 10950 raft_consensus.cc:515] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P 305b05bc72f04d769644fbff5188bc26 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:51.095592 10698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3e7d3c774f4fbcb175375d2e4d60b6" candidate_uuid: "305b05bc72f04d769644fbff5188bc26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d"
I20260709 13:02:51.096180 10698 raft_consensus.cc:3060] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:51.096674 10621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a3e7d3c774f4fbcb175375d2e4d60b6" candidate_uuid: "305b05bc72f04d769644fbff5188bc26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66abd7e8893940bdbe81d60bffc91261"
I20260709 13:02:51.097325 10621 raft_consensus.cc:3060] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:51.102766 10950 leader_election.cc:290] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 1 election: Requested vote from peers 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009), d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683)
I20260709 13:02:51.103473 10698 raft_consensus.cc:2468] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 305b05bc72f04d769644fbff5188bc26 in term 1.
I20260709 13:02:51.104823 10737 leader_election.cc:304] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 305b05bc72f04d769644fbff5188bc26, d895d0e90a3b45ed9aed3af8222a9b5d; no voters: 
I20260709 13:02:51.106253 10903 raft_consensus.cc:2804] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P 305b05bc72f04d769644fbff5188bc26 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:51.107223 10621 raft_consensus.cc:2468] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P 66abd7e8893940bdbe81d60bffc91261 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 305b05bc72f04d769644fbff5188bc26 in term 1.
I20260709 13:02:51.108315 10903 raft_consensus.cc:697] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P 305b05bc72f04d769644fbff5188bc26 [term 1 LEADER]: Becoming Leader. State: Replica: 305b05bc72f04d769644fbff5188bc26, State: Running, Role: LEADER
I20260709 13:02:51.109201 10903 consensus_queue.cc:237] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P 305b05bc72f04d769644fbff5188bc26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:51.118202 10522 catalog_manager.cc:5697] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P 305b05bc72f04d769644fbff5188bc26 reported cstate change: term changed from 0 to 1, leader changed from <none> to 305b05bc72f04d769644fbff5188bc26 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "305b05bc72f04d769644fbff5188bc26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:51.142148 10928 raft_consensus.cc:493] T 70931771066e47f7a57a558edb1b3e61 P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:02:51.142752 10928 raft_consensus.cc:515] T 70931771066e47f7a57a558edb1b3e61 P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:51.144521 10928 leader_election.cc:290] T 70931771066e47f7a57a558edb1b3e61 P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009), 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947)
I20260709 13:02:51.145736 10772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70931771066e47f7a57a558edb1b3e61" candidate_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "305b05bc72f04d769644fbff5188bc26" is_pre_election: true
I20260709 13:02:51.145677 10621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70931771066e47f7a57a558edb1b3e61" candidate_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66abd7e8893940bdbe81d60bffc91261" is_pre_election: true
I20260709 13:02:51.146770 10772 raft_consensus.cc:2468] T 70931771066e47f7a57a558edb1b3e61 P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d895d0e90a3b45ed9aed3af8222a9b5d in term 0.
I20260709 13:02:51.146771 10621 raft_consensus.cc:2468] T 70931771066e47f7a57a558edb1b3e61 P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d895d0e90a3b45ed9aed3af8222a9b5d in term 0.
I20260709 13:02:51.148298 10665 leader_election.cc:304] T 70931771066e47f7a57a558edb1b3e61 P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 305b05bc72f04d769644fbff5188bc26, 66abd7e8893940bdbe81d60bffc91261, d895d0e90a3b45ed9aed3af8222a9b5d; no voters: 
I20260709 13:02:51.149076 10928 raft_consensus.cc:2804] T 70931771066e47f7a57a558edb1b3e61 P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:02:51.149507 10928 raft_consensus.cc:493] T 70931771066e47f7a57a558edb1b3e61 P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:02:51.149863 10928 raft_consensus.cc:3060] T 70931771066e47f7a57a558edb1b3e61 P d895d0e90a3b45ed9aed3af8222a9b5d [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:51.155033 10928 raft_consensus.cc:515] T 70931771066e47f7a57a558edb1b3e61 P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:51.156833 10928 leader_election.cc:290] T 70931771066e47f7a57a558edb1b3e61 P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 1 election: Requested vote from peers 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009), 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947)
I20260709 13:02:51.157564 10621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70931771066e47f7a57a558edb1b3e61" candidate_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66abd7e8893940bdbe81d60bffc91261"
I20260709 13:02:51.157848 10772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70931771066e47f7a57a558edb1b3e61" candidate_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "305b05bc72f04d769644fbff5188bc26"
I20260709 13:02:51.158337 10621 raft_consensus.cc:3060] T 70931771066e47f7a57a558edb1b3e61 P 66abd7e8893940bdbe81d60bffc91261 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:51.158437 10772 raft_consensus.cc:3060] T 70931771066e47f7a57a558edb1b3e61 P 305b05bc72f04d769644fbff5188bc26 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:02:51.166123 10772 raft_consensus.cc:2468] T 70931771066e47f7a57a558edb1b3e61 P 305b05bc72f04d769644fbff5188bc26 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d895d0e90a3b45ed9aed3af8222a9b5d in term 1.
I20260709 13:02:51.166141 10621 raft_consensus.cc:2468] T 70931771066e47f7a57a558edb1b3e61 P 66abd7e8893940bdbe81d60bffc91261 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d895d0e90a3b45ed9aed3af8222a9b5d in term 1.
I20260709 13:02:51.167649 10665 leader_election.cc:304] T 70931771066e47f7a57a558edb1b3e61 P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 305b05bc72f04d769644fbff5188bc26, 66abd7e8893940bdbe81d60bffc91261, d895d0e90a3b45ed9aed3af8222a9b5d; no voters: 
I20260709 13:02:51.168450 10928 raft_consensus.cc:2804] T 70931771066e47f7a57a558edb1b3e61 P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:02:51.169166 10928 raft_consensus.cc:697] T 70931771066e47f7a57a558edb1b3e61 P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 LEADER]: Becoming Leader. State: Replica: d895d0e90a3b45ed9aed3af8222a9b5d, State: Running, Role: LEADER
I20260709 13:02:51.169950 10928 consensus_queue.cc:237] T 70931771066e47f7a57a558edb1b3e61 P d895d0e90a3b45ed9aed3af8222a9b5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:51.178033 10522 catalog_manager.cc:5697] T 70931771066e47f7a57a558edb1b3e61 P d895d0e90a3b45ed9aed3af8222a9b5d reported cstate change: term changed from 0 to 1, leader changed from <none> to d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194). New cstate: current_term: 1 leader_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:51.229415 10698 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b498f794eab54c15846243452d7992e0"
dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d"
mode: GRACEFUL
new_leader_uuid: "66abd7e8893940bdbe81d60bffc91261"
 from {username='slave'} at 127.0.0.1:38968
I20260709 13:02:51.230217 10698 raft_consensus.cc:606] T b498f794eab54c15846243452d7992e0 P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 LEADER]: Received request to transfer leadership to TS 66abd7e8893940bdbe81d60bffc91261
I20260709 13:02:51.231424 10928 consensus_queue.cc:1048] T 57fe93cb1bec4bc1ad43b091fb49f120 P d895d0e90a3b45ed9aed3af8222a9b5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:51.236593 10772 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30e72e0b20944bcbbea372c99c5f27fc"
dest_uuid: "305b05bc72f04d769644fbff5188bc26"
mode: GRACEFUL
new_leader_uuid: "66abd7e8893940bdbe81d60bffc91261"
 from {username='slave'} at 127.0.0.1:59754
I20260709 13:02:51.237293 10772 raft_consensus.cc:606] T 30e72e0b20944bcbbea372c99c5f27fc P 305b05bc72f04d769644fbff5188bc26 [term 1 LEADER]: Received request to transfer leadership to TS 66abd7e8893940bdbe81d60bffc91261
I20260709 13:02:51.246060 10699 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "57fe93cb1bec4bc1ad43b091fb49f120"
dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d"
mode: GRACEFUL
new_leader_uuid: "66abd7e8893940bdbe81d60bffc91261"
 from {username='slave'} at 127.0.0.1:38968
I20260709 13:02:51.246723 10699 raft_consensus.cc:606] T 57fe93cb1bec4bc1ad43b091fb49f120 P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 LEADER]: Received request to transfer leadership to TS 66abd7e8893940bdbe81d60bffc91261
I20260709 13:02:51.246798 10972 consensus_queue.cc:1048] T 57fe93cb1bec4bc1ad43b091fb49f120 P d895d0e90a3b45ed9aed3af8222a9b5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:51.251909 10922 consensus_queue.cc:1048] T 110992c04e984796a1919262f4bbe67f P 66abd7e8893940bdbe81d60bffc91261 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:51.262758 10922 consensus_queue.cc:1048] T b018c17ab00f46b6b1eab7e49e0adfe5 P 66abd7e8893940bdbe81d60bffc91261 [LEADER]: Connected to new peer: Peer: permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:51.268920 10947 consensus_queue.cc:1048] T 110992c04e984796a1919262f4bbe67f P 66abd7e8893940bdbe81d60bffc91261 [LEADER]: Connected to new peer: Peer: permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:51.273531 10621 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "110992c04e984796a1919262f4bbe67f"
dest_uuid: "66abd7e8893940bdbe81d60bffc91261"
mode: GRACEFUL
new_leader_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d"
 from {username='slave'} at 127.0.0.1:34362
I20260709 13:02:51.274386 10621 raft_consensus.cc:606] T 110992c04e984796a1919262f4bbe67f P 66abd7e8893940bdbe81d60bffc91261 [term 1 LEADER]: Received request to transfer leadership to TS d895d0e90a3b45ed9aed3af8222a9b5d
I20260709 13:02:51.285277 10773 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "34e0b8824c444b59b50cc2c8f61f49af"
dest_uuid: "305b05bc72f04d769644fbff5188bc26"
mode: GRACEFUL
new_leader_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d"
 from {username='slave'} at 127.0.0.1:59754
I20260709 13:02:51.287212 10773 raft_consensus.cc:606] T 34e0b8824c444b59b50cc2c8f61f49af P 305b05bc72f04d769644fbff5188bc26 [term 1 LEADER]: Received request to transfer leadership to TS d895d0e90a3b45ed9aed3af8222a9b5d
I20260709 13:02:51.287032 10947 consensus_queue.cc:1048] T b018c17ab00f46b6b1eab7e49e0adfe5 P 66abd7e8893940bdbe81d60bffc91261 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:51.295143 10621 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "420a103ab9df43e9b3d34aacfd2325aa"
dest_uuid: "66abd7e8893940bdbe81d60bffc91261"
mode: GRACEFUL
new_leader_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d"
 from {username='slave'} at 127.0.0.1:34362
I20260709 13:02:51.295873 10621 raft_consensus.cc:606] T 420a103ab9df43e9b3d34aacfd2325aa P 66abd7e8893940bdbe81d60bffc91261 [term 1 LEADER]: Received request to transfer leadership to TS d895d0e90a3b45ed9aed3af8222a9b5d
I20260709 13:02:51.356930 10950 consensus_queue.cc:1048] T 30e72e0b20944bcbbea372c99c5f27fc P 305b05bc72f04d769644fbff5188bc26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:51.368062 10903 consensus_queue.cc:1048] T 30e72e0b20944bcbbea372c99c5f27fc P 305b05bc72f04d769644fbff5188bc26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:51.376737 10985 raft_consensus.cc:993] T 30e72e0b20944bcbbea372c99c5f27fc P 305b05bc72f04d769644fbff5188bc26: : Instructing follower 66abd7e8893940bdbe81d60bffc91261 to start an election
I20260709 13:02:51.377225 10903 raft_consensus.cc:1081] T 30e72e0b20944bcbbea372c99c5f27fc P 305b05bc72f04d769644fbff5188bc26 [term 1 LEADER]: Signalling peer 66abd7e8893940bdbe81d60bffc91261 to start an election
I20260709 13:02:51.378741 10621 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "30e72e0b20944bcbbea372c99c5f27fc"
dest_uuid: "66abd7e8893940bdbe81d60bffc91261"
 from {username='slave'} at 127.0.0.1:34348
I20260709 13:02:51.379441 10621 raft_consensus.cc:493] T 30e72e0b20944bcbbea372c99c5f27fc P 66abd7e8893940bdbe81d60bffc91261 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:51.379844 10621 raft_consensus.cc:3060] T 30e72e0b20944bcbbea372c99c5f27fc P 66abd7e8893940bdbe81d60bffc91261 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:51.384968 10621 raft_consensus.cc:515] T 30e72e0b20944bcbbea372c99c5f27fc P 66abd7e8893940bdbe81d60bffc91261 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:51.386878 10621 leader_election.cc:290] T 30e72e0b20944bcbbea372c99c5f27fc P 66abd7e8893940bdbe81d60bffc91261 [CANDIDATE]: Term 2 election: Requested vote from peers d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683), 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947)
I20260709 13:02:51.388240 10773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e72e0b20944bcbbea372c99c5f27fc" candidate_uuid: "66abd7e8893940bdbe81d60bffc91261" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "305b05bc72f04d769644fbff5188bc26"
I20260709 13:02:51.388955 10773 raft_consensus.cc:3055] T 30e72e0b20944bcbbea372c99c5f27fc P 305b05bc72f04d769644fbff5188bc26 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:51.388967 10698 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e72e0b20944bcbbea372c99c5f27fc" candidate_uuid: "66abd7e8893940bdbe81d60bffc91261" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d"
I20260709 13:02:51.389776 10698 raft_consensus.cc:3060] T 30e72e0b20944bcbbea372c99c5f27fc P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:51.389328 10773 raft_consensus.cc:740] T 30e72e0b20944bcbbea372c99c5f27fc P 305b05bc72f04d769644fbff5188bc26 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 305b05bc72f04d769644fbff5188bc26, State: Running, Role: LEADER
I20260709 13:02:51.391716 10773 consensus_queue.cc:260] T 30e72e0b20944bcbbea372c99c5f27fc P 305b05bc72f04d769644fbff5188bc26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:51.393028 10773 raft_consensus.cc:3060] T 30e72e0b20944bcbbea372c99c5f27fc P 305b05bc72f04d769644fbff5188bc26 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:51.397177 10698 raft_consensus.cc:2468] T 30e72e0b20944bcbbea372c99c5f27fc P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66abd7e8893940bdbe81d60bffc91261 in term 2.
I20260709 13:02:51.398464 10588 leader_election.cc:304] T 30e72e0b20944bcbbea372c99c5f27fc P 66abd7e8893940bdbe81d60bffc91261 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66abd7e8893940bdbe81d60bffc91261, d895d0e90a3b45ed9aed3af8222a9b5d; no voters: 
I20260709 13:02:51.399205 10947 raft_consensus.cc:2804] T 30e72e0b20944bcbbea372c99c5f27fc P 66abd7e8893940bdbe81d60bffc91261 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:51.399607 10773 raft_consensus.cc:2468] T 30e72e0b20944bcbbea372c99c5f27fc P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66abd7e8893940bdbe81d60bffc91261 in term 2.
I20260709 13:02:51.399768 10947 raft_consensus.cc:697] T 30e72e0b20944bcbbea372c99c5f27fc P 66abd7e8893940bdbe81d60bffc91261 [term 2 LEADER]: Becoming Leader. State: Replica: 66abd7e8893940bdbe81d60bffc91261, State: Running, Role: LEADER
I20260709 13:02:51.400784 10947 consensus_queue.cc:237] T 30e72e0b20944bcbbea372c99c5f27fc P 66abd7e8893940bdbe81d60bffc91261 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:51.407989 10522 catalog_manager.cc:5697] T 30e72e0b20944bcbbea372c99c5f27fc P 66abd7e8893940bdbe81d60bffc91261 reported cstate change: term changed from 1 to 2, leader changed from 305b05bc72f04d769644fbff5188bc26 (127.0.107.195) to 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "66abd7e8893940bdbe81d60bffc91261" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:51.453135 10903 consensus_queue.cc:1048] T 34e0b8824c444b59b50cc2c8f61f49af P 305b05bc72f04d769644fbff5188bc26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:51.463024 10985 consensus_queue.cc:1048] T 34e0b8824c444b59b50cc2c8f61f49af P 305b05bc72f04d769644fbff5188bc26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:51.471565 10950 raft_consensus.cc:993] T 34e0b8824c444b59b50cc2c8f61f49af P 305b05bc72f04d769644fbff5188bc26: : Instructing follower d895d0e90a3b45ed9aed3af8222a9b5d to start an election
I20260709 13:02:51.472070 10985 raft_consensus.cc:1081] T 34e0b8824c444b59b50cc2c8f61f49af P 305b05bc72f04d769644fbff5188bc26 [term 1 LEADER]: Signalling peer d895d0e90a3b45ed9aed3af8222a9b5d to start an election
I20260709 13:02:51.472092 10947 consensus_queue.cc:1048] T 420a103ab9df43e9b3d34aacfd2325aa P 66abd7e8893940bdbe81d60bffc91261 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:51.473737 10699 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "34e0b8824c444b59b50cc2c8f61f49af"
dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d"
 from {username='slave'} at 127.0.0.1:38940
I20260709 13:02:51.474484 10699 raft_consensus.cc:493] T 34e0b8824c444b59b50cc2c8f61f49af P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:51.475035 10699 raft_consensus.cc:3060] T 34e0b8824c444b59b50cc2c8f61f49af P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:51.479988 10922 raft_consensus.cc:993] T 420a103ab9df43e9b3d34aacfd2325aa P 66abd7e8893940bdbe81d60bffc91261: : Instructing follower d895d0e90a3b45ed9aed3af8222a9b5d to start an election
I20260709 13:02:51.480564 10948 raft_consensus.cc:1081] T 420a103ab9df43e9b3d34aacfd2325aa P 66abd7e8893940bdbe81d60bffc91261 [term 1 LEADER]: Signalling peer d895d0e90a3b45ed9aed3af8222a9b5d to start an election
I20260709 13:02:51.482389 10697 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "420a103ab9df43e9b3d34aacfd2325aa"
dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d"
 from {username='slave'} at 127.0.0.1:38954
I20260709 13:02:51.483052 10697 raft_consensus.cc:493] T 420a103ab9df43e9b3d34aacfd2325aa P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:51.482848 10699 raft_consensus.cc:515] T 34e0b8824c444b59b50cc2c8f61f49af P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:51.483510 10697 raft_consensus.cc:3060] T 420a103ab9df43e9b3d34aacfd2325aa P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:51.486088 10621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e0b8824c444b59b50cc2c8f61f49af" candidate_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "66abd7e8893940bdbe81d60bffc91261"
I20260709 13:02:51.486665 10621 raft_consensus.cc:3060] T 34e0b8824c444b59b50cc2c8f61f49af P 66abd7e8893940bdbe81d60bffc91261 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:51.490923 10922 consensus_queue.cc:1048] T 420a103ab9df43e9b3d34aacfd2325aa P 66abd7e8893940bdbe81d60bffc91261 [LEADER]: Connected to new peer: Peer: permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:51.493433 10621 raft_consensus.cc:2468] T 34e0b8824c444b59b50cc2c8f61f49af P 66abd7e8893940bdbe81d60bffc91261 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d895d0e90a3b45ed9aed3af8222a9b5d in term 2.
I20260709 13:02:51.494669 10663 leader_election.cc:304] T 34e0b8824c444b59b50cc2c8f61f49af P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66abd7e8893940bdbe81d60bffc91261, d895d0e90a3b45ed9aed3af8222a9b5d; no voters: 
I20260709 13:02:51.495620 10972 raft_consensus.cc:2804] T 34e0b8824c444b59b50cc2c8f61f49af P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:51.496167 10972 raft_consensus.cc:697] T 34e0b8824c444b59b50cc2c8f61f49af P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 LEADER]: Becoming Leader. State: Replica: d895d0e90a3b45ed9aed3af8222a9b5d, State: Running, Role: LEADER
I20260709 13:02:51.497079 10972 consensus_queue.cc:237] T 34e0b8824c444b59b50cc2c8f61f49af P d895d0e90a3b45ed9aed3af8222a9b5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:51.498937 10697 raft_consensus.cc:515] T 420a103ab9df43e9b3d34aacfd2325aa P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:51.503121 10621 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "420a103ab9df43e9b3d34aacfd2325aa" candidate_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "66abd7e8893940bdbe81d60bffc91261"
I20260709 13:02:51.503640 10771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "34e0b8824c444b59b50cc2c8f61f49af" candidate_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "305b05bc72f04d769644fbff5188bc26"
I20260709 13:02:51.504168 10621 raft_consensus.cc:3055] T 420a103ab9df43e9b3d34aacfd2325aa P 66abd7e8893940bdbe81d60bffc91261 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:51.504298 10771 raft_consensus.cc:3055] T 34e0b8824c444b59b50cc2c8f61f49af P 305b05bc72f04d769644fbff5188bc26 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:51.504824 10621 raft_consensus.cc:740] T 420a103ab9df43e9b3d34aacfd2325aa P 66abd7e8893940bdbe81d60bffc91261 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 66abd7e8893940bdbe81d60bffc91261, State: Running, Role: LEADER
I20260709 13:02:51.505062 10771 raft_consensus.cc:740] T 34e0b8824c444b59b50cc2c8f61f49af P 305b05bc72f04d769644fbff5188bc26 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 305b05bc72f04d769644fbff5188bc26, State: Running, Role: LEADER
I20260709 13:02:51.505828 10621 consensus_queue.cc:260] T 420a103ab9df43e9b3d34aacfd2325aa P 66abd7e8893940bdbe81d60bffc91261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:51.505971 10771 consensus_queue.cc:260] T 34e0b8824c444b59b50cc2c8f61f49af P 305b05bc72f04d769644fbff5188bc26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:51.506805 10621 raft_consensus.cc:3060] T 420a103ab9df43e9b3d34aacfd2325aa P 66abd7e8893940bdbe81d60bffc91261 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:51.507161 10771 raft_consensus.cc:3060] T 34e0b8824c444b59b50cc2c8f61f49af P 305b05bc72f04d769644fbff5188bc26 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:51.504674 10699 leader_election.cc:290] T 34e0b8824c444b59b50cc2c8f61f49af P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 2 election: Requested vote from peers 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009), 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947)
I20260709 13:02:51.514680 10621 raft_consensus.cc:2468] T 420a103ab9df43e9b3d34aacfd2325aa P 66abd7e8893940bdbe81d60bffc91261 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d895d0e90a3b45ed9aed3af8222a9b5d in term 2.
I20260709 13:02:51.515035 10697 leader_election.cc:290] T 420a103ab9df43e9b3d34aacfd2325aa P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 2 election: Requested vote from peers 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009), 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947)
I20260709 13:02:51.516186 10663 leader_election.cc:304] T 420a103ab9df43e9b3d34aacfd2325aa P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66abd7e8893940bdbe81d60bffc91261, d895d0e90a3b45ed9aed3af8222a9b5d; no voters: 
I20260709 13:02:51.517274 10972 raft_consensus.cc:2804] T 420a103ab9df43e9b3d34aacfd2325aa P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:51.517861 10972 raft_consensus.cc:697] T 420a103ab9df43e9b3d34aacfd2325aa P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 LEADER]: Becoming Leader. State: Replica: d895d0e90a3b45ed9aed3af8222a9b5d, State: Running, Role: LEADER
I20260709 13:02:51.517716 10522 catalog_manager.cc:5697] T 34e0b8824c444b59b50cc2c8f61f49af P d895d0e90a3b45ed9aed3af8222a9b5d reported cstate change: term changed from 1 to 2, leader changed from 305b05bc72f04d769644fbff5188bc26 (127.0.107.195) to d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194). New cstate: current_term: 2 leader_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:51.518817 10972 consensus_queue.cc:237] T 420a103ab9df43e9b3d34aacfd2325aa P d895d0e90a3b45ed9aed3af8222a9b5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:51.522861 10772 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "420a103ab9df43e9b3d34aacfd2325aa" candidate_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "305b05bc72f04d769644fbff5188bc26"
I20260709 13:02:51.526196 10771 raft_consensus.cc:2468] T 34e0b8824c444b59b50cc2c8f61f49af P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d895d0e90a3b45ed9aed3af8222a9b5d in term 2.
I20260709 13:02:51.537389 10519 catalog_manager.cc:5697] T 420a103ab9df43e9b3d34aacfd2325aa P d895d0e90a3b45ed9aed3af8222a9b5d reported cstate change: term changed from 1 to 2, leader changed from 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193) to d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194). New cstate: current_term: 2 leader_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:51.555236 10950 consensus_queue.cc:1048] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P 305b05bc72f04d769644fbff5188bc26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:51.568728 10992 consensus_queue.cc:1048] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P 305b05bc72f04d769644fbff5188bc26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:51.629565 10859 raft_consensus.cc:993] T b498f794eab54c15846243452d7992e0 P d895d0e90a3b45ed9aed3af8222a9b5d: : Instructing follower 66abd7e8893940bdbe81d60bffc91261 to start an election
I20260709 13:02:51.630043 10972 raft_consensus.cc:1081] T b498f794eab54c15846243452d7992e0 P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 LEADER]: Signalling peer 66abd7e8893940bdbe81d60bffc91261 to start an election
I20260709 13:02:51.631469 10621 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b498f794eab54c15846243452d7992e0"
dest_uuid: "66abd7e8893940bdbe81d60bffc91261"
 from {username='slave'} at 127.0.0.1:34352
I20260709 13:02:51.632040 10621 raft_consensus.cc:493] T b498f794eab54c15846243452d7992e0 P 66abd7e8893940bdbe81d60bffc91261 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:51.632352 10621 raft_consensus.cc:3060] T b498f794eab54c15846243452d7992e0 P 66abd7e8893940bdbe81d60bffc91261 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:51.637185 10621 raft_consensus.cc:515] T b498f794eab54c15846243452d7992e0 P 66abd7e8893940bdbe81d60bffc91261 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:51.638702 10621 leader_election.cc:290] T b498f794eab54c15846243452d7992e0 P 66abd7e8893940bdbe81d60bffc91261 [CANDIDATE]: Term 2 election: Requested vote from peers d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683), 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947)
I20260709 13:02:51.639626 10699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b498f794eab54c15846243452d7992e0" candidate_uuid: "66abd7e8893940bdbe81d60bffc91261" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d"
I20260709 13:02:51.639813 10771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b498f794eab54c15846243452d7992e0" candidate_uuid: "66abd7e8893940bdbe81d60bffc91261" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "305b05bc72f04d769644fbff5188bc26"
I20260709 13:02:51.640286 10699 raft_consensus.cc:3055] T b498f794eab54c15846243452d7992e0 P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:51.640425 10771 raft_consensus.cc:3060] T b498f794eab54c15846243452d7992e0 P 305b05bc72f04d769644fbff5188bc26 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:51.640640 10699 raft_consensus.cc:740] T b498f794eab54c15846243452d7992e0 P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d895d0e90a3b45ed9aed3af8222a9b5d, State: Running, Role: LEADER
I20260709 13:02:51.641474 10699 consensus_queue.cc:260] T b498f794eab54c15846243452d7992e0 P d895d0e90a3b45ed9aed3af8222a9b5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:51.642414 10699 raft_consensus.cc:3060] T b498f794eab54c15846243452d7992e0 P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:51.646045 10771 raft_consensus.cc:2468] T b498f794eab54c15846243452d7992e0 P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66abd7e8893940bdbe81d60bffc91261 in term 2.
I20260709 13:02:51.647328 10590 leader_election.cc:304] T b498f794eab54c15846243452d7992e0 P 66abd7e8893940bdbe81d60bffc91261 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 305b05bc72f04d769644fbff5188bc26, 66abd7e8893940bdbe81d60bffc91261; no voters: 
I20260709 13:02:51.648074 10922 raft_consensus.cc:2804] T b498f794eab54c15846243452d7992e0 P 66abd7e8893940bdbe81d60bffc91261 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:51.648574 10922 raft_consensus.cc:697] T b498f794eab54c15846243452d7992e0 P 66abd7e8893940bdbe81d60bffc91261 [term 2 LEADER]: Becoming Leader. State: Replica: 66abd7e8893940bdbe81d60bffc91261, State: Running, Role: LEADER
I20260709 13:02:51.649570 10922 consensus_queue.cc:237] T b498f794eab54c15846243452d7992e0 P 66abd7e8893940bdbe81d60bffc91261 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:51.650158 10699 raft_consensus.cc:2468] T b498f794eab54c15846243452d7992e0 P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66abd7e8893940bdbe81d60bffc91261 in term 2.
I20260709 13:02:51.653028 10859 raft_consensus.cc:993] T 57fe93cb1bec4bc1ad43b091fb49f120 P d895d0e90a3b45ed9aed3af8222a9b5d: : Instructing follower 66abd7e8893940bdbe81d60bffc91261 to start an election
I20260709 13:02:51.653498 10972 raft_consensus.cc:1081] T 57fe93cb1bec4bc1ad43b091fb49f120 P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 LEADER]: Signalling peer 66abd7e8893940bdbe81d60bffc91261 to start an election
I20260709 13:02:51.655108 10621 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "57fe93cb1bec4bc1ad43b091fb49f120"
dest_uuid: "66abd7e8893940bdbe81d60bffc91261"
 from {username='slave'} at 127.0.0.1:34352
I20260709 13:02:51.655556 10621 raft_consensus.cc:493] T 57fe93cb1bec4bc1ad43b091fb49f120 P 66abd7e8893940bdbe81d60bffc91261 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:51.655869 10621 raft_consensus.cc:3060] T 57fe93cb1bec4bc1ad43b091fb49f120 P 66abd7e8893940bdbe81d60bffc91261 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:51.657891 10522 catalog_manager.cc:5697] T b498f794eab54c15846243452d7992e0 P 66abd7e8893940bdbe81d60bffc91261 reported cstate change: term changed from 1 to 2, leader changed from d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194) to 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "66abd7e8893940bdbe81d60bffc91261" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:51.660964 10972 consensus_queue.cc:1048] T 70931771066e47f7a57a558edb1b3e61 P d895d0e90a3b45ed9aed3af8222a9b5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:02:51.662629 10621 raft_consensus.cc:515] T 57fe93cb1bec4bc1ad43b091fb49f120 P 66abd7e8893940bdbe81d60bffc91261 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:51.664636 10621 leader_election.cc:290] T 57fe93cb1bec4bc1ad43b091fb49f120 P 66abd7e8893940bdbe81d60bffc91261 [CANDIDATE]: Term 2 election: Requested vote from peers d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683), 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947)
I20260709 13:02:51.665639 10773 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe93cb1bec4bc1ad43b091fb49f120" candidate_uuid: "66abd7e8893940bdbe81d60bffc91261" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "305b05bc72f04d769644fbff5188bc26"
I20260709 13:02:51.666249 10773 raft_consensus.cc:3060] T 57fe93cb1bec4bc1ad43b091fb49f120 P 305b05bc72f04d769644fbff5188bc26 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:51.667135 10699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe93cb1bec4bc1ad43b091fb49f120" candidate_uuid: "66abd7e8893940bdbe81d60bffc91261" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d"
I20260709 13:02:51.667743 10699 raft_consensus.cc:3055] T 57fe93cb1bec4bc1ad43b091fb49f120 P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:51.668056 10699 raft_consensus.cc:740] T 57fe93cb1bec4bc1ad43b091fb49f120 P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: d895d0e90a3b45ed9aed3af8222a9b5d, State: Running, Role: LEADER
I20260709 13:02:51.668821 10699 consensus_queue.cc:260] T 57fe93cb1bec4bc1ad43b091fb49f120 P d895d0e90a3b45ed9aed3af8222a9b5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:51.669786 10699 raft_consensus.cc:3060] T 57fe93cb1bec4bc1ad43b091fb49f120 P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:51.676867 10773 raft_consensus.cc:2468] T 57fe93cb1bec4bc1ad43b091fb49f120 P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66abd7e8893940bdbe81d60bffc91261 in term 2.
I20260709 13:02:51.677165 10699 raft_consensus.cc:2468] T 57fe93cb1bec4bc1ad43b091fb49f120 P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66abd7e8893940bdbe81d60bffc91261 in term 2.
I20260709 13:02:51.678447 10590 leader_election.cc:304] T 57fe93cb1bec4bc1ad43b091fb49f120 P 66abd7e8893940bdbe81d60bffc91261 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 305b05bc72f04d769644fbff5188bc26, 66abd7e8893940bdbe81d60bffc91261; no voters: 
I20260709 13:02:51.679471 10922 raft_consensus.cc:2804] T 57fe93cb1bec4bc1ad43b091fb49f120 P 66abd7e8893940bdbe81d60bffc91261 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:51.679986 10922 raft_consensus.cc:697] T 57fe93cb1bec4bc1ad43b091fb49f120 P 66abd7e8893940bdbe81d60bffc91261 [term 2 LEADER]: Becoming Leader. State: Replica: 66abd7e8893940bdbe81d60bffc91261, State: Running, Role: LEADER
I20260709 13:02:51.680925 10922 consensus_queue.cc:237] T 57fe93cb1bec4bc1ad43b091fb49f120 P 66abd7e8893940bdbe81d60bffc91261 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:51.684985 10948 raft_consensus.cc:993] T 110992c04e984796a1919262f4bbe67f P 66abd7e8893940bdbe81d60bffc91261: : Instructing follower d895d0e90a3b45ed9aed3af8222a9b5d to start an election
I20260709 13:02:51.685417 10948 raft_consensus.cc:1081] T 110992c04e984796a1919262f4bbe67f P 66abd7e8893940bdbe81d60bffc91261 [term 1 LEADER]: Signalling peer d895d0e90a3b45ed9aed3af8222a9b5d to start an election
I20260709 13:02:51.687036 10699 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "110992c04e984796a1919262f4bbe67f"
dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d"
 from {username='slave'} at 127.0.0.1:38954
I20260709 13:02:51.687630 10699 raft_consensus.cc:493] T 110992c04e984796a1919262f4bbe67f P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:51.688006 10699 raft_consensus.cc:3060] T 110992c04e984796a1919262f4bbe67f P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:51.697069 10859 consensus_queue.cc:1048] T 70931771066e47f7a57a558edb1b3e61 P d895d0e90a3b45ed9aed3af8222a9b5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:02:51.697324 10699 raft_consensus.cc:515] T 110992c04e984796a1919262f4bbe67f P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:51.699705 10699 leader_election.cc:290] T 110992c04e984796a1919262f4bbe67f P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 2 election: Requested vote from peers 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009), 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947)
I20260709 13:02:51.701923 10771 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "110992c04e984796a1919262f4bbe67f" candidate_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "305b05bc72f04d769644fbff5188bc26"
I20260709 13:02:51.701929 10623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "110992c04e984796a1919262f4bbe67f" candidate_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "66abd7e8893940bdbe81d60bffc91261"
I20260709 13:02:51.702721 10771 raft_consensus.cc:3060] T 110992c04e984796a1919262f4bbe67f P 305b05bc72f04d769644fbff5188bc26 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:51.702984 10623 raft_consensus.cc:3055] T 110992c04e984796a1919262f4bbe67f P 66abd7e8893940bdbe81d60bffc91261 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:51.703375 10623 raft_consensus.cc:740] T 110992c04e984796a1919262f4bbe67f P 66abd7e8893940bdbe81d60bffc91261 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 66abd7e8893940bdbe81d60bffc91261, State: Running, Role: LEADER
I20260709 13:02:51.704219 10623 consensus_queue.cc:260] T 110992c04e984796a1919262f4bbe67f P 66abd7e8893940bdbe81d60bffc91261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:51.705518 10623 raft_consensus.cc:3060] T 110992c04e984796a1919262f4bbe67f P 66abd7e8893940bdbe81d60bffc91261 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:51.707381 10519 catalog_manager.cc:5697] T 57fe93cb1bec4bc1ad43b091fb49f120 P 66abd7e8893940bdbe81d60bffc91261 reported cstate change: term changed from 1 to 2, leader changed from d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194) to 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193). New cstate: current_term: 2 leader_uuid: "66abd7e8893940bdbe81d60bffc91261" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:51.710891 10771 raft_consensus.cc:2468] T 110992c04e984796a1919262f4bbe67f P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d895d0e90a3b45ed9aed3af8222a9b5d in term 2.
I20260709 13:02:51.712234 10665 leader_election.cc:304] T 110992c04e984796a1919262f4bbe67f P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 305b05bc72f04d769644fbff5188bc26, d895d0e90a3b45ed9aed3af8222a9b5d; no voters: 
I20260709 13:02:51.712960 10971 raft_consensus.cc:2804] T 110992c04e984796a1919262f4bbe67f P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:51.713467 10971 raft_consensus.cc:697] T 110992c04e984796a1919262f4bbe67f P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 LEADER]: Becoming Leader. State: Replica: d895d0e90a3b45ed9aed3af8222a9b5d, State: Running, Role: LEADER
I20260709 13:02:51.714263 10971 consensus_queue.cc:237] T 110992c04e984796a1919262f4bbe67f P d895d0e90a3b45ed9aed3af8222a9b5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:51.717840 10623 raft_consensus.cc:2468] T 110992c04e984796a1919262f4bbe67f P 66abd7e8893940bdbe81d60bffc91261 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d895d0e90a3b45ed9aed3af8222a9b5d in term 2.
I20260709 13:02:51.722658 10519 catalog_manager.cc:5697] T 110992c04e984796a1919262f4bbe67f P d895d0e90a3b45ed9aed3af8222a9b5d reported cstate change: term changed from 1 to 2, leader changed from 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193) to d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194). New cstate: current_term: 2 leader_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:51.873776 10699 raft_consensus.cc:1275] T 30e72e0b20944bcbbea372c99c5f27fc P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Refusing update from remote peer 66abd7e8893940bdbe81d60bffc91261: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:51.875267 10947 consensus_queue.cc:1048] T 30e72e0b20944bcbbea372c99c5f27fc P 66abd7e8893940bdbe81d60bffc91261 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:51.885063 10771 raft_consensus.cc:1275] T 30e72e0b20944bcbbea372c99c5f27fc P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Refusing update from remote peer 66abd7e8893940bdbe81d60bffc91261: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:51.887034 10948 consensus_queue.cc:1048] T 30e72e0b20944bcbbea372c99c5f27fc P 66abd7e8893940bdbe81d60bffc91261 [LEADER]: Connected to new peer: Peer: permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:51.978498 10623 raft_consensus.cc:1275] T 420a103ab9df43e9b3d34aacfd2325aa P 66abd7e8893940bdbe81d60bffc91261 [term 2 FOLLOWER]: Refusing update from remote peer d895d0e90a3b45ed9aed3af8222a9b5d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:51.979837 10971 consensus_queue.cc:1048] T 420a103ab9df43e9b3d34aacfd2325aa P d895d0e90a3b45ed9aed3af8222a9b5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:51.987515 10771 raft_consensus.cc:3060] T 420a103ab9df43e9b3d34aacfd2325aa P 305b05bc72f04d769644fbff5188bc26 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:51.997568 10771 raft_consensus.cc:1275] T 420a103ab9df43e9b3d34aacfd2325aa P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Refusing update from remote peer d895d0e90a3b45ed9aed3af8222a9b5d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:51.998970 10859 consensus_queue.cc:1048] T 420a103ab9df43e9b3d34aacfd2325aa P d895d0e90a3b45ed9aed3af8222a9b5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:52.005909 10623 raft_consensus.cc:1275] T 34e0b8824c444b59b50cc2c8f61f49af P 66abd7e8893940bdbe81d60bffc91261 [term 2 FOLLOWER]: Refusing update from remote peer d895d0e90a3b45ed9aed3af8222a9b5d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:52.007297 10972 consensus_queue.cc:1048] T 34e0b8824c444b59b50cc2c8f61f49af P d895d0e90a3b45ed9aed3af8222a9b5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:52.020242 10772 raft_consensus.cc:1275] T 34e0b8824c444b59b50cc2c8f61f49af P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Refusing update from remote peer d895d0e90a3b45ed9aed3af8222a9b5d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:52.024080 10859 consensus_queue.cc:1048] T 34e0b8824c444b59b50cc2c8f61f49af P d895d0e90a3b45ed9aed3af8222a9b5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:52.129803 10772 raft_consensus.cc:1275] T b498f794eab54c15846243452d7992e0 P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Refusing update from remote peer 66abd7e8893940bdbe81d60bffc91261: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:52.131227 10948 consensus_queue.cc:1048] T b498f794eab54c15846243452d7992e0 P 66abd7e8893940bdbe81d60bffc91261 [LEADER]: Connected to new peer: Peer: permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:52.141335 10699 raft_consensus.cc:1275] T b498f794eab54c15846243452d7992e0 P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Refusing update from remote peer 66abd7e8893940bdbe81d60bffc91261: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:52.143319 10948 consensus_queue.cc:1048] T b498f794eab54c15846243452d7992e0 P 66abd7e8893940bdbe81d60bffc91261 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:52.189188 10623 raft_consensus.cc:1275] T 110992c04e984796a1919262f4bbe67f P 66abd7e8893940bdbe81d60bffc91261 [term 2 FOLLOWER]: Refusing update from remote peer d895d0e90a3b45ed9aed3af8222a9b5d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:52.190726 10859 consensus_queue.cc:1048] T 110992c04e984796a1919262f4bbe67f P d895d0e90a3b45ed9aed3af8222a9b5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:52.191737 10771 raft_consensus.cc:1275] T 57fe93cb1bec4bc1ad43b091fb49f120 P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Refusing update from remote peer 66abd7e8893940bdbe81d60bffc91261: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:52.193173 10948 consensus_queue.cc:1048] T 57fe93cb1bec4bc1ad43b091fb49f120 P 66abd7e8893940bdbe81d60bffc91261 [LEADER]: Connected to new peer: Peer: permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:52.200784 10771 raft_consensus.cc:1275] T 110992c04e984796a1919262f4bbe67f P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Refusing update from remote peer d895d0e90a3b45ed9aed3af8222a9b5d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:52.202991 10972 consensus_queue.cc:1048] T 110992c04e984796a1919262f4bbe67f P d895d0e90a3b45ed9aed3af8222a9b5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:02:52.202139 10699 raft_consensus.cc:1275] T 57fe93cb1bec4bc1ad43b091fb49f120 P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Refusing update from remote peer 66abd7e8893940bdbe81d60bffc91261: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:02:52.211313 10996 consensus_queue.cc:1048] T 57fe93cb1bec4bc1ad43b091fb49f120 P 66abd7e8893940bdbe81d60bffc91261 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:02:54.311416 10520 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:49846:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:02:54.332929 10520 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49846:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:02:54.368724   431 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 13:02:54.501573 10665 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:32947, user_credentials={real_user=slave}} blocked reactor thread for 64309.2us
I20260709 13:02:54.569247 10699 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "420a103ab9df43e9b3d34aacfd2325aa"
dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d"
mode: GRACEFUL
new_leader_uuid: "305b05bc72f04d769644fbff5188bc26"
 from {username='slave'} at 127.0.0.1:42202
I20260709 13:02:54.561256 11046 tablet.cc:1724] T 420a103ab9df43e9b3d34aacfd2325aa P 66abd7e8893940bdbe81d60bffc91261: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:54.605947 10699 raft_consensus.cc:606] T 420a103ab9df43e9b3d34aacfd2325aa P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 LEADER]: Received request to transfer leadership to TS 305b05bc72f04d769644fbff5188bc26
I20260709 13:02:54.616153 11035 tablet.cc:1724] T b498f794eab54c15846243452d7992e0 P 66abd7e8893940bdbe81d60bffc91261: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:54.642951 11052 tablet.cc:1724] T b498f794eab54c15846243452d7992e0 P 305b05bc72f04d769644fbff5188bc26: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:54.673897 11062 tablet.cc:1724] T b018c17ab00f46b6b1eab7e49e0adfe5 P 305b05bc72f04d769644fbff5188bc26: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:54.709885 11065 tablet.cc:1724] T 70931771066e47f7a57a558edb1b3e61 P d895d0e90a3b45ed9aed3af8222a9b5d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:54.702781 11061 tablet.cc:1724] T b018c17ab00f46b6b1eab7e49e0adfe5 P 66abd7e8893940bdbe81d60bffc91261: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:02:54.718520 11051 log.cc:927] Time spent T 420a103ab9df43e9b3d34aacfd2325aa P 305b05bc72f04d769644fbff5188bc26: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 13:02:54.648599 11037 tablet.cc:1724] T 420a103ab9df43e9b3d34aacfd2325aa P d895d0e90a3b45ed9aed3af8222a9b5d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:54.726548 11067 tablet.cc:1724] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P 305b05bc72f04d769644fbff5188bc26: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:54.737910 11039 raft_consensus.cc:993] T 420a103ab9df43e9b3d34aacfd2325aa P d895d0e90a3b45ed9aed3af8222a9b5d: : Instructing follower 305b05bc72f04d769644fbff5188bc26 to start an election
I20260709 13:02:54.738897 11029 raft_consensus.cc:1081] T 420a103ab9df43e9b3d34aacfd2325aa P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 LEADER]: Signalling peer 305b05bc72f04d769644fbff5188bc26 to start an election
I20260709 13:02:54.698792 11059 tablet.cc:1724] T b498f794eab54c15846243452d7992e0 P d895d0e90a3b45ed9aed3af8222a9b5d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:54.765359 10770 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "420a103ab9df43e9b3d34aacfd2325aa"
dest_uuid: "305b05bc72f04d769644fbff5188bc26"
 from {username='slave'} at 127.0.0.1:59746
I20260709 13:02:54.766000 10770 raft_consensus.cc:493] T 420a103ab9df43e9b3d34aacfd2325aa P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:54.766419 10770 raft_consensus.cc:3060] T 420a103ab9df43e9b3d34aacfd2325aa P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:54.772826 11064 tablet.cc:1724] T 30e72e0b20944bcbbea372c99c5f27fc P 305b05bc72f04d769644fbff5188bc26: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:02:54.773726 11060 log.cc:927] Time spent T 30e72e0b20944bcbbea372c99c5f27fc P d895d0e90a3b45ed9aed3af8222a9b5d: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:02:54.780712 11065 tablet.cc:1724] T 110992c04e984796a1919262f4bbe67f P d895d0e90a3b45ed9aed3af8222a9b5d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:54.803277 10622 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b018c17ab00f46b6b1eab7e49e0adfe5"
dest_uuid: "66abd7e8893940bdbe81d60bffc91261"
mode: GRACEFUL
new_leader_uuid: "305b05bc72f04d769644fbff5188bc26"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:02:54.814438 11064 tablet.cc:1724] T 34e0b8824c444b59b50cc2c8f61f49af P 305b05bc72f04d769644fbff5188bc26: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:54.818606 10622 raft_consensus.cc:606] T b018c17ab00f46b6b1eab7e49e0adfe5 P 66abd7e8893940bdbe81d60bffc91261 [term 1 LEADER]: Received request to transfer leadership to TS 305b05bc72f04d769644fbff5188bc26
I20260709 13:02:54.824791   431 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:02:54.825488   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:54.828760 11052 tablet.cc:1724] T 420a103ab9df43e9b3d34aacfd2325aa P 305b05bc72f04d769644fbff5188bc26: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:54.830055 11061 tablet.cc:1724] T 70931771066e47f7a57a558edb1b3e61 P 66abd7e8893940bdbe81d60bffc91261: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:54.836874 11074 tablet.cc:1724] T b018c17ab00f46b6b1eab7e49e0adfe5 P d895d0e90a3b45ed9aed3af8222a9b5d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:54.838447 11067 tablet.cc:1724] T 70931771066e47f7a57a558edb1b3e61 P 305b05bc72f04d769644fbff5188bc26: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:54.840019 10695 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0edc1ee1d1aa48b38e4df79d771249ad"
dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d"
mode: GRACEFUL
new_leader_uuid: "305b05bc72f04d769644fbff5188bc26"
 from {username='slave'} at 127.0.0.1:42202
I20260709 13:02:54.840992 10695 raft_consensus.cc:606] T 0edc1ee1d1aa48b38e4df79d771249ad P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 LEADER]: Received request to transfer leadership to TS 305b05bc72f04d769644fbff5188bc26
I20260709 13:02:54.861616 10622 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c7a40faf0455492eb35f727fc91e9fab"
dest_uuid: "66abd7e8893940bdbe81d60bffc91261"
mode: GRACEFUL
new_leader_uuid: "305b05bc72f04d769644fbff5188bc26"
 from {username='slave'} at 127.0.0.1:49014
I20260709 13:02:54.863404 10622 raft_consensus.cc:606] T c7a40faf0455492eb35f727fc91e9fab P 66abd7e8893940bdbe81d60bffc91261 [term 2 LEADER]: Received request to transfer leadership to TS 305b05bc72f04d769644fbff5188bc26
I20260709 13:02:54.798862 11035 tablet.cc:1724] T 30e72e0b20944bcbbea372c99c5f27fc P 66abd7e8893940bdbe81d60bffc91261: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:54.866462 11071 tablet.cc:1724] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P 66abd7e8893940bdbe81d60bffc91261: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:54.868335   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:02:54.870321   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:02:54.852798 11046 tablet.cc:1724] T 110992c04e984796a1919262f4bbe67f P 66abd7e8893940bdbe81d60bffc91261: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:54.820130 11062 tablet.cc:1724] T 110992c04e984796a1919262f4bbe67f P 305b05bc72f04d769644fbff5188bc26: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:54.885317 11059 tablet.cc:1724] T 34e0b8824c444b59b50cc2c8f61f49af P d895d0e90a3b45ed9aed3af8222a9b5d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:54.896426 11064 tablet.cc:1724] T 57fe93cb1bec4bc1ad43b091fb49f120 P 305b05bc72f04d769644fbff5188bc26: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:54.905428 11065 tablet.cc:1724] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P d895d0e90a3b45ed9aed3af8222a9b5d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:54.906464 10971 raft_consensus.cc:993] T 0edc1ee1d1aa48b38e4df79d771249ad P d895d0e90a3b45ed9aed3af8222a9b5d: : Instructing follower 305b05bc72f04d769644fbff5188bc26 to start an election
I20260709 13:02:54.886935 11037 tablet.cc:1724] T 30e72e0b20944bcbbea372c99c5f27fc P d895d0e90a3b45ed9aed3af8222a9b5d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:54.919991 11036 raft_consensus.cc:1081] T 0edc1ee1d1aa48b38e4df79d771249ad P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 LEADER]: Signalling peer 305b05bc72f04d769644fbff5188bc26 to start an election
I20260709 13:02:54.922119 11071 tablet.cc:1724] T 34e0b8824c444b59b50cc2c8f61f49af P 66abd7e8893940bdbe81d60bffc91261: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:54.923609 11074 tablet.cc:1724] T 57fe93cb1bec4bc1ad43b091fb49f120 P d895d0e90a3b45ed9aed3af8222a9b5d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:54.919564 11061 tablet.cc:1724] T 57fe93cb1bec4bc1ad43b091fb49f120 P 66abd7e8893940bdbe81d60bffc91261: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:02:54.927917 10772 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0edc1ee1d1aa48b38e4df79d771249ad"
dest_uuid: "305b05bc72f04d769644fbff5188bc26"
 from {username='slave'} at 127.0.0.1:59746
I20260709 13:02:54.930141 10772 raft_consensus.cc:493] T 0edc1ee1d1aa48b38e4df79d771249ad P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:54.930600 10772 raft_consensus.cc:3060] T 0edc1ee1d1aa48b38e4df79d771249ad P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:54.866418 10770 raft_consensus.cc:515] T 420a103ab9df43e9b3d34aacfd2325aa P 305b05bc72f04d769644fbff5188bc26 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:54.945075 10770 leader_election.cc:290] T 420a103ab9df43e9b3d34aacfd2325aa P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 3 election: Requested vote from peers 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009), d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683)
I20260709 13:02:54.946521 10695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "420a103ab9df43e9b3d34aacfd2325aa" candidate_uuid: "305b05bc72f04d769644fbff5188bc26" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d"
I20260709 13:02:54.947237 10695 raft_consensus.cc:3055] T 420a103ab9df43e9b3d34aacfd2325aa P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:54.947557 10695 raft_consensus.cc:740] T 420a103ab9df43e9b3d34aacfd2325aa P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d895d0e90a3b45ed9aed3af8222a9b5d, State: Running, Role: LEADER
I20260709 13:02:54.946585 10624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "420a103ab9df43e9b3d34aacfd2325aa" candidate_uuid: "305b05bc72f04d769644fbff5188bc26" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "66abd7e8893940bdbe81d60bffc91261"
I20260709 13:02:54.948547 10624 raft_consensus.cc:3060] T 420a103ab9df43e9b3d34aacfd2325aa P 66abd7e8893940bdbe81d60bffc91261 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:54.948374 10695 consensus_queue.cc:260] T 420a103ab9df43e9b3d34aacfd2325aa P d895d0e90a3b45ed9aed3af8222a9b5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:54.950060 10695 raft_consensus.cc:3060] T 420a103ab9df43e9b3d34aacfd2325aa P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:54.959182 10695 raft_consensus.cc:2468] T 420a103ab9df43e9b3d34aacfd2325aa P d895d0e90a3b45ed9aed3af8222a9b5d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 305b05bc72f04d769644fbff5188bc26 in term 3.
I20260709 13:02:54.960433 10737 leader_election.cc:304] T 420a103ab9df43e9b3d34aacfd2325aa P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 305b05bc72f04d769644fbff5188bc26, d895d0e90a3b45ed9aed3af8222a9b5d; no voters: 
I20260709 13:02:54.961493 11072 raft_consensus.cc:2804] T 420a103ab9df43e9b3d34aacfd2325aa P 305b05bc72f04d769644fbff5188bc26 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:54.961993 11072 raft_consensus.cc:697] T 420a103ab9df43e9b3d34aacfd2325aa P 305b05bc72f04d769644fbff5188bc26 [term 3 LEADER]: Becoming Leader. State: Replica: 305b05bc72f04d769644fbff5188bc26, State: Running, Role: LEADER
I20260709 13:02:54.962805 11072 consensus_queue.cc:237] T 420a103ab9df43e9b3d34aacfd2325aa P 305b05bc72f04d769644fbff5188bc26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:54.967772 10772 raft_consensus.cc:515] T 0edc1ee1d1aa48b38e4df79d771249ad P 305b05bc72f04d769644fbff5188bc26 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:54.969906 10772 leader_election.cc:290] T 0edc1ee1d1aa48b38e4df79d771249ad P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 3 election: Requested vote from peers 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009), d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683)
I20260709 13:02:54.970921 10622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edc1ee1d1aa48b38e4df79d771249ad" candidate_uuid: "305b05bc72f04d769644fbff5188bc26" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "66abd7e8893940bdbe81d60bffc91261"
I20260709 13:02:54.971360 10695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0edc1ee1d1aa48b38e4df79d771249ad" candidate_uuid: "305b05bc72f04d769644fbff5188bc26" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d"
I20260709 13:02:54.971640 10622 raft_consensus.cc:3060] T 0edc1ee1d1aa48b38e4df79d771249ad P 66abd7e8893940bdbe81d60bffc91261 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:54.972048 10695 raft_consensus.cc:3055] T 0edc1ee1d1aa48b38e4df79d771249ad P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:54.972445 10695 raft_consensus.cc:740] T 0edc1ee1d1aa48b38e4df79d771249ad P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: d895d0e90a3b45ed9aed3af8222a9b5d, State: Running, Role: LEADER
I20260709 13:02:54.973397 10695 consensus_queue.cc:260] T 0edc1ee1d1aa48b38e4df79d771249ad P d895d0e90a3b45ed9aed3af8222a9b5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:54.974751 10695 raft_consensus.cc:3060] T 0edc1ee1d1aa48b38e4df79d771249ad P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:54.975180 11019 raft_consensus.cc:993] T c7a40faf0455492eb35f727fc91e9fab P 66abd7e8893940bdbe81d60bffc91261: : Instructing follower 305b05bc72f04d769644fbff5188bc26 to start an election
I20260709 13:02:54.975713 11019 raft_consensus.cc:1081] T c7a40faf0455492eb35f727fc91e9fab P 66abd7e8893940bdbe81d60bffc91261 [term 2 LEADER]: Signalling peer 305b05bc72f04d769644fbff5188bc26 to start an election
I20260709 13:02:54.977547 10772 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c7a40faf0455492eb35f727fc91e9fab"
dest_uuid: "305b05bc72f04d769644fbff5188bc26"
 from {username='slave'} at 127.0.0.1:59742
I20260709 13:02:54.978112 10772 raft_consensus.cc:493] T c7a40faf0455492eb35f727fc91e9fab P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:54.978510 10772 raft_consensus.cc:3060] T c7a40faf0455492eb35f727fc91e9fab P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:54.982535 10695 raft_consensus.cc:2468] T 0edc1ee1d1aa48b38e4df79d771249ad P d895d0e90a3b45ed9aed3af8222a9b5d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 305b05bc72f04d769644fbff5188bc26 in term 3.
I20260709 13:02:54.984658 10737 leader_election.cc:304] T 0edc1ee1d1aa48b38e4df79d771249ad P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 305b05bc72f04d769644fbff5188bc26, d895d0e90a3b45ed9aed3af8222a9b5d; no voters: 
I20260709 13:02:54.985702 11072 raft_consensus.cc:2804] T 0edc1ee1d1aa48b38e4df79d771249ad P 305b05bc72f04d769644fbff5188bc26 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:54.986163 11072 raft_consensus.cc:697] T 0edc1ee1d1aa48b38e4df79d771249ad P 305b05bc72f04d769644fbff5188bc26 [term 3 LEADER]: Becoming Leader. State: Replica: 305b05bc72f04d769644fbff5188bc26, State: Running, Role: LEADER
I20260709 13:02:54.971007 10624 raft_consensus.cc:2468] T 420a103ab9df43e9b3d34aacfd2325aa P 66abd7e8893940bdbe81d60bffc91261 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 305b05bc72f04d769644fbff5188bc26 in term 3.
I20260709 13:02:54.986994 10772 raft_consensus.cc:515] T c7a40faf0455492eb35f727fc91e9fab P 305b05bc72f04d769644fbff5188bc26 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:54.987000 11072 consensus_queue.cc:237] T 0edc1ee1d1aa48b38e4df79d771249ad P 305b05bc72f04d769644fbff5188bc26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:54.990646 10772 leader_election.cc:290] T c7a40faf0455492eb35f727fc91e9fab P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 3 election: Requested vote from peers 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009), d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683)
I20260709 13:02:54.988773 10622 raft_consensus.cc:2468] T 0edc1ee1d1aa48b38e4df79d771249ad P 66abd7e8893940bdbe81d60bffc91261 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 305b05bc72f04d769644fbff5188bc26 in term 3.
I20260709 13:02:54.991709 10695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7a40faf0455492eb35f727fc91e9fab" candidate_uuid: "305b05bc72f04d769644fbff5188bc26" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d"
I20260709 13:02:54.991770 10624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c7a40faf0455492eb35f727fc91e9fab" candidate_uuid: "305b05bc72f04d769644fbff5188bc26" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "66abd7e8893940bdbe81d60bffc91261"
I20260709 13:02:54.992412 10695 raft_consensus.cc:3060] T c7a40faf0455492eb35f727fc91e9fab P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:54.992630 10624 raft_consensus.cc:3055] T c7a40faf0455492eb35f727fc91e9fab P 66abd7e8893940bdbe81d60bffc91261 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:02:54.993182 10624 raft_consensus.cc:740] T c7a40faf0455492eb35f727fc91e9fab P 66abd7e8893940bdbe81d60bffc91261 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 66abd7e8893940bdbe81d60bffc91261, State: Running, Role: LEADER
I20260709 13:02:54.994303 10624 consensus_queue.cc:260] T c7a40faf0455492eb35f727fc91e9fab P 66abd7e8893940bdbe81d60bffc91261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:54.995398 10624 raft_consensus.cc:3060] T c7a40faf0455492eb35f727fc91e9fab P 66abd7e8893940bdbe81d60bffc91261 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:55.003443 10695 raft_consensus.cc:2468] T c7a40faf0455492eb35f727fc91e9fab P d895d0e90a3b45ed9aed3af8222a9b5d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 305b05bc72f04d769644fbff5188bc26 in term 3.
I20260709 13:02:55.003569 10624 raft_consensus.cc:2468] T c7a40faf0455492eb35f727fc91e9fab P 66abd7e8893940bdbe81d60bffc91261 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 305b05bc72f04d769644fbff5188bc26 in term 3.
I20260709 13:02:55.005095 10519 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 4631e7102cf64abaacdf677f51e88449: soft_deleted_table [id=4ea887c0026e4e15825f08f4d2396528] alter complete (version 1)
I20260709 13:02:55.005035 10737 leader_election.cc:304] T c7a40faf0455492eb35f727fc91e9fab P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 305b05bc72f04d769644fbff5188bc26, 66abd7e8893940bdbe81d60bffc91261; no voters: 
I20260709 13:02:55.006325 11041 raft_consensus.cc:2804] T c7a40faf0455492eb35f727fc91e9fab P 305b05bc72f04d769644fbff5188bc26 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:55.006783 11041 raft_consensus.cc:697] T c7a40faf0455492eb35f727fc91e9fab P 305b05bc72f04d769644fbff5188bc26 [term 3 LEADER]: Becoming Leader. State: Replica: 305b05bc72f04d769644fbff5188bc26, State: Running, Role: LEADER
I20260709 13:02:55.007692 11041 consensus_queue.cc:237] T c7a40faf0455492eb35f727fc91e9fab P 305b05bc72f04d769644fbff5188bc26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:55.015561 11019 raft_consensus.cc:993] T b018c17ab00f46b6b1eab7e49e0adfe5 P 66abd7e8893940bdbe81d60bffc91261: : Instructing follower 305b05bc72f04d769644fbff5188bc26 to start an election
I20260709 13:02:55.016373 11068 raft_consensus.cc:1081] T b018c17ab00f46b6b1eab7e49e0adfe5 P 66abd7e8893940bdbe81d60bffc91261 [term 1 LEADER]: Signalling peer 305b05bc72f04d769644fbff5188bc26 to start an election
I20260709 13:02:55.019532 10772 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b018c17ab00f46b6b1eab7e49e0adfe5"
dest_uuid: "305b05bc72f04d769644fbff5188bc26"
 from {username='slave'} at 127.0.0.1:59742
I20260709 13:02:55.021296 10772 raft_consensus.cc:493] T b018c17ab00f46b6b1eab7e49e0adfe5 P 305b05bc72f04d769644fbff5188bc26 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:02:55.022935 10519 catalog_manager.cc:5697] T 420a103ab9df43e9b3d34aacfd2325aa P 305b05bc72f04d769644fbff5188bc26 reported cstate change: term changed from 2 to 3, leader changed from d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194) to 305b05bc72f04d769644fbff5188bc26 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "305b05bc72f04d769644fbff5188bc26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:55.024750 10772 raft_consensus.cc:3060] T b018c17ab00f46b6b1eab7e49e0adfe5 P 305b05bc72f04d769644fbff5188bc26 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:55.025590 10519 catalog_manager.cc:5697] T 0edc1ee1d1aa48b38e4df79d771249ad P 305b05bc72f04d769644fbff5188bc26 reported cstate change: term changed from 2 to 3, leader changed from d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194) to 305b05bc72f04d769644fbff5188bc26 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "305b05bc72f04d769644fbff5188bc26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:55.030555 10772 raft_consensus.cc:515] T b018c17ab00f46b6b1eab7e49e0adfe5 P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:55.032133 10772 leader_election.cc:290] T b018c17ab00f46b6b1eab7e49e0adfe5 P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 2 election: Requested vote from peers 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009), d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683)
I20260709 13:02:55.033074 10624 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b018c17ab00f46b6b1eab7e49e0adfe5" candidate_uuid: "305b05bc72f04d769644fbff5188bc26" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "66abd7e8893940bdbe81d60bffc91261"
I20260709 13:02:55.033473 10695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b018c17ab00f46b6b1eab7e49e0adfe5" candidate_uuid: "305b05bc72f04d769644fbff5188bc26" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d"
I20260709 13:02:55.033833 10624 raft_consensus.cc:3055] T b018c17ab00f46b6b1eab7e49e0adfe5 P 66abd7e8893940bdbe81d60bffc91261 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:02:55.034162 10695 raft_consensus.cc:3060] T b018c17ab00f46b6b1eab7e49e0adfe5 P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:55.034267 10624 raft_consensus.cc:740] T b018c17ab00f46b6b1eab7e49e0adfe5 P 66abd7e8893940bdbe81d60bffc91261 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 66abd7e8893940bdbe81d60bffc91261, State: Running, Role: LEADER
I20260709 13:02:55.035318 10624 consensus_queue.cc:260] T b018c17ab00f46b6b1eab7e49e0adfe5 P 66abd7e8893940bdbe81d60bffc91261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:55.036728 10624 raft_consensus.cc:3060] T b018c17ab00f46b6b1eab7e49e0adfe5 P 66abd7e8893940bdbe81d60bffc91261 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:02:55.041945 10695 raft_consensus.cc:2468] T b018c17ab00f46b6b1eab7e49e0adfe5 P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 305b05bc72f04d769644fbff5188bc26 in term 2.
I20260709 13:02:55.043361 10737 leader_election.cc:304] T b018c17ab00f46b6b1eab7e49e0adfe5 P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 305b05bc72f04d769644fbff5188bc26, d895d0e90a3b45ed9aed3af8222a9b5d; no voters: 
I20260709 13:02:55.043720 10519 catalog_manager.cc:5697] T c7a40faf0455492eb35f727fc91e9fab P 305b05bc72f04d769644fbff5188bc26 reported cstate change: term changed from 2 to 3, leader changed from 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193) to 305b05bc72f04d769644fbff5188bc26 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "305b05bc72f04d769644fbff5188bc26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:55.044416 11041 raft_consensus.cc:2804] T b018c17ab00f46b6b1eab7e49e0adfe5 P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:02:55.044695 10624 raft_consensus.cc:2468] T b018c17ab00f46b6b1eab7e49e0adfe5 P 66abd7e8893940bdbe81d60bffc91261 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 305b05bc72f04d769644fbff5188bc26 in term 2.
I20260709 13:02:55.045264 11041 raft_consensus.cc:697] T b018c17ab00f46b6b1eab7e49e0adfe5 P 305b05bc72f04d769644fbff5188bc26 [term 2 LEADER]: Becoming Leader. State: Replica: 305b05bc72f04d769644fbff5188bc26, State: Running, Role: LEADER
I20260709 13:02:55.046277 11041 consensus_queue.cc:237] T b018c17ab00f46b6b1eab7e49e0adfe5 P 305b05bc72f04d769644fbff5188bc26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:55.056939 10519 catalog_manager.cc:5697] T b018c17ab00f46b6b1eab7e49e0adfe5 P 305b05bc72f04d769644fbff5188bc26 reported cstate change: term changed from 1 to 2, leader changed from 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193) to 305b05bc72f04d769644fbff5188bc26 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "305b05bc72f04d769644fbff5188bc26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:55.372985 10624 raft_consensus.cc:1275] T 0edc1ee1d1aa48b38e4df79d771249ad P 66abd7e8893940bdbe81d60bffc91261 [term 3 FOLLOWER]: Refusing update from remote peer 305b05bc72f04d769644fbff5188bc26: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:55.374384 11041 consensus_queue.cc:1048] T 0edc1ee1d1aa48b38e4df79d771249ad P 305b05bc72f04d769644fbff5188bc26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:55.383584 10695 raft_consensus.cc:1275] T 0edc1ee1d1aa48b38e4df79d771249ad P d895d0e90a3b45ed9aed3af8222a9b5d [term 3 FOLLOWER]: Refusing update from remote peer 305b05bc72f04d769644fbff5188bc26: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:55.387952 11041 consensus_queue.cc:1048] T 0edc1ee1d1aa48b38e4df79d771249ad P 305b05bc72f04d769644fbff5188bc26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:55.482278 10696 raft_consensus.cc:1275] T b018c17ab00f46b6b1eab7e49e0adfe5 P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Refusing update from remote peer 305b05bc72f04d769644fbff5188bc26: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:02:55.483620 11041 consensus_queue.cc:1048] T b018c17ab00f46b6b1eab7e49e0adfe5 P 305b05bc72f04d769644fbff5188bc26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:55.490707 10624 raft_consensus.cc:1275] T b018c17ab00f46b6b1eab7e49e0adfe5 P 66abd7e8893940bdbe81d60bffc91261 [term 2 FOLLOWER]: Refusing update from remote peer 305b05bc72f04d769644fbff5188bc26: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:02:55.492966 11041 consensus_queue.cc:1048] T b018c17ab00f46b6b1eab7e49e0adfe5 P 305b05bc72f04d769644fbff5188bc26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:55.520170 10624 raft_consensus.cc:1275] T 420a103ab9df43e9b3d34aacfd2325aa P 66abd7e8893940bdbe81d60bffc91261 [term 3 FOLLOWER]: Refusing update from remote peer 305b05bc72f04d769644fbff5188bc26: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:02:55.521488 11085 consensus_queue.cc:1048] T 420a103ab9df43e9b3d34aacfd2325aa P 305b05bc72f04d769644fbff5188bc26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:55.530011 10696 raft_consensus.cc:1275] T 420a103ab9df43e9b3d34aacfd2325aa P d895d0e90a3b45ed9aed3af8222a9b5d [term 3 FOLLOWER]: Refusing update from remote peer 305b05bc72f04d769644fbff5188bc26: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:02:55.531836 11085 consensus_queue.cc:1048] T 420a103ab9df43e9b3d34aacfd2325aa P 305b05bc72f04d769644fbff5188bc26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:02:55.541846 10696 raft_consensus.cc:1275] T c7a40faf0455492eb35f727fc91e9fab P d895d0e90a3b45ed9aed3af8222a9b5d [term 3 FOLLOWER]: Refusing update from remote peer 305b05bc72f04d769644fbff5188bc26: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:55.543553 11085 consensus_queue.cc:1048] T c7a40faf0455492eb35f727fc91e9fab P 305b05bc72f04d769644fbff5188bc26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:55.555936 10624 raft_consensus.cc:1275] T c7a40faf0455492eb35f727fc91e9fab P 66abd7e8893940bdbe81d60bffc91261 [term 3 FOLLOWER]: Refusing update from remote peer 305b05bc72f04d769644fbff5188bc26: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:55.559463 11085 consensus_queue.cc:1048] T c7a40faf0455492eb35f727fc91e9fab P 305b05bc72f04d769644fbff5188bc26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:02:56.099542   431 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:02:56.105680   431 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:02:56.106113   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:02:56.111253   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:02:56.111641   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:02:56.847347 10645 debug-util.cc:398] Leaking SignalData structure 0x7b08001e2260 after lost signal to thread 434
W20260709 13:02:56.848407 10645 debug-util.cc:398] Leaking SignalData structure 0x7b0800120780 after lost signal to thread 10556
W20260709 13:02:56.849459 10645 debug-util.cc:398] Leaking SignalData structure 0x7b08002a6d40 after lost signal to thread 10648
W20260709 13:02:56.850574 10645 debug-util.cc:398] Leaking SignalData structure 0x7b080026cf80 after lost signal to thread 10723
W20260709 13:02:56.851594 10645 debug-util.cc:398] Leaking SignalData structure 0x7b0800103c60 after lost signal to thread 10797
I20260709 13:02:57.148684   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 13:02:57.173220 10663 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 7 similar messages]
W20260709 13:02:57.178752 10663 consensus_peers.cc:597] T 110992c04e984796a1919262f4bbe67f P d895d0e90a3b45ed9aed3af8222a9b5d -> Peer 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009): Couldn't send request to peer 66abd7e8893940bdbe81d60bffc91261. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:57.195166   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:02:57.196271   431 tablet_replica.cc:333] T 34e0b8824c444b59b50cc2c8f61f49af P 66abd7e8893940bdbe81d60bffc91261: stopping tablet replica
I20260709 13:02:57.197309   431 raft_consensus.cc:2243] T 34e0b8824c444b59b50cc2c8f61f49af P 66abd7e8893940bdbe81d60bffc91261 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:57.197940   431 raft_consensus.cc:2272] T 34e0b8824c444b59b50cc2c8f61f49af P 66abd7e8893940bdbe81d60bffc91261 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:57.200773   431 tablet_replica.cc:333] T 70931771066e47f7a57a558edb1b3e61 P 66abd7e8893940bdbe81d60bffc91261: stopping tablet replica
I20260709 13:02:57.201628   431 raft_consensus.cc:2243] T 70931771066e47f7a57a558edb1b3e61 P 66abd7e8893940bdbe81d60bffc91261 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:57.202209   431 raft_consensus.cc:2272] T 70931771066e47f7a57a558edb1b3e61 P 66abd7e8893940bdbe81d60bffc91261 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:57.204946   431 tablet_replica.cc:333] T 30e72e0b20944bcbbea372c99c5f27fc P 66abd7e8893940bdbe81d60bffc91261: stopping tablet replica
I20260709 13:02:57.205842   431 raft_consensus.cc:2243] T 30e72e0b20944bcbbea372c99c5f27fc P 66abd7e8893940bdbe81d60bffc91261 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:57.206971   431 raft_consensus.cc:2272] T 30e72e0b20944bcbbea372c99c5f27fc P 66abd7e8893940bdbe81d60bffc91261 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:57.209800   431 tablet_replica.cc:333] T 57fe93cb1bec4bc1ad43b091fb49f120 P 66abd7e8893940bdbe81d60bffc91261: stopping tablet replica
I20260709 13:02:57.210667   431 raft_consensus.cc:2243] T 57fe93cb1bec4bc1ad43b091fb49f120 P 66abd7e8893940bdbe81d60bffc91261 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:57.211714   431 raft_consensus.cc:2272] T 57fe93cb1bec4bc1ad43b091fb49f120 P 66abd7e8893940bdbe81d60bffc91261 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:57.214329   431 tablet_replica.cc:333] T 110992c04e984796a1919262f4bbe67f P 66abd7e8893940bdbe81d60bffc91261: stopping tablet replica
I20260709 13:02:57.215150   431 raft_consensus.cc:2243] T 110992c04e984796a1919262f4bbe67f P 66abd7e8893940bdbe81d60bffc91261 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:57.215766   431 raft_consensus.cc:2272] T 110992c04e984796a1919262f4bbe67f P 66abd7e8893940bdbe81d60bffc91261 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:57.218669   431 tablet_replica.cc:333] T 020e5de5fe4f481ba994779ae752696c P 66abd7e8893940bdbe81d60bffc91261: stopping tablet replica
I20260709 13:02:57.219631   431 raft_consensus.cc:2243] T 020e5de5fe4f481ba994779ae752696c P 66abd7e8893940bdbe81d60bffc91261 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:57.220897   431 raft_consensus.cc:2272] T 020e5de5fe4f481ba994779ae752696c P 66abd7e8893940bdbe81d60bffc91261 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:57.224174   431 tablet_replica.cc:333] T 420a103ab9df43e9b3d34aacfd2325aa P 66abd7e8893940bdbe81d60bffc91261: stopping tablet replica
I20260709 13:02:57.225149   431 raft_consensus.cc:2243] T 420a103ab9df43e9b3d34aacfd2325aa P 66abd7e8893940bdbe81d60bffc91261 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:57.225868   431 raft_consensus.cc:2272] T 420a103ab9df43e9b3d34aacfd2325aa P 66abd7e8893940bdbe81d60bffc91261 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:57.228669   431 tablet_replica.cc:333] T 0edc1ee1d1aa48b38e4df79d771249ad P 66abd7e8893940bdbe81d60bffc91261: stopping tablet replica
I20260709 13:02:57.229537   431 raft_consensus.cc:2243] T 0edc1ee1d1aa48b38e4df79d771249ad P 66abd7e8893940bdbe81d60bffc91261 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:57.230195   431 raft_consensus.cc:2272] T 0edc1ee1d1aa48b38e4df79d771249ad P 66abd7e8893940bdbe81d60bffc91261 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:57.233379   431 tablet_replica.cc:333] T ddaf52c482884428ab1694c903f54cd8 P 66abd7e8893940bdbe81d60bffc91261: stopping tablet replica
I20260709 13:02:57.234248   431 raft_consensus.cc:2243] T ddaf52c482884428ab1694c903f54cd8 P 66abd7e8893940bdbe81d60bffc91261 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:57.234869   431 raft_consensus.cc:2272] T ddaf52c482884428ab1694c903f54cd8 P 66abd7e8893940bdbe81d60bffc91261 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:57.238312   431 tablet_replica.cc:333] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 66abd7e8893940bdbe81d60bffc91261: stopping tablet replica
I20260709 13:02:57.239183   431 raft_consensus.cc:2243] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 66abd7e8893940bdbe81d60bffc91261 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:57.239817   431 raft_consensus.cc:2272] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 66abd7e8893940bdbe81d60bffc91261 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:57.242959   431 tablet_replica.cc:333] T b498f794eab54c15846243452d7992e0 P 66abd7e8893940bdbe81d60bffc91261: stopping tablet replica
I20260709 13:02:57.243780   431 raft_consensus.cc:2243] T b498f794eab54c15846243452d7992e0 P 66abd7e8893940bdbe81d60bffc91261 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:57.244920   431 raft_consensus.cc:2272] T b498f794eab54c15846243452d7992e0 P 66abd7e8893940bdbe81d60bffc91261 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:57.247839   431 tablet_replica.cc:333] T c7a40faf0455492eb35f727fc91e9fab P 66abd7e8893940bdbe81d60bffc91261: stopping tablet replica
I20260709 13:02:57.248775   431 raft_consensus.cc:2243] T c7a40faf0455492eb35f727fc91e9fab P 66abd7e8893940bdbe81d60bffc91261 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:57.249356   431 raft_consensus.cc:2272] T c7a40faf0455492eb35f727fc91e9fab P 66abd7e8893940bdbe81d60bffc91261 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:57.252591   431 tablet_replica.cc:333] T bd8914371e234fd89180b58dd299e334 P 66abd7e8893940bdbe81d60bffc91261: stopping tablet replica
I20260709 13:02:57.253545   431 raft_consensus.cc:2243] T bd8914371e234fd89180b58dd299e334 P 66abd7e8893940bdbe81d60bffc91261 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:57.254305   431 raft_consensus.cc:2272] T bd8914371e234fd89180b58dd299e334 P 66abd7e8893940bdbe81d60bffc91261 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:57.257754   431 tablet_replica.cc:333] T b018c17ab00f46b6b1eab7e49e0adfe5 P 66abd7e8893940bdbe81d60bffc91261: stopping tablet replica
I20260709 13:02:57.258538   431 raft_consensus.cc:2243] T b018c17ab00f46b6b1eab7e49e0adfe5 P 66abd7e8893940bdbe81d60bffc91261 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:57.259102   431 raft_consensus.cc:2272] T b018c17ab00f46b6b1eab7e49e0adfe5 P 66abd7e8893940bdbe81d60bffc91261 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:57.261838   431 tablet_replica.cc:333] T e23dd32048434889a42ea8dc88626ed3 P 66abd7e8893940bdbe81d60bffc91261: stopping tablet replica
I20260709 13:02:57.262614   431 raft_consensus.cc:2243] T e23dd32048434889a42ea8dc88626ed3 P 66abd7e8893940bdbe81d60bffc91261 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:57.263234   431 raft_consensus.cc:2272] T e23dd32048434889a42ea8dc88626ed3 P 66abd7e8893940bdbe81d60bffc91261 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:57.266379   431 tablet_replica.cc:333] T b5719c2d308646c28e9b2297f7d3becd P 66abd7e8893940bdbe81d60bffc91261: stopping tablet replica
I20260709 13:02:57.267148   431 raft_consensus.cc:2243] T b5719c2d308646c28e9b2297f7d3becd P 66abd7e8893940bdbe81d60bffc91261 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:57.268226   431 raft_consensus.cc:2272] T b5719c2d308646c28e9b2297f7d3becd P 66abd7e8893940bdbe81d60bffc91261 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:57.271358   431 tablet_replica.cc:333] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P 66abd7e8893940bdbe81d60bffc91261: stopping tablet replica
I20260709 13:02:57.272044   431 raft_consensus.cc:2243] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P 66abd7e8893940bdbe81d60bffc91261 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:02:57.272634   431 raft_consensus.cc:2272] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P 66abd7e8893940bdbe81d60bffc91261 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:02:57.275175   431 tablet_replica.cc:333] T bf181cd133ed4b8d8b3cbe5b36b23316 P 66abd7e8893940bdbe81d60bffc91261: stopping tablet replica
I20260709 13:02:57.275867   431 raft_consensus.cc:2243] T bf181cd133ed4b8d8b3cbe5b36b23316 P 66abd7e8893940bdbe81d60bffc91261 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:02:57.276975   431 raft_consensus.cc:2272] T bf181cd133ed4b8d8b3cbe5b36b23316 P 66abd7e8893940bdbe81d60bffc91261 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:02:57.282824 10663 consensus_peers.cc:597] T 70931771066e47f7a57a558edb1b3e61 P d895d0e90a3b45ed9aed3af8222a9b5d -> Peer 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009): Couldn't send request to peer 66abd7e8893940bdbe81d60bffc91261. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:57.285183 10663 consensus_peers.cc:597] T bd8914371e234fd89180b58dd299e334 P d895d0e90a3b45ed9aed3af8222a9b5d -> Peer 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009): Couldn't send request to peer 66abd7e8893940bdbe81d60bffc91261. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:57.333884 10663 consensus_peers.cc:597] T ddaf52c482884428ab1694c903f54cd8 P d895d0e90a3b45ed9aed3af8222a9b5d -> Peer 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009): Couldn't send request to peer 66abd7e8893940bdbe81d60bffc91261. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:44009: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:57.367530 10737 consensus_peers.cc:597] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 305b05bc72f04d769644fbff5188bc26 -> Peer 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009): Couldn't send request to peer 66abd7e8893940bdbe81d60bffc91261. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:44009: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:57.461724 10737 consensus_peers.cc:597] T b018c17ab00f46b6b1eab7e49e0adfe5 P 305b05bc72f04d769644fbff5188bc26 -> Peer 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009): Couldn't send request to peer 66abd7e8893940bdbe81d60bffc91261. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:44009: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:57.471974 10737 consensus_peers.cc:597] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P 305b05bc72f04d769644fbff5188bc26 -> Peer 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009): Couldn't send request to peer 66abd7e8893940bdbe81d60bffc91261. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:44009: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:57.479065 10663 consensus_peers.cc:597] T e23dd32048434889a42ea8dc88626ed3 P d895d0e90a3b45ed9aed3af8222a9b5d -> Peer 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009): Couldn't send request to peer 66abd7e8893940bdbe81d60bffc91261. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:44009: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:57.482148 10737 consensus_peers.cc:597] T 420a103ab9df43e9b3d34aacfd2325aa P 305b05bc72f04d769644fbff5188bc26 -> Peer 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009): Couldn't send request to peer 66abd7e8893940bdbe81d60bffc91261. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:44009: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:57.530433 10737 consensus_peers.cc:597] T 0edc1ee1d1aa48b38e4df79d771249ad P 305b05bc72f04d769644fbff5188bc26 -> Peer 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009): Couldn't send request to peer 66abd7e8893940bdbe81d60bffc91261. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:44009: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:57.634383 10737 consensus_peers.cc:597] T c7a40faf0455492eb35f727fc91e9fab P 305b05bc72f04d769644fbff5188bc26 -> Peer 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009): Couldn't send request to peer 66abd7e8893940bdbe81d60bffc91261. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:44009: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:57.649971 10663 consensus_peers.cc:597] T 34e0b8824c444b59b50cc2c8f61f49af P d895d0e90a3b45ed9aed3af8222a9b5d -> Peer 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009): Couldn't send request to peer 66abd7e8893940bdbe81d60bffc91261. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:44009: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:58.282507 11101 raft_consensus.cc:493] T 30e72e0b20944bcbbea372c99c5f27fc P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66abd7e8893940bdbe81d60bffc91261)
I20260709 13:02:58.283002 11101 raft_consensus.cc:515] T 30e72e0b20944bcbbea372c99c5f27fc P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:58.284960 11101 leader_election.cc:290] T 30e72e0b20944bcbbea372c99c5f27fc P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009), 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947)
I20260709 13:02:58.285948 10769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e72e0b20944bcbbea372c99c5f27fc" candidate_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "305b05bc72f04d769644fbff5188bc26" is_pre_election: true
W20260709 13:02:58.289736 10663 leader_election.cc:336] T 30e72e0b20944bcbbea372c99c5f27fc P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009): Network error: Client connection negotiation failed: client connection to 127.0.107.193:44009: connect: Connection refused (error 111)
I20260709 13:02:58.290216 10663 leader_election.cc:304] T 30e72e0b20944bcbbea372c99c5f27fc P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d895d0e90a3b45ed9aed3af8222a9b5d; no voters: 305b05bc72f04d769644fbff5188bc26, 66abd7e8893940bdbe81d60bffc91261
I20260709 13:02:58.291059 11101 raft_consensus.cc:2749] T 30e72e0b20944bcbbea372c99c5f27fc P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:02:58.320374   431 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 10645)
I20260709 13:02:58.322402 11085 raft_consensus.cc:493] T b5719c2d308646c28e9b2297f7d3becd P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66abd7e8893940bdbe81d60bffc91261)
I20260709 13:02:58.322958 11085 raft_consensus.cc:515] T b5719c2d308646c28e9b2297f7d3becd P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:58.324821 11085 leader_election.cc:290] T b5719c2d308646c28e9b2297f7d3becd P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009), d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683)
I20260709 13:02:58.326673 10695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5719c2d308646c28e9b2297f7d3becd" candidate_uuid: "305b05bc72f04d769644fbff5188bc26" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" is_pre_election: true
W20260709 13:02:58.328823 10737 leader_election.cc:336] T b5719c2d308646c28e9b2297f7d3becd P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009): Network error: Client connection negotiation failed: client connection to 127.0.107.193:44009: connect: Connection refused (error 111)
I20260709 13:02:58.329864 10737 leader_election.cc:304] T b5719c2d308646c28e9b2297f7d3becd P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 305b05bc72f04d769644fbff5188bc26; no voters: 66abd7e8893940bdbe81d60bffc91261, d895d0e90a3b45ed9aed3af8222a9b5d
I20260709 13:02:58.330662 11085 raft_consensus.cc:2749] T b5719c2d308646c28e9b2297f7d3becd P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:58.388294 11085 raft_consensus.cc:493] T 30e72e0b20944bcbbea372c99c5f27fc P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66abd7e8893940bdbe81d60bffc91261)
I20260709 13:02:58.388862 11085 raft_consensus.cc:515] T 30e72e0b20944bcbbea372c99c5f27fc P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:58.390666 11085 leader_election.cc:290] T 30e72e0b20944bcbbea372c99c5f27fc P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009), d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683)
I20260709 13:02:58.392393 10695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e72e0b20944bcbbea372c99c5f27fc" candidate_uuid: "305b05bc72f04d769644fbff5188bc26" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" is_pre_election: true
I20260709 13:02:58.393201 10695 raft_consensus.cc:2468] T 30e72e0b20944bcbbea372c99c5f27fc P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 305b05bc72f04d769644fbff5188bc26 in term 2.
I20260709 13:02:58.394254 10737 leader_election.cc:304] T 30e72e0b20944bcbbea372c99c5f27fc P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 305b05bc72f04d769644fbff5188bc26, d895d0e90a3b45ed9aed3af8222a9b5d; no voters: 
I20260709 13:02:58.395012 11085 raft_consensus.cc:2804] T 30e72e0b20944bcbbea372c99c5f27fc P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:02:58.395067 10737 leader_election.cc:336] T 30e72e0b20944bcbbea372c99c5f27fc P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009): Network error: Client connection negotiation failed: client connection to 127.0.107.193:44009: connect: Connection refused (error 111)
I20260709 13:02:58.395471 11085 raft_consensus.cc:493] T 30e72e0b20944bcbbea372c99c5f27fc P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 66abd7e8893940bdbe81d60bffc91261)
I20260709 13:02:58.395859 11085 raft_consensus.cc:3060] T 30e72e0b20944bcbbea372c99c5f27fc P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:58.401261 11085 raft_consensus.cc:515] T 30e72e0b20944bcbbea372c99c5f27fc P 305b05bc72f04d769644fbff5188bc26 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:58.403172 11085 leader_election.cc:290] T 30e72e0b20944bcbbea372c99c5f27fc P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 3 election: Requested vote from peers 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009), d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683)
I20260709 13:02:58.404649 10695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30e72e0b20944bcbbea372c99c5f27fc" candidate_uuid: "305b05bc72f04d769644fbff5188bc26" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d"
I20260709 13:02:58.405341 10695 raft_consensus.cc:3060] T 30e72e0b20944bcbbea372c99c5f27fc P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:02:58.407315 10737 leader_election.cc:336] T 30e72e0b20944bcbbea372c99c5f27fc P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009): Network error: Client connection negotiation failed: client connection to 127.0.107.193:44009: connect: Connection refused (error 111)
I20260709 13:02:58.411032 10695 raft_consensus.cc:2468] T 30e72e0b20944bcbbea372c99c5f27fc P d895d0e90a3b45ed9aed3af8222a9b5d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 305b05bc72f04d769644fbff5188bc26 in term 3.
I20260709 13:02:58.412367 10737 leader_election.cc:304] T 30e72e0b20944bcbbea372c99c5f27fc P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 305b05bc72f04d769644fbff5188bc26, d895d0e90a3b45ed9aed3af8222a9b5d; no voters: 66abd7e8893940bdbe81d60bffc91261
I20260709 13:02:58.413245 11085 raft_consensus.cc:2804] T 30e72e0b20944bcbbea372c99c5f27fc P 305b05bc72f04d769644fbff5188bc26 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:58.413733 11085 raft_consensus.cc:697] T 30e72e0b20944bcbbea372c99c5f27fc P 305b05bc72f04d769644fbff5188bc26 [term 3 LEADER]: Becoming Leader. State: Replica: 305b05bc72f04d769644fbff5188bc26, State: Running, Role: LEADER
I20260709 13:02:58.414582 11085 consensus_queue.cc:237] T 30e72e0b20944bcbbea372c99c5f27fc P 305b05bc72f04d769644fbff5188bc26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:58.424974 10522 catalog_manager.cc:5697] T 30e72e0b20944bcbbea372c99c5f27fc P 305b05bc72f04d769644fbff5188bc26 reported cstate change: term changed from 2 to 3, leader changed from 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193) to 305b05bc72f04d769644fbff5188bc26 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "305b05bc72f04d769644fbff5188bc26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:58.432322 11085 raft_consensus.cc:493] T 57fe93cb1bec4bc1ad43b091fb49f120 P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66abd7e8893940bdbe81d60bffc91261)
I20260709 13:02:58.433051 11085 raft_consensus.cc:515] T 57fe93cb1bec4bc1ad43b091fb49f120 P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:58.435252 11085 leader_election.cc:290] T 57fe93cb1bec4bc1ad43b091fb49f120 P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009), d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683)
I20260709 13:02:58.438822 10695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe93cb1bec4bc1ad43b091fb49f120" candidate_uuid: "305b05bc72f04d769644fbff5188bc26" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" is_pre_election: true
W20260709 13:02:58.441699 10737 leader_election.cc:336] T 57fe93cb1bec4bc1ad43b091fb49f120 P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009): Network error: Client connection negotiation failed: client connection to 127.0.107.193:44009: connect: Connection refused (error 111)
I20260709 13:02:58.442209 10737 leader_election.cc:304] T 57fe93cb1bec4bc1ad43b091fb49f120 P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 305b05bc72f04d769644fbff5188bc26; no voters: 66abd7e8893940bdbe81d60bffc91261, d895d0e90a3b45ed9aed3af8222a9b5d
I20260709 13:02:58.443287 11085 raft_consensus.cc:2749] T 57fe93cb1bec4bc1ad43b091fb49f120 P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:58.449975 11101 raft_consensus.cc:493] T 020e5de5fe4f481ba994779ae752696c P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66abd7e8893940bdbe81d60bffc91261)
I20260709 13:02:58.450646 11101 raft_consensus.cc:515] T 020e5de5fe4f481ba994779ae752696c P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:58.452920 11101 leader_election.cc:290] T 020e5de5fe4f481ba994779ae752696c P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009), 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947)
I20260709 13:02:58.454068 10769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020e5de5fe4f481ba994779ae752696c" candidate_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "305b05bc72f04d769644fbff5188bc26" is_pre_election: true
W20260709 13:02:58.456478 10663 leader_election.cc:336] T 020e5de5fe4f481ba994779ae752696c P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009): Network error: Client connection negotiation failed: client connection to 127.0.107.193:44009: connect: Connection refused (error 111)
I20260709 13:02:58.456897 10663 leader_election.cc:304] T 020e5de5fe4f481ba994779ae752696c P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d895d0e90a3b45ed9aed3af8222a9b5d; no voters: 305b05bc72f04d769644fbff5188bc26, 66abd7e8893940bdbe81d60bffc91261
I20260709 13:02:58.457486 11101 raft_consensus.cc:2749] T 020e5de5fe4f481ba994779ae752696c P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:58.458231 11101 raft_consensus.cc:493] T 57fe93cb1bec4bc1ad43b091fb49f120 P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66abd7e8893940bdbe81d60bffc91261)
I20260709 13:02:58.458721 11101 raft_consensus.cc:515] T 57fe93cb1bec4bc1ad43b091fb49f120 P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:58.463011 11101 leader_election.cc:290] T 57fe93cb1bec4bc1ad43b091fb49f120 P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009), 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947)
I20260709 13:02:58.463780 10769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe93cb1bec4bc1ad43b091fb49f120" candidate_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "305b05bc72f04d769644fbff5188bc26" is_pre_election: true
I20260709 13:02:58.464658 10769 raft_consensus.cc:2468] T 57fe93cb1bec4bc1ad43b091fb49f120 P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d895d0e90a3b45ed9aed3af8222a9b5d in term 2.
W20260709 13:02:58.465099 10663 leader_election.cc:336] T 57fe93cb1bec4bc1ad43b091fb49f120 P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009): Network error: Client connection negotiation failed: client connection to 127.0.107.193:44009: connect: Connection refused (error 111)
I20260709 13:02:58.465873 10665 leader_election.cc:304] T 57fe93cb1bec4bc1ad43b091fb49f120 P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 305b05bc72f04d769644fbff5188bc26, d895d0e90a3b45ed9aed3af8222a9b5d; no voters: 66abd7e8893940bdbe81d60bffc91261
I20260709 13:02:58.466485 11101 raft_consensus.cc:2804] T 57fe93cb1bec4bc1ad43b091fb49f120 P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:58.466929 11101 raft_consensus.cc:493] T 57fe93cb1bec4bc1ad43b091fb49f120 P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 66abd7e8893940bdbe81d60bffc91261)
I20260709 13:02:58.467232 11101 raft_consensus.cc:3060] T 57fe93cb1bec4bc1ad43b091fb49f120 P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:58.472146 11101 raft_consensus.cc:515] T 57fe93cb1bec4bc1ad43b091fb49f120 P d895d0e90a3b45ed9aed3af8222a9b5d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:58.473901 11101 leader_election.cc:290] T 57fe93cb1bec4bc1ad43b091fb49f120 P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 3 election: Requested vote from peers 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009), 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947)
I20260709 13:02:58.475196 10769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57fe93cb1bec4bc1ad43b091fb49f120" candidate_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "305b05bc72f04d769644fbff5188bc26"
I20260709 13:02:58.475867 10769 raft_consensus.cc:3060] T 57fe93cb1bec4bc1ad43b091fb49f120 P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:02:58.478197 10663 leader_election.cc:336] T 57fe93cb1bec4bc1ad43b091fb49f120 P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009): Network error: Client connection negotiation failed: client connection to 127.0.107.193:44009: connect: Connection refused (error 111)
I20260709 13:02:58.482722 10769 raft_consensus.cc:2468] T 57fe93cb1bec4bc1ad43b091fb49f120 P 305b05bc72f04d769644fbff5188bc26 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d895d0e90a3b45ed9aed3af8222a9b5d in term 3.
I20260709 13:02:58.483958 10665 leader_election.cc:304] T 57fe93cb1bec4bc1ad43b091fb49f120 P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 305b05bc72f04d769644fbff5188bc26, d895d0e90a3b45ed9aed3af8222a9b5d; no voters: 66abd7e8893940bdbe81d60bffc91261
I20260709 13:02:58.484711 11101 raft_consensus.cc:2804] T 57fe93cb1bec4bc1ad43b091fb49f120 P d895d0e90a3b45ed9aed3af8222a9b5d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:58.485234 11101 raft_consensus.cc:697] T 57fe93cb1bec4bc1ad43b091fb49f120 P d895d0e90a3b45ed9aed3af8222a9b5d [term 3 LEADER]: Becoming Leader. State: Replica: d895d0e90a3b45ed9aed3af8222a9b5d, State: Running, Role: LEADER
I20260709 13:02:58.486109 11101 consensus_queue.cc:237] T 57fe93cb1bec4bc1ad43b091fb49f120 P d895d0e90a3b45ed9aed3af8222a9b5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:58.495728 10522 catalog_manager.cc:5697] T 57fe93cb1bec4bc1ad43b091fb49f120 P d895d0e90a3b45ed9aed3af8222a9b5d reported cstate change: term changed from 2 to 3, leader changed from 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193) to d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194). New cstate: current_term: 3 leader_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:58.511001 11085 raft_consensus.cc:493] T bf181cd133ed4b8d8b3cbe5b36b23316 P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66abd7e8893940bdbe81d60bffc91261)
I20260709 13:02:58.511644 11085 raft_consensus.cc:515] T bf181cd133ed4b8d8b3cbe5b36b23316 P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:58.513859 11085 leader_election.cc:290] T bf181cd133ed4b8d8b3cbe5b36b23316 P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009), d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683)
I20260709 13:02:58.516044 10695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf181cd133ed4b8d8b3cbe5b36b23316" candidate_uuid: "305b05bc72f04d769644fbff5188bc26" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" is_pre_election: true
W20260709 13:02:58.518095 10737 leader_election.cc:336] T bf181cd133ed4b8d8b3cbe5b36b23316 P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009): Network error: Client connection negotiation failed: client connection to 127.0.107.193:44009: connect: Connection refused (error 111)
I20260709 13:02:58.518491 10737 leader_election.cc:304] T bf181cd133ed4b8d8b3cbe5b36b23316 P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 305b05bc72f04d769644fbff5188bc26; no voters: 66abd7e8893940bdbe81d60bffc91261, d895d0e90a3b45ed9aed3af8222a9b5d
I20260709 13:02:58.519073 11085 raft_consensus.cc:2749] T bf181cd133ed4b8d8b3cbe5b36b23316 P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:58.522600 11101 raft_consensus.cc:493] T bf181cd133ed4b8d8b3cbe5b36b23316 P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66abd7e8893940bdbe81d60bffc91261)
I20260709 13:02:58.523180 11101 raft_consensus.cc:515] T bf181cd133ed4b8d8b3cbe5b36b23316 P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:58.525020 11101 leader_election.cc:290] T bf181cd133ed4b8d8b3cbe5b36b23316 P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009), 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947)
I20260709 13:02:58.526096 10769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf181cd133ed4b8d8b3cbe5b36b23316" candidate_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "305b05bc72f04d769644fbff5188bc26" is_pre_election: true
I20260709 13:02:58.526721 10769 raft_consensus.cc:2468] T bf181cd133ed4b8d8b3cbe5b36b23316 P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d895d0e90a3b45ed9aed3af8222a9b5d in term 2.
I20260709 13:02:58.527976 10665 leader_election.cc:304] T bf181cd133ed4b8d8b3cbe5b36b23316 P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 305b05bc72f04d769644fbff5188bc26, d895d0e90a3b45ed9aed3af8222a9b5d; no voters: 
I20260709 13:02:58.528972 11101 raft_consensus.cc:2804] T bf181cd133ed4b8d8b3cbe5b36b23316 P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:58.529338 11101 raft_consensus.cc:493] T bf181cd133ed4b8d8b3cbe5b36b23316 P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 66abd7e8893940bdbe81d60bffc91261)
I20260709 13:02:58.529668 11101 raft_consensus.cc:3060] T bf181cd133ed4b8d8b3cbe5b36b23316 P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:02:58.529747 10663 leader_election.cc:336] T bf181cd133ed4b8d8b3cbe5b36b23316 P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009): Network error: Client connection negotiation failed: client connection to 127.0.107.193:44009: connect: Connection refused (error 111)
I20260709 13:02:58.535101 11101 raft_consensus.cc:515] T bf181cd133ed4b8d8b3cbe5b36b23316 P d895d0e90a3b45ed9aed3af8222a9b5d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:58.537068 11101 leader_election.cc:290] T bf181cd133ed4b8d8b3cbe5b36b23316 P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 3 election: Requested vote from peers 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009), 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947)
I20260709 13:02:58.538316 10769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf181cd133ed4b8d8b3cbe5b36b23316" candidate_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "305b05bc72f04d769644fbff5188bc26"
I20260709 13:02:58.538980 10769 raft_consensus.cc:3060] T bf181cd133ed4b8d8b3cbe5b36b23316 P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:02:58.541430 10663 leader_election.cc:336] T bf181cd133ed4b8d8b3cbe5b36b23316 P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009): Network error: Client connection negotiation failed: client connection to 127.0.107.193:44009: connect: Connection refused (error 111)
I20260709 13:02:58.545948 10769 raft_consensus.cc:2468] T bf181cd133ed4b8d8b3cbe5b36b23316 P 305b05bc72f04d769644fbff5188bc26 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d895d0e90a3b45ed9aed3af8222a9b5d in term 3.
I20260709 13:02:58.546998 10665 leader_election.cc:304] T bf181cd133ed4b8d8b3cbe5b36b23316 P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 305b05bc72f04d769644fbff5188bc26, d895d0e90a3b45ed9aed3af8222a9b5d; no voters: 66abd7e8893940bdbe81d60bffc91261
I20260709 13:02:58.547845 11101 raft_consensus.cc:2804] T bf181cd133ed4b8d8b3cbe5b36b23316 P d895d0e90a3b45ed9aed3af8222a9b5d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:58.548297 11101 raft_consensus.cc:697] T bf181cd133ed4b8d8b3cbe5b36b23316 P d895d0e90a3b45ed9aed3af8222a9b5d [term 3 LEADER]: Becoming Leader. State: Replica: d895d0e90a3b45ed9aed3af8222a9b5d, State: Running, Role: LEADER
I20260709 13:02:58.549194 11101 consensus_queue.cc:237] T bf181cd133ed4b8d8b3cbe5b36b23316 P d895d0e90a3b45ed9aed3af8222a9b5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:58.556921 10522 catalog_manager.cc:5697] T bf181cd133ed4b8d8b3cbe5b36b23316 P d895d0e90a3b45ed9aed3af8222a9b5d reported cstate change: term changed from 2 to 3, leader changed from 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193) to d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194). New cstate: current_term: 3 leader_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:58.639235 11085 raft_consensus.cc:493] T 020e5de5fe4f481ba994779ae752696c P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66abd7e8893940bdbe81d60bffc91261)
I20260709 13:02:58.639957 11085 raft_consensus.cc:515] T 020e5de5fe4f481ba994779ae752696c P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:58.642376 11085 leader_election.cc:290] T 020e5de5fe4f481ba994779ae752696c P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009), d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683)
I20260709 13:02:58.643937 10695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020e5de5fe4f481ba994779ae752696c" candidate_uuid: "305b05bc72f04d769644fbff5188bc26" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" is_pre_election: true
I20260709 13:02:58.645660 10695 raft_consensus.cc:2468] T 020e5de5fe4f481ba994779ae752696c P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 305b05bc72f04d769644fbff5188bc26 in term 2.
I20260709 13:02:58.647519 10737 leader_election.cc:304] T 020e5de5fe4f481ba994779ae752696c P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 305b05bc72f04d769644fbff5188bc26, d895d0e90a3b45ed9aed3af8222a9b5d; no voters: 
I20260709 13:02:58.647818 11085 raft_consensus.cc:493] T b498f794eab54c15846243452d7992e0 P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66abd7e8893940bdbe81d60bffc91261)
I20260709 13:02:58.648967 11102 raft_consensus.cc:2804] T 020e5de5fe4f481ba994779ae752696c P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:58.649459 11102 raft_consensus.cc:493] T 020e5de5fe4f481ba994779ae752696c P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 66abd7e8893940bdbe81d60bffc91261)
I20260709 13:02:58.649159 11085 raft_consensus.cc:515] T b498f794eab54c15846243452d7992e0 P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:58.650019 11102 raft_consensus.cc:3060] T 020e5de5fe4f481ba994779ae752696c P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:02:58.652067 11085 leader_election.cc:290] T b498f794eab54c15846243452d7992e0 P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009), d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683)
I20260709 13:02:58.656610 10695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b498f794eab54c15846243452d7992e0" candidate_uuid: "305b05bc72f04d769644fbff5188bc26" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" is_pre_election: true
W20260709 13:02:58.657116 10737 leader_election.cc:336] T 020e5de5fe4f481ba994779ae752696c P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009): Network error: Client connection negotiation failed: client connection to 127.0.107.193:44009: connect: Connection refused (error 111)
I20260709 13:02:58.659718 11102 raft_consensus.cc:515] T 020e5de5fe4f481ba994779ae752696c P 305b05bc72f04d769644fbff5188bc26 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
W20260709 13:02:58.660772 10737 leader_election.cc:336] T b498f794eab54c15846243452d7992e0 P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009): Network error: Client connection negotiation failed: client connection to 127.0.107.193:44009: connect: Connection refused (error 111)
I20260709 13:02:58.661417 10737 leader_election.cc:304] T b498f794eab54c15846243452d7992e0 P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 305b05bc72f04d769644fbff5188bc26; no voters: 66abd7e8893940bdbe81d60bffc91261, d895d0e90a3b45ed9aed3af8222a9b5d
I20260709 13:02:58.662379 11085 raft_consensus.cc:2749] T b498f794eab54c15846243452d7992e0 P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:02:58.664800 11102 leader_election.cc:290] T 020e5de5fe4f481ba994779ae752696c P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 3 election: Requested vote from peers 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009), d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683)
I20260709 13:02:58.667589 10695 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "020e5de5fe4f481ba994779ae752696c" candidate_uuid: "305b05bc72f04d769644fbff5188bc26" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d"
I20260709 13:02:58.668299 10695 raft_consensus.cc:3060] T 020e5de5fe4f481ba994779ae752696c P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:02:58.675647 10737 leader_election.cc:336] T 020e5de5fe4f481ba994779ae752696c P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009): Network error: Client connection negotiation failed: client connection to 127.0.107.193:44009: connect: Connection refused (error 111)
I20260709 13:02:58.680323 10695 raft_consensus.cc:2468] T 020e5de5fe4f481ba994779ae752696c P d895d0e90a3b45ed9aed3af8222a9b5d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 305b05bc72f04d769644fbff5188bc26 in term 3.
I20260709 13:02:58.682083 10737 leader_election.cc:304] T 020e5de5fe4f481ba994779ae752696c P 305b05bc72f04d769644fbff5188bc26 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 305b05bc72f04d769644fbff5188bc26, d895d0e90a3b45ed9aed3af8222a9b5d; no voters: 66abd7e8893940bdbe81d60bffc91261
I20260709 13:02:58.682956 11085 raft_consensus.cc:2804] T 020e5de5fe4f481ba994779ae752696c P 305b05bc72f04d769644fbff5188bc26 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:58.683643 11085 raft_consensus.cc:697] T 020e5de5fe4f481ba994779ae752696c P 305b05bc72f04d769644fbff5188bc26 [term 3 LEADER]: Becoming Leader. State: Replica: 305b05bc72f04d769644fbff5188bc26, State: Running, Role: LEADER
I20260709 13:02:58.684754 11085 consensus_queue.cc:237] T 020e5de5fe4f481ba994779ae752696c P 305b05bc72f04d769644fbff5188bc26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:58.696007 10522 catalog_manager.cc:5697] T 020e5de5fe4f481ba994779ae752696c P 305b05bc72f04d769644fbff5188bc26 reported cstate change: term changed from 2 to 3, leader changed from 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193) to 305b05bc72f04d769644fbff5188bc26 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "305b05bc72f04d769644fbff5188bc26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } health_report { overall_health: HEALTHY } } }
I20260709 13:02:58.719718 11100 raft_consensus.cc:493] T b5719c2d308646c28e9b2297f7d3becd P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66abd7e8893940bdbe81d60bffc91261)
I20260709 13:02:58.720649 11100 raft_consensus.cc:515] T b5719c2d308646c28e9b2297f7d3becd P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:58.723358 11100 leader_election.cc:290] T b5719c2d308646c28e9b2297f7d3becd P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009), 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947)
I20260709 13:02:58.725211 10769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5719c2d308646c28e9b2297f7d3becd" candidate_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "305b05bc72f04d769644fbff5188bc26" is_pre_election: true
I20260709 13:02:58.725979 10769 raft_consensus.cc:2468] T b5719c2d308646c28e9b2297f7d3becd P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d895d0e90a3b45ed9aed3af8222a9b5d in term 2.
I20260709 13:02:58.727576 10665 leader_election.cc:304] T b5719c2d308646c28e9b2297f7d3becd P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 305b05bc72f04d769644fbff5188bc26, d895d0e90a3b45ed9aed3af8222a9b5d; no voters: 
I20260709 13:02:58.727573 11100 raft_consensus.cc:493] T b498f794eab54c15846243452d7992e0 P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 66abd7e8893940bdbe81d60bffc91261)
I20260709 13:02:58.728561 11101 raft_consensus.cc:2804] T b5719c2d308646c28e9b2297f7d3becd P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:58.729049 11101 raft_consensus.cc:493] T b5719c2d308646c28e9b2297f7d3becd P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 66abd7e8893940bdbe81d60bffc91261)
I20260709 13:02:58.728835 11100 raft_consensus.cc:515] T b498f794eab54c15846243452d7992e0 P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:58.729532 11101 raft_consensus.cc:3060] T b5719c2d308646c28e9b2297f7d3becd P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:02:58.730450 10663 leader_election.cc:336] T b5719c2d308646c28e9b2297f7d3becd P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009): Network error: Client connection negotiation failed: client connection to 127.0.107.193:44009: connect: Connection refused (error 111)
I20260709 13:02:58.731490 11100 leader_election.cc:290] T b498f794eab54c15846243452d7992e0 P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009), 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947)
I20260709 13:02:58.733343 10769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b498f794eab54c15846243452d7992e0" candidate_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "305b05bc72f04d769644fbff5188bc26" is_pre_election: true
I20260709 13:02:58.734148 10769 raft_consensus.cc:2468] T b498f794eab54c15846243452d7992e0 P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d895d0e90a3b45ed9aed3af8222a9b5d in term 2.
I20260709 13:02:58.735733 10665 leader_election.cc:304] T b498f794eab54c15846243452d7992e0 P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 305b05bc72f04d769644fbff5188bc26, d895d0e90a3b45ed9aed3af8222a9b5d; no voters: 
I20260709 13:02:58.736729 11100 raft_consensus.cc:2804] T b498f794eab54c15846243452d7992e0 P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:02:58.737154 11100 raft_consensus.cc:493] T b498f794eab54c15846243452d7992e0 P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 66abd7e8893940bdbe81d60bffc91261)
I20260709 13:02:58.737599 11100 raft_consensus.cc:3060] T b498f794eab54c15846243452d7992e0 P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:02:58.738034 10663 leader_election.cc:336] T b498f794eab54c15846243452d7992e0 P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009): Network error: Client connection negotiation failed: client connection to 127.0.107.193:44009: connect: Connection refused (error 111)
I20260709 13:02:58.739560 11101 raft_consensus.cc:515] T b5719c2d308646c28e9b2297f7d3becd P d895d0e90a3b45ed9aed3af8222a9b5d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:58.741925 11101 leader_election.cc:290] T b5719c2d308646c28e9b2297f7d3becd P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 3 election: Requested vote from peers 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009), 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947)
I20260709 13:02:58.744417 10769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b5719c2d308646c28e9b2297f7d3becd" candidate_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "305b05bc72f04d769644fbff5188bc26"
I20260709 13:02:58.745232 10769 raft_consensus.cc:3060] T b5719c2d308646c28e9b2297f7d3becd P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:02:58.748729 10663 leader_election.cc:336] T b5719c2d308646c28e9b2297f7d3becd P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009): Network error: Client connection negotiation failed: client connection to 127.0.107.193:44009: connect: Connection refused (error 111)
I20260709 13:02:58.752794 11100 raft_consensus.cc:515] T b498f794eab54c15846243452d7992e0 P d895d0e90a3b45ed9aed3af8222a9b5d [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:58.754091 10769 raft_consensus.cc:2468] T b5719c2d308646c28e9b2297f7d3becd P 305b05bc72f04d769644fbff5188bc26 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d895d0e90a3b45ed9aed3af8222a9b5d in term 3.
I20260709 13:02:58.755452 10665 leader_election.cc:304] T b5719c2d308646c28e9b2297f7d3becd P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 305b05bc72f04d769644fbff5188bc26, d895d0e90a3b45ed9aed3af8222a9b5d; no voters: 66abd7e8893940bdbe81d60bffc91261
I20260709 13:02:58.755986 11100 leader_election.cc:290] T b498f794eab54c15846243452d7992e0 P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 3 election: Requested vote from peers 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009), 305b05bc72f04d769644fbff5188bc26 (127.0.107.195:32947)
I20260709 13:02:58.756374 11101 raft_consensus.cc:2804] T b5719c2d308646c28e9b2297f7d3becd P d895d0e90a3b45ed9aed3af8222a9b5d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:58.757128 11101 raft_consensus.cc:697] T b5719c2d308646c28e9b2297f7d3becd P d895d0e90a3b45ed9aed3af8222a9b5d [term 3 LEADER]: Becoming Leader. State: Replica: d895d0e90a3b45ed9aed3af8222a9b5d, State: Running, Role: LEADER
I20260709 13:02:58.758285 11101 consensus_queue.cc:237] T b5719c2d308646c28e9b2297f7d3becd P d895d0e90a3b45ed9aed3af8222a9b5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:58.760672 10769 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b498f794eab54c15846243452d7992e0" candidate_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "305b05bc72f04d769644fbff5188bc26"
I20260709 13:02:58.761483 10769 raft_consensus.cc:3060] T b498f794eab54c15846243452d7992e0 P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:02:58.761916 10663 leader_election.cc:336] T b498f794eab54c15846243452d7992e0 P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009): Network error: Client connection negotiation failed: client connection to 127.0.107.193:44009: connect: Connection refused (error 111)
I20260709 13:02:58.770013 10769 raft_consensus.cc:2468] T b498f794eab54c15846243452d7992e0 P 305b05bc72f04d769644fbff5188bc26 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d895d0e90a3b45ed9aed3af8222a9b5d in term 3.
I20260709 13:02:58.771636 10665 leader_election.cc:304] T b498f794eab54c15846243452d7992e0 P d895d0e90a3b45ed9aed3af8222a9b5d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 305b05bc72f04d769644fbff5188bc26, d895d0e90a3b45ed9aed3af8222a9b5d; no voters: 66abd7e8893940bdbe81d60bffc91261
I20260709 13:02:58.772552 11101 raft_consensus.cc:2804] T b498f794eab54c15846243452d7992e0 P d895d0e90a3b45ed9aed3af8222a9b5d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:02:58.773128 11101 raft_consensus.cc:697] T b498f794eab54c15846243452d7992e0 P d895d0e90a3b45ed9aed3af8222a9b5d [term 3 LEADER]: Becoming Leader. State: Replica: d895d0e90a3b45ed9aed3af8222a9b5d, State: Running, Role: LEADER
I20260709 13:02:58.774094 11101 consensus_queue.cc:237] T b498f794eab54c15846243452d7992e0 P d895d0e90a3b45ed9aed3af8222a9b5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } }
I20260709 13:02:58.774197 10522 catalog_manager.cc:5697] T b5719c2d308646c28e9b2297f7d3becd P d895d0e90a3b45ed9aed3af8222a9b5d reported cstate change: term changed from 2 to 3, leader changed from 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193) to d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194). New cstate: current_term: 3 leader_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } health_report { overall_health: UNKNOWN } } }
I20260709 13:02:58.789429 10522 catalog_manager.cc:5697] T b498f794eab54c15846243452d7992e0 P d895d0e90a3b45ed9aed3af8222a9b5d reported cstate change: term changed from 2 to 3, leader changed from 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193) to d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194). New cstate: current_term: 3 leader_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66abd7e8893940bdbe81d60bffc91261" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 44009 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 } health_report { overall_health: UNKNOWN } } }
W20260709 13:02:58.857842 10737 consensus_peers.cc:597] T 30e72e0b20944bcbbea372c99c5f27fc P 305b05bc72f04d769644fbff5188bc26 -> Peer 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009): Couldn't send request to peer 66abd7e8893940bdbe81d60bffc91261. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:44009: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:58.871539 10695 raft_consensus.cc:1275] T 30e72e0b20944bcbbea372c99c5f27fc P d895d0e90a3b45ed9aed3af8222a9b5d [term 3 FOLLOWER]: Refusing update from remote peer 305b05bc72f04d769644fbff5188bc26: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:02:58.873104 11085 consensus_queue.cc:1048] T 30e72e0b20944bcbbea372c99c5f27fc P 305b05bc72f04d769644fbff5188bc26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:02:58.956087 10663 consensus_peers.cc:597] T bf181cd133ed4b8d8b3cbe5b36b23316 P d895d0e90a3b45ed9aed3af8222a9b5d -> Peer 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009): Couldn't send request to peer 66abd7e8893940bdbe81d60bffc91261. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:44009: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:59.013465 10769 raft_consensus.cc:1275] T 57fe93cb1bec4bc1ad43b091fb49f120 P 305b05bc72f04d769644fbff5188bc26 [term 3 FOLLOWER]: Refusing update from remote peer d895d0e90a3b45ed9aed3af8222a9b5d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:02:59.015265 11100 consensus_queue.cc:1048] T 57fe93cb1bec4bc1ad43b091fb49f120 P d895d0e90a3b45ed9aed3af8222a9b5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:02:59.045746 10663 consensus_peers.cc:597] T 57fe93cb1bec4bc1ad43b091fb49f120 P d895d0e90a3b45ed9aed3af8222a9b5d -> Peer 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009): Couldn't send request to peer 66abd7e8893940bdbe81d60bffc91261. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:44009: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:59.087713 10695 raft_consensus.cc:1275] T 020e5de5fe4f481ba994779ae752696c P d895d0e90a3b45ed9aed3af8222a9b5d [term 3 FOLLOWER]: Refusing update from remote peer 305b05bc72f04d769644fbff5188bc26: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:59.089551 11102 consensus_queue.cc:1048] T 020e5de5fe4f481ba994779ae752696c P 305b05bc72f04d769644fbff5188bc26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d895d0e90a3b45ed9aed3af8222a9b5d" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 33683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:02:59.112820 10737 consensus_peers.cc:597] T 020e5de5fe4f481ba994779ae752696c P 305b05bc72f04d769644fbff5188bc26 -> Peer 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009): Couldn't send request to peer 66abd7e8893940bdbe81d60bffc91261. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:44009: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:59.143337 10769 raft_consensus.cc:1275] T bf181cd133ed4b8d8b3cbe5b36b23316 P 305b05bc72f04d769644fbff5188bc26 [term 3 FOLLOWER]: Refusing update from remote peer d895d0e90a3b45ed9aed3af8222a9b5d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:59.144682 11118 consensus_queue.cc:1048] T bf181cd133ed4b8d8b3cbe5b36b23316 P d895d0e90a3b45ed9aed3af8222a9b5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:02:59.191265 10663 consensus_peers.cc:597] T b5719c2d308646c28e9b2297f7d3becd P d895d0e90a3b45ed9aed3af8222a9b5d -> Peer 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009): Couldn't send request to peer 66abd7e8893940bdbe81d60bffc91261. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:44009: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:02:59.293061 10769 raft_consensus.cc:1275] T b498f794eab54c15846243452d7992e0 P 305b05bc72f04d769644fbff5188bc26 [term 3 FOLLOWER]: Refusing update from remote peer d895d0e90a3b45ed9aed3af8222a9b5d: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:02:59.295341 11101 consensus_queue.cc:1048] T b498f794eab54c15846243452d7992e0 P d895d0e90a3b45ed9aed3af8222a9b5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 13:02:59.316339 10663 consensus_peers.cc:597] T b498f794eab54c15846243452d7992e0 P d895d0e90a3b45ed9aed3af8222a9b5d -> Peer 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009): Couldn't send request to peer 66abd7e8893940bdbe81d60bffc91261. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:44009: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:02:59.321015   431 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 10645)
I20260709 13:02:59.363761 10769 raft_consensus.cc:1275] T b5719c2d308646c28e9b2297f7d3becd P 305b05bc72f04d769644fbff5188bc26 [term 3 FOLLOWER]: Refusing update from remote peer d895d0e90a3b45ed9aed3af8222a9b5d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:02:59.365692 11100 consensus_queue.cc:1048] T b5719c2d308646c28e9b2297f7d3becd P d895d0e90a3b45ed9aed3af8222a9b5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "305b05bc72f04d769644fbff5188bc26" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 32947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:02:59.529385 10663 consensus_peers.cc:597] T ddaf52c482884428ab1694c903f54cd8 P d895d0e90a3b45ed9aed3af8222a9b5d -> Peer 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009): Couldn't send request to peer 66abd7e8893940bdbe81d60bffc91261. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:44009: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:59.812902 10737 consensus_peers.cc:597] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 305b05bc72f04d769644fbff5188bc26 -> Peer 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009): Couldn't send request to peer 66abd7e8893940bdbe81d60bffc91261. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:44009: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:59.850309 10663 consensus_peers.cc:597] T 110992c04e984796a1919262f4bbe67f P d895d0e90a3b45ed9aed3af8222a9b5d -> Peer 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009): Couldn't send request to peer 66abd7e8893940bdbe81d60bffc91261. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:44009: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:59.858022 10663 consensus_peers.cc:597] T 70931771066e47f7a57a558edb1b3e61 P d895d0e90a3b45ed9aed3af8222a9b5d -> Peer 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009): Couldn't send request to peer 66abd7e8893940bdbe81d60bffc91261. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:44009: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:59.858342 10737 consensus_peers.cc:597] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P 305b05bc72f04d769644fbff5188bc26 -> Peer 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009): Couldn't send request to peer 66abd7e8893940bdbe81d60bffc91261. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:44009: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:59.874583 10737 consensus_peers.cc:597] T b018c17ab00f46b6b1eab7e49e0adfe5 P 305b05bc72f04d769644fbff5188bc26 -> Peer 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009): Couldn't send request to peer 66abd7e8893940bdbe81d60bffc91261. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:44009: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:59.876662 10737 consensus_peers.cc:597] T 420a103ab9df43e9b3d34aacfd2325aa P 305b05bc72f04d769644fbff5188bc26 -> Peer 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009): Couldn't send request to peer 66abd7e8893940bdbe81d60bffc91261. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:44009: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:02:59.984961 10737 consensus_peers.cc:597] T 0edc1ee1d1aa48b38e4df79d771249ad P 305b05bc72f04d769644fbff5188bc26 -> Peer 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009): Couldn't send request to peer 66abd7e8893940bdbe81d60bffc91261. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:44009: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:00.008221   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
I20260709 13:03:00.043210   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:03:00.058481 10737 consensus_peers.cc:597] T c7a40faf0455492eb35f727fc91e9fab P 305b05bc72f04d769644fbff5188bc26 -> Peer 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009): Couldn't send request to peer 66abd7e8893940bdbe81d60bffc91261. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:44009: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:00.074882   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:00.075838   431 tablet_replica.cc:333] T 70931771066e47f7a57a558edb1b3e61 P d895d0e90a3b45ed9aed3af8222a9b5d: stopping tablet replica
I20260709 13:03:00.076665   431 raft_consensus.cc:2243] T 70931771066e47f7a57a558edb1b3e61 P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:00.077553   431 raft_consensus.cc:2272] T 70931771066e47f7a57a558edb1b3e61 P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.079659   431 tablet_replica.cc:333] T 34e0b8824c444b59b50cc2c8f61f49af P d895d0e90a3b45ed9aed3af8222a9b5d: stopping tablet replica
I20260709 13:03:00.080328   431 raft_consensus.cc:2243] T 34e0b8824c444b59b50cc2c8f61f49af P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:00.081228   431 raft_consensus.cc:2272] T 34e0b8824c444b59b50cc2c8f61f49af P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.083252   431 tablet_replica.cc:333] T 30e72e0b20944bcbbea372c99c5f27fc P d895d0e90a3b45ed9aed3af8222a9b5d: stopping tablet replica
I20260709 13:03:00.083895   431 raft_consensus.cc:2243] T 30e72e0b20944bcbbea372c99c5f27fc P d895d0e90a3b45ed9aed3af8222a9b5d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:00.084403   431 raft_consensus.cc:2272] T 30e72e0b20944bcbbea372c99c5f27fc P d895d0e90a3b45ed9aed3af8222a9b5d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.086467   431 tablet_replica.cc:333] T 110992c04e984796a1919262f4bbe67f P d895d0e90a3b45ed9aed3af8222a9b5d: stopping tablet replica
I20260709 13:03:00.087069   431 raft_consensus.cc:2243] T 110992c04e984796a1919262f4bbe67f P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:00.087911   431 raft_consensus.cc:2272] T 110992c04e984796a1919262f4bbe67f P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.090209   431 tablet_replica.cc:333] T 57fe93cb1bec4bc1ad43b091fb49f120 P d895d0e90a3b45ed9aed3af8222a9b5d: stopping tablet replica
I20260709 13:03:00.090828   431 raft_consensus.cc:2243] T 57fe93cb1bec4bc1ad43b091fb49f120 P d895d0e90a3b45ed9aed3af8222a9b5d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:00.091742   431 raft_consensus.cc:2272] T 57fe93cb1bec4bc1ad43b091fb49f120 P d895d0e90a3b45ed9aed3af8222a9b5d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.094226   431 tablet_replica.cc:333] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P d895d0e90a3b45ed9aed3af8222a9b5d: stopping tablet replica
I20260709 13:03:00.095033   431 raft_consensus.cc:2243] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:00.095605   431 raft_consensus.cc:2272] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P d895d0e90a3b45ed9aed3af8222a9b5d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:00.096949 10737 consensus_peers.cc:597] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 305b05bc72f04d769644fbff5188bc26 -> Peer d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683): Couldn't send request to peer d895d0e90a3b45ed9aed3af8222a9b5d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:00.098080   431 tablet_replica.cc:333] T bf181cd133ed4b8d8b3cbe5b36b23316 P d895d0e90a3b45ed9aed3af8222a9b5d: stopping tablet replica
I20260709 13:03:00.098789   431 raft_consensus.cc:2243] T bf181cd133ed4b8d8b3cbe5b36b23316 P d895d0e90a3b45ed9aed3af8222a9b5d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:00.099581   431 raft_consensus.cc:2272] T bf181cd133ed4b8d8b3cbe5b36b23316 P d895d0e90a3b45ed9aed3af8222a9b5d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.102664   431 tablet_replica.cc:333] T 020e5de5fe4f481ba994779ae752696c P d895d0e90a3b45ed9aed3af8222a9b5d: stopping tablet replica
I20260709 13:03:00.103355   431 raft_consensus.cc:2243] T 020e5de5fe4f481ba994779ae752696c P d895d0e90a3b45ed9aed3af8222a9b5d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:00.103817   431 raft_consensus.cc:2272] T 020e5de5fe4f481ba994779ae752696c P d895d0e90a3b45ed9aed3af8222a9b5d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.106525   431 tablet_replica.cc:333] T 420a103ab9df43e9b3d34aacfd2325aa P d895d0e90a3b45ed9aed3af8222a9b5d: stopping tablet replica
I20260709 13:03:00.107107   431 raft_consensus.cc:2243] T 420a103ab9df43e9b3d34aacfd2325aa P d895d0e90a3b45ed9aed3af8222a9b5d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:00.107560   431 raft_consensus.cc:2272] T 420a103ab9df43e9b3d34aacfd2325aa P d895d0e90a3b45ed9aed3af8222a9b5d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.109624   431 tablet_replica.cc:333] T ddaf52c482884428ab1694c903f54cd8 P d895d0e90a3b45ed9aed3af8222a9b5d: stopping tablet replica
I20260709 13:03:00.110175   431 raft_consensus.cc:2243] T ddaf52c482884428ab1694c903f54cd8 P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:00.110944   431 raft_consensus.cc:2272] T ddaf52c482884428ab1694c903f54cd8 P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.113081   431 tablet_replica.cc:333] T 0edc1ee1d1aa48b38e4df79d771249ad P d895d0e90a3b45ed9aed3af8222a9b5d: stopping tablet replica
I20260709 13:03:00.113562   431 raft_consensus.cc:2243] T 0edc1ee1d1aa48b38e4df79d771249ad P d895d0e90a3b45ed9aed3af8222a9b5d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:00.113950   431 raft_consensus.cc:2272] T 0edc1ee1d1aa48b38e4df79d771249ad P d895d0e90a3b45ed9aed3af8222a9b5d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.115924   431 tablet_replica.cc:333] T b5719c2d308646c28e9b2297f7d3becd P d895d0e90a3b45ed9aed3af8222a9b5d: stopping tablet replica
I20260709 13:03:00.116475   431 raft_consensus.cc:2243] T b5719c2d308646c28e9b2297f7d3becd P d895d0e90a3b45ed9aed3af8222a9b5d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:00.117350   431 raft_consensus.cc:2272] T b5719c2d308646c28e9b2297f7d3becd P d895d0e90a3b45ed9aed3af8222a9b5d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.120119   431 tablet_replica.cc:333] T b018c17ab00f46b6b1eab7e49e0adfe5 P d895d0e90a3b45ed9aed3af8222a9b5d: stopping tablet replica
I20260709 13:03:00.120955   431 raft_consensus.cc:2243] T b018c17ab00f46b6b1eab7e49e0adfe5 P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:00.121539   431 raft_consensus.cc:2272] T b018c17ab00f46b6b1eab7e49e0adfe5 P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.124001   431 tablet_replica.cc:333] T e23dd32048434889a42ea8dc88626ed3 P d895d0e90a3b45ed9aed3af8222a9b5d: stopping tablet replica
I20260709 13:03:00.124881   431 raft_consensus.cc:2243] T e23dd32048434889a42ea8dc88626ed3 P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:03:00.125584 10737 consensus_peers.cc:597] T b018c17ab00f46b6b1eab7e49e0adfe5 P 305b05bc72f04d769644fbff5188bc26 -> Peer d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683): Couldn't send request to peer d895d0e90a3b45ed9aed3af8222a9b5d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:00.126042   431 raft_consensus.cc:2272] T e23dd32048434889a42ea8dc88626ed3 P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:00.127697 10663 consensus_peers.cc:597] T bd8914371e234fd89180b58dd299e334 P d895d0e90a3b45ed9aed3af8222a9b5d -> Peer 66abd7e8893940bdbe81d60bffc91261 (127.0.107.193:44009): Couldn't send request to peer 66abd7e8893940bdbe81d60bffc91261. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:44009: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:00.128798   431 tablet_replica.cc:333] T 8eb4dc0971ed4d6183bfb9d283ad51dc P d895d0e90a3b45ed9aed3af8222a9b5d: stopping tablet replica
I20260709 13:03:00.129470   431 raft_consensus.cc:2243] T 8eb4dc0971ed4d6183bfb9d283ad51dc P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:00.129952   431 raft_consensus.cc:2272] T 8eb4dc0971ed4d6183bfb9d283ad51dc P d895d0e90a3b45ed9aed3af8222a9b5d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.132261   431 tablet_replica.cc:333] T b498f794eab54c15846243452d7992e0 P d895d0e90a3b45ed9aed3af8222a9b5d: stopping tablet replica
I20260709 13:03:00.132962   431 raft_consensus.cc:2243] T b498f794eab54c15846243452d7992e0 P d895d0e90a3b45ed9aed3af8222a9b5d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:00.134032   431 raft_consensus.cc:2272] T b498f794eab54c15846243452d7992e0 P d895d0e90a3b45ed9aed3af8222a9b5d [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:00.136461 10737 consensus_peers.cc:597] T 020e5de5fe4f481ba994779ae752696c P 305b05bc72f04d769644fbff5188bc26 -> Peer d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683): Couldn't send request to peer d895d0e90a3b45ed9aed3af8222a9b5d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:00.136744   431 tablet_replica.cc:333] T bd8914371e234fd89180b58dd299e334 P d895d0e90a3b45ed9aed3af8222a9b5d: stopping tablet replica
I20260709 13:03:00.137471   431 raft_consensus.cc:2243] T bd8914371e234fd89180b58dd299e334 P d895d0e90a3b45ed9aed3af8222a9b5d [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:00.138345   431 raft_consensus.cc:2272] T bd8914371e234fd89180b58dd299e334 P d895d0e90a3b45ed9aed3af8222a9b5d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.140682   431 tablet_replica.cc:333] T c7a40faf0455492eb35f727fc91e9fab P d895d0e90a3b45ed9aed3af8222a9b5d: stopping tablet replica
I20260709 13:03:00.141291   431 raft_consensus.cc:2243] T c7a40faf0455492eb35f727fc91e9fab P d895d0e90a3b45ed9aed3af8222a9b5d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:00.141775   431 raft_consensus.cc:2272] T c7a40faf0455492eb35f727fc91e9fab P d895d0e90a3b45ed9aed3af8222a9b5d [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:00.187508 10737 consensus_peers.cc:597] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P 305b05bc72f04d769644fbff5188bc26 -> Peer d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683): Couldn't send request to peer d895d0e90a3b45ed9aed3af8222a9b5d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:00.189510 10737 consensus_peers.cc:597] T c7a40faf0455492eb35f727fc91e9fab P 305b05bc72f04d769644fbff5188bc26 -> Peer d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683): Couldn't send request to peer d895d0e90a3b45ed9aed3af8222a9b5d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:00.245158   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
W20260709 13:03:00.257203 10737 consensus_peers.cc:597] T 420a103ab9df43e9b3d34aacfd2325aa P 305b05bc72f04d769644fbff5188bc26 -> Peer d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683): Couldn't send request to peer d895d0e90a3b45ed9aed3af8222a9b5d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33683: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:00.311086   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
W20260709 13:03:00.376425 10737 consensus_peers.cc:597] T 0edc1ee1d1aa48b38e4df79d771249ad P 305b05bc72f04d769644fbff5188bc26 -> Peer d895d0e90a3b45ed9aed3af8222a9b5d (127.0.107.194:33683): Couldn't send request to peer d895d0e90a3b45ed9aed3af8222a9b5d. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:33683: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:00.391669   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:00.393347   431 tablet_replica.cc:333] T 70931771066e47f7a57a558edb1b3e61 P 305b05bc72f04d769644fbff5188bc26: stopping tablet replica
I20260709 13:03:00.395063   431 raft_consensus.cc:2243] T 70931771066e47f7a57a558edb1b3e61 P 305b05bc72f04d769644fbff5188bc26 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:00.396251   431 raft_consensus.cc:2272] T 70931771066e47f7a57a558edb1b3e61 P 305b05bc72f04d769644fbff5188bc26 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.400226   431 tablet_replica.cc:333] T 34e0b8824c444b59b50cc2c8f61f49af P 305b05bc72f04d769644fbff5188bc26: stopping tablet replica
I20260709 13:03:00.401288   431 raft_consensus.cc:2243] T 34e0b8824c444b59b50cc2c8f61f49af P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:00.402299   431 raft_consensus.cc:2272] T 34e0b8824c444b59b50cc2c8f61f49af P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.406124   431 tablet_replica.cc:333] T b498f794eab54c15846243452d7992e0 P 305b05bc72f04d769644fbff5188bc26: stopping tablet replica
I20260709 13:03:00.407202   431 raft_consensus.cc:2243] T b498f794eab54c15846243452d7992e0 P 305b05bc72f04d769644fbff5188bc26 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:00.408424   431 raft_consensus.cc:2272] T b498f794eab54c15846243452d7992e0 P 305b05bc72f04d769644fbff5188bc26 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.413272   431 tablet_replica.cc:333] T 110992c04e984796a1919262f4bbe67f P 305b05bc72f04d769644fbff5188bc26: stopping tablet replica
I20260709 13:03:00.414412   431 raft_consensus.cc:2243] T 110992c04e984796a1919262f4bbe67f P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:00.415330   431 raft_consensus.cc:2272] T 110992c04e984796a1919262f4bbe67f P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.418562   431 tablet_replica.cc:333] T 57fe93cb1bec4bc1ad43b091fb49f120 P 305b05bc72f04d769644fbff5188bc26: stopping tablet replica
I20260709 13:03:00.419353   431 raft_consensus.cc:2243] T 57fe93cb1bec4bc1ad43b091fb49f120 P 305b05bc72f04d769644fbff5188bc26 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:00.419989   431 raft_consensus.cc:2272] T 57fe93cb1bec4bc1ad43b091fb49f120 P 305b05bc72f04d769644fbff5188bc26 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.422896   431 tablet_replica.cc:333] T b018c17ab00f46b6b1eab7e49e0adfe5 P 305b05bc72f04d769644fbff5188bc26: stopping tablet replica
I20260709 13:03:00.423698   431 raft_consensus.cc:2243] T b018c17ab00f46b6b1eab7e49e0adfe5 P 305b05bc72f04d769644fbff5188bc26 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:00.425026   431 raft_consensus.cc:2272] T b018c17ab00f46b6b1eab7e49e0adfe5 P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.427855   431 tablet_replica.cc:333] T e23dd32048434889a42ea8dc88626ed3 P 305b05bc72f04d769644fbff5188bc26: stopping tablet replica
I20260709 13:03:00.428750   431 raft_consensus.cc:2243] T e23dd32048434889a42ea8dc88626ed3 P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:00.429497   431 raft_consensus.cc:2272] T e23dd32048434889a42ea8dc88626ed3 P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.432168   431 tablet_replica.cc:333] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P 305b05bc72f04d769644fbff5188bc26: stopping tablet replica
I20260709 13:03:00.432950   431 raft_consensus.cc:2243] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P 305b05bc72f04d769644fbff5188bc26 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:00.434195   431 raft_consensus.cc:2272] T 0a3e7d3c774f4fbcb175375d2e4d60b6 P 305b05bc72f04d769644fbff5188bc26 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.436934   431 tablet_replica.cc:333] T bf181cd133ed4b8d8b3cbe5b36b23316 P 305b05bc72f04d769644fbff5188bc26: stopping tablet replica
I20260709 13:03:00.437678   431 raft_consensus.cc:2243] T bf181cd133ed4b8d8b3cbe5b36b23316 P 305b05bc72f04d769644fbff5188bc26 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:00.438446   431 raft_consensus.cc:2272] T bf181cd133ed4b8d8b3cbe5b36b23316 P 305b05bc72f04d769644fbff5188bc26 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.441449   431 tablet_replica.cc:333] T 020e5de5fe4f481ba994779ae752696c P 305b05bc72f04d769644fbff5188bc26: stopping tablet replica
I20260709 13:03:00.442152   431 raft_consensus.cc:2243] T 020e5de5fe4f481ba994779ae752696c P 305b05bc72f04d769644fbff5188bc26 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:00.444388   431 raft_consensus.cc:2272] T 020e5de5fe4f481ba994779ae752696c P 305b05bc72f04d769644fbff5188bc26 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.447304   431 tablet_replica.cc:333] T 420a103ab9df43e9b3d34aacfd2325aa P 305b05bc72f04d769644fbff5188bc26: stopping tablet replica
I20260709 13:03:00.447954   431 raft_consensus.cc:2243] T 420a103ab9df43e9b3d34aacfd2325aa P 305b05bc72f04d769644fbff5188bc26 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:00.449380   431 raft_consensus.cc:2272] T 420a103ab9df43e9b3d34aacfd2325aa P 305b05bc72f04d769644fbff5188bc26 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.451954   431 tablet_replica.cc:333] T ddaf52c482884428ab1694c903f54cd8 P 305b05bc72f04d769644fbff5188bc26: stopping tablet replica
I20260709 13:03:00.452657   431 raft_consensus.cc:2243] T ddaf52c482884428ab1694c903f54cd8 P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:00.453369   431 raft_consensus.cc:2272] T ddaf52c482884428ab1694c903f54cd8 P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.456441   431 tablet_replica.cc:333] T 0edc1ee1d1aa48b38e4df79d771249ad P 305b05bc72f04d769644fbff5188bc26: stopping tablet replica
I20260709 13:03:00.457404   431 raft_consensus.cc:2243] T 0edc1ee1d1aa48b38e4df79d771249ad P 305b05bc72f04d769644fbff5188bc26 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:00.458911   431 raft_consensus.cc:2272] T 0edc1ee1d1aa48b38e4df79d771249ad P 305b05bc72f04d769644fbff5188bc26 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.462018   431 tablet_replica.cc:333] T b5719c2d308646c28e9b2297f7d3becd P 305b05bc72f04d769644fbff5188bc26: stopping tablet replica
I20260709 13:03:00.462672   431 raft_consensus.cc:2243] T b5719c2d308646c28e9b2297f7d3becd P 305b05bc72f04d769644fbff5188bc26 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:00.463339   431 raft_consensus.cc:2272] T b5719c2d308646c28e9b2297f7d3becd P 305b05bc72f04d769644fbff5188bc26 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.466017   431 tablet_replica.cc:333] T 30e72e0b20944bcbbea372c99c5f27fc P 305b05bc72f04d769644fbff5188bc26: stopping tablet replica
I20260709 13:03:00.466629   431 raft_consensus.cc:2243] T 30e72e0b20944bcbbea372c99c5f27fc P 305b05bc72f04d769644fbff5188bc26 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:00.468012   431 raft_consensus.cc:2272] T 30e72e0b20944bcbbea372c99c5f27fc P 305b05bc72f04d769644fbff5188bc26 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.470885   431 tablet_replica.cc:333] T c7a40faf0455492eb35f727fc91e9fab P 305b05bc72f04d769644fbff5188bc26: stopping tablet replica
I20260709 13:03:00.471486   431 raft_consensus.cc:2243] T c7a40faf0455492eb35f727fc91e9fab P 305b05bc72f04d769644fbff5188bc26 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:00.472659   431 raft_consensus.cc:2272] T c7a40faf0455492eb35f727fc91e9fab P 305b05bc72f04d769644fbff5188bc26 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.475325   431 tablet_replica.cc:333] T bd8914371e234fd89180b58dd299e334 P 305b05bc72f04d769644fbff5188bc26: stopping tablet replica
I20260709 13:03:00.475903   431 raft_consensus.cc:2243] T bd8914371e234fd89180b58dd299e334 P 305b05bc72f04d769644fbff5188bc26 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:00.476621   431 raft_consensus.cc:2272] T bd8914371e234fd89180b58dd299e334 P 305b05bc72f04d769644fbff5188bc26 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.479265   431 tablet_replica.cc:333] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 305b05bc72f04d769644fbff5188bc26: stopping tablet replica
I20260709 13:03:00.479815   431 raft_consensus.cc:2243] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 305b05bc72f04d769644fbff5188bc26 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:00.481083   431 raft_consensus.cc:2272] T 8eb4dc0971ed4d6183bfb9d283ad51dc P 305b05bc72f04d769644fbff5188bc26 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.529739   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:03:00.591387   431 master.cc:562] Master@127.0.107.254:46301 shutting down...
I20260709 13:03:00.618322   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 4631e7102cf64abaacdf677f51e88449 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:00.619071   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 4631e7102cf64abaacdf677f51e88449 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:00.619455   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 4631e7102cf64abaacdf677f51e88449: stopping tablet replica
I20260709 13:03:00.642958   431 master.cc:584] Master@127.0.107.254:46301 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (15602 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:03:00.707068   431 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.0.107.254:43089
I20260709 13:03:00.708364   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:00.715560 11128 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:00.715787 11127 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:00.715801 11130 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:00.716987   431 server_base.cc:1061] running on GCE node
I20260709 13:03:00.717926   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:00.718104   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:00.718227   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602180718216 us; error 0 us; skew 500 ppm
I20260709 13:03:00.718811   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:00.721487   431 webserver.cc:533] Webserver started at http://127.0.107.254:34665/ using document root <none> and password file <none>
I20260709 13:03:00.721987   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:00.722191   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:00.722426   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:00.723699   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601869227091-431-0/minicluster-data/master-0-root/instance:
uuid: "232d656f14734e1592f736d056eb3fc3"
format_stamp: "Formatted at 2026-07-09 13:03:00 on dist-test-slave-5mzn"
I20260709 13:03:00.728480   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:03:00.732419 11135 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:00.733402   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:03:00.733692   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601869227091-431-0/minicluster-data/master-0-root
uuid: "232d656f14734e1592f736d056eb3fc3"
format_stamp: "Formatted at 2026-07-09 13:03:00 on dist-test-slave-5mzn"
I20260709 13:03:00.733958   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601869227091-431-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601869227091-431-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601869227091-431-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:00.748351   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:00.749709   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:00.791973   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.254:43089
I20260709 13:03:00.792069 11186 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.254:43089 every 8 connection(s)
I20260709 13:03:00.798383 11187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:00.811940 11187 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 232d656f14734e1592f736d056eb3fc3: Bootstrap starting.
I20260709 13:03:00.817129 11187 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 232d656f14734e1592f736d056eb3fc3: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:00.821666 11187 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 232d656f14734e1592f736d056eb3fc3: No bootstrap required, opened a new log
I20260709 13:03:00.824056 11187 raft_consensus.cc:359] T 00000000000000000000000000000000 P 232d656f14734e1592f736d056eb3fc3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "232d656f14734e1592f736d056eb3fc3" member_type: VOTER }
I20260709 13:03:00.824594 11187 raft_consensus.cc:385] T 00000000000000000000000000000000 P 232d656f14734e1592f736d056eb3fc3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:00.824853 11187 raft_consensus.cc:740] T 00000000000000000000000000000000 P 232d656f14734e1592f736d056eb3fc3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 232d656f14734e1592f736d056eb3fc3, State: Initialized, Role: FOLLOWER
I20260709 13:03:00.825446 11187 consensus_queue.cc:260] T 00000000000000000000000000000000 P 232d656f14734e1592f736d056eb3fc3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "232d656f14734e1592f736d056eb3fc3" member_type: VOTER }
I20260709 13:03:00.825934 11187 raft_consensus.cc:399] T 00000000000000000000000000000000 P 232d656f14734e1592f736d056eb3fc3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:03:00.826192 11187 raft_consensus.cc:493] T 00000000000000000000000000000000 P 232d656f14734e1592f736d056eb3fc3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:03:00.826480 11187 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 232d656f14734e1592f736d056eb3fc3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:00.831378 11187 raft_consensus.cc:515] T 00000000000000000000000000000000 P 232d656f14734e1592f736d056eb3fc3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "232d656f14734e1592f736d056eb3fc3" member_type: VOTER }
I20260709 13:03:00.831990 11187 leader_election.cc:304] T 00000000000000000000000000000000 P 232d656f14734e1592f736d056eb3fc3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 232d656f14734e1592f736d056eb3fc3; no voters: 
I20260709 13:03:00.833214 11187 leader_election.cc:290] T 00000000000000000000000000000000 P 232d656f14734e1592f736d056eb3fc3 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:03:00.833611 11190 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 232d656f14734e1592f736d056eb3fc3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:00.835070 11190 raft_consensus.cc:697] T 00000000000000000000000000000000 P 232d656f14734e1592f736d056eb3fc3 [term 1 LEADER]: Becoming Leader. State: Replica: 232d656f14734e1592f736d056eb3fc3, State: Running, Role: LEADER
I20260709 13:03:00.835863 11190 consensus_queue.cc:237] T 00000000000000000000000000000000 P 232d656f14734e1592f736d056eb3fc3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "232d656f14734e1592f736d056eb3fc3" member_type: VOTER }
I20260709 13:03:00.836356 11187 sys_catalog.cc:565] T 00000000000000000000000000000000 P 232d656f14734e1592f736d056eb3fc3 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:03:00.842468 11192 sys_catalog.cc:455] T 00000000000000000000000000000000 P 232d656f14734e1592f736d056eb3fc3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 232d656f14734e1592f736d056eb3fc3. Latest consensus state: current_term: 1 leader_uuid: "232d656f14734e1592f736d056eb3fc3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "232d656f14734e1592f736d056eb3fc3" member_type: VOTER } }
I20260709 13:03:00.842468 11191 sys_catalog.cc:455] T 00000000000000000000000000000000 P 232d656f14734e1592f736d056eb3fc3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "232d656f14734e1592f736d056eb3fc3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "232d656f14734e1592f736d056eb3fc3" member_type: VOTER } }
I20260709 13:03:00.843355 11192 sys_catalog.cc:458] T 00000000000000000000000000000000 P 232d656f14734e1592f736d056eb3fc3 [sys.catalog]: This master's current role is: LEADER
I20260709 13:03:00.843466 11191 sys_catalog.cc:458] T 00000000000000000000000000000000 P 232d656f14734e1592f736d056eb3fc3 [sys.catalog]: This master's current role is: LEADER
I20260709 13:03:00.845943 11198 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:03:00.851501 11198 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:03:00.854561   431 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:03:00.861670 11198 catalog_manager.cc:1383] Generated new cluster ID: 8a723906f03a4dae96d9cdb4caa42025
I20260709 13:03:00.862046 11198 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:03:00.893844 11198 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:03:00.895202 11198 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:03:00.912259 11198 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 232d656f14734e1592f736d056eb3fc3: Generated new TSK 0
I20260709 13:03:00.912945 11198 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:03:00.921347   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:00.927372 11208 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:00.928435 11209 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:00.931740 11211 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:00.931885   431 server_base.cc:1061] running on GCE node
I20260709 13:03:00.933099   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:00.933363   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:00.933537   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602180933524 us; error 0 us; skew 500 ppm
I20260709 13:03:00.934125   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:00.936762   431 webserver.cc:533] Webserver started at http://127.0.107.193:44249/ using document root <none> and password file <none>
I20260709 13:03:00.937268   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:00.937459   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:00.937740   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:00.938908   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601869227091-431-0/minicluster-data/ts-0-root/instance:
uuid: "e1ee21679c764758a302a52b2f954b5b"
format_stamp: "Formatted at 2026-07-09 13:03:00 on dist-test-slave-5mzn"
I20260709 13:03:00.943574   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.005s
I20260709 13:03:00.947263 11216 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:00.948194   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
I20260709 13:03:00.948572   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601869227091-431-0/minicluster-data/ts-0-root
uuid: "e1ee21679c764758a302a52b2f954b5b"
format_stamp: "Formatted at 2026-07-09 13:03:00 on dist-test-slave-5mzn"
I20260709 13:03:00.948915   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601869227091-431-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601869227091-431-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601869227091-431-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:00.968699   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:00.970000   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:00.971585   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:00.974300   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:00.974550   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:00.974817   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:00.975011   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:01.019322   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.193:33331
I20260709 13:03:01.019433 11278 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.193:33331 every 8 connection(s)
I20260709 13:03:01.024782   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:01.032032 11283 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:01.035245 11284 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:01.040028 11286 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:01.040386   431 server_base.cc:1061] running on GCE node
I20260709 13:03:01.044070   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:03:01.044385   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:01.044409 11279 heartbeater.cc:344] Connected to a master server at 127.0.107.254:43089
I20260709 13:03:01.044700   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602181044680 us; error 0 us; skew 500 ppm
I20260709 13:03:01.045120 11279 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:01.045548   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:01.046027 11279 heartbeater.cc:507] Master 127.0.107.254:43089 requested a full tablet report, sending...
I20260709 13:03:01.048486   431 webserver.cc:533] Webserver started at http://127.0.107.194:42241/ using document root <none> and password file <none>
I20260709 13:03:01.048790 11152 ts_manager.cc:194] Registered new tserver with Master: e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331)
I20260709 13:03:01.049350   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:01.049614   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:01.049944   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:01.051365 11152 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60954
I20260709 13:03:01.051584   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601869227091-431-0/minicluster-data/ts-1-root/instance:
uuid: "770cf1ff89494e54baba82d84dac5831"
format_stamp: "Formatted at 2026-07-09 13:03:01 on dist-test-slave-5mzn"
I20260709 13:03:01.056360   431 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.003s
I20260709 13:03:01.059985 11291 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:01.060977   431 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:03:01.061367   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601869227091-431-0/minicluster-data/ts-1-root
uuid: "770cf1ff89494e54baba82d84dac5831"
format_stamp: "Formatted at 2026-07-09 13:03:01 on dist-test-slave-5mzn"
I20260709 13:03:01.061702   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601869227091-431-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601869227091-431-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601869227091-431-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:01.081507   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:01.082942   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:01.084736   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:01.087383   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:01.087678   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:01.087968   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:01.088218   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:03:01.135139   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.194:39205
I20260709 13:03:01.135288 11353 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.194:39205 every 8 connection(s)
I20260709 13:03:01.141506   431 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:03:01.150156 11357 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:03:01.151521 11358 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:01.155009   431 server_base.cc:1061] running on GCE node
I20260709 13:03:01.156888 11354 heartbeater.cc:344] Connected to a master server at 127.0.107.254:43089
W20260709 13:03:01.157038 11360 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:03:01.157373 11354 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:01.158433   431 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:03:01.158499 11354 heartbeater.cc:507] Master 127.0.107.254:43089 requested a full tablet report, sending...
W20260709 13:03:01.158965   431 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:03:01.159214   431 hybrid_clock.cc:648] HybridClock initialized: now 1783602181159195 us; error 0 us; skew 500 ppm
I20260709 13:03:01.160006   431 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:03:01.161190 11152 ts_manager.cc:194] Registered new tserver with Master: 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205)
I20260709 13:03:01.162897 11152 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60964
I20260709 13:03:01.163513   431 webserver.cc:533] Webserver started at http://127.0.107.195:46089/ using document root <none> and password file <none>
I20260709 13:03:01.164170   431 fs_manager.cc:362] Metadata directory not provided
I20260709 13:03:01.164382   431 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:03:01.164754   431 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:03:01.166131   431 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601869227091-431-0/minicluster-data/ts-2-root/instance:
uuid: "244b85b5155e4f58a13b566c50083890"
format_stamp: "Formatted at 2026-07-09 13:03:01 on dist-test-slave-5mzn"
I20260709 13:03:01.171366   431 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:03:01.175282 11365 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:01.176184   431 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:03:01.176568   431 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601869227091-431-0/minicluster-data/ts-2-root
uuid: "244b85b5155e4f58a13b566c50083890"
format_stamp: "Formatted at 2026-07-09 13:03:01 on dist-test-slave-5mzn"
I20260709 13:03:01.176954   431 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601869227091-431-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601869227091-431-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskvsA0NN/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783601869227091-431-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:03:01.192196   431 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:03:01.193539   431 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:03:01.195015   431 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:03:01.197378   431 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:03:01.197618   431 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:01.197871   431 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:03:01.198050   431 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:03:01.244061   431 rpc_server.cc:307] RPC server started. Bound to: 127.0.107.195:34445
I20260709 13:03:01.244182 11427 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.0.107.195:34445 every 8 connection(s)
I20260709 13:03:01.260278 11428 heartbeater.cc:344] Connected to a master server at 127.0.107.254:43089
I20260709 13:03:01.260993 11428 heartbeater.cc:461] Registering TS with master...
I20260709 13:03:01.261953 11428 heartbeater.cc:507] Master 127.0.107.254:43089 requested a full tablet report, sending...
I20260709 13:03:01.264470 11152 ts_manager.cc:194] Registered new tserver with Master: 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445)
I20260709 13:03:01.264806   431 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017390215s
I20260709 13:03:01.265951 11152 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60968
I20260709 13:03:01.292209 11152 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60970:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:03:01.295109 11152 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:03:01.361388 11393 tablet_service.cc:1511] Processing CreateTablet for tablet 5efc9b8718b0461f95bd09f4b67f1197 (DEFAULT_TABLE table=test-workload [id=4d5766eff2ad4bfa8cb9b3be19ad2ef1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:03:01.362900 11393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5efc9b8718b0461f95bd09f4b67f1197. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:01.364667 11392 tablet_service.cc:1511] Processing CreateTablet for tablet e5a872d4022c47d4b20da810ceffb01b (DEFAULT_TABLE table=test-workload [id=4d5766eff2ad4bfa8cb9b3be19ad2ef1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:03:01.366165 11392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5a872d4022c47d4b20da810ceffb01b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:01.369151 11390 tablet_service.cc:1511] Processing CreateTablet for tablet 90befbbddbe842949771c44d3a3ea4db (DEFAULT_TABLE table=test-workload [id=4d5766eff2ad4bfa8cb9b3be19ad2ef1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:03:01.370731 11390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90befbbddbe842949771c44d3a3ea4db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:01.373886 11391 tablet_service.cc:1511] Processing CreateTablet for tablet 3c7b44fee55543f58f87877c52ecfb79 (DEFAULT_TABLE table=test-workload [id=4d5766eff2ad4bfa8cb9b3be19ad2ef1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:03:01.375341 11391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c7b44fee55543f58f87877c52ecfb79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:01.382181 11389 tablet_service.cc:1511] Processing CreateTablet for tablet 564b17319fe141cab611a47bf22f0b76 (DEFAULT_TABLE table=test-workload [id=4d5766eff2ad4bfa8cb9b3be19ad2ef1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:03:01.384171 11389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 564b17319fe141cab611a47bf22f0b76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:01.388115 11388 tablet_service.cc:1511] Processing CreateTablet for tablet 560d3cdf923a4ab1b6d9f0747f8c40bf (DEFAULT_TABLE table=test-workload [id=4d5766eff2ad4bfa8cb9b3be19ad2ef1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:03:01.389992 11388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 560d3cdf923a4ab1b6d9f0747f8c40bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:01.394928 11387 tablet_service.cc:1511] Processing CreateTablet for tablet ae318533d2c141c9bef5b69d44f64d90 (DEFAULT_TABLE table=test-workload [id=4d5766eff2ad4bfa8cb9b3be19ad2ef1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:03:01.396576 11387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae318533d2c141c9bef5b69d44f64d90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:01.398195 11386 tablet_service.cc:1511] Processing CreateTablet for tablet 2893484e7ace4fd4af892dc3aa82998b (DEFAULT_TABLE table=test-workload [id=4d5766eff2ad4bfa8cb9b3be19ad2ef1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:03:01.399801 11386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2893484e7ace4fd4af892dc3aa82998b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:01.404501 11385 tablet_service.cc:1511] Processing CreateTablet for tablet b604dfd1da1840b2836273c326d4f269 (DEFAULT_TABLE table=test-workload [id=4d5766eff2ad4bfa8cb9b3be19ad2ef1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:03:01.406062 11385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b604dfd1da1840b2836273c326d4f269. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:01.440625 11443 tablet_bootstrap.cc:492] T 90befbbddbe842949771c44d3a3ea4db P 244b85b5155e4f58a13b566c50083890: Bootstrap starting.
I20260709 13:03:01.443859 11244 tablet_service.cc:1511] Processing CreateTablet for tablet 5efc9b8718b0461f95bd09f4b67f1197 (DEFAULT_TABLE table=test-workload [id=4d5766eff2ad4bfa8cb9b3be19ad2ef1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:03:01.445544 11244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5efc9b8718b0461f95bd09f4b67f1197. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:01.448489 11239 tablet_service.cc:1511] Processing CreateTablet for tablet 560d3cdf923a4ab1b6d9f0747f8c40bf (DEFAULT_TABLE table=test-workload [id=4d5766eff2ad4bfa8cb9b3be19ad2ef1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:03:01.450026 11239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 560d3cdf923a4ab1b6d9f0747f8c40bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:01.449666 11238 tablet_service.cc:1511] Processing CreateTablet for tablet ae318533d2c141c9bef5b69d44f64d90 (DEFAULT_TABLE table=test-workload [id=4d5766eff2ad4bfa8cb9b3be19ad2ef1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:03:01.451038 11238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae318533d2c141c9bef5b69d44f64d90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:01.451916 11241 tablet_service.cc:1511] Processing CreateTablet for tablet 90befbbddbe842949771c44d3a3ea4db (DEFAULT_TABLE table=test-workload [id=4d5766eff2ad4bfa8cb9b3be19ad2ef1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:03:01.453343 11241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90befbbddbe842949771c44d3a3ea4db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:01.453814 11240 tablet_service.cc:1511] Processing CreateTablet for tablet 564b17319fe141cab611a47bf22f0b76 (DEFAULT_TABLE table=test-workload [id=4d5766eff2ad4bfa8cb9b3be19ad2ef1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:03:01.455173 11240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 564b17319fe141cab611a47bf22f0b76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:01.457129 11242 tablet_service.cc:1511] Processing CreateTablet for tablet 3c7b44fee55543f58f87877c52ecfb79 (DEFAULT_TABLE table=test-workload [id=4d5766eff2ad4bfa8cb9b3be19ad2ef1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:03:01.458252 11236 tablet_service.cc:1511] Processing CreateTablet for tablet b604dfd1da1840b2836273c326d4f269 (DEFAULT_TABLE table=test-workload [id=4d5766eff2ad4bfa8cb9b3be19ad2ef1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:03:01.458855 11237 tablet_service.cc:1511] Processing CreateTablet for tablet 2893484e7ace4fd4af892dc3aa82998b (DEFAULT_TABLE table=test-workload [id=4d5766eff2ad4bfa8cb9b3be19ad2ef1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:03:01.458648 11242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c7b44fee55543f58f87877c52ecfb79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:01.460232 11237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2893484e7ace4fd4af892dc3aa82998b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:01.460928 11236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b604dfd1da1840b2836273c326d4f269. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:01.448491 11243 tablet_service.cc:1511] Processing CreateTablet for tablet e5a872d4022c47d4b20da810ceffb01b (DEFAULT_TABLE table=test-workload [id=4d5766eff2ad4bfa8cb9b3be19ad2ef1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:03:01.462603 11243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5a872d4022c47d4b20da810ceffb01b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:01.490598 11319 tablet_service.cc:1511] Processing CreateTablet for tablet 5efc9b8718b0461f95bd09f4b67f1197 (DEFAULT_TABLE table=test-workload [id=4d5766eff2ad4bfa8cb9b3be19ad2ef1]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:03:01.491818 11319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5efc9b8718b0461f95bd09f4b67f1197. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:01.493814 11443 tablet_bootstrap.cc:654] T 90befbbddbe842949771c44d3a3ea4db P 244b85b5155e4f58a13b566c50083890: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:01.498484 11318 tablet_service.cc:1511] Processing CreateTablet for tablet e5a872d4022c47d4b20da810ceffb01b (DEFAULT_TABLE table=test-workload [id=4d5766eff2ad4bfa8cb9b3be19ad2ef1]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:03:01.499502 11316 tablet_service.cc:1511] Processing CreateTablet for tablet 90befbbddbe842949771c44d3a3ea4db (DEFAULT_TABLE table=test-workload [id=4d5766eff2ad4bfa8cb9b3be19ad2ef1]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:03:01.500064 11318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5a872d4022c47d4b20da810ceffb01b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:01.500943 11316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90befbbddbe842949771c44d3a3ea4db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:01.502310 11317 tablet_service.cc:1511] Processing CreateTablet for tablet 3c7b44fee55543f58f87877c52ecfb79 (DEFAULT_TABLE table=test-workload [id=4d5766eff2ad4bfa8cb9b3be19ad2ef1]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:03:01.503744 11317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c7b44fee55543f58f87877c52ecfb79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:01.507351 11315 tablet_service.cc:1511] Processing CreateTablet for tablet 564b17319fe141cab611a47bf22f0b76 (DEFAULT_TABLE table=test-workload [id=4d5766eff2ad4bfa8cb9b3be19ad2ef1]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:03:01.508948 11315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 564b17319fe141cab611a47bf22f0b76. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:01.532373 11314 tablet_service.cc:1511] Processing CreateTablet for tablet 560d3cdf923a4ab1b6d9f0747f8c40bf (DEFAULT_TABLE table=test-workload [id=4d5766eff2ad4bfa8cb9b3be19ad2ef1]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:03:01.534185 11314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 560d3cdf923a4ab1b6d9f0747f8c40bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:01.539168 11311 tablet_service.cc:1511] Processing CreateTablet for tablet b604dfd1da1840b2836273c326d4f269 (DEFAULT_TABLE table=test-workload [id=4d5766eff2ad4bfa8cb9b3be19ad2ef1]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:03:01.546427 11311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b604dfd1da1840b2836273c326d4f269. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:01.540555 11312 tablet_service.cc:1511] Processing CreateTablet for tablet 2893484e7ace4fd4af892dc3aa82998b (DEFAULT_TABLE table=test-workload [id=4d5766eff2ad4bfa8cb9b3be19ad2ef1]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:03:01.549616 11312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2893484e7ace4fd4af892dc3aa82998b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:01.535993 11313 tablet_service.cc:1511] Processing CreateTablet for tablet ae318533d2c141c9bef5b69d44f64d90 (DEFAULT_TABLE table=test-workload [id=4d5766eff2ad4bfa8cb9b3be19ad2ef1]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:03:01.552831 11443 tablet_bootstrap.cc:492] T 90befbbddbe842949771c44d3a3ea4db P 244b85b5155e4f58a13b566c50083890: No bootstrap required, opened a new log
I20260709 13:03:01.553480 11443 ts_tablet_manager.cc:1403] T 90befbbddbe842949771c44d3a3ea4db P 244b85b5155e4f58a13b566c50083890: Time spent bootstrapping tablet: real 0.113s	user 0.016s	sys 0.010s
I20260709 13:03:01.553664 11313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae318533d2c141c9bef5b69d44f64d90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:01.558598 11444 tablet_bootstrap.cc:492] T 5efc9b8718b0461f95bd09f4b67f1197 P e1ee21679c764758a302a52b2f954b5b: Bootstrap starting.
I20260709 13:03:01.561147 11443 raft_consensus.cc:359] T 90befbbddbe842949771c44d3a3ea4db P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:01.562091 11443 raft_consensus.cc:385] T 90befbbddbe842949771c44d3a3ea4db P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:01.562404 11443 raft_consensus.cc:740] T 90befbbddbe842949771c44d3a3ea4db P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 244b85b5155e4f58a13b566c50083890, State: Initialized, Role: FOLLOWER
I20260709 13:03:01.563279 11443 consensus_queue.cc:260] T 90befbbddbe842949771c44d3a3ea4db P 244b85b5155e4f58a13b566c50083890 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:01.575295 11446 tablet_bootstrap.cc:492] T 90befbbddbe842949771c44d3a3ea4db P 770cf1ff89494e54baba82d84dac5831: Bootstrap starting.
I20260709 13:03:01.582175 11446 tablet_bootstrap.cc:654] T 90befbbddbe842949771c44d3a3ea4db P 770cf1ff89494e54baba82d84dac5831: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:01.584339 11444 tablet_bootstrap.cc:654] T 5efc9b8718b0461f95bd09f4b67f1197 P e1ee21679c764758a302a52b2f954b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:01.585373 11428 heartbeater.cc:499] Master 127.0.107.254:43089 was elected leader, sending a full tablet report...
I20260709 13:03:01.582043 11443 ts_tablet_manager.cc:1434] T 90befbbddbe842949771c44d3a3ea4db P 244b85b5155e4f58a13b566c50083890: Time spent starting tablet: real 0.028s	user 0.010s	sys 0.007s
I20260709 13:03:01.601564 11443 tablet_bootstrap.cc:492] T b604dfd1da1840b2836273c326d4f269 P 244b85b5155e4f58a13b566c50083890: Bootstrap starting.
I20260709 13:03:01.611726 11444 tablet_bootstrap.cc:492] T 5efc9b8718b0461f95bd09f4b67f1197 P e1ee21679c764758a302a52b2f954b5b: No bootstrap required, opened a new log
I20260709 13:03:01.612556 11444 ts_tablet_manager.cc:1403] T 5efc9b8718b0461f95bd09f4b67f1197 P e1ee21679c764758a302a52b2f954b5b: Time spent bootstrapping tablet: real 0.054s	user 0.015s	sys 0.000s
I20260709 13:03:01.615857 11444 raft_consensus.cc:359] T 5efc9b8718b0461f95bd09f4b67f1197 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } }
I20260709 13:03:01.616765 11444 raft_consensus.cc:385] T 5efc9b8718b0461f95bd09f4b67f1197 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:01.617156 11444 raft_consensus.cc:740] T 5efc9b8718b0461f95bd09f4b67f1197 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1ee21679c764758a302a52b2f954b5b, State: Initialized, Role: FOLLOWER
I20260709 13:03:01.617959 11443 tablet_bootstrap.cc:654] T b604dfd1da1840b2836273c326d4f269 P 244b85b5155e4f58a13b566c50083890: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:01.617969 11444 consensus_queue.cc:260] T 5efc9b8718b0461f95bd09f4b67f1197 P e1ee21679c764758a302a52b2f954b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } }
I20260709 13:03:01.620812 11279 heartbeater.cc:499] Master 127.0.107.254:43089 was elected leader, sending a full tablet report...
I20260709 13:03:01.621040 11446 tablet_bootstrap.cc:492] T 90befbbddbe842949771c44d3a3ea4db P 770cf1ff89494e54baba82d84dac5831: No bootstrap required, opened a new log
I20260709 13:03:01.621253 11444 ts_tablet_manager.cc:1434] T 5efc9b8718b0461f95bd09f4b67f1197 P e1ee21679c764758a302a52b2f954b5b: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:03:01.621691 11446 ts_tablet_manager.cc:1403] T 90befbbddbe842949771c44d3a3ea4db P 770cf1ff89494e54baba82d84dac5831: Time spent bootstrapping tablet: real 0.047s	user 0.026s	sys 0.015s
I20260709 13:03:01.622323 11444 tablet_bootstrap.cc:492] T b604dfd1da1840b2836273c326d4f269 P e1ee21679c764758a302a52b2f954b5b: Bootstrap starting.
I20260709 13:03:01.624869 11446 raft_consensus.cc:359] T 90befbbddbe842949771c44d3a3ea4db P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:01.625669 11446 raft_consensus.cc:385] T 90befbbddbe842949771c44d3a3ea4db P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:01.625981 11446 raft_consensus.cc:740] T 90befbbddbe842949771c44d3a3ea4db P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 770cf1ff89494e54baba82d84dac5831, State: Initialized, Role: FOLLOWER
I20260709 13:03:01.626746 11446 consensus_queue.cc:260] T 90befbbddbe842949771c44d3a3ea4db P 770cf1ff89494e54baba82d84dac5831 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:01.629352 11444 tablet_bootstrap.cc:654] T b604dfd1da1840b2836273c326d4f269 P e1ee21679c764758a302a52b2f954b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:01.629565 11354 heartbeater.cc:499] Master 127.0.107.254:43089 was elected leader, sending a full tablet report...
I20260709 13:03:01.629940 11446 ts_tablet_manager.cc:1434] T 90befbbddbe842949771c44d3a3ea4db P 770cf1ff89494e54baba82d84dac5831: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:03:01.631163 11446 tablet_bootstrap.cc:492] T 564b17319fe141cab611a47bf22f0b76 P 770cf1ff89494e54baba82d84dac5831: Bootstrap starting.
I20260709 13:03:01.637180 11443 tablet_bootstrap.cc:492] T b604dfd1da1840b2836273c326d4f269 P 244b85b5155e4f58a13b566c50083890: No bootstrap required, opened a new log
I20260709 13:03:01.637877 11443 ts_tablet_manager.cc:1403] T b604dfd1da1840b2836273c326d4f269 P 244b85b5155e4f58a13b566c50083890: Time spent bootstrapping tablet: real 0.037s	user 0.019s	sys 0.000s
I20260709 13:03:01.641281 11443 raft_consensus.cc:359] T b604dfd1da1840b2836273c326d4f269 P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
W20260709 13:03:01.641716 11355 tablet.cc:2406] T 90befbbddbe842949771c44d3a3ea4db P 770cf1ff89494e54baba82d84dac5831: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:03:01.647636 11443 raft_consensus.cc:385] T b604dfd1da1840b2836273c326d4f269 P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:01.648161 11443 raft_consensus.cc:740] T b604dfd1da1840b2836273c326d4f269 P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 244b85b5155e4f58a13b566c50083890, State: Initialized, Role: FOLLOWER
I20260709 13:03:01.649216 11443 consensus_queue.cc:260] T b604dfd1da1840b2836273c326d4f269 P 244b85b5155e4f58a13b566c50083890 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:01.640897 11446 tablet_bootstrap.cc:654] T 564b17319fe141cab611a47bf22f0b76 P 770cf1ff89494e54baba82d84dac5831: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:01.651974 11443 ts_tablet_manager.cc:1434] T b604dfd1da1840b2836273c326d4f269 P 244b85b5155e4f58a13b566c50083890: Time spent starting tablet: real 0.014s	user 0.011s	sys 0.003s
I20260709 13:03:01.653175 11443 tablet_bootstrap.cc:492] T 3c7b44fee55543f58f87877c52ecfb79 P 244b85b5155e4f58a13b566c50083890: Bootstrap starting.
I20260709 13:03:01.655797 11452 raft_consensus.cc:493] T 90befbbddbe842949771c44d3a3ea4db P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.656455 11452 raft_consensus.cc:515] T 90befbbddbe842949771c44d3a3ea4db P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:01.660687 11443 tablet_bootstrap.cc:654] T 3c7b44fee55543f58f87877c52ecfb79 P 244b85b5155e4f58a13b566c50083890: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:01.666116 11446 tablet_bootstrap.cc:492] T 564b17319fe141cab611a47bf22f0b76 P 770cf1ff89494e54baba82d84dac5831: No bootstrap required, opened a new log
I20260709 13:03:01.667064 11446 ts_tablet_manager.cc:1403] T 564b17319fe141cab611a47bf22f0b76 P 770cf1ff89494e54baba82d84dac5831: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.009s
I20260709 13:03:01.671480 11446 raft_consensus.cc:359] T 564b17319fe141cab611a47bf22f0b76 P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:01.672616 11446 raft_consensus.cc:385] T 564b17319fe141cab611a47bf22f0b76 P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:01.673085 11446 raft_consensus.cc:740] T 564b17319fe141cab611a47bf22f0b76 P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 770cf1ff89494e54baba82d84dac5831, State: Initialized, Role: FOLLOWER
I20260709 13:03:01.673077 11452 leader_election.cc:290] T 90befbbddbe842949771c44d3a3ea4db P 770cf1ff89494e54baba82d84dac5831 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331), 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445)
I20260709 13:03:01.674423 11446 consensus_queue.cc:260] T 564b17319fe141cab611a47bf22f0b76 P 770cf1ff89494e54baba82d84dac5831 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:01.678005 11446 ts_tablet_manager.cc:1434] T 564b17319fe141cab611a47bf22f0b76 P 770cf1ff89494e54baba82d84dac5831: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:03:01.679426 11446 tablet_bootstrap.cc:492] T 3c7b44fee55543f58f87877c52ecfb79 P 770cf1ff89494e54baba82d84dac5831: Bootstrap starting.
I20260709 13:03:01.691470 11444 tablet_bootstrap.cc:492] T b604dfd1da1840b2836273c326d4f269 P e1ee21679c764758a302a52b2f954b5b: No bootstrap required, opened a new log
I20260709 13:03:01.692180 11444 ts_tablet_manager.cc:1403] T b604dfd1da1840b2836273c326d4f269 P e1ee21679c764758a302a52b2f954b5b: Time spent bootstrapping tablet: real 0.070s	user 0.044s	sys 0.023s
I20260709 13:03:01.692339 11446 tablet_bootstrap.cc:654] T 3c7b44fee55543f58f87877c52ecfb79 P 770cf1ff89494e54baba82d84dac5831: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:01.683545 11443 tablet_bootstrap.cc:492] T 3c7b44fee55543f58f87877c52ecfb79 P 244b85b5155e4f58a13b566c50083890: No bootstrap required, opened a new log
I20260709 13:03:01.695453 11443 ts_tablet_manager.cc:1403] T 3c7b44fee55543f58f87877c52ecfb79 P 244b85b5155e4f58a13b566c50083890: Time spent bootstrapping tablet: real 0.043s	user 0.021s	sys 0.009s
I20260709 13:03:01.695600 11444 raft_consensus.cc:359] T b604dfd1da1840b2836273c326d4f269 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:01.696548 11444 raft_consensus.cc:385] T b604dfd1da1840b2836273c326d4f269 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:01.696914 11444 raft_consensus.cc:740] T b604dfd1da1840b2836273c326d4f269 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1ee21679c764758a302a52b2f954b5b, State: Initialized, Role: FOLLOWER
I20260709 13:03:01.697870 11444 consensus_queue.cc:260] T b604dfd1da1840b2836273c326d4f269 P e1ee21679c764758a302a52b2f954b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:01.698694 11443 raft_consensus.cc:359] T 3c7b44fee55543f58f87877c52ecfb79 P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:01.699456 11443 raft_consensus.cc:385] T 3c7b44fee55543f58f87877c52ecfb79 P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:01.699749 11443 raft_consensus.cc:740] T 3c7b44fee55543f58f87877c52ecfb79 P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 244b85b5155e4f58a13b566c50083890, State: Initialized, Role: FOLLOWER
I20260709 13:03:01.700304 11444 ts_tablet_manager.cc:1434] T b604dfd1da1840b2836273c326d4f269 P e1ee21679c764758a302a52b2f954b5b: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:03:01.700572 11443 consensus_queue.cc:260] T 3c7b44fee55543f58f87877c52ecfb79 P 244b85b5155e4f58a13b566c50083890 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:01.701404 11444 tablet_bootstrap.cc:492] T e5a872d4022c47d4b20da810ceffb01b P e1ee21679c764758a302a52b2f954b5b: Bootstrap starting.
I20260709 13:03:01.709028 11444 tablet_bootstrap.cc:654] T e5a872d4022c47d4b20da810ceffb01b P e1ee21679c764758a302a52b2f954b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:01.709936 11403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90befbbddbe842949771c44d3a3ea4db" candidate_uuid: "770cf1ff89494e54baba82d84dac5831" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "244b85b5155e4f58a13b566c50083890" is_pre_election: true
I20260709 13:03:01.711107 11403 raft_consensus.cc:2468] T 90befbbddbe842949771c44d3a3ea4db P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 770cf1ff89494e54baba82d84dac5831 in term 0.
I20260709 13:03:01.712455 11443 ts_tablet_manager.cc:1434] T 3c7b44fee55543f58f87877c52ecfb79 P 244b85b5155e4f58a13b566c50083890: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.004s
I20260709 13:03:01.713914 11446 tablet_bootstrap.cc:492] T 3c7b44fee55543f58f87877c52ecfb79 P 770cf1ff89494e54baba82d84dac5831: No bootstrap required, opened a new log
I20260709 13:03:01.714545 11446 ts_tablet_manager.cc:1403] T 3c7b44fee55543f58f87877c52ecfb79 P 770cf1ff89494e54baba82d84dac5831: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.003s
I20260709 13:03:01.718240 11446 raft_consensus.cc:359] T 3c7b44fee55543f58f87877c52ecfb79 P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:01.719172 11446 raft_consensus.cc:385] T 3c7b44fee55543f58f87877c52ecfb79 P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:01.719394 11443 tablet_bootstrap.cc:492] T 564b17319fe141cab611a47bf22f0b76 P 244b85b5155e4f58a13b566c50083890: Bootstrap starting.
I20260709 13:03:01.719549 11446 raft_consensus.cc:740] T 3c7b44fee55543f58f87877c52ecfb79 P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 770cf1ff89494e54baba82d84dac5831, State: Initialized, Role: FOLLOWER
I20260709 13:03:01.721204 11444 tablet_bootstrap.cc:492] T e5a872d4022c47d4b20da810ceffb01b P e1ee21679c764758a302a52b2f954b5b: No bootstrap required, opened a new log
I20260709 13:03:01.720911 11446 consensus_queue.cc:260] T 3c7b44fee55543f58f87877c52ecfb79 P 770cf1ff89494e54baba82d84dac5831 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:01.721907 11444 ts_tablet_manager.cc:1403] T e5a872d4022c47d4b20da810ceffb01b P e1ee21679c764758a302a52b2f954b5b: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.007s
I20260709 13:03:01.724782 11295 leader_election.cc:304] T 90befbbddbe842949771c44d3a3ea4db P 770cf1ff89494e54baba82d84dac5831 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 244b85b5155e4f58a13b566c50083890, 770cf1ff89494e54baba82d84dac5831; no voters: 
I20260709 13:03:01.725423 11444 raft_consensus.cc:359] T e5a872d4022c47d4b20da810ceffb01b P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:01.726060 11452 raft_consensus.cc:2804] T 90befbbddbe842949771c44d3a3ea4db P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:01.726451 11444 raft_consensus.cc:385] T e5a872d4022c47d4b20da810ceffb01b P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:01.726498 11452 raft_consensus.cc:493] T 90befbbddbe842949771c44d3a3ea4db P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:01.726933 11444 raft_consensus.cc:740] T e5a872d4022c47d4b20da810ceffb01b P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1ee21679c764758a302a52b2f954b5b, State: Initialized, Role: FOLLOWER
I20260709 13:03:01.727139 11452 raft_consensus.cc:3060] T 90befbbddbe842949771c44d3a3ea4db P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:01.728071 11444 consensus_queue.cc:260] T e5a872d4022c47d4b20da810ceffb01b P e1ee21679c764758a302a52b2f954b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:01.732410 11254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90befbbddbe842949771c44d3a3ea4db" candidate_uuid: "770cf1ff89494e54baba82d84dac5831" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1ee21679c764758a302a52b2f954b5b" is_pre_election: true
I20260709 13:03:01.734695 11444 ts_tablet_manager.cc:1434] T e5a872d4022c47d4b20da810ceffb01b P e1ee21679c764758a302a52b2f954b5b: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
W20260709 13:03:01.734527 11292 leader_election.cc:343] T 90befbbddbe842949771c44d3a3ea4db P 770cf1ff89494e54baba82d84dac5831 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:01.735661 11446 ts_tablet_manager.cc:1434] T 3c7b44fee55543f58f87877c52ecfb79 P 770cf1ff89494e54baba82d84dac5831: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.001s
I20260709 13:03:01.736163 11444 tablet_bootstrap.cc:492] T 560d3cdf923a4ab1b6d9f0747f8c40bf P e1ee21679c764758a302a52b2f954b5b: Bootstrap starting.
I20260709 13:03:01.736953 11452 raft_consensus.cc:515] T 90befbbddbe842949771c44d3a3ea4db P 770cf1ff89494e54baba82d84dac5831 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:01.727088 11443 tablet_bootstrap.cc:654] T 564b17319fe141cab611a47bf22f0b76 P 244b85b5155e4f58a13b566c50083890: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:01.740410 11254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90befbbddbe842949771c44d3a3ea4db" candidate_uuid: "770cf1ff89494e54baba82d84dac5831" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1ee21679c764758a302a52b2f954b5b"
I20260709 13:03:01.743769 11452 leader_election.cc:290] T 90befbbddbe842949771c44d3a3ea4db P 770cf1ff89494e54baba82d84dac5831 [CANDIDATE]: Term 1 election: Requested vote from peers e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331), 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445)
I20260709 13:03:01.743929 11446 tablet_bootstrap.cc:492] T e5a872d4022c47d4b20da810ceffb01b P 770cf1ff89494e54baba82d84dac5831: Bootstrap starting.
I20260709 13:03:01.744227 11444 tablet_bootstrap.cc:654] T 560d3cdf923a4ab1b6d9f0747f8c40bf P e1ee21679c764758a302a52b2f954b5b: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:01.745326 11292 leader_election.cc:343] T 90befbbddbe842949771c44d3a3ea4db P 770cf1ff89494e54baba82d84dac5831 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:01.747283 11403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90befbbddbe842949771c44d3a3ea4db" candidate_uuid: "770cf1ff89494e54baba82d84dac5831" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "244b85b5155e4f58a13b566c50083890"
I20260709 13:03:01.748101 11403 raft_consensus.cc:3060] T 90befbbddbe842949771c44d3a3ea4db P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:01.750064 11443 tablet_bootstrap.cc:492] T 564b17319fe141cab611a47bf22f0b76 P 244b85b5155e4f58a13b566c50083890: No bootstrap required, opened a new log
I20260709 13:03:01.750875 11443 ts_tablet_manager.cc:1403] T 564b17319fe141cab611a47bf22f0b76 P 244b85b5155e4f58a13b566c50083890: Time spent bootstrapping tablet: real 0.032s	user 0.013s	sys 0.003s
I20260709 13:03:01.752135 11446 tablet_bootstrap.cc:654] T e5a872d4022c47d4b20da810ceffb01b P 770cf1ff89494e54baba82d84dac5831: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:01.755354 11443 raft_consensus.cc:359] T 564b17319fe141cab611a47bf22f0b76 P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:01.757061 11443 raft_consensus.cc:385] T 564b17319fe141cab611a47bf22f0b76 P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:01.757565 11443 raft_consensus.cc:740] T 564b17319fe141cab611a47bf22f0b76 P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 244b85b5155e4f58a13b566c50083890, State: Initialized, Role: FOLLOWER
I20260709 13:03:01.758600 11403 raft_consensus.cc:2468] T 90befbbddbe842949771c44d3a3ea4db P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 770cf1ff89494e54baba82d84dac5831 in term 1.
I20260709 13:03:01.759775 11444 tablet_bootstrap.cc:492] T 560d3cdf923a4ab1b6d9f0747f8c40bf P e1ee21679c764758a302a52b2f954b5b: No bootstrap required, opened a new log
I20260709 13:03:01.758971 11443 consensus_queue.cc:260] T 564b17319fe141cab611a47bf22f0b76 P 244b85b5155e4f58a13b566c50083890 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:01.762893 11446 tablet_bootstrap.cc:492] T e5a872d4022c47d4b20da810ceffb01b P 770cf1ff89494e54baba82d84dac5831: No bootstrap required, opened a new log
I20260709 13:03:01.763726 11444 ts_tablet_manager.cc:1403] T 560d3cdf923a4ab1b6d9f0747f8c40bf P e1ee21679c764758a302a52b2f954b5b: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.006s
I20260709 13:03:01.764163 11446 ts_tablet_manager.cc:1403] T e5a872d4022c47d4b20da810ceffb01b P 770cf1ff89494e54baba82d84dac5831: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.005s
I20260709 13:03:01.765087 11295 leader_election.cc:304] T 90befbbddbe842949771c44d3a3ea4db P 770cf1ff89494e54baba82d84dac5831 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 244b85b5155e4f58a13b566c50083890, 770cf1ff89494e54baba82d84dac5831; no voters: e1ee21679c764758a302a52b2f954b5b
I20260709 13:03:01.766568 11443 ts_tablet_manager.cc:1434] T 564b17319fe141cab611a47bf22f0b76 P 244b85b5155e4f58a13b566c50083890: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 13:03:01.767347 11444 raft_consensus.cc:359] T 560d3cdf923a4ab1b6d9f0747f8c40bf P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:01.767637 11446 raft_consensus.cc:359] T e5a872d4022c47d4b20da810ceffb01b P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:01.768268 11444 raft_consensus.cc:385] T 560d3cdf923a4ab1b6d9f0747f8c40bf P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:01.768353 11452 raft_consensus.cc:2804] T 90befbbddbe842949771c44d3a3ea4db P 770cf1ff89494e54baba82d84dac5831 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:01.767844 11443 tablet_bootstrap.cc:492] T 2893484e7ace4fd4af892dc3aa82998b P 244b85b5155e4f58a13b566c50083890: Bootstrap starting.
I20260709 13:03:01.768601 11446 raft_consensus.cc:385] T e5a872d4022c47d4b20da810ceffb01b P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:01.769284 11446 raft_consensus.cc:740] T e5a872d4022c47d4b20da810ceffb01b P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 770cf1ff89494e54baba82d84dac5831, State: Initialized, Role: FOLLOWER
I20260709 13:03:01.770298 11446 consensus_queue.cc:260] T e5a872d4022c47d4b20da810ceffb01b P 770cf1ff89494e54baba82d84dac5831 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:01.773542 11450 raft_consensus.cc:493] T e5a872d4022c47d4b20da810ceffb01b P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.774174 11450 raft_consensus.cc:515] T e5a872d4022c47d4b20da810ceffb01b P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:01.768702 11444 raft_consensus.cc:740] T 560d3cdf923a4ab1b6d9f0747f8c40bf P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1ee21679c764758a302a52b2f954b5b, State: Initialized, Role: FOLLOWER
I20260709 13:03:01.780218 11444 consensus_queue.cc:260] T 560d3cdf923a4ab1b6d9f0747f8c40bf P e1ee21679c764758a302a52b2f954b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:01.783532 11450 leader_election.cc:290] T e5a872d4022c47d4b20da810ceffb01b P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205), 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445)
I20260709 13:03:01.784641 11443 tablet_bootstrap.cc:654] T 2893484e7ace4fd4af892dc3aa82998b P 244b85b5155e4f58a13b566c50083890: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:01.786000 11452 raft_consensus.cc:697] T 90befbbddbe842949771c44d3a3ea4db P 770cf1ff89494e54baba82d84dac5831 [term 1 LEADER]: Becoming Leader. State: Replica: 770cf1ff89494e54baba82d84dac5831, State: Running, Role: LEADER
I20260709 13:03:01.814183 11446 ts_tablet_manager.cc:1434] T e5a872d4022c47d4b20da810ceffb01b P 770cf1ff89494e54baba82d84dac5831: Time spent starting tablet: real 0.050s	user 0.023s	sys 0.008s
I20260709 13:03:01.813788 11452 consensus_queue.cc:237] T 90befbbddbe842949771c44d3a3ea4db P 770cf1ff89494e54baba82d84dac5831 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:01.815611 11446 tablet_bootstrap.cc:492] T 5efc9b8718b0461f95bd09f4b67f1197 P 770cf1ff89494e54baba82d84dac5831: Bootstrap starting.
I20260709 13:03:01.812608 11444 ts_tablet_manager.cc:1434] T 560d3cdf923a4ab1b6d9f0747f8c40bf P e1ee21679c764758a302a52b2f954b5b: Time spent starting tablet: real 0.048s	user 0.017s	sys 0.018s
I20260709 13:03:01.820367 11444 tablet_bootstrap.cc:492] T 90befbbddbe842949771c44d3a3ea4db P e1ee21679c764758a302a52b2f954b5b: Bootstrap starting.
I20260709 13:03:01.823853 11446 tablet_bootstrap.cc:654] T 5efc9b8718b0461f95bd09f4b67f1197 P 770cf1ff89494e54baba82d84dac5831: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:01.825199 11403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a872d4022c47d4b20da810ceffb01b" candidate_uuid: "e1ee21679c764758a302a52b2f954b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "244b85b5155e4f58a13b566c50083890" is_pre_election: true
W20260709 13:03:01.827273 11220 leader_election.cc:343] T e5a872d4022c47d4b20da810ceffb01b P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:01.829790 11329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a872d4022c47d4b20da810ceffb01b" candidate_uuid: "e1ee21679c764758a302a52b2f954b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770cf1ff89494e54baba82d84dac5831" is_pre_election: true
I20260709 13:03:01.830698 11444 tablet_bootstrap.cc:654] T 90befbbddbe842949771c44d3a3ea4db P e1ee21679c764758a302a52b2f954b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:01.830983 11329 raft_consensus.cc:2468] T e5a872d4022c47d4b20da810ceffb01b P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1ee21679c764758a302a52b2f954b5b in term 0.
I20260709 13:03:01.833905 11217 leader_election.cc:304] T e5a872d4022c47d4b20da810ceffb01b P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 770cf1ff89494e54baba82d84dac5831, e1ee21679c764758a302a52b2f954b5b; no voters: 244b85b5155e4f58a13b566c50083890
I20260709 13:03:01.835527 11467 raft_consensus.cc:2804] T e5a872d4022c47d4b20da810ceffb01b P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:01.836062 11467 raft_consensus.cc:493] T e5a872d4022c47d4b20da810ceffb01b P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:01.836589 11467 raft_consensus.cc:3060] T e5a872d4022c47d4b20da810ceffb01b P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:01.849877 11200 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:01.848919 11444 tablet_bootstrap.cc:492] T 90befbbddbe842949771c44d3a3ea4db P e1ee21679c764758a302a52b2f954b5b: No bootstrap required, opened a new log
I20260709 13:03:01.852906 11444 ts_tablet_manager.cc:1403] T 90befbbddbe842949771c44d3a3ea4db P e1ee21679c764758a302a52b2f954b5b: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.003s
I20260709 13:03:01.854866 11467 raft_consensus.cc:515] T e5a872d4022c47d4b20da810ceffb01b P e1ee21679c764758a302a52b2f954b5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:01.855703 11450 raft_consensus.cc:493] T 560d3cdf923a4ab1b6d9f0747f8c40bf P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.856509 11450 raft_consensus.cc:515] T 560d3cdf923a4ab1b6d9f0747f8c40bf P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:01.857611 11444 raft_consensus.cc:359] T 90befbbddbe842949771c44d3a3ea4db P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:01.858908 11444 raft_consensus.cc:385] T 90befbbddbe842949771c44d3a3ea4db P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:01.859637 11444 raft_consensus.cc:740] T 90befbbddbe842949771c44d3a3ea4db P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1ee21679c764758a302a52b2f954b5b, State: Initialized, Role: FOLLOWER
I20260709 13:03:01.858870 11152 catalog_manager.cc:5697] T 90befbbddbe842949771c44d3a3ea4db P 770cf1ff89494e54baba82d84dac5831 reported cstate change: term changed from 0 to 1, leader changed from <none> to 770cf1ff89494e54baba82d84dac5831 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "770cf1ff89494e54baba82d84dac5831" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:01.860733 11403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "560d3cdf923a4ab1b6d9f0747f8c40bf" candidate_uuid: "e1ee21679c764758a302a52b2f954b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "244b85b5155e4f58a13b566c50083890" is_pre_election: true
I20260709 13:03:01.860809 11444 consensus_queue.cc:260] T 90befbbddbe842949771c44d3a3ea4db P e1ee21679c764758a302a52b2f954b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
W20260709 13:03:01.862622 11220 leader_election.cc:343] T 560d3cdf923a4ab1b6d9f0747f8c40bf P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:01.863430 11450 leader_election.cc:290] T 560d3cdf923a4ab1b6d9f0747f8c40bf P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205), 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445)
I20260709 13:03:01.865420 11329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "560d3cdf923a4ab1b6d9f0747f8c40bf" candidate_uuid: "e1ee21679c764758a302a52b2f954b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770cf1ff89494e54baba82d84dac5831" is_pre_election: true
W20260709 13:03:01.867301 11217 leader_election.cc:343] T 560d3cdf923a4ab1b6d9f0747f8c40bf P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:01.867856 11217 leader_election.cc:304] T 560d3cdf923a4ab1b6d9f0747f8c40bf P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1ee21679c764758a302a52b2f954b5b; no voters: 244b85b5155e4f58a13b566c50083890, 770cf1ff89494e54baba82d84dac5831
I20260709 13:03:01.868903 11452 raft_consensus.cc:493] T 564b17319fe141cab611a47bf22f0b76 P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.869021 11450 raft_consensus.cc:2749] T 560d3cdf923a4ab1b6d9f0747f8c40bf P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:01.869717 11443 tablet_bootstrap.cc:492] T 2893484e7ace4fd4af892dc3aa82998b P 244b85b5155e4f58a13b566c50083890: No bootstrap required, opened a new log
I20260709 13:03:01.869632 11452 raft_consensus.cc:515] T 564b17319fe141cab611a47bf22f0b76 P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:01.870550 11443 ts_tablet_manager.cc:1403] T 2893484e7ace4fd4af892dc3aa82998b P 244b85b5155e4f58a13b566c50083890: Time spent bootstrapping tablet: real 0.103s	user 0.018s	sys 0.018s
I20260709 13:03:01.872691 11329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a872d4022c47d4b20da810ceffb01b" candidate_uuid: "e1ee21679c764758a302a52b2f954b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770cf1ff89494e54baba82d84dac5831"
I20260709 13:03:01.873440 11329 raft_consensus.cc:3060] T e5a872d4022c47d4b20da810ceffb01b P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:01.873859 11452 leader_election.cc:290] T 564b17319fe141cab611a47bf22f0b76 P 770cf1ff89494e54baba82d84dac5831 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331), 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445)
I20260709 13:03:01.873976 11254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564b17319fe141cab611a47bf22f0b76" candidate_uuid: "770cf1ff89494e54baba82d84dac5831" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1ee21679c764758a302a52b2f954b5b" is_pre_election: true
I20260709 13:03:01.875214 11403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564b17319fe141cab611a47bf22f0b76" candidate_uuid: "770cf1ff89494e54baba82d84dac5831" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "244b85b5155e4f58a13b566c50083890" is_pre_election: true
W20260709 13:03:01.875763 11292 leader_election.cc:343] T 564b17319fe141cab611a47bf22f0b76 P 770cf1ff89494e54baba82d84dac5831 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:01.876003 11403 raft_consensus.cc:2468] T 564b17319fe141cab611a47bf22f0b76 P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 770cf1ff89494e54baba82d84dac5831 in term 0.
I20260709 13:03:01.876319 11444 ts_tablet_manager.cc:1434] T 90befbbddbe842949771c44d3a3ea4db P e1ee21679c764758a302a52b2f954b5b: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.007s
I20260709 13:03:01.877815 11295 leader_election.cc:304] T 564b17319fe141cab611a47bf22f0b76 P 770cf1ff89494e54baba82d84dac5831 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 244b85b5155e4f58a13b566c50083890, 770cf1ff89494e54baba82d84dac5831; no voters: e1ee21679c764758a302a52b2f954b5b
I20260709 13:03:01.878876 11452 raft_consensus.cc:2804] T 564b17319fe141cab611a47bf22f0b76 P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:01.879472 11452 raft_consensus.cc:493] T 564b17319fe141cab611a47bf22f0b76 P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:01.879940 11452 raft_consensus.cc:3060] T 564b17319fe141cab611a47bf22f0b76 P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:01.882050 11443 raft_consensus.cc:359] T 2893484e7ace4fd4af892dc3aa82998b P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:01.883026 11443 raft_consensus.cc:385] T 2893484e7ace4fd4af892dc3aa82998b P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:01.883375 11443 raft_consensus.cc:740] T 2893484e7ace4fd4af892dc3aa82998b P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 244b85b5155e4f58a13b566c50083890, State: Initialized, Role: FOLLOWER
I20260709 13:03:01.885447 11446 tablet_bootstrap.cc:492] T 5efc9b8718b0461f95bd09f4b67f1197 P 770cf1ff89494e54baba82d84dac5831: No bootstrap required, opened a new log
I20260709 13:03:01.878149 11444 tablet_bootstrap.cc:492] T 2893484e7ace4fd4af892dc3aa82998b P e1ee21679c764758a302a52b2f954b5b: Bootstrap starting.
I20260709 13:03:01.886157 11403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5a872d4022c47d4b20da810ceffb01b" candidate_uuid: "e1ee21679c764758a302a52b2f954b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "244b85b5155e4f58a13b566c50083890"
W20260709 13:03:01.888130 11220 leader_election.cc:343] T e5a872d4022c47d4b20da810ceffb01b P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:01.888806 11467 leader_election.cc:290] T e5a872d4022c47d4b20da810ceffb01b P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 election: Requested vote from peers 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205), 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445)
I20260709 13:03:01.886194 11446 ts_tablet_manager.cc:1403] T 5efc9b8718b0461f95bd09f4b67f1197 P 770cf1ff89494e54baba82d84dac5831: Time spent bootstrapping tablet: real 0.071s	user 0.032s	sys 0.029s
I20260709 13:03:01.889079 11452 raft_consensus.cc:515] T 564b17319fe141cab611a47bf22f0b76 P 770cf1ff89494e54baba82d84dac5831 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:01.893030 11254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564b17319fe141cab611a47bf22f0b76" candidate_uuid: "770cf1ff89494e54baba82d84dac5831" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1ee21679c764758a302a52b2f954b5b"
I20260709 13:03:01.893646 11446 raft_consensus.cc:359] T 5efc9b8718b0461f95bd09f4b67f1197 P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } }
I20260709 13:03:01.894584 11444 tablet_bootstrap.cc:654] T 2893484e7ace4fd4af892dc3aa82998b P e1ee21679c764758a302a52b2f954b5b: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:01.894876 11292 leader_election.cc:343] T 564b17319fe141cab611a47bf22f0b76 P 770cf1ff89494e54baba82d84dac5831 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:01.896277 11452 leader_election.cc:290] T 564b17319fe141cab611a47bf22f0b76 P 770cf1ff89494e54baba82d84dac5831 [CANDIDATE]: Term 1 election: Requested vote from peers e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331), 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445)
I20260709 13:03:01.897260 11329 raft_consensus.cc:2468] T e5a872d4022c47d4b20da810ceffb01b P 770cf1ff89494e54baba82d84dac5831 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1ee21679c764758a302a52b2f954b5b in term 1.
I20260709 13:03:01.897746 11403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564b17319fe141cab611a47bf22f0b76" candidate_uuid: "770cf1ff89494e54baba82d84dac5831" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "244b85b5155e4f58a13b566c50083890"
I20260709 13:03:01.894932 11446 raft_consensus.cc:385] T 5efc9b8718b0461f95bd09f4b67f1197 P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:01.898437 11403 raft_consensus.cc:3060] T 564b17319fe141cab611a47bf22f0b76 P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:01.898732 11446 raft_consensus.cc:740] T 5efc9b8718b0461f95bd09f4b67f1197 P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 770cf1ff89494e54baba82d84dac5831, State: Initialized, Role: FOLLOWER
I20260709 13:03:01.898830 11217 leader_election.cc:304] T e5a872d4022c47d4b20da810ceffb01b P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 770cf1ff89494e54baba82d84dac5831, e1ee21679c764758a302a52b2f954b5b; no voters: 244b85b5155e4f58a13b566c50083890
I20260709 13:03:01.900591 11467 raft_consensus.cc:2804] T e5a872d4022c47d4b20da810ceffb01b P e1ee21679c764758a302a52b2f954b5b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:01.901669 11467 raft_consensus.cc:697] T e5a872d4022c47d4b20da810ceffb01b P e1ee21679c764758a302a52b2f954b5b [term 1 LEADER]: Becoming Leader. State: Replica: e1ee21679c764758a302a52b2f954b5b, State: Running, Role: LEADER
I20260709 13:03:01.900559 11446 consensus_queue.cc:260] T 5efc9b8718b0461f95bd09f4b67f1197 P 770cf1ff89494e54baba82d84dac5831 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } }
I20260709 13:03:01.902613 11467 consensus_queue.cc:237] T e5a872d4022c47d4b20da810ceffb01b P e1ee21679c764758a302a52b2f954b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:01.904852 11446 ts_tablet_manager.cc:1434] T 5efc9b8718b0461f95bd09f4b67f1197 P 770cf1ff89494e54baba82d84dac5831: Time spent starting tablet: real 0.015s	user 0.010s	sys 0.000s
I20260709 13:03:01.904851 11447 raft_consensus.cc:493] T b604dfd1da1840b2836273c326d4f269 P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.905841 11447 raft_consensus.cc:515] T b604dfd1da1840b2836273c326d4f269 P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:01.906769 11446 tablet_bootstrap.cc:492] T ae318533d2c141c9bef5b69d44f64d90 P 770cf1ff89494e54baba82d84dac5831: Bootstrap starting.
I20260709 13:03:01.907791 11452 raft_consensus.cc:493] T 3c7b44fee55543f58f87877c52ecfb79 P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.908708 11452 raft_consensus.cc:515] T 3c7b44fee55543f58f87877c52ecfb79 P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:01.912372 11447 leader_election.cc:290] T b604dfd1da1840b2836273c326d4f269 P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331), 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205)
I20260709 13:03:01.912734 11254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7b44fee55543f58f87877c52ecfb79" candidate_uuid: "770cf1ff89494e54baba82d84dac5831" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1ee21679c764758a302a52b2f954b5b" is_pre_election: true
I20260709 13:03:01.913219 11402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7b44fee55543f58f87877c52ecfb79" candidate_uuid: "770cf1ff89494e54baba82d84dac5831" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "244b85b5155e4f58a13b566c50083890" is_pre_election: true
I20260709 13:03:01.914263 11402 raft_consensus.cc:2468] T 3c7b44fee55543f58f87877c52ecfb79 P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 770cf1ff89494e54baba82d84dac5831 in term 0.
W20260709 13:03:01.914553 11292 leader_election.cc:343] T 3c7b44fee55543f58f87877c52ecfb79 P 770cf1ff89494e54baba82d84dac5831 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:01.912788 11452 leader_election.cc:290] T 3c7b44fee55543f58f87877c52ecfb79 P 770cf1ff89494e54baba82d84dac5831 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331), 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445)
I20260709 13:03:01.916203 11403 raft_consensus.cc:2468] T 564b17319fe141cab611a47bf22f0b76 P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 770cf1ff89494e54baba82d84dac5831 in term 1.
I20260709 13:03:01.916326 11295 leader_election.cc:304] T 3c7b44fee55543f58f87877c52ecfb79 P 770cf1ff89494e54baba82d84dac5831 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 244b85b5155e4f58a13b566c50083890, 770cf1ff89494e54baba82d84dac5831; no voters: e1ee21679c764758a302a52b2f954b5b
I20260709 13:03:01.889006 11443 consensus_queue.cc:260] T 2893484e7ace4fd4af892dc3aa82998b P 244b85b5155e4f58a13b566c50083890 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:01.919128 11295 leader_election.cc:304] T 564b17319fe141cab611a47bf22f0b76 P 770cf1ff89494e54baba82d84dac5831 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 244b85b5155e4f58a13b566c50083890, 770cf1ff89494e54baba82d84dac5831; no voters: e1ee21679c764758a302a52b2f954b5b
I20260709 13:03:01.922669 11464 raft_consensus.cc:2804] T 564b17319fe141cab611a47bf22f0b76 P 770cf1ff89494e54baba82d84dac5831 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:01.923765 11464 raft_consensus.cc:697] T 564b17319fe141cab611a47bf22f0b76 P 770cf1ff89494e54baba82d84dac5831 [term 1 LEADER]: Becoming Leader. State: Replica: 770cf1ff89494e54baba82d84dac5831, State: Running, Role: LEADER
I20260709 13:03:01.926285 11464 consensus_queue.cc:237] T 564b17319fe141cab611a47bf22f0b76 P 770cf1ff89494e54baba82d84dac5831 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:01.927623 11446 tablet_bootstrap.cc:654] T ae318533d2c141c9bef5b69d44f64d90 P 770cf1ff89494e54baba82d84dac5831: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:01.920104 11452 raft_consensus.cc:2804] T 3c7b44fee55543f58f87877c52ecfb79 P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:01.932097 11452 raft_consensus.cc:493] T 3c7b44fee55543f58f87877c52ecfb79 P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:01.932708 11452 raft_consensus.cc:3060] T 3c7b44fee55543f58f87877c52ecfb79 P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:01.921011 11443 ts_tablet_manager.cc:1434] T 2893484e7ace4fd4af892dc3aa82998b P 244b85b5155e4f58a13b566c50083890: Time spent starting tablet: real 0.050s	user 0.009s	sys 0.001s
I20260709 13:03:01.934816 11444 tablet_bootstrap.cc:492] T 2893484e7ace4fd4af892dc3aa82998b P e1ee21679c764758a302a52b2f954b5b: No bootstrap required, opened a new log
I20260709 13:03:01.937335 11444 ts_tablet_manager.cc:1403] T 2893484e7ace4fd4af892dc3aa82998b P e1ee21679c764758a302a52b2f954b5b: Time spent bootstrapping tablet: real 0.060s	user 0.016s	sys 0.005s
I20260709 13:03:01.943187 11443 tablet_bootstrap.cc:492] T e5a872d4022c47d4b20da810ceffb01b P 244b85b5155e4f58a13b566c50083890: Bootstrap starting.
I20260709 13:03:01.948424 11444 raft_consensus.cc:359] T 2893484e7ace4fd4af892dc3aa82998b P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:01.949445 11444 raft_consensus.cc:385] T 2893484e7ace4fd4af892dc3aa82998b P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:01.949790 11444 raft_consensus.cc:740] T 2893484e7ace4fd4af892dc3aa82998b P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1ee21679c764758a302a52b2f954b5b, State: Initialized, Role: FOLLOWER
I20260709 13:03:01.950650 11444 consensus_queue.cc:260] T 2893484e7ace4fd4af892dc3aa82998b P e1ee21679c764758a302a52b2f954b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:01.953868 11152 catalog_manager.cc:5697] T e5a872d4022c47d4b20da810ceffb01b P e1ee21679c764758a302a52b2f954b5b reported cstate change: term changed from 0 to 1, leader changed from <none> to e1ee21679c764758a302a52b2f954b5b (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e1ee21679c764758a302a52b2f954b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:01.957619 11467 raft_consensus.cc:493] T 90befbbddbe842949771c44d3a3ea4db P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:01.958528 11467 raft_consensus.cc:515] T 90befbbddbe842949771c44d3a3ea4db P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:01.961513 11452 raft_consensus.cc:515] T 3c7b44fee55543f58f87877c52ecfb79 P 770cf1ff89494e54baba82d84dac5831 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:01.963416 11329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90befbbddbe842949771c44d3a3ea4db" candidate_uuid: "e1ee21679c764758a302a52b2f954b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770cf1ff89494e54baba82d84dac5831" is_pre_election: true
I20260709 13:03:01.965618 11444 ts_tablet_manager.cc:1434] T 2893484e7ace4fd4af892dc3aa82998b P e1ee21679c764758a302a52b2f954b5b: Time spent starting tablet: real 0.028s	user 0.003s	sys 0.006s
I20260709 13:03:01.967070 11403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90befbbddbe842949771c44d3a3ea4db" candidate_uuid: "e1ee21679c764758a302a52b2f954b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "244b85b5155e4f58a13b566c50083890" is_pre_election: true
I20260709 13:03:01.967358 11444 tablet_bootstrap.cc:492] T 564b17319fe141cab611a47bf22f0b76 P e1ee21679c764758a302a52b2f954b5b: Bootstrap starting.
I20260709 13:03:01.968058 11403 raft_consensus.cc:2393] T 90befbbddbe842949771c44d3a3ea4db P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e1ee21679c764758a302a52b2f954b5b in current term 1: Already voted for candidate 770cf1ff89494e54baba82d84dac5831 in this term.
I20260709 13:03:01.969852 11220 leader_election.cc:304] T 90befbbddbe842949771c44d3a3ea4db P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1ee21679c764758a302a52b2f954b5b; no voters: 244b85b5155e4f58a13b566c50083890, 770cf1ff89494e54baba82d84dac5831
I20260709 13:03:01.970961 11450 raft_consensus.cc:3060] T 90befbbddbe842949771c44d3a3ea4db P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:01.976683 11467 leader_election.cc:290] T 90befbbddbe842949771c44d3a3ea4db P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205), 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445)
I20260709 13:03:01.980234 11450 raft_consensus.cc:2749] T 90befbbddbe842949771c44d3a3ea4db P e1ee21679c764758a302a52b2f954b5b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:01.984725 11254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b604dfd1da1840b2836273c326d4f269" candidate_uuid: "244b85b5155e4f58a13b566c50083890" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1ee21679c764758a302a52b2f954b5b" is_pre_election: true
I20260709 13:03:01.985661 11254 raft_consensus.cc:2468] T b604dfd1da1840b2836273c326d4f269 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 244b85b5155e4f58a13b566c50083890 in term 0.
I20260709 13:03:01.986800 11443 tablet_bootstrap.cc:654] T e5a872d4022c47d4b20da810ceffb01b P 244b85b5155e4f58a13b566c50083890: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:01.987432 11366 leader_election.cc:304] T b604dfd1da1840b2836273c326d4f269 P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 244b85b5155e4f58a13b566c50083890, e1ee21679c764758a302a52b2f954b5b; no voters: 
I20260709 13:03:01.988811 11447 raft_consensus.cc:2804] T b604dfd1da1840b2836273c326d4f269 P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:01.989305 11447 raft_consensus.cc:493] T b604dfd1da1840b2836273c326d4f269 P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:01.989732 11447 raft_consensus.cc:3060] T b604dfd1da1840b2836273c326d4f269 P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:01.991348 11452 leader_election.cc:290] T 3c7b44fee55543f58f87877c52ecfb79 P 770cf1ff89494e54baba82d84dac5831 [CANDIDATE]: Term 1 election: Requested vote from peers e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331), 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445)
I20260709 13:03:01.995177 11403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7b44fee55543f58f87877c52ecfb79" candidate_uuid: "770cf1ff89494e54baba82d84dac5831" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "244b85b5155e4f58a13b566c50083890"
I20260709 13:03:01.996275 11403 raft_consensus.cc:3060] T 3c7b44fee55543f58f87877c52ecfb79 P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:01.987198 11151 catalog_manager.cc:5697] T 564b17319fe141cab611a47bf22f0b76 P 770cf1ff89494e54baba82d84dac5831 reported cstate change: term changed from 0 to 1, leader changed from <none> to 770cf1ff89494e54baba82d84dac5831 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "770cf1ff89494e54baba82d84dac5831" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:02.000098 11443 tablet_bootstrap.cc:492] T e5a872d4022c47d4b20da810ceffb01b P 244b85b5155e4f58a13b566c50083890: No bootstrap required, opened a new log
I20260709 13:03:02.000952 11443 ts_tablet_manager.cc:1403] T e5a872d4022c47d4b20da810ceffb01b P 244b85b5155e4f58a13b566c50083890: Time spent bootstrapping tablet: real 0.058s	user 0.015s	sys 0.007s
I20260709 13:03:02.003508 11444 tablet_bootstrap.cc:654] T 564b17319fe141cab611a47bf22f0b76 P e1ee21679c764758a302a52b2f954b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:02.000970 11254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7b44fee55543f58f87877c52ecfb79" candidate_uuid: "770cf1ff89494e54baba82d84dac5831" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1ee21679c764758a302a52b2f954b5b"
I20260709 13:03:02.004920 11443 raft_consensus.cc:359] T e5a872d4022c47d4b20da810ceffb01b P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:02.005923 11443 raft_consensus.cc:385] T e5a872d4022c47d4b20da810ceffb01b P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:02.006320 11443 raft_consensus.cc:740] T e5a872d4022c47d4b20da810ceffb01b P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 244b85b5155e4f58a13b566c50083890, State: Initialized, Role: FOLLOWER
W20260709 13:03:02.006507 11292 leader_election.cc:343] T 3c7b44fee55543f58f87877c52ecfb79 P 770cf1ff89494e54baba82d84dac5831 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:02.008507 11443 consensus_queue.cc:260] T e5a872d4022c47d4b20da810ceffb01b P 244b85b5155e4f58a13b566c50083890 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:02.021658 11444 tablet_bootstrap.cc:492] T 564b17319fe141cab611a47bf22f0b76 P e1ee21679c764758a302a52b2f954b5b: No bootstrap required, opened a new log
I20260709 13:03:02.022578 11444 ts_tablet_manager.cc:1403] T 564b17319fe141cab611a47bf22f0b76 P e1ee21679c764758a302a52b2f954b5b: Time spent bootstrapping tablet: real 0.056s	user 0.019s	sys 0.003s
I20260709 13:03:02.029824 11403 raft_consensus.cc:2468] T 3c7b44fee55543f58f87877c52ecfb79 P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 770cf1ff89494e54baba82d84dac5831 in term 1.
I20260709 13:03:02.040222 11484 raft_consensus.cc:493] T 2893484e7ace4fd4af892dc3aa82998b P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.041510 11484 raft_consensus.cc:515] T 2893484e7ace4fd4af892dc3aa82998b P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:02.044912 11450 raft_consensus.cc:493] T 5efc9b8718b0461f95bd09f4b67f1197 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.045578 11450 raft_consensus.cc:515] T 5efc9b8718b0461f95bd09f4b67f1197 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } }
I20260709 13:03:02.047851 11443 ts_tablet_manager.cc:1434] T e5a872d4022c47d4b20da810ceffb01b P 244b85b5155e4f58a13b566c50083890: Time spent starting tablet: real 0.046s	user 0.017s	sys 0.016s
I20260709 13:03:02.049422 11443 tablet_bootstrap.cc:492] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 244b85b5155e4f58a13b566c50083890: Bootstrap starting.
I20260709 13:03:02.049746 11329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5efc9b8718b0461f95bd09f4b67f1197" candidate_uuid: "e1ee21679c764758a302a52b2f954b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770cf1ff89494e54baba82d84dac5831" is_pre_election: true
I20260709 13:03:02.050334 11328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b604dfd1da1840b2836273c326d4f269" candidate_uuid: "244b85b5155e4f58a13b566c50083890" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770cf1ff89494e54baba82d84dac5831" is_pre_election: true
I20260709 13:03:02.050654 11329 raft_consensus.cc:2468] T 5efc9b8718b0461f95bd09f4b67f1197 P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1ee21679c764758a302a52b2f954b5b in term 0.
I20260709 13:03:02.051759 11450 leader_election.cc:290] T 5efc9b8718b0461f95bd09f4b67f1197 P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445), 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205)
W20260709 13:03:02.052649 11366 leader_election.cc:343] T b604dfd1da1840b2836273c326d4f269 P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:02.054443 11403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5efc9b8718b0461f95bd09f4b67f1197" candidate_uuid: "e1ee21679c764758a302a52b2f954b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "244b85b5155e4f58a13b566c50083890" is_pre_election: true
I20260709 13:03:02.056114 11217 leader_election.cc:304] T 5efc9b8718b0461f95bd09f4b67f1197 P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 770cf1ff89494e54baba82d84dac5831, e1ee21679c764758a302a52b2f954b5b; no voters: 
I20260709 13:03:02.057453 11450 raft_consensus.cc:2804] T 5efc9b8718b0461f95bd09f4b67f1197 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:02.057847 11450 raft_consensus.cc:493] T 5efc9b8718b0461f95bd09f4b67f1197 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:02.058207 11450 raft_consensus.cc:3060] T 5efc9b8718b0461f95bd09f4b67f1197 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:02.058039 11444 raft_consensus.cc:359] T 564b17319fe141cab611a47bf22f0b76 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:02.059036 11443 tablet_bootstrap.cc:654] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 244b85b5155e4f58a13b566c50083890: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:02.059118 11444 raft_consensus.cc:385] T 564b17319fe141cab611a47bf22f0b76 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:03:02.059562 11220 leader_election.cc:343] T 5efc9b8718b0461f95bd09f4b67f1197 P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:02.059672 11444 raft_consensus.cc:740] T 564b17319fe141cab611a47bf22f0b76 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1ee21679c764758a302a52b2f954b5b, State: Initialized, Role: FOLLOWER
I20260709 13:03:02.056622 11447 raft_consensus.cc:515] T b604dfd1da1840b2836273c326d4f269 P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:02.064044 11254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b604dfd1da1840b2836273c326d4f269" candidate_uuid: "244b85b5155e4f58a13b566c50083890" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1ee21679c764758a302a52b2f954b5b"
I20260709 13:03:02.064908 11254 raft_consensus.cc:3060] T b604dfd1da1840b2836273c326d4f269 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:02.066085 11446 tablet_bootstrap.cc:492] T ae318533d2c141c9bef5b69d44f64d90 P 770cf1ff89494e54baba82d84dac5831: No bootstrap required, opened a new log
I20260709 13:03:02.066691 11446 ts_tablet_manager.cc:1403] T ae318533d2c141c9bef5b69d44f64d90 P 770cf1ff89494e54baba82d84dac5831: Time spent bootstrapping tablet: real 0.160s	user 0.044s	sys 0.033s
I20260709 13:03:02.067813 11253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2893484e7ace4fd4af892dc3aa82998b" candidate_uuid: "244b85b5155e4f58a13b566c50083890" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1ee21679c764758a302a52b2f954b5b" is_pre_election: true
I20260709 13:03:02.068955 11253 raft_consensus.cc:2468] T 2893484e7ace4fd4af892dc3aa82998b P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 244b85b5155e4f58a13b566c50083890 in term 0.
I20260709 13:03:02.071247 11366 leader_election.cc:304] T 2893484e7ace4fd4af892dc3aa82998b P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 244b85b5155e4f58a13b566c50083890, e1ee21679c764758a302a52b2f954b5b; no voters: 
I20260709 13:03:02.072402 11446 raft_consensus.cc:359] T ae318533d2c141c9bef5b69d44f64d90 P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:02.072781 11295 leader_election.cc:304] T 3c7b44fee55543f58f87877c52ecfb79 P 770cf1ff89494e54baba82d84dac5831 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 244b85b5155e4f58a13b566c50083890, 770cf1ff89494e54baba82d84dac5831; no voters: e1ee21679c764758a302a52b2f954b5b
I20260709 13:03:02.073312 11446 raft_consensus.cc:385] T ae318533d2c141c9bef5b69d44f64d90 P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:02.073794 11446 raft_consensus.cc:740] T ae318533d2c141c9bef5b69d44f64d90 P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 770cf1ff89494e54baba82d84dac5831, State: Initialized, Role: FOLLOWER
I20260709 13:03:02.074635 11452 raft_consensus.cc:2804] T 3c7b44fee55543f58f87877c52ecfb79 P 770cf1ff89494e54baba82d84dac5831 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:02.074579 11446 consensus_queue.cc:260] T ae318533d2c141c9bef5b69d44f64d90 P 770cf1ff89494e54baba82d84dac5831 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:02.075441 11452 raft_consensus.cc:697] T 3c7b44fee55543f58f87877c52ecfb79 P 770cf1ff89494e54baba82d84dac5831 [term 1 LEADER]: Becoming Leader. State: Replica: 770cf1ff89494e54baba82d84dac5831, State: Running, Role: LEADER
I20260709 13:03:02.076895 11446 ts_tablet_manager.cc:1434] T ae318533d2c141c9bef5b69d44f64d90 P 770cf1ff89494e54baba82d84dac5831: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.002s
I20260709 13:03:02.076429 11452 consensus_queue.cc:237] T 3c7b44fee55543f58f87877c52ecfb79 P 770cf1ff89494e54baba82d84dac5831 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:02.078045 11446 tablet_bootstrap.cc:492] T 2893484e7ace4fd4af892dc3aa82998b P 770cf1ff89494e54baba82d84dac5831: Bootstrap starting.
I20260709 13:03:02.073004 11485 raft_consensus.cc:2804] T 2893484e7ace4fd4af892dc3aa82998b P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:02.084856 11328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b604dfd1da1840b2836273c326d4f269" candidate_uuid: "244b85b5155e4f58a13b566c50083890" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770cf1ff89494e54baba82d84dac5831"
I20260709 13:03:02.085716 11446 tablet_bootstrap.cc:654] T 2893484e7ace4fd4af892dc3aa82998b P 770cf1ff89494e54baba82d84dac5831: Neither blocks nor log segments found. Creating new log.
W20260709 13:03:02.086660 11366 leader_election.cc:343] T b604dfd1da1840b2836273c326d4f269 P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:02.087291 11328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2893484e7ace4fd4af892dc3aa82998b" candidate_uuid: "244b85b5155e4f58a13b566c50083890" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770cf1ff89494e54baba82d84dac5831" is_pre_election: true
I20260709 13:03:02.088676 11447 leader_election.cc:290] T b604dfd1da1840b2836273c326d4f269 P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 1 election: Requested vote from peers e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331), 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205)
W20260709 13:03:02.089178 11366 leader_election.cc:343] T 2893484e7ace4fd4af892dc3aa82998b P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:02.089563 11484 leader_election.cc:290] T 2893484e7ace4fd4af892dc3aa82998b P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331), 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205)
I20260709 13:03:02.084795 11485 raft_consensus.cc:493] T 2893484e7ace4fd4af892dc3aa82998b P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:02.090762 11485 raft_consensus.cc:3060] T 2893484e7ace4fd4af892dc3aa82998b P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:02.088094 11444 consensus_queue.cc:260] T 564b17319fe141cab611a47bf22f0b76 P e1ee21679c764758a302a52b2f954b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:02.077653 11254 raft_consensus.cc:2468] T b604dfd1da1840b2836273c326d4f269 P e1ee21679c764758a302a52b2f954b5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 244b85b5155e4f58a13b566c50083890 in term 1.
I20260709 13:03:02.099256 11366 leader_election.cc:304] T b604dfd1da1840b2836273c326d4f269 P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 244b85b5155e4f58a13b566c50083890, e1ee21679c764758a302a52b2f954b5b; no voters: 770cf1ff89494e54baba82d84dac5831
I20260709 13:03:02.101552 11450 raft_consensus.cc:515] T 5efc9b8718b0461f95bd09f4b67f1197 P e1ee21679c764758a302a52b2f954b5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } }
I20260709 13:03:02.105795 11328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5efc9b8718b0461f95bd09f4b67f1197" candidate_uuid: "e1ee21679c764758a302a52b2f954b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770cf1ff89494e54baba82d84dac5831"
I20260709 13:03:02.105795 11403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5efc9b8718b0461f95bd09f4b67f1197" candidate_uuid: "e1ee21679c764758a302a52b2f954b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "244b85b5155e4f58a13b566c50083890"
I20260709 13:03:02.106611 11328 raft_consensus.cc:3060] T 5efc9b8718b0461f95bd09f4b67f1197 P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:02.107568 11220 leader_election.cc:343] T 5efc9b8718b0461f95bd09f4b67f1197 P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:02.108035 11444 ts_tablet_manager.cc:1434] T 564b17319fe141cab611a47bf22f0b76 P e1ee21679c764758a302a52b2f954b5b: Time spent starting tablet: real 0.085s	user 0.008s	sys 0.003s
I20260709 13:03:02.121115 11149 catalog_manager.cc:5697] T 3c7b44fee55543f58f87877c52ecfb79 P 770cf1ff89494e54baba82d84dac5831 reported cstate change: term changed from 0 to 1, leader changed from <none> to 770cf1ff89494e54baba82d84dac5831 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "770cf1ff89494e54baba82d84dac5831" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:02.126221 11484 raft_consensus.cc:2804] T b604dfd1da1840b2836273c326d4f269 P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:02.132227 11444 tablet_bootstrap.cc:492] T ae318533d2c141c9bef5b69d44f64d90 P e1ee21679c764758a302a52b2f954b5b: Bootstrap starting.
I20260709 13:03:02.139492 11443 tablet_bootstrap.cc:492] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 244b85b5155e4f58a13b566c50083890: No bootstrap required, opened a new log
I20260709 13:03:02.140338 11443 ts_tablet_manager.cc:1403] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 244b85b5155e4f58a13b566c50083890: Time spent bootstrapping tablet: real 0.091s	user 0.027s	sys 0.058s
I20260709 13:03:02.140571 11446 tablet_bootstrap.cc:492] T 2893484e7ace4fd4af892dc3aa82998b P 770cf1ff89494e54baba82d84dac5831: No bootstrap required, opened a new log
I20260709 13:03:02.141162 11446 ts_tablet_manager.cc:1403] T 2893484e7ace4fd4af892dc3aa82998b P 770cf1ff89494e54baba82d84dac5831: Time spent bootstrapping tablet: real 0.063s	user 0.027s	sys 0.031s
I20260709 13:03:02.144402 11443 raft_consensus.cc:359] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:02.144743 11446 raft_consensus.cc:359] T 2893484e7ace4fd4af892dc3aa82998b P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:02.145573 11443 raft_consensus.cc:385] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:02.145653 11444 tablet_bootstrap.cc:654] T ae318533d2c141c9bef5b69d44f64d90 P e1ee21679c764758a302a52b2f954b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:02.145599 11446 raft_consensus.cc:385] T 2893484e7ace4fd4af892dc3aa82998b P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:02.146356 11443 raft_consensus.cc:740] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 244b85b5155e4f58a13b566c50083890, State: Initialized, Role: FOLLOWER
I20260709 13:03:02.146404 11446 raft_consensus.cc:740] T 2893484e7ace4fd4af892dc3aa82998b P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 770cf1ff89494e54baba82d84dac5831, State: Initialized, Role: FOLLOWER
I20260709 13:03:02.147789 11446 consensus_queue.cc:260] T 2893484e7ace4fd4af892dc3aa82998b P 770cf1ff89494e54baba82d84dac5831 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:02.147802 11443 consensus_queue.cc:260] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 244b85b5155e4f58a13b566c50083890 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:02.149144 11484 raft_consensus.cc:697] T b604dfd1da1840b2836273c326d4f269 P 244b85b5155e4f58a13b566c50083890 [term 1 LEADER]: Becoming Leader. State: Replica: 244b85b5155e4f58a13b566c50083890, State: Running, Role: LEADER
I20260709 13:03:02.150430 11446 ts_tablet_manager.cc:1434] T 2893484e7ace4fd4af892dc3aa82998b P 770cf1ff89494e54baba82d84dac5831: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:03:02.151367 11443 ts_tablet_manager.cc:1434] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 244b85b5155e4f58a13b566c50083890: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.005s
I20260709 13:03:02.151787 11446 tablet_bootstrap.cc:492] T b604dfd1da1840b2836273c326d4f269 P 770cf1ff89494e54baba82d84dac5831: Bootstrap starting.
I20260709 13:03:02.151928 11328 raft_consensus.cc:2468] T 5efc9b8718b0461f95bd09f4b67f1197 P 770cf1ff89494e54baba82d84dac5831 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1ee21679c764758a302a52b2f954b5b in term 1.
I20260709 13:03:02.152757 11443 tablet_bootstrap.cc:492] T 5efc9b8718b0461f95bd09f4b67f1197 P 244b85b5155e4f58a13b566c50083890: Bootstrap starting.
I20260709 13:03:02.153312 11217 leader_election.cc:304] T 5efc9b8718b0461f95bd09f4b67f1197 P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 770cf1ff89494e54baba82d84dac5831, e1ee21679c764758a302a52b2f954b5b; no voters: 244b85b5155e4f58a13b566c50083890
I20260709 13:03:02.154263 11450 leader_election.cc:290] T 5efc9b8718b0461f95bd09f4b67f1197 P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 election: Requested vote from peers 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445), 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205)
I20260709 13:03:02.155372 11450 raft_consensus.cc:2804] T 5efc9b8718b0461f95bd09f4b67f1197 P e1ee21679c764758a302a52b2f954b5b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:02.150373 11484 consensus_queue.cc:237] T b604dfd1da1840b2836273c326d4f269 P 244b85b5155e4f58a13b566c50083890 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:02.162946 11446 tablet_bootstrap.cc:654] T b604dfd1da1840b2836273c326d4f269 P 770cf1ff89494e54baba82d84dac5831: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:02.157786 11485 raft_consensus.cc:515] T 2893484e7ace4fd4af892dc3aa82998b P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:02.166020 11444 tablet_bootstrap.cc:492] T ae318533d2c141c9bef5b69d44f64d90 P e1ee21679c764758a302a52b2f954b5b: No bootstrap required, opened a new log
I20260709 13:03:02.166760 11444 ts_tablet_manager.cc:1403] T ae318533d2c141c9bef5b69d44f64d90 P e1ee21679c764758a302a52b2f954b5b: Time spent bootstrapping tablet: real 0.035s	user 0.021s	sys 0.000s
I20260709 13:03:02.162621 11443 tablet_bootstrap.cc:654] T 5efc9b8718b0461f95bd09f4b67f1197 P 244b85b5155e4f58a13b566c50083890: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:02.168830 11254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2893484e7ace4fd4af892dc3aa82998b" candidate_uuid: "244b85b5155e4f58a13b566c50083890" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1ee21679c764758a302a52b2f954b5b"
I20260709 13:03:02.169852 11254 raft_consensus.cc:3060] T 2893484e7ace4fd4af892dc3aa82998b P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:02.170801 11444 raft_consensus.cc:359] T ae318533d2c141c9bef5b69d44f64d90 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:02.171686 11444 raft_consensus.cc:385] T ae318533d2c141c9bef5b69d44f64d90 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:02.172065 11444 raft_consensus.cc:740] T ae318533d2c141c9bef5b69d44f64d90 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1ee21679c764758a302a52b2f954b5b, State: Initialized, Role: FOLLOWER
I20260709 13:03:02.162803 11450 raft_consensus.cc:697] T 5efc9b8718b0461f95bd09f4b67f1197 P e1ee21679c764758a302a52b2f954b5b [term 1 LEADER]: Becoming Leader. State: Replica: e1ee21679c764758a302a52b2f954b5b, State: Running, Role: LEADER
I20260709 13:03:02.173349 11444 consensus_queue.cc:260] T ae318533d2c141c9bef5b69d44f64d90 P e1ee21679c764758a302a52b2f954b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:02.173920 11450 consensus_queue.cc:237] T 5efc9b8718b0461f95bd09f4b67f1197 P e1ee21679c764758a302a52b2f954b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } }
I20260709 13:03:02.176352 11444 ts_tablet_manager.cc:1434] T ae318533d2c141c9bef5b69d44f64d90 P e1ee21679c764758a302a52b2f954b5b: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:03:02.177886 11444 tablet_bootstrap.cc:492] T 3c7b44fee55543f58f87877c52ecfb79 P e1ee21679c764758a302a52b2f954b5b: Bootstrap starting.
I20260709 13:03:02.182934 11485 leader_election.cc:290] T 2893484e7ace4fd4af892dc3aa82998b P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 1 election: Requested vote from peers e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331), 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205)
I20260709 13:03:02.185451 11328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2893484e7ace4fd4af892dc3aa82998b" candidate_uuid: "244b85b5155e4f58a13b566c50083890" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770cf1ff89494e54baba82d84dac5831"
I20260709 13:03:02.186295 11328 raft_consensus.cc:3060] T 2893484e7ace4fd4af892dc3aa82998b P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:02.188244 11444 tablet_bootstrap.cc:654] T 3c7b44fee55543f58f87877c52ecfb79 P e1ee21679c764758a302a52b2f954b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:02.196003 11254 raft_consensus.cc:2468] T 2893484e7ace4fd4af892dc3aa82998b P e1ee21679c764758a302a52b2f954b5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 244b85b5155e4f58a13b566c50083890 in term 1.
I20260709 13:03:02.202272 11149 catalog_manager.cc:5697] T b604dfd1da1840b2836273c326d4f269 P 244b85b5155e4f58a13b566c50083890 reported cstate change: term changed from 0 to 1, leader changed from <none> to 244b85b5155e4f58a13b566c50083890 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "244b85b5155e4f58a13b566c50083890" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:02.203851 11366 leader_election.cc:304] T 2893484e7ace4fd4af892dc3aa82998b P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 244b85b5155e4f58a13b566c50083890, e1ee21679c764758a302a52b2f954b5b; no voters: 
I20260709 13:03:02.204908 11485 raft_consensus.cc:2804] T 2893484e7ace4fd4af892dc3aa82998b P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:02.205227 11443 tablet_bootstrap.cc:492] T 5efc9b8718b0461f95bd09f4b67f1197 P 244b85b5155e4f58a13b566c50083890: No bootstrap required, opened a new log
I20260709 13:03:02.205804 11443 ts_tablet_manager.cc:1403] T 5efc9b8718b0461f95bd09f4b67f1197 P 244b85b5155e4f58a13b566c50083890: Time spent bootstrapping tablet: real 0.053s	user 0.012s	sys 0.013s
I20260709 13:03:02.205440 11485 raft_consensus.cc:697] T 2893484e7ace4fd4af892dc3aa82998b P 244b85b5155e4f58a13b566c50083890 [term 1 LEADER]: Becoming Leader. State: Replica: 244b85b5155e4f58a13b566c50083890, State: Running, Role: LEADER
I20260709 13:03:02.209163 11443 raft_consensus.cc:359] T 5efc9b8718b0461f95bd09f4b67f1197 P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } }
I20260709 13:03:02.209244 11485 consensus_queue.cc:237] T 2893484e7ace4fd4af892dc3aa82998b P 244b85b5155e4f58a13b566c50083890 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:02.209986 11443 raft_consensus.cc:385] T 5efc9b8718b0461f95bd09f4b67f1197 P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:02.210309 11443 raft_consensus.cc:740] T 5efc9b8718b0461f95bd09f4b67f1197 P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 244b85b5155e4f58a13b566c50083890, State: Initialized, Role: FOLLOWER
I20260709 13:03:02.203984 11446 tablet_bootstrap.cc:492] T b604dfd1da1840b2836273c326d4f269 P 770cf1ff89494e54baba82d84dac5831: No bootstrap required, opened a new log
I20260709 13:03:02.211295 11446 ts_tablet_manager.cc:1403] T b604dfd1da1840b2836273c326d4f269 P 770cf1ff89494e54baba82d84dac5831: Time spent bootstrapping tablet: real 0.060s	user 0.009s	sys 0.019s
I20260709 13:03:02.214674 11446 raft_consensus.cc:359] T b604dfd1da1840b2836273c326d4f269 P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:02.215855 11446 raft_consensus.cc:385] T b604dfd1da1840b2836273c326d4f269 P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:02.216233 11446 raft_consensus.cc:740] T b604dfd1da1840b2836273c326d4f269 P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 770cf1ff89494e54baba82d84dac5831, State: Initialized, Role: FOLLOWER
I20260709 13:03:02.217298 11446 consensus_queue.cc:260] T b604dfd1da1840b2836273c326d4f269 P 770cf1ff89494e54baba82d84dac5831 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:02.219796 11446 ts_tablet_manager.cc:1434] T b604dfd1da1840b2836273c326d4f269 P 770cf1ff89494e54baba82d84dac5831: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:03:02.221827 11446 tablet_bootstrap.cc:492] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 770cf1ff89494e54baba82d84dac5831: Bootstrap starting.
I20260709 13:03:02.226469 11467 raft_consensus.cc:493] T ae318533d2c141c9bef5b69d44f64d90 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.227139 11467 raft_consensus.cc:515] T ae318533d2c141c9bef5b69d44f64d90 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:02.229481 11446 tablet_bootstrap.cc:654] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 770cf1ff89494e54baba82d84dac5831: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:02.230553 11467 leader_election.cc:290] T ae318533d2c141c9bef5b69d44f64d90 P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205), 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445)
I20260709 13:03:02.220364 11443 consensus_queue.cc:260] T 5efc9b8718b0461f95bd09f4b67f1197 P 244b85b5155e4f58a13b566c50083890 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } }
I20260709 13:03:02.233213 11403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae318533d2c141c9bef5b69d44f64d90" candidate_uuid: "e1ee21679c764758a302a52b2f954b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "244b85b5155e4f58a13b566c50083890" is_pre_election: true
I20260709 13:03:02.235186 11443 ts_tablet_manager.cc:1434] T 5efc9b8718b0461f95bd09f4b67f1197 P 244b85b5155e4f58a13b566c50083890: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.004s
I20260709 13:03:02.232033 11329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae318533d2c141c9bef5b69d44f64d90" candidate_uuid: "e1ee21679c764758a302a52b2f954b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770cf1ff89494e54baba82d84dac5831" is_pre_election: true
W20260709 13:03:02.235919 11220 leader_election.cc:343] T ae318533d2c141c9bef5b69d44f64d90 P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:02.236418 11443 tablet_bootstrap.cc:492] T ae318533d2c141c9bef5b69d44f64d90 P 244b85b5155e4f58a13b566c50083890: Bootstrap starting.
I20260709 13:03:02.236670 11329 raft_consensus.cc:2468] T ae318533d2c141c9bef5b69d44f64d90 P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1ee21679c764758a302a52b2f954b5b in term 0.
I20260709 13:03:02.238850 11217 leader_election.cc:304] T ae318533d2c141c9bef5b69d44f64d90 P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 770cf1ff89494e54baba82d84dac5831, e1ee21679c764758a302a52b2f954b5b; no voters: 244b85b5155e4f58a13b566c50083890
I20260709 13:03:02.240208 11473 raft_consensus.cc:493] T 564b17319fe141cab611a47bf22f0b76 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.240785 11473 raft_consensus.cc:515] T 564b17319fe141cab611a47bf22f0b76 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:02.243310 11473 leader_election.cc:290] T 564b17319fe141cab611a47bf22f0b76 P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205), 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445)
I20260709 13:03:02.243880 11473 raft_consensus.cc:2804] T ae318533d2c141c9bef5b69d44f64d90 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:02.244238 11473 raft_consensus.cc:493] T ae318533d2c141c9bef5b69d44f64d90 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:02.247192 11473 raft_consensus.cc:3060] T ae318533d2c141c9bef5b69d44f64d90 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:02.246040 11403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564b17319fe141cab611a47bf22f0b76" candidate_uuid: "e1ee21679c764758a302a52b2f954b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "244b85b5155e4f58a13b566c50083890" is_pre_election: true
I20260709 13:03:02.248124 11329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "564b17319fe141cab611a47bf22f0b76" candidate_uuid: "e1ee21679c764758a302a52b2f954b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770cf1ff89494e54baba82d84dac5831" is_pre_election: true
I20260709 13:03:02.249289 11403 raft_consensus.cc:2393] T 564b17319fe141cab611a47bf22f0b76 P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e1ee21679c764758a302a52b2f954b5b in current term 1: Already voted for candidate 770cf1ff89494e54baba82d84dac5831 in this term.
I20260709 13:03:02.249444 11328 raft_consensus.cc:2468] T 2893484e7ace4fd4af892dc3aa82998b P 770cf1ff89494e54baba82d84dac5831 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 244b85b5155e4f58a13b566c50083890 in term 1.
I20260709 13:03:02.251410 11217 leader_election.cc:304] T 564b17319fe141cab611a47bf22f0b76 P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1ee21679c764758a302a52b2f954b5b; no voters: 244b85b5155e4f58a13b566c50083890, 770cf1ff89494e54baba82d84dac5831
I20260709 13:03:02.267623 11467 raft_consensus.cc:3060] T 564b17319fe141cab611a47bf22f0b76 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:02.269228 11446 tablet_bootstrap.cc:492] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 770cf1ff89494e54baba82d84dac5831: No bootstrap required, opened a new log
I20260709 13:03:02.269873 11446 ts_tablet_manager.cc:1403] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 770cf1ff89494e54baba82d84dac5831: Time spent bootstrapping tablet: real 0.048s	user 0.010s	sys 0.002s
I20260709 13:03:02.271924 11149 catalog_manager.cc:5697] T 2893484e7ace4fd4af892dc3aa82998b P 244b85b5155e4f58a13b566c50083890 reported cstate change: term changed from 0 to 1, leader changed from <none> to 244b85b5155e4f58a13b566c50083890 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "244b85b5155e4f58a13b566c50083890" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:02.264312 11452 raft_consensus.cc:493] T b604dfd1da1840b2836273c326d4f269 P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.274219 11452 raft_consensus.cc:515] T b604dfd1da1840b2836273c326d4f269 P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:02.277626 11467 raft_consensus.cc:2749] T 564b17319fe141cab611a47bf22f0b76 P e1ee21679c764758a302a52b2f954b5b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:02.264986 11151 catalog_manager.cc:5697] T 5efc9b8718b0461f95bd09f4b67f1197 P e1ee21679c764758a302a52b2f954b5b reported cstate change: term changed from 0 to 1, leader changed from <none> to e1ee21679c764758a302a52b2f954b5b (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e1ee21679c764758a302a52b2f954b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:02.265888 11443 tablet_bootstrap.cc:654] T ae318533d2c141c9bef5b69d44f64d90 P 244b85b5155e4f58a13b566c50083890: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:02.262944 11473 raft_consensus.cc:515] T ae318533d2c141c9bef5b69d44f64d90 P e1ee21679c764758a302a52b2f954b5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:02.278302 11403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b604dfd1da1840b2836273c326d4f269" candidate_uuid: "770cf1ff89494e54baba82d84dac5831" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "244b85b5155e4f58a13b566c50083890" is_pre_election: true
I20260709 13:03:02.284380 11473 leader_election.cc:290] T ae318533d2c141c9bef5b69d44f64d90 P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 election: Requested vote from peers 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205), 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445)
I20260709 13:03:02.286528 11403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae318533d2c141c9bef5b69d44f64d90" candidate_uuid: "e1ee21679c764758a302a52b2f954b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "244b85b5155e4f58a13b566c50083890"
W20260709 13:03:02.288304 11220 leader_election.cc:343] T ae318533d2c141c9bef5b69d44f64d90 P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:02.289007 11452 leader_election.cc:290] T b604dfd1da1840b2836273c326d4f269 P 770cf1ff89494e54baba82d84dac5831 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331), 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445)
I20260709 13:03:02.289994 11444 tablet_bootstrap.cc:492] T 3c7b44fee55543f58f87877c52ecfb79 P e1ee21679c764758a302a52b2f954b5b: No bootstrap required, opened a new log
I20260709 13:03:02.289948 11328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae318533d2c141c9bef5b69d44f64d90" candidate_uuid: "e1ee21679c764758a302a52b2f954b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770cf1ff89494e54baba82d84dac5831"
I20260709 13:03:02.290696 11328 raft_consensus.cc:3060] T ae318533d2c141c9bef5b69d44f64d90 P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:02.290699 11444 ts_tablet_manager.cc:1403] T 3c7b44fee55543f58f87877c52ecfb79 P e1ee21679c764758a302a52b2f954b5b: Time spent bootstrapping tablet: real 0.113s	user 0.037s	sys 0.063s
I20260709 13:03:02.293136 11254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b604dfd1da1840b2836273c326d4f269" candidate_uuid: "770cf1ff89494e54baba82d84dac5831" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1ee21679c764758a302a52b2f954b5b" is_pre_election: true
I20260709 13:03:02.294315 11254 raft_consensus.cc:2393] T b604dfd1da1840b2836273c326d4f269 P e1ee21679c764758a302a52b2f954b5b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 770cf1ff89494e54baba82d84dac5831 in current term 1: Already voted for candidate 244b85b5155e4f58a13b566c50083890 in this term.
I20260709 13:03:02.294464 11444 raft_consensus.cc:359] T 3c7b44fee55543f58f87877c52ecfb79 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:02.295406 11444 raft_consensus.cc:385] T 3c7b44fee55543f58f87877c52ecfb79 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:02.295758 11444 raft_consensus.cc:740] T 3c7b44fee55543f58f87877c52ecfb79 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1ee21679c764758a302a52b2f954b5b, State: Initialized, Role: FOLLOWER
I20260709 13:03:02.273165 11446 raft_consensus.cc:359] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:02.296190 11292 leader_election.cc:304] T b604dfd1da1840b2836273c326d4f269 P 770cf1ff89494e54baba82d84dac5831 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 770cf1ff89494e54baba82d84dac5831; no voters: 244b85b5155e4f58a13b566c50083890, e1ee21679c764758a302a52b2f954b5b
I20260709 13:03:02.296679 11446 raft_consensus.cc:385] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:02.296772 11444 consensus_queue.cc:260] T 3c7b44fee55543f58f87877c52ecfb79 P e1ee21679c764758a302a52b2f954b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:02.297606 11446 raft_consensus.cc:740] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 770cf1ff89494e54baba82d84dac5831, State: Initialized, Role: FOLLOWER
I20260709 13:03:02.297968 11452 raft_consensus.cc:3060] T b604dfd1da1840b2836273c326d4f269 P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:02.299964 11444 ts_tablet_manager.cc:1434] T 3c7b44fee55543f58f87877c52ecfb79 P e1ee21679c764758a302a52b2f954b5b: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 13:03:02.299965 11446 consensus_queue.cc:260] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 770cf1ff89494e54baba82d84dac5831 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:02.304419 11443 tablet_bootstrap.cc:492] T ae318533d2c141c9bef5b69d44f64d90 P 244b85b5155e4f58a13b566c50083890: No bootstrap required, opened a new log
I20260709 13:03:02.305233 11443 ts_tablet_manager.cc:1403] T ae318533d2c141c9bef5b69d44f64d90 P 244b85b5155e4f58a13b566c50083890: Time spent bootstrapping tablet: real 0.069s	user 0.007s	sys 0.010s
I20260709 13:03:02.307282 11446 ts_tablet_manager.cc:1434] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 770cf1ff89494e54baba82d84dac5831: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.002s
I20260709 13:03:02.308799 11443 raft_consensus.cc:359] T ae318533d2c141c9bef5b69d44f64d90 P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:02.309887 11443 raft_consensus.cc:385] T ae318533d2c141c9bef5b69d44f64d90 P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:02.310295 11443 raft_consensus.cc:740] T ae318533d2c141c9bef5b69d44f64d90 P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 244b85b5155e4f58a13b566c50083890, State: Initialized, Role: FOLLOWER
I20260709 13:03:02.311214 11443 consensus_queue.cc:260] T ae318533d2c141c9bef5b69d44f64d90 P 244b85b5155e4f58a13b566c50083890 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:02.315433 11452 raft_consensus.cc:2749] T b604dfd1da1840b2836273c326d4f269 P 770cf1ff89494e54baba82d84dac5831 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:02.315629 11473 consensus_queue.cc:1048] T e5a872d4022c47d4b20da810ceffb01b P e1ee21679c764758a302a52b2f954b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:02.318728 11328 raft_consensus.cc:2468] T ae318533d2c141c9bef5b69d44f64d90 P 770cf1ff89494e54baba82d84dac5831 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1ee21679c764758a302a52b2f954b5b in term 1.
I20260709 13:03:02.320472 11217 leader_election.cc:304] T ae318533d2c141c9bef5b69d44f64d90 P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 770cf1ff89494e54baba82d84dac5831, e1ee21679c764758a302a52b2f954b5b; no voters: 244b85b5155e4f58a13b566c50083890
I20260709 13:03:02.321017 11443 ts_tablet_manager.cc:1434] T ae318533d2c141c9bef5b69d44f64d90 P 244b85b5155e4f58a13b566c50083890: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.002s
I20260709 13:03:02.321758 11473 raft_consensus.cc:2804] T ae318533d2c141c9bef5b69d44f64d90 P e1ee21679c764758a302a52b2f954b5b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:02.322376 11473 raft_consensus.cc:697] T ae318533d2c141c9bef5b69d44f64d90 P e1ee21679c764758a302a52b2f954b5b [term 1 LEADER]: Becoming Leader. State: Replica: e1ee21679c764758a302a52b2f954b5b, State: Running, Role: LEADER
I20260709 13:03:02.323258 11473 consensus_queue.cc:237] T ae318533d2c141c9bef5b69d44f64d90 P e1ee21679c764758a302a52b2f954b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:02.345816 11403 raft_consensus.cc:3060] T e5a872d4022c47d4b20da810ceffb01b P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:02.349009 11149 catalog_manager.cc:5697] T ae318533d2c141c9bef5b69d44f64d90 P e1ee21679c764758a302a52b2f954b5b reported cstate change: term changed from 0 to 1, leader changed from <none> to e1ee21679c764758a302a52b2f954b5b (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e1ee21679c764758a302a52b2f954b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:02.356747 11467 consensus_queue.cc:1048] T e5a872d4022c47d4b20da810ceffb01b P e1ee21679c764758a302a52b2f954b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:02.375253 11452 consensus_queue.cc:1048] T 564b17319fe141cab611a47bf22f0b76 P 770cf1ff89494e54baba82d84dac5831 [LEADER]: Connected to new peer: Peer: permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:02.388686 11463 consensus_queue.cc:1048] T 564b17319fe141cab611a47bf22f0b76 P 770cf1ff89494e54baba82d84dac5831 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:02.430881 11464 consensus_queue.cc:1048] T 90befbbddbe842949771c44d3a3ea4db P 770cf1ff89494e54baba82d84dac5831 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:02.443202 11463 consensus_queue.cc:1048] T 90befbbddbe842949771c44d3a3ea4db P 770cf1ff89494e54baba82d84dac5831 [LEADER]: Connected to new peer: Peer: permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:02.473067 11467 raft_consensus.cc:493] T 3c7b44fee55543f58f87877c52ecfb79 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.473729 11467 raft_consensus.cc:515] T 3c7b44fee55543f58f87877c52ecfb79 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:02.475657 11467 leader_election.cc:290] T 3c7b44fee55543f58f87877c52ecfb79 P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205), 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445)
I20260709 13:03:02.476886 11327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7b44fee55543f58f87877c52ecfb79" candidate_uuid: "e1ee21679c764758a302a52b2f954b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770cf1ff89494e54baba82d84dac5831" is_pre_election: true
I20260709 13:03:02.477035 11403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7b44fee55543f58f87877c52ecfb79" candidate_uuid: "e1ee21679c764758a302a52b2f954b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "244b85b5155e4f58a13b566c50083890" is_pre_election: true
I20260709 13:03:02.477905 11403 raft_consensus.cc:2393] T 3c7b44fee55543f58f87877c52ecfb79 P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e1ee21679c764758a302a52b2f954b5b in current term 1: Already voted for candidate 770cf1ff89494e54baba82d84dac5831 in this term.
I20260709 13:03:02.478966 11220 leader_election.cc:304] T 3c7b44fee55543f58f87877c52ecfb79 P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1ee21679c764758a302a52b2f954b5b; no voters: 244b85b5155e4f58a13b566c50083890, 770cf1ff89494e54baba82d84dac5831
I20260709 13:03:02.479800 11467 raft_consensus.cc:3060] T 3c7b44fee55543f58f87877c52ecfb79 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:02.486127 11467 raft_consensus.cc:2749] T 3c7b44fee55543f58f87877c52ecfb79 P e1ee21679c764758a302a52b2f954b5b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:02.519173 11485 raft_consensus.cc:493] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.519887 11485 raft_consensus.cc:515] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:02.521625 11485 leader_election.cc:290] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331), 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205)
I20260709 13:03:02.522650 11254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "560d3cdf923a4ab1b6d9f0747f8c40bf" candidate_uuid: "244b85b5155e4f58a13b566c50083890" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1ee21679c764758a302a52b2f954b5b" is_pre_election: true
I20260709 13:03:02.522886 11327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "560d3cdf923a4ab1b6d9f0747f8c40bf" candidate_uuid: "244b85b5155e4f58a13b566c50083890" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770cf1ff89494e54baba82d84dac5831" is_pre_election: true
I20260709 13:03:02.523473 11254 raft_consensus.cc:2468] T 560d3cdf923a4ab1b6d9f0747f8c40bf P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 244b85b5155e4f58a13b566c50083890 in term 0.
I20260709 13:03:02.523473 11327 raft_consensus.cc:2468] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 244b85b5155e4f58a13b566c50083890 in term 0.
I20260709 13:03:02.524895 11366 leader_election.cc:304] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 244b85b5155e4f58a13b566c50083890, e1ee21679c764758a302a52b2f954b5b; no voters: 
I20260709 13:03:02.525518 11485 raft_consensus.cc:2804] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:02.525926 11485 raft_consensus.cc:493] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:02.526233 11485 raft_consensus.cc:3060] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:02.531325 11485 raft_consensus.cc:515] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:02.533349 11485 leader_election.cc:290] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 1 election: Requested vote from peers e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331), 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205)
I20260709 13:03:02.534147 11254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "560d3cdf923a4ab1b6d9f0747f8c40bf" candidate_uuid: "244b85b5155e4f58a13b566c50083890" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1ee21679c764758a302a52b2f954b5b"
I20260709 13:03:02.534564 11327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "560d3cdf923a4ab1b6d9f0747f8c40bf" candidate_uuid: "244b85b5155e4f58a13b566c50083890" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770cf1ff89494e54baba82d84dac5831"
I20260709 13:03:02.534896 11254 raft_consensus.cc:3060] T 560d3cdf923a4ab1b6d9f0747f8c40bf P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:02.535229 11327 raft_consensus.cc:3060] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:02.538440 11463 consensus_queue.cc:1048] T 3c7b44fee55543f58f87877c52ecfb79 P 770cf1ff89494e54baba82d84dac5831 [LEADER]: Connected to new peer: Peer: permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:02.543306 11327 raft_consensus.cc:2468] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 770cf1ff89494e54baba82d84dac5831 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 244b85b5155e4f58a13b566c50083890 in term 1.
I20260709 13:03:02.543525 11254 raft_consensus.cc:2468] T 560d3cdf923a4ab1b6d9f0747f8c40bf P e1ee21679c764758a302a52b2f954b5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 244b85b5155e4f58a13b566c50083890 in term 1.
I20260709 13:03:02.544704 11366 leader_election.cc:304] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 244b85b5155e4f58a13b566c50083890, e1ee21679c764758a302a52b2f954b5b; no voters: 
I20260709 13:03:02.545615 11485 raft_consensus.cc:2804] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:02.546120 11485 raft_consensus.cc:697] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 244b85b5155e4f58a13b566c50083890 [term 1 LEADER]: Becoming Leader. State: Replica: 244b85b5155e4f58a13b566c50083890, State: Running, Role: LEADER
I20260709 13:03:02.547025 11485 consensus_queue.cc:237] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 244b85b5155e4f58a13b566c50083890 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:02.548763 11484 raft_consensus.cc:493] T 5efc9b8718b0461f95bd09f4b67f1197 P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.549320 11484 raft_consensus.cc:515] T 5efc9b8718b0461f95bd09f4b67f1197 P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } }
I20260709 13:03:02.551461 11484 leader_election.cc:290] T 5efc9b8718b0461f95bd09f4b67f1197 P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205), e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331)
I20260709 13:03:02.554276 11464 consensus_queue.cc:1048] T 3c7b44fee55543f58f87877c52ecfb79 P 770cf1ff89494e54baba82d84dac5831 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:02.555524 11254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5efc9b8718b0461f95bd09f4b67f1197" candidate_uuid: "244b85b5155e4f58a13b566c50083890" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1ee21679c764758a302a52b2f954b5b" is_pre_election: true
I20260709 13:03:02.557601 11327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5efc9b8718b0461f95bd09f4b67f1197" candidate_uuid: "244b85b5155e4f58a13b566c50083890" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770cf1ff89494e54baba82d84dac5831" is_pre_election: true
I20260709 13:03:02.558554 11484 raft_consensus.cc:493] T ae318533d2c141c9bef5b69d44f64d90 P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:02.558565 11327 raft_consensus.cc:2393] T 5efc9b8718b0461f95bd09f4b67f1197 P 770cf1ff89494e54baba82d84dac5831 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 244b85b5155e4f58a13b566c50083890 in current term 1: Already voted for candidate e1ee21679c764758a302a52b2f954b5b in this term.
I20260709 13:03:02.559142 11484 raft_consensus.cc:515] T ae318533d2c141c9bef5b69d44f64d90 P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:02.560487 11366 leader_election.cc:304] T 5efc9b8718b0461f95bd09f4b67f1197 P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 244b85b5155e4f58a13b566c50083890; no voters: 770cf1ff89494e54baba82d84dac5831, e1ee21679c764758a302a52b2f954b5b
I20260709 13:03:02.561379 11484 leader_election.cc:290] T ae318533d2c141c9bef5b69d44f64d90 P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331), 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205)
I20260709 13:03:02.561928 11484 raft_consensus.cc:3060] T 5efc9b8718b0461f95bd09f4b67f1197 P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:02.563120 11329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae318533d2c141c9bef5b69d44f64d90" candidate_uuid: "244b85b5155e4f58a13b566c50083890" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770cf1ff89494e54baba82d84dac5831" is_pre_election: true
I20260709 13:03:02.563397 11254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae318533d2c141c9bef5b69d44f64d90" candidate_uuid: "244b85b5155e4f58a13b566c50083890" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1ee21679c764758a302a52b2f954b5b" is_pre_election: true
I20260709 13:03:02.564002 11329 raft_consensus.cc:2393] T ae318533d2c141c9bef5b69d44f64d90 P 770cf1ff89494e54baba82d84dac5831 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 244b85b5155e4f58a13b566c50083890 in current term 1: Already voted for candidate e1ee21679c764758a302a52b2f954b5b in this term.
I20260709 13:03:02.562290 11152 catalog_manager.cc:5697] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 244b85b5155e4f58a13b566c50083890 reported cstate change: term changed from 0 to 1, leader changed from <none> to 244b85b5155e4f58a13b566c50083890 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "244b85b5155e4f58a13b566c50083890" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:02.565522 11366 leader_election.cc:304] T ae318533d2c141c9bef5b69d44f64d90 P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 244b85b5155e4f58a13b566c50083890; no voters: 770cf1ff89494e54baba82d84dac5831, e1ee21679c764758a302a52b2f954b5b
I20260709 13:03:02.566890 11485 raft_consensus.cc:3060] T ae318533d2c141c9bef5b69d44f64d90 P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:02.571538 11484 raft_consensus.cc:2749] T 5efc9b8718b0461f95bd09f4b67f1197 P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:02.573351 11485 raft_consensus.cc:2749] T ae318533d2c141c9bef5b69d44f64d90 P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:02.588135 11485 consensus_queue.cc:1048] T b604dfd1da1840b2836273c326d4f269 P 244b85b5155e4f58a13b566c50083890 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:02.600569 11447 consensus_queue.cc:1048] T b604dfd1da1840b2836273c326d4f269 P 244b85b5155e4f58a13b566c50083890 [LEADER]: Connected to new peer: Peer: permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:02.630837 11447 consensus_queue.cc:1048] T 2893484e7ace4fd4af892dc3aa82998b P 244b85b5155e4f58a13b566c50083890 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:02.633797 11450 consensus_queue.cc:1048] T 5efc9b8718b0461f95bd09f4b67f1197 P e1ee21679c764758a302a52b2f954b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:02.643473 11485 consensus_queue.cc:1048] T 2893484e7ace4fd4af892dc3aa82998b P 244b85b5155e4f58a13b566c50083890 [LEADER]: Connected to new peer: Peer: permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:02.650722 11473 consensus_queue.cc:1048] T 5efc9b8718b0461f95bd09f4b67f1197 P e1ee21679c764758a302a52b2f954b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:02.752185 11329 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3c7b44fee55543f58f87877c52ecfb79"
dest_uuid: "770cf1ff89494e54baba82d84dac5831"
mode: GRACEFUL
new_leader_uuid: "e1ee21679c764758a302a52b2f954b5b"
 from {username='slave'} at 127.0.0.1:49552
I20260709 13:03:02.752795 11329 raft_consensus.cc:606] T 3c7b44fee55543f58f87877c52ecfb79 P 770cf1ff89494e54baba82d84dac5831 [term 1 LEADER]: Received request to transfer leadership to TS e1ee21679c764758a302a52b2f954b5b
I20260709 13:03:02.758066 11329 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "90befbbddbe842949771c44d3a3ea4db"
dest_uuid: "770cf1ff89494e54baba82d84dac5831"
mode: GRACEFUL
new_leader_uuid: "e1ee21679c764758a302a52b2f954b5b"
 from {username='slave'} at 127.0.0.1:49552
I20260709 13:03:02.758541 11329 raft_consensus.cc:606] T 90befbbddbe842949771c44d3a3ea4db P 770cf1ff89494e54baba82d84dac5831 [term 1 LEADER]: Received request to transfer leadership to TS e1ee21679c764758a302a52b2f954b5b
I20260709 13:03:02.766188 11467 consensus_queue.cc:1048] T ae318533d2c141c9bef5b69d44f64d90 P e1ee21679c764758a302a52b2f954b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:02.779685 11403 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "560d3cdf923a4ab1b6d9f0747f8c40bf"
dest_uuid: "244b85b5155e4f58a13b566c50083890"
mode: GRACEFUL
new_leader_uuid: "770cf1ff89494e54baba82d84dac5831"
 from {username='slave'} at 127.0.0.1:49258
I20260709 13:03:02.780355 11403 raft_consensus.cc:606] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 244b85b5155e4f58a13b566c50083890 [term 1 LEADER]: Received request to transfer leadership to TS 770cf1ff89494e54baba82d84dac5831
I20260709 13:03:02.782526 11467 consensus_queue.cc:1048] T ae318533d2c141c9bef5b69d44f64d90 P e1ee21679c764758a302a52b2f954b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:02.801450 11253 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae318533d2c141c9bef5b69d44f64d90"
dest_uuid: "e1ee21679c764758a302a52b2f954b5b"
mode: GRACEFUL
new_leader_uuid: "770cf1ff89494e54baba82d84dac5831"
 from {username='slave'} at 127.0.0.1:37374
I20260709 13:03:02.802291 11253 raft_consensus.cc:606] T ae318533d2c141c9bef5b69d44f64d90 P e1ee21679c764758a302a52b2f954b5b [term 1 LEADER]: Received request to transfer leadership to TS 770cf1ff89494e54baba82d84dac5831
I20260709 13:03:02.807852 11403 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2893484e7ace4fd4af892dc3aa82998b"
dest_uuid: "244b85b5155e4f58a13b566c50083890"
mode: GRACEFUL
new_leader_uuid: "770cf1ff89494e54baba82d84dac5831"
 from {username='slave'} at 127.0.0.1:49258
I20260709 13:03:02.808481 11403 raft_consensus.cc:606] T 2893484e7ace4fd4af892dc3aa82998b P 244b85b5155e4f58a13b566c50083890 [term 1 LEADER]: Received request to transfer leadership to TS 770cf1ff89494e54baba82d84dac5831
I20260709 13:03:02.924502 11463 raft_consensus.cc:993] T 90befbbddbe842949771c44d3a3ea4db P 770cf1ff89494e54baba82d84dac5831: : Instructing follower e1ee21679c764758a302a52b2f954b5b to start an election
I20260709 13:03:02.925091 11464 raft_consensus.cc:1081] T 90befbbddbe842949771c44d3a3ea4db P 770cf1ff89494e54baba82d84dac5831 [term 1 LEADER]: Signalling peer e1ee21679c764758a302a52b2f954b5b to start an election
I20260709 13:03:02.926859 11253 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "90befbbddbe842949771c44d3a3ea4db"
dest_uuid: "e1ee21679c764758a302a52b2f954b5b"
 from {username='slave'} at 127.0.0.1:37360
I20260709 13:03:02.927383 11253 raft_consensus.cc:493] T 90befbbddbe842949771c44d3a3ea4db P e1ee21679c764758a302a52b2f954b5b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:02.927675 11253 raft_consensus.cc:3060] T 90befbbddbe842949771c44d3a3ea4db P e1ee21679c764758a302a52b2f954b5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:02.933897 11253 raft_consensus.cc:515] T 90befbbddbe842949771c44d3a3ea4db P e1ee21679c764758a302a52b2f954b5b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:02.935963 11253 leader_election.cc:290] T 90befbbddbe842949771c44d3a3ea4db P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 2 election: Requested vote from peers 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205), 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445)
I20260709 13:03:02.937105 11329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90befbbddbe842949771c44d3a3ea4db" candidate_uuid: "e1ee21679c764758a302a52b2f954b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "770cf1ff89494e54baba82d84dac5831"
I20260709 13:03:02.937206 11403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "90befbbddbe842949771c44d3a3ea4db" candidate_uuid: "e1ee21679c764758a302a52b2f954b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "244b85b5155e4f58a13b566c50083890"
I20260709 13:03:02.937973 11329 raft_consensus.cc:3055] T 90befbbddbe842949771c44d3a3ea4db P 770cf1ff89494e54baba82d84dac5831 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:02.938232 11403 raft_consensus.cc:3060] T 90befbbddbe842949771c44d3a3ea4db P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:02.938525 11329 raft_consensus.cc:740] T 90befbbddbe842949771c44d3a3ea4db P 770cf1ff89494e54baba82d84dac5831 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 770cf1ff89494e54baba82d84dac5831, State: Running, Role: LEADER
I20260709 13:03:02.939570 11329 consensus_queue.cc:260] T 90befbbddbe842949771c44d3a3ea4db P 770cf1ff89494e54baba82d84dac5831 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:02.940769 11329 raft_consensus.cc:3060] T 90befbbddbe842949771c44d3a3ea4db P 770cf1ff89494e54baba82d84dac5831 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:02.945506 11403 raft_consensus.cc:2468] T 90befbbddbe842949771c44d3a3ea4db P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1ee21679c764758a302a52b2f954b5b in term 2.
I20260709 13:03:02.947018 11220 leader_election.cc:304] T 90befbbddbe842949771c44d3a3ea4db P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 244b85b5155e4f58a13b566c50083890, e1ee21679c764758a302a52b2f954b5b; no voters: 
I20260709 13:03:02.947997 11450 raft_consensus.cc:2804] T 90befbbddbe842949771c44d3a3ea4db P e1ee21679c764758a302a52b2f954b5b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:02.948619 11450 raft_consensus.cc:697] T 90befbbddbe842949771c44d3a3ea4db P e1ee21679c764758a302a52b2f954b5b [term 2 LEADER]: Becoming Leader. State: Replica: e1ee21679c764758a302a52b2f954b5b, State: Running, Role: LEADER
I20260709 13:03:02.949445 11329 raft_consensus.cc:2468] T 90befbbddbe842949771c44d3a3ea4db P 770cf1ff89494e54baba82d84dac5831 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1ee21679c764758a302a52b2f954b5b in term 2.
I20260709 13:03:02.949596 11450 consensus_queue.cc:237] T 90befbbddbe842949771c44d3a3ea4db P e1ee21679c764758a302a52b2f954b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:02.957942 11148 catalog_manager.cc:5697] T 90befbbddbe842949771c44d3a3ea4db P e1ee21679c764758a302a52b2f954b5b reported cstate change: term changed from 1 to 2, leader changed from 770cf1ff89494e54baba82d84dac5831 (127.0.107.194) to e1ee21679c764758a302a52b2f954b5b (127.0.107.193). New cstate: current_term: 2 leader_uuid: "e1ee21679c764758a302a52b2f954b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:03.067953 11463 raft_consensus.cc:993] T 3c7b44fee55543f58f87877c52ecfb79 P 770cf1ff89494e54baba82d84dac5831: : Instructing follower e1ee21679c764758a302a52b2f954b5b to start an election
I20260709 13:03:03.068431 11464 raft_consensus.cc:1081] T 3c7b44fee55543f58f87877c52ecfb79 P 770cf1ff89494e54baba82d84dac5831 [term 1 LEADER]: Signalling peer e1ee21679c764758a302a52b2f954b5b to start an election
I20260709 13:03:03.070117 11253 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3c7b44fee55543f58f87877c52ecfb79"
dest_uuid: "e1ee21679c764758a302a52b2f954b5b"
 from {username='slave'} at 127.0.0.1:37360
I20260709 13:03:03.070705 11253 raft_consensus.cc:493] T 3c7b44fee55543f58f87877c52ecfb79 P e1ee21679c764758a302a52b2f954b5b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:03.071463 11253 raft_consensus.cc:3060] T 3c7b44fee55543f58f87877c52ecfb79 P e1ee21679c764758a302a52b2f954b5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:03.076905 11253 raft_consensus.cc:515] T 3c7b44fee55543f58f87877c52ecfb79 P e1ee21679c764758a302a52b2f954b5b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:03.077454 11484 consensus_queue.cc:1048] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 244b85b5155e4f58a13b566c50083890 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:03.078832 11253 leader_election.cc:290] T 3c7b44fee55543f58f87877c52ecfb79 P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 2 election: Requested vote from peers 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205), 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445)
I20260709 13:03:03.080060 11403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7b44fee55543f58f87877c52ecfb79" candidate_uuid: "e1ee21679c764758a302a52b2f954b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "244b85b5155e4f58a13b566c50083890"
I20260709 13:03:03.079975 11329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c7b44fee55543f58f87877c52ecfb79" candidate_uuid: "e1ee21679c764758a302a52b2f954b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "770cf1ff89494e54baba82d84dac5831"
I20260709 13:03:03.080948 11403 raft_consensus.cc:3060] T 3c7b44fee55543f58f87877c52ecfb79 P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:03.081108 11329 raft_consensus.cc:3055] T 3c7b44fee55543f58f87877c52ecfb79 P 770cf1ff89494e54baba82d84dac5831 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:03.081633 11329 raft_consensus.cc:740] T 3c7b44fee55543f58f87877c52ecfb79 P 770cf1ff89494e54baba82d84dac5831 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 770cf1ff89494e54baba82d84dac5831, State: Running, Role: LEADER
I20260709 13:03:03.082541 11329 consensus_queue.cc:260] T 3c7b44fee55543f58f87877c52ecfb79 P 770cf1ff89494e54baba82d84dac5831 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:03.083945 11329 raft_consensus.cc:3060] T 3c7b44fee55543f58f87877c52ecfb79 P 770cf1ff89494e54baba82d84dac5831 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:03.088927 11403 raft_consensus.cc:2468] T 3c7b44fee55543f58f87877c52ecfb79 P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1ee21679c764758a302a52b2f954b5b in term 2.
I20260709 13:03:03.090440 11220 leader_election.cc:304] T 3c7b44fee55543f58f87877c52ecfb79 P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 244b85b5155e4f58a13b566c50083890, e1ee21679c764758a302a52b2f954b5b; no voters: 
I20260709 13:03:03.091354 11473 raft_consensus.cc:2804] T 3c7b44fee55543f58f87877c52ecfb79 P e1ee21679c764758a302a52b2f954b5b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:03.091423 11484 consensus_queue.cc:1048] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 244b85b5155e4f58a13b566c50083890 [LEADER]: Connected to new peer: Peer: permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:03.091907 11473 raft_consensus.cc:697] T 3c7b44fee55543f58f87877c52ecfb79 P e1ee21679c764758a302a52b2f954b5b [term 2 LEADER]: Becoming Leader. State: Replica: e1ee21679c764758a302a52b2f954b5b, State: Running, Role: LEADER
I20260709 13:03:03.092808 11329 raft_consensus.cc:2468] T 3c7b44fee55543f58f87877c52ecfb79 P 770cf1ff89494e54baba82d84dac5831 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1ee21679c764758a302a52b2f954b5b in term 2.
I20260709 13:03:03.093606 11473 consensus_queue.cc:237] T 3c7b44fee55543f58f87877c52ecfb79 P e1ee21679c764758a302a52b2f954b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:03.102620 11485 raft_consensus.cc:993] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 244b85b5155e4f58a13b566c50083890: : Instructing follower 770cf1ff89494e54baba82d84dac5831 to start an election
I20260709 13:03:03.103144 11484 raft_consensus.cc:1081] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 244b85b5155e4f58a13b566c50083890 [term 1 LEADER]: Signalling peer 770cf1ff89494e54baba82d84dac5831 to start an election
I20260709 13:03:03.103552 11152 catalog_manager.cc:5697] T 3c7b44fee55543f58f87877c52ecfb79 P e1ee21679c764758a302a52b2f954b5b reported cstate change: term changed from 1 to 2, leader changed from 770cf1ff89494e54baba82d84dac5831 (127.0.107.194) to e1ee21679c764758a302a52b2f954b5b (127.0.107.193). New cstate: current_term: 2 leader_uuid: "e1ee21679c764758a302a52b2f954b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:03.104683 11327 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "560d3cdf923a4ab1b6d9f0747f8c40bf"
dest_uuid: "770cf1ff89494e54baba82d84dac5831"
 from {username='slave'} at 127.0.0.1:49548
I20260709 13:03:03.105357 11327 raft_consensus.cc:493] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 770cf1ff89494e54baba82d84dac5831 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:03.105692 11327 raft_consensus.cc:3060] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 770cf1ff89494e54baba82d84dac5831 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:03.112075 11327 raft_consensus.cc:515] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 770cf1ff89494e54baba82d84dac5831 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:03.114208 11327 leader_election.cc:290] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 770cf1ff89494e54baba82d84dac5831 [CANDIDATE]: Term 2 election: Requested vote from peers e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331), 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445)
I20260709 13:03:03.115365 11253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "560d3cdf923a4ab1b6d9f0747f8c40bf" candidate_uuid: "770cf1ff89494e54baba82d84dac5831" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e1ee21679c764758a302a52b2f954b5b"
I20260709 13:03:03.115701 11403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "560d3cdf923a4ab1b6d9f0747f8c40bf" candidate_uuid: "770cf1ff89494e54baba82d84dac5831" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "244b85b5155e4f58a13b566c50083890"
I20260709 13:03:03.116055 11253 raft_consensus.cc:3060] T 560d3cdf923a4ab1b6d9f0747f8c40bf P e1ee21679c764758a302a52b2f954b5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:03.116408 11403 raft_consensus.cc:3055] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 244b85b5155e4f58a13b566c50083890 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:03.116806 11403 raft_consensus.cc:740] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 244b85b5155e4f58a13b566c50083890 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 244b85b5155e4f58a13b566c50083890, State: Running, Role: LEADER
I20260709 13:03:03.117820 11403 consensus_queue.cc:260] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 244b85b5155e4f58a13b566c50083890 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:03.119238 11403 raft_consensus.cc:3060] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:03.123059 11253 raft_consensus.cc:2468] T 560d3cdf923a4ab1b6d9f0747f8c40bf P e1ee21679c764758a302a52b2f954b5b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 770cf1ff89494e54baba82d84dac5831 in term 2.
I20260709 13:03:03.124336 11292 leader_election.cc:304] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 770cf1ff89494e54baba82d84dac5831 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 770cf1ff89494e54baba82d84dac5831, e1ee21679c764758a302a52b2f954b5b; no voters: 
I20260709 13:03:03.125145 11464 raft_consensus.cc:2804] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 770cf1ff89494e54baba82d84dac5831 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:03.125442 11403 raft_consensus.cc:2468] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 770cf1ff89494e54baba82d84dac5831 in term 2.
I20260709 13:03:03.125687 11464 raft_consensus.cc:697] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 770cf1ff89494e54baba82d84dac5831 [term 2 LEADER]: Becoming Leader. State: Replica: 770cf1ff89494e54baba82d84dac5831, State: Running, Role: LEADER
I20260709 13:03:03.126569 11464 consensus_queue.cc:237] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 770cf1ff89494e54baba82d84dac5831 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:03.133638 11148 catalog_manager.cc:5697] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 770cf1ff89494e54baba82d84dac5831 reported cstate change: term changed from 1 to 2, leader changed from 244b85b5155e4f58a13b566c50083890 (127.0.107.195) to 770cf1ff89494e54baba82d84dac5831 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "770cf1ff89494e54baba82d84dac5831" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:03.156670 11485 raft_consensus.cc:993] T 2893484e7ace4fd4af892dc3aa82998b P 244b85b5155e4f58a13b566c50083890: : Instructing follower 770cf1ff89494e54baba82d84dac5831 to start an election
I20260709 13:03:03.157235 11484 raft_consensus.cc:1081] T 2893484e7ace4fd4af892dc3aa82998b P 244b85b5155e4f58a13b566c50083890 [term 1 LEADER]: Signalling peer 770cf1ff89494e54baba82d84dac5831 to start an election
I20260709 13:03:03.158864 11327 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2893484e7ace4fd4af892dc3aa82998b"
dest_uuid: "770cf1ff89494e54baba82d84dac5831"
 from {username='slave'} at 127.0.0.1:49548
I20260709 13:03:03.159500 11327 raft_consensus.cc:493] T 2893484e7ace4fd4af892dc3aa82998b P 770cf1ff89494e54baba82d84dac5831 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:03.159888 11327 raft_consensus.cc:3060] T 2893484e7ace4fd4af892dc3aa82998b P 770cf1ff89494e54baba82d84dac5831 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:03.165289 11327 raft_consensus.cc:515] T 2893484e7ace4fd4af892dc3aa82998b P 770cf1ff89494e54baba82d84dac5831 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:03.167069 11327 leader_election.cc:290] T 2893484e7ace4fd4af892dc3aa82998b P 770cf1ff89494e54baba82d84dac5831 [CANDIDATE]: Term 2 election: Requested vote from peers e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331), 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445)
I20260709 13:03:03.167908 11253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2893484e7ace4fd4af892dc3aa82998b" candidate_uuid: "770cf1ff89494e54baba82d84dac5831" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e1ee21679c764758a302a52b2f954b5b"
I20260709 13:03:03.168085 11403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2893484e7ace4fd4af892dc3aa82998b" candidate_uuid: "770cf1ff89494e54baba82d84dac5831" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "244b85b5155e4f58a13b566c50083890"
I20260709 13:03:03.168668 11253 raft_consensus.cc:3060] T 2893484e7ace4fd4af892dc3aa82998b P e1ee21679c764758a302a52b2f954b5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:03.168758 11403 raft_consensus.cc:3055] T 2893484e7ace4fd4af892dc3aa82998b P 244b85b5155e4f58a13b566c50083890 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:03.169171 11403 raft_consensus.cc:740] T 2893484e7ace4fd4af892dc3aa82998b P 244b85b5155e4f58a13b566c50083890 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 244b85b5155e4f58a13b566c50083890, State: Running, Role: LEADER
I20260709 13:03:03.169871 11403 consensus_queue.cc:260] T 2893484e7ace4fd4af892dc3aa82998b P 244b85b5155e4f58a13b566c50083890 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:03.170843 11403 raft_consensus.cc:3060] T 2893484e7ace4fd4af892dc3aa82998b P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:03.175546 11253 raft_consensus.cc:2468] T 2893484e7ace4fd4af892dc3aa82998b P e1ee21679c764758a302a52b2f954b5b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 770cf1ff89494e54baba82d84dac5831 in term 2.
I20260709 13:03:03.175835 11403 raft_consensus.cc:2468] T 2893484e7ace4fd4af892dc3aa82998b P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 770cf1ff89494e54baba82d84dac5831 in term 2.
I20260709 13:03:03.176898 11292 leader_election.cc:304] T 2893484e7ace4fd4af892dc3aa82998b P 770cf1ff89494e54baba82d84dac5831 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 770cf1ff89494e54baba82d84dac5831, e1ee21679c764758a302a52b2f954b5b; no voters: 
I20260709 13:03:03.177618 11464 raft_consensus.cc:2804] T 2893484e7ace4fd4af892dc3aa82998b P 770cf1ff89494e54baba82d84dac5831 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:03.178119 11464 raft_consensus.cc:697] T 2893484e7ace4fd4af892dc3aa82998b P 770cf1ff89494e54baba82d84dac5831 [term 2 LEADER]: Becoming Leader. State: Replica: 770cf1ff89494e54baba82d84dac5831, State: Running, Role: LEADER
I20260709 13:03:03.178857 11464 consensus_queue.cc:237] T 2893484e7ace4fd4af892dc3aa82998b P 770cf1ff89494e54baba82d84dac5831 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:03.185418 11148 catalog_manager.cc:5697] T 2893484e7ace4fd4af892dc3aa82998b P 770cf1ff89494e54baba82d84dac5831 reported cstate change: term changed from 1 to 2, leader changed from 244b85b5155e4f58a13b566c50083890 (127.0.107.195) to 770cf1ff89494e54baba82d84dac5831 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "770cf1ff89494e54baba82d84dac5831" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:03.223692 11450 raft_consensus.cc:993] T ae318533d2c141c9bef5b69d44f64d90 P e1ee21679c764758a302a52b2f954b5b: : Instructing follower 770cf1ff89494e54baba82d84dac5831 to start an election
I20260709 13:03:03.224218 11473 raft_consensus.cc:1081] T ae318533d2c141c9bef5b69d44f64d90 P e1ee21679c764758a302a52b2f954b5b [term 1 LEADER]: Signalling peer 770cf1ff89494e54baba82d84dac5831 to start an election
I20260709 13:03:03.225912 11327 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ae318533d2c141c9bef5b69d44f64d90"
dest_uuid: "770cf1ff89494e54baba82d84dac5831"
 from {username='slave'} at 127.0.0.1:49536
I20260709 13:03:03.226550 11327 raft_consensus.cc:493] T ae318533d2c141c9bef5b69d44f64d90 P 770cf1ff89494e54baba82d84dac5831 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:03.226926 11327 raft_consensus.cc:3060] T ae318533d2c141c9bef5b69d44f64d90 P 770cf1ff89494e54baba82d84dac5831 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:03.232128 11327 raft_consensus.cc:515] T ae318533d2c141c9bef5b69d44f64d90 P 770cf1ff89494e54baba82d84dac5831 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:03.233850 11327 leader_election.cc:290] T ae318533d2c141c9bef5b69d44f64d90 P 770cf1ff89494e54baba82d84dac5831 [CANDIDATE]: Term 2 election: Requested vote from peers e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331), 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445)
I20260709 13:03:03.234921 11253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae318533d2c141c9bef5b69d44f64d90" candidate_uuid: "770cf1ff89494e54baba82d84dac5831" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e1ee21679c764758a302a52b2f954b5b"
I20260709 13:03:03.235114 11403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae318533d2c141c9bef5b69d44f64d90" candidate_uuid: "770cf1ff89494e54baba82d84dac5831" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "244b85b5155e4f58a13b566c50083890"
I20260709 13:03:03.235661 11253 raft_consensus.cc:3055] T ae318533d2c141c9bef5b69d44f64d90 P e1ee21679c764758a302a52b2f954b5b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:03.235862 11403 raft_consensus.cc:3060] T ae318533d2c141c9bef5b69d44f64d90 P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:03.236025 11253 raft_consensus.cc:740] T ae318533d2c141c9bef5b69d44f64d90 P e1ee21679c764758a302a52b2f954b5b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e1ee21679c764758a302a52b2f954b5b, State: Running, Role: LEADER
I20260709 13:03:03.237057 11253 consensus_queue.cc:260] T ae318533d2c141c9bef5b69d44f64d90 P e1ee21679c764758a302a52b2f954b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:03.238336 11253 raft_consensus.cc:3060] T ae318533d2c141c9bef5b69d44f64d90 P e1ee21679c764758a302a52b2f954b5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:03.241890 11403 raft_consensus.cc:2468] T ae318533d2c141c9bef5b69d44f64d90 P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 770cf1ff89494e54baba82d84dac5831 in term 2.
I20260709 13:03:03.243219 11295 leader_election.cc:304] T ae318533d2c141c9bef5b69d44f64d90 P 770cf1ff89494e54baba82d84dac5831 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 244b85b5155e4f58a13b566c50083890, 770cf1ff89494e54baba82d84dac5831; no voters: 
I20260709 13:03:03.243968 11253 raft_consensus.cc:2468] T ae318533d2c141c9bef5b69d44f64d90 P e1ee21679c764758a302a52b2f954b5b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 770cf1ff89494e54baba82d84dac5831 in term 2.
I20260709 13:03:03.244159 11464 raft_consensus.cc:2804] T ae318533d2c141c9bef5b69d44f64d90 P 770cf1ff89494e54baba82d84dac5831 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:03.244984 11464 raft_consensus.cc:697] T ae318533d2c141c9bef5b69d44f64d90 P 770cf1ff89494e54baba82d84dac5831 [term 2 LEADER]: Becoming Leader. State: Replica: 770cf1ff89494e54baba82d84dac5831, State: Running, Role: LEADER
I20260709 13:03:03.245855 11464 consensus_queue.cc:237] T ae318533d2c141c9bef5b69d44f64d90 P 770cf1ff89494e54baba82d84dac5831 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:03.253163 11148 catalog_manager.cc:5697] T ae318533d2c141c9bef5b69d44f64d90 P 770cf1ff89494e54baba82d84dac5831 reported cstate change: term changed from 1 to 2, leader changed from e1ee21679c764758a302a52b2f954b5b (127.0.107.193) to 770cf1ff89494e54baba82d84dac5831 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "770cf1ff89494e54baba82d84dac5831" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:03.460187 11327 raft_consensus.cc:1275] T 90befbbddbe842949771c44d3a3ea4db P 770cf1ff89494e54baba82d84dac5831 [term 2 FOLLOWER]: Refusing update from remote peer e1ee21679c764758a302a52b2f954b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:03.461779 11473 consensus_queue.cc:1048] T 90befbbddbe842949771c44d3a3ea4db P e1ee21679c764758a302a52b2f954b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:03.472290 11403 raft_consensus.cc:1275] T 90befbbddbe842949771c44d3a3ea4db P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Refusing update from remote peer e1ee21679c764758a302a52b2f954b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:03.475451 11527 consensus_queue.cc:1048] T 90befbbddbe842949771c44d3a3ea4db P e1ee21679c764758a302a52b2f954b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:03.523353 11403 raft_consensus.cc:1275] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Refusing update from remote peer 770cf1ff89494e54baba82d84dac5831: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:03.524912 11464 consensus_queue.cc:1048] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 770cf1ff89494e54baba82d84dac5831 [LEADER]: Connected to new peer: Peer: permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:03.534197 11253 raft_consensus.cc:1275] T 560d3cdf923a4ab1b6d9f0747f8c40bf P e1ee21679c764758a302a52b2f954b5b [term 2 FOLLOWER]: Refusing update from remote peer 770cf1ff89494e54baba82d84dac5831: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:03.539078 11403 raft_consensus.cc:1275] T 3c7b44fee55543f58f87877c52ecfb79 P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Refusing update from remote peer e1ee21679c764758a302a52b2f954b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:03.536690 11464 consensus_queue.cc:1048] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 770cf1ff89494e54baba82d84dac5831 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:03:03.541481 11450 consensus_queue.cc:1048] T 3c7b44fee55543f58f87877c52ecfb79 P e1ee21679c764758a302a52b2f954b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:03.554808 11327 raft_consensus.cc:1275] T 3c7b44fee55543f58f87877c52ecfb79 P 770cf1ff89494e54baba82d84dac5831 [term 2 FOLLOWER]: Refusing update from remote peer e1ee21679c764758a302a52b2f954b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:03.557140 11530 consensus_queue.cc:1048] T 3c7b44fee55543f58f87877c52ecfb79 P e1ee21679c764758a302a52b2f954b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:03.594362 11253 raft_consensus.cc:1275] T 2893484e7ace4fd4af892dc3aa82998b P e1ee21679c764758a302a52b2f954b5b [term 2 FOLLOWER]: Refusing update from remote peer 770cf1ff89494e54baba82d84dac5831: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:03.596125 11529 consensus_queue.cc:1048] T 2893484e7ace4fd4af892dc3aa82998b P 770cf1ff89494e54baba82d84dac5831 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:03.605139 11403 raft_consensus.cc:1275] T 2893484e7ace4fd4af892dc3aa82998b P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Refusing update from remote peer 770cf1ff89494e54baba82d84dac5831: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:03.607183 11464 consensus_queue.cc:1048] T 2893484e7ace4fd4af892dc3aa82998b P 770cf1ff89494e54baba82d84dac5831 [LEADER]: Connected to new peer: Peer: permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:03.641076 11403 raft_consensus.cc:1275] T ae318533d2c141c9bef5b69d44f64d90 P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Refusing update from remote peer 770cf1ff89494e54baba82d84dac5831: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:03.642475 11464 consensus_queue.cc:1048] T ae318533d2c141c9bef5b69d44f64d90 P 770cf1ff89494e54baba82d84dac5831 [LEADER]: Connected to new peer: Peer: permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:03.651259 11254 raft_consensus.cc:1275] T ae318533d2c141c9bef5b69d44f64d90 P e1ee21679c764758a302a52b2f954b5b [term 2 FOLLOWER]: Refusing update from remote peer 770cf1ff89494e54baba82d84dac5831: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:03.654688 11464 consensus_queue.cc:1048] T ae318533d2c141c9bef5b69d44f64d90 P 770cf1ff89494e54baba82d84dac5831 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:05.842154 11152 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60976:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:03:05.844404 11152 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
W20260709 13:03:05.890869 11200 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:03:05.893522 11244 tablet_service.cc:1511] Processing CreateTablet for tablet 40f440212cf64606bbd7ddbf7bf153af (DEFAULT_TABLE table=soft_deleted_table [id=0b1c6b950fd545d9bc3398534e94374c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:03:05.894570 11311 tablet_service.cc:1511] Processing CreateTablet for tablet 40f440212cf64606bbd7ddbf7bf153af (DEFAULT_TABLE table=soft_deleted_table [id=0b1c6b950fd545d9bc3398534e94374c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:03:05.895092 11244 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40f440212cf64606bbd7ddbf7bf153af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.896232 11311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40f440212cf64606bbd7ddbf7bf153af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.897910 11393 tablet_service.cc:1511] Processing CreateTablet for tablet 40f440212cf64606bbd7ddbf7bf153af (DEFAULT_TABLE table=soft_deleted_table [id=0b1c6b950fd545d9bc3398534e94374c]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:03:05.898104 11242 tablet_service.cc:1511] Processing CreateTablet for tablet 2634154f9f364cfea520c15a5ad325ed (DEFAULT_TABLE table=soft_deleted_table [id=0b1c6b950fd545d9bc3398534e94374c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:03:05.899245 11393 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40f440212cf64606bbd7ddbf7bf153af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.899614 11242 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2634154f9f364cfea520c15a5ad325ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.902923 11387 tablet_service.cc:1511] Processing CreateTablet for tablet 2634154f9f364cfea520c15a5ad325ed (DEFAULT_TABLE table=soft_deleted_table [id=0b1c6b950fd545d9bc3398534e94374c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:03:05.904505 11387 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2634154f9f364cfea520c15a5ad325ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.904273 11314 tablet_service.cc:1511] Processing CreateTablet for tablet 2634154f9f364cfea520c15a5ad325ed (DEFAULT_TABLE table=soft_deleted_table [id=0b1c6b950fd545d9bc3398534e94374c]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:03:05.904476 11312 tablet_service.cc:1511] Processing CreateTablet for tablet 676042afc21b4ff5b2f7146544765db1 (DEFAULT_TABLE table=soft_deleted_table [id=0b1c6b950fd545d9bc3398534e94374c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:03:05.905833 11314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2634154f9f364cfea520c15a5ad325ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.907517 11238 tablet_service.cc:1511] Processing CreateTablet for tablet 676042afc21b4ff5b2f7146544765db1 (DEFAULT_TABLE table=soft_deleted_table [id=0b1c6b950fd545d9bc3398534e94374c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:03:05.909060 11238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 676042afc21b4ff5b2f7146544765db1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.908830 11313 tablet_service.cc:1511] Processing CreateTablet for tablet 59c4fef046b94123b15bb064ae4bacc5 (DEFAULT_TABLE table=soft_deleted_table [id=0b1c6b950fd545d9bc3398534e94374c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:03:05.910131 11388 tablet_service.cc:1511] Processing CreateTablet for tablet 676042afc21b4ff5b2f7146544765db1 (DEFAULT_TABLE table=soft_deleted_table [id=0b1c6b950fd545d9bc3398534e94374c]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:03:05.910723 11392 tablet_service.cc:1511] Processing CreateTablet for tablet 59c4fef046b94123b15bb064ae4bacc5 (DEFAULT_TABLE table=soft_deleted_table [id=0b1c6b950fd545d9bc3398534e94374c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:03:05.911494 11388 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 676042afc21b4ff5b2f7146544765db1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.912139 11392 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59c4fef046b94123b15bb064ae4bacc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.912942 11316 tablet_service.cc:1511] Processing CreateTablet for tablet b0d7238307174b48aa91030413f37fea (DEFAULT_TABLE table=soft_deleted_table [id=0b1c6b950fd545d9bc3398534e94374c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:03:05.913647 11240 tablet_service.cc:1511] Processing CreateTablet for tablet 59c4fef046b94123b15bb064ae4bacc5 (DEFAULT_TABLE table=soft_deleted_table [id=0b1c6b950fd545d9bc3398534e94374c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:03:05.911504 11313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59c4fef046b94123b15bb064ae4bacc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.915058 11240 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59c4fef046b94123b15bb064ae4bacc5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.916303 11312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 676042afc21b4ff5b2f7146544765db1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.917284 11237 tablet_service.cc:1511] Processing CreateTablet for tablet b0d7238307174b48aa91030413f37fea (DEFAULT_TABLE table=soft_deleted_table [id=0b1c6b950fd545d9bc3398534e94374c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:03:05.918710 11237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0d7238307174b48aa91030413f37fea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.919862 11316 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0d7238307174b48aa91030413f37fea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.923067 11386 tablet_service.cc:1511] Processing CreateTablet for tablet b0d7238307174b48aa91030413f37fea (DEFAULT_TABLE table=soft_deleted_table [id=0b1c6b950fd545d9bc3398534e94374c]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:03:05.925064 11386 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0d7238307174b48aa91030413f37fea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.946818 11241 tablet_service.cc:1511] Processing CreateTablet for tablet 9ee4855c256940e7819fac4e5d729b0d (DEFAULT_TABLE table=soft_deleted_table [id=0b1c6b950fd545d9bc3398534e94374c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:03:05.947916 11319 tablet_service.cc:1511] Processing CreateTablet for tablet 9ee4855c256940e7819fac4e5d729b0d (DEFAULT_TABLE table=soft_deleted_table [id=0b1c6b950fd545d9bc3398534e94374c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:03:05.948910 11241 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ee4855c256940e7819fac4e5d729b0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.949402 11319 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ee4855c256940e7819fac4e5d729b0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.952476 11389 tablet_service.cc:1511] Processing CreateTablet for tablet 9ee4855c256940e7819fac4e5d729b0d (DEFAULT_TABLE table=soft_deleted_table [id=0b1c6b950fd545d9bc3398534e94374c]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:03:05.954468 11389 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ee4855c256940e7819fac4e5d729b0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.960552 11318 tablet_service.cc:1511] Processing CreateTablet for tablet a271b64cf17e4bb2994ab9820417f2e8 (DEFAULT_TABLE table=soft_deleted_table [id=0b1c6b950fd545d9bc3398534e94374c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:03:05.962100 11318 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a271b64cf17e4bb2994ab9820417f2e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.965739 11239 tablet_service.cc:1511] Processing CreateTablet for tablet a271b64cf17e4bb2994ab9820417f2e8 (DEFAULT_TABLE table=soft_deleted_table [id=0b1c6b950fd545d9bc3398534e94374c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:03:05.965854 11243 tablet_service.cc:1511] Processing CreateTablet for tablet 1d3a3c192f1a498cb0c2253625c69f3a (DEFAULT_TABLE table=soft_deleted_table [id=0b1c6b950fd545d9bc3398534e94374c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:03:05.966306 11390 tablet_service.cc:1511] Processing CreateTablet for tablet a271b64cf17e4bb2994ab9820417f2e8 (DEFAULT_TABLE table=soft_deleted_table [id=0b1c6b950fd545d9bc3398534e94374c]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:03:05.967631 11239 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a271b64cf17e4bb2994ab9820417f2e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.968132 11390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a271b64cf17e4bb2994ab9820417f2e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.968456 11243 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d3a3c192f1a498cb0c2253625c69f3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.974808 11317 tablet_service.cc:1511] Processing CreateTablet for tablet 1d3a3c192f1a498cb0c2253625c69f3a (DEFAULT_TABLE table=soft_deleted_table [id=0b1c6b950fd545d9bc3398534e94374c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:03:05.975520 11385 tablet_service.cc:1511] Processing CreateTablet for tablet 1d3a3c192f1a498cb0c2253625c69f3a (DEFAULT_TABLE table=soft_deleted_table [id=0b1c6b950fd545d9bc3398534e94374c]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:03:05.976900 11317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d3a3c192f1a498cb0c2253625c69f3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.977150 11385 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d3a3c192f1a498cb0c2253625c69f3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:05.996851 11236 tablet_service.cc:1511] Processing CreateTablet for tablet 97ab0a1ca9a548b69b4af26987138b42 (DEFAULT_TABLE table=soft_deleted_table [id=0b1c6b950fd545d9bc3398534e94374c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:03:05.998402 11236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97ab0a1ca9a548b69b4af26987138b42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:06.003269 11315 tablet_service.cc:1511] Processing CreateTablet for tablet 97ab0a1ca9a548b69b4af26987138b42 (DEFAULT_TABLE table=soft_deleted_table [id=0b1c6b950fd545d9bc3398534e94374c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:03:06.005681 11391 tablet_service.cc:1511] Processing CreateTablet for tablet 97ab0a1ca9a548b69b4af26987138b42 (DEFAULT_TABLE table=soft_deleted_table [id=0b1c6b950fd545d9bc3398534e94374c]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:03:06.007241 11391 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97ab0a1ca9a548b69b4af26987138b42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:06.008968 11315 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97ab0a1ca9a548b69b4af26987138b42. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:03:06.100329 11544 tablet_bootstrap.cc:492] T 1d3a3c192f1a498cb0c2253625c69f3a P 770cf1ff89494e54baba82d84dac5831: Bootstrap starting.
I20260709 13:03:06.100944 11543 tablet_bootstrap.cc:492] T 676042afc21b4ff5b2f7146544765db1 P 244b85b5155e4f58a13b566c50083890: Bootstrap starting.
I20260709 13:03:06.121686 11545 tablet_bootstrap.cc:492] T 9ee4855c256940e7819fac4e5d729b0d P e1ee21679c764758a302a52b2f954b5b: Bootstrap starting.
I20260709 13:03:06.124032 11544 tablet_bootstrap.cc:654] T 1d3a3c192f1a498cb0c2253625c69f3a P 770cf1ff89494e54baba82d84dac5831: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:06.129673 11545 tablet_bootstrap.cc:654] T 9ee4855c256940e7819fac4e5d729b0d P e1ee21679c764758a302a52b2f954b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:06.176081 11545 tablet_bootstrap.cc:492] T 9ee4855c256940e7819fac4e5d729b0d P e1ee21679c764758a302a52b2f954b5b: No bootstrap required, opened a new log
I20260709 13:03:06.176090 11544 tablet_bootstrap.cc:492] T 1d3a3c192f1a498cb0c2253625c69f3a P 770cf1ff89494e54baba82d84dac5831: No bootstrap required, opened a new log
I20260709 13:03:06.177198 11544 ts_tablet_manager.cc:1403] T 1d3a3c192f1a498cb0c2253625c69f3a P 770cf1ff89494e54baba82d84dac5831: Time spent bootstrapping tablet: real 0.077s	user 0.027s	sys 0.031s
I20260709 13:03:06.179355 11545 ts_tablet_manager.cc:1403] T 9ee4855c256940e7819fac4e5d729b0d P e1ee21679c764758a302a52b2f954b5b: Time spent bootstrapping tablet: real 0.058s	user 0.025s	sys 0.028s
I20260709 13:03:06.183020 11545 raft_consensus.cc:359] T 9ee4855c256940e7819fac4e5d729b0d P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:06.183663 11543 tablet_bootstrap.cc:654] T 676042afc21b4ff5b2f7146544765db1 P 244b85b5155e4f58a13b566c50083890: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:06.183905 11545 raft_consensus.cc:385] T 9ee4855c256940e7819fac4e5d729b0d P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:06.190053 11545 raft_consensus.cc:740] T 9ee4855c256940e7819fac4e5d729b0d P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1ee21679c764758a302a52b2f954b5b, State: Initialized, Role: FOLLOWER
I20260709 13:03:06.190972 11545 consensus_queue.cc:260] T 9ee4855c256940e7819fac4e5d729b0d P e1ee21679c764758a302a52b2f954b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:06.185899 11544 raft_consensus.cc:359] T 1d3a3c192f1a498cb0c2253625c69f3a P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:06.193962 11545 ts_tablet_manager.cc:1434] T 9ee4855c256940e7819fac4e5d729b0d P e1ee21679c764758a302a52b2f954b5b: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 13:03:06.195220 11545 tablet_bootstrap.cc:492] T a271b64cf17e4bb2994ab9820417f2e8 P e1ee21679c764758a302a52b2f954b5b: Bootstrap starting.
I20260709 13:03:06.193801 11544 raft_consensus.cc:385] T 1d3a3c192f1a498cb0c2253625c69f3a P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:06.199504 11544 raft_consensus.cc:740] T 1d3a3c192f1a498cb0c2253625c69f3a P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 770cf1ff89494e54baba82d84dac5831, State: Initialized, Role: FOLLOWER
I20260709 13:03:06.200664 11544 consensus_queue.cc:260] T 1d3a3c192f1a498cb0c2253625c69f3a P 770cf1ff89494e54baba82d84dac5831 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:06.202592 11545 tablet_bootstrap.cc:654] T a271b64cf17e4bb2994ab9820417f2e8 P e1ee21679c764758a302a52b2f954b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:06.204481 11544 ts_tablet_manager.cc:1434] T 1d3a3c192f1a498cb0c2253625c69f3a P 770cf1ff89494e54baba82d84dac5831: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 13:03:06.205850 11544 tablet_bootstrap.cc:492] T 40f440212cf64606bbd7ddbf7bf153af P 770cf1ff89494e54baba82d84dac5831: Bootstrap starting.
I20260709 13:03:06.213997 11545 tablet_bootstrap.cc:492] T a271b64cf17e4bb2994ab9820417f2e8 P e1ee21679c764758a302a52b2f954b5b: No bootstrap required, opened a new log
I20260709 13:03:06.214466 11544 tablet_bootstrap.cc:654] T 40f440212cf64606bbd7ddbf7bf153af P 770cf1ff89494e54baba82d84dac5831: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:06.214701 11545 ts_tablet_manager.cc:1403] T a271b64cf17e4bb2994ab9820417f2e8 P e1ee21679c764758a302a52b2f954b5b: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.007s
I20260709 13:03:06.218801 11545 raft_consensus.cc:359] T a271b64cf17e4bb2994ab9820417f2e8 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:06.219774 11545 raft_consensus.cc:385] T a271b64cf17e4bb2994ab9820417f2e8 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:06.220237 11545 raft_consensus.cc:740] T a271b64cf17e4bb2994ab9820417f2e8 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1ee21679c764758a302a52b2f954b5b, State: Initialized, Role: FOLLOWER
I20260709 13:03:06.221617 11543 tablet_bootstrap.cc:492] T 676042afc21b4ff5b2f7146544765db1 P 244b85b5155e4f58a13b566c50083890: No bootstrap required, opened a new log
I20260709 13:03:06.222230 11543 ts_tablet_manager.cc:1403] T 676042afc21b4ff5b2f7146544765db1 P 244b85b5155e4f58a13b566c50083890: Time spent bootstrapping tablet: real 0.122s	user 0.007s	sys 0.014s
I20260709 13:03:06.221400 11545 consensus_queue.cc:260] T a271b64cf17e4bb2994ab9820417f2e8 P e1ee21679c764758a302a52b2f954b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:06.225231 11545 ts_tablet_manager.cc:1434] T a271b64cf17e4bb2994ab9820417f2e8 P e1ee21679c764758a302a52b2f954b5b: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.003s
I20260709 13:03:06.226840 11545 tablet_bootstrap.cc:492] T 97ab0a1ca9a548b69b4af26987138b42 P e1ee21679c764758a302a52b2f954b5b: Bootstrap starting.
I20260709 13:03:06.236315 11545 tablet_bootstrap.cc:654] T 97ab0a1ca9a548b69b4af26987138b42 P e1ee21679c764758a302a52b2f954b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:06.239455 11543 raft_consensus.cc:359] T 676042afc21b4ff5b2f7146544765db1 P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:06.240449 11543 raft_consensus.cc:385] T 676042afc21b4ff5b2f7146544765db1 P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:06.240859 11543 raft_consensus.cc:740] T 676042afc21b4ff5b2f7146544765db1 P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 244b85b5155e4f58a13b566c50083890, State: Initialized, Role: FOLLOWER
I20260709 13:03:06.241858 11543 consensus_queue.cc:260] T 676042afc21b4ff5b2f7146544765db1 P 244b85b5155e4f58a13b566c50083890 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:06.245500 11543 ts_tablet_manager.cc:1434] T 676042afc21b4ff5b2f7146544765db1 P 244b85b5155e4f58a13b566c50083890: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.001s
I20260709 13:03:06.245682 11544 tablet_bootstrap.cc:492] T 40f440212cf64606bbd7ddbf7bf153af P 770cf1ff89494e54baba82d84dac5831: No bootstrap required, opened a new log
I20260709 13:03:06.246282 11544 ts_tablet_manager.cc:1403] T 40f440212cf64606bbd7ddbf7bf153af P 770cf1ff89494e54baba82d84dac5831: Time spent bootstrapping tablet: real 0.041s	user 0.025s	sys 0.007s
I20260709 13:03:06.246956 11545 tablet_bootstrap.cc:492] T 97ab0a1ca9a548b69b4af26987138b42 P e1ee21679c764758a302a52b2f954b5b: No bootstrap required, opened a new log
I20260709 13:03:06.247563 11545 ts_tablet_manager.cc:1403] T 97ab0a1ca9a548b69b4af26987138b42 P e1ee21679c764758a302a52b2f954b5b: Time spent bootstrapping tablet: real 0.021s	user 0.017s	sys 0.001s
I20260709 13:03:06.251475 11545 raft_consensus.cc:359] T 97ab0a1ca9a548b69b4af26987138b42 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:06.252415 11545 raft_consensus.cc:385] T 97ab0a1ca9a548b69b4af26987138b42 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:06.252830 11545 raft_consensus.cc:740] T 97ab0a1ca9a548b69b4af26987138b42 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1ee21679c764758a302a52b2f954b5b, State: Initialized, Role: FOLLOWER
I20260709 13:03:06.253376 11544 raft_consensus.cc:359] T 40f440212cf64606bbd7ddbf7bf153af P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:06.253782 11545 consensus_queue.cc:260] T 97ab0a1ca9a548b69b4af26987138b42 P e1ee21679c764758a302a52b2f954b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:06.254657 11544 raft_consensus.cc:385] T 40f440212cf64606bbd7ddbf7bf153af P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:06.255295 11544 raft_consensus.cc:740] T 40f440212cf64606bbd7ddbf7bf153af P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 770cf1ff89494e54baba82d84dac5831, State: Initialized, Role: FOLLOWER
I20260709 13:03:06.256623 11544 consensus_queue.cc:260] T 40f440212cf64606bbd7ddbf7bf153af P 770cf1ff89494e54baba82d84dac5831 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:06.260939 11545 ts_tablet_manager.cc:1434] T 97ab0a1ca9a548b69b4af26987138b42 P e1ee21679c764758a302a52b2f954b5b: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.001s
I20260709 13:03:06.261487 11544 ts_tablet_manager.cc:1434] T 40f440212cf64606bbd7ddbf7bf153af P 770cf1ff89494e54baba82d84dac5831: Time spent starting tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 13:03:06.262992 11544 tablet_bootstrap.cc:492] T 59c4fef046b94123b15bb064ae4bacc5 P 770cf1ff89494e54baba82d84dac5831: Bootstrap starting.
I20260709 13:03:06.265202 11545 tablet_bootstrap.cc:492] T 676042afc21b4ff5b2f7146544765db1 P e1ee21679c764758a302a52b2f954b5b: Bootstrap starting.
I20260709 13:03:06.274547 11544 tablet_bootstrap.cc:654] T 59c4fef046b94123b15bb064ae4bacc5 P 770cf1ff89494e54baba82d84dac5831: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:06.274732 11545 tablet_bootstrap.cc:654] T 676042afc21b4ff5b2f7146544765db1 P e1ee21679c764758a302a52b2f954b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:06.289358 11545 tablet_bootstrap.cc:492] T 676042afc21b4ff5b2f7146544765db1 P e1ee21679c764758a302a52b2f954b5b: No bootstrap required, opened a new log
I20260709 13:03:06.289983 11545 ts_tablet_manager.cc:1403] T 676042afc21b4ff5b2f7146544765db1 P e1ee21679c764758a302a52b2f954b5b: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.013s
I20260709 13:03:06.296675 11543 tablet_bootstrap.cc:492] T a271b64cf17e4bb2994ab9820417f2e8 P 244b85b5155e4f58a13b566c50083890: Bootstrap starting.
I20260709 13:03:06.297857 11545 raft_consensus.cc:359] T 676042afc21b4ff5b2f7146544765db1 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:06.298870 11545 raft_consensus.cc:385] T 676042afc21b4ff5b2f7146544765db1 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:06.299324 11545 raft_consensus.cc:740] T 676042afc21b4ff5b2f7146544765db1 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1ee21679c764758a302a52b2f954b5b, State: Initialized, Role: FOLLOWER
I20260709 13:03:06.300287 11545 consensus_queue.cc:260] T 676042afc21b4ff5b2f7146544765db1 P e1ee21679c764758a302a52b2f954b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:06.303547 11545 ts_tablet_manager.cc:1434] T 676042afc21b4ff5b2f7146544765db1 P e1ee21679c764758a302a52b2f954b5b: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.006s
I20260709 13:03:06.295737 11544 tablet_bootstrap.cc:492] T 59c4fef046b94123b15bb064ae4bacc5 P 770cf1ff89494e54baba82d84dac5831: No bootstrap required, opened a new log
I20260709 13:03:06.304860 11545 tablet_bootstrap.cc:492] T 1d3a3c192f1a498cb0c2253625c69f3a P e1ee21679c764758a302a52b2f954b5b: Bootstrap starting.
I20260709 13:03:06.305336 11544 ts_tablet_manager.cc:1403] T 59c4fef046b94123b15bb064ae4bacc5 P 770cf1ff89494e54baba82d84dac5831: Time spent bootstrapping tablet: real 0.043s	user 0.021s	sys 0.002s
I20260709 13:03:06.307240 11543 tablet_bootstrap.cc:654] T a271b64cf17e4bb2994ab9820417f2e8 P 244b85b5155e4f58a13b566c50083890: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:06.309497 11544 raft_consensus.cc:359] T 59c4fef046b94123b15bb064ae4bacc5 P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:06.311002 11544 raft_consensus.cc:385] T 59c4fef046b94123b15bb064ae4bacc5 P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:06.311561 11544 raft_consensus.cc:740] T 59c4fef046b94123b15bb064ae4bacc5 P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 770cf1ff89494e54baba82d84dac5831, State: Initialized, Role: FOLLOWER
I20260709 13:03:06.312698 11544 consensus_queue.cc:260] T 59c4fef046b94123b15bb064ae4bacc5 P 770cf1ff89494e54baba82d84dac5831 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:06.318957 11545 tablet_bootstrap.cc:654] T 1d3a3c192f1a498cb0c2253625c69f3a P e1ee21679c764758a302a52b2f954b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:06.326934 11544 ts_tablet_manager.cc:1434] T 59c4fef046b94123b15bb064ae4bacc5 P 770cf1ff89494e54baba82d84dac5831: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 13:03:06.329274 11544 tablet_bootstrap.cc:492] T a271b64cf17e4bb2994ab9820417f2e8 P 770cf1ff89494e54baba82d84dac5831: Bootstrap starting.
I20260709 13:03:06.340492 11543 tablet_bootstrap.cc:492] T a271b64cf17e4bb2994ab9820417f2e8 P 244b85b5155e4f58a13b566c50083890: No bootstrap required, opened a new log
I20260709 13:03:06.341245 11543 ts_tablet_manager.cc:1403] T a271b64cf17e4bb2994ab9820417f2e8 P 244b85b5155e4f58a13b566c50083890: Time spent bootstrapping tablet: real 0.045s	user 0.032s	sys 0.007s
I20260709 13:03:06.342654 11545 tablet_bootstrap.cc:492] T 1d3a3c192f1a498cb0c2253625c69f3a P e1ee21679c764758a302a52b2f954b5b: No bootstrap required, opened a new log
I20260709 13:03:06.343133 11544 tablet_bootstrap.cc:654] T a271b64cf17e4bb2994ab9820417f2e8 P 770cf1ff89494e54baba82d84dac5831: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:06.343319 11545 ts_tablet_manager.cc:1403] T 1d3a3c192f1a498cb0c2253625c69f3a P e1ee21679c764758a302a52b2f954b5b: Time spent bootstrapping tablet: real 0.039s	user 0.015s	sys 0.013s
I20260709 13:03:06.345679 11543 raft_consensus.cc:359] T a271b64cf17e4bb2994ab9820417f2e8 P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:06.346562 11543 raft_consensus.cc:385] T a271b64cf17e4bb2994ab9820417f2e8 P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:06.346912 11543 raft_consensus.cc:740] T a271b64cf17e4bb2994ab9820417f2e8 P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 244b85b5155e4f58a13b566c50083890, State: Initialized, Role: FOLLOWER
I20260709 13:03:06.347895 11543 consensus_queue.cc:260] T a271b64cf17e4bb2994ab9820417f2e8 P 244b85b5155e4f58a13b566c50083890 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:06.349859 11545 raft_consensus.cc:359] T 1d3a3c192f1a498cb0c2253625c69f3a P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:06.350709 11543 ts_tablet_manager.cc:1434] T a271b64cf17e4bb2994ab9820417f2e8 P 244b85b5155e4f58a13b566c50083890: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:03:06.350792 11545 raft_consensus.cc:385] T 1d3a3c192f1a498cb0c2253625c69f3a P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:06.351416 11545 raft_consensus.cc:740] T 1d3a3c192f1a498cb0c2253625c69f3a P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1ee21679c764758a302a52b2f954b5b, State: Initialized, Role: FOLLOWER
I20260709 13:03:06.352173 11543 tablet_bootstrap.cc:492] T 40f440212cf64606bbd7ddbf7bf153af P 244b85b5155e4f58a13b566c50083890: Bootstrap starting.
I20260709 13:03:06.352283 11545 consensus_queue.cc:260] T 1d3a3c192f1a498cb0c2253625c69f3a P e1ee21679c764758a302a52b2f954b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:06.355335 11545 ts_tablet_manager.cc:1434] T 1d3a3c192f1a498cb0c2253625c69f3a P e1ee21679c764758a302a52b2f954b5b: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:03:06.356663 11545 tablet_bootstrap.cc:492] T 59c4fef046b94123b15bb064ae4bacc5 P e1ee21679c764758a302a52b2f954b5b: Bootstrap starting.
I20260709 13:03:06.362450 11543 tablet_bootstrap.cc:654] T 40f440212cf64606bbd7ddbf7bf153af P 244b85b5155e4f58a13b566c50083890: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:06.364428 11545 tablet_bootstrap.cc:654] T 59c4fef046b94123b15bb064ae4bacc5 P e1ee21679c764758a302a52b2f954b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:06.365867 11544 tablet_bootstrap.cc:492] T a271b64cf17e4bb2994ab9820417f2e8 P 770cf1ff89494e54baba82d84dac5831: No bootstrap required, opened a new log
I20260709 13:03:06.366519 11544 ts_tablet_manager.cc:1403] T a271b64cf17e4bb2994ab9820417f2e8 P 770cf1ff89494e54baba82d84dac5831: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.011s
I20260709 13:03:06.370880 11544 raft_consensus.cc:359] T a271b64cf17e4bb2994ab9820417f2e8 P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:06.371749 11544 raft_consensus.cc:385] T a271b64cf17e4bb2994ab9820417f2e8 P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:06.372102 11544 raft_consensus.cc:740] T a271b64cf17e4bb2994ab9820417f2e8 P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 770cf1ff89494e54baba82d84dac5831, State: Initialized, Role: FOLLOWER
I20260709 13:03:06.372931 11544 consensus_queue.cc:260] T a271b64cf17e4bb2994ab9820417f2e8 P 770cf1ff89494e54baba82d84dac5831 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:06.373629 11545 tablet_bootstrap.cc:492] T 59c4fef046b94123b15bb064ae4bacc5 P e1ee21679c764758a302a52b2f954b5b: No bootstrap required, opened a new log
I20260709 13:03:06.374264 11545 ts_tablet_manager.cc:1403] T 59c4fef046b94123b15bb064ae4bacc5 P e1ee21679c764758a302a52b2f954b5b: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.003s
I20260709 13:03:06.374846 11544 ts_tablet_manager.cc:1434] T a271b64cf17e4bb2994ab9820417f2e8 P 770cf1ff89494e54baba82d84dac5831: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:03:06.375805 11544 tablet_bootstrap.cc:492] T b0d7238307174b48aa91030413f37fea P 770cf1ff89494e54baba82d84dac5831: Bootstrap starting.
I20260709 13:03:06.377638 11545 raft_consensus.cc:359] T 59c4fef046b94123b15bb064ae4bacc5 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:06.378546 11545 raft_consensus.cc:385] T 59c4fef046b94123b15bb064ae4bacc5 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:06.378876 11545 raft_consensus.cc:740] T 59c4fef046b94123b15bb064ae4bacc5 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1ee21679c764758a302a52b2f954b5b, State: Initialized, Role: FOLLOWER
I20260709 13:03:06.379601 11530 raft_consensus.cc:493] T 97ab0a1ca9a548b69b4af26987138b42 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.379689 11545 consensus_queue.cc:260] T 59c4fef046b94123b15bb064ae4bacc5 P e1ee21679c764758a302a52b2f954b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:06.380316 11530 raft_consensus.cc:515] T 97ab0a1ca9a548b69b4af26987138b42 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:06.382634 11530 leader_election.cc:290] T 97ab0a1ca9a548b69b4af26987138b42 P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205), 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445)
I20260709 13:03:06.383095 11544 tablet_bootstrap.cc:654] T b0d7238307174b48aa91030413f37fea P 770cf1ff89494e54baba82d84dac5831: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:06.383594 11543 tablet_bootstrap.cc:492] T 40f440212cf64606bbd7ddbf7bf153af P 244b85b5155e4f58a13b566c50083890: No bootstrap required, opened a new log
I20260709 13:03:06.384186 11543 ts_tablet_manager.cc:1403] T 40f440212cf64606bbd7ddbf7bf153af P 244b85b5155e4f58a13b566c50083890: Time spent bootstrapping tablet: real 0.032s	user 0.006s	sys 0.007s
I20260709 13:03:06.388054 11543 raft_consensus.cc:359] T 40f440212cf64606bbd7ddbf7bf153af P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:06.389014 11543 raft_consensus.cc:385] T 40f440212cf64606bbd7ddbf7bf153af P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:06.389317 11543 raft_consensus.cc:740] T 40f440212cf64606bbd7ddbf7bf153af P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 244b85b5155e4f58a13b566c50083890, State: Initialized, Role: FOLLOWER
I20260709 13:03:06.390153 11543 consensus_queue.cc:260] T 40f440212cf64606bbd7ddbf7bf153af P 244b85b5155e4f58a13b566c50083890 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:06.395009 11543 ts_tablet_manager.cc:1434] T 40f440212cf64606bbd7ddbf7bf153af P 244b85b5155e4f58a13b566c50083890: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:03:06.396157 11543 tablet_bootstrap.cc:492] T 9ee4855c256940e7819fac4e5d729b0d P 244b85b5155e4f58a13b566c50083890: Bootstrap starting.
I20260709 13:03:06.412777 11543 tablet_bootstrap.cc:654] T 9ee4855c256940e7819fac4e5d729b0d P 244b85b5155e4f58a13b566c50083890: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:06.418692 11545 ts_tablet_manager.cc:1434] T 59c4fef046b94123b15bb064ae4bacc5 P e1ee21679c764758a302a52b2f954b5b: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.015s
I20260709 13:03:06.420642 11545 tablet_bootstrap.cc:492] T 2634154f9f364cfea520c15a5ad325ed P e1ee21679c764758a302a52b2f954b5b: Bootstrap starting.
I20260709 13:03:06.512372 11560 raft_consensus.cc:493] T 9ee4855c256940e7819fac4e5d729b0d P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.513571 11560 raft_consensus.cc:515] T 9ee4855c256940e7819fac4e5d729b0d P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:06.515566 11545 tablet_bootstrap.cc:654] T 2634154f9f364cfea520c15a5ad325ed P e1ee21679c764758a302a52b2f954b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:06.515887 11560 leader_election.cc:290] T 9ee4855c256940e7819fac4e5d729b0d P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205), 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445)
I20260709 13:03:06.520066 11544 tablet_bootstrap.cc:492] T b0d7238307174b48aa91030413f37fea P 770cf1ff89494e54baba82d84dac5831: No bootstrap required, opened a new log
I20260709 13:03:06.521047 11544 ts_tablet_manager.cc:1403] T b0d7238307174b48aa91030413f37fea P 770cf1ff89494e54baba82d84dac5831: Time spent bootstrapping tablet: real 0.145s	user 0.040s	sys 0.096s
I20260709 13:03:06.531024 11484 raft_consensus.cc:493] T 40f440212cf64606bbd7ddbf7bf153af P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.531929 11484 raft_consensus.cc:515] T 40f440212cf64606bbd7ddbf7bf153af P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:06.532698 11544 raft_consensus.cc:359] T b0d7238307174b48aa91030413f37fea P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:06.533558 11544 raft_consensus.cc:385] T b0d7238307174b48aa91030413f37fea P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:06.533890 11544 raft_consensus.cc:740] T b0d7238307174b48aa91030413f37fea P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 770cf1ff89494e54baba82d84dac5831, State: Initialized, Role: FOLLOWER
I20260709 13:03:06.534380 11484 leader_election.cc:290] T 40f440212cf64606bbd7ddbf7bf153af P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331), 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205)
I20260709 13:03:06.534765 11544 consensus_queue.cc:260] T b0d7238307174b48aa91030413f37fea P 770cf1ff89494e54baba82d84dac5831 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:06.536710 11254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f440212cf64606bbd7ddbf7bf153af" candidate_uuid: "244b85b5155e4f58a13b566c50083890" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1ee21679c764758a302a52b2f954b5b" is_pre_election: true
I20260709 13:03:06.538005 11544 ts_tablet_manager.cc:1434] T b0d7238307174b48aa91030413f37fea P 770cf1ff89494e54baba82d84dac5831: Time spent starting tablet: real 0.016s	user 0.009s	sys 0.000s
W20260709 13:03:06.539093 11366 leader_election.cc:343] T 40f440212cf64606bbd7ddbf7bf153af P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:06.539762 11544 tablet_bootstrap.cc:492] T 9ee4855c256940e7819fac4e5d729b0d P 770cf1ff89494e54baba82d84dac5831: Bootstrap starting.
I20260709 13:03:06.542145 11545 tablet_bootstrap.cc:492] T 2634154f9f364cfea520c15a5ad325ed P e1ee21679c764758a302a52b2f954b5b: No bootstrap required, opened a new log
I20260709 13:03:06.542932 11545 ts_tablet_manager.cc:1403] T 2634154f9f364cfea520c15a5ad325ed P e1ee21679c764758a302a52b2f954b5b: Time spent bootstrapping tablet: real 0.123s	user 0.012s	sys 0.002s
I20260709 13:03:06.549309 11327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ab0a1ca9a548b69b4af26987138b42" candidate_uuid: "e1ee21679c764758a302a52b2f954b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770cf1ff89494e54baba82d84dac5831" is_pre_election: true
I20260709 13:03:06.561894 11327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee4855c256940e7819fac4e5d729b0d" candidate_uuid: "e1ee21679c764758a302a52b2f954b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770cf1ff89494e54baba82d84dac5831" is_pre_election: true
I20260709 13:03:06.563114 11544 tablet_bootstrap.cc:654] T 9ee4855c256940e7819fac4e5d729b0d P 770cf1ff89494e54baba82d84dac5831: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:06.594023 11560 raft_consensus.cc:493] T a271b64cf17e4bb2994ab9820417f2e8 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.594923 11560 raft_consensus.cc:515] T a271b64cf17e4bb2994ab9820417f2e8 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:06.598390 11560 leader_election.cc:290] T a271b64cf17e4bb2994ab9820417f2e8 P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205), 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445)
I20260709 13:03:06.606571 11560 raft_consensus.cc:493] T 59c4fef046b94123b15bb064ae4bacc5 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.607661 11560 raft_consensus.cc:515] T 59c4fef046b94123b15bb064ae4bacc5 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:06.610639 11560 leader_election.cc:290] T 59c4fef046b94123b15bb064ae4bacc5 P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205), 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445)
I20260709 13:03:06.631204 11530 raft_consensus.cc:493] T 1d3a3c192f1a498cb0c2253625c69f3a P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.632000 11530 raft_consensus.cc:515] T 1d3a3c192f1a498cb0c2253625c69f3a P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:06.635710 11530 leader_election.cc:290] T 1d3a3c192f1a498cb0c2253625c69f3a P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205), 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445)
W20260709 13:03:06.661892 11217 leader_election.cc:343] T 97ab0a1ca9a548b69b4af26987138b42 P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:06.673393 11484 raft_consensus.cc:493] T a271b64cf17e4bb2994ab9820417f2e8 P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.711024 11484 raft_consensus.cc:515] T a271b64cf17e4bb2994ab9820417f2e8 P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:06.660472 11545 raft_consensus.cc:359] T 2634154f9f364cfea520c15a5ad325ed P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:06.751492 11254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a271b64cf17e4bb2994ab9820417f2e8" candidate_uuid: "244b85b5155e4f58a13b566c50083890" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1ee21679c764758a302a52b2f954b5b" is_pre_election: true
I20260709 13:03:06.752687 11254 raft_consensus.cc:2468] T a271b64cf17e4bb2994ab9820417f2e8 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 244b85b5155e4f58a13b566c50083890 in term 0.
I20260709 13:03:06.755254 11366 leader_election.cc:304] T a271b64cf17e4bb2994ab9820417f2e8 P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 244b85b5155e4f58a13b566c50083890, e1ee21679c764758a302a52b2f954b5b; no voters: 
I20260709 13:03:06.758836 11484 leader_election.cc:290] T a271b64cf17e4bb2994ab9820417f2e8 P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331), 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205)
W20260709 13:03:06.733721 11217 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39205, user_credentials={real_user=slave}} blocked reactor thread for 71890.2us
W20260709 13:03:06.764585 11217 leader_election.cc:343] T 9ee4855c256940e7819fac4e5d729b0d P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:06.767201 11484 raft_consensus.cc:493] T 676042afc21b4ff5b2f7146544765db1 P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.771734 11484 raft_consensus.cc:515] T 676042afc21b4ff5b2f7146544765db1 P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:06.804293 11327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a271b64cf17e4bb2994ab9820417f2e8" candidate_uuid: "e1ee21679c764758a302a52b2f954b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770cf1ff89494e54baba82d84dac5831" is_pre_election: true
I20260709 13:03:06.805271 11327 raft_consensus.cc:2468] T a271b64cf17e4bb2994ab9820417f2e8 P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1ee21679c764758a302a52b2f954b5b in term 0.
I20260709 13:03:06.806090 11484 leader_election.cc:290] T 676042afc21b4ff5b2f7146544765db1 P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331), 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205)
I20260709 13:03:06.806236 11543 tablet_bootstrap.cc:492] T 9ee4855c256940e7819fac4e5d729b0d P 244b85b5155e4f58a13b566c50083890: No bootstrap required, opened a new log
I20260709 13:03:06.807140 11543 ts_tablet_manager.cc:1403] T 9ee4855c256940e7819fac4e5d729b0d P 244b85b5155e4f58a13b566c50083890: Time spent bootstrapping tablet: real 0.411s	user 0.080s	sys 0.158s
I20260709 13:03:06.769912 11545 raft_consensus.cc:385] T 2634154f9f364cfea520c15a5ad325ed P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:06.810084 11327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c4fef046b94123b15bb064ae4bacc5" candidate_uuid: "e1ee21679c764758a302a52b2f954b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770cf1ff89494e54baba82d84dac5831" is_pre_election: true
I20260709 13:03:06.810681 11544 tablet_bootstrap.cc:492] T 9ee4855c256940e7819fac4e5d729b0d P 770cf1ff89494e54baba82d84dac5831: No bootstrap required, opened a new log
I20260709 13:03:06.811177 11543 raft_consensus.cc:359] T 9ee4855c256940e7819fac4e5d729b0d P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:06.811792 11327 raft_consensus.cc:2468] T 59c4fef046b94123b15bb064ae4bacc5 P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1ee21679c764758a302a52b2f954b5b in term 0.
I20260709 13:03:06.812132 11544 ts_tablet_manager.cc:1403] T 9ee4855c256940e7819fac4e5d729b0d P 770cf1ff89494e54baba82d84dac5831: Time spent bootstrapping tablet: real 0.273s	user 0.052s	sys 0.036s
W20260709 13:03:06.811270 11366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.193:33331, user_credentials={real_user=slave}} blocked reactor thread for 56196.6us
I20260709 13:03:06.813817 11329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3a3c192f1a498cb0c2253625c69f3a" candidate_uuid: "e1ee21679c764758a302a52b2f954b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770cf1ff89494e54baba82d84dac5831" is_pre_election: true
I20260709 13:03:06.812207 11543 raft_consensus.cc:385] T 9ee4855c256940e7819fac4e5d729b0d P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:06.814318 11217 leader_election.cc:304] T a271b64cf17e4bb2994ab9820417f2e8 P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 770cf1ff89494e54baba82d84dac5831, e1ee21679c764758a302a52b2f954b5b; no voters: 
I20260709 13:03:06.814792 11484 raft_consensus.cc:2804] T a271b64cf17e4bb2994ab9820417f2e8 P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:06.815274 11484 raft_consensus.cc:493] T a271b64cf17e4bb2994ab9820417f2e8 P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:06.815685 11484 raft_consensus.cc:3060] T a271b64cf17e4bb2994ab9820417f2e8 P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:06.815940 11254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "676042afc21b4ff5b2f7146544765db1" candidate_uuid: "244b85b5155e4f58a13b566c50083890" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1ee21679c764758a302a52b2f954b5b" is_pre_election: true
I20260709 13:03:06.814615 11329 raft_consensus.cc:2468] T 1d3a3c192f1a498cb0c2253625c69f3a P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1ee21679c764758a302a52b2f954b5b in term 0.
I20260709 13:03:06.816220 11544 raft_consensus.cc:359] T 9ee4855c256940e7819fac4e5d729b0d P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:06.816757 11254 raft_consensus.cc:2468] T 676042afc21b4ff5b2f7146544765db1 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 244b85b5155e4f58a13b566c50083890 in term 0.
I20260709 13:03:06.817167 11544 raft_consensus.cc:385] T 9ee4855c256940e7819fac4e5d729b0d P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:06.817562 11544 raft_consensus.cc:740] T 9ee4855c256940e7819fac4e5d729b0d P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 770cf1ff89494e54baba82d84dac5831, State: Initialized, Role: FOLLOWER
I20260709 13:03:06.818244 11366 leader_election.cc:304] T 676042afc21b4ff5b2f7146544765db1 P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 244b85b5155e4f58a13b566c50083890, e1ee21679c764758a302a52b2f954b5b; no voters: 
I20260709 13:03:06.818581 11530 raft_consensus.cc:493] T 676042afc21b4ff5b2f7146544765db1 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:06.818361 11544 consensus_queue.cc:260] T 9ee4855c256940e7819fac4e5d729b0d P 770cf1ff89494e54baba82d84dac5831 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:06.819274 11566 raft_consensus.cc:2804] T 676042afc21b4ff5b2f7146544765db1 P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:06.819183 11530 raft_consensus.cc:515] T 676042afc21b4ff5b2f7146544765db1 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:06.819785 11566 raft_consensus.cc:493] T 676042afc21b4ff5b2f7146544765db1 P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:06.820211 11566 raft_consensus.cc:3060] T 676042afc21b4ff5b2f7146544765db1 P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:06.821270 11544 ts_tablet_manager.cc:1434] T 9ee4855c256940e7819fac4e5d729b0d P 770cf1ff89494e54baba82d84dac5831: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:03:06.822592 11544 tablet_bootstrap.cc:492] T 676042afc21b4ff5b2f7146544765db1 P 770cf1ff89494e54baba82d84dac5831: Bootstrap starting.
I20260709 13:03:06.825080 11530 leader_election.cc:290] T 676042afc21b4ff5b2f7146544765db1 P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205), 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445)
I20260709 13:03:06.825769 11559 raft_consensus.cc:2804] T a271b64cf17e4bb2994ab9820417f2e8 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:06.814540 11543 raft_consensus.cc:740] T 9ee4855c256940e7819fac4e5d729b0d P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 244b85b5155e4f58a13b566c50083890, State: Initialized, Role: FOLLOWER
I20260709 13:03:06.827195 11559 raft_consensus.cc:493] T a271b64cf17e4bb2994ab9820417f2e8 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:06.827838 11559 raft_consensus.cc:3060] T a271b64cf17e4bb2994ab9820417f2e8 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:06.827729 11543 consensus_queue.cc:260] T 9ee4855c256940e7819fac4e5d729b0d P 244b85b5155e4f58a13b566c50083890 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:06.830166 11544 tablet_bootstrap.cc:654] T 676042afc21b4ff5b2f7146544765db1 P 770cf1ff89494e54baba82d84dac5831: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:06.830354 11217 leader_election.cc:304] T 1d3a3c192f1a498cb0c2253625c69f3a P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 770cf1ff89494e54baba82d84dac5831, e1ee21679c764758a302a52b2f954b5b; no voters: 
I20260709 13:03:06.830782 11543 ts_tablet_manager.cc:1434] T 9ee4855c256940e7819fac4e5d729b0d P 244b85b5155e4f58a13b566c50083890: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.003s
I20260709 13:03:06.831022 11327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "676042afc21b4ff5b2f7146544765db1" candidate_uuid: "e1ee21679c764758a302a52b2f954b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770cf1ff89494e54baba82d84dac5831" is_pre_election: true
I20260709 13:03:06.831847 11217 leader_election.cc:304] T 59c4fef046b94123b15bb064ae4bacc5 P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 770cf1ff89494e54baba82d84dac5831, e1ee21679c764758a302a52b2f954b5b; no voters: 
I20260709 13:03:06.831766 11560 raft_consensus.cc:2804] T 1d3a3c192f1a498cb0c2253625c69f3a P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:06.832682 11560 raft_consensus.cc:493] T 1d3a3c192f1a498cb0c2253625c69f3a P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:06.833180 11560 raft_consensus.cc:3060] T 1d3a3c192f1a498cb0c2253625c69f3a P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:06.833635 11530 raft_consensus.cc:2804] T 59c4fef046b94123b15bb064ae4bacc5 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:06.834092 11530 raft_consensus.cc:493] T 59c4fef046b94123b15bb064ae4bacc5 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:06.834510 11530 raft_consensus.cc:3060] T 59c4fef046b94123b15bb064ae4bacc5 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:06.837159 11484 raft_consensus.cc:515] T a271b64cf17e4bb2994ab9820417f2e8 P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:06.832078 11543 tablet_bootstrap.cc:492] T 59c4fef046b94123b15bb064ae4bacc5 P 244b85b5155e4f58a13b566c50083890: Bootstrap starting.
I20260709 13:03:06.841142 11566 raft_consensus.cc:515] T 676042afc21b4ff5b2f7146544765db1 P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:06.845324 11254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "676042afc21b4ff5b2f7146544765db1" candidate_uuid: "244b85b5155e4f58a13b566c50083890" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1ee21679c764758a302a52b2f954b5b"
I20260709 13:03:06.846072 11254 raft_consensus.cc:3060] T 676042afc21b4ff5b2f7146544765db1 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:06.849887 11543 tablet_bootstrap.cc:654] T 59c4fef046b94123b15bb064ae4bacc5 P 244b85b5155e4f58a13b566c50083890: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:06.854367 11253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a271b64cf17e4bb2994ab9820417f2e8" candidate_uuid: "244b85b5155e4f58a13b566c50083890" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1ee21679c764758a302a52b2f954b5b"
I20260709 13:03:06.855732 11254 raft_consensus.cc:2468] T 676042afc21b4ff5b2f7146544765db1 P e1ee21679c764758a302a52b2f954b5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 244b85b5155e4f58a13b566c50083890 in term 1.
I20260709 13:03:06.852051 11484 leader_election.cc:290] T a271b64cf17e4bb2994ab9820417f2e8 P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 1 election: Requested vote from peers e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331), 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205)
I20260709 13:03:06.857395 11366 leader_election.cc:304] T 676042afc21b4ff5b2f7146544765db1 P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 244b85b5155e4f58a13b566c50083890, e1ee21679c764758a302a52b2f954b5b; no voters: 
I20260709 13:03:06.860903 11484 raft_consensus.cc:2804] T 676042afc21b4ff5b2f7146544765db1 P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:06.862192 11484 raft_consensus.cc:697] T 676042afc21b4ff5b2f7146544765db1 P 244b85b5155e4f58a13b566c50083890 [term 1 LEADER]: Becoming Leader. State: Replica: 244b85b5155e4f58a13b566c50083890, State: Running, Role: LEADER
I20260709 13:03:06.862527 11530 raft_consensus.cc:515] T 59c4fef046b94123b15bb064ae4bacc5 P e1ee21679c764758a302a52b2f954b5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:06.866345 11566 leader_election.cc:290] T 676042afc21b4ff5b2f7146544765db1 P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 1 election: Requested vote from peers e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331), 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205)
I20260709 13:03:06.810912 11545 raft_consensus.cc:740] T 2634154f9f364cfea520c15a5ad325ed P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1ee21679c764758a302a52b2f954b5b, State: Initialized, Role: FOLLOWER
I20260709 13:03:07.094089 11530 leader_election.cc:290] T 59c4fef046b94123b15bb064ae4bacc5 P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 election: Requested vote from peers 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205), 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445)
I20260709 13:03:07.110733 11545 consensus_queue.cc:260] T 2634154f9f364cfea520c15a5ad325ed P e1ee21679c764758a302a52b2f954b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:07.114492 11545 ts_tablet_manager.cc:1434] T 2634154f9f364cfea520c15a5ad325ed P e1ee21679c764758a302a52b2f954b5b: Time spent starting tablet: real 0.571s	user 0.004s	sys 0.010s
W20260709 13:03:07.114954 11545 ts_tablet_manager.cc:1467] T 2634154f9f364cfea520c15a5ad325ed P e1ee21679c764758a302a52b2f954b5b: Tablet startup took 571ms
I20260709 13:03:07.121042 11403 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ab0a1ca9a548b69b4af26987138b42" candidate_uuid: "e1ee21679c764758a302a52b2f954b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "244b85b5155e4f58a13b566c50083890" is_pre_election: true
I20260709 13:03:07.125608 11400 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c4fef046b94123b15bb064ae4bacc5" candidate_uuid: "e1ee21679c764758a302a52b2f954b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "244b85b5155e4f58a13b566c50083890" is_pre_election: true
I20260709 13:03:07.126009 11399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3a3c192f1a498cb0c2253625c69f3a" candidate_uuid: "e1ee21679c764758a302a52b2f954b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "244b85b5155e4f58a13b566c50083890" is_pre_election: true
I20260709 13:03:07.136677 11566 raft_consensus.cc:493] T 9ee4855c256940e7819fac4e5d729b0d P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.147384 11566 raft_consensus.cc:515] T 9ee4855c256940e7819fac4e5d729b0d P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:07.151295 11566 leader_election.cc:290] T 9ee4855c256940e7819fac4e5d729b0d P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331), 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205)
W20260709 13:03:07.137802 11295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34445, user_credentials={real_user=slave}} blocked reactor thread for 297617us
I20260709 13:03:07.168277 11254 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee4855c256940e7819fac4e5d729b0d" candidate_uuid: "244b85b5155e4f58a13b566c50083890" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1ee21679c764758a302a52b2f954b5b" is_pre_election: true
I20260709 13:03:07.169157 11571 raft_consensus.cc:493] T 40f440212cf64606bbd7ddbf7bf153af P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.179692 11254 raft_consensus.cc:2468] T 9ee4855c256940e7819fac4e5d729b0d P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 244b85b5155e4f58a13b566c50083890 in term 0.
I20260709 13:03:07.183459 11571 raft_consensus.cc:515] T 40f440212cf64606bbd7ddbf7bf153af P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:07.188383 11571 leader_election.cc:290] T 40f440212cf64606bbd7ddbf7bf153af P 770cf1ff89494e54baba82d84dac5831 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331), 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445)
I20260709 13:03:07.190843 11252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f440212cf64606bbd7ddbf7bf153af" candidate_uuid: "770cf1ff89494e54baba82d84dac5831" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1ee21679c764758a302a52b2f954b5b" is_pre_election: true
I20260709 13:03:07.196354 11399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "676042afc21b4ff5b2f7146544765db1" candidate_uuid: "e1ee21679c764758a302a52b2f954b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "244b85b5155e4f58a13b566c50083890" is_pre_election: true
W20260709 13:03:07.169565 11217 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.0.107.194:39205, user_credentials={real_user=slave}} blocked reactor thread for 337807us
I20260709 13:03:07.198627 11401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a271b64cf17e4bb2994ab9820417f2e8" candidate_uuid: "e1ee21679c764758a302a52b2f954b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "244b85b5155e4f58a13b566c50083890" is_pre_election: true
I20260709 13:03:07.205673 11401 raft_consensus.cc:2393] T a271b64cf17e4bb2994ab9820417f2e8 P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e1ee21679c764758a302a52b2f954b5b in current term 1: Already voted for candidate 244b85b5155e4f58a13b566c50083890 in this term.
I20260709 13:03:07.205003 11399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c4fef046b94123b15bb064ae4bacc5" candidate_uuid: "e1ee21679c764758a302a52b2f954b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "244b85b5155e4f58a13b566c50083890"
W20260709 13:03:07.205726 11292 leader_election.cc:343] T 40f440212cf64606bbd7ddbf7bf153af P 770cf1ff89494e54baba82d84dac5831 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:07.212805 11399 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f440212cf64606bbd7ddbf7bf153af" candidate_uuid: "770cf1ff89494e54baba82d84dac5831" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "244b85b5155e4f58a13b566c50083890" is_pre_election: true
I20260709 13:03:07.213810 11399 raft_consensus.cc:2468] T 40f440212cf64606bbd7ddbf7bf153af P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 770cf1ff89494e54baba82d84dac5831 in term 0.
I20260709 13:03:07.215015 11402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee4855c256940e7819fac4e5d729b0d" candidate_uuid: "e1ee21679c764758a302a52b2f954b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "244b85b5155e4f58a13b566c50083890" is_pre_election: true
I20260709 13:03:07.215768 11402 raft_consensus.cc:2468] T 9ee4855c256940e7819fac4e5d729b0d P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1ee21679c764758a302a52b2f954b5b in term 0.
I20260709 13:03:07.216413 11295 leader_election.cc:304] T 40f440212cf64606bbd7ddbf7bf153af P 770cf1ff89494e54baba82d84dac5831 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 244b85b5155e4f58a13b566c50083890, 770cf1ff89494e54baba82d84dac5831; no voters: e1ee21679c764758a302a52b2f954b5b
W20260709 13:03:07.217245 11220 leader_election.cc:343] T 97ab0a1ca9a548b69b4af26987138b42 P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:07.218329 11220 leader_election.cc:304] T 97ab0a1ca9a548b69b4af26987138b42 P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1ee21679c764758a302a52b2f954b5b; no voters: 244b85b5155e4f58a13b566c50083890, 770cf1ff89494e54baba82d84dac5831
I20260709 13:03:07.218480 11560 raft_consensus.cc:515] T 1d3a3c192f1a498cb0c2253625c69f3a P e1ee21679c764758a302a52b2f954b5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:07.219408 11366 leader_election.cc:304] T 9ee4855c256940e7819fac4e5d729b0d P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 244b85b5155e4f58a13b566c50083890, e1ee21679c764758a302a52b2f954b5b; no voters: 
I20260709 13:03:07.221668 11560 leader_election.cc:290] T 1d3a3c192f1a498cb0c2253625c69f3a P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 election: Requested vote from peers 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205), 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445)
I20260709 13:03:07.221822 11566 raft_consensus.cc:2804] T 9ee4855c256940e7819fac4e5d729b0d P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:07.222355 11566 raft_consensus.cc:493] T 9ee4855c256940e7819fac4e5d729b0d P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:03:07.223026 11220 leader_election.cc:343] T 59c4fef046b94123b15bb064ae4bacc5 P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:07.223547 11574 raft_consensus.cc:2749] T 97ab0a1ca9a548b69b4af26987138b42 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:03:07.224391 11220 leader_election.cc:343] T 1d3a3c192f1a498cb0c2253625c69f3a P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:07.228744 11200 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:03:07.224989 11217 leader_election.cc:343] T 676042afc21b4ff5b2f7146544765db1 P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:03:07.115309 11545 ts_tablet_manager.cc:1469] T 2634154f9f364cfea520c15a5ad325ed P e1ee21679c764758a302a52b2f954b5b: Trace:
0709 13:03:05.896819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:05.897078 (+   259us) service_pool.cc:224] Handling call
0709 13:03:05.899099 (+  2021us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:03:05.899198 (+    99us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:03:06.131109 (+231911us) tablet_metadata.cc:665] Metadata flushed
0709 13:03:06.181899 (+ 50790us) tablet_replica.cc:206] Creating consensus instance
0709 13:03:06.182477 (+   578us) inbound_call.cc:177] Queueing success response
0709 13:03:06.420097 (+237620us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 13:03:06.543308 (+123211us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 13:03:06.543988 (+   680us) tablet_replica.cc:261] Starting instrumentation
0709 13:03:06.658171 (+114183us) tablet_replica.cc:280] Starting consensus
Metrics: {"raft.queue_time_us":80312,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":145,"tablet-open.queue_time_us":237724}
I20260709 13:03:07.233335 11545 tablet_bootstrap.cc:492] T b0d7238307174b48aa91030413f37fea P e1ee21679c764758a302a52b2f954b5b: Bootstrap starting.
I20260709 13:03:07.241029 11545 tablet_bootstrap.cc:654] T b0d7238307174b48aa91030413f37fea P e1ee21679c764758a302a52b2f954b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:07.247046 11572 raft_consensus.cc:2804] T 40f440212cf64606bbd7ddbf7bf153af P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:07.247651 11572 raft_consensus.cc:493] T 40f440212cf64606bbd7ddbf7bf153af P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:07.247385 11220 leader_election.cc:304] T 676042afc21b4ff5b2f7146544765db1 P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1ee21679c764758a302a52b2f954b5b; no voters: 244b85b5155e4f58a13b566c50083890, 770cf1ff89494e54baba82d84dac5831
I20260709 13:03:07.248260 11572 raft_consensus.cc:3060] T 40f440212cf64606bbd7ddbf7bf153af P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:07.250555 11220 leader_election.cc:343] T 59c4fef046b94123b15bb064ae4bacc5 P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:07.251602 11220 leader_election.cc:304] T 9ee4855c256940e7819fac4e5d729b0d P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 244b85b5155e4f58a13b566c50083890, e1ee21679c764758a302a52b2f954b5b; no voters: 770cf1ff89494e54baba82d84dac5831
I20260709 13:03:07.252621 11530 raft_consensus.cc:2749] T 676042afc21b4ff5b2f7146544765db1 P e1ee21679c764758a302a52b2f954b5b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:07.253455 11530 raft_consensus.cc:2804] T 9ee4855c256940e7819fac4e5d729b0d P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:07.253867 11530 raft_consensus.cc:493] T 9ee4855c256940e7819fac4e5d729b0d P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:07.254261 11530 raft_consensus.cc:3060] T 9ee4855c256940e7819fac4e5d729b0d P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:07.254936 11402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3a3c192f1a498cb0c2253625c69f3a" candidate_uuid: "e1ee21679c764758a302a52b2f954b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "244b85b5155e4f58a13b566c50083890"
I20260709 13:03:07.257352 11327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c4fef046b94123b15bb064ae4bacc5" candidate_uuid: "e1ee21679c764758a302a52b2f954b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770cf1ff89494e54baba82d84dac5831"
I20260709 13:03:07.258181 11327 raft_consensus.cc:3060] T 59c4fef046b94123b15bb064ae4bacc5 P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:07.259316 11572 raft_consensus.cc:515] T 40f440212cf64606bbd7ddbf7bf153af P 770cf1ff89494e54baba82d84dac5831 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:07.262079 11572 leader_election.cc:290] T 40f440212cf64606bbd7ddbf7bf153af P 770cf1ff89494e54baba82d84dac5831 [CANDIDATE]: Term 1 election: Requested vote from peers e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331), 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445)
I20260709 13:03:07.264788 11329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3a3c192f1a498cb0c2253625c69f3a" candidate_uuid: "e1ee21679c764758a302a52b2f954b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770cf1ff89494e54baba82d84dac5831"
I20260709 13:03:07.265853 11329 raft_consensus.cc:3060] T 1d3a3c192f1a498cb0c2253625c69f3a P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:07.266981 11401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f440212cf64606bbd7ddbf7bf153af" candidate_uuid: "770cf1ff89494e54baba82d84dac5831" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "244b85b5155e4f58a13b566c50083890"
I20260709 13:03:07.267834 11401 raft_consensus.cc:3060] T 40f440212cf64606bbd7ddbf7bf153af P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:07.270787 11220 leader_election.cc:343] T 1d3a3c192f1a498cb0c2253625c69f3a P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:07.267450 11544 tablet_bootstrap.cc:492] T 676042afc21b4ff5b2f7146544765db1 P 770cf1ff89494e54baba82d84dac5831: No bootstrap required, opened a new log
I20260709 13:03:07.276813 11544 ts_tablet_manager.cc:1403] T 676042afc21b4ff5b2f7146544765db1 P 770cf1ff89494e54baba82d84dac5831: Time spent bootstrapping tablet: real 0.454s	user 0.121s	sys 0.207s
I20260709 13:03:07.277956 11252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f440212cf64606bbd7ddbf7bf153af" candidate_uuid: "770cf1ff89494e54baba82d84dac5831" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1ee21679c764758a302a52b2f954b5b"
I20260709 13:03:07.280992 11401 raft_consensus.cc:2468] T 40f440212cf64606bbd7ddbf7bf153af P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 770cf1ff89494e54baba82d84dac5831 in term 1.
I20260709 13:03:07.281507 11544 raft_consensus.cc:359] T 676042afc21b4ff5b2f7146544765db1 P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:07.282563 11544 raft_consensus.cc:385] T 676042afc21b4ff5b2f7146544765db1 P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:07.283001 11544 raft_consensus.cc:740] T 676042afc21b4ff5b2f7146544765db1 P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 770cf1ff89494e54baba82d84dac5831, State: Initialized, Role: FOLLOWER
I20260709 13:03:07.283115 11295 leader_election.cc:304] T 40f440212cf64606bbd7ddbf7bf153af P 770cf1ff89494e54baba82d84dac5831 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 244b85b5155e4f58a13b566c50083890, 770cf1ff89494e54baba82d84dac5831; no voters: 
I20260709 13:03:07.223112 11566 raft_consensus.cc:3060] T 9ee4855c256940e7819fac4e5d729b0d P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:07.228015 11559 raft_consensus.cc:515] T a271b64cf17e4bb2994ab9820417f2e8 P e1ee21679c764758a302a52b2f954b5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:07.284560 11572 raft_consensus.cc:2804] T 40f440212cf64606bbd7ddbf7bf153af P 770cf1ff89494e54baba82d84dac5831 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:07.285266 11572 raft_consensus.cc:697] T 40f440212cf64606bbd7ddbf7bf153af P 770cf1ff89494e54baba82d84dac5831 [term 1 LEADER]: Becoming Leader. State: Replica: 770cf1ff89494e54baba82d84dac5831, State: Running, Role: LEADER
I20260709 13:03:07.285666 11253 raft_consensus.cc:2393] T a271b64cf17e4bb2994ab9820417f2e8 P e1ee21679c764758a302a52b2f954b5b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 244b85b5155e4f58a13b566c50083890 in current term 1: Already voted for candidate e1ee21679c764758a302a52b2f954b5b in this term.
I20260709 13:03:07.286337 11572 consensus_queue.cc:237] T 40f440212cf64606bbd7ddbf7bf153af P 770cf1ff89494e54baba82d84dac5831 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:07.292431 11559 leader_election.cc:290] T a271b64cf17e4bb2994ab9820417f2e8 P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 election: Requested vote from peers 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205), 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445)
I20260709 13:03:07.284143 11544 consensus_queue.cc:260] T 676042afc21b4ff5b2f7146544765db1 P 770cf1ff89494e54baba82d84dac5831 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:07.295136 11401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a271b64cf17e4bb2994ab9820417f2e8" candidate_uuid: "e1ee21679c764758a302a52b2f954b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "244b85b5155e4f58a13b566c50083890"
I20260709 13:03:07.296098 11401 raft_consensus.cc:2393] T a271b64cf17e4bb2994ab9820417f2e8 P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e1ee21679c764758a302a52b2f954b5b in current term 1: Already voted for candidate 244b85b5155e4f58a13b566c50083890 in this term.
I20260709 13:03:07.297518 11544 ts_tablet_manager.cc:1434] T 676042afc21b4ff5b2f7146544765db1 P 770cf1ff89494e54baba82d84dac5831: Time spent starting tablet: real 0.020s	user 0.010s	sys 0.000s
I20260709 13:03:07.300563 11543 tablet_bootstrap.cc:492] T 59c4fef046b94123b15bb064ae4bacc5 P 244b85b5155e4f58a13b566c50083890: No bootstrap required, opened a new log
I20260709 13:03:07.301383 11543 ts_tablet_manager.cc:1403] T 59c4fef046b94123b15bb064ae4bacc5 P 244b85b5155e4f58a13b566c50083890: Time spent bootstrapping tablet: real 0.470s	user 0.025s	sys 0.000s
I20260709 13:03:07.306190 11543 raft_consensus.cc:359] T 59c4fef046b94123b15bb064ae4bacc5 P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
W20260709 13:03:07.306977 11292 leader_election.cc:343] T 40f440212cf64606bbd7ddbf7bf153af P 770cf1ff89494e54baba82d84dac5831 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:07.307371 11543 raft_consensus.cc:385] T 59c4fef046b94123b15bb064ae4bacc5 P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:07.309151 11543 raft_consensus.cc:740] T 59c4fef046b94123b15bb064ae4bacc5 P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 244b85b5155e4f58a13b566c50083890, State: Initialized, Role: FOLLOWER
I20260709 13:03:07.310122 11543 consensus_queue.cc:260] T 59c4fef046b94123b15bb064ae4bacc5 P 244b85b5155e4f58a13b566c50083890 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:07.311018 11544 tablet_bootstrap.cc:492] T 2634154f9f364cfea520c15a5ad325ed P 770cf1ff89494e54baba82d84dac5831: Bootstrap starting.
I20260709 13:03:07.313141 11326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f440212cf64606bbd7ddbf7bf153af" candidate_uuid: "244b85b5155e4f58a13b566c50083890" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770cf1ff89494e54baba82d84dac5831" is_pre_election: true
I20260709 13:03:07.315354 11543 ts_tablet_manager.cc:1434] T 59c4fef046b94123b15bb064ae4bacc5 P 244b85b5155e4f58a13b566c50083890: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.002s
I20260709 13:03:07.315773 11326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a271b64cf17e4bb2994ab9820417f2e8" candidate_uuid: "244b85b5155e4f58a13b566c50083890" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770cf1ff89494e54baba82d84dac5831" is_pre_election: true
I20260709 13:03:07.317389 11326 raft_consensus.cc:2468] T a271b64cf17e4bb2994ab9820417f2e8 P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 244b85b5155e4f58a13b566c50083890 in term 0.
I20260709 13:03:07.318288 11543 tablet_bootstrap.cc:492] T 2634154f9f364cfea520c15a5ad325ed P 244b85b5155e4f58a13b566c50083890: Bootstrap starting.
I20260709 13:03:07.319947 11328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a271b64cf17e4bb2994ab9820417f2e8" candidate_uuid: "244b85b5155e4f58a13b566c50083890" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770cf1ff89494e54baba82d84dac5831"
I20260709 13:03:07.320667 11328 raft_consensus.cc:3060] T a271b64cf17e4bb2994ab9820417f2e8 P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:07.320506 11326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "676042afc21b4ff5b2f7146544765db1" candidate_uuid: "244b85b5155e4f58a13b566c50083890" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770cf1ff89494e54baba82d84dac5831" is_pre_election: true
I20260709 13:03:07.329816 11328 raft_consensus.cc:2468] T a271b64cf17e4bb2994ab9820417f2e8 P 770cf1ff89494e54baba82d84dac5831 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 244b85b5155e4f58a13b566c50083890 in term 1.
I20260709 13:03:07.329896 11326 raft_consensus.cc:2468] T 676042afc21b4ff5b2f7146544765db1 P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 244b85b5155e4f58a13b566c50083890 in term 0.
I20260709 13:03:07.330706 11544 tablet_bootstrap.cc:654] T 2634154f9f364cfea520c15a5ad325ed P 770cf1ff89494e54baba82d84dac5831: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:07.338351 11543 tablet_bootstrap.cc:654] T 2634154f9f364cfea520c15a5ad325ed P 244b85b5155e4f58a13b566c50083890: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:06.869215 11484 consensus_queue.cc:237] T 676042afc21b4ff5b2f7146544765db1 P 244b85b5155e4f58a13b566c50083890 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:07.344295 11544 tablet_bootstrap.cc:492] T 2634154f9f364cfea520c15a5ad325ed P 770cf1ff89494e54baba82d84dac5831: No bootstrap required, opened a new log
I20260709 13:03:07.345028 11544 ts_tablet_manager.cc:1403] T 2634154f9f364cfea520c15a5ad325ed P 770cf1ff89494e54baba82d84dac5831: Time spent bootstrapping tablet: real 0.037s	user 0.014s	sys 0.000s
I20260709 13:03:07.345861 11327 raft_consensus.cc:2468] T 59c4fef046b94123b15bb064ae4bacc5 P 770cf1ff89494e54baba82d84dac5831 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1ee21679c764758a302a52b2f954b5b in term 1.
I20260709 13:03:07.348403 11544 raft_consensus.cc:359] T 2634154f9f364cfea520c15a5ad325ed P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:07.349087 11325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "676042afc21b4ff5b2f7146544765db1" candidate_uuid: "244b85b5155e4f58a13b566c50083890" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770cf1ff89494e54baba82d84dac5831"
I20260709 13:03:07.350251 11544 raft_consensus.cc:385] T 2634154f9f364cfea520c15a5ad325ed P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:07.350483 11325 raft_consensus.cc:3060] T 676042afc21b4ff5b2f7146544765db1 P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:07.350615 11544 raft_consensus.cc:740] T 2634154f9f364cfea520c15a5ad325ed P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 770cf1ff89494e54baba82d84dac5831, State: Initialized, Role: FOLLOWER
I20260709 13:03:07.350687 11326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a271b64cf17e4bb2994ab9820417f2e8" candidate_uuid: "e1ee21679c764758a302a52b2f954b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770cf1ff89494e54baba82d84dac5831"
I20260709 13:03:07.352829 11217 leader_election.cc:304] T 59c4fef046b94123b15bb064ae4bacc5 P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 770cf1ff89494e54baba82d84dac5831, e1ee21679c764758a302a52b2f954b5b; no voters: 244b85b5155e4f58a13b566c50083890
I20260709 13:03:07.353125 11326 raft_consensus.cc:2393] T a271b64cf17e4bb2994ab9820417f2e8 P 770cf1ff89494e54baba82d84dac5831 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e1ee21679c764758a302a52b2f954b5b in current term 1: Already voted for candidate 244b85b5155e4f58a13b566c50083890 in this term.
I20260709 13:03:07.353219 11543 tablet_bootstrap.cc:492] T 2634154f9f364cfea520c15a5ad325ed P 244b85b5155e4f58a13b566c50083890: No bootstrap required, opened a new log
I20260709 13:03:07.354079 11543 ts_tablet_manager.cc:1403] T 2634154f9f364cfea520c15a5ad325ed P 244b85b5155e4f58a13b566c50083890: Time spent bootstrapping tablet: real 0.038s	user 0.008s	sys 0.007s
I20260709 13:03:07.354809 11559 raft_consensus.cc:2804] T 59c4fef046b94123b15bb064ae4bacc5 P e1ee21679c764758a302a52b2f954b5b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:07.354522 11544 consensus_queue.cc:260] T 2634154f9f364cfea520c15a5ad325ed P 770cf1ff89494e54baba82d84dac5831 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:07.355397 11559 raft_consensus.cc:697] T 59c4fef046b94123b15bb064ae4bacc5 P e1ee21679c764758a302a52b2f954b5b [term 1 LEADER]: Becoming Leader. State: Replica: e1ee21679c764758a302a52b2f954b5b, State: Running, Role: LEADER
I20260709 13:03:07.356376 11559 consensus_queue.cc:237] T 59c4fef046b94123b15bb064ae4bacc5 P e1ee21679c764758a302a52b2f954b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:07.356972 11544 ts_tablet_manager.cc:1434] T 2634154f9f364cfea520c15a5ad325ed P 770cf1ff89494e54baba82d84dac5831: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:03:07.357601 11543 raft_consensus.cc:359] T 2634154f9f364cfea520c15a5ad325ed P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:07.358042 11544 tablet_bootstrap.cc:492] T 97ab0a1ca9a548b69b4af26987138b42 P 770cf1ff89494e54baba82d84dac5831: Bootstrap starting.
I20260709 13:03:07.358385 11543 raft_consensus.cc:385] T 2634154f9f364cfea520c15a5ad325ed P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:07.358688 11543 raft_consensus.cc:740] T 2634154f9f364cfea520c15a5ad325ed P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 244b85b5155e4f58a13b566c50083890, State: Initialized, Role: FOLLOWER
I20260709 13:03:07.361649 11217 leader_election.cc:304] T a271b64cf17e4bb2994ab9820417f2e8 P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1ee21679c764758a302a52b2f954b5b; no voters: 244b85b5155e4f58a13b566c50083890, 770cf1ff89494e54baba82d84dac5831
I20260709 13:03:07.363080 11574 raft_consensus.cc:2749] T a271b64cf17e4bb2994ab9820417f2e8 P e1ee21679c764758a302a52b2f954b5b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:03:07.363322 11327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee4855c256940e7819fac4e5d729b0d" candidate_uuid: "244b85b5155e4f58a13b566c50083890" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770cf1ff89494e54baba82d84dac5831" is_pre_election: true
I20260709 13:03:07.364081 11327 raft_consensus.cc:2468] T 9ee4855c256940e7819fac4e5d729b0d P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 244b85b5155e4f58a13b566c50083890 in term 0.
I20260709 13:03:07.367122 11530 raft_consensus.cc:515] T 9ee4855c256940e7819fac4e5d729b0d P e1ee21679c764758a302a52b2f954b5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:07.367980 11566 raft_consensus.cc:515] T 9ee4855c256940e7819fac4e5d729b0d P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:07.368827 11366 leader_election.cc:304] T 40f440212cf64606bbd7ddbf7bf153af P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 244b85b5155e4f58a13b566c50083890; no voters: 770cf1ff89494e54baba82d84dac5831, e1ee21679c764758a302a52b2f954b5b
I20260709 13:03:07.369891 11530 leader_election.cc:290] T 9ee4855c256940e7819fac4e5d729b0d P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 election: Requested vote from peers 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205), 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445)
I20260709 13:03:07.360044 11543 consensus_queue.cc:260] T 2634154f9f364cfea520c15a5ad325ed P 244b85b5155e4f58a13b566c50083890 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:07.370846 11565 raft_consensus.cc:2749] T 40f440212cf64606bbd7ddbf7bf153af P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:07.371291 11401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee4855c256940e7819fac4e5d729b0d" candidate_uuid: "e1ee21679c764758a302a52b2f954b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "244b85b5155e4f58a13b566c50083890"
I20260709 13:03:07.375627 11543 ts_tablet_manager.cc:1434] T 2634154f9f364cfea520c15a5ad325ed P 244b85b5155e4f58a13b566c50083890: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.003s
I20260709 13:03:07.377036 11543 tablet_bootstrap.cc:492] T 1d3a3c192f1a498cb0c2253625c69f3a P 244b85b5155e4f58a13b566c50083890: Bootstrap starting.
I20260709 13:03:07.377209 11152 catalog_manager.cc:5697] T 40f440212cf64606bbd7ddbf7bf153af P 770cf1ff89494e54baba82d84dac5831 reported cstate change: term changed from 0 to 1, leader changed from <none> to 770cf1ff89494e54baba82d84dac5831 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "770cf1ff89494e54baba82d84dac5831" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:07.372591 11401 raft_consensus.cc:2393] T 9ee4855c256940e7819fac4e5d729b0d P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e1ee21679c764758a302a52b2f954b5b in current term 1: Already voted for candidate 244b85b5155e4f58a13b566c50083890 in this term.
I20260709 13:03:07.382267 11566 leader_election.cc:290] T 9ee4855c256940e7819fac4e5d729b0d P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 1 election: Requested vote from peers e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331), 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205)
I20260709 13:03:07.367839 11329 raft_consensus.cc:2468] T 1d3a3c192f1a498cb0c2253625c69f3a P 770cf1ff89494e54baba82d84dac5831 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1ee21679c764758a302a52b2f954b5b in term 1.
I20260709 13:03:07.366109 11325 raft_consensus.cc:2468] T 676042afc21b4ff5b2f7146544765db1 P 770cf1ff89494e54baba82d84dac5831 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 244b85b5155e4f58a13b566c50083890 in term 1.
I20260709 13:03:07.385339 11326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee4855c256940e7819fac4e5d729b0d" candidate_uuid: "e1ee21679c764758a302a52b2f954b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770cf1ff89494e54baba82d84dac5831"
I20260709 13:03:07.382776 11366 leader_election.cc:304] T a271b64cf17e4bb2994ab9820417f2e8 P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 244b85b5155e4f58a13b566c50083890, 770cf1ff89494e54baba82d84dac5831; no voters: e1ee21679c764758a302a52b2f954b5b
I20260709 13:03:07.386332 11326 raft_consensus.cc:3060] T 9ee4855c256940e7819fac4e5d729b0d P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:07.389966 11544 tablet_bootstrap.cc:654] T 97ab0a1ca9a548b69b4af26987138b42 P 770cf1ff89494e54baba82d84dac5831: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:07.393271 11566 raft_consensus.cc:2804] T a271b64cf17e4bb2994ab9820417f2e8 P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:07.393975 11566 raft_consensus.cc:697] T a271b64cf17e4bb2994ab9820417f2e8 P 244b85b5155e4f58a13b566c50083890 [term 1 LEADER]: Becoming Leader. State: Replica: 244b85b5155e4f58a13b566c50083890, State: Running, Role: LEADER
I20260709 13:03:07.394937 11545 tablet_bootstrap.cc:492] T b0d7238307174b48aa91030413f37fea P e1ee21679c764758a302a52b2f954b5b: No bootstrap required, opened a new log
I20260709 13:03:07.397956 11252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee4855c256940e7819fac4e5d729b0d" candidate_uuid: "244b85b5155e4f58a13b566c50083890" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1ee21679c764758a302a52b2f954b5b"
I20260709 13:03:07.399385 11252 raft_consensus.cc:2393] T 9ee4855c256940e7819fac4e5d729b0d P e1ee21679c764758a302a52b2f954b5b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 244b85b5155e4f58a13b566c50083890 in current term 1: Already voted for candidate e1ee21679c764758a302a52b2f954b5b in this term.
I20260709 13:03:07.395658 11545 ts_tablet_manager.cc:1403] T b0d7238307174b48aa91030413f37fea P e1ee21679c764758a302a52b2f954b5b: Time spent bootstrapping tablet: real 0.163s	user 0.037s	sys 0.048s
I20260709 13:03:07.401508 11325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee4855c256940e7819fac4e5d729b0d" candidate_uuid: "244b85b5155e4f58a13b566c50083890" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770cf1ff89494e54baba82d84dac5831"
I20260709 13:03:07.394949 11566 consensus_queue.cc:237] T a271b64cf17e4bb2994ab9820417f2e8 P 244b85b5155e4f58a13b566c50083890 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:07.406823 11545 raft_consensus.cc:359] T b0d7238307174b48aa91030413f37fea P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:07.408049 11545 raft_consensus.cc:385] T b0d7238307174b48aa91030413f37fea P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:07.408810 11217 leader_election.cc:304] T 1d3a3c192f1a498cb0c2253625c69f3a P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 770cf1ff89494e54baba82d84dac5831, e1ee21679c764758a302a52b2f954b5b; no voters: 244b85b5155e4f58a13b566c50083890
I20260709 13:03:07.410821 11559 raft_consensus.cc:2804] T 1d3a3c192f1a498cb0c2253625c69f3a P e1ee21679c764758a302a52b2f954b5b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:07.411561 11559 raft_consensus.cc:697] T 1d3a3c192f1a498cb0c2253625c69f3a P e1ee21679c764758a302a52b2f954b5b [term 1 LEADER]: Becoming Leader. State: Replica: e1ee21679c764758a302a52b2f954b5b, State: Running, Role: LEADER
I20260709 13:03:07.412849 11559 consensus_queue.cc:237] T 1d3a3c192f1a498cb0c2253625c69f3a P e1ee21679c764758a302a52b2f954b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:07.416574 11366 leader_election.cc:304] T 9ee4855c256940e7819fac4e5d729b0d P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 244b85b5155e4f58a13b566c50083890; no voters: 770cf1ff89494e54baba82d84dac5831, e1ee21679c764758a302a52b2f954b5b
I20260709 13:03:07.408447 11545 raft_consensus.cc:740] T b0d7238307174b48aa91030413f37fea P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1ee21679c764758a302a52b2f954b5b, State: Initialized, Role: FOLLOWER
I20260709 13:03:07.419250 11545 consensus_queue.cc:260] T b0d7238307174b48aa91030413f37fea P e1ee21679c764758a302a52b2f954b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:07.422359 11543 tablet_bootstrap.cc:654] T 1d3a3c192f1a498cb0c2253625c69f3a P 244b85b5155e4f58a13b566c50083890: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:07.425207 11582 raft_consensus.cc:2749] T 9ee4855c256940e7819fac4e5d729b0d P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:03:07.428637 11545 ts_tablet_manager.cc:1434] T b0d7238307174b48aa91030413f37fea P e1ee21679c764758a302a52b2f954b5b: Time spent starting tablet: real 0.024s	user 0.009s	sys 0.001s
I20260709 13:03:07.429744 11545 tablet_bootstrap.cc:492] T 40f440212cf64606bbd7ddbf7bf153af P e1ee21679c764758a302a52b2f954b5b: Bootstrap starting.
I20260709 13:03:07.439563 11544 tablet_bootstrap.cc:492] T 97ab0a1ca9a548b69b4af26987138b42 P 770cf1ff89494e54baba82d84dac5831: No bootstrap required, opened a new log
I20260709 13:03:07.440279 11544 ts_tablet_manager.cc:1403] T 97ab0a1ca9a548b69b4af26987138b42 P 770cf1ff89494e54baba82d84dac5831: Time spent bootstrapping tablet: real 0.082s	user 0.020s	sys 0.024s
I20260709 13:03:07.434325 11326 raft_consensus.cc:2468] T 9ee4855c256940e7819fac4e5d729b0d P 770cf1ff89494e54baba82d84dac5831 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1ee21679c764758a302a52b2f954b5b in term 1.
I20260709 13:03:07.443063 11217 leader_election.cc:304] T 9ee4855c256940e7819fac4e5d729b0d P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 770cf1ff89494e54baba82d84dac5831, e1ee21679c764758a302a52b2f954b5b; no voters: 244b85b5155e4f58a13b566c50083890
I20260709 13:03:07.444039 11544 raft_consensus.cc:359] T 97ab0a1ca9a548b69b4af26987138b42 P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:07.445214 11544 raft_consensus.cc:385] T 97ab0a1ca9a548b69b4af26987138b42 P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:07.445698 11559 raft_consensus.cc:2804] T 9ee4855c256940e7819fac4e5d729b0d P e1ee21679c764758a302a52b2f954b5b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:07.447494 11559 raft_consensus.cc:697] T 9ee4855c256940e7819fac4e5d729b0d P e1ee21679c764758a302a52b2f954b5b [term 1 LEADER]: Becoming Leader. State: Replica: e1ee21679c764758a302a52b2f954b5b, State: Running, Role: LEADER
I20260709 13:03:07.448438 11559 consensus_queue.cc:237] T 9ee4855c256940e7819fac4e5d729b0d P e1ee21679c764758a302a52b2f954b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:07.451442 11545 tablet_bootstrap.cc:654] T 40f440212cf64606bbd7ddbf7bf153af P e1ee21679c764758a302a52b2f954b5b: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:07.446671 11544 raft_consensus.cc:740] T 97ab0a1ca9a548b69b4af26987138b42 P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 770cf1ff89494e54baba82d84dac5831, State: Initialized, Role: FOLLOWER
I20260709 13:03:07.453672 11544 consensus_queue.cc:260] T 97ab0a1ca9a548b69b4af26987138b42 P 770cf1ff89494e54baba82d84dac5831 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:07.456257 11544 ts_tablet_manager.cc:1434] T 97ab0a1ca9a548b69b4af26987138b42 P 770cf1ff89494e54baba82d84dac5831: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:03:07.456322 11566 raft_consensus.cc:493] T 2634154f9f364cfea520c15a5ad325ed P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.457078 11566 raft_consensus.cc:515] T 2634154f9f364cfea520c15a5ad325ed P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:07.458932 11566 leader_election.cc:290] T 2634154f9f364cfea520c15a5ad325ed P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331), 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205)
I20260709 13:03:07.459836 11530 raft_consensus.cc:493] T 2634154f9f364cfea520c15a5ad325ed P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.461277 11530 raft_consensus.cc:515] T 2634154f9f364cfea520c15a5ad325ed P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:07.461678 11252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2634154f9f364cfea520c15a5ad325ed" candidate_uuid: "244b85b5155e4f58a13b566c50083890" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1ee21679c764758a302a52b2f954b5b" is_pre_election: true
I20260709 13:03:07.462679 11252 raft_consensus.cc:2468] T 2634154f9f364cfea520c15a5ad325ed P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 244b85b5155e4f58a13b566c50083890 in term 0.
I20260709 13:03:07.464888 11366 leader_election.cc:304] T 2634154f9f364cfea520c15a5ad325ed P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 244b85b5155e4f58a13b566c50083890, e1ee21679c764758a302a52b2f954b5b; no voters: 
I20260709 13:03:07.465050 11326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2634154f9f364cfea520c15a5ad325ed" candidate_uuid: "244b85b5155e4f58a13b566c50083890" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770cf1ff89494e54baba82d84dac5831" is_pre_election: true
I20260709 13:03:07.466078 11326 raft_consensus.cc:2468] T 2634154f9f364cfea520c15a5ad325ed P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 244b85b5155e4f58a13b566c50083890 in term 0.
I20260709 13:03:07.468590 11530 leader_election.cc:290] T 2634154f9f364cfea520c15a5ad325ed P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205), 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445)
I20260709 13:03:07.469265 11326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2634154f9f364cfea520c15a5ad325ed" candidate_uuid: "e1ee21679c764758a302a52b2f954b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770cf1ff89494e54baba82d84dac5831" is_pre_election: true
I20260709 13:03:07.469718 11401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2634154f9f364cfea520c15a5ad325ed" candidate_uuid: "e1ee21679c764758a302a52b2f954b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "244b85b5155e4f58a13b566c50083890" is_pre_election: true
I20260709 13:03:07.470854 11326 raft_consensus.cc:2468] T 2634154f9f364cfea520c15a5ad325ed P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1ee21679c764758a302a52b2f954b5b in term 0.
I20260709 13:03:07.469671 11566 raft_consensus.cc:2804] T 2634154f9f364cfea520c15a5ad325ed P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:07.472767 11566 raft_consensus.cc:493] T 2634154f9f364cfea520c15a5ad325ed P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:07.472965 11217 leader_election.cc:304] T 2634154f9f364cfea520c15a5ad325ed P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 770cf1ff89494e54baba82d84dac5831, e1ee21679c764758a302a52b2f954b5b; no voters: 
I20260709 13:03:07.473326 11566 raft_consensus.cc:3060] T 2634154f9f364cfea520c15a5ad325ed P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:07.475713 11559 raft_consensus.cc:2804] T 2634154f9f364cfea520c15a5ad325ed P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:07.476817 11559 raft_consensus.cc:493] T 2634154f9f364cfea520c15a5ad325ed P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:07.477227 11559 raft_consensus.cc:3060] T 2634154f9f364cfea520c15a5ad325ed P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:07.481561 11543 tablet_bootstrap.cc:492] T 1d3a3c192f1a498cb0c2253625c69f3a P 244b85b5155e4f58a13b566c50083890: No bootstrap required, opened a new log
I20260709 13:03:07.481735 11545 tablet_bootstrap.cc:492] T 40f440212cf64606bbd7ddbf7bf153af P e1ee21679c764758a302a52b2f954b5b: No bootstrap required, opened a new log
I20260709 13:03:07.482302 11543 ts_tablet_manager.cc:1403] T 1d3a3c192f1a498cb0c2253625c69f3a P 244b85b5155e4f58a13b566c50083890: Time spent bootstrapping tablet: real 0.106s	user 0.011s	sys 0.012s
I20260709 13:03:07.482463 11545 ts_tablet_manager.cc:1403] T 40f440212cf64606bbd7ddbf7bf153af P e1ee21679c764758a302a52b2f954b5b: Time spent bootstrapping tablet: real 0.053s	user 0.008s	sys 0.005s
I20260709 13:03:07.485370 11566 raft_consensus.cc:515] T 2634154f9f364cfea520c15a5ad325ed P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:07.486204 11559 raft_consensus.cc:515] T 2634154f9f364cfea520c15a5ad325ed P e1ee21679c764758a302a52b2f954b5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:07.486784 11401 raft_consensus.cc:2393] T 2634154f9f364cfea520c15a5ad325ed P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e1ee21679c764758a302a52b2f954b5b in current term 1: Already voted for candidate 244b85b5155e4f58a13b566c50083890 in this term.
I20260709 13:03:07.488063 11545 raft_consensus.cc:359] T 40f440212cf64606bbd7ddbf7bf153af P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:07.488845 11545 raft_consensus.cc:385] T 40f440212cf64606bbd7ddbf7bf153af P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:07.489003 11566 leader_election.cc:290] T 2634154f9f364cfea520c15a5ad325ed P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 1 election: Requested vote from peers e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331), 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205)
I20260709 13:03:07.489136 11545 raft_consensus.cc:740] T 40f440212cf64606bbd7ddbf7bf153af P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1ee21679c764758a302a52b2f954b5b, State: Initialized, Role: FOLLOWER
I20260709 13:03:07.485904 11543 raft_consensus.cc:359] T 1d3a3c192f1a498cb0c2253625c69f3a P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:07.490222 11545 consensus_queue.cc:260] T 40f440212cf64606bbd7ddbf7bf153af P e1ee21679c764758a302a52b2f954b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:07.490875 11573 raft_consensus.cc:493] T 97ab0a1ca9a548b69b4af26987138b42 P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.491468 11573 raft_consensus.cc:515] T 97ab0a1ca9a548b69b4af26987138b42 P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:07.491039 11252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2634154f9f364cfea520c15a5ad325ed" candidate_uuid: "244b85b5155e4f58a13b566c50083890" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1ee21679c764758a302a52b2f954b5b"
I20260709 13:03:07.490222 11543 raft_consensus.cc:385] T 1d3a3c192f1a498cb0c2253625c69f3a P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:07.492755 11543 raft_consensus.cc:740] T 1d3a3c192f1a498cb0c2253625c69f3a P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 244b85b5155e4f58a13b566c50083890, State: Initialized, Role: FOLLOWER
I20260709 13:03:07.493105 11545 ts_tablet_manager.cc:1434] T 40f440212cf64606bbd7ddbf7bf153af P e1ee21679c764758a302a52b2f954b5b: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 13:03:07.493414 11252 raft_consensus.cc:2393] T 2634154f9f364cfea520c15a5ad325ed P e1ee21679c764758a302a52b2f954b5b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 244b85b5155e4f58a13b566c50083890 in current term 1: Already voted for candidate e1ee21679c764758a302a52b2f954b5b in this term.
I20260709 13:03:07.493784 11543 consensus_queue.cc:260] T 1d3a3c192f1a498cb0c2253625c69f3a P 244b85b5155e4f58a13b566c50083890 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:07.495565 11559 leader_election.cc:290] T 2634154f9f364cfea520c15a5ad325ed P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 election: Requested vote from peers 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205), 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445)
I20260709 13:03:07.496393 11543 ts_tablet_manager.cc:1434] T 1d3a3c192f1a498cb0c2253625c69f3a P 244b85b5155e4f58a13b566c50083890: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.003s
I20260709 13:03:07.496804 11401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ab0a1ca9a548b69b4af26987138b42" candidate_uuid: "770cf1ff89494e54baba82d84dac5831" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "244b85b5155e4f58a13b566c50083890" is_pre_election: true
I20260709 13:03:07.497148 11326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2634154f9f364cfea520c15a5ad325ed" candidate_uuid: "244b85b5155e4f58a13b566c50083890" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770cf1ff89494e54baba82d84dac5831"
I20260709 13:03:07.497601 11543 tablet_bootstrap.cc:492] T b0d7238307174b48aa91030413f37fea P 244b85b5155e4f58a13b566c50083890: Bootstrap starting.
I20260709 13:03:07.496850 11329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2634154f9f364cfea520c15a5ad325ed" candidate_uuid: "e1ee21679c764758a302a52b2f954b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770cf1ff89494e54baba82d84dac5831"
W20260709 13:03:07.499320 11295 leader_election.cc:343] T 97ab0a1ca9a548b69b4af26987138b42 P 770cf1ff89494e54baba82d84dac5831 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:07.500126 11401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2634154f9f364cfea520c15a5ad325ed" candidate_uuid: "e1ee21679c764758a302a52b2f954b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "244b85b5155e4f58a13b566c50083890"
I20260709 13:03:07.500229 11252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ab0a1ca9a548b69b4af26987138b42" candidate_uuid: "770cf1ff89494e54baba82d84dac5831" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1ee21679c764758a302a52b2f954b5b" is_pre_election: true
I20260709 13:03:07.497828 11326 raft_consensus.cc:3060] T 2634154f9f364cfea520c15a5ad325ed P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:07.501058 11252 raft_consensus.cc:2468] T 97ab0a1ca9a548b69b4af26987138b42 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 770cf1ff89494e54baba82d84dac5831 in term 0.
I20260709 13:03:07.501681 11573 leader_election.cc:290] T 97ab0a1ca9a548b69b4af26987138b42 P 770cf1ff89494e54baba82d84dac5831 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331), 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445)
I20260709 13:03:07.501425 11149 catalog_manager.cc:5697] T 59c4fef046b94123b15bb064ae4bacc5 P e1ee21679c764758a302a52b2f954b5b reported cstate change: term changed from 0 to 1, leader changed from <none> to e1ee21679c764758a302a52b2f954b5b (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e1ee21679c764758a302a52b2f954b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:07.501065 11401 raft_consensus.cc:2393] T 2634154f9f364cfea520c15a5ad325ed P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e1ee21679c764758a302a52b2f954b5b in current term 1: Already voted for candidate 244b85b5155e4f58a13b566c50083890 in this term.
I20260709 13:03:07.501941 11148 catalog_manager.cc:5697] T 676042afc21b4ff5b2f7146544765db1 P 244b85b5155e4f58a13b566c50083890 reported cstate change: term changed from 0 to 1, leader changed from <none> to 244b85b5155e4f58a13b566c50083890 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "244b85b5155e4f58a13b566c50083890" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:07.503703 11220 leader_election.cc:304] T 2634154f9f364cfea520c15a5ad325ed P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1ee21679c764758a302a52b2f954b5b; no voters: 244b85b5155e4f58a13b566c50083890, 770cf1ff89494e54baba82d84dac5831
I20260709 13:03:07.505211 11559 raft_consensus.cc:2749] T 2634154f9f364cfea520c15a5ad325ed P e1ee21679c764758a302a52b2f954b5b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:03:07.509899 11292 leader_election.cc:304] T 97ab0a1ca9a548b69b4af26987138b42 P 770cf1ff89494e54baba82d84dac5831 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 770cf1ff89494e54baba82d84dac5831, e1ee21679c764758a302a52b2f954b5b; no voters: 244b85b5155e4f58a13b566c50083890
I20260709 13:03:07.510146 11326 raft_consensus.cc:2468] T 2634154f9f364cfea520c15a5ad325ed P 770cf1ff89494e54baba82d84dac5831 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 244b85b5155e4f58a13b566c50083890 in term 1.
I20260709 13:03:07.511382 11573 raft_consensus.cc:2804] T 97ab0a1ca9a548b69b4af26987138b42 P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:07.511848 11573 raft_consensus.cc:493] T 97ab0a1ca9a548b69b4af26987138b42 P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:07.512131 11573 raft_consensus.cc:3060] T 97ab0a1ca9a548b69b4af26987138b42 P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:07.512508 11543 tablet_bootstrap.cc:654] T b0d7238307174b48aa91030413f37fea P 244b85b5155e4f58a13b566c50083890: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:07.513489 11366 leader_election.cc:304] T 2634154f9f364cfea520c15a5ad325ed P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 244b85b5155e4f58a13b566c50083890, 770cf1ff89494e54baba82d84dac5831; no voters: e1ee21679c764758a302a52b2f954b5b
I20260709 13:03:07.514591 11582 raft_consensus.cc:2804] T 2634154f9f364cfea520c15a5ad325ed P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:07.515203 11582 raft_consensus.cc:697] T 2634154f9f364cfea520c15a5ad325ed P 244b85b5155e4f58a13b566c50083890 [term 1 LEADER]: Becoming Leader. State: Replica: 244b85b5155e4f58a13b566c50083890, State: Running, Role: LEADER
I20260709 13:03:07.516208 11582 consensus_queue.cc:237] T 2634154f9f364cfea520c15a5ad325ed P 244b85b5155e4f58a13b566c50083890 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:07.520946 11573 raft_consensus.cc:515] T 97ab0a1ca9a548b69b4af26987138b42 P 770cf1ff89494e54baba82d84dac5831 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:07.509833 11566 raft_consensus.cc:493] T 59c4fef046b94123b15bb064ae4bacc5 P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.525189 11252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ab0a1ca9a548b69b4af26987138b42" candidate_uuid: "770cf1ff89494e54baba82d84dac5831" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1ee21679c764758a302a52b2f954b5b"
I20260709 13:03:07.525468 11401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ab0a1ca9a548b69b4af26987138b42" candidate_uuid: "770cf1ff89494e54baba82d84dac5831" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "244b85b5155e4f58a13b566c50083890"
I20260709 13:03:07.526019 11252 raft_consensus.cc:3060] T 97ab0a1ca9a548b69b4af26987138b42 P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:03:07.527179 11295 leader_election.cc:343] T 97ab0a1ca9a548b69b4af26987138b42 P 770cf1ff89494e54baba82d84dac5831 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:07.525918 11566 raft_consensus.cc:515] T 59c4fef046b94123b15bb064ae4bacc5 P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:07.530169 11566 leader_election.cc:290] T 59c4fef046b94123b15bb064ae4bacc5 P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331), 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205)
I20260709 13:03:07.530316 11559 raft_consensus.cc:493] T b0d7238307174b48aa91030413f37fea P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.530843 11573 leader_election.cc:290] T 97ab0a1ca9a548b69b4af26987138b42 P 770cf1ff89494e54baba82d84dac5831 [CANDIDATE]: Term 1 election: Requested vote from peers e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331), 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445)
I20260709 13:03:07.530963 11559 raft_consensus.cc:515] T b0d7238307174b48aa91030413f37fea P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:07.532864 11326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c4fef046b94123b15bb064ae4bacc5" candidate_uuid: "244b85b5155e4f58a13b566c50083890" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770cf1ff89494e54baba82d84dac5831" is_pre_election: true
I20260709 13:03:07.532591 11253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59c4fef046b94123b15bb064ae4bacc5" candidate_uuid: "244b85b5155e4f58a13b566c50083890" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1ee21679c764758a302a52b2f954b5b" is_pre_election: true
I20260709 13:03:07.533429 11559 leader_election.cc:290] T b0d7238307174b48aa91030413f37fea P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205), 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445)
I20260709 13:03:07.533764 11326 raft_consensus.cc:2393] T 59c4fef046b94123b15bb064ae4bacc5 P 770cf1ff89494e54baba82d84dac5831 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 244b85b5155e4f58a13b566c50083890 in current term 1: Already voted for candidate e1ee21679c764758a302a52b2f954b5b in this term.
I20260709 13:03:07.535740 11401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0d7238307174b48aa91030413f37fea" candidate_uuid: "e1ee21679c764758a302a52b2f954b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "244b85b5155e4f58a13b566c50083890" is_pre_election: true
W20260709 13:03:07.539625 11220 leader_election.cc:343] T b0d7238307174b48aa91030413f37fea P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:07.541105 11366 leader_election.cc:304] T 59c4fef046b94123b15bb064ae4bacc5 P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 244b85b5155e4f58a13b566c50083890; no voters: 770cf1ff89494e54baba82d84dac5831, e1ee21679c764758a302a52b2f954b5b
I20260709 13:03:07.550963 11326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0d7238307174b48aa91030413f37fea" candidate_uuid: "e1ee21679c764758a302a52b2f954b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770cf1ff89494e54baba82d84dac5831" is_pre_election: true
I20260709 13:03:07.552302 11566 raft_consensus.cc:3060] T 59c4fef046b94123b15bb064ae4bacc5 P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:07.552417 11326 raft_consensus.cc:2468] T b0d7238307174b48aa91030413f37fea P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1ee21679c764758a302a52b2f954b5b in term 0.
I20260709 13:03:07.556033 11217 leader_election.cc:304] T b0d7238307174b48aa91030413f37fea P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 770cf1ff89494e54baba82d84dac5831, e1ee21679c764758a302a52b2f954b5b; no voters: 244b85b5155e4f58a13b566c50083890
I20260709 13:03:07.557686 11559 raft_consensus.cc:2804] T b0d7238307174b48aa91030413f37fea P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:03:07.558215 11559 raft_consensus.cc:493] T b0d7238307174b48aa91030413f37fea P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:03:07.558703 11559 raft_consensus.cc:3060] T b0d7238307174b48aa91030413f37fea P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:07.561337 11566 raft_consensus.cc:2749] T 59c4fef046b94123b15bb064ae4bacc5 P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:07.561851 11252 raft_consensus.cc:2468] T 97ab0a1ca9a548b69b4af26987138b42 P e1ee21679c764758a302a52b2f954b5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 770cf1ff89494e54baba82d84dac5831 in term 1.
I20260709 13:03:07.565126 11292 leader_election.cc:304] T 97ab0a1ca9a548b69b4af26987138b42 P 770cf1ff89494e54baba82d84dac5831 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 770cf1ff89494e54baba82d84dac5831, e1ee21679c764758a302a52b2f954b5b; no voters: 244b85b5155e4f58a13b566c50083890
I20260709 13:03:07.566308 11573 raft_consensus.cc:2804] T 97ab0a1ca9a548b69b4af26987138b42 P 770cf1ff89494e54baba82d84dac5831 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:07.566910 11573 raft_consensus.cc:697] T 97ab0a1ca9a548b69b4af26987138b42 P 770cf1ff89494e54baba82d84dac5831 [term 1 LEADER]: Becoming Leader. State: Replica: 770cf1ff89494e54baba82d84dac5831, State: Running, Role: LEADER
I20260709 13:03:07.567848 11573 consensus_queue.cc:237] T 97ab0a1ca9a548b69b4af26987138b42 P 770cf1ff89494e54baba82d84dac5831 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:07.570264 11149 catalog_manager.cc:5697] T 1d3a3c192f1a498cb0c2253625c69f3a P e1ee21679c764758a302a52b2f954b5b reported cstate change: term changed from 0 to 1, leader changed from <none> to e1ee21679c764758a302a52b2f954b5b (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e1ee21679c764758a302a52b2f954b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:07.571099 11559 raft_consensus.cc:515] T b0d7238307174b48aa91030413f37fea P e1ee21679c764758a302a52b2f954b5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:07.572652 11149 catalog_manager.cc:5697] T 9ee4855c256940e7819fac4e5d729b0d P e1ee21679c764758a302a52b2f954b5b reported cstate change: term changed from 0 to 1, leader changed from <none> to e1ee21679c764758a302a52b2f954b5b (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e1ee21679c764758a302a52b2f954b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:07.574996 11559 leader_election.cc:290] T b0d7238307174b48aa91030413f37fea P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 election: Requested vote from peers 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205), 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445)
I20260709 13:03:07.576553 11401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0d7238307174b48aa91030413f37fea" candidate_uuid: "e1ee21679c764758a302a52b2f954b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "244b85b5155e4f58a13b566c50083890"
W20260709 13:03:07.578217 11220 leader_election.cc:343] T b0d7238307174b48aa91030413f37fea P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:03:07.584249 11329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0d7238307174b48aa91030413f37fea" candidate_uuid: "e1ee21679c764758a302a52b2f954b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770cf1ff89494e54baba82d84dac5831"
I20260709 13:03:07.585289 11329 raft_consensus.cc:3060] T b0d7238307174b48aa91030413f37fea P 770cf1ff89494e54baba82d84dac5831 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:07.596304 11148 catalog_manager.cc:5697] T 97ab0a1ca9a548b69b4af26987138b42 P 770cf1ff89494e54baba82d84dac5831 reported cstate change: term changed from 0 to 1, leader changed from <none> to 770cf1ff89494e54baba82d84dac5831 (127.0.107.194). New cstate: current_term: 1 leader_uuid: "770cf1ff89494e54baba82d84dac5831" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:07.596410 11329 raft_consensus.cc:2468] T b0d7238307174b48aa91030413f37fea P 770cf1ff89494e54baba82d84dac5831 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1ee21679c764758a302a52b2f954b5b in term 1.
I20260709 13:03:07.600353 11217 leader_election.cc:304] T b0d7238307174b48aa91030413f37fea P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 770cf1ff89494e54baba82d84dac5831, e1ee21679c764758a302a52b2f954b5b; no voters: 244b85b5155e4f58a13b566c50083890
I20260709 13:03:07.600386 11152 catalog_manager.cc:5697] T a271b64cf17e4bb2994ab9820417f2e8 P 244b85b5155e4f58a13b566c50083890 reported cstate change: term changed from 0 to 1, leader changed from <none> to 244b85b5155e4f58a13b566c50083890 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "244b85b5155e4f58a13b566c50083890" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:07.602411 11559 raft_consensus.cc:2804] T b0d7238307174b48aa91030413f37fea P e1ee21679c764758a302a52b2f954b5b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:03:07.602259 11152 catalog_manager.cc:5697] T 2634154f9f364cfea520c15a5ad325ed P 244b85b5155e4f58a13b566c50083890 reported cstate change: term changed from 0 to 1, leader changed from <none> to 244b85b5155e4f58a13b566c50083890 (127.0.107.195). New cstate: current_term: 1 leader_uuid: "244b85b5155e4f58a13b566c50083890" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:07.603847 11559 raft_consensus.cc:697] T b0d7238307174b48aa91030413f37fea P e1ee21679c764758a302a52b2f954b5b [term 1 LEADER]: Becoming Leader. State: Replica: e1ee21679c764758a302a52b2f954b5b, State: Running, Role: LEADER
I20260709 13:03:07.604851 11559 consensus_queue.cc:237] T b0d7238307174b48aa91030413f37fea P e1ee21679c764758a302a52b2f954b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:07.606925 11530 raft_consensus.cc:493] T 40f440212cf64606bbd7ddbf7bf153af P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.608189 11530 raft_consensus.cc:515] T 40f440212cf64606bbd7ddbf7bf153af P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:07.607666 11543 tablet_bootstrap.cc:492] T b0d7238307174b48aa91030413f37fea P 244b85b5155e4f58a13b566c50083890: No bootstrap required, opened a new log
I20260709 13:03:07.611405 11329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f440212cf64606bbd7ddbf7bf153af" candidate_uuid: "e1ee21679c764758a302a52b2f954b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770cf1ff89494e54baba82d84dac5831" is_pre_election: true
I20260709 13:03:07.610327 11530 leader_election.cc:290] T 40f440212cf64606bbd7ddbf7bf153af P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205), 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445)
I20260709 13:03:07.611937 11543 ts_tablet_manager.cc:1403] T b0d7238307174b48aa91030413f37fea P 244b85b5155e4f58a13b566c50083890: Time spent bootstrapping tablet: real 0.115s	user 0.044s	sys 0.030s
I20260709 13:03:07.612164 11401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f440212cf64606bbd7ddbf7bf153af" candidate_uuid: "e1ee21679c764758a302a52b2f954b5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "244b85b5155e4f58a13b566c50083890" is_pre_election: true
I20260709 13:03:07.613910 11401 raft_consensus.cc:2393] T 40f440212cf64606bbd7ddbf7bf153af P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e1ee21679c764758a302a52b2f954b5b in current term 1: Already voted for candidate 770cf1ff89494e54baba82d84dac5831 in this term.
I20260709 13:03:07.615233 11220 leader_election.cc:304] T 40f440212cf64606bbd7ddbf7bf153af P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1ee21679c764758a302a52b2f954b5b; no voters: 244b85b5155e4f58a13b566c50083890, 770cf1ff89494e54baba82d84dac5831
I20260709 13:03:07.616552 11530 raft_consensus.cc:3060] T 40f440212cf64606bbd7ddbf7bf153af P e1ee21679c764758a302a52b2f954b5b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:07.617097 11543 raft_consensus.cc:359] T b0d7238307174b48aa91030413f37fea P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:07.618328 11543 raft_consensus.cc:385] T b0d7238307174b48aa91030413f37fea P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:07.618794 11543 raft_consensus.cc:740] T b0d7238307174b48aa91030413f37fea P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 244b85b5155e4f58a13b566c50083890, State: Initialized, Role: FOLLOWER
I20260709 13:03:07.620019 11543 consensus_queue.cc:260] T b0d7238307174b48aa91030413f37fea P 244b85b5155e4f58a13b566c50083890 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:07.623168 11543 ts_tablet_manager.cc:1434] T b0d7238307174b48aa91030413f37fea P 244b85b5155e4f58a13b566c50083890: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 13:03:07.624241 11543 tablet_bootstrap.cc:492] T 97ab0a1ca9a548b69b4af26987138b42 P 244b85b5155e4f58a13b566c50083890: Bootstrap starting.
I20260709 13:03:07.625909 11530 raft_consensus.cc:2749] T 40f440212cf64606bbd7ddbf7bf153af P e1ee21679c764758a302a52b2f954b5b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:07.630836 11543 tablet_bootstrap.cc:654] T 97ab0a1ca9a548b69b4af26987138b42 P 244b85b5155e4f58a13b566c50083890: Neither blocks nor log segments found. Creating new log.
I20260709 13:03:07.635677 11148 catalog_manager.cc:5697] T b0d7238307174b48aa91030413f37fea P e1ee21679c764758a302a52b2f954b5b reported cstate change: term changed from 0 to 1, leader changed from <none> to e1ee21679c764758a302a52b2f954b5b (127.0.107.193). New cstate: current_term: 1 leader_uuid: "e1ee21679c764758a302a52b2f954b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:07.638674 11543 tablet_bootstrap.cc:492] T 97ab0a1ca9a548b69b4af26987138b42 P 244b85b5155e4f58a13b566c50083890: No bootstrap required, opened a new log
I20260709 13:03:07.639308 11543 ts_tablet_manager.cc:1403] T 97ab0a1ca9a548b69b4af26987138b42 P 244b85b5155e4f58a13b566c50083890: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 13:03:07.641952 11543 raft_consensus.cc:359] T 97ab0a1ca9a548b69b4af26987138b42 P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:07.642766 11543 raft_consensus.cc:385] T 97ab0a1ca9a548b69b4af26987138b42 P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:03:07.643105 11543 raft_consensus.cc:740] T 97ab0a1ca9a548b69b4af26987138b42 P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 244b85b5155e4f58a13b566c50083890, State: Initialized, Role: FOLLOWER
I20260709 13:03:07.644179 11543 consensus_queue.cc:260] T 97ab0a1ca9a548b69b4af26987138b42 P 244b85b5155e4f58a13b566c50083890 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:07.646602 11543 ts_tablet_manager.cc:1434] T 97ab0a1ca9a548b69b4af26987138b42 P 244b85b5155e4f58a13b566c50083890: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:03:07.701295 11572 consensus_queue.cc:1048] T 40f440212cf64606bbd7ddbf7bf153af P 770cf1ff89494e54baba82d84dac5831 [LEADER]: Connected to new peer: Peer: permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:07.707912 11582 raft_consensus.cc:493] T 97ab0a1ca9a548b69b4af26987138b42 P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.708444 11582 raft_consensus.cc:515] T 97ab0a1ca9a548b69b4af26987138b42 P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:07.711203 11582 leader_election.cc:290] T 97ab0a1ca9a548b69b4af26987138b42 P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331), 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205)
I20260709 13:03:07.713698 11252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ab0a1ca9a548b69b4af26987138b42" candidate_uuid: "244b85b5155e4f58a13b566c50083890" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1ee21679c764758a302a52b2f954b5b" is_pre_election: true
I20260709 13:03:07.715749 11252 raft_consensus.cc:2393] T 97ab0a1ca9a548b69b4af26987138b42 P e1ee21679c764758a302a52b2f954b5b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 244b85b5155e4f58a13b566c50083890 in current term 1: Already voted for candidate 770cf1ff89494e54baba82d84dac5831 in this term.
I20260709 13:03:07.713692 11326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ab0a1ca9a548b69b4af26987138b42" candidate_uuid: "244b85b5155e4f58a13b566c50083890" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770cf1ff89494e54baba82d84dac5831" is_pre_election: true
I20260709 13:03:07.717056 11572 consensus_queue.cc:1048] T 40f440212cf64606bbd7ddbf7bf153af P 770cf1ff89494e54baba82d84dac5831 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:07.718367 11366 leader_election.cc:304] T 97ab0a1ca9a548b69b4af26987138b42 P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 244b85b5155e4f58a13b566c50083890; no voters: 770cf1ff89494e54baba82d84dac5831, e1ee21679c764758a302a52b2f954b5b
I20260709 13:03:07.719215 11582 raft_consensus.cc:3060] T 97ab0a1ca9a548b69b4af26987138b42 P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:07.727703 11582 raft_consensus.cc:2749] T 97ab0a1ca9a548b69b4af26987138b42 P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:07.736399 11582 consensus_queue.cc:1048] T 676042afc21b4ff5b2f7146544765db1 P 244b85b5155e4f58a13b566c50083890 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:07.749225 11582 consensus_queue.cc:1048] T 676042afc21b4ff5b2f7146544765db1 P 244b85b5155e4f58a13b566c50083890 [LEADER]: Connected to new peer: Peer: permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:07.777320 11326 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "40f440212cf64606bbd7ddbf7bf153af"
dest_uuid: "770cf1ff89494e54baba82d84dac5831"
mode: GRACEFUL
new_leader_uuid: "e1ee21679c764758a302a52b2f954b5b"
 from {username='slave'} at 127.0.0.1:49552
I20260709 13:03:07.777927 11326 raft_consensus.cc:606] T 40f440212cf64606bbd7ddbf7bf153af P 770cf1ff89494e54baba82d84dac5831 [term 1 LEADER]: Received request to transfer leadership to TS e1ee21679c764758a302a52b2f954b5b
I20260709 13:03:07.780375 11582 raft_consensus.cc:493] T 1d3a3c192f1a498cb0c2253625c69f3a P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.781047 11582 raft_consensus.cc:515] T 1d3a3c192f1a498cb0c2253625c69f3a P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:07.783121 11582 leader_election.cc:290] T 1d3a3c192f1a498cb0c2253625c69f3a P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331), 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205)
I20260709 13:03:07.784265 11326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3a3c192f1a498cb0c2253625c69f3a" candidate_uuid: "244b85b5155e4f58a13b566c50083890" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770cf1ff89494e54baba82d84dac5831" is_pre_election: true
I20260709 13:03:07.784359 11252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3a3c192f1a498cb0c2253625c69f3a" candidate_uuid: "244b85b5155e4f58a13b566c50083890" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1ee21679c764758a302a52b2f954b5b" is_pre_election: true
I20260709 13:03:07.784871 11401 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2634154f9f364cfea520c15a5ad325ed"
dest_uuid: "244b85b5155e4f58a13b566c50083890"
mode: GRACEFUL
new_leader_uuid: "e1ee21679c764758a302a52b2f954b5b"
 from {username='slave'} at 127.0.0.1:49258
I20260709 13:03:07.785306 11326 raft_consensus.cc:2393] T 1d3a3c192f1a498cb0c2253625c69f3a P 770cf1ff89494e54baba82d84dac5831 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 244b85b5155e4f58a13b566c50083890 in current term 1: Already voted for candidate e1ee21679c764758a302a52b2f954b5b in this term.
I20260709 13:03:07.785633 11401 raft_consensus.cc:606] T 2634154f9f364cfea520c15a5ad325ed P 244b85b5155e4f58a13b566c50083890 [term 1 LEADER]: Received request to transfer leadership to TS e1ee21679c764758a302a52b2f954b5b
I20260709 13:03:07.786700 11366 leader_election.cc:304] T 1d3a3c192f1a498cb0c2253625c69f3a P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 244b85b5155e4f58a13b566c50083890; no voters: 770cf1ff89494e54baba82d84dac5831, e1ee21679c764758a302a52b2f954b5b
I20260709 13:03:07.787556 11582 raft_consensus.cc:3060] T 1d3a3c192f1a498cb0c2253625c69f3a P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:07.793432 11401 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "676042afc21b4ff5b2f7146544765db1"
dest_uuid: "244b85b5155e4f58a13b566c50083890"
mode: GRACEFUL
new_leader_uuid: "e1ee21679c764758a302a52b2f954b5b"
 from {username='slave'} at 127.0.0.1:49258
I20260709 13:03:07.794226 11401 raft_consensus.cc:606] T 676042afc21b4ff5b2f7146544765db1 P 244b85b5155e4f58a13b566c50083890 [term 1 LEADER]: Received request to transfer leadership to TS e1ee21679c764758a302a52b2f954b5b
I20260709 13:03:07.794857 11582 raft_consensus.cc:2749] T 1d3a3c192f1a498cb0c2253625c69f3a P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:07.803402 11253 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b0d7238307174b48aa91030413f37fea"
dest_uuid: "e1ee21679c764758a302a52b2f954b5b"
mode: GRACEFUL
new_leader_uuid: "770cf1ff89494e54baba82d84dac5831"
 from {username='slave'} at 127.0.0.1:37374
I20260709 13:03:07.804113 11253 raft_consensus.cc:606] T b0d7238307174b48aa91030413f37fea P e1ee21679c764758a302a52b2f954b5b [term 1 LEADER]: Received request to transfer leadership to TS 770cf1ff89494e54baba82d84dac5831
I20260709 13:03:07.804361 11582 consensus_queue.cc:1048] T a271b64cf17e4bb2994ab9820417f2e8 P 244b85b5155e4f58a13b566c50083890 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:07.811055 11252 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ee4855c256940e7819fac4e5d729b0d"
dest_uuid: "e1ee21679c764758a302a52b2f954b5b"
mode: GRACEFUL
new_leader_uuid: "770cf1ff89494e54baba82d84dac5831"
 from {username='slave'} at 127.0.0.1:37374
I20260709 13:03:07.811446 11559 consensus_queue.cc:1048] T 1d3a3c192f1a498cb0c2253625c69f3a P e1ee21679c764758a302a52b2f954b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:07.812116 11252 raft_consensus.cc:606] T 9ee4855c256940e7819fac4e5d729b0d P e1ee21679c764758a302a52b2f954b5b [term 1 LEADER]: Received request to transfer leadership to TS 770cf1ff89494e54baba82d84dac5831
I20260709 13:03:07.820725 11566 consensus_queue.cc:1048] T a271b64cf17e4bb2994ab9820417f2e8 P 244b85b5155e4f58a13b566c50083890 [LEADER]: Connected to new peer: Peer: permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:07.826469 11574 consensus_queue.cc:1048] T 1d3a3c192f1a498cb0c2253625c69f3a P e1ee21679c764758a302a52b2f954b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:07.837292 11402 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a271b64cf17e4bb2994ab9820417f2e8"
dest_uuid: "244b85b5155e4f58a13b566c50083890"
mode: GRACEFUL
new_leader_uuid: "770cf1ff89494e54baba82d84dac5831"
 from {username='slave'} at 127.0.0.1:49258
I20260709 13:03:07.838042 11402 raft_consensus.cc:606] T a271b64cf17e4bb2994ab9820417f2e8 P 244b85b5155e4f58a13b566c50083890 [term 1 LEADER]: Received request to transfer leadership to TS 770cf1ff89494e54baba82d84dac5831
I20260709 13:03:07.846073 11530 consensus_queue.cc:1048] T 59c4fef046b94123b15bb064ae4bacc5 P e1ee21679c764758a302a52b2f954b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:07.847561 11252 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d3a3c192f1a498cb0c2253625c69f3a"
dest_uuid: "e1ee21679c764758a302a52b2f954b5b"
mode: GRACEFUL
new_leader_uuid: "770cf1ff89494e54baba82d84dac5831"
 from {username='slave'} at 127.0.0.1:37374
I20260709 13:03:07.848441 11252 raft_consensus.cc:606] T 1d3a3c192f1a498cb0c2253625c69f3a P e1ee21679c764758a302a52b2f954b5b [term 1 LEADER]: Received request to transfer leadership to TS 770cf1ff89494e54baba82d84dac5831
I20260709 13:03:07.853628 11566 raft_consensus.cc:493] T b0d7238307174b48aa91030413f37fea P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:03:07.854277 11566 raft_consensus.cc:515] T b0d7238307174b48aa91030413f37fea P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:07.857247 11325 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "97ab0a1ca9a548b69b4af26987138b42"
dest_uuid: "770cf1ff89494e54baba82d84dac5831"
mode: GRACEFUL
new_leader_uuid: "244b85b5155e4f58a13b566c50083890"
 from {username='slave'} at 127.0.0.1:49552
I20260709 13:03:07.857913 11325 raft_consensus.cc:606] T 97ab0a1ca9a548b69b4af26987138b42 P 770cf1ff89494e54baba82d84dac5831 [term 1 LEADER]: Received request to transfer leadership to TS 244b85b5155e4f58a13b566c50083890
I20260709 13:03:07.859519 11252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0d7238307174b48aa91030413f37fea" candidate_uuid: "244b85b5155e4f58a13b566c50083890" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1ee21679c764758a302a52b2f954b5b" is_pre_election: true
I20260709 13:03:07.865010 11566 leader_election.cc:290] T b0d7238307174b48aa91030413f37fea P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331), 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205)
I20260709 13:03:07.866465 11325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0d7238307174b48aa91030413f37fea" candidate_uuid: "244b85b5155e4f58a13b566c50083890" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "770cf1ff89494e54baba82d84dac5831" is_pre_election: true
I20260709 13:03:07.867766 11325 raft_consensus.cc:2393] T b0d7238307174b48aa91030413f37fea P 770cf1ff89494e54baba82d84dac5831 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 244b85b5155e4f58a13b566c50083890 in current term 1: Already voted for candidate e1ee21679c764758a302a52b2f954b5b in this term.
I20260709 13:03:07.869222 11366 leader_election.cc:304] T b0d7238307174b48aa91030413f37fea P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 244b85b5155e4f58a13b566c50083890; no voters: 770cf1ff89494e54baba82d84dac5831, e1ee21679c764758a302a52b2f954b5b
I20260709 13:03:07.870864 11566 raft_consensus.cc:3060] T b0d7238307174b48aa91030413f37fea P 244b85b5155e4f58a13b566c50083890 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:03:07.880169 11484 raft_consensus.cc:993] T a271b64cf17e4bb2994ab9820417f2e8 P 244b85b5155e4f58a13b566c50083890: : Instructing follower 770cf1ff89494e54baba82d84dac5831 to start an election
I20260709 13:03:07.880828 11484 raft_consensus.cc:1081] T a271b64cf17e4bb2994ab9820417f2e8 P 244b85b5155e4f58a13b566c50083890 [term 1 LEADER]: Signalling peer 770cf1ff89494e54baba82d84dac5831 to start an election
I20260709 13:03:07.882270 11559 consensus_queue.cc:1048] T 59c4fef046b94123b15bb064ae4bacc5 P e1ee21679c764758a302a52b2f954b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:07.883051 11329 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a271b64cf17e4bb2994ab9820417f2e8"
dest_uuid: "770cf1ff89494e54baba82d84dac5831"
 from {username='slave'} at 127.0.0.1:49548
I20260709 13:03:07.883772 11329 raft_consensus.cc:493] T a271b64cf17e4bb2994ab9820417f2e8 P 770cf1ff89494e54baba82d84dac5831 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:07.884238 11329 raft_consensus.cc:3060] T a271b64cf17e4bb2994ab9820417f2e8 P 770cf1ff89494e54baba82d84dac5831 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:07.890753 11566 raft_consensus.cc:2749] T b0d7238307174b48aa91030413f37fea P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:03:07.899443 11329 raft_consensus.cc:515] T a271b64cf17e4bb2994ab9820417f2e8 P 770cf1ff89494e54baba82d84dac5831 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:07.902611 11329 leader_election.cc:290] T a271b64cf17e4bb2994ab9820417f2e8 P 770cf1ff89494e54baba82d84dac5831 [CANDIDATE]: Term 2 election: Requested vote from peers e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331), 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445)
I20260709 13:03:07.902710 11252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a271b64cf17e4bb2994ab9820417f2e8" candidate_uuid: "770cf1ff89494e54baba82d84dac5831" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e1ee21679c764758a302a52b2f954b5b"
I20260709 13:03:07.903425 11252 raft_consensus.cc:3060] T a271b64cf17e4bb2994ab9820417f2e8 P e1ee21679c764758a302a52b2f954b5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:07.903959 11401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a271b64cf17e4bb2994ab9820417f2e8" candidate_uuid: "770cf1ff89494e54baba82d84dac5831" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "244b85b5155e4f58a13b566c50083890"
I20260709 13:03:07.904721 11401 raft_consensus.cc:3055] T a271b64cf17e4bb2994ab9820417f2e8 P 244b85b5155e4f58a13b566c50083890 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:07.905040 11401 raft_consensus.cc:740] T a271b64cf17e4bb2994ab9820417f2e8 P 244b85b5155e4f58a13b566c50083890 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 244b85b5155e4f58a13b566c50083890, State: Running, Role: LEADER
I20260709 13:03:07.905920 11401 consensus_queue.cc:260] T a271b64cf17e4bb2994ab9820417f2e8 P 244b85b5155e4f58a13b566c50083890 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:07.907251 11401 raft_consensus.cc:3060] T a271b64cf17e4bb2994ab9820417f2e8 P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:07.911429 11252 raft_consensus.cc:2468] T a271b64cf17e4bb2994ab9820417f2e8 P e1ee21679c764758a302a52b2f954b5b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 770cf1ff89494e54baba82d84dac5831 in term 2.
I20260709 13:03:07.913021 11292 leader_election.cc:304] T a271b64cf17e4bb2994ab9820417f2e8 P 770cf1ff89494e54baba82d84dac5831 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 770cf1ff89494e54baba82d84dac5831, e1ee21679c764758a302a52b2f954b5b; no voters: 
I20260709 13:03:07.913879 11573 raft_consensus.cc:2804] T a271b64cf17e4bb2994ab9820417f2e8 P 770cf1ff89494e54baba82d84dac5831 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:07.914336 11401 raft_consensus.cc:2468] T a271b64cf17e4bb2994ab9820417f2e8 P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 770cf1ff89494e54baba82d84dac5831 in term 2.
I20260709 13:03:07.914412 11573 raft_consensus.cc:697] T a271b64cf17e4bb2994ab9820417f2e8 P 770cf1ff89494e54baba82d84dac5831 [term 2 LEADER]: Becoming Leader. State: Replica: 770cf1ff89494e54baba82d84dac5831, State: Running, Role: LEADER
I20260709 13:03:07.915551 11573 consensus_queue.cc:237] T a271b64cf17e4bb2994ab9820417f2e8 P 770cf1ff89494e54baba82d84dac5831 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:07.922602 11152 catalog_manager.cc:5697] T a271b64cf17e4bb2994ab9820417f2e8 P 770cf1ff89494e54baba82d84dac5831 reported cstate change: term changed from 1 to 2, leader changed from 244b85b5155e4f58a13b566c50083890 (127.0.107.195) to 770cf1ff89494e54baba82d84dac5831 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "770cf1ff89494e54baba82d84dac5831" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:07.951619 11582 consensus_queue.cc:1048] T 2634154f9f364cfea520c15a5ad325ed P 244b85b5155e4f58a13b566c50083890 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:07.958737 11566 raft_consensus.cc:993] T 2634154f9f364cfea520c15a5ad325ed P 244b85b5155e4f58a13b566c50083890: : Instructing follower e1ee21679c764758a302a52b2f954b5b to start an election
I20260709 13:03:07.959233 11565 raft_consensus.cc:1081] T 2634154f9f364cfea520c15a5ad325ed P 244b85b5155e4f58a13b566c50083890 [term 1 LEADER]: Signalling peer e1ee21679c764758a302a52b2f954b5b to start an election
I20260709 13:03:07.961280 11252 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2634154f9f364cfea520c15a5ad325ed"
dest_uuid: "e1ee21679c764758a302a52b2f954b5b"
 from {username='slave'} at 127.0.0.1:37370
I20260709 13:03:07.961994 11252 raft_consensus.cc:493] T 2634154f9f364cfea520c15a5ad325ed P e1ee21679c764758a302a52b2f954b5b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:07.962487 11252 raft_consensus.cc:3060] T 2634154f9f364cfea520c15a5ad325ed P e1ee21679c764758a302a52b2f954b5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:07.965828 11582 consensus_queue.cc:1048] T 2634154f9f364cfea520c15a5ad325ed P 244b85b5155e4f58a13b566c50083890 [LEADER]: Connected to new peer: Peer: permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:07.972077 11252 raft_consensus.cc:515] T 2634154f9f364cfea520c15a5ad325ed P e1ee21679c764758a302a52b2f954b5b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:07.974897 11253 raft_consensus.cc:1240] T 2634154f9f364cfea520c15a5ad325ed P e1ee21679c764758a302a52b2f954b5b [term 2 FOLLOWER]: Rejecting Update request from peer 244b85b5155e4f58a13b566c50083890 for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:07.976089 11252 leader_election.cc:290] T 2634154f9f364cfea520c15a5ad325ed P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 2 election: Requested vote from peers 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205), 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445)
I20260709 13:03:07.978576 11329 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2634154f9f364cfea520c15a5ad325ed" candidate_uuid: "e1ee21679c764758a302a52b2f954b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "770cf1ff89494e54baba82d84dac5831"
I20260709 13:03:07.979112 11401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2634154f9f364cfea520c15a5ad325ed" candidate_uuid: "e1ee21679c764758a302a52b2f954b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "244b85b5155e4f58a13b566c50083890"
I20260709 13:03:07.979336 11329 raft_consensus.cc:3060] T 2634154f9f364cfea520c15a5ad325ed P 770cf1ff89494e54baba82d84dac5831 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:07.979152 11582 consensus_queue.cc:1059] T 2634154f9f364cfea520c15a5ad325ed P 244b85b5155e4f58a13b566c50083890 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:07.980793 11401 raft_consensus.cc:3055] T 2634154f9f364cfea520c15a5ad325ed P 244b85b5155e4f58a13b566c50083890 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:07.981127 11401 raft_consensus.cc:740] T 2634154f9f364cfea520c15a5ad325ed P 244b85b5155e4f58a13b566c50083890 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 244b85b5155e4f58a13b566c50083890, State: Running, Role: LEADER
I20260709 13:03:07.981904 11401 consensus_queue.cc:260] T 2634154f9f364cfea520c15a5ad325ed P 244b85b5155e4f58a13b566c50083890 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:07.982959 11401 raft_consensus.cc:3060] T 2634154f9f364cfea520c15a5ad325ed P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:07.985829 11329 raft_consensus.cc:2468] T 2634154f9f364cfea520c15a5ad325ed P 770cf1ff89494e54baba82d84dac5831 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1ee21679c764758a302a52b2f954b5b in term 2.
I20260709 13:03:07.987339 11217 leader_election.cc:304] T 2634154f9f364cfea520c15a5ad325ed P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 770cf1ff89494e54baba82d84dac5831, e1ee21679c764758a302a52b2f954b5b; no voters: 
I20260709 13:03:07.988170 11574 raft_consensus.cc:2804] T 2634154f9f364cfea520c15a5ad325ed P e1ee21679c764758a302a52b2f954b5b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:07.988732 11574 raft_consensus.cc:697] T 2634154f9f364cfea520c15a5ad325ed P e1ee21679c764758a302a52b2f954b5b [term 2 LEADER]: Becoming Leader. State: Replica: e1ee21679c764758a302a52b2f954b5b, State: Running, Role: LEADER
I20260709 13:03:07.989464 11401 raft_consensus.cc:2468] T 2634154f9f364cfea520c15a5ad325ed P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1ee21679c764758a302a52b2f954b5b in term 2.
I20260709 13:03:07.989589 11574 consensus_queue.cc:237] T 2634154f9f364cfea520c15a5ad325ed P e1ee21679c764758a302a52b2f954b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
W20260709 13:03:07.990451 11566 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:03:07.997193 11574 consensus_queue.cc:1048] T 9ee4855c256940e7819fac4e5d729b0d P e1ee21679c764758a302a52b2f954b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:07.999152 11152 catalog_manager.cc:5697] T 2634154f9f364cfea520c15a5ad325ed P e1ee21679c764758a302a52b2f954b5b reported cstate change: term changed from 1 to 2, leader changed from 244b85b5155e4f58a13b566c50083890 (127.0.107.195) to e1ee21679c764758a302a52b2f954b5b (127.0.107.193). New cstate: current_term: 2 leader_uuid: "e1ee21679c764758a302a52b2f954b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:08.007009 11573 consensus_queue.cc:1048] T 97ab0a1ca9a548b69b4af26987138b42 P 770cf1ff89494e54baba82d84dac5831 [LEADER]: Connected to new peer: Peer: permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:08.011162 11530 consensus_queue.cc:1048] T 9ee4855c256940e7819fac4e5d729b0d P e1ee21679c764758a302a52b2f954b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:03:08.023484 11573 raft_consensus.cc:993] T 97ab0a1ca9a548b69b4af26987138b42 P 770cf1ff89494e54baba82d84dac5831: : Instructing follower 244b85b5155e4f58a13b566c50083890 to start an election
I20260709 13:03:08.024008 11571 raft_consensus.cc:1081] T 97ab0a1ca9a548b69b4af26987138b42 P 770cf1ff89494e54baba82d84dac5831 [term 1 LEADER]: Signalling peer 244b85b5155e4f58a13b566c50083890 to start an election
I20260709 13:03:08.025074 11559 raft_consensus.cc:993] T 9ee4855c256940e7819fac4e5d729b0d P e1ee21679c764758a302a52b2f954b5b: : Instructing follower 770cf1ff89494e54baba82d84dac5831 to start an election
I20260709 13:03:08.025652 11559 raft_consensus.cc:1081] T 9ee4855c256940e7819fac4e5d729b0d P e1ee21679c764758a302a52b2f954b5b [term 1 LEADER]: Signalling peer 770cf1ff89494e54baba82d84dac5831 to start an election
I20260709 13:03:08.027456 11401 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "97ab0a1ca9a548b69b4af26987138b42"
dest_uuid: "244b85b5155e4f58a13b566c50083890"
 from {username='slave'} at 127.0.0.1:49230
I20260709 13:03:08.028144 11401 raft_consensus.cc:493] T 97ab0a1ca9a548b69b4af26987138b42 P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:08.028559 11401 raft_consensus.cc:3060] T 97ab0a1ca9a548b69b4af26987138b42 P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:08.033073 11572 consensus_queue.cc:1048] T 97ab0a1ca9a548b69b4af26987138b42 P 770cf1ff89494e54baba82d84dac5831 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:08.033170 11329 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ee4855c256940e7819fac4e5d729b0d"
dest_uuid: "770cf1ff89494e54baba82d84dac5831"
 from {username='slave'} at 127.0.0.1:49536
I20260709 13:03:08.036756 11329 raft_consensus.cc:493] T 9ee4855c256940e7819fac4e5d729b0d P 770cf1ff89494e54baba82d84dac5831 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:08.037216 11329 raft_consensus.cc:3060] T 9ee4855c256940e7819fac4e5d729b0d P 770cf1ff89494e54baba82d84dac5831 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:08.037781 11401 raft_consensus.cc:515] T 97ab0a1ca9a548b69b4af26987138b42 P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:08.041569 11252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ab0a1ca9a548b69b4af26987138b42" candidate_uuid: "244b85b5155e4f58a13b566c50083890" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e1ee21679c764758a302a52b2f954b5b"
I20260709 13:03:08.043321 11326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "97ab0a1ca9a548b69b4af26987138b42" candidate_uuid: "244b85b5155e4f58a13b566c50083890" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "770cf1ff89494e54baba82d84dac5831"
I20260709 13:03:08.044272 11326 raft_consensus.cc:3055] T 97ab0a1ca9a548b69b4af26987138b42 P 770cf1ff89494e54baba82d84dac5831 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:08.044704 11326 raft_consensus.cc:740] T 97ab0a1ca9a548b69b4af26987138b42 P 770cf1ff89494e54baba82d84dac5831 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 770cf1ff89494e54baba82d84dac5831, State: Running, Role: LEADER
I20260709 13:03:08.045542 11329 raft_consensus.cc:515] T 9ee4855c256940e7819fac4e5d729b0d P 770cf1ff89494e54baba82d84dac5831 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:08.045743 11326 consensus_queue.cc:260] T 97ab0a1ca9a548b69b4af26987138b42 P 770cf1ff89494e54baba82d84dac5831 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:08.047173 11326 raft_consensus.cc:3060] T 97ab0a1ca9a548b69b4af26987138b42 P 770cf1ff89494e54baba82d84dac5831 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:08.049052 11329 leader_election.cc:290] T 9ee4855c256940e7819fac4e5d729b0d P 770cf1ff89494e54baba82d84dac5831 [CANDIDATE]: Term 2 election: Requested vote from peers e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331), 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445)
I20260709 13:03:08.049315 11402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee4855c256940e7819fac4e5d729b0d" candidate_uuid: "770cf1ff89494e54baba82d84dac5831" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "244b85b5155e4f58a13b566c50083890"
I20260709 13:03:08.050194 11402 raft_consensus.cc:3060] T 9ee4855c256940e7819fac4e5d729b0d P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:08.049196 11252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ee4855c256940e7819fac4e5d729b0d" candidate_uuid: "770cf1ff89494e54baba82d84dac5831" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e1ee21679c764758a302a52b2f954b5b"
I20260709 13:03:08.051054 11252 raft_consensus.cc:3055] T 9ee4855c256940e7819fac4e5d729b0d P e1ee21679c764758a302a52b2f954b5b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:08.051355 11252 raft_consensus.cc:740] T 9ee4855c256940e7819fac4e5d729b0d P e1ee21679c764758a302a52b2f954b5b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e1ee21679c764758a302a52b2f954b5b, State: Running, Role: LEADER
I20260709 13:03:08.052090 11252 consensus_queue.cc:260] T 9ee4855c256940e7819fac4e5d729b0d P e1ee21679c764758a302a52b2f954b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:08.053404 11252 raft_consensus.cc:3060] T 9ee4855c256940e7819fac4e5d729b0d P e1ee21679c764758a302a52b2f954b5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:08.054644 11559 consensus_queue.cc:1048] T b0d7238307174b48aa91030413f37fea P e1ee21679c764758a302a52b2f954b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:08.064075 11252 raft_consensus.cc:2468] T 9ee4855c256940e7819fac4e5d729b0d P e1ee21679c764758a302a52b2f954b5b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 770cf1ff89494e54baba82d84dac5831 in term 2.
I20260709 13:03:08.066293 11292 leader_election.cc:304] T 9ee4855c256940e7819fac4e5d729b0d P 770cf1ff89494e54baba82d84dac5831 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 770cf1ff89494e54baba82d84dac5831, e1ee21679c764758a302a52b2f954b5b; no voters: 
I20260709 13:03:08.066841 11402 raft_consensus.cc:2468] T 9ee4855c256940e7819fac4e5d729b0d P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 770cf1ff89494e54baba82d84dac5831 in term 2.
I20260709 13:03:08.067440 11572 raft_consensus.cc:2804] T 9ee4855c256940e7819fac4e5d729b0d P 770cf1ff89494e54baba82d84dac5831 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:08.074532 11572 raft_consensus.cc:697] T 9ee4855c256940e7819fac4e5d729b0d P 770cf1ff89494e54baba82d84dac5831 [term 2 LEADER]: Becoming Leader. State: Replica: 770cf1ff89494e54baba82d84dac5831, State: Running, Role: LEADER
I20260709 13:03:08.075455 11572 consensus_queue.cc:237] T 9ee4855c256940e7819fac4e5d729b0d P 770cf1ff89494e54baba82d84dac5831 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:08.076676 11326 raft_consensus.cc:2468] T 97ab0a1ca9a548b69b4af26987138b42 P 770cf1ff89494e54baba82d84dac5831 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 244b85b5155e4f58a13b566c50083890 in term 2.
I20260709 13:03:08.080561 11366 leader_election.cc:304] T 97ab0a1ca9a548b69b4af26987138b42 P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 244b85b5155e4f58a13b566c50083890, 770cf1ff89494e54baba82d84dac5831; no voters: e1ee21679c764758a302a52b2f954b5b
I20260709 13:03:08.082122 11566 raft_consensus.cc:2804] T 97ab0a1ca9a548b69b4af26987138b42 P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:08.082719 11566 raft_consensus.cc:697] T 97ab0a1ca9a548b69b4af26987138b42 P 244b85b5155e4f58a13b566c50083890 [term 2 LEADER]: Becoming Leader. State: Replica: 244b85b5155e4f58a13b566c50083890, State: Running, Role: LEADER
I20260709 13:03:08.069175 11401 leader_election.cc:290] T 97ab0a1ca9a548b69b4af26987138b42 P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 2 election: Requested vote from peers e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331), 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205)
I20260709 13:03:08.083660 11566 consensus_queue.cc:237] T 97ab0a1ca9a548b69b4af26987138b42 P 244b85b5155e4f58a13b566c50083890 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:08.086577 11530 raft_consensus.cc:993] T b0d7238307174b48aa91030413f37fea P e1ee21679c764758a302a52b2f954b5b: : Instructing follower 770cf1ff89494e54baba82d84dac5831 to start an election
I20260709 13:03:08.087564 11530 raft_consensus.cc:1081] T b0d7238307174b48aa91030413f37fea P e1ee21679c764758a302a52b2f954b5b [term 1 LEADER]: Signalling peer 770cf1ff89494e54baba82d84dac5831 to start an election
I20260709 13:03:08.095965 11530 consensus_queue.cc:1048] T b0d7238307174b48aa91030413f37fea P e1ee21679c764758a302a52b2f954b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:03:08.096189 11152 catalog_manager.cc:5697] T 97ab0a1ca9a548b69b4af26987138b42 P 244b85b5155e4f58a13b566c50083890 reported cstate change: term changed from 1 to 2, leader changed from 770cf1ff89494e54baba82d84dac5831 (127.0.107.194) to 244b85b5155e4f58a13b566c50083890 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "244b85b5155e4f58a13b566c50083890" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:08.099412 11325 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b0d7238307174b48aa91030413f37fea"
dest_uuid: "770cf1ff89494e54baba82d84dac5831"
 from {username='slave'} at 127.0.0.1:49536
I20260709 13:03:08.100755 11325 raft_consensus.cc:493] T b0d7238307174b48aa91030413f37fea P 770cf1ff89494e54baba82d84dac5831 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:08.101181 11325 raft_consensus.cc:3060] T b0d7238307174b48aa91030413f37fea P 770cf1ff89494e54baba82d84dac5831 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:08.107787 11148 catalog_manager.cc:5697] T 9ee4855c256940e7819fac4e5d729b0d P 770cf1ff89494e54baba82d84dac5831 reported cstate change: term changed from 1 to 2, leader changed from e1ee21679c764758a302a52b2f954b5b (127.0.107.193) to 770cf1ff89494e54baba82d84dac5831 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "770cf1ff89494e54baba82d84dac5831" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:08.112744 11325 raft_consensus.cc:515] T b0d7238307174b48aa91030413f37fea P 770cf1ff89494e54baba82d84dac5831 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:08.114004 11326 raft_consensus.cc:1240] T b0d7238307174b48aa91030413f37fea P 770cf1ff89494e54baba82d84dac5831 [term 2 FOLLOWER]: Rejecting Update request from peer e1ee21679c764758a302a52b2f954b5b for earlier term 1. Current term is 2. Ops: []
I20260709 13:03:08.116366 11253 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0d7238307174b48aa91030413f37fea" candidate_uuid: "770cf1ff89494e54baba82d84dac5831" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e1ee21679c764758a302a52b2f954b5b"
I20260709 13:03:08.117165 11253 raft_consensus.cc:3055] T b0d7238307174b48aa91030413f37fea P e1ee21679c764758a302a52b2f954b5b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:08.117571 11253 raft_consensus.cc:740] T b0d7238307174b48aa91030413f37fea P e1ee21679c764758a302a52b2f954b5b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e1ee21679c764758a302a52b2f954b5b, State: Running, Role: LEADER
W20260709 13:03:08.118112 11350 debug-util.cc:398] Leaking SignalData structure 0x7b080020b540 after lost signal to thread 434
I20260709 13:03:08.118400 11325 leader_election.cc:290] T b0d7238307174b48aa91030413f37fea P 770cf1ff89494e54baba82d84dac5831 [CANDIDATE]: Term 2 election: Requested vote from peers e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331), 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445)
I20260709 13:03:08.118673 11253 consensus_queue.cc:260] T b0d7238307174b48aa91030413f37fea P e1ee21679c764758a302a52b2f954b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
W20260709 13:03:08.119589 11350 debug-util.cc:398] Leaking SignalData structure 0x7b0800176340 after lost signal to thread 11186
I20260709 13:03:08.119904 11253 raft_consensus.cc:3060] T b0d7238307174b48aa91030413f37fea P e1ee21679c764758a302a52b2f954b5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:08.120316 11401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0d7238307174b48aa91030413f37fea" candidate_uuid: "770cf1ff89494e54baba82d84dac5831" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "244b85b5155e4f58a13b566c50083890"
W20260709 13:03:08.121276 11350 debug-util.cc:398] Leaking SignalData structure 0x7b08001da2a0 after lost signal to thread 11278
W20260709 13:03:08.123021 11350 debug-util.cc:398] Leaking SignalData structure 0x7b08002fb640 after lost signal to thread 11353
W20260709 13:03:08.124898 11350 debug-util.cc:398] Leaking SignalData structure 0x7b08001aa980 after lost signal to thread 11427
W20260709 13:03:08.125622 11350 debug-util.cc:398] Leaking SignalData structure 0x7b0800092420 after lost signal to thread 11540
I20260709 13:03:08.140498 11253 raft_consensus.cc:2468] T b0d7238307174b48aa91030413f37fea P e1ee21679c764758a302a52b2f954b5b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 770cf1ff89494e54baba82d84dac5831 in term 2.
I20260709 13:03:08.143862 11292 leader_election.cc:304] T b0d7238307174b48aa91030413f37fea P 770cf1ff89494e54baba82d84dac5831 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 770cf1ff89494e54baba82d84dac5831, e1ee21679c764758a302a52b2f954b5b; no voters: 244b85b5155e4f58a13b566c50083890
I20260709 13:03:08.145319 11572 raft_consensus.cc:2804] T b0d7238307174b48aa91030413f37fea P 770cf1ff89494e54baba82d84dac5831 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:08.145902 11572 raft_consensus.cc:697] T b0d7238307174b48aa91030413f37fea P 770cf1ff89494e54baba82d84dac5831 [term 2 LEADER]: Becoming Leader. State: Replica: 770cf1ff89494e54baba82d84dac5831, State: Running, Role: LEADER
I20260709 13:03:08.146819 11572 consensus_queue.cc:237] T b0d7238307174b48aa91030413f37fea P 770cf1ff89494e54baba82d84dac5831 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
W20260709 13:03:08.148591   436 debug-util.cc:398] Leaking SignalData structure 0x7b08003d8bc0 after lost signal to thread 11543
I20260709 13:03:08.157246 11148 catalog_manager.cc:5697] T b0d7238307174b48aa91030413f37fea P 770cf1ff89494e54baba82d84dac5831 reported cstate change: term changed from 1 to 2, leader changed from e1ee21679c764758a302a52b2f954b5b (127.0.107.193) to 770cf1ff89494e54baba82d84dac5831 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "770cf1ff89494e54baba82d84dac5831" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:08.207671 11572 raft_consensus.cc:993] T 40f440212cf64606bbd7ddbf7bf153af P 770cf1ff89494e54baba82d84dac5831: : Instructing follower e1ee21679c764758a302a52b2f954b5b to start an election
I20260709 13:03:08.208244 11573 raft_consensus.cc:1081] T 40f440212cf64606bbd7ddbf7bf153af P 770cf1ff89494e54baba82d84dac5831 [term 1 LEADER]: Signalling peer e1ee21679c764758a302a52b2f954b5b to start an election
I20260709 13:03:08.210170 11252 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "40f440212cf64606bbd7ddbf7bf153af"
dest_uuid: "e1ee21679c764758a302a52b2f954b5b"
 from {username='slave'} at 127.0.0.1:37360
I20260709 13:03:08.210821 11252 raft_consensus.cc:493] T 40f440212cf64606bbd7ddbf7bf153af P e1ee21679c764758a302a52b2f954b5b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:08.211274 11252 raft_consensus.cc:3060] T 40f440212cf64606bbd7ddbf7bf153af P e1ee21679c764758a302a52b2f954b5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:08.214201 11582 raft_consensus.cc:993] T 676042afc21b4ff5b2f7146544765db1 P 244b85b5155e4f58a13b566c50083890: : Instructing follower e1ee21679c764758a302a52b2f954b5b to start an election
I20260709 13:03:08.214848 11582 raft_consensus.cc:1081] T 676042afc21b4ff5b2f7146544765db1 P 244b85b5155e4f58a13b566c50083890 [term 1 LEADER]: Signalling peer e1ee21679c764758a302a52b2f954b5b to start an election
I20260709 13:03:08.217375 11253 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "676042afc21b4ff5b2f7146544765db1"
dest_uuid: "e1ee21679c764758a302a52b2f954b5b"
 from {username='slave'} at 127.0.0.1:37370
I20260709 13:03:08.218065 11253 raft_consensus.cc:493] T 676042afc21b4ff5b2f7146544765db1 P e1ee21679c764758a302a52b2f954b5b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:08.218475 11253 raft_consensus.cc:3060] T 676042afc21b4ff5b2f7146544765db1 P e1ee21679c764758a302a52b2f954b5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:08.228094 11253 raft_consensus.cc:515] T 676042afc21b4ff5b2f7146544765db1 P e1ee21679c764758a302a52b2f954b5b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:08.220296 11252 raft_consensus.cc:515] T 40f440212cf64606bbd7ddbf7bf153af P e1ee21679c764758a302a52b2f954b5b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:08.234721 11253 leader_election.cc:290] T 676042afc21b4ff5b2f7146544765db1 P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 2 election: Requested vote from peers 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205), 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445)
I20260709 13:03:08.235458 11325 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f440212cf64606bbd7ddbf7bf153af" candidate_uuid: "e1ee21679c764758a302a52b2f954b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "770cf1ff89494e54baba82d84dac5831"
I20260709 13:03:08.236320 11325 raft_consensus.cc:3055] T 40f440212cf64606bbd7ddbf7bf153af P 770cf1ff89494e54baba82d84dac5831 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:08.236763 11325 raft_consensus.cc:740] T 40f440212cf64606bbd7ddbf7bf153af P 770cf1ff89494e54baba82d84dac5831 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 770cf1ff89494e54baba82d84dac5831, State: Running, Role: LEADER
I20260709 13:03:08.237771 11325 consensus_queue.cc:260] T 40f440212cf64606bbd7ddbf7bf153af P 770cf1ff89494e54baba82d84dac5831 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:08.239249 11325 raft_consensus.cc:3060] T 40f440212cf64606bbd7ddbf7bf153af P 770cf1ff89494e54baba82d84dac5831 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:08.237155 11402 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "676042afc21b4ff5b2f7146544765db1" candidate_uuid: "e1ee21679c764758a302a52b2f954b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "244b85b5155e4f58a13b566c50083890"
I20260709 13:03:08.242249 11402 raft_consensus.cc:3055] T 676042afc21b4ff5b2f7146544765db1 P 244b85b5155e4f58a13b566c50083890 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:08.242641 11402 raft_consensus.cc:740] T 676042afc21b4ff5b2f7146544765db1 P 244b85b5155e4f58a13b566c50083890 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 244b85b5155e4f58a13b566c50083890, State: Running, Role: LEADER
I20260709 13:03:08.243731 11402 consensus_queue.cc:260] T 676042afc21b4ff5b2f7146544765db1 P 244b85b5155e4f58a13b566c50083890 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:08.245205 11402 raft_consensus.cc:3060] T 676042afc21b4ff5b2f7146544765db1 P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:08.247581 11326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "676042afc21b4ff5b2f7146544765db1" candidate_uuid: "e1ee21679c764758a302a52b2f954b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "770cf1ff89494e54baba82d84dac5831"
I20260709 13:03:08.248476 11326 raft_consensus.cc:3060] T 676042afc21b4ff5b2f7146544765db1 P 770cf1ff89494e54baba82d84dac5831 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:08.253463 11325 raft_consensus.cc:2468] T 40f440212cf64606bbd7ddbf7bf153af P 770cf1ff89494e54baba82d84dac5831 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1ee21679c764758a302a52b2f954b5b in term 2.
I20260709 13:03:08.255155 11217 leader_election.cc:304] T 40f440212cf64606bbd7ddbf7bf153af P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 770cf1ff89494e54baba82d84dac5831, e1ee21679c764758a302a52b2f954b5b; no voters: 
I20260709 13:03:08.256135 11559 raft_consensus.cc:2804] T 40f440212cf64606bbd7ddbf7bf153af P e1ee21679c764758a302a52b2f954b5b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:08.257758 11559 raft_consensus.cc:697] T 40f440212cf64606bbd7ddbf7bf153af P e1ee21679c764758a302a52b2f954b5b [term 2 LEADER]: Becoming Leader. State: Replica: e1ee21679c764758a302a52b2f954b5b, State: Running, Role: LEADER
I20260709 13:03:08.258834 11559 consensus_queue.cc:237] T 40f440212cf64606bbd7ddbf7bf153af P e1ee21679c764758a302a52b2f954b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:08.265828 11326 raft_consensus.cc:2468] T 676042afc21b4ff5b2f7146544765db1 P 770cf1ff89494e54baba82d84dac5831 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1ee21679c764758a302a52b2f954b5b in term 2.
I20260709 13:03:08.266870 11252 leader_election.cc:290] T 40f440212cf64606bbd7ddbf7bf153af P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 2 election: Requested vote from peers 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205), 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445)
I20260709 13:03:08.267134 11401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40f440212cf64606bbd7ddbf7bf153af" candidate_uuid: "e1ee21679c764758a302a52b2f954b5b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "244b85b5155e4f58a13b566c50083890"
I20260709 13:03:08.269644 11401 raft_consensus.cc:3060] T 40f440212cf64606bbd7ddbf7bf153af P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:08.270450 11217 leader_election.cc:304] T 676042afc21b4ff5b2f7146544765db1 P e1ee21679c764758a302a52b2f954b5b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 770cf1ff89494e54baba82d84dac5831, e1ee21679c764758a302a52b2f954b5b; no voters: 
I20260709 13:03:08.267827 11402 raft_consensus.cc:2468] T 676042afc21b4ff5b2f7146544765db1 P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1ee21679c764758a302a52b2f954b5b in term 2.
I20260709 13:03:08.274147 11530 raft_consensus.cc:2804] T 676042afc21b4ff5b2f7146544765db1 P e1ee21679c764758a302a52b2f954b5b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:08.274742 11530 raft_consensus.cc:697] T 676042afc21b4ff5b2f7146544765db1 P e1ee21679c764758a302a52b2f954b5b [term 2 LEADER]: Becoming Leader. State: Replica: e1ee21679c764758a302a52b2f954b5b, State: Running, Role: LEADER
I20260709 13:03:08.275729 11530 consensus_queue.cc:237] T 676042afc21b4ff5b2f7146544765db1 P e1ee21679c764758a302a52b2f954b5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:08.277902 11152 catalog_manager.cc:5697] T 40f440212cf64606bbd7ddbf7bf153af P e1ee21679c764758a302a52b2f954b5b reported cstate change: term changed from 1 to 2, leader changed from 770cf1ff89494e54baba82d84dac5831 (127.0.107.194) to e1ee21679c764758a302a52b2f954b5b (127.0.107.193). New cstate: current_term: 2 leader_uuid: "e1ee21679c764758a302a52b2f954b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:08.279306 11401 raft_consensus.cc:2468] T 40f440212cf64606bbd7ddbf7bf153af P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1ee21679c764758a302a52b2f954b5b in term 2.
I20260709 13:03:08.292932 11152 catalog_manager.cc:5697] T 676042afc21b4ff5b2f7146544765db1 P e1ee21679c764758a302a52b2f954b5b reported cstate change: term changed from 1 to 2, leader changed from 244b85b5155e4f58a13b566c50083890 (127.0.107.195) to e1ee21679c764758a302a52b2f954b5b (127.0.107.193). New cstate: current_term: 2 leader_uuid: "e1ee21679c764758a302a52b2f954b5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:08.357930 11401 raft_consensus.cc:1275] T a271b64cf17e4bb2994ab9820417f2e8 P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Refusing update from remote peer 770cf1ff89494e54baba82d84dac5831: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:08.359479 11573 consensus_queue.cc:1048] T a271b64cf17e4bb2994ab9820417f2e8 P 770cf1ff89494e54baba82d84dac5831 [LEADER]: Connected to new peer: Peer: permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:08.373006 11252 raft_consensus.cc:1275] T a271b64cf17e4bb2994ab9820417f2e8 P e1ee21679c764758a302a52b2f954b5b [term 2 FOLLOWER]: Refusing update from remote peer 770cf1ff89494e54baba82d84dac5831: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:08.376763 11572 consensus_queue.cc:1048] T a271b64cf17e4bb2994ab9820417f2e8 P 770cf1ff89494e54baba82d84dac5831 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:08.389866 11574 raft_consensus.cc:993] T 1d3a3c192f1a498cb0c2253625c69f3a P e1ee21679c764758a302a52b2f954b5b: : Instructing follower 770cf1ff89494e54baba82d84dac5831 to start an election
I20260709 13:03:08.390446 11574 raft_consensus.cc:1081] T 1d3a3c192f1a498cb0c2253625c69f3a P e1ee21679c764758a302a52b2f954b5b [term 1 LEADER]: Signalling peer 770cf1ff89494e54baba82d84dac5831 to start an election
I20260709 13:03:08.394775 11326 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d3a3c192f1a498cb0c2253625c69f3a"
dest_uuid: "770cf1ff89494e54baba82d84dac5831"
 from {username='slave'} at 127.0.0.1:49536
I20260709 13:03:08.395493 11326 raft_consensus.cc:493] T 1d3a3c192f1a498cb0c2253625c69f3a P 770cf1ff89494e54baba82d84dac5831 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:08.395943 11326 raft_consensus.cc:3060] T 1d3a3c192f1a498cb0c2253625c69f3a P 770cf1ff89494e54baba82d84dac5831 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:08.405031 11326 raft_consensus.cc:515] T 1d3a3c192f1a498cb0c2253625c69f3a P 770cf1ff89494e54baba82d84dac5831 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:08.407995 11326 leader_election.cc:290] T 1d3a3c192f1a498cb0c2253625c69f3a P 770cf1ff89494e54baba82d84dac5831 [CANDIDATE]: Term 2 election: Requested vote from peers e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331), 244b85b5155e4f58a13b566c50083890 (127.0.107.195:34445)
I20260709 13:03:08.408337 11252 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3a3c192f1a498cb0c2253625c69f3a" candidate_uuid: "770cf1ff89494e54baba82d84dac5831" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e1ee21679c764758a302a52b2f954b5b"
I20260709 13:03:08.408596 11401 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d3a3c192f1a498cb0c2253625c69f3a" candidate_uuid: "770cf1ff89494e54baba82d84dac5831" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "244b85b5155e4f58a13b566c50083890"
I20260709 13:03:08.409117 11252 raft_consensus.cc:3055] T 1d3a3c192f1a498cb0c2253625c69f3a P e1ee21679c764758a302a52b2f954b5b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:08.409138 11401 raft_consensus.cc:3060] T 1d3a3c192f1a498cb0c2253625c69f3a P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:08.409559 11252 raft_consensus.cc:740] T 1d3a3c192f1a498cb0c2253625c69f3a P e1ee21679c764758a302a52b2f954b5b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e1ee21679c764758a302a52b2f954b5b, State: Running, Role: LEADER
I20260709 13:03:08.410486 11252 consensus_queue.cc:260] T 1d3a3c192f1a498cb0c2253625c69f3a P e1ee21679c764758a302a52b2f954b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:08.411819 11252 raft_consensus.cc:3060] T 1d3a3c192f1a498cb0c2253625c69f3a P e1ee21679c764758a302a52b2f954b5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:08.417773 11401 raft_consensus.cc:2468] T 1d3a3c192f1a498cb0c2253625c69f3a P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 770cf1ff89494e54baba82d84dac5831 in term 2.
I20260709 13:03:08.419265 11295 leader_election.cc:304] T 1d3a3c192f1a498cb0c2253625c69f3a P 770cf1ff89494e54baba82d84dac5831 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 244b85b5155e4f58a13b566c50083890, 770cf1ff89494e54baba82d84dac5831; no voters: 
I20260709 13:03:08.419713 11252 raft_consensus.cc:2468] T 1d3a3c192f1a498cb0c2253625c69f3a P e1ee21679c764758a302a52b2f954b5b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 770cf1ff89494e54baba82d84dac5831 in term 2.
I20260709 13:03:08.420292 11572 raft_consensus.cc:2804] T 1d3a3c192f1a498cb0c2253625c69f3a P 770cf1ff89494e54baba82d84dac5831 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:08.421003 11572 raft_consensus.cc:697] T 1d3a3c192f1a498cb0c2253625c69f3a P 770cf1ff89494e54baba82d84dac5831 [term 2 LEADER]: Becoming Leader. State: Replica: 770cf1ff89494e54baba82d84dac5831, State: Running, Role: LEADER
I20260709 13:03:08.421957 11572 consensus_queue.cc:237] T 1d3a3c192f1a498cb0c2253625c69f3a P 770cf1ff89494e54baba82d84dac5831 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:08.429776 11148 catalog_manager.cc:5697] T 1d3a3c192f1a498cb0c2253625c69f3a P 770cf1ff89494e54baba82d84dac5831 reported cstate change: term changed from 1 to 2, leader changed from e1ee21679c764758a302a52b2f954b5b (127.0.107.193) to 770cf1ff89494e54baba82d84dac5831 (127.0.107.194). New cstate: current_term: 2 leader_uuid: "770cf1ff89494e54baba82d84dac5831" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:08.460951 11401 raft_consensus.cc:1275] T 9ee4855c256940e7819fac4e5d729b0d P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Refusing update from remote peer 770cf1ff89494e54baba82d84dac5831: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:08.462661 11572 consensus_queue.cc:1048] T 9ee4855c256940e7819fac4e5d729b0d P 770cf1ff89494e54baba82d84dac5831 [LEADER]: Connected to new peer: Peer: permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:08.473527 11252 raft_consensus.cc:1275] T 9ee4855c256940e7819fac4e5d729b0d P e1ee21679c764758a302a52b2f954b5b [term 2 FOLLOWER]: Refusing update from remote peer 770cf1ff89494e54baba82d84dac5831: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:08.475162 11572 consensus_queue.cc:1048] T 9ee4855c256940e7819fac4e5d729b0d P 770cf1ff89494e54baba82d84dac5831 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:08.520773 11252 raft_consensus.cc:3060] T 97ab0a1ca9a548b69b4af26987138b42 P e1ee21679c764758a302a52b2f954b5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:08.526789 11401 raft_consensus.cc:1275] T 2634154f9f364cfea520c15a5ad325ed P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Refusing update from remote peer e1ee21679c764758a302a52b2f954b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:08.527468 11252 raft_consensus.cc:1275] T 97ab0a1ca9a548b69b4af26987138b42 P e1ee21679c764758a302a52b2f954b5b [term 2 FOLLOWER]: Refusing update from remote peer 244b85b5155e4f58a13b566c50083890: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:08.528497 11621 consensus_queue.cc:1048] T 2634154f9f364cfea520c15a5ad325ed P e1ee21679c764758a302a52b2f954b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:08.529075 11566 consensus_queue.cc:1048] T 97ab0a1ca9a548b69b4af26987138b42 P 244b85b5155e4f58a13b566c50083890 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:08.540658 11326 raft_consensus.cc:1275] T 97ab0a1ca9a548b69b4af26987138b42 P 770cf1ff89494e54baba82d84dac5831 [term 2 FOLLOWER]: Refusing update from remote peer 244b85b5155e4f58a13b566c50083890: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:08.542385 11325 raft_consensus.cc:1275] T 2634154f9f364cfea520c15a5ad325ed P 770cf1ff89494e54baba82d84dac5831 [term 2 FOLLOWER]: Refusing update from remote peer e1ee21679c764758a302a52b2f954b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:08.542981 11582 consensus_queue.cc:1048] T 97ab0a1ca9a548b69b4af26987138b42 P 244b85b5155e4f58a13b566c50083890 [LEADER]: Connected to new peer: Peer: permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:08.544376 11621 consensus_queue.cc:1048] T 2634154f9f364cfea520c15a5ad325ed P e1ee21679c764758a302a52b2f954b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:08.592739 11252 raft_consensus.cc:1275] T b0d7238307174b48aa91030413f37fea P e1ee21679c764758a302a52b2f954b5b [term 2 FOLLOWER]: Refusing update from remote peer 770cf1ff89494e54baba82d84dac5831: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:08.594209 11572 consensus_queue.cc:1048] T b0d7238307174b48aa91030413f37fea P 770cf1ff89494e54baba82d84dac5831 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:08.605469 11401 raft_consensus.cc:3060] T b0d7238307174b48aa91030413f37fea P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:08.615304 11401 raft_consensus.cc:1275] T b0d7238307174b48aa91030413f37fea P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Refusing update from remote peer 770cf1ff89494e54baba82d84dac5831: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:08.617101 11571 consensus_queue.cc:1048] T b0d7238307174b48aa91030413f37fea P 770cf1ff89494e54baba82d84dac5831 [LEADER]: Connected to new peer: Peer: permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:08.903429 11399 raft_consensus.cc:1275] T 40f440212cf64606bbd7ddbf7bf153af P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Refusing update from remote peer e1ee21679c764758a302a52b2f954b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:08.905472 11530 consensus_queue.cc:1048] T 40f440212cf64606bbd7ddbf7bf153af P e1ee21679c764758a302a52b2f954b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:08.915148 11254 raft_consensus.cc:1275] T 1d3a3c192f1a498cb0c2253625c69f3a P e1ee21679c764758a302a52b2f954b5b [term 2 FOLLOWER]: Refusing update from remote peer 770cf1ff89494e54baba82d84dac5831: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:08.917273 11573 consensus_queue.cc:1048] T 1d3a3c192f1a498cb0c2253625c69f3a P 770cf1ff89494e54baba82d84dac5831 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:08.931182 11402 raft_consensus.cc:1275] T 676042afc21b4ff5b2f7146544765db1 P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Refusing update from remote peer e1ee21679c764758a302a52b2f954b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:08.932927 11530 consensus_queue.cc:1048] T 676042afc21b4ff5b2f7146544765db1 P e1ee21679c764758a302a52b2f954b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:08.937575 11398 raft_consensus.cc:1275] T 1d3a3c192f1a498cb0c2253625c69f3a P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Refusing update from remote peer 770cf1ff89494e54baba82d84dac5831: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:08.939766 11571 consensus_queue.cc:1048] T 1d3a3c192f1a498cb0c2253625c69f3a P 770cf1ff89494e54baba82d84dac5831 [LEADER]: Connected to new peer: Peer: permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:08.986992 11329 raft_consensus.cc:1275] T 40f440212cf64606bbd7ddbf7bf153af P 770cf1ff89494e54baba82d84dac5831 [term 2 FOLLOWER]: Refusing update from remote peer e1ee21679c764758a302a52b2f954b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:08.988874 11326 raft_consensus.cc:1275] T 676042afc21b4ff5b2f7146544765db1 P 770cf1ff89494e54baba82d84dac5831 [term 2 FOLLOWER]: Refusing update from remote peer e1ee21679c764758a302a52b2f954b5b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:09.002331 11559 consensus_queue.cc:1048] T 40f440212cf64606bbd7ddbf7bf153af P e1ee21679c764758a302a52b2f954b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:09.006548 11559 consensus_queue.cc:1048] T 676042afc21b4ff5b2f7146544765db1 P e1ee21679c764758a302a52b2f954b5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:03:09.803191 11183 debug-util.cc:398] Leaking SignalData structure 0x7b080038d8a0 after lost signal to thread 434
W20260709 13:03:09.804355 11183 debug-util.cc:398] Leaking SignalData structure 0x7b08002dbf20 after lost signal to thread 11186
W20260709 13:03:09.805688 11183 debug-util.cc:398] Leaking SignalData structure 0x7b0800089de0 after lost signal to thread 11278
W20260709 13:03:09.806747 11183 debug-util.cc:398] Leaking SignalData structure 0x7b0800118b40 after lost signal to thread 11353
W20260709 13:03:09.807790 11183 debug-util.cc:398] Leaking SignalData structure 0x7b08001324c0 after lost signal to thread 11427
I20260709 13:03:10.866377 11152 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60976:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:03:10.900758 11152 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60976:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:03:10.932945   431 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:03:11.085290 11648 log.cc:927] Time spent T 676042afc21b4ff5b2f7146544765db1 P e1ee21679c764758a302a52b2f954b5b: Append to log took a long time: real 0.077s	user 0.000s	sys 0.002s
W20260709 13:03:11.195096 11655 log.cc:927] Time spent T a271b64cf17e4bb2994ab9820417f2e8 P 770cf1ff89494e54baba82d84dac5831: Append to log took a long time: real 0.062s	user 0.002s	sys 0.000s
W20260709 13:03:11.205228 11366 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33331, user_credentials={real_user=slave}} blocked reactor thread for 50451.6us
W20260709 13:03:11.225891 11292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33331, user_credentials={real_user=slave}} blocked reactor thread for 69792us
I20260709 13:03:11.275880 11675 tablet.cc:1724] T 97ab0a1ca9a548b69b4af26987138b42 P 244b85b5155e4f58a13b566c50083890: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:03:11.285920 11671 log.cc:927] Time spent T b0d7238307174b48aa91030413f37fea P 244b85b5155e4f58a13b566c50083890: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 13:03:11.290705 11323 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "560d3cdf923a4ab1b6d9f0747f8c40bf"
dest_uuid: "770cf1ff89494e54baba82d84dac5831"
mode: GRACEFUL
new_leader_uuid: "244b85b5155e4f58a13b566c50083890"
 from {username='slave'} at 127.0.0.1:43062
I20260709 13:03:11.292150 11323 raft_consensus.cc:606] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 770cf1ff89494e54baba82d84dac5831 [term 2 LEADER]: Received request to transfer leadership to TS 244b85b5155e4f58a13b566c50083890
I20260709 13:03:11.306856 11682 tablet.cc:1724] T 97ab0a1ca9a548b69b4af26987138b42 P 770cf1ff89494e54baba82d84dac5831: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:03:11.314538 11670 log.cc:927] Time spent T 1d3a3c192f1a498cb0c2253625c69f3a P 244b85b5155e4f58a13b566c50083890: Append to log took a long time: real 0.120s	user 0.002s	sys 0.000s
W20260709 13:03:11.319707 11292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33331, user_credentials={real_user=slave}} blocked reactor thread for 69856.8us
W20260709 13:03:11.392864 11295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34445, user_credentials={real_user=slave}} blocked reactor thread for 105425us
I20260709 13:03:11.429077 11690 raft_consensus.cc:993] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 770cf1ff89494e54baba82d84dac5831: : Instructing follower 244b85b5155e4f58a13b566c50083890 to start an election
I20260709 13:03:11.443823 11685 tablet.cc:1724] T 97ab0a1ca9a548b69b4af26987138b42 P e1ee21679c764758a302a52b2f954b5b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:03:11.467685 11680 log.cc:927] Time spent T 9ee4855c256940e7819fac4e5d729b0d P 244b85b5155e4f58a13b566c50083890: Append to log took a long time: real 0.133s	user 0.002s	sys 0.000s
W20260709 13:03:11.467693 11683 log.cc:927] Time spent T 676042afc21b4ff5b2f7146544765db1 P 244b85b5155e4f58a13b566c50083890: Append to log took a long time: real 0.182s	user 0.006s	sys 0.000s
I20260709 13:03:11.463042 11688 raft_consensus.cc:1081] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 770cf1ff89494e54baba82d84dac5831 [term 2 LEADER]: Signalling peer 244b85b5155e4f58a13b566c50083890 to start an election
I20260709 13:03:11.490588 11691 tablet.cc:1724] T 9ee4855c256940e7819fac4e5d729b0d P 770cf1ff89494e54baba82d84dac5831: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:03:11.493408 11672 log.cc:927] Time spent T 40f440212cf64606bbd7ddbf7bf153af P 770cf1ff89494e54baba82d84dac5831: Append to log took a long time: real 0.292s	user 0.006s	sys 0.005s
W20260709 13:03:11.496412 11662 log.cc:927] Time spent T 1d3a3c192f1a498cb0c2253625c69f3a P 770cf1ff89494e54baba82d84dac5831: Append to log took a long time: real 0.344s	user 0.005s	sys 0.000s
I20260709 13:03:11.535996 11403 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "560d3cdf923a4ab1b6d9f0747f8c40bf"
dest_uuid: "244b85b5155e4f58a13b566c50083890"
 from {username='slave'} at 127.0.0.1:49230
I20260709 13:03:11.536892 11403 raft_consensus.cc:493] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:11.537370 11403 raft_consensus.cc:3060] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:03:11.605033 11292 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.193:33331, user_credentials={real_user=slave}} blocked reactor thread for 59169.7us
W20260709 13:03:11.567875 11660 log.cc:927] Time spent T 2634154f9f364cfea520c15a5ad325ed P e1ee21679c764758a302a52b2f954b5b: Append to log took a long time: real 0.076s	user 0.001s	sys 0.001s
W20260709 13:03:11.566480 11681 log.cc:927] Time spent T b0d7238307174b48aa91030413f37fea P e1ee21679c764758a302a52b2f954b5b: Append to log took a long time: real 0.315s	user 0.000s	sys 0.015s
I20260709 13:03:11.610816 11706 tablet.cc:1724] T b0d7238307174b48aa91030413f37fea P 244b85b5155e4f58a13b566c50083890: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:11.623684 11698 tablet.cc:1724] T 59c4fef046b94123b15bb064ae4bacc5 P 244b85b5155e4f58a13b566c50083890: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:03:11.602627 11295 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34445, user_credentials={real_user=slave}} blocked reactor thread for 50176.3us
I20260709 13:03:11.522054 11699 tablet.cc:1724] T a271b64cf17e4bb2994ab9820417f2e8 P 770cf1ff89494e54baba82d84dac5831: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:11.637528 11696 tablet.cc:1724] T 59c4fef046b94123b15bb064ae4bacc5 P e1ee21679c764758a302a52b2f954b5b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:11.576687 11694 tablet.cc:1724] T 40f440212cf64606bbd7ddbf7bf153af P e1ee21679c764758a302a52b2f954b5b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:11.559561 11704 tablet.cc:1724] T a271b64cf17e4bb2994ab9820417f2e8 P 244b85b5155e4f58a13b566c50083890: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:11.658983 11705 tablet.cc:1724] T 9ee4855c256940e7819fac4e5d729b0d P e1ee21679c764758a302a52b2f954b5b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:03:11.672092 11217 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.194:39205, user_credentials={real_user=slave}} blocked reactor thread for 77893us
I20260709 13:03:11.668900 11403 raft_consensus.cc:515] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 244b85b5155e4f58a13b566c50083890 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
W20260709 13:03:11.665870 11220 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.0.107.195:34445, user_credentials={real_user=slave}} blocked reactor thread for 86051.3us
I20260709 13:03:11.676187 11403 leader_election.cc:290] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 3 election: Requested vote from peers e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331), 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205)
I20260709 13:03:11.678056 11327 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "560d3cdf923a4ab1b6d9f0747f8c40bf" candidate_uuid: "244b85b5155e4f58a13b566c50083890" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "770cf1ff89494e54baba82d84dac5831"
I20260709 13:03:11.679159 11327 raft_consensus.cc:3055] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 770cf1ff89494e54baba82d84dac5831 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:03:11.679572 11327 raft_consensus.cc:740] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 770cf1ff89494e54baba82d84dac5831 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 770cf1ff89494e54baba82d84dac5831, State: Running, Role: LEADER
I20260709 13:03:11.680758 11327 consensus_queue.cc:260] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 770cf1ff89494e54baba82d84dac5831 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:11.681939 11327 raft_consensus.cc:3060] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 770cf1ff89494e54baba82d84dac5831 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:11.682358 11675 tablet.cc:1724] T 40f440212cf64606bbd7ddbf7bf153af P 244b85b5155e4f58a13b566c50083890: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:11.703343 11254 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5efc9b8718b0461f95bd09f4b67f1197"
dest_uuid: "e1ee21679c764758a302a52b2f954b5b"
mode: GRACEFUL
new_leader_uuid: "244b85b5155e4f58a13b566c50083890"
 from {username='slave'} at 127.0.0.1:60274
I20260709 13:03:11.705123 11254 raft_consensus.cc:606] T 5efc9b8718b0461f95bd09f4b67f1197 P e1ee21679c764758a302a52b2f954b5b [term 1 LEADER]: Received request to transfer leadership to TS 244b85b5155e4f58a13b566c50083890
I20260709 13:03:11.711020 11682 tablet.cc:1724] T 40f440212cf64606bbd7ddbf7bf153af P 770cf1ff89494e54baba82d84dac5831: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:11.712615 11703 tablet.cc:1724] T b0d7238307174b48aa91030413f37fea P 770cf1ff89494e54baba82d84dac5831: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:11.729719 11685 tablet.cc:1724] T a271b64cf17e4bb2994ab9820417f2e8 P e1ee21679c764758a302a52b2f954b5b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:11.733071 11251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "560d3cdf923a4ab1b6d9f0747f8c40bf" candidate_uuid: "244b85b5155e4f58a13b566c50083890" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e1ee21679c764758a302a52b2f954b5b"
I20260709 13:03:11.734655 11149 catalog_manager.cc:5789] TS 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205) does not have the latest schema for tablet 1d3a3c192f1a498cb0c2253625c69f3a (table soft_deleted_table [id=0b1c6b950fd545d9bc3398534e94374c]). Expected version 1 got 0
I20260709 13:03:11.737471 11149 catalog_manager.cc:5789] TS 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205) does not have the latest schema for tablet b0d7238307174b48aa91030413f37fea (table soft_deleted_table [id=0b1c6b950fd545d9bc3398534e94374c]). Expected version 1 got 0
I20260709 13:03:11.738258 11149 catalog_manager.cc:5789] TS 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205) does not have the latest schema for tablet a271b64cf17e4bb2994ab9820417f2e8 (table soft_deleted_table [id=0b1c6b950fd545d9bc3398534e94374c]). Expected version 1 got 0
I20260709 13:03:11.735939 11401 raft_consensus.cc:1240] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 244b85b5155e4f58a13b566c50083890 [term 3 FOLLOWER]: Rejecting Update request from peer 770cf1ff89494e54baba82d84dac5831 for earlier term 2. Current term is 3. Ops: []
I20260709 13:03:11.738831 11251 raft_consensus.cc:3060] T 560d3cdf923a4ab1b6d9f0747f8c40bf P e1ee21679c764758a302a52b2f954b5b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:03:11.737212 11148 catalog_manager.cc:5789] TS e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331) does not have the latest schema for tablet 676042afc21b4ff5b2f7146544765db1 (table soft_deleted_table [id=0b1c6b950fd545d9bc3398534e94374c]). Expected version 1 got 0
I20260709 13:03:11.743403 11148 catalog_manager.cc:5789] TS e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331) does not have the latest schema for tablet 2634154f9f364cfea520c15a5ad325ed (table soft_deleted_table [id=0b1c6b950fd545d9bc3398534e94374c]). Expected version 1 got 0
I20260709 13:03:11.747668 11699 tablet.cc:1724] T 59c4fef046b94123b15bb064ae4bacc5 P 770cf1ff89494e54baba82d84dac5831: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:11.777019   431 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:03:11.711720 11691 tablet.cc:1724] T 1d3a3c192f1a498cb0c2253625c69f3a P 770cf1ff89494e54baba82d84dac5831: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:11.778972   431 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:03:11.763728 11704 tablet.cc:1724] T 676042afc21b4ff5b2f7146544765db1 P 244b85b5155e4f58a13b566c50083890: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:11.797437 11696 tablet.cc:1724] T 676042afc21b4ff5b2f7146544765db1 P e1ee21679c764758a302a52b2f954b5b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:11.804333 11251 raft_consensus.cc:2468] T 560d3cdf923a4ab1b6d9f0747f8c40bf P e1ee21679c764758a302a52b2f954b5b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 244b85b5155e4f58a13b566c50083890 in term 3.
I20260709 13:03:11.814438 11711 raft_consensus.cc:993] T 5efc9b8718b0461f95bd09f4b67f1197 P e1ee21679c764758a302a52b2f954b5b: : Instructing follower 244b85b5155e4f58a13b566c50083890 to start an election
I20260709 13:03:11.815315 11711 raft_consensus.cc:1081] T 5efc9b8718b0461f95bd09f4b67f1197 P e1ee21679c764758a302a52b2f954b5b [term 1 LEADER]: Signalling peer 244b85b5155e4f58a13b566c50083890 to start an election
I20260709 13:03:11.816514 11366 leader_election.cc:304] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 244b85b5155e4f58a13b566c50083890, e1ee21679c764758a302a52b2f954b5b; no voters: 
I20260709 13:03:11.818477 11401 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5efc9b8718b0461f95bd09f4b67f1197"
dest_uuid: "244b85b5155e4f58a13b566c50083890"
 from {username='slave'} at 127.0.0.1:49242
I20260709 13:03:11.818535 11667 raft_consensus.cc:2804] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 244b85b5155e4f58a13b566c50083890 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:03:11.819258 11401 raft_consensus.cc:493] T 5efc9b8718b0461f95bd09f4b67f1197 P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:03:11.819370 11667 raft_consensus.cc:697] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 244b85b5155e4f58a13b566c50083890 [term 3 LEADER]: Becoming Leader. State: Replica: 244b85b5155e4f58a13b566c50083890, State: Running, Role: LEADER
I20260709 13:03:11.819706 11401 raft_consensus.cc:3060] T 5efc9b8718b0461f95bd09f4b67f1197 P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:11.820508 11667 consensus_queue.cc:237] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 244b85b5155e4f58a13b566c50083890 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:11.784742 11698 tablet.cc:1724] T 9ee4855c256940e7819fac4e5d729b0d P 244b85b5155e4f58a13b566c50083890: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:11.815280 11694 tablet.cc:1724] T 1d3a3c192f1a498cb0c2253625c69f3a P e1ee21679c764758a302a52b2f954b5b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:11.830325 11675 tablet.cc:1724] T 2634154f9f364cfea520c15a5ad325ed P 244b85b5155e4f58a13b566c50083890: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:11.818277 11706 tablet.cc:1724] T 1d3a3c192f1a498cb0c2253625c69f3a P 244b85b5155e4f58a13b566c50083890: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:11.840019 11699 tablet.cc:1724] T 676042afc21b4ff5b2f7146544765db1 P 770cf1ff89494e54baba82d84dac5831: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:11.872296 11694 tablet.cc:1724] T 2634154f9f364cfea520c15a5ad325ed P e1ee21679c764758a302a52b2f954b5b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:11.877826 11401 raft_consensus.cc:515] T 5efc9b8718b0461f95bd09f4b67f1197 P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } }
I20260709 13:03:11.887274 11328 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5efc9b8718b0461f95bd09f4b67f1197" candidate_uuid: "244b85b5155e4f58a13b566c50083890" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "770cf1ff89494e54baba82d84dac5831"
I20260709 13:03:11.887940 11328 raft_consensus.cc:3060] T 5efc9b8718b0461f95bd09f4b67f1197 P 770cf1ff89494e54baba82d84dac5831 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:11.888763 11705 tablet.cc:1724] T b0d7238307174b48aa91030413f37fea P e1ee21679c764758a302a52b2f954b5b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:11.901901 11328 raft_consensus.cc:2468] T 5efc9b8718b0461f95bd09f4b67f1197 P 770cf1ff89494e54baba82d84dac5831 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 244b85b5155e4f58a13b566c50083890 in term 2.
I20260709 13:03:11.910362 11366 leader_election.cc:304] T 5efc9b8718b0461f95bd09f4b67f1197 P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 244b85b5155e4f58a13b566c50083890, 770cf1ff89494e54baba82d84dac5831; no voters: 
I20260709 13:03:11.911437 11667 raft_consensus.cc:2804] T 5efc9b8718b0461f95bd09f4b67f1197 P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:03:11.882933 11327 raft_consensus.cc:2468] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 770cf1ff89494e54baba82d84dac5831 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 244b85b5155e4f58a13b566c50083890 in term 3.
I20260709 13:03:11.905296 11251 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5efc9b8718b0461f95bd09f4b67f1197" candidate_uuid: "244b85b5155e4f58a13b566c50083890" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e1ee21679c764758a302a52b2f954b5b"
I20260709 13:03:11.915581 11251 raft_consensus.cc:3055] T 5efc9b8718b0461f95bd09f4b67f1197 P e1ee21679c764758a302a52b2f954b5b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:03:11.916008 11251 raft_consensus.cc:740] T 5efc9b8718b0461f95bd09f4b67f1197 P e1ee21679c764758a302a52b2f954b5b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e1ee21679c764758a302a52b2f954b5b, State: Running, Role: LEADER
I20260709 13:03:11.917161 11251 consensus_queue.cc:260] T 5efc9b8718b0461f95bd09f4b67f1197 P e1ee21679c764758a302a52b2f954b5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } }
I20260709 13:03:11.918656 11251 raft_consensus.cc:3060] T 5efc9b8718b0461f95bd09f4b67f1197 P e1ee21679c764758a302a52b2f954b5b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:03:11.906212 11699 tablet.cc:1724] T 2634154f9f364cfea520c15a5ad325ed P 770cf1ff89494e54baba82d84dac5831: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:03:11.931258 11703 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:49526 (request call id 18) took 1004 ms. Trace:
I20260709 13:03:11.912286 11667 raft_consensus.cc:697] T 5efc9b8718b0461f95bd09f4b67f1197 P 244b85b5155e4f58a13b566c50083890 [term 2 LEADER]: Becoming Leader. State: Replica: 244b85b5155e4f58a13b566c50083890, State: Running, Role: LEADER
I20260709 13:03:11.937081 11667 consensus_queue.cc:237] T 5efc9b8718b0461f95bd09f4b67f1197 P 244b85b5155e4f58a13b566c50083890 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } }
I20260709 13:03:11.937706 11694 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.AlterSchema from 127.0.0.1:37350 (request call id 19) took 1015 ms. Trace:
I20260709 13:03:11.913573 11401 leader_election.cc:290] T 5efc9b8718b0461f95bd09f4b67f1197 P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 2 election: Requested vote from peers 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205), e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331)
I20260709 13:03:11.938337 11694 rpcz_store.cc:276] 0709 13:03:10.922079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:10.922260 (+   181us) service_pool.cc:224] Handling call
0709 13:03:11.937636 (+1015376us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:11.028476 (+     0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0709 13:03:11.029264 (+   788us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0709 13:03:11.029305 (+    41us) alter_schema_op.cc:66] Acquired schema lock
0709 13:03:11.029842 (+   537us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0709 13:03:11.030004 (+   162us) alter_schema_op.cc:128] START. Timestamp: 1783602191029906
0709 13:03:11.030032 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 13:03:11.053651 (+ 23619us) log.cc:844] Serialized 204 byte log entry
0709 13:03:11.491336 (+437685us) spinlock_profiling.cc:243] Waited 5.94 ms on lock 0x7b180026bd80. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef29c2a6 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f8196de1 00007fa9f81a35b1 00007fa9ef2ce3f3 00007fa9ef2d07c1
0709 13:03:11.567088 (+ 75752us) spinlock_profiling.cc:243] Waited 9.38 ms on lock 0x7b4400022b4c. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9ef156db1 00007fa9ef1f4c85 00007fa9ef1f56a2 00007fa9f1f671db 00007fa9f1f62aaf 00007fa9f1f5686e 00007fa9f1f55bb6 00007fa9f1f557d8 00007fa9f1f5f221 00007fa9f1f5f1d9 00007fa9f1f5f169
0709 13:03:11.690357 (+123269us) spinlock_profiling.cc:243] Waited 2.89 ms on lock 0x7b5400405ea0. stack: 00007fa9ef29c343 00007fa9ef29c240 00007fa9eec2b1d4 00007fa9f8969304 00007fa9f8969299 00007fa9f2324571 00007fa9f2330dbe 00007fa9f233b930 00007fa9f233b8d8 00007fa9f233b858 00007fa9f233b813 00007fa9f233aa9c 00007fa9f8226626 00007fa9f8220dd8 00007fa9f23777cb 00007fa9f237a2c0
0709 13:03:11.750363 (+ 60006us) op_driver.cc:464] REPLICATION: finished
0709 13:03:11.872092 (+121729us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0709 13:03:11.903389 (+ 31297us) log.cc:844] Serialized 5 byte log entry
0709 13:03:11.935516 (+ 32127us) tablet_metadata.cc:665] Metadata flushed
0709 13:03:11.936657 (+  1141us) log.cc:844] Serialized 14 byte log entry
0709 13:03:11.937430 (+   773us) alter_schema_op.cc:73] Released schema lock
0709 13:03:11.937464 (+    34us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":121527,"mutex_wait_us":52572,"prepare.queue_time_us":37638,"prepare.run_cpu_time_us":13142,"prepare.run_wall_time_us":76270,"raft.queue_time_us":74066,"raft.run_cpu_time_us":2584,"raft.run_wall_time_us":71982,"replication_time_us":720156,"spinlock_wait_cycles":43804416,"thread_start_us":64844,"threads_started":3,"wal-append.queue_time_us":48836}]]}
I20260709 13:03:11.948473 11251 raft_consensus.cc:2468] T 5efc9b8718b0461f95bd09f4b67f1197 P e1ee21679c764758a302a52b2f954b5b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 244b85b5155e4f58a13b566c50083890 in term 2.
I20260709 13:03:11.931939 11703 rpcz_store.cc:276] 0709 13:03:10.926980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:03:10.927756 (+   776us) service_pool.cc:224] Handling call
0709 13:03:11.931183 (+1003427us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:03:10.952924 (+     0us) alter_schema_op.cc:104] PREPARE ALTER-SCHEMA: Starting
0709 13:03:10.953993 (+  1069us) alter_schema_op.cc:63] Acquiring schema lock in exclusive mode
0709 13:03:10.954040 (+    47us) alter_schema_op.cc:66] Acquired schema lock
0709 13:03:10.954137 (+    97us) alter_schema_op.cc:119] PREPARE ALTER-SCHEMA: finished
0709 13:03:10.954327 (+   190us) alter_schema_op.cc:128] START. Timestamp: 1783602190954233
0709 13:03:10.954360 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:03:10.955547 (+  1187us) log.cc:844] Serialized 204 byte log entry
0709 13:03:11.526075 (+570528us) op_driver.cc:464] REPLICATION: finished
0709 13:03:11.636359 (+110284us) alter_schema_op.cc:133] APPLY ALTER-SCHEMA: Starting
0709 13:03:11.728555 (+ 92196us) log.cc:844] Serialized 5 byte log entry
0709 13:03:11.929997 (+201442us) tablet_metadata.cc:665] Metadata flushed
0709 13:03:11.930869 (+   872us) log.cc:844] Serialized 14 byte log entry
0709 13:03:11.931003 (+   134us) alter_schema_op.cc:73] Released schema lock
0709 13:03:11.931035 (+    32us) alter_schema_op.cc:186] AlterSchemaCommitCallback: making alter schema visible
Metrics: {"child_traces":[["op",{"apply.queue_time_us":92145,"mutex_wait_us":79,"prepare.queue_time_us":23605,"prepare.run_cpu_time_us":15211,"prepare.run_wall_time_us":23842,"raft.queue_time_us":426,"raft.run_cpu_time_us":3033,"raft.run_wall_time_us":3033,"replication_time_us":565639,"spinlock_wait_cycles":1078144,"thread_start_us":78405,"threads_started":3,"wal-append.queue_time_us":47754}]]}
I20260709 13:03:11.956866 11152 catalog_manager.cc:5697] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 244b85b5155e4f58a13b566c50083890 reported cstate change: term changed from 2 to 3, leader changed from 770cf1ff89494e54baba82d84dac5831 (127.0.107.194) to 244b85b5155e4f58a13b566c50083890 (127.0.107.195). New cstate: current_term: 3 leader_uuid: "244b85b5155e4f58a13b566c50083890" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } health_report { overall_health: HEALTHY } } }
I20260709 13:03:12.023581 11151 catalog_manager.cc:5697] T 5efc9b8718b0461f95bd09f4b67f1197 P 244b85b5155e4f58a13b566c50083890 reported cstate change: term changed from 1 to 2, leader changed from e1ee21679c764758a302a52b2f954b5b (127.0.107.193) to 244b85b5155e4f58a13b566c50083890 (127.0.107.195). New cstate: current_term: 2 leader_uuid: "244b85b5155e4f58a13b566c50083890" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } health_report { overall_health: UNKNOWN } } }
I20260709 13:03:12.048090 11152 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 232d656f14734e1592f736d056eb3fc3: soft_deleted_table [id=0b1c6b950fd545d9bc3398534e94374c] alter complete (version 1)
I20260709 13:03:12.234860 11254 raft_consensus.cc:1275] T 560d3cdf923a4ab1b6d9f0747f8c40bf P e1ee21679c764758a302a52b2f954b5b [term 3 FOLLOWER]: Refusing update from remote peer 244b85b5155e4f58a13b566c50083890: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:12.243511 11667 consensus_queue.cc:1048] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 244b85b5155e4f58a13b566c50083890 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:03:12.271189 11327 raft_consensus.cc:1275] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 770cf1ff89494e54baba82d84dac5831 [term 3 FOLLOWER]: Refusing update from remote peer 244b85b5155e4f58a13b566c50083890: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:03:12.274065 11667 consensus_queue.cc:1048] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 244b85b5155e4f58a13b566c50083890 [LEADER]: Connected to new peer: Peer: permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:03:12.446733 11327 raft_consensus.cc:1275] T 5efc9b8718b0461f95bd09f4b67f1197 P 770cf1ff89494e54baba82d84dac5831 [term 2 FOLLOWER]: Refusing update from remote peer 244b85b5155e4f58a13b566c50083890: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:12.448658 11723 consensus_queue.cc:1048] T 5efc9b8718b0461f95bd09f4b67f1197 P 244b85b5155e4f58a13b566c50083890 [LEADER]: Connected to new peer: Peer: permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:03:12.471077 11254 raft_consensus.cc:1275] T 5efc9b8718b0461f95bd09f4b67f1197 P e1ee21679c764758a302a52b2f954b5b [term 2 FOLLOWER]: Refusing update from remote peer 244b85b5155e4f58a13b566c50083890: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:03:12.482992 11726 consensus_queue.cc:1048] T 5efc9b8718b0461f95bd09f4b67f1197 P 244b85b5155e4f58a13b566c50083890 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:03:12.868948   431 tablet_server.cc:179] TabletServer@127.0.107.193:0 shutting down...
W20260709 13:03:12.931875 11366 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 116 similar messages]
I20260709 13:03:12.947084   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 13:03:12.956408 11292 consensus_peers.cc:597] T b0d7238307174b48aa91030413f37fea P 770cf1ff89494e54baba82d84dac5831 -> Peer e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331): Couldn't send request to peer e1ee21679c764758a302a52b2f954b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:12.956843   431 tablet_replica.cc:333] T b0d7238307174b48aa91030413f37fea P e1ee21679c764758a302a52b2f954b5b: stopping tablet replica
W20260709 13:03:12.957520 11292 consensus_peers.cc:597] T ae318533d2c141c9bef5b69d44f64d90 P 770cf1ff89494e54baba82d84dac5831 -> Peer e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331): Couldn't send request to peer e1ee21679c764758a302a52b2f954b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:12.965607 11292 consensus_peers.cc:597] T 9ee4855c256940e7819fac4e5d729b0d P 770cf1ff89494e54baba82d84dac5831 -> Peer e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331): Couldn't send request to peer e1ee21679c764758a302a52b2f954b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:12.958851   431 raft_consensus.cc:2243] T b0d7238307174b48aa91030413f37fea P e1ee21679c764758a302a52b2f954b5b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:12.969167   431 raft_consensus.cc:2272] T b0d7238307174b48aa91030413f37fea P e1ee21679c764758a302a52b2f954b5b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:12.971211 11292 consensus_peers.cc:597] T 564b17319fe141cab611a47bf22f0b76 P 770cf1ff89494e54baba82d84dac5831 -> Peer e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331): Couldn't send request to peer e1ee21679c764758a302a52b2f954b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:12.974517   431 tablet_replica.cc:333] T 59c4fef046b94123b15bb064ae4bacc5 P e1ee21679c764758a302a52b2f954b5b: stopping tablet replica
I20260709 13:03:12.975836   431 raft_consensus.cc:2243] T 59c4fef046b94123b15bb064ae4bacc5 P e1ee21679c764758a302a52b2f954b5b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:12.977284   431 raft_consensus.cc:2272] T 59c4fef046b94123b15bb064ae4bacc5 P e1ee21679c764758a302a52b2f954b5b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:12.978180 11366 consensus_peers.cc:597] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 244b85b5155e4f58a13b566c50083890 -> Peer e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331): Couldn't send request to peer e1ee21679c764758a302a52b2f954b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:12.982028   431 tablet_replica.cc:333] T 676042afc21b4ff5b2f7146544765db1 P e1ee21679c764758a302a52b2f954b5b: stopping tablet replica
I20260709 13:03:12.983404   431 raft_consensus.cc:2243] T 676042afc21b4ff5b2f7146544765db1 P e1ee21679c764758a302a52b2f954b5b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:12.984858   431 raft_consensus.cc:2272] T 676042afc21b4ff5b2f7146544765db1 P e1ee21679c764758a302a52b2f954b5b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:12.985239 11292 consensus_peers.cc:597] T 2893484e7ace4fd4af892dc3aa82998b P 770cf1ff89494e54baba82d84dac5831 -> Peer e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331): Couldn't send request to peer e1ee21679c764758a302a52b2f954b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:12.988847   431 tablet_replica.cc:333] T 97ab0a1ca9a548b69b4af26987138b42 P e1ee21679c764758a302a52b2f954b5b: stopping tablet replica
I20260709 13:03:12.990115   431 raft_consensus.cc:2243] T 97ab0a1ca9a548b69b4af26987138b42 P e1ee21679c764758a302a52b2f954b5b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:12.990862   431 raft_consensus.cc:2272] T 97ab0a1ca9a548b69b4af26987138b42 P e1ee21679c764758a302a52b2f954b5b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:12.994752   431 tablet_replica.cc:333] T 2634154f9f364cfea520c15a5ad325ed P e1ee21679c764758a302a52b2f954b5b: stopping tablet replica
I20260709 13:03:12.996084   431 raft_consensus.cc:2243] T 2634154f9f364cfea520c15a5ad325ed P e1ee21679c764758a302a52b2f954b5b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:12.997597   431 raft_consensus.cc:2272] T 2634154f9f364cfea520c15a5ad325ed P e1ee21679c764758a302a52b2f954b5b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.002835   431 tablet_replica.cc:333] T 3c7b44fee55543f58f87877c52ecfb79 P e1ee21679c764758a302a52b2f954b5b: stopping tablet replica
I20260709 13:03:13.003934   431 raft_consensus.cc:2243] T 3c7b44fee55543f58f87877c52ecfb79 P e1ee21679c764758a302a52b2f954b5b [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:03:13.006083 11366 consensus_peers.cc:597] T b604dfd1da1840b2836273c326d4f269 P 244b85b5155e4f58a13b566c50083890 -> Peer e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331): Couldn't send request to peer e1ee21679c764758a302a52b2f954b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:13.007417   431 raft_consensus.cc:2272] T 3c7b44fee55543f58f87877c52ecfb79 P e1ee21679c764758a302a52b2f954b5b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.011584   431 tablet_replica.cc:333] T ae318533d2c141c9bef5b69d44f64d90 P e1ee21679c764758a302a52b2f954b5b: stopping tablet replica
I20260709 13:03:13.012699   431 raft_consensus.cc:2243] T ae318533d2c141c9bef5b69d44f64d90 P e1ee21679c764758a302a52b2f954b5b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.013443   431 raft_consensus.cc:2272] T ae318533d2c141c9bef5b69d44f64d90 P e1ee21679c764758a302a52b2f954b5b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.018342   431 tablet_replica.cc:333] T 560d3cdf923a4ab1b6d9f0747f8c40bf P e1ee21679c764758a302a52b2f954b5b: stopping tablet replica
I20260709 13:03:13.019692   431 raft_consensus.cc:2243] T 560d3cdf923a4ab1b6d9f0747f8c40bf P e1ee21679c764758a302a52b2f954b5b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.020777   431 raft_consensus.cc:2272] T 560d3cdf923a4ab1b6d9f0747f8c40bf P e1ee21679c764758a302a52b2f954b5b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.025269   431 tablet_replica.cc:333] T 2893484e7ace4fd4af892dc3aa82998b P e1ee21679c764758a302a52b2f954b5b: stopping tablet replica
I20260709 13:03:13.026572   431 raft_consensus.cc:2243] T 2893484e7ace4fd4af892dc3aa82998b P e1ee21679c764758a302a52b2f954b5b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.027570   431 raft_consensus.cc:2272] T 2893484e7ace4fd4af892dc3aa82998b P e1ee21679c764758a302a52b2f954b5b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.031709   431 tablet_replica.cc:333] T 564b17319fe141cab611a47bf22f0b76 P e1ee21679c764758a302a52b2f954b5b: stopping tablet replica
I20260709 13:03:13.032871   431 raft_consensus.cc:2243] T 564b17319fe141cab611a47bf22f0b76 P e1ee21679c764758a302a52b2f954b5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.034240   431 raft_consensus.cc:2272] T 564b17319fe141cab611a47bf22f0b76 P e1ee21679c764758a302a52b2f954b5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.039386   431 tablet_replica.cc:333] T a271b64cf17e4bb2994ab9820417f2e8 P e1ee21679c764758a302a52b2f954b5b: stopping tablet replica
I20260709 13:03:13.040395   431 raft_consensus.cc:2243] T a271b64cf17e4bb2994ab9820417f2e8 P e1ee21679c764758a302a52b2f954b5b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.041159   431 raft_consensus.cc:2272] T a271b64cf17e4bb2994ab9820417f2e8 P e1ee21679c764758a302a52b2f954b5b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.045094   431 tablet_replica.cc:333] T 90befbbddbe842949771c44d3a3ea4db P e1ee21679c764758a302a52b2f954b5b: stopping tablet replica
I20260709 13:03:13.046233   431 raft_consensus.cc:2243] T 90befbbddbe842949771c44d3a3ea4db P e1ee21679c764758a302a52b2f954b5b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.049522   431 raft_consensus.cc:2272] T 90befbbddbe842949771c44d3a3ea4db P e1ee21679c764758a302a52b2f954b5b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.054405   431 tablet_replica.cc:333] T e5a872d4022c47d4b20da810ceffb01b P e1ee21679c764758a302a52b2f954b5b: stopping tablet replica
I20260709 13:03:13.055696   431 raft_consensus.cc:2243] T e5a872d4022c47d4b20da810ceffb01b P e1ee21679c764758a302a52b2f954b5b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.057312   431 raft_consensus.cc:2272] T e5a872d4022c47d4b20da810ceffb01b P e1ee21679c764758a302a52b2f954b5b [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:13.061918 11366 consensus_peers.cc:597] T 5efc9b8718b0461f95bd09f4b67f1197 P 244b85b5155e4f58a13b566c50083890 -> Peer e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331): Couldn't send request to peer e1ee21679c764758a302a52b2f954b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:13.061865   431 tablet_replica.cc:333] T 40f440212cf64606bbd7ddbf7bf153af P e1ee21679c764758a302a52b2f954b5b: stopping tablet replica
I20260709 13:03:13.063972   431 raft_consensus.cc:2243] T 40f440212cf64606bbd7ddbf7bf153af P e1ee21679c764758a302a52b2f954b5b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.065603   431 raft_consensus.cc:2272] T 40f440212cf64606bbd7ddbf7bf153af P e1ee21679c764758a302a52b2f954b5b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.070006   431 tablet_replica.cc:333] T 9ee4855c256940e7819fac4e5d729b0d P e1ee21679c764758a302a52b2f954b5b: stopping tablet replica
I20260709 13:03:13.071225   431 raft_consensus.cc:2243] T 9ee4855c256940e7819fac4e5d729b0d P e1ee21679c764758a302a52b2f954b5b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.072441   431 raft_consensus.cc:2272] T 9ee4855c256940e7819fac4e5d729b0d P e1ee21679c764758a302a52b2f954b5b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.076786   431 tablet_replica.cc:333] T b604dfd1da1840b2836273c326d4f269 P e1ee21679c764758a302a52b2f954b5b: stopping tablet replica
I20260709 13:03:13.077863   431 raft_consensus.cc:2243] T b604dfd1da1840b2836273c326d4f269 P e1ee21679c764758a302a52b2f954b5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.084759   431 raft_consensus.cc:2272] T b604dfd1da1840b2836273c326d4f269 P e1ee21679c764758a302a52b2f954b5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.088704   431 tablet_replica.cc:333] T 1d3a3c192f1a498cb0c2253625c69f3a P e1ee21679c764758a302a52b2f954b5b: stopping tablet replica
I20260709 13:03:13.089695   431 raft_consensus.cc:2243] T 1d3a3c192f1a498cb0c2253625c69f3a P e1ee21679c764758a302a52b2f954b5b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.090483   431 raft_consensus.cc:2272] T 1d3a3c192f1a498cb0c2253625c69f3a P e1ee21679c764758a302a52b2f954b5b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.094400   431 tablet_replica.cc:333] T 5efc9b8718b0461f95bd09f4b67f1197 P e1ee21679c764758a302a52b2f954b5b: stopping tablet replica
I20260709 13:03:13.095414   431 raft_consensus.cc:2243] T 5efc9b8718b0461f95bd09f4b67f1197 P e1ee21679c764758a302a52b2f954b5b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.096082   431 raft_consensus.cc:2272] T 5efc9b8718b0461f95bd09f4b67f1197 P e1ee21679c764758a302a52b2f954b5b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:13.100199 11292 consensus_peers.cc:597] T a271b64cf17e4bb2994ab9820417f2e8 P 770cf1ff89494e54baba82d84dac5831 -> Peer e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331): Couldn't send request to peer e1ee21679c764758a302a52b2f954b5b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:13.148102   431 tablet_server.cc:196] TabletServer@127.0.107.193:0 shutdown complete.
W20260709 13:03:13.185724 11292 consensus_peers.cc:597] T 1d3a3c192f1a498cb0c2253625c69f3a P 770cf1ff89494e54baba82d84dac5831 -> Peer e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331): Couldn't send request to peer e1ee21679c764758a302a52b2f954b5b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33331: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:13.218760   431 tablet_server.cc:179] TabletServer@127.0.107.194:0 shutting down...
W20260709 13:03:13.247772 11366 consensus_peers.cc:597] T 97ab0a1ca9a548b69b4af26987138b42 P 244b85b5155e4f58a13b566c50083890 -> Peer e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331): Couldn't send request to peer e1ee21679c764758a302a52b2f954b5b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33331: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:13.289642   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:13.295058   431 tablet_replica.cc:333] T 97ab0a1ca9a548b69b4af26987138b42 P 770cf1ff89494e54baba82d84dac5831: stopping tablet replica
I20260709 13:03:13.296254   431 raft_consensus.cc:2243] T 97ab0a1ca9a548b69b4af26987138b42 P 770cf1ff89494e54baba82d84dac5831 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.297017   431 raft_consensus.cc:2272] T 97ab0a1ca9a548b69b4af26987138b42 P 770cf1ff89494e54baba82d84dac5831 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:13.297389 11366 consensus_peers.cc:597] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 244b85b5155e4f58a13b566c50083890 -> Peer 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205): Couldn't send request to peer 770cf1ff89494e54baba82d84dac5831. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:13.301995   431 tablet_replica.cc:333] T 676042afc21b4ff5b2f7146544765db1 P 770cf1ff89494e54baba82d84dac5831: stopping tablet replica
I20260709 13:03:13.303018   431 raft_consensus.cc:2243] T 676042afc21b4ff5b2f7146544765db1 P 770cf1ff89494e54baba82d84dac5831 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.303710   431 raft_consensus.cc:2272] T 676042afc21b4ff5b2f7146544765db1 P 770cf1ff89494e54baba82d84dac5831 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:13.305406 11366 consensus_peers.cc:597] T 97ab0a1ca9a548b69b4af26987138b42 P 244b85b5155e4f58a13b566c50083890 -> Peer 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205): Couldn't send request to peer 770cf1ff89494e54baba82d84dac5831. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:13.307269   431 tablet_replica.cc:333] T b0d7238307174b48aa91030413f37fea P 770cf1ff89494e54baba82d84dac5831: stopping tablet replica
I20260709 13:03:13.308224   431 raft_consensus.cc:2243] T b0d7238307174b48aa91030413f37fea P 770cf1ff89494e54baba82d84dac5831 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.309187   431 raft_consensus.cc:2272] T b0d7238307174b48aa91030413f37fea P 770cf1ff89494e54baba82d84dac5831 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.311808   431 tablet_replica.cc:333] T 59c4fef046b94123b15bb064ae4bacc5 P 770cf1ff89494e54baba82d84dac5831: stopping tablet replica
I20260709 13:03:13.312510   431 raft_consensus.cc:2243] T 59c4fef046b94123b15bb064ae4bacc5 P 770cf1ff89494e54baba82d84dac5831 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.313174   431 raft_consensus.cc:2272] T 59c4fef046b94123b15bb064ae4bacc5 P 770cf1ff89494e54baba82d84dac5831 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.316254   431 tablet_replica.cc:333] T 5efc9b8718b0461f95bd09f4b67f1197 P 770cf1ff89494e54baba82d84dac5831: stopping tablet replica
I20260709 13:03:13.316962   431 raft_consensus.cc:2243] T 5efc9b8718b0461f95bd09f4b67f1197 P 770cf1ff89494e54baba82d84dac5831 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.317561   431 raft_consensus.cc:2272] T 5efc9b8718b0461f95bd09f4b67f1197 P 770cf1ff89494e54baba82d84dac5831 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.320936   431 tablet_replica.cc:333] T 1d3a3c192f1a498cb0c2253625c69f3a P 770cf1ff89494e54baba82d84dac5831: stopping tablet replica
I20260709 13:03:13.321842   431 raft_consensus.cc:2243] T 1d3a3c192f1a498cb0c2253625c69f3a P 770cf1ff89494e54baba82d84dac5831 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.322992   431 raft_consensus.cc:2272] T 1d3a3c192f1a498cb0c2253625c69f3a P 770cf1ff89494e54baba82d84dac5831 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.326539   431 tablet_replica.cc:333] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 770cf1ff89494e54baba82d84dac5831: stopping tablet replica
I20260709 13:03:13.327548   431 raft_consensus.cc:2243] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 770cf1ff89494e54baba82d84dac5831 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.328145   431 raft_consensus.cc:2272] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 770cf1ff89494e54baba82d84dac5831 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.331707   431 tablet_replica.cc:333] T 2893484e7ace4fd4af892dc3aa82998b P 770cf1ff89494e54baba82d84dac5831: stopping tablet replica
I20260709 13:03:13.332650   431 raft_consensus.cc:2243] T 2893484e7ace4fd4af892dc3aa82998b P 770cf1ff89494e54baba82d84dac5831 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.333845   431 raft_consensus.cc:2272] T 2893484e7ace4fd4af892dc3aa82998b P 770cf1ff89494e54baba82d84dac5831 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.336977   431 tablet_replica.cc:333] T ae318533d2c141c9bef5b69d44f64d90 P 770cf1ff89494e54baba82d84dac5831: stopping tablet replica
I20260709 13:03:13.337869   431 raft_consensus.cc:2243] T ae318533d2c141c9bef5b69d44f64d90 P 770cf1ff89494e54baba82d84dac5831 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.338883   431 raft_consensus.cc:2272] T ae318533d2c141c9bef5b69d44f64d90 P 770cf1ff89494e54baba82d84dac5831 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.342062   431 tablet_replica.cc:333] T b604dfd1da1840b2836273c326d4f269 P 770cf1ff89494e54baba82d84dac5831: stopping tablet replica
I20260709 13:03:13.342871   431 raft_consensus.cc:2243] T b604dfd1da1840b2836273c326d4f269 P 770cf1ff89494e54baba82d84dac5831 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.343448   431 raft_consensus.cc:2272] T b604dfd1da1840b2836273c326d4f269 P 770cf1ff89494e54baba82d84dac5831 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.346276   431 tablet_replica.cc:333] T e5a872d4022c47d4b20da810ceffb01b P 770cf1ff89494e54baba82d84dac5831: stopping tablet replica
I20260709 13:03:13.347267   431 raft_consensus.cc:2243] T e5a872d4022c47d4b20da810ceffb01b P 770cf1ff89494e54baba82d84dac5831 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.347846   431 raft_consensus.cc:2272] T e5a872d4022c47d4b20da810ceffb01b P 770cf1ff89494e54baba82d84dac5831 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.351127   431 tablet_replica.cc:333] T 9ee4855c256940e7819fac4e5d729b0d P 770cf1ff89494e54baba82d84dac5831: stopping tablet replica
I20260709 13:03:13.351830   431 raft_consensus.cc:2243] T 9ee4855c256940e7819fac4e5d729b0d P 770cf1ff89494e54baba82d84dac5831 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.352979   431 raft_consensus.cc:2272] T 9ee4855c256940e7819fac4e5d729b0d P 770cf1ff89494e54baba82d84dac5831 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.355849   431 tablet_replica.cc:333] T 40f440212cf64606bbd7ddbf7bf153af P 770cf1ff89494e54baba82d84dac5831: stopping tablet replica
I20260709 13:03:13.356594   431 raft_consensus.cc:2243] T 40f440212cf64606bbd7ddbf7bf153af P 770cf1ff89494e54baba82d84dac5831 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.357234   431 raft_consensus.cc:2272] T 40f440212cf64606bbd7ddbf7bf153af P 770cf1ff89494e54baba82d84dac5831 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.359895   431 tablet_replica.cc:333] T 2634154f9f364cfea520c15a5ad325ed P 770cf1ff89494e54baba82d84dac5831: stopping tablet replica
I20260709 13:03:13.360670   431 raft_consensus.cc:2243] T 2634154f9f364cfea520c15a5ad325ed P 770cf1ff89494e54baba82d84dac5831 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.361199   431 raft_consensus.cc:2272] T 2634154f9f364cfea520c15a5ad325ed P 770cf1ff89494e54baba82d84dac5831 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.363941   431 tablet_replica.cc:333] T 3c7b44fee55543f58f87877c52ecfb79 P 770cf1ff89494e54baba82d84dac5831: stopping tablet replica
I20260709 13:03:13.364506   431 raft_consensus.cc:2243] T 3c7b44fee55543f58f87877c52ecfb79 P 770cf1ff89494e54baba82d84dac5831 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.365098   431 raft_consensus.cc:2272] T 3c7b44fee55543f58f87877c52ecfb79 P 770cf1ff89494e54baba82d84dac5831 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.367834   431 tablet_replica.cc:333] T a271b64cf17e4bb2994ab9820417f2e8 P 770cf1ff89494e54baba82d84dac5831: stopping tablet replica
I20260709 13:03:13.368453   431 raft_consensus.cc:2243] T a271b64cf17e4bb2994ab9820417f2e8 P 770cf1ff89494e54baba82d84dac5831 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.369441   431 raft_consensus.cc:2272] T a271b64cf17e4bb2994ab9820417f2e8 P 770cf1ff89494e54baba82d84dac5831 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.372151   431 tablet_replica.cc:333] T 564b17319fe141cab611a47bf22f0b76 P 770cf1ff89494e54baba82d84dac5831: stopping tablet replica
I20260709 13:03:13.372808   431 raft_consensus.cc:2243] T 564b17319fe141cab611a47bf22f0b76 P 770cf1ff89494e54baba82d84dac5831 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:13.373760   431 raft_consensus.cc:2272] T 564b17319fe141cab611a47bf22f0b76 P 770cf1ff89494e54baba82d84dac5831 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:13.376715   431 tablet_replica.cc:333] T 90befbbddbe842949771c44d3a3ea4db P 770cf1ff89494e54baba82d84dac5831: stopping tablet replica
I20260709 13:03:13.377378   431 raft_consensus.cc:2243] T 90befbbddbe842949771c44d3a3ea4db P 770cf1ff89494e54baba82d84dac5831 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:13.378001   431 raft_consensus.cc:2272] T 90befbbddbe842949771c44d3a3ea4db P 770cf1ff89494e54baba82d84dac5831 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:13.468590 11366 consensus_peers.cc:597] T b604dfd1da1840b2836273c326d4f269 P 244b85b5155e4f58a13b566c50083890 -> Peer 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205): Couldn't send request to peer 770cf1ff89494e54baba82d84dac5831. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39205: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:03:13.585227 11366 consensus_peers.cc:597] T 5efc9b8718b0461f95bd09f4b67f1197 P 244b85b5155e4f58a13b566c50083890 -> Peer 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205): Couldn't send request to peer 770cf1ff89494e54baba82d84dac5831. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39205: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:03:14.102087 11739 raft_consensus.cc:493] T 59c4fef046b94123b15bb064ae4bacc5 P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e1ee21679c764758a302a52b2f954b5b)
I20260709 13:03:14.102738 11739 raft_consensus.cc:515] T 59c4fef046b94123b15bb064ae4bacc5 P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:14.112167 11739 leader_election.cc:290] T 59c4fef046b94123b15bb064ae4bacc5 P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331), 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205)
W20260709 13:03:14.123868 11366 leader_election.cc:336] T 59c4fef046b94123b15bb064ae4bacc5 P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33331: connect: Connection refused (error 111)
W20260709 13:03:14.124845 11366 leader_election.cc:336] T 59c4fef046b94123b15bb064ae4bacc5 P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39205: connect: Connection refused (error 111)
I20260709 13:03:14.125378 11366 leader_election.cc:304] T 59c4fef046b94123b15bb064ae4bacc5 P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 244b85b5155e4f58a13b566c50083890; no voters: 770cf1ff89494e54baba82d84dac5831, e1ee21679c764758a302a52b2f954b5b
I20260709 13:03:14.126566 11739 raft_consensus.cc:2749] T 59c4fef046b94123b15bb064ae4bacc5 P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:14.155931 11739 raft_consensus.cc:493] T 90befbbddbe842949771c44d3a3ea4db P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e1ee21679c764758a302a52b2f954b5b)
I20260709 13:03:14.156669 11739 raft_consensus.cc:515] T 90befbbddbe842949771c44d3a3ea4db P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:14.159572 11739 leader_election.cc:290] T 90befbbddbe842949771c44d3a3ea4db P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331), 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205)
W20260709 13:03:14.166518 11366 leader_election.cc:336] T 90befbbddbe842949771c44d3a3ea4db P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33331: connect: Connection refused (error 111)
W20260709 13:03:14.167351 11366 leader_election.cc:336] T 90befbbddbe842949771c44d3a3ea4db P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39205: connect: Connection refused (error 111)
I20260709 13:03:14.167842 11366 leader_election.cc:304] T 90befbbddbe842949771c44d3a3ea4db P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 244b85b5155e4f58a13b566c50083890; no voters: 770cf1ff89494e54baba82d84dac5831, e1ee21679c764758a302a52b2f954b5b
I20260709 13:03:14.168761 11739 raft_consensus.cc:2749] T 90befbbddbe842949771c44d3a3ea4db P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:14.227378 11739 raft_consensus.cc:493] T e5a872d4022c47d4b20da810ceffb01b P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e1ee21679c764758a302a52b2f954b5b)
I20260709 13:03:14.228163 11739 raft_consensus.cc:515] T e5a872d4022c47d4b20da810ceffb01b P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:14.231153 11739 leader_election.cc:290] T e5a872d4022c47d4b20da810ceffb01b P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331), 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205)
W20260709 13:03:14.238770 11366 leader_election.cc:336] T e5a872d4022c47d4b20da810ceffb01b P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33331: connect: Connection refused (error 111)
W20260709 13:03:14.239676 11366 leader_election.cc:336] T e5a872d4022c47d4b20da810ceffb01b P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39205: connect: Connection refused (error 111)
I20260709 13:03:14.240228 11366 leader_election.cc:304] T e5a872d4022c47d4b20da810ceffb01b P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 244b85b5155e4f58a13b566c50083890; no voters: 770cf1ff89494e54baba82d84dac5831, e1ee21679c764758a302a52b2f954b5b
I20260709 13:03:14.241644 11739 raft_consensus.cc:2749] T e5a872d4022c47d4b20da810ceffb01b P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:14.279266 11739 raft_consensus.cc:493] T 676042afc21b4ff5b2f7146544765db1 P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e1ee21679c764758a302a52b2f954b5b)
I20260709 13:03:14.280051 11739 raft_consensus.cc:515] T 676042afc21b4ff5b2f7146544765db1 P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:14.283001 11739 leader_election.cc:290] T 676042afc21b4ff5b2f7146544765db1 P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331), 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205)
W20260709 13:03:14.289821 11366 leader_election.cc:336] T 676042afc21b4ff5b2f7146544765db1 P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33331: connect: Connection refused (error 111)
W20260709 13:03:14.290979 11366 leader_election.cc:336] T 676042afc21b4ff5b2f7146544765db1 P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39205: connect: Connection refused (error 111)
I20260709 13:03:14.291484 11366 leader_election.cc:304] T 676042afc21b4ff5b2f7146544765db1 P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 244b85b5155e4f58a13b566c50083890; no voters: 770cf1ff89494e54baba82d84dac5831, e1ee21679c764758a302a52b2f954b5b
I20260709 13:03:14.292331 11739 raft_consensus.cc:2749] T 676042afc21b4ff5b2f7146544765db1 P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:14.326710 11739 raft_consensus.cc:493] T 40f440212cf64606bbd7ddbf7bf153af P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e1ee21679c764758a302a52b2f954b5b)
I20260709 13:03:14.327704 11739 raft_consensus.cc:515] T 40f440212cf64606bbd7ddbf7bf153af P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:14.330426 11739 leader_election.cc:290] T 40f440212cf64606bbd7ddbf7bf153af P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331), 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205)
W20260709 13:03:14.340811 11366 leader_election.cc:336] T 40f440212cf64606bbd7ddbf7bf153af P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33331: connect: Connection refused (error 111)
W20260709 13:03:14.341687 11366 leader_election.cc:336] T 40f440212cf64606bbd7ddbf7bf153af P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39205: connect: Connection refused (error 111)
I20260709 13:03:14.342134 11366 leader_election.cc:304] T 40f440212cf64606bbd7ddbf7bf153af P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 244b85b5155e4f58a13b566c50083890; no voters: 770cf1ff89494e54baba82d84dac5831, e1ee21679c764758a302a52b2f954b5b
I20260709 13:03:14.343205 11739 raft_consensus.cc:2749] T 40f440212cf64606bbd7ddbf7bf153af P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:14.346433 11739 raft_consensus.cc:493] T 2893484e7ace4fd4af892dc3aa82998b P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 770cf1ff89494e54baba82d84dac5831)
I20260709 13:03:14.347321 11739 raft_consensus.cc:515] T 2893484e7ace4fd4af892dc3aa82998b P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:14.350477 11739 leader_election.cc:290] T 2893484e7ace4fd4af892dc3aa82998b P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331), 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205)
I20260709 13:03:14.357117 11739 raft_consensus.cc:493] T 2634154f9f364cfea520c15a5ad325ed P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e1ee21679c764758a302a52b2f954b5b)
I20260709 13:03:14.358021 11739 raft_consensus.cc:515] T 2634154f9f364cfea520c15a5ad325ed P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
W20260709 13:03:14.358722 11366 leader_election.cc:336] T 2893484e7ace4fd4af892dc3aa82998b P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33331: connect: Connection refused (error 111)
W20260709 13:03:14.359620 11366 leader_election.cc:336] T 2893484e7ace4fd4af892dc3aa82998b P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39205: connect: Connection refused (error 111)
I20260709 13:03:14.361049 11739 leader_election.cc:290] T 2634154f9f364cfea520c15a5ad325ed P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331), 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205)
I20260709 13:03:14.360070 11366 leader_election.cc:304] T 2893484e7ace4fd4af892dc3aa82998b P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 244b85b5155e4f58a13b566c50083890; no voters: 770cf1ff89494e54baba82d84dac5831, e1ee21679c764758a302a52b2f954b5b
I20260709 13:03:14.362569 11739 raft_consensus.cc:2749] T 2893484e7ace4fd4af892dc3aa82998b P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:03:14.371567 11366 leader_election.cc:336] T 2634154f9f364cfea520c15a5ad325ed P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33331: connect: Connection refused (error 111)
W20260709 13:03:14.372876 11366 leader_election.cc:336] T 2634154f9f364cfea520c15a5ad325ed P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39205: connect: Connection refused (error 111)
I20260709 13:03:14.373322 11366 leader_election.cc:304] T 2634154f9f364cfea520c15a5ad325ed P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 244b85b5155e4f58a13b566c50083890; no voters: 770cf1ff89494e54baba82d84dac5831, e1ee21679c764758a302a52b2f954b5b
I20260709 13:03:14.374142 11739 raft_consensus.cc:2749] T 2634154f9f364cfea520c15a5ad325ed P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:03:14.427309   431 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 11350)
I20260709 13:03:14.444159 11739 raft_consensus.cc:493] T 1d3a3c192f1a498cb0c2253625c69f3a P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 770cf1ff89494e54baba82d84dac5831)
I20260709 13:03:14.444939 11739 raft_consensus.cc:515] T 1d3a3c192f1a498cb0c2253625c69f3a P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:14.447505 11739 leader_election.cc:290] T 1d3a3c192f1a498cb0c2253625c69f3a P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331), 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205)
W20260709 13:03:14.454538 11366 leader_election.cc:336] T 1d3a3c192f1a498cb0c2253625c69f3a P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33331: connect: Connection refused (error 111)
W20260709 13:03:14.457376 11366 leader_election.cc:336] T 1d3a3c192f1a498cb0c2253625c69f3a P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39205: connect: Connection refused (error 111)
I20260709 13:03:14.457916 11366 leader_election.cc:304] T 1d3a3c192f1a498cb0c2253625c69f3a P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 244b85b5155e4f58a13b566c50083890; no voters: 770cf1ff89494e54baba82d84dac5831, e1ee21679c764758a302a52b2f954b5b
I20260709 13:03:14.458765 11739 raft_consensus.cc:2749] T 1d3a3c192f1a498cb0c2253625c69f3a P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:14.507339 11739 raft_consensus.cc:493] T 3c7b44fee55543f58f87877c52ecfb79 P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e1ee21679c764758a302a52b2f954b5b)
I20260709 13:03:14.508173 11739 raft_consensus.cc:515] T 3c7b44fee55543f58f87877c52ecfb79 P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:14.511175 11739 leader_election.cc:290] T 3c7b44fee55543f58f87877c52ecfb79 P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331), 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205)
W20260709 13:03:14.517748 11366 leader_election.cc:336] T 3c7b44fee55543f58f87877c52ecfb79 P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33331: connect: Connection refused (error 111)
W20260709 13:03:14.519068 11366 leader_election.cc:336] T 3c7b44fee55543f58f87877c52ecfb79 P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39205: connect: Connection refused (error 111)
I20260709 13:03:14.519565 11366 leader_election.cc:304] T 3c7b44fee55543f58f87877c52ecfb79 P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 244b85b5155e4f58a13b566c50083890; no voters: 770cf1ff89494e54baba82d84dac5831, e1ee21679c764758a302a52b2f954b5b
I20260709 13:03:14.520474 11739 raft_consensus.cc:2749] T 3c7b44fee55543f58f87877c52ecfb79 P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:14.538360 11739 raft_consensus.cc:493] T a271b64cf17e4bb2994ab9820417f2e8 P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 770cf1ff89494e54baba82d84dac5831)
I20260709 13:03:14.539492 11739 raft_consensus.cc:515] T a271b64cf17e4bb2994ab9820417f2e8 P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:14.542691 11739 leader_election.cc:290] T a271b64cf17e4bb2994ab9820417f2e8 P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331), 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205)
W20260709 13:03:14.552870 11366 leader_election.cc:336] T a271b64cf17e4bb2994ab9820417f2e8 P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33331: connect: Connection refused (error 111)
W20260709 13:03:14.553678 11366 leader_election.cc:336] T a271b64cf17e4bb2994ab9820417f2e8 P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39205: connect: Connection refused (error 111)
I20260709 13:03:14.554123 11366 leader_election.cc:304] T a271b64cf17e4bb2994ab9820417f2e8 P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 244b85b5155e4f58a13b566c50083890; no voters: 770cf1ff89494e54baba82d84dac5831, e1ee21679c764758a302a52b2f954b5b
I20260709 13:03:14.555418 11739 raft_consensus.cc:2749] T a271b64cf17e4bb2994ab9820417f2e8 P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:14.582828 11739 raft_consensus.cc:493] T 564b17319fe141cab611a47bf22f0b76 P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 770cf1ff89494e54baba82d84dac5831)
I20260709 13:03:14.583608 11739 raft_consensus.cc:515] T 564b17319fe141cab611a47bf22f0b76 P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:14.586349 11739 leader_election.cc:290] T 564b17319fe141cab611a47bf22f0b76 P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331), 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205)
W20260709 13:03:14.592953 11366 leader_election.cc:336] T 564b17319fe141cab611a47bf22f0b76 P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33331: connect: Connection refused (error 111)
W20260709 13:03:14.593722 11366 leader_election.cc:336] T 564b17319fe141cab611a47bf22f0b76 P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39205: connect: Connection refused (error 111)
I20260709 13:03:14.594159 11366 leader_election.cc:304] T 564b17319fe141cab611a47bf22f0b76 P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 244b85b5155e4f58a13b566c50083890; no voters: 770cf1ff89494e54baba82d84dac5831, e1ee21679c764758a302a52b2f954b5b
I20260709 13:03:14.595029 11739 raft_consensus.cc:2749] T 564b17319fe141cab611a47bf22f0b76 P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:03:14.673007 11739 raft_consensus.cc:493] T 9ee4855c256940e7819fac4e5d729b0d P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 770cf1ff89494e54baba82d84dac5831)
I20260709 13:03:14.673833 11739 raft_consensus.cc:515] T 9ee4855c256940e7819fac4e5d729b0d P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:14.676426 11739 leader_election.cc:290] T 9ee4855c256940e7819fac4e5d729b0d P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331), 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205)
W20260709 13:03:14.684804 11366 leader_election.cc:336] T 9ee4855c256940e7819fac4e5d729b0d P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33331: connect: Connection refused (error 111)
W20260709 13:03:14.686009 11366 leader_election.cc:336] T 9ee4855c256940e7819fac4e5d729b0d P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39205: connect: Connection refused (error 111)
I20260709 13:03:14.686523 11366 leader_election.cc:304] T 9ee4855c256940e7819fac4e5d729b0d P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 244b85b5155e4f58a13b566c50083890; no voters: 770cf1ff89494e54baba82d84dac5831, e1ee21679c764758a302a52b2f954b5b
I20260709 13:03:14.687402 11739 raft_consensus.cc:2749] T 9ee4855c256940e7819fac4e5d729b0d P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:14.793658 11739 raft_consensus.cc:493] T b0d7238307174b48aa91030413f37fea P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 770cf1ff89494e54baba82d84dac5831)
I20260709 13:03:14.794392 11739 raft_consensus.cc:515] T b0d7238307174b48aa91030413f37fea P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:14.797153 11739 leader_election.cc:290] T b0d7238307174b48aa91030413f37fea P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331), 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205)
W20260709 13:03:14.804625 11366 leader_election.cc:336] T b0d7238307174b48aa91030413f37fea P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33331: connect: Connection refused (error 111)
W20260709 13:03:14.805548 11366 leader_election.cc:336] T b0d7238307174b48aa91030413f37fea P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39205: connect: Connection refused (error 111)
I20260709 13:03:14.806041 11366 leader_election.cc:304] T b0d7238307174b48aa91030413f37fea P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 244b85b5155e4f58a13b566c50083890; no voters: 770cf1ff89494e54baba82d84dac5831, e1ee21679c764758a302a52b2f954b5b
I20260709 13:03:14.806984 11739 raft_consensus.cc:2749] T b0d7238307174b48aa91030413f37fea P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:03:14.829783 11739 raft_consensus.cc:493] T ae318533d2c141c9bef5b69d44f64d90 P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 770cf1ff89494e54baba82d84dac5831)
I20260709 13:03:14.830552 11739 raft_consensus.cc:515] T ae318533d2c141c9bef5b69d44f64d90 P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1ee21679c764758a302a52b2f954b5b" member_type: VOTER last_known_addr { host: "127.0.107.193" port: 33331 } } peers { permanent_uuid: "770cf1ff89494e54baba82d84dac5831" member_type: VOTER last_known_addr { host: "127.0.107.194" port: 39205 } } peers { permanent_uuid: "244b85b5155e4f58a13b566c50083890" member_type: VOTER last_known_addr { host: "127.0.107.195" port: 34445 } }
I20260709 13:03:14.833218 11739 leader_election.cc:290] T ae318533d2c141c9bef5b69d44f64d90 P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331), 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205)
W20260709 13:03:14.840742 11366 leader_election.cc:336] T ae318533d2c141c9bef5b69d44f64d90 P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331): Network error: Client connection negotiation failed: client connection to 127.0.107.193:33331: connect: Connection refused (error 111)
W20260709 13:03:14.841915 11366 leader_election.cc:336] T ae318533d2c141c9bef5b69d44f64d90 P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205): Network error: Client connection negotiation failed: client connection to 127.0.107.194:39205: connect: Connection refused (error 111)
I20260709 13:03:14.842409 11366 leader_election.cc:304] T ae318533d2c141c9bef5b69d44f64d90 P 244b85b5155e4f58a13b566c50083890 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 244b85b5155e4f58a13b566c50083890; no voters: 770cf1ff89494e54baba82d84dac5831, e1ee21679c764758a302a52b2f954b5b
I20260709 13:03:14.843281 11739 raft_consensus.cc:2749] T ae318533d2c141c9bef5b69d44f64d90 P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:03:15.425642 11366 consensus_peers.cc:597] T b604dfd1da1840b2836273c326d4f269 P 244b85b5155e4f58a13b566c50083890 -> Peer e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331): Couldn't send request to peer e1ee21679c764758a302a52b2f954b5b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:15.426245 11366 consensus_peers.cc:597] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 244b85b5155e4f58a13b566c50083890 -> Peer e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331): Couldn't send request to peer e1ee21679c764758a302a52b2f954b5b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:03:15.427893   431 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 11350)
W20260709 13:03:15.452131 11366 consensus_peers.cc:597] T b604dfd1da1840b2836273c326d4f269 P 244b85b5155e4f58a13b566c50083890 -> Peer 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205): Couldn't send request to peer 770cf1ff89494e54baba82d84dac5831. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39205: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:15.482508   431 tablet_server.cc:196] TabletServer@127.0.107.194:0 shutdown complete.
W20260709 13:03:15.517009 11366 consensus_peers.cc:597] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 244b85b5155e4f58a13b566c50083890 -> Peer 770cf1ff89494e54baba82d84dac5831 (127.0.107.194:39205): Couldn't send request to peer 770cf1ff89494e54baba82d84dac5831. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.194:39205: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:15.526655   431 tablet_server.cc:179] TabletServer@127.0.107.195:0 shutting down...
I20260709 13:03:15.574648   431 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:03:15.625887   431 tablet_replica.cc:333] T 97ab0a1ca9a548b69b4af26987138b42 P 244b85b5155e4f58a13b566c50083890: stopping tablet replica
I20260709 13:03:15.626989   431 raft_consensus.cc:2243] T 97ab0a1ca9a548b69b4af26987138b42 P 244b85b5155e4f58a13b566c50083890 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:15.628259   431 raft_consensus.cc:2272] T 97ab0a1ca9a548b69b4af26987138b42 P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:15.631560   431 tablet_replica.cc:333] T b0d7238307174b48aa91030413f37fea P 244b85b5155e4f58a13b566c50083890: stopping tablet replica
I20260709 13:03:15.632146   431 raft_consensus.cc:2243] T b0d7238307174b48aa91030413f37fea P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:15.632804   431 raft_consensus.cc:2272] T b0d7238307174b48aa91030413f37fea P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:15.637037   431 tablet_replica.cc:333] T 59c4fef046b94123b15bb064ae4bacc5 P 244b85b5155e4f58a13b566c50083890: stopping tablet replica
I20260709 13:03:15.705845   431 raft_consensus.cc:2243] T 59c4fef046b94123b15bb064ae4bacc5 P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:15.706593   431 raft_consensus.cc:2272] T 59c4fef046b94123b15bb064ae4bacc5 P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:15.710096   431 tablet_replica.cc:333] T 9ee4855c256940e7819fac4e5d729b0d P 244b85b5155e4f58a13b566c50083890: stopping tablet replica
I20260709 13:03:15.726039   431 raft_consensus.cc:2243] T 9ee4855c256940e7819fac4e5d729b0d P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:15.737564   431 raft_consensus.cc:2272] T 9ee4855c256940e7819fac4e5d729b0d P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:03:15.742897 11366 consensus_peers.cc:597] T 5efc9b8718b0461f95bd09f4b67f1197 P 244b85b5155e4f58a13b566c50083890 -> Peer e1ee21679c764758a302a52b2f954b5b (127.0.107.193:33331): Couldn't send request to peer e1ee21679c764758a302a52b2f954b5b. Status: Network error: Client connection negotiation failed: client connection to 127.0.107.193:33331: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:03:15.767045   431 tablet_replica.cc:333] T 40f440212cf64606bbd7ddbf7bf153af P 244b85b5155e4f58a13b566c50083890: stopping tablet replica
I20260709 13:03:15.768587   431 raft_consensus.cc:2243] T 40f440212cf64606bbd7ddbf7bf153af P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:15.769332   431 raft_consensus.cc:2272] T 40f440212cf64606bbd7ddbf7bf153af P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:15.772758   431 tablet_replica.cc:333] T 676042afc21b4ff5b2f7146544765db1 P 244b85b5155e4f58a13b566c50083890: stopping tablet replica
I20260709 13:03:15.773551   431 raft_consensus.cc:2243] T 676042afc21b4ff5b2f7146544765db1 P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:15.774181   431 raft_consensus.cc:2272] T 676042afc21b4ff5b2f7146544765db1 P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:15.777786   431 tablet_replica.cc:333] T e5a872d4022c47d4b20da810ceffb01b P 244b85b5155e4f58a13b566c50083890: stopping tablet replica
I20260709 13:03:15.778697   431 raft_consensus.cc:2243] T e5a872d4022c47d4b20da810ceffb01b P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:15.779335   431 raft_consensus.cc:2272] T e5a872d4022c47d4b20da810ceffb01b P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:15.784147   431 tablet_replica.cc:333] T ae318533d2c141c9bef5b69d44f64d90 P 244b85b5155e4f58a13b566c50083890: stopping tablet replica
I20260709 13:03:15.785568   431 raft_consensus.cc:2243] T ae318533d2c141c9bef5b69d44f64d90 P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:15.786561   431 raft_consensus.cc:2272] T ae318533d2c141c9bef5b69d44f64d90 P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:15.790624   431 tablet_replica.cc:333] T 2893484e7ace4fd4af892dc3aa82998b P 244b85b5155e4f58a13b566c50083890: stopping tablet replica
I20260709 13:03:15.792076   431 raft_consensus.cc:2243] T 2893484e7ace4fd4af892dc3aa82998b P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:15.792928   431 raft_consensus.cc:2272] T 2893484e7ace4fd4af892dc3aa82998b P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:15.797425   431 tablet_replica.cc:333] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 244b85b5155e4f58a13b566c50083890: stopping tablet replica
I20260709 13:03:15.798271   431 raft_consensus.cc:2243] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 244b85b5155e4f58a13b566c50083890 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:03:15.799525   431 raft_consensus.cc:2272] T 560d3cdf923a4ab1b6d9f0747f8c40bf P 244b85b5155e4f58a13b566c50083890 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:15.803995   431 tablet_replica.cc:333] T a271b64cf17e4bb2994ab9820417f2e8 P 244b85b5155e4f58a13b566c50083890: stopping tablet replica
I20260709 13:03:15.805119   431 raft_consensus.cc:2243] T a271b64cf17e4bb2994ab9820417f2e8 P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:15.805923   431 raft_consensus.cc:2272] T a271b64cf17e4bb2994ab9820417f2e8 P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:15.809384   431 tablet_replica.cc:333] T 564b17319fe141cab611a47bf22f0b76 P 244b85b5155e4f58a13b566c50083890: stopping tablet replica
I20260709 13:03:15.810370   431 raft_consensus.cc:2243] T 564b17319fe141cab611a47bf22f0b76 P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:15.811046   431 raft_consensus.cc:2272] T 564b17319fe141cab611a47bf22f0b76 P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:15.814815   431 tablet_replica.cc:333] T 2634154f9f364cfea520c15a5ad325ed P 244b85b5155e4f58a13b566c50083890: stopping tablet replica
I20260709 13:03:15.815841   431 raft_consensus.cc:2243] T 2634154f9f364cfea520c15a5ad325ed P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:15.816771   431 raft_consensus.cc:2272] T 2634154f9f364cfea520c15a5ad325ed P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:15.819707   431 tablet_replica.cc:333] T 3c7b44fee55543f58f87877c52ecfb79 P 244b85b5155e4f58a13b566c50083890: stopping tablet replica
I20260709 13:03:15.820770   431 raft_consensus.cc:2243] T 3c7b44fee55543f58f87877c52ecfb79 P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:15.821533   431 raft_consensus.cc:2272] T 3c7b44fee55543f58f87877c52ecfb79 P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:15.824663   431 tablet_replica.cc:333] T 1d3a3c192f1a498cb0c2253625c69f3a P 244b85b5155e4f58a13b566c50083890: stopping tablet replica
I20260709 13:03:15.827610   431 raft_consensus.cc:2243] T 1d3a3c192f1a498cb0c2253625c69f3a P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:15.828310   431 raft_consensus.cc:2272] T 1d3a3c192f1a498cb0c2253625c69f3a P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:15.831027   431 tablet_replica.cc:333] T 5efc9b8718b0461f95bd09f4b67f1197 P 244b85b5155e4f58a13b566c50083890: stopping tablet replica
I20260709 13:03:15.831864   431 raft_consensus.cc:2243] T 5efc9b8718b0461f95bd09f4b67f1197 P 244b85b5155e4f58a13b566c50083890 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:03:15.833077   431 raft_consensus.cc:2272] T 5efc9b8718b0461f95bd09f4b67f1197 P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:15.835444   431 tablet_replica.cc:333] T b604dfd1da1840b2836273c326d4f269 P 244b85b5155e4f58a13b566c50083890: stopping tablet replica
I20260709 13:03:15.835927   431 raft_consensus.cc:2243] T b604dfd1da1840b2836273c326d4f269 P 244b85b5155e4f58a13b566c50083890 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:15.836865   431 raft_consensus.cc:2272] T b604dfd1da1840b2836273c326d4f269 P 244b85b5155e4f58a13b566c50083890 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:15.839298   431 tablet_replica.cc:333] T 90befbbddbe842949771c44d3a3ea4db P 244b85b5155e4f58a13b566c50083890: stopping tablet replica
I20260709 13:03:15.839810   431 raft_consensus.cc:2243] T 90befbbddbe842949771c44d3a3ea4db P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:03:15.840257   431 raft_consensus.cc:2272] T 90befbbddbe842949771c44d3a3ea4db P 244b85b5155e4f58a13b566c50083890 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:15.883391   431 tablet_server.cc:196] TabletServer@127.0.107.195:0 shutdown complete.
I20260709 13:03:15.920893   431 master.cc:562] Master@127.0.107.254:43089 shutting down...
I20260709 13:03:15.945777   431 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 232d656f14734e1592f736d056eb3fc3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:03:15.946432   431 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 232d656f14734e1592f736d056eb3fc3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:03:15.946803   431 tablet_replica.cc:333] T 00000000000000000000000000000000 P 232d656f14734e1592f736d056eb3fc3: stopping tablet replica
W20260709 13:03:16.794203 11183 debug-util.cc:398] Leaking SignalData structure 0x7b0800214200 after lost signal to thread 434
W20260709 13:03:16.795372 11183 debug-util.cc:398] Leaking SignalData structure 0x7b08002153a0 after lost signal to thread 11186
W20260709 13:03:16.795943 11183 debug-util.cc:398] Leaking SignalData structure 0x7b08003cefe0 after lost signal to thread 11427
W20260709 13:03:16.964248   431 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 11183)
I20260709 13:03:17.079280   431 master.cc:584] Master@127.0.107.254:43089 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (16441 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (32044 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (327743 ms total)
[  PASSED  ] 8 tests.
I20260709 13:03:17.151304   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 680 messages since previous log ~518 seconds ago
I20260709 13:03:17.151589   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 680 messages since previous log ~518 seconds ago
I20260709 13:03:17.151808   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 675 messages since previous log ~518 seconds ago
I20260709 13:03:17.152112   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~40 seconds ago
I20260709 13:03:17.152292   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~40 seconds ago
I20260709 13:03:17.152854   431 logging.cc:436] LogThrottler Service Queue Overflow: suppressed but not reported on 1 messages since previous log ~194 seconds ago
I20260709 13:03:17.153028   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/service_pool.cc:136: suppressed but not reported on 1 messages since previous log ~194 seconds ago
I20260709 13:03:17.153242   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 6 messages since previous log ~149 seconds ago
I20260709 13:03:17.153543   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 80 messages since previous log ~4 seconds ago
I20260709 13:03:17.153869   431 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~15 seconds ago
